Augmented Reality in assembly processes

With the aim of making assembly workplaces more efficient, Fraunhofer IGD has integrated augmented reality (AR) and machine learning in the development of a system for user-guided fabrication of complex product configurations.

The human operator is guided through the real process of assembly along the CAD specification of a digital product configuration. In addition to overlaying the contours of the relevant CAD model, the system also recognizes the predefined sequence of assembly and provides the worker with direct visual feedback on the correctness of the assembly step as well as the accurate positioning and orientation of a component. This not only ensures a successful outcome to the assembly process, but also enables simultaneous verification against CAD specification.

By using multiple cameras from different perspectives, it can be ensured that the component can be accurately tracked in every orientation despite potential obstructions. The deviation can thus be determined precisely in every direction and provided directly as visual feedback to the worker.

With the AR-based assembly workstation, complex product setups are efficiently supported and simultaneously verified against CAD specification. The system thus replaces the assembly instructions that are still mostly available in a physical format which imposes the difficult task on the human operator of transferring information from 2D assembly instructions to the 3D world. Thanks to an innovative method of remote support, even highly complex assemblies can be carried out quickly and cost-effectively. The subsequent acceptance of the assembly then takes place fully automatically and is immediately verified according to the existing CAD specification.

Related topics