Use of projector based augmented reality to improve manual spot-welding precision and accuracy for automotive manufacturing

Abstract

This paper presents the use of a projector-based spatial augmented reality system in an industrial quality assurance setting to highlight spot-weld locations on vehicle panels for manual welding operators. The aim of this work is to improve the precision and accuracy of manual spot-weld placements with the aid of visual cues as a proactive step by the automotive manufacturer to enhance product quality. The prototype system was deployed at General Motors (GM) Holden plant in Elizabeth, Australia on the production line building Holden Cruze vehicles. Production trials were conducted and techniques developed to analyse and validate the precision and accuracy of spot-welds both with and without the visual cues. A reduction of 52 % of the standard deviation of manual spot-weld placement was observed when using augmented reality visual cues. The average standard deviation with-AR assistance (19 panels and 114 spot-welds) was calculated at 1.94 mm compared to without-AR (45 panels and 270 spot-welds) at 4.08 mm. All welds were within the required specification and panels evaluated in this study were used as the final product made available to consumers. The visual cues enabled operators to spot-weld at a higher degree of precision and accuracy.

Augmented reality technology in the manufacturing industry: A review of the last decade

“…MAR systems make use of one or more of the following tracking technologies: digital cameras and/or other optical sensors, accelerometers, GPS, gyroscopes, solid state compasses, RFID and wireless sensors (Chatzopoulos et al, 2013). SAR has been applied to enhance the accuracy of automotive manufacturing processes (Doshi et al, 2017). Examples of MAR usage in industry have been proposed by Shaaban et al (2015) for the case of laptop maintenance and Monroy Reyes et al (2016) for the training of students in the use of milling and lathe machines in laboratories.…”

Color refinement using deep neural networks for enhancing color recognition in a projector‐camera system

“…Projector‐camera systems (Figure ) have been extensively used as a hardware configuration for the table top interface for various applications in media art, education, and entertainment as they effectively visualize information in space and allow users to manipulate visual entities intuitively . Applied in augmented reality (AR), the system realizes the projection‐based AR and can visualize relevant information on user's hand and objects …”

“…[1][2][3][4][5][6][7][8] Applied in augmented reality (AR), the system realizes the projection-based AR and can visualize relevant information on user's hand and objects. [9][10][11] In the projector-camera system, user interaction is implemented in many ways. A method using multitouch displays allows users to directly manipulate virtual entities by fingers without using additional devices.…”

Representation of Robots in Matlab

“…Furthermore, it is possible to create multiple objects within the same workspace for research purposes like master-slave control algorithms or kinematic and dynamic simulation of parallel robots, amongst others. A realistic simulation is especially useful for some applications of robotic research, like surgical interventions [5] or virtual reality [6], where the environment and the user perception are relevant.…”