Augmented assembly technologies based on 3D bare-hand interaction

Ong, S. K.; Wang, Z.B.

doi:10.1016/j.cirp.2011.03.001

Cited by 77 publications

(35 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The digital twin can be coupled with additional computational intelligence to handle the diversity of autonomous human actions, or provide cognitive support-e.g., real-time scene assessment, revealing hidden aspects via visualisation or other humaninterpretable feedback-assisting humans in their participation in the production process [21] [22]. Fig.…”

Section: Services To Support Symbiotic Hrcmentioning

confidence: 99%

Human–robot collaborative assembly in cyber-physical production: Classification framework and implementation

et al. 2017

View full text Add to dashboard Cite

The production industry is moving towards the next generation of assembly, which is conducted based on safe and reliable robots working in the same workplace alongside with humans. Focusing on assembly tasks, this paper presents a review of human-robot collaboration research and its classification works. Aside from defining key terms and relations, the paper also proposes means of describing human-robot collaboration that can be relied on during detailed elaboration of solutions. A human-robot collaborative assembly system is developed with a novel and comprehensive structure, and a case study is presented to validate the proposed framework.Assembly, man-machine system, human-robot collaboration

show abstract

Section: Services To Support Symbiotic Hrcmentioning

confidence: 99%

Human–robot collaborative assembly in cyber-physical production: Classification framework and implementation

et al. 2017

View full text Add to dashboard Cite

show abstract

“…Some researches have explored assembly with bare-hand interactions using AR NEE, 2013, ONG;WANG, 2011). In these researches, the users manipulate and assemble virtual components, which are projected through a HMD.…”

Section: Ar As a Tool For Assembly Tasksmentioning

confidence: 99%

“…AR has been applied to, e.g., an animated system to improve the construction assembly process ; an experiment focusing on verifying the performance in retaining work memory according to the user gender (HOU; WANG, 2013); assisted interactive manual assembly design systems NEE, 2013, ONG;WANG, 2011); a piping assembly in order to examine physical and cognitive potential of the assemblers (HOU; WANG; TRUIJENS, 2015); a building structure model assembly using wooden blocks in order to teach abstract construction and civil engineering topics in a more practical manner (SHIRAZI; BEHZADAN, 2015). These researches are summarized in Figure 1.…”

Section: Ar As a Tool For Assembly Tasksmentioning

confidence: 99%

Development of an Augmented Reality environment for the assembly of a precast wood-frame wall using the BIM model

2016

View full text Add to dashboard Cite

Abstracthis article presents the development of an Augmented Reality (AR) application to assist in the assembly of a precast wood-frame wall, based on the BIM model of the wall execution sequence. The research study used the Design Science Research approach and its aim was to develop an AR application named "montAR" (version 2.0). This application offers a tutorial that combines a wall model visualized in AR in actual scale, followed by an audio with step-by-step instructions of the assembly process. Its applicability was simulated in a laboratory with the participation of volunteers (architecture and engineering students). Two visualization gadgets were used and compared: smartphones and smart glasses. The potentialities and difficulties of the use of the AR system were assessed through a questionnaire answered by the participants and through direct observation and result analysis by the researchers. The results demonstrated the potential of using AR for precast wall assembly. From a technological innovation perspective, this study emphasizes the potential use of AR as a technology suitable for training and for construction quality control.Keywords: Augmented Reality. Wood-frame. Assembly. Building. Resumo

show abstract

“…Otherwise, the algorithms are inaccurate because of the missing depth information. However, a rough determination of 3D movements for hands with known dimensions still is possible, e.g., see [21]. Due to the fact that finger gesture recognition based on 3D optical motion tracking data is complex (see application for MS Kinect [26]), we choose a novel approach to provide generic gestural interaction.…”

Section: Gesture-based Interactionmentioning

confidence: 99%

“…A possible extension of 2D to 3D gesture interaction through a stereo camera system is mentioned, but not as yet implemented. Other publications of this research group consider a gesturebased definition of complex assembly tasks in an AR application [21,22].…”

Section: Related Workmentioning

confidence: 99%

Spatial Programming for Industrial Robots through Task Demonstration

Lambrecht

Kleinsorge

Rosenstrauch

et al. 2013

International Journal of Advanced Robotic Systems

View full text Add to dashboard Cite

We present an intuitive system for the programming of industrial robots using markerless gesture recognition and mobile augmented reality in terms of programming by demonstration. The approach covers gesture-based task definition and adaption by human demonstration, as well as task evaluation through augmented reality. A 3D motion tracking system and a handheld device establish the basis for the presented spatial programming system. In this publication, we present a prototype toward the programming of an assembly sequence consisting of several pick-and-place tasks. A scene reconstruction provides pose estimation of known objects with the help of the 2D camera of the handheld. Therefore, the programmer is able to define the program through natural bare-hand manipulation of these objects with the help of direct visual feedback in the augmented reality application. The program can be adapted by gestures and transmitted subsequently to an arbitrary industrial robot controller using a unified interface. Finally, we discuss an application of the presented spatial programming approach toward robot-based welding tasks.

show abstract

Augmented assembly technologies based on 3D bare-hand interaction

Cited by 77 publications

References 12 publications

Human–robot collaborative assembly in cyber-physical production: Classification framework and implementation

Human–robot collaborative assembly in cyber-physical production: Classification framework and implementation

Development of an Augmented Reality environment for the assembly of a precast wood-frame wall using the BIM model

Spatial Programming for Industrial Robots through Task Demonstration

Contact Info

Product

Resources

About