An AR-based Worker Support System for Human-Robot Collaboration

Liu, Hongyi; Wang, Lihui

doi:10.1016/j.promfg.2017.07.124

Cited by 54 publications

(32 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Fig. 34 shows the system architecture of one AR-based in-situ decision-support system [134], consisting of four sub-systems: AR-based instruction system, task sequence planning & replanning system, worker monitoring system, and industrial robot control system. The AR-based instruction system is responsible for in-situ support to workers by receiving and delivering assembly instructions in the HRC context.…”

Section: Ar-based In-situ Decision Supportmentioning

confidence: 99%

Symbiotic human-robot collaborative assembly

et al. 2019

View full text Add to dashboard Cite

In human-robot collaborative assembly, robots are often required to dynamically change their pre-planned tasks to collaborate with human operators in a shared workspace. However, the robots used today are controlled by pre-generated rigid codes that cannot support effective human-robot collaboration. In response to this need, multi-modal yet symbiotic communication and control methods have been a focus in recent years. These methods include voice processing, gesture recognition, haptic interaction, and brainwave perception. Deep learning is used for classification, recognition and context awareness identification. Within this context, this keynote provides an overview of symbiotic human-robot collaborative assembly and highlights future research directions.

show abstract

Section: Ar-based In-situ Decision Supportmentioning

confidence: 99%

Symbiotic human-robot collaborative assembly

et al. 2019

View full text Add to dashboard Cite

show abstract

“…Smart glasses can also be used after basic training for quality control of the assembly process. An AR-based worker support system for human-robot collaboration is described in H. Liu and Wang (2017).…”

Section: Background and Literature Reviewmentioning

confidence: 99%

The Digitization of Quality Control Operations with Cloud Platform Computing Technologies

Židek

Modrák

Piteľ

et al. 2020

Industry 4.0 for SMEs

View full text Add to dashboard Cite

“…The images of the robot motion are overlaid on the images of the real robot in a handheld device. The AR-based worker support system was introduced in [21]. The instruction to assembly some parts using tools and a robot are indicated by overlaid texts or holography though an AR device for performing the cooperative assembly operations by a human and a robot.…”

Section: Related Researchmentioning

confidence: 99%

“…In recent years, immersive VR display devices such as Oculus Rift (Oculus VR), augmented reality (AR) display devices such as HoloLens (Microsoft), or smart glasses with screens such as Epson Moverio, are beginning to be used in human-robot interaction [16][17][18], knowledge transfer [19], and human-robot collaborative manufacturing [20,21]. Most of VR display devices are immersivetype and need to attach cameras if a user wants to see a real scene.…”

Section: Introductionmentioning

confidence: 99%

Near-future perception system: Previewed Reality

et al. 2020

View full text Add to dashboard Cite

The present paper introduces a near-future perception system called Previewed Reality. In a coexistence environment of a human and a robot, unexpected collisions between the human and the robot must be avoided to the extent possible. In many cases, the robot is controlled carefully so as not to collide with a human. However, it is almost impossible to perfectly predict human behavior in advance. On the other hand, if a user can determine the motion of a robot in advance, he/she can avoid a hazardous situation and exist safely with the robot. In order to ensure that a user perceives future events naturally, we developed a near-future perception system named Previewed Reality. Previewed Reality consists of an informationally structured environment, a VR display or an AR display, and a dynamics simulator. A number of sensors are embedded in an informationally structured environment, and information such as the position of furniture, objects, humans, and robots, is sensed and stored structurally in a database. Therefore, we can forecast possible subsequent events using a robot motion planner and a dynamics simulator and can synthesize virtual images from the viewpoint of the user, which will actually occur in the near future. The viewpoint of the user, which is the position and orientation of a VR display or an AR display, is also tracked by an optical tracking system in the informationally structured environment, or the SLAM technique on an AR display. The synthesized images are presented to the user by overlaying these images on a real scene using the VR display or the AR display. This system provides human-friendly communication between a human and a robotic system, and a human and a robot can coexist safely by intuitively showing the human possible hazardous situations in advance.

show abstract

An AR-based Worker Support System for Human-Robot Collaboration

Cited by 54 publications

References 18 publications

Symbiotic human-robot collaborative assembly

Symbiotic human-robot collaborative assembly

The Digitization of Quality Control Operations with Cloud Platform Computing Technologies

Near-future perception system: Previewed Reality

Contact Info

Product

Resources

About