Application of Wearable Devices for Supporting Operators in Human-Robot Cooperative Assembly Tasks

Gkournelos, Christos; Karagiannis, Panagiotis; Kousi, Niki; Michalos, George; Koukas, Spyridon; Makris, Sotiris

doi:10.1016/j.procir.2018.01.019

Cited by 47 publications

(27 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In HRC, the improved phase information can be used for tele-operating robot synchronised with external signals, such as real human walk. A tool for supporting human operators in shared industrial workplaces has also been reported in the form of a software application for wearable devices, such as smartwatches, which provides functionalities for direct interaction with the robot [67]. The results indicate that the approach can significantly enhance the operators' integration in an HRC assembly system.…”

Section: Human-robot Collaborative Assemblymentioning

confidence: 99%

See 1 more Smart Citation

Symbiotic human-robot collaborative assembly

et al. 2019

View full text Add to dashboard Cite

In human-robot collaborative assembly, robots are often required to dynamically change their pre-planned tasks to collaborate with human operators in a shared workspace. However, the robots used today are controlled by pre-generated rigid codes that cannot support effective human-robot collaboration. In response to this need, multi-modal yet symbiotic communication and control methods have been a focus in recent years. These methods include voice processing, gesture recognition, haptic interaction, and brainwave perception. Deep learning is used for classification, recognition and context awareness identification. Within this context, this keynote provides an overview of symbiotic human-robot collaborative assembly and highlights future research directions.

show abstract

Section: Human-robot Collaborative Assemblymentioning

confidence: 99%

“…Another tool reported by Gkournelos et al [67] is to support operators in shared HRC workplaces. The tool was developed in the form of a software application for wearable devices, such as smartwatches in Fig.…”

Section: Ar-based In-situ Decision Supportmentioning

confidence: 99%

Symbiotic human-robot collaborative assembly

et al. 2019

View full text Add to dashboard Cite

show abstract

“…In general, human operators are positive about the use of AR for assembly support [226]. The technology-enhanced operator is a growing field of research, with many other Industry 4.0 KET involved in achieving varied goals: IoT-based human-Cyber Physical Systems for providing feedback to operators working in an intelligent space [72]; reducing big data to smart data to assist people [60]; software robots (softbots) to interface between machines and computer information systems [227]; mobile devices in order to allow dynamic job rotation in multi-variant assembly lines [228]; verbal and visual prompts for assisting workers with intellectual disabilities [229]; wearables for audio commands [230] or detecting potentially hazardous or risky situations [231]; or a combination of many technology-enabled tools [232][233][234].…”

Section: Framework For Operators In Industry 40mentioning

confidence: 99%

Lean Manual Assembly 4.0: A Systematic Review

2020

View full text Add to dashboard Cite

In a demand context of mass customization, shifting towards the mass personalization of products, assembly operations face the trade-off between highly productive automated systems and flexible manual operators. Novel digital technologies—conceptualized as Industry 4.0—suggest the possibility of simultaneously achieving superior productivity and flexibility. This article aims to address how Industry 4.0 technologies could improve the productivity, flexibility and quality of assembly operations. A systematic literature review was carried out, including 234 peer-reviewed articles from 2010–2020. As a result, the analysis was structured addressing four sets of research questions regarding (1) assembly for mass customization; (2) Industry 4.0 and performance evaluation; (3) Lean production as a starting point for smart factories, and (4) the implications of Industry 4.0 for people in assembly operations. It was found that mass customization brings great complexity that needs to be addressed at different levels from a holistic point of view; that Industry 4.0 offers powerful tools to achieve superior productivity and flexibility in assembly; that Lean is a great starting point for implementing such changes; and that people need to be considered central to Assembly 4.0. Developing methodologies for implementing Industry 4.0 to achieve specific business goals remains an open research topic.

show abstract

“…The work developed by Zhu et al [26] presents a deep neural network based on bidirectional LSTM that can recognize the gestures movements of the wrist and fingers of the users, the results show that the system has the potential to use a smartwatch as a remote control. The work of Gkournelos et al [5] proposed a method that allows controlling robots using a smartwatch as a control mechanism.…”

Section: Related Workmentioning

confidence: 99%

WatchControl: A Control for Interactive Movie Using Continuous Gesture Recognition in Smartwatches

Nascimento

Soares

2020

Journal of Information Processing

View full text Add to dashboard Cite

This work proposes the development of a method to allow the use of smartwatch as a control for interactive movies using continuous recognition of gestures in smartwatches. We developed two prototypes to interact with interactive movies. The first one uses gesture recognition on the smartwatch screen. Thus, we created a set of gestures composed of straight lines that represent the actions in the interactive movie. In this prototype, the recognition of gestures is performed by the algorithm of continuous recognition of gestures. In this way, a gesture can be recognized before the user finalizes, and the action is sent quickly to the movie. The second prototype uses a touch of pressure in the smartwatch to control the film. As a study case, we have conducted our user study with the movie "Black Mirror: Bandersnatch", with usability and experience evaluation. A result has shown that the gestures proposed in the method are intuitive and that it has the potential to be used pleasantly and satisfactorily by the users. For 90% of the participants, the use of the smartwatch is more practical and easy to control Netflix compared to the remote control.

show abstract

Application of Wearable Devices for Supporting Operators in Human-Robot Cooperative Assembly Tasks

Cited by 47 publications

References 12 publications

Symbiotic human-robot collaborative assembly

Symbiotic human-robot collaborative assembly

Lean Manual Assembly 4.0: A Systematic Review

WatchControl: A Control for Interactive Movie Using Continuous Gesture Recognition in Smartwatches

Contact Info

Product

Resources

About