Digital Twin Based Synchronised Control and Simulation 
Of the Industrial Robotic Cell Using Virtual Reality

Kuts, Vladimir; Otto, Tauno; Tähemaa, Toivo; Bondarenko, Yevhen

doi:10.5604/01.3001.0013.0464

Cited by 82 publications

(56 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The IoRT augmentation comprises of methods, techniques and technologies that are applied to improve the sensing, action, or cognitive abilities of IoRT devices. The concept expands to humans by providing an interactive digital extension of human capabilities (e.g., replication, supplementation) by using IoRT sensing and actuation technologies, AI, fusion and fission of information, AR, VR, and digital twins (Kuts et al, 2019a ) to improve human productivity and capabilities.…”

Section: Enabling Technologiesmentioning

confidence: 99%

Internet of Robotic Things Intelligent Connectivity and Platforms

et al. 2020

View full text Add to dashboard Cite

The Internet of Things (IoT) and Industrial IoT (IIoT) have developed rapidly in the past few years, as both the Internet and "things" have evolved significantly. "Things" now range from simple Radio Frequency Identification (RFID) devices to smart wireless sensors, intelligent wireless sensors and actuators, robotic things, and autonomous vehicles operating in consumer, business, and industrial environments. The emergence of "intelligent things" (static or mobile) in collaborative autonomous fleets requires new architectures, connectivity paradigms, trustworthiness frameworks, and platforms for the integration of applications across different business and industrial domains. These new applications accelerate the development of autonomous system design paradigms and the proliferation of the Internet of Robotic Things (IoRT). In IoRT, collaborative robotic things can communicate with other things, learn autonomously, interact safely with the environment, humans and other things, and gain qualities like self-maintenance, self-awareness, self-healing, and fail-operational behavior. IoRT applications can make use of the individual, collaborative, and collective intelligence of robotic things, as well as information from the infrastructure and operating context to plan, implement and accomplish tasks under different environmental conditions and uncertainties. The continuous, real-time interaction with the environment makes perception, location, communication, cognition, computation, connectivity, propulsion, and integration of federated IoRT and digital platforms important components of new-generation IoRT applications. This paper reviews the taxonomy of the IoRT, emphasizing the IoRT intelligent connectivity, architectures, interoperability, and trustworthiness framework, and surveys the technologies that enable the application of the IoRT across different domains to perform missions more efficiently, productively, and completely. The aim is to provide a novel perspective on the IoRT that involves communication among robotic things and humans and highlights the convergence of several technologies and interactions between different taxonomies used in the literature.

show abstract

Section: Enabling Technologiesmentioning

confidence: 99%

Internet of Robotic Things Intelligent Connectivity and Platforms

et al. 2020

View full text Add to dashboard Cite

show abstract

“…In order to train people in virtual reality with systems that behave realistically, there is the interesting option of combining virtual reality and digital twin technologies [11]. Burghardt in [37] and Kuts in [38] present different methods for programming and controlling robots using virtual reality and digital twins, confirming that this combination facilitates human-robot interactions in terms of collaborative work, telecontrol, and programming.…”

Section: Digital Twins and Robotsmentioning

confidence: 99%

Digital Twin and Virtual Reality Based Methodology for Multi-Robot Manufacturing Cell Commissioning

et al. 2020

View full text Add to dashboard Cite

Intelligent automation, including robotics, is one of the current trends in the manufacturing industry in the context of “Industry 4.0”, where cyber-physical systems control the production at automated or semi-automated factories. Robots are perfect substitutes for a skilled workforce for some repeatable, general, and strategically-important tasks. However, this transformation is not always feasible and immediate, since certain technologies do not provide the required degree of flexibility. The introduction of collaborative robots in the industry permits the combination of the advantages of manual and automated production. In some processes, it is necessary to incorporate robots from different manufacturers, thus the design of these multi-robot systems is crucial to guarantee the maximum quality and efficiency. In this context, this paper presents a novel methodology for process automation design, enhanced implementation, and real-time monitoring in operation based on creating a digital twin of the manufacturing process with an immersive virtual reality interface to be used as a virtual testbed before the physical implementation. Moreover, it can be efficiently used for operator training, real-time monitoring, and feasibility studies of future optimizations. It has been validated in a use case which provides a solution for an assembly manufacturing process.

show abstract

“…Another related work is the digital twin (El Saddik, 2018), which creates a digital replica of the real world, including humans, robot agents, and environments. An application of the digital twin in HRI is the investigation and optimization of the interaction/interface system and the design of robot systems The manufacturing engineering field has recently focused on this technology; consequently, several software systems have been proposed (Bilberg and Malik, 2019;Kuts et al, 2019). However, the main focus of these attempts is the real-time reproduction of the physical world.…”

Section: Multimodal User Interface For Hri In Vrmentioning

confidence: 99%

SIGVerse: A Cloud-Based VR Platform for Research on Multimodal Human-Robot Interaction

Inamura

Mizuchi

2021

Front. Robot. AI

View full text Add to dashboard Cite

Research on Human-Robot Interaction (HRI) requires the substantial consideration of an experimental design, as well as a significant amount of time to practice the subject experiment. Recent technology in virtual reality (VR) can potentially address these time and effort challenges. The significant advantages of VR systems for HRI are: 1) cost reduction, as experimental facilities are not required in a real environment; 2) provision of the same environmental and embodied interaction conditions to test subjects; 3) visualization of arbitrary information and situations that cannot occur in reality, such as playback of past experiences, and 4) ease of access to an immersive and natural interface for robot/avatar teleoperations. Although VR tools with their features have been applied and developed in previous HRI research, all-encompassing tools or frameworks remain unavailable. In particular, the benefits of integration with cloud computing have not been comprehensively considered. Hence, the purpose of this study is to propose a research platform that can comprehensively provide the elements required for HRI research by integrating VR and cloud technologies. To realize a flexible and reusable system, we developed a real-time bridging mechanism between the robot operating system (ROS) and Unity. To confirm the feasibility of the system in a practical HRI scenario, we applied the proposed system to three case studies, including a robot competition named RoboCup@Home. via these case studies, we validated the system’s usefulness and its potential for the development and evaluation of social intelligence via multimodal HRI.

show abstract

Digital Twin Based Synchronised Control and Simulation Of the Industrial Robotic Cell Using Virtual Reality

Cited by 82 publications

References 17 publications

Internet of Robotic Things Intelligent Connectivity and Platforms

Internet of Robotic Things Intelligent Connectivity and Platforms

Digital Twin and Virtual Reality Based Methodology for Multi-Robot Manufacturing Cell Commissioning

SIGVerse: A Cloud-Based VR Platform for Research on Multimodal Human-Robot Interaction

Contact Info

Product

Resources

About