ARssist: augmented reality on a head‐mounted display for the first assistant in robotic surgery

Qian, Long; Deguet, Anton; Kazanzides, Peter

doi:10.1049/htl.2018.5065

Cited by 71 publications

(55 citation statements)

References 37 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…dVRK-XR can enable many research opportunities that integrate surgical robotics and mixed reality. As an example, we developed an augmented reality application for the patient-side assistant in da Vinci surgery [2]. The assistant may need to insert a robotic instrument without knowing the position of the tip before it enters the fieldof-view of the endoscope.…”

Section: Discussionmentioning

confidence: 99%

dVRK-XR: Mixed Reality Extension for da Vinci Research Kit

Qian¹,

Deguet²,

Kazanzides³

2019

The Hamlyn Symposium on Medical Robotics

Self Cite

View full text Add to dashboard Cite

Section: Discussionmentioning

confidence: 99%

dVRK-XR: Mixed Reality Extension for da Vinci Research Kit

Qian¹,

Deguet²,

Kazanzides³

2019

The Hamlyn Symposium on Medical Robotics

Self Cite

View full text Add to dashboard Cite

“…The system utilized an algorithm that identified an object and sent corresponding grasping commands to the upper-limb prosthesis. Qian et al [55] refer to the AR-based framework "ARssist" that consists of a teleoperated robot assistance module and a haptic feedback interface. It can generate visual instructions during minimally invasive surgery.…”

Section: Ar In Medical Roboticsmentioning

confidence: 99%

“…The system renders the 3D models of the endoscope, utilized instruments, and handheld tools inside the patient's body onto the surgeon's view in real-time ( Figure 4a). Furthermore, AR-assisted surgery with the help of projector-camera technology is also gaining momentum [55]. In [56], an AR system was used in rendering the operational area during the urological robot-assisted surgery for "radical prostatectomy".…”

Section: Ar In Medical Roboticsmentioning

confidence: 99%

Augmented Reality for Robotics: A Review

2020

View full text Add to dashboard Cite

Augmented reality (AR) is used to enhance the perception of the real world by integrating virtual objects to an image sequence acquired from various camera technologies. Numerous AR applications in robotics have been developed in recent years. The aim of this paper is to provide an overview of AR research in robotics during the five year period from 2015 to 2019. We classified these works in terms of application areas into four categories: (1) Medical robotics: Robot-Assisted surgery (RAS), prosthetics, rehabilitation, and training systems; (2) Motion planning and control: trajectory generation, robot programming, simulation, and manipulation; (3) Human-robot interaction (HRI): teleoperation, collaborative interfaces, wearable robots, haptic interfaces, brain-computer interfaces (BCIs), and gaming; (4) Multi-agent systems: use of visual feedback to remotely control drones, robot swarms, and robots with shared workspace. Recent developments in AR technology are discussed followed by the challenges met in AR due to issues of camera localization, environment mapping, and registration. We explore AR applications in terms of how AR was integrated and which improvements it introduced to corresponding fields of robotics. In addition, we summarize the major limitations of the presented applications in each category. Finally, we conclude our review with future directions of AR research in robotics. The survey covers over 100 research works published over the last five years.

show abstract

“…The surgeon controls the surgical robot such as DaVinci at the patient side by passing commands and haptic input, ie, the position information through a position sensor. Surgeon side is installed with a tactile monitor for capturing tactile information, a high‐resolution video monitor for viewing patients condition, and a AR assistant device for providing visualization of instruments in the human body . Master controller at surgeon side controls the patient side manipulator, encoders, and force sensors.…”

Section: Case Studiesmentioning

confidence: 99%

Tactile internet and its applications in 5G era: A comprehensive review

Gupta

Tanwar

Tyagi

et al. 2019

Int J Communication

125

View full text Add to dashboard Cite

Over the last few years, communication latency has been a major hurdle for most of the applications deployed in different network domains. During this era, a number of communication protocols and standards were developed and used by the community. However, still, the problem of latency persists keeping in view of the quality of service (QoS) and quality of experience (QoE) for different applications. To mitigate the aforementioned issues, in this paper, we present an in-depth survey of state-of-the art proposals having tactile internet as a backbone for delay mitigation using 5G networks for future ultra-reliable low-latency applications such as Healthcare 4.0, Industry 4.0, virtual reality and augmented reality, and smart education. From the existing proposals, it has been observed that tactile internet can provide interactions between virtual objects to give a feel of real environment with maximum latency of 1 millisecond. Also, this paper highlights the key differences between the tactile internet and Internet of Things in context with 5G revolution. Then open issues and challenges of tactile internet for smart applications are analyzed. Finally, a comparison of existing proposals with respect to various parameters is presented, which allows the end users to select one of the proposals in comparison with its merits over the others. KEYWORDSHealthcare 4.0, Industry 4.0, IoT, latency, reliability, tactile internet, 5G INTRODUCTIONMobile communication allows users to exchange data using smart devices ubiquitously using the mobile internet (MI). MI has millions of connected smart devices irrespective of their locations. It has revolutionized the different segments of industries such as health care, logistics, education, gaming, and transportation for maintaining quality of service (QoS) and quality of experience (QoE) for different applications. Moreover, it provides a device-to-device (D2D) communication, ie, ubiquitous communication for data sharing and communication between devices. This D2D communication coined the new term, the Internet of Things (IoT), 1 which provides the low power devices or equipments to perform specific tasks in the environment where they are deployed. IoT is being used in various smart city applications such as smart lightening, smart parking, waste management, traffic congestion, and forest fire detection. In D2D communication, the mobile devices can share prime or critical information in which a delay of even millisecond can harm the persons life (for example, the information sharing during robotic telesurgery). Existing cellular systems infrastructure is not suitable for such sensitive data sharing because of low data rates and long delay (greater than 20 ms). However, for D2D communications, Int J Commun Syst. 2019;32:e3981.wileyonlinelibrary.com/journal/dac

show abstract

ARssist: augmented reality on a head‐mounted display for the first assistant in robotic surgery

Cited by 71 publications

References 37 publications

dVRK-XR: Mixed Reality Extension for da Vinci Research Kit

dVRK-XR: Mixed Reality Extension for da Vinci Research Kit

Augmented Reality for Robotics: A Review

Tactile internet and its applications in 5G era: A comprehensive review

Contact Info

Product

Resources

About