Intelligent Laparoscopic Assistant Robot through Surgery Task Model: How to Give Intelligence to Medical Robots

Kwon, Dong‐Soo; Ko, Seong-Young; Kim, Jonathan

doi:10.5772/5249

Cited by 5 publications

(4 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Pandya et al argued that such schemes are reactive and that better results can be obtained with predictive schemes, which incorporate knowledge of the surgery and the surgical phase ( Pandya et al, 2014 ). Examples of such knowledge-based methods are ( Wang et al, 1998 ; Kwon et al, 2008 ; Weede et al, 2011 ; Rivas-Blanco et al, 2014 ; Bihlmaier, 2016 ; Wagner et al, 2021 ). While promising in theory, in practice, the effort to create complete and reliable models for an entire surgery is excessive for current surgical data science systems.…”

Section: Related Workmentioning

confidence: 99%

Robotic Endoscope Control Via Autonomous Instrument Tracking

Gruijthuijsen

García-Peraza-Herrera

Borghesan

et al. 2022

Front. Robot. AI

View full text Add to dashboard Cite

Many keyhole interventions rely on bi-manual handling of surgical instruments, forcing the main surgeon to rely on a second surgeon to act as a camera assistant. In addition to the burden of excessively involving surgical staff, this may lead to reduced image stability, increased task completion time and sometimes errors due to the monotony of the task. Robotic endoscope holders, controlled by a set of basic instructions, have been proposed as an alternative, but their unnatural handling may increase the cognitive load of the (solo) surgeon, which hinders their clinical acceptance. More seamless integration in the surgical workflow would be achieved if robotic endoscope holders collaborated with the operating surgeon via semantically rich instructions that closely resemble instructions that would otherwise be issued to a human camera assistant, such as “focus on my right-hand instrument.” As a proof of concept, this paper presents a novel system that paves the way towards a synergistic interaction between surgeons and robotic endoscope holders. The proposed platform allows the surgeon to perform a bimanual coordination and navigation task, while a robotic arm autonomously performs the endoscope positioning tasks. Within our system, we propose a novel tooltip localization method based on surgical tool segmentation and a novel visual servoing approach that ensures smooth and appropriate motion of the endoscope camera. We validate our vision pipeline and run a user study of this system. The clinical relevance of the study is ensured through the use of a laparoscopic exercise validated by the European Academy of Gynaecological Surgery which involves bi-manual coordination and navigation. Successful application of our proposed system provides a promising starting point towards broader clinical adoption of robotic endoscope holders.

show abstract

Section: Related Workmentioning

confidence: 99%

Robotic Endoscope Control Via Autonomous Instrument Tracking

Gruijthuijsen

García-Peraza-Herrera

Borghesan

et al. 2022

Front. Robot. AI

View full text Add to dashboard Cite

show abstract

“…Furthermore, supervisory control can be achieved by providing laparoscopic robots with preliminary surgical knowledge such as the sequence of procedures, instruments used in each stage, and the preferred laparoscope view at each one. The robotic arm can estimate the current stage using surgical knowledge and information of surgical environment and suggests the proper laparoscope view corresponding to the estimated surgical stage [182][183][184].…”

Section: Generalized Control Block Diagram Of Robots In Laparoscopic ...mentioning

confidence: 99%

“…• No significant change in complications • The surgeon may have required assistance for some parts in the procedure KaLAR [182,184] No reported clinical evaluation on human subjects.…”

Section: Mpc Controlmentioning

confidence: 99%

Robotics in laparoscopic surgery - A review

et al. 2022

View full text Add to dashboard Cite

Because of the increasing use of laparoscopic surgeries, robotic technologies have been developed to overcome the challenges these surgeries impose on surgeons. This paper presents an overview of the current state of surgical robots used in laparoscopic surgeries. Four main categories were discussed: handheld laparoscopic devices, laparoscope positioning robots, master–slave teleoperated systems with dedicated consoles, and robotic training systems. A generalized control block diagram is developed to demonstrate the general control scheme for each category of surgical robots. In order to review these robotic technologies, related published works were investigated and discussed. Detailed discussions and comparison tables are presented to compare their effectiveness in laparoscopic surgeries. Each of these technologies has proved to be beneficial in laparoscopic surgeries.

show abstract

“…A very interesting analysis of operations and research on this subject can be found in the book edited by Dankelman et al [5]. In the work of Kwon et al [6], the sequences of 21 tasks, the so-called surgery task model of cholecystectomy, were obtained as a result of the analysis of recordings of six laparoscopic clinical operations. Research and analyses were conducted to optimize treatments.…”

Section: Modeling and Planning Of A Surgical Proceduresmentioning

confidence: 99%

6 Virtual operating theater for planning Robin Heart robot operation

Nawrat¹

2020

Simulations in Medicine

View full text Add to dashboard Cite

Virtual reality (VR), artificial reality, cyberspace, and augmented reality are the new languages of communication. The ability to use it allows you to transfer information to the previously unavailable level: multidisciplinary but specific, local and personalized but global and based on knowledge (artificial intelligence, big data analysis), spatial and physical, fictional and real, and pictorial and interactive. Let's learn this new language, a new method of communication, to shorten the learning curve; plan the treatment, taking into account all patient data and prospective knowledge; and provide the necessary information during surgery, in short, to reduce the number of medical errors.

show abstract

Intelligent Laparoscopic Assistant Robot through Surgery Task Model: How to Give Intelligence to Medical Robots

Cited by 5 publications

References 23 publications

Robotic Endoscope Control Via Autonomous Instrument Tracking

Robotic Endoscope Control Via Autonomous Instrument Tracking

Robotics in laparoscopic surgery - A review

6 Virtual operating theater for planning Robin Heart robot operation

Contact Info

Product

Resources

About