Gesteme-free context-aware adaptation of robot behavior in human–robot cooperation

Nessi, Federico; Beretta, Elisa; Gatti, Cecilia; Ferrigno, Giancarlo; Momi, Elena De

doi:10.1016/j.artmed.2016.10.001

Cited by 6 publications

(4 citation statements)

References 36 publications

(65 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…First-Order Inductive Learner [53] [54] to create individual disease- [55] and procedure-specific [51] surgical process models and testing the system in real-surgical environments where the system retrieves the contextual information to trainees based on the expert performing the procedure. The context-aware system framework could further be enhanced to be used for intention detection [56] in human-robot interaction and for automating and planning [57] the robot-assisted surgeries, which will be eventually used in SMARTsurg project as to develop advanced cognition and perception abilities. SMARTsurg project will develop an advanced system for performing Robot Assisted Minimally Invasive Surgery (RAMIS) to reduce surgeon's cognitive load to shorten the training time and to deliver accuracy, safety, reduced procedure time and expanded applicability.…”

Section: Resultsmentioning

confidence: 99%

Development of an intelligent surgical training system for Thoracentesis

Nakawala

Ferrigno

Momi

2018

Artificial Intelligence in Medicine

Self Cite

View full text Add to dashboard Cite

Surgical training improves patient care, helps to reduce surgical risks, increases surgeon's confidence, and thus enhances overall patient safety. Current surgical training systems are more focused on developing technical skills, e.g. dexterity, of the surgeons while lacking the aspects of context-awareness and intra-operative real-time guidance. Context-aware intelligent training systems interpret the current surgical situation and help surgeons to train on surgical tasks. As a prototypical scenario, we chose Thoracentesis procedure in this work. We designed the context-aware software framework using the surgical process model encompassing ontology and production rules, based on the procedure descriptions obtained through textbooks and interviews, and ontology-based and marker-based object recognition, where the system tracked and recognised surgical instruments and materials in surgeon's hands and recognised surgical instruments on the surgical stand. The ontology was validated using annotated surgical videos, where the system identified "Anaesthesia" and "Aspiration" phase with 100% relative frequency and "Penetration" phase with 65% relative frequency. The system tracked surgical swab and 50mL syringe with approximately 88.23% and 100% accuracy in surgeon's hands and recognised surgical instruments with approximately 90% accuracy on the surgical stand. Surgical workflow training with the proposed system showed equivalent results as the traditional mentor-based training regime, thus this work is a step forward a new tool for context awareness and decision-making during surgical training.

show abstract

Section: Resultsmentioning

confidence: 99%

Development of an intelligent surgical training system for Thoracentesis

Nakawala

Ferrigno

Momi

2018

Artificial Intelligence in Medicine

Self Cite

View full text Add to dashboard Cite

show abstract

“…Further to surgical training, the knowledge-based framework could be possibly extended to the intraoperative robotic assistance, e.g. robotic scrub nurse, where instrument's contextual information is forwarded to robotic scrub nurse and the robot will handle the instruments and assist surgeons during the procedure also detecting surgeon's intent [46].…”

Section: Discussionmentioning

confidence: 99%

Toward a Knowledge-Driven Context-Aware System for Surgical Assistance

Nakawala

Ferrigno

Momi

2017

J. Med. Robot. Res.

Self Cite

View full text Add to dashboard Cite

Complex surgeries complications are increasing, thus making an efficient surgical assistance is a real need. In this work, an ontology-based context-aware system was developed for surgical training/assistance during Thoracentesis by using image processing and semantic technologies. We evaluated the Thoracentesis ontology and implemented a paradigmatic test scenario to check the efficacy of the system by recognizing contextual information, e.g. the presence of surgical instruments on the table. The framework was able to retrieve contextual information about current surgical activity along with information on the need or presence of a surgical instrument

show abstract

“…Controlled robotic assistants have intensively emerged in surgery room environment, so [118] present a robot capable of adaptation of control strategy based on surgeon's activities. The clinical relevance of such a context application is improvement of safety and inference of the human-robot cooperation.…”

Section: Urban Planningmentioning

confidence: 99%

Context Aware Control Systems: An Engineering Applications Perspective

et al. 2020

View full text Add to dashboard Cite

Cyber-physical systems revolve around context awareness, empowering objective-oriented services, products and operations based on real data. Self-aware and self-control systems are core elements in the Industry 4.0 framework towards self-sustainable adaptive manufacturing and personalized services. This development is witnessed by the context-aware pervasive assistance to users and machines in decisions making process for optimizing product performance and economic yield. While integration of the virtual and the physical world entails smart sensors communication and complex data analytics, it relies on artificial intelligence tools to manage process operations. The objective of the article is to create awareness that systems & control community must address theoretical and practical aspects from a larger perspective. Context aware control is emerging as a natural solution to maximize the use of available sensing instrumentation and the relatively low cost data logging, i.e. an important source for extracting information, interpreting and using context information and adapt its functionality to the current context of use. This article presents a concise overview of applications where context aware systems and control methodologies are relevant in the seven societal challenges acknowledged by European policy-makers: Digital Society;

show abstract

Gesteme-free context-aware adaptation of robot behavior in human–robot cooperation

Cited by 6 publications

References 36 publications

Development of an intelligent surgical training system for Thoracentesis

Development of an intelligent surgical training system for Thoracentesis

Toward a Knowledge-Driven Context-Aware System for Surgical Assistance

Context Aware Control Systems: An Engineering Applications Perspective

Contact Info

Product

Resources

About