Evaluation of diagnostician user interface aspects in a virtual reality-based tele-ultrasonography simulation

Filippeschi, Alessandro; Brizzi, Filippo; Ruffaldi, Emanuele; Jacinto‐Villegas, Juan Manuel; Landolfi, Lorenzo; Avizzano, Carlo Alberto

doi:10.1080/01691864.2019.1635909

Cited by 9 publications

(5 citation statements)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Another simulated study used teleoperated ultrasonography that builds on the VE developed as a 3D representation of a real USG probe and a mannequin imitating a patient’s body highlighted with a geometric mesh for the purpose of following the examination. The user wears an Oculus Rift DK2 HMD (Oculus) to perform this simulation of tele-USG [ 148 ]. Syawaludin et al [ 150 ] introduced the use of 360° foveated pipeline imaging viewed via an HMD.…”

Section: Resultsmentioning

confidence: 99%

“…Evaluation of 3D VR telenavigation in cardiac USG has been undertaken in simulated settings. The added benefits of AR enable real-time teleguidance on procedural performance and image registration for point-of-focus ultrasonography (POCUS) and foveated imaging pipeline in extending VR-based telediagnosis [148][149][150]. Another study mentions AR video communication projected by mobile-based AR guidance to conduct POCUS on popliteal nerve block and a subsequent diagnosis based on the availed health information [151].…”

Section: Digital Reality Platform Via Telehealthmentioning

confidence: 99%

See 1 more Smart Citation

Mixed Reality Platforms in Telehealth Delivery: Scoping Review

Worlikar¹,

Coleman²,

Kelly³

et al. 2023

JMIR Biomed Eng

View full text Add to dashboard Cite

Background The distinctive features of the digital reality platforms, namely augmented reality (AR), virtual reality (VR), and mixed reality (MR) have extended to medical education, training, simulation, and patient care. Furthermore, this digital reality technology seamlessly merges with information and communication technology creating an enriched telehealth ecosystem. This review provides a composite overview of the prospects of telehealth delivered using the MR platform in clinical settings. Objective This review identifies various clinical applications of high-fidelity digital display technology, namely AR, VR, and MR, delivered using telehealth capabilities. Next, the review focuses on the technical characteristics, hardware, and software technologies used in the composition of AR, VR, and MR in telehealth. Methods We conducted a scoping review using the methodological framework and reporting design using the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. Full-length articles in English were obtained from the Embase, PubMed, and Web of Science databases. The search protocol was based on the following keywords and Medical Subject Headings to obtain relevant results: “augmented reality,” “virtual reality,” “mixed-reality,” “telemedicine,” “telehealth,” and “digital health.” A predefined inclusion-exclusion criterion was developed in filtering the obtained results and the final selection of the articles, followed by data extraction and construction of the review. Results We identified 4407 articles, of which 320 were eligible for full-text screening. A total of 134 full-text articles were included in the review. Telerehabilitation, telementoring, teleconsultation, telemonitoring, telepsychiatry, telesurgery, and telediagnosis were the segments of the telehealth division that explored the use of AR, VR, and MR platforms. Telerehabilitation using VR was the most commonly recurring segment in the included studies. AR and MR has been mainly used for telementoring and teleconsultation. The most important technical features of digital reality technology to emerge with telehealth were virtual environment, exergaming, 3D avatars, telepresence, anchoring annotations, and first-person viewpoint. Different arrangements of technology—3D modeling and viewing tools, communication and streaming platforms, file transfer and sharing platforms, sensors, high-fidelity displays, and controllers—formed the basis of most systems. Conclusions This review constitutes a recent overview of the evolving digital AR and VR in various clinical applications using the telehealth setup. This combination of telehealth with AR, VR, and MR allows for remote facilitation of clinical expertise and further development of home-based treatment. This review explores the rapidly growing suite of technologies available to users within the digital health sector and examines the opportunities and challenges they present.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Digital Reality Platform Via Telehealthmentioning

confidence: 99%

Mixed Reality Platforms in Telehealth Delivery: Scoping Review

Worlikar¹,

Coleman²,

Kelly³

et al. 2023

JMIR Biomed Eng

View full text Add to dashboard Cite

show abstract

“…The study presented in [29] is notable, where the analysis of the relationship between physicians and user interfaces involving ultrasonography devices was carried out, concluding that virtual reality alone is not sufficient to reproduce the effectiveness of a locally performed scan. In ultrasound scan procedures, not only the image provides information but also the direct tactile information process.…”

Section: Controlmentioning

confidence: 96%

“…The fact that the physicians are distant from the patients implies that they are not able to directly feel the body reaction, something that is required even for highly skilled medical personnel. To improve the [24] Pressure control High weight Abdomen Kim et al [25] Force feedback Limited force Thyroid Abolhassani et al [26] Trajectory planning Slow velocity Prostate therapy Li et al [27] Trajectory planning Lack of in vivo testing Lumbar puncture Böttger et al [28] Dexterity and kinematics Simulations only Microcirculation Filippeschi et al [29] User interface including navigation Remote conditions simulated only Abdomen Sénac et al [31] Review of pneumatic actuators control No in vivo testing Neonatal procedures Gilbertson et al [32] Force and position control Soft tissues Muscular systems Kaminski et al [33] Force feedback Feasibility study Thyroid diseases Bucolo et al [34] Force feedback Prototype only Abdomen Hadjikov et al [35] Model-based control Simulations only Abdominal fascia Applied Bionics and Biomechanics capability to compensate for the separation between the operator and the patient, the interface with the medical robot must be enhanced. The use of a haptic device to control the robot through an intelligent probe scaling the forces to allow a more ergonomic holding position was evaluated in [11].…”

Section: Human-robot Interface and Sensorsmentioning

confidence: 99%

Remote Ultrasound Scan Procedures with Medical Robots: Towards New Perspectives between Medicine and Engineering

Bucolo

Buscarino

et al. 2022

Applied Bionics and Biomechanics

View full text Add to dashboard Cite

Background. This review explores state-of-the-art teleoperated robots for medical ultrasound scan procedures, providing a comprehensive look including the recent trends arising from the COVID-19 pandemic. Methods. Physicians’ experience is included to indicate the importance of their role in the design of improved medical robots. From this perspective, novel classes of equipment for remote diagnostics based on medical robotics are discussed in terms of innovative engineering technologies. Results. Relevant literature is reviewed under the system engineering point of view, organizing the discussion on the basis of the main technological focus of each contribution. Conclusions. This contribution is aimed at stimulating new research to obtain faster results on teleoperated robotics for ultrasound diagnostics in response to the high demand raised by the ongoing pandemic.

show abstract

“…Advances in robotic and computer graphics technologies made it possible the development of robotic tele-medicine systems (e.g. [1,[3][4][5]13]. Among these examinations ultrasonography (USG) is one of the most important to make a decision on patient's need to be directed to a specialist.…”

Section: Introductionmentioning

confidence: 99%

Kinematic Optimization for the Design of a UR5 Robot End-Effector for Cardiac Tele-Ultrasonography

Griffa

Filippeschi

Avizzano

2020

Mechanisms and Machine Science

Self Cite

View full text Add to dashboard Cite

Robotic tele-examination is mainstream for solving the nowadays worsening shortage of physicians. However, many solutions are based on custom robotic arms, whereas using COTS arms could reduce costs and make such systems affordable. In this paper, we address the problem of the design of an end-effector for cardiac tele-ultrasonography, assuming the use of a popular and low-cost industrial robot such as the Universal Robot UR5. We use a kinematic optimization based on the manipulability measure taking into account the position of the robot base with respect to the patient, the number of degrees of freedom (DoFs), and the size of the end-effector. The constraints of the problem are the full inclusion of the examination area in the workspace and the possibility to orient the probe correctly. The results of this study show that, although the arm has 6 DoFs, an additive DoF of the end-effector improves the manipulability measure by more than 100%.

show abstract

Evaluation of diagnostician user interface aspects in a virtual reality-based tele-ultrasonography simulation

Cited by 9 publications

References 25 publications

Mixed Reality Platforms in Telehealth Delivery: Scoping Review

Mixed Reality Platforms in Telehealth Delivery: Scoping Review

Remote Ultrasound Scan Procedures with Medical Robots: Towards New Perspectives between Medicine and Engineering

Kinematic Optimization for the Design of a UR5 Robot End-Effector for Cardiac Tele-Ultrasonography

Contact Info

Product

Resources

About