An augmented reality system for liver thermal ablation: Design and evaluation on clinical cases

Nicolau, Stéphane; Pennec, Xavier; Soler, Luc; Buy, Xavier; Gangi, Afshin; Ayache, Nicholas; Marescaux, Jacques

doi:10.1016/j.media.2009.02.003

Cited by 93 publications

(44 citation statements)

References 44 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Using a head-mounted display (HMD), interventional procedures are trained on phantoms without the risk of performing an invasive intervention in reality. Nicolau et al [10] introduced a guidance system for liver percutaneous punctures that superimposes planning models on video images of the interventional view. Alpha compositing is used to achieve semi-transparent planning models.…”

Section: Augmented Reality For Liver Interventionsmentioning

confidence: 99%

“…A drawback therein is its limitation to the intraoperative processed segmentation result which does not provide an accentuation of risk structures and spatial relations. Several groups [12,13] in the field of laparoscopy guidance apply transparency-based superimpositions, similar to [8,9,10], in order to achieve a superimposition of laparoscopic video images with planning information, which could as well lead to misinterpretations.…”

Section: Augmented Reality For Liver Interventionsmentioning

confidence: 99%

See 1 more Smart Citation

Illustrative visualization of 3D planning models for augmented reality in liver surgery

et al. 2009

View full text Add to dashboard Cite

Purpose: Augmented Reality (AR) obtains increasing acceptance in the operating room. However, a meaningful augmentation of the surgical view with a 3D visualization of planning data which allows reliable comparisons of distances and spatial relations is still an open request. Methods: We introduce methods for intraoperative visualization of 3D planning models which extend illustrative rendering and AR techniques. We aim to reduce visual complexity of 3D planning models and accentuate spatial relations between relevant objects. The main contribution of our work is an advanced silhouette algorithm for 3D planning models (distance-encoding silhouettes) combined with procedural textures (distance-encoding surfaces). In addition, we present a method for illustrative visualization of resection surfaces. Results: The developed algorithms have been embedded into a clinical prototype that has been evaluated in the operating room. To verify the expressiveness of our illustration methods, we performed a user study under controlled conditions. The study revealed a clear advantage in distance assessment with the proposed illustrative approach in comparison to classical rendering techniques. Conclusion:The presented illustration methods are beneficial for distance assessment in surgical AR. To increase the safety of interventions with the proposed approach, reduction of inaccuracies in tracking and registration are subject of our current research.

show abstract

Section: Augmented Reality For Liver Interventionsmentioning

confidence: 99%

Section: Augmented Reality For Liver Interventionsmentioning

confidence: 99%

Illustrative visualization of 3D planning models for augmented reality in liver surgery

et al. 2009

View full text Add to dashboard Cite

show abstract

“…During the intervention needle guidance is provided in real time: A surface-based registration with the surface acquired by the range camera yields the transformation from the CT volume to the range image space. The trajectory can then be transformed and superimposed along with the instrument model on the intensity/RGB image to provide guidance information [1,2,10,18,19,23,27,32,34,36,38,45] differing mainly in the methods used for tracking (e.g., optical, electromagnetical), registration (e.g., point-based, model-based) and guidance visualization (e.g., external monitor, head-mounted display, projector). However, thus far, none of them became widely accepted in clinical routine, because the benefit of such systems for the patient could not exceed the additional complexity and additional higher costs.…”

Section: Introductionmentioning

confidence: 99%

Towards markerless navigation for percutaneous needle insertions

et al. 2015

View full text Add to dashboard Cite

show abstract

“…In the area of needle guidance applications, many navigation systems have been developed to solve specific clinical problems, such as liver puncture [7,8] and vertebroplasty procedures [9], as well as for general biopsy procedures [10,11]. While some groups [9][10][11] rely on well established rigid approaches for registering the patient to the image and are therefore limited to targeting static anatomical regions, other groups have investigated nonrigid methods to gate breathing [7] or to model deformation [8] in order to target organs that can deform considerably during the procedure. A recent review by Cleary and Peters [12] shows that even though non-rigid methods are making progress for interventions in the thorax and abdomen, most current work is still based on the rigid approach.…”

Section: Introductionmentioning

confidence: 99%

A navigation system for percutaneous needle interventions based on PET/CT images: Design, workflow and error analysis of soft tissue and bone punctures

Oliveira-Santos

Klaeser

Weitzel

et al. 2011

Computer Aided Surgery

View full text Add to dashboard Cite

Percutaneous needle intervention based on PET/CT images is effective, but exposes the patient to unnecessary radiation due to the increased number of CT scans required. Computer assisted intervention can reduce the number of scans, but requires handling, matching and visualization of two different datasets. While one dataset is used for target definition according to metabolism, the other is used for instrument guidance according to anatomical structures. No navigation systems capable of handling such data and performing PET/CT image-based procedures while following clinically approved protocols for oncologic percutaneous interventions are available. The need for such systems is emphasized in scenarios where the target can be located in different types of tissue such as bone and soft tissue. These two tissues require different clinical protocols for puncturing and may therefore give rise to different problems during the navigated intervention.Studies comparing the performance of navigated needle interventions targeting lesions located in these two types of tissue are not often found in the literature. Hence, this paper presents an optical navigation system for percutaneous needle interventions based on PET/CT images. The system provides viewers for guiding the physician to the target with real-time visualization of PET/CT datasets, and is able to handle targets located in both bone and soft tissue. The navigation system and the required clinical workflow were designed taking into consideration clinical protocols and requirements, and the system is thus operable by a single person, even during transition to the sterile phase. Both the system and the workflow were evaluated in an initial set of experiments simulating 41 lesions (23 located in bone tissue and 18 in soft tissue) in swine cadavers. We also measured and decomposed the overall system error into distinct error sources, which allowed for the identification of particularities involved in the process as well as highlighting the differences between bone and soft tissue punctures.An overall average error of 4.23 mm and 3.07 mm for bone and soft tissue punctures, respectively, demonstrated the feasibility of using this system for such interventions. The proposed system workflow was shown to be effective in separating the preparation from the sterile phase, as well as in keeping the system manageable by a single operator. Among the distinct sources of error, the user error based on the system accuracy (defined as the distance from the planned target to the actual needle tip) appeared to be the most significant. Bone punctures showed higher user error, whereas soft tissue punctures showed higher tissue deformation error.

show abstract

An augmented reality system for liver thermal ablation: Design and evaluation on clinical cases

Cited by 93 publications

References 44 publications

Illustrative visualization of 3D planning models for augmented reality in liver surgery

Illustrative visualization of 3D planning models for augmented reality in liver surgery

Towards markerless navigation for percutaneous needle insertions

A navigation system for percutaneous needle interventions based on PET/CT images: Design, workflow and error analysis of soft tissue and bone punctures

Contact Info

Product

Resources

About