No abstract

A real-time ultrasound-guided needle-insertion medical robot for percutaneous cholecystostomy has been developed. Image-guided interventions have become widely accepted because they are consistent with minimal invasiveness. However, organ or abnormality displacement due to involuntary patient motion may undesirably affect the intervention. The proposed instrument uses intraoperative images and modifies the needle path in real time by using a novel ultrasonic image segmentation technique. In phantom and volunteer experiments, the needle path updating time was 130 and 301 ms per cycle, respectively. In animal experiments, the needle could be placed accurately in the target.

BackgroundThis study evaluated the use of an augmented reality navigation system that provides a markerless registration system using stereo vision in oral and maxillofacial surgery.MethodA feasibility study was performed on a subject, wherein a stereo camera was used for tracking and markerless registration. The computed tomography data obtained from the volunteer was used to create an integral videography image and a 3-dimensional rapid prototype model of the jaw. The overlay of the subject’s anatomic site and its 3D-IV image were displayed in real space using a 3D-AR display. Extraction of characteristic points and teeth matching were done using parallax images from two stereo cameras for patient-image registration.ResultsAccurate registration of the volunteer’s anatomy with IV stereoscopic images via image matching was done using the fully automated markerless system, which recognized the incisal edges of the teeth and captured information pertaining to their position with an average target registration error of < 1 mm. These 3D-CT images were then displayed in real space with high accuracy using AR. Even when the viewing position was changed, the 3D images could be observed as if they were floating in real space without using special glasses.ConclusionTeeth were successfully used for registration via 3D image (contour) matching. This system, without using references or fiducial markers, displayed 3D-CT images in real space with high accuracy. The system provided real-time markerless registration and 3D image matching via stereo vision, which, combined with AR, could have significant clinical applications.Electronic supplementary materialThe online version of this article (doi:10.1186/s12880-015-0089-5) contains supplementary material, which is available to authorized users.

To evaluate the feasibility and accuracy of a three-dimensional augmented reality system incorporating integral videography for imaging oral and maxillofacial regions, based on preoperative computed tomography data. Three-dimensional surface models of the jawbones, based on the computed tomography data, were used to create the integral videography images of a subject's maxillofacial area. The three-dimensional augmented reality system (integral videography display, computed tomography, a position tracker and a computer) was used to generate a three-dimensional overlay that was projected on the surgical site via a half-silvered mirror. Thereafter, a feasibility study was performed on a volunteer. The accuracy of this system was verified on a solid model while simulating bone resection. Positional registration was attained by identifying and tracking the patient/surgical instrument's position. Thus, integral videography images of jawbones, teeth and the surgical tool were superimposed in the correct position. Stereoscopic images viewed from various angles were accurately displayed. Change in the viewing angle did not negatively affect the surgeon's ability to simultaneously observe the three-dimensional images and the patient, without special glasses. The difference in three-dimensional position of each measuring point on the solid model and augmented reality navigation was almost negligible (<1 mm); this indicates that the system was highly accurate. This augmented reality system was highly accurate and effective for surgical navigation and for overlaying a three-dimensional computed tomography image on a patient's surgical area, enabling the surgeon to understand the positional relationship between the preoperative image and the actual surgical site, with the naked eye.

Integral videography (IV) is an animated extension of integral photography. Despite IV's many advantages, the quality of its spatial images has thus far been poor; the pixel pitch of the display and the lens pitch are considered to be the main factors affecting the IV image format. Our solution for increasing pixel density is to use multiple projectors to create a high-resolution image and project the resultant image onto a small screen by using long-zoom-lens projection optics. We manufactured a lens array for the display device, and here we present experimental results on using two SXGA projectors. The pixel pitch and lens pitch of the new display are 85 mum and 1.016 mm, respectively. The multiprojector IV display device has a spatial resolution of approximately 1, 2, and 3 mm for image depths of 10, 35, and 60 mm, respectively, in front of and behind the lens array.