Real-time volume rendering of digital medical images on an iOS device

Noon, Christian; Holub, Joseph; Winer, Eliot H.

doi:10.1117/12.2005335

Cited by 7 publications

(7 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It was impossible to compare this method with others because no other real-time mobile volume raycaster that support 3D and 4D data could be found after an exhaustive literature search. Therefore, the results of this research were compared, when possible, with an fMRI desktop implementation [41] similar to this work as well as a previous iPad volume renderer using orthogonal texture slicing instead of raycasting [38]. The data initialization times were 16.4 and 29.8 s with dataset 1 and 18.1 and 47.8 for dataset 2 using two different implementations for storing the volume data ( Table 1).…”

Section: Discussionmentioning

confidence: 99%

“…To date, there has not been a successful real-time volume raycasting implementation for mobile devices. Achieving real-time volume rendering has required using a less computationally expensive method, such as orthogonal texture slicing [38]. The only available application for visualizing fMRI data in 3D on a mobile device is NeuroPub [39], an application for Apple's iOS platform.…”

Section: Mobile Raycastingmentioning

confidence: 99%

See 1 more Smart Citation

Enabling Real-Time Volume Rendering of Functional Magnetic Resonance Imaging on an iOS Device

Holub

Winer

2017

J Digit Imaging

Self Cite

View full text Add to dashboard Cite

Powerful non-invasive imaging technologies like computed tomography (CT), ultrasound, and magnetic resonance imaging (MRI) are used daily by medical professionals to diagnose and treat patients. While 2D slice viewers have long been the standard, many tools allowing 3D representations of digital medical data are now available. The newest imaging advancement, functional MRI (fMRI) technology, has changed medical imaging from viewing static to dynamic physiology (4D) over time, particularly to study brain activity. Add this to the rapid adoption of mobile devices for everyday work and the need to visualize fMRI data on tablets or smartphones arises. However, there are few mobile tools available to visualize 3D MRI data, let alone 4D fMRI data. Building volume rendering tools on mobile devices to visualize 3D and 4D medical data is challenging given the limited computational power of the devices. This paper describes research that explored the feasibility of performing real-time 3D and 4D volume raycasting on a tablet device. The prototype application was tested on a 9.7" iPad Pro using two different fMRI datasets of brain activity. The results show that mobile raycasting is able to achieve between 20 and 40 frames per second for traditional 3D datasets, depending on the sampling interval, and up to 9 frames per second for 4D data. While the prototype application did not always achieve true real-time interaction, these results clearly demonstrated that visualizing 3D and 4D digital medical data is feasible with a properly constructed software framework.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Mobile Raycastingmentioning

confidence: 99%

Enabling Real-Time Volume Rendering of Functional Magnetic Resonance Imaging on an iOS Device

Holub

Winer

2017

J Digit Imaging

Self Cite

View full text Add to dashboard Cite

show abstract

“…The improved frame rates are expected with a 2.6GHz Intel Core i7 processor, 16 GB of RAM, and a NVIDIA GeForce GT 750M graphics card. The comparison iPad application used orthogonal texture slicing and a similar dataset of 256 x 256 pixels per slice and 128 slices and saw frame rates between 114 45-50 fps for the structural static condition[163]. The improved frame rates can largely be attributed to the use of a less computationally expensive orthogonal texture slicing algorithm, even running on an iPad 2.When increasing the sampling step size to twice the width of a single voxel, the frame rates increased as expected.…”

mentioning

confidence: 72%

“…It is impossible to compare this method with others, because there currently is no real-time volume raycaster that support 3D and 4D data. Therefore, the results of this research were compared, when possible, with a fMRI desktop implementation [183] similar to this work as well as a previous iPad volume renderer using orthogonal texture slicing instead of raycasting [163].…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Dynamic Volume Rendering of Functional Medical Data on Dissimilar Hardware Platforms

Holub¹

View full text Add to dashboard Cite

In the last 30 years, medical imaging has become one of the most used diagnostic tools in the medical profession. Computed Tomography (CT) and Magnetic Resonance Imaging (MRI) technologies have become widely adopted because of their ability to capture the human body in a non-invasive manner. A volumetric dataset is a series of orthogonal 2D slices captured at a regular interval, typically along the axis of the body from the head to the feet. Volume rendering is a computer graphics technique that allows volumetric data to be visualized and manipulated as a single 3D object. Isosurface rendering, image splatting, shear warp, texture slicing, and raycasting are volume rendering methods, each with associated advantages and disadvantages. Raycasting is widely regarded as the highest quality renderer of these methods.

show abstract

A Medical Application Integrating Remote 3D Visualization Tools to Access Picture Archiving and Communication System on Mobile Devices

Ming

Liu

2014

J Med Syst

View full text Add to dashboard Cite

With computing capability and display size growing, the mobile device has been used as a tool to help clinicians view patient information and medical images anywhere and anytime. However, for direct interactive 3D visualization, which plays an important role in radiological diagnosis, the mobile device cannot provide a satisfactory quality of experience for radiologists. This paper developed a medical system that can get medical images from the picture archiving and communication system on the mobile device over the wireless network. In the proposed application, the mobile device got patient information and medical images through a proxy server connecting to the PACS server. Meanwhile, the proxy server integrated a range of 3D visualization techniques, including maximum intensity projection, multi-planar reconstruction and direct volume rendering, to providing shape, brightness, depth and location information generated from the original sectional images for radiologists. Furthermore, an algorithm that changes remote render parameters automatically to adapt to the network status was employed to improve the quality of experience. Finally, performance issues regarding the remote 3D visualization of the medical images over the wireless network of the proposed application were also discussed. The results demonstrated that this proposed medical application could provide a smooth interactive experience in the WLAN and 3G networks.

show abstract

Real-time volume rendering of digital medical images on an iOS device

Cited by 7 publications

References 0 publications

Enabling Real-Time Volume Rendering of Functional Magnetic Resonance Imaging on an iOS Device

Enabling Real-Time Volume Rendering of Functional Magnetic Resonance Imaging on an iOS Device

Dynamic Volume Rendering of Functional Medical Data on Dissimilar Hardware Platforms

A Medical Application Integrating Remote 3D Visualization Tools to Access Picture Archiving and Communication System on Mobile Devices

Contact Info

Product

Resources

About