Interacting with a virtual Destroyed Environment constructed from real disaster data

Ferworn, Alexander; Herman, Scott; Kong, Christopher; Ufkes, Alex; Tran, Jimmy

doi:10.1109/ssrr.2014.7017654

Cited by 9 publications

(7 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The first step involves scanning the IED in a process we call the model creation pipeline (MCP). In contrast to the high fidelity point cloud framework described in our previous work [7][8], this process utilizes open source projects, Slicer 3D [26], Blender [27] and Aperio [6] to convert Digital Imaging and Communications in Medicine (DICOM) data into separate mesh models as object files compatible with game engines such as Unity [28] or Unreal [29] for interactive 3D simulation. This MCP allows for the ability to inject arbitrary real models into a game engine and reason about them.…”

Section: Methodsmentioning

confidence: 99%

“…Figure 2 depicts the generalized overview of our pipeline. This work stems from our previous research in which we use data collected from an Unmanned Aerial Vehicle (UAV) fitted with an RGB-D sensor to create a high fidelity 3D point cloud model of scanned rubble terrain [7] and inject it into another serious game. Our previous work, in this broad area, focused on timesensitive operations with technology that can be applied to support USAR operations [7][8][9].…”

Section: Introductionmentioning

confidence: 99%

“…This work stems from our previous research in which we use data collected from an Unmanned Aerial Vehicle (UAV) fitted with an RGB-D sensor to create a high fidelity 3D point cloud model of scanned rubble terrain [7] and inject it into another serious game. Our previous work, in this broad area, focused on timesensitive operations with technology that can be applied to support USAR operations [7][8][9]. Stemming from this work, we present an approach to separate parts of an IED within a model and provide a game-based simulation that can potentially assist in the training of EDU personnel with the benefits of lowering exposure to actual IEDs, and providing visually and spatially accurate 3D model representations.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Serious Gaming for Improvised Explosive Device Neutralization Training

2016

Self Cite

View full text Add to dashboard Cite

Abstract. An improvised explosive device (IED) is a "homemade" bomb intended to cause great harm when it explodes. The public safety task of identifying and neutralizing IEDs falls to military and police services often called explosive disposal units (EDU) who act to neutralize the threat associated with the IED either rendering it inoperable or destroying it safely. EDUs train in various aspects of explosive handling and investigation but are limited in the tools available for safely analyzing real world bombs. This paper describes a game based approach to IED training that employs an interactive 3D simulation to spatially identify key IED components of interest. We give an example of how this approach might be used and provide a preliminary evaluation of its potential effectiveness. We employ images formed from a Digital Imaging and Communications in Medicine (DICOM) system captured using Magnetic Resonance Imaging (MRI) technology to a virtual IED in a game. Empirical evaluation and EDU testimony suggest accurate representation of the IED and the potential efficacy of the proposed approach for successfully identifying components in the bomb for the purposes of EDU training.

show abstract

Section: Methodsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Serious Gaming for Improvised Explosive Device Neutralization Training

2016

Self Cite

View full text Add to dashboard Cite

show abstract

“…The next publication pertinent to this research done through CPS is by the same group of researchers. Interacting with a virtual Destroyed Environment Constructed From Real Disaster Data delves into reconstructing destroyed and disaster environments in virtual reality [21]. This task is done in a timely manner so that engineers and emergency responders can survey the environment for direct pathways to victims before they risk their own lives going through the rubble.…”

Section: Responsementioning

confidence: 99%

Getting Out Safe: Navigation Utilizing The ARAIG Suit and Minecraft

Laffan

2024

Preprint

View full text Add to dashboard Cite

<p>This thesis conducts a study into which algorithms and haptic technologies are necessary for assisting first responders in peril. Firefighters run the risk of getting lost and disoriented in unfamiliar emergency environments. This research uses haptic feedback to direct firefighters out of these environments. These haptic instructions are given by the “As Real As It Gets” (ARAIG) suit by IFTech. Due to COVID-19, in order to test these algorithms applied to egress paths, a Minecraft mod is written.</p> <p>The algorithms for creating a pathway of egress include octree construction, insertion and search, and a modified Dijkstra’s algorithm. The resulting reconstructed egress path is used to create physical haptic instructions for the user. These instructions are conveyed to the ARAIG suit. Finally, four users provide feedback on their interactions with the system. This thesis concludes with proposals for future directions for this research to go in.</p>

show abstract

“…-Methodology for repurposing medical imaging for IED model creation: An augmented approach to producing relevant 3D models through the use of Digital Imaging and Communications in Medicine (DICOM) data captured using Magnetic Resonance Imaging (MRI) technology. In contrast to the high-fidelity point cloud framework described in our previous work [8], [9], this process utilizes open source projects, Slicer 3D [10], Blender [11] and Aperio [12] to convert DICOM data into separate mesh models as object files compatible with game engines such as Unity [13] and Unreal [14] for interactive 3D simulation. This system allows for the ability to inject arbitrary real models into a game engine and reason about them.…”

Section: Contributionsmentioning

confidence: 99%

Game-based threat assessment tool for improvised explosive device neutralization training

Chan¹

2021

Preprint

View full text Add to dashboard Cite

CBRNe is an acronym referring to chemical, biological, radiological, nuclear and explosives. When specialized response teams deal with CBRNe-related incidents, one of the guiding principles is to avoid contact with the threat until the nature of the threat can be determined. Our research demonstrates that we can safely create, inspect and manipulate a 3D model of a suspected CBRNe threat within a physics-based game engine where models are created from extremely accurate data gathered from Magnetic Resonance Imaging (MRI) sensors. Our system is able to provide first responders the ability to visually identify key IED components of interest and obtain relevant information directly from the simulation. The primary goal of our research is to demonstrate that the functionality we developed can be used to provide accurate information to its users for the purposes of training and potentially assist CBRNe planning efforts in the future.

show abstract

Interacting with a virtual Destroyed Environment constructed from real disaster data

Cited by 9 publications

References 11 publications

Serious Gaming for Improvised Explosive Device Neutralization Training

Serious Gaming for Improvised Explosive Device Neutralization Training

Getting Out Safe: Navigation Utilizing The ARAIG Suit and Minecraft

Game-based threat assessment tool for improvised explosive device neutralization training

Contact Info

Product

Resources

About