Development of a 3D User Interface based on Kinect Sensor and Bend-Sensing Data Glove for Controlling Software in the Mining Industry

Kim, Heonmoo; Choi, Yosoon

doi:10.32390/ksmer.2019.56.1.044

Cited by 4 publications

(7 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although several previous studies have been performed in the development of user interface devices that can enhance user immersion and effectively control software in a VR environment [22][23][24][25][26][27][28][29], they did not quantitatively compare the performances of the various user interface devices that are able to control mining industry software. Therefore, our research findings are expected to be a useful reference material for the future development of user interface devices in the mining industry.…”

Section: Discussionmentioning

confidence: 99%

“…The Kinect sensor & bend-sensing data glove ( Figure 1d) were developed by Kim et al [28] as a 3DUI for use in a VR environment. The experimenters controlled the position of the cursor by tracking the position of the hand and then tracking the movement of the arm using the Kinect sensor, which is a 3D depth measurement camera.…”

Section: Item Conditionmentioning

confidence: 99%

“…In the mining industry, several studies have been conducted on the development of 3D user interfaces (3DUIs) to control VR-based software [28,29]. Kim and Choi [28] developed a 3D user interface based on gesture and hand tracking using a Kinect sensor and a bend-sensing data glove to control mining software in a virtual reality environment; Bednarz et al [29] proposed a new interaction approach that can control mining equipment using a touch screen, data glove and spherical dome in an immersive virtual reality environment. However, previous studies have not quantitatively compared the performance of various user interface devices for controlling mining industry software in a VR environment, as they have mainly focused only on the development of 3DUI devices.…”

Section: Introductionmentioning

confidence: 99%

“…Three-dimensional (3D) user interface devices used in this study. (a) Two-dimensional (2D) mouse (M185, Logitech, Lausanne, Switzerland); (b) 3D mouse (Space Explorer, 3D Connexion, München, Germany); (c) virtual reality (VR) controller (Oculus Touch, Oculus, Irvine, CA, USA); and (d) bend-sensing data glove with Kinect sensor[28].…”

mentioning

confidence: 99%

See 3 more Smart Citations

Performance Comparison of User Interface Devices for Controlling Mining Software in Virtual Reality Environments

Kim

Choi

2019

Applied Sciences

Self Cite

View full text Add to dashboard Cite

Recently, many studies have been conducted to apply virtual reality (VR) technology to the mining industry. To accomplish this, it is necessary to develop user interface devices that can effectively control software. Most VR content in the mining industry requires precise device control for equipment operation or accident response. In this study, we compare the performance of four user interface devices (a 2D mouse, 2D & 3D mice, a VR controller, and a Kinect (Microsoft) sensor and bend-sensing data glove) for controlling mining industry software in a VR environment. The total working time, number of device clicks and click accuracy, were analyzed based on 10 experimenters performing 3D orebody modeling, using each device in the VR environment. Furthermore, we conducted a survey to evaluate the ease of learning, ease of use, immersion and fatigue of each device after the experiment. The results show that the 2D mouse yields a high performance in terms of its working time, click accuracy, ease of learning and ease of use. However, the 2D mouse did not completely leverage the VR environment, owing to low user immersion. The Kinect sensor and bend-sensing data glove could control the software efficiently while maximizing user immersion. Our findings are expected to provide a useful reference for the future development of user interface devices in the mining industry.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Item Conditionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

mentioning

confidence: 99%

See 2 more Smart Citations

Performance Comparison of User Interface Devices for Controlling Mining Software in Virtual Reality Environments

Kim

Choi

2019

Applied Sciences

Self Cite

View full text Add to dashboard Cite

show abstract

“…In the mining sector, ICTs are being used in various ways. For example, it was used in the form of building a spatial database for a mine site, entering attribute information to visualize it, or performing a pre-simulation by changing attribute information [16][17][18][19]. Recently, high-resolution databases of mining sites have been constructed using drones [20][21][22][23] and unmanned ground vehicles [24][25][26][27][28][29].…”

Section: Introductionmentioning

confidence: 99%

Lab Scale Model Experiment of Smart Hopper System to Remove Blockages Using Machine Vision and Collaborative Robot

Kim

Choi

2022

Applied Sciences

Self Cite

View full text Add to dashboard Cite

In this study, we propose a smart hopper system that automatically unblocks obstructions caused by rocks dropped into hoppers at mining sites. The proposed system captures RGB (red green blue) and D (depth) images of the upper surfaces of hopper models using an RGB-D camera and transmits them to a computer. Then, a virtual hopper system is used to identify rocks via machine vision-based image processing techniques, and an appropriate motion is simulated in a robot arm. Based on the simulation, the robot arm moves to the location of the rock in the real world and removes it from the actual hopper. The recognition accuracy of the proposed model is evaluated in terms of the quantity and location of rocks. The results confirm that rocks are accurately recognized at all positions in the hopper by the proposed system.

show abstract

Analysis of Features and Applications of Smart Glass for Utilization in the Mining Industry

Kim¹,

Baek²,

Choi³

et al. 2019

ksmer

View full text Add to dashboard Cite

Development of a 3D User Interface based on Kinect Sensor and Bend-Sensing Data Glove for Controlling Software in the Mining Industry

Cited by 4 publications

References 8 publications

Performance Comparison of User Interface Devices for Controlling Mining Software in Virtual Reality Environments

Performance Comparison of User Interface Devices for Controlling Mining Software in Virtual Reality Environments

Lab Scale Model Experiment of Smart Hopper System to Remove Blockages Using Machine Vision and Collaborative Robot

Analysis of Features and Applications of Smart Glass for Utilization in the Mining Industry

Contact Info

Product

Resources

About