Easy and Fast Reconstruction of a 3D Avatar with an RGB-D Sensor

Mao, Aihua; Hong, Zhang; Liu, Yuxin; Zheng, Yinglong; Li, Guiqing; Han, Guoqiang

doi:10.3390/s17051113

Cited by 15 publications

(10 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The virtual instructor reconstruction process demonstrated the feasibility of creating posture training material using 3D point cloud reconstruction, which was initially applied in computer science or medical research (Mao et al, 2017;Sinko et al, 2018). Three main takeaways will feed into the next iteration.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Develop and evaluate an augmented reality posture training tool to promote work safety

Chen

Perera

et al. 2020

Proceedings of the Human Factors and Ergonomics Society Annual

View full text Add to dashboard Cite

Conventional work posture training tools included pamphlets, one-time training orientation, and/or videos. These tools did not always yield satisfactory training outcomes, and the incident rate of work-related musculoskeletal disorders did not substantially lower. In this research, modern augmented reality (AR) technology was leveraged to deliver interactive, holistic, whole-body visual information to convey safe work postures. The developmental procedure followed DMAIC by first defining specifications of training content, which led to the development of the training tool, including 3D reconstruction of a virtual instructor and building of user interface based on user-centered framework. This AR training tool was measured and analyzed through usability evaluation, and quantitative and qualitative data were obtained for cross-validation and usability issue source identification. Findings revealed the utility of 3D reconstruction of a virtual instructor and practicality of adopting conventional usability evaluation method for AR user interface usability evaluation. Feedback from the usability evaluation via questionnaire, think aloud, and post-task open-ended responses are employed to iteratively design the next version of the AR posture training tool.

show abstract

Section: Discussionmentioning

confidence: 99%

“…The interactive posture training tool includes a vivid, human-like virtual instructor who demonstrates how to lift or bend safely. This virtual instructor was created by capturing the surface features of a real human using Red Green Blue-Depth (RGB-D) cameras (Mao et al, 2017). The RGB-D data were…”

Section: Create Point Cloud Virtual Instructormentioning

confidence: 99%

Develop and evaluate an augmented reality posture training tool to promote work safety

Chen

Perera

et al. 2020

Proceedings of the Human Factors and Ergonomics Society Annual

View full text Add to dashboard Cite

show abstract

“…The manual measurement method is less efficient and time consuming; the accuracy of the measurement is dependent on the measurement skill of the experimenter, and the reliability and repeatability are, thus, usually poor. The optical image scanning measurement approach, with the progress of science and society's development, now can be used in a variety of applications and scenarios: the measurement of human body parts, hand posture recognition, face recognition, and 3D human body reconstruction [20][21][22][23], etc. However, it usually needs to carry out three-dimensional modeling, the computational-cost is high, and the cost of the system is also very high.…”

Section: Introductionmentioning

confidence: 99%

A New Automatic Foot Arch Index Measurement Method Based on a Flexible Membrane Pressure Sensor

Zheng

2020

Sensors

View full text Add to dashboard Cite

The foot arch index is an important index to evaluate the health of human feet and the biomechanics line, aiming at addressing the shortcomings of the low efficiency and slow speed of manual foot arch index measurement; in this work, an automatic foot arch index measurement method based on a flexible membrane pressure sensor was proposed. The distribution of plantar pressure data was obtained from the flexible membrane pressure sensor and converted into a digital image. The 8-neighborhood correlation pixel method was proposed to remove the interference of isolated noise points. In order to remove the toes’ data without affecting the foot sole data, the row element association algorithm was proposed. The front and back endpoints of the foot were automatically located to obtain the foot length, and the foot arch index was also automatically obtained based on the foot arch pressure area. Whether it was a high arch foot, flat foot or normal foot, the method proposed in this paper could accurately and quickly distinguish them. The prototype was developed, and its feasibility and validity were verified by a series of tests.

show abstract

“…The term Avatar can be perceived as (1) modeling human interlocutors in the virtual environment [11,12] (e.g., virtual assistants) or (2) as the presence of (additional) human resource within the virtual environment [12][13][14]. In this article, the authors use the latter understanding of the Avatar concept.…”

Section: Introduction To the Hybrid Intelligence System (Hint)mentioning

confidence: 99%

User Experience Sensor for Man–Machine Interaction Modeled as an Analogy to the Tower of Hanoi

Gardecki

Podpora

Beniak

et al. 2020

Sensors

View full text Add to dashboard Cite

This paper presents a novel user experience optimization concept and method, named User Experience Sensor, applied within the Hybrid Intelligence System (HINT). The HINT system, defined as a combination of an extensive AI system and the possibility of attaching a human expert, is designed to be used by relational agents, which may have a physical form, such as a robot, a kiosk, be embodied in an avatar, or may also exist as only software. The proposed method focuses on automatic process evaluation as a common sensor for optimization of the user experience for every process stage and the indicator for human-expert automatic session activation. This functionality is realized by the User Experience Sensor, which constitutes one of main elements of the self-optimizing interaction system. The authors present the optimization mechanism of the HINT system as an analogy to the process of building a Tower of Hanoi. The proposed sensor evaluates the user experience and measures the user/employee efficiency at every stage of a given process, offering the user to choose other forms of information, interaction, or expert support. The designed HINT system is able to learn and self-optimize, making the entire process more intuitive and easy for each and every user individually. The HINT system with the proposed sensor, implemented in a window assembly facility, successfully reduced assembly time, increased employees’ satisfaction, and assembly quality. The proposed approach can be implemented in numerous man–machine interaction applications.

show abstract

Easy and Fast Reconstruction of a 3D Avatar with an RGB-D Sensor

Cited by 15 publications

References 35 publications

Develop and evaluate an augmented reality posture training tool to promote work safety

Develop and evaluate an augmented reality posture training tool to promote work safety

A New Automatic Foot Arch Index Measurement Method Based on a Flexible Membrane Pressure Sensor

User Experience Sensor for Man–Machine Interaction Modeled as an Analogy to the Tower of Hanoi

Contact Info

Product

Resources

About