Teaching natural user interaction using OpenNI and the Microsoft Kinect sensor

Villaroman, Norman H.; Rowe, Dale C.; Swan, Bret R.

doi:10.1145/2047594.2047654

Cited by 107 publications

(47 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Numerous programming projects are accessible to be used with Kinect, such as OpenKinect, OpenNI, Microsoft Kinect for windows SDK (Boulos et al, 2011). OpenKinect is designed free for equipping the Kinect with computers and other devices in Villaroman, Rowe, and Swan (2011). OpenNI is able to support a large amount of different devices apart from Kinect in Villaroman et al (2011), which utilizes NITE to get the skeleton information of the operator, according to Bolíbar (2012).…”

Section: Kinect Sensor and Development Worktationmentioning

confidence: 99%

“…OpenKinect is designed free for equipping the Kinect with computers and other devices in Villaroman, Rowe, and Swan (2011). OpenNI is able to support a large amount of different devices apart from Kinect in Villaroman et al (2011), which utilizes NITE to get the skeleton information of the operator, according to Bolíbar (2012). Microsoft Kinect for windows SDK is another commonly used platform produced by Microsoft in Bolíbar (2012).…”

Section: Kinect Sensor and Development Worktationmentioning

confidence: 99%

See 1 more Smart Citation

Teleoperation control of Baxter robot using Kalman filter-based sensor fusion

Yang

Wan

et al. 2017

Systems Science & Control Engineering

View full text Add to dashboard Cite

Kalman filter has been successfully applied to fuse the motion capture data collected from Kinect sensor and a pair of MYO armbands to teleoperate a robot. A new strategy utilizing the vector approach has been developed to accomplish a specific motion capture task. The arm motion of the operator is captured by a Kinect sensor and programmed with Processing software. Two MYO armbands with the inertial measurement unit embedded are worn on the operator's arm, which is used to detect the upper arm motion of the human operator. This is utilized to recognize and to calculate the precise speed of the physical motion of the operator's arm. User Datagram Protocol is employed to send the human movement to a simulated Baxter robot arm for teleoperation. In order to obtain joint angles for human limb utilizing vector approach, RosPy and Python script programming has been utilized. A series of experiments have been conducted to test the performance of the proposed technique, which provides the basis for the teleoperation of simulated Baxter robot. ARTICLE HISTORY

show abstract

Section: Kinect Sensor and Development Worktationmentioning

confidence: 99%

Section: Kinect Sensor and Development Worktationmentioning

confidence: 99%

Teleoperation control of Baxter robot using Kalman filter-based sensor fusion

Yang

Wan

et al. 2017

Systems Science & Control Engineering

View full text Add to dashboard Cite

show abstract

“…In Figure 2 it is showed the details of the system in which is used the smart resource. The smart device is using the OpenNI library [11] to the xTion sensor connection. The image processing is done using the OpenCV library [12], implementing the connection and distribution with the Linux socket library.…”

Section: System Proposed Descriptionmentioning

confidence: 99%

Performance and Results of the Triple Buffering Built-In in a Raspberry PI to Optimize the Distribution of Information from a Smart Sensor

Jimenez-Garcia

Poza-Lujan

Posadas-Yagüe

et al. 2014

Advances in Intelligent Systems and Computing

View full text Add to dashboard Cite

“…For example, Ghose, Chakravarty, Agrawal, and Ahmed, N. (2013) proposed a system for unobtrusive automated indoor surveillance of subjects in indoor environment using the Kinect sensor. Villaroman, Rowe, and Swan (2011) suggested that the launch of Kinect and its functional class libraries have allowed Kinect to flourish in different areas, including the design of natural user interfaces. Lou, Wu, Zhang, Zhang, and Chen (2012) proposed using Kinect and Wii Remote to control Windows in a multi-user interactive system that can be either desktop-or wall-sized.…”

Section: Introductionmentioning

confidence: 99%

A Situated Cultural Festival Learning System Based on Motion Sensing

Chang

Lin

Fang

et al. 2016

EURASIA J MATH SCI T

View full text Add to dashboard Cite

A situated Chinese cultural festival learning system based on motion sensing is developed in this study. The primary design principle is to create a highly interactive learning environment, allowing learners to interact with Kinect through natural gestures in the designed learning situation to achieve efficient learning. The system has the following characteristics: the learning activities and contents are designed according to the key elements of situated learning theory; the system combines augmented reality with a real environment to provide story-based learning situations for learners. The Lantern Festival is used as the learning objective of this study, and 74 students from four third to fourth-grade level classes at Shanhua Elementary School in Tainan City were recruited as the study participants. In the experiment, the students were divided into a control group receiving traditional teaching and an experimental group that employed the system developed in this study. To assess the proposed system, questionnaire analysis and learning achievement assessment were conducted. The questionnaire includes situated learning, learning materials and operating interaction. The learning achievement was assessed by using the ttest for pre-test and post-test. The experiment shows that the system can indeed enhance users' learning interest and outcomes.

show abstract

Teaching natural user interaction using OpenNI and the Microsoft Kinect sensor

Cited by 107 publications

References 4 publications

Teleoperation control of Baxter robot using Kalman filter-based sensor fusion

Teleoperation control of Baxter robot using Kalman filter-based sensor fusion

Performance and Results of the Triple Buffering Built-In in a Raspberry PI to Optimize the Distribution of Information from a Smart Sensor

A Situated Cultural Festival Learning System Based on Motion Sensing

Contact Info

Product

Resources

About