Real Time Multiple Hand Gesture Recognition System for Human Computer Interaction

Abstract

Abstract-With the increasing use of computing devices in day to day life, the need of user friendly interfaces has lead towards the evolution of different types of interfaces for human co mputer interaction. Real t ime vision based hand gesture recognition affords users the ability to interact with computers in more natural and intuitive ways. Direct use of hands as an input device is an attractive method which can co mmunicate much more information by itself in comparison to mice, joysticks etc allowing a greater nu mber of recognition system that can be used in a variety of human computer interaction applicat ions. The gesture recognition system consist of three main modules like hand segmentation, hand tracking and gesture recognition fro m hand features. The designed system further integrated with different applications like image bro wser, virtual game etc. possibilities for hu man computer interaction. Co mputer Vision based systems has the potential to provide more natural, non-contact solutions. The present research work focuses on to design and develops a practical framework for real time hand gesture Index Terms-Real t ime, gesture recognition, human computer interaction, tracking. I. INTRO DUCTIO NSince their first appearance, co mputers have become a key element of our society. Surfing the web, typing a letter, playing a video game or storing and retriev ing data are just a few o f the examp les involving the use of computers. And due to the constant decrease in price of personal computers, they will even more influence our everyday life in the near future.To efficiently use them, most computer applications require more and more interaction. Fo r that reason, human-computer interaction (HCI) has been a lively field of research these las t few years. Firstly based in the past on punched cards, reserved to experts, the interaction has evolved to the graphical interface paradigm. The interaction consists of the direct man ipulation of graphic objects such as icons and windows using a pointing device. Even if the invention of keyboard and mouse is a great progress, there are still situations in wh ich these devices can be seen as dinosaurs of HCI. This is particularly the case for the interaction with 3D objects. The 2 degrees of freedo m (DOFs) of the mouse cannot properly emulate the 3 dimensions of space. Furthermore, such interfaces are often not intuitive to use. To achieve natural and immersive hu man-co mputer interaction, the hu man hand could be used as an interface device [1]. Hand gestures are a powerfu l hu man to-hu man co mmunication channel, which forms a major part of information transfer in our everyday life. Hand gestures are an easy to use and natural way of interaction. Using hands as a device can help people co mmunicate with computers in a more intuitive and natural way. When we interact with other people, our hand movements play an important role and the information they convey is very rich in many ways. We use our hands for pointing at a person or at an object, conveying informati...

Smart home in a box: usability study for a large scale self-installation of smart home technologies

“…From that time on, topics of researches relates to ubiquitous computing expands into wide fields, such as distributed computing [5,23,32,38], mobile computing [7,19,33], location computing [8,24,26,43], mobile networking [17], context-aware computing [11,12,20,37], sensor networks [1,3,9, 25,27,29], human-computer interaction [35], artificial intelligence [14,15,15], machine learning [10,40], psychology, sociology, manufacturing and materials.…”

Correlation between Classroom Engagement and Academic Performance of Engineering Students

“…A "gesture" is defined as "a movement usually of the body or limbs that expresses or emphasizes an idea, sentiment, or attitude" (Merriam Webster 2019, page 525). Gestures are widely used as a natural form of communication between persons for simple actions such as pointing to objects to expressing feelings (Rautaray & Agrawal, 2012). Within the teacher-student learning process, instructors use hand and body gestures to convey topics, as well as use movement to keep students engaged during the lecture.…”

“…Some previous studies reported that people's most commonly used gestures include hand and arm movement, adjustments to seating or posture, touching of one-self i.e. stroking hair, done primarily for self-soothing, and other typical nervous ticks or repetitive, involuntary movements (Rautaray & Agrawal, 2012;Sariyanidi, Gunes, & Cavallaro, 2014). In the current study, the observers focused on and recorded movements of the arm and hand to measure students' classroom engagement.…”

Hand-Tracking Framework using Three-dimensional Tracking Ellipsoid

“…However, in many situations, such operations and interactions are impossible; in such a case, a user's natural body motion can be used as very useful information for the human-machine interaction. Therefore, considerable research efforts have been carried out on the techniques known as the natural user interface (NUI), in which the system attempts to track and recognize a user's action and this then provides a very efficient method for the interaction [1][2][3][4][5][6][7]. In particular, the NUI technique, which uses a user's bare hand information, is known as one of the most efficient methods that enables users to interact with any device.…”