A generic framework for the design of visual-based gesture control interface

This paper proposes an effective and robust hand tracking and fingertip detection method and applies it to a novel vision based human computer interaction system: Visual Keyboard System For Smart TV (VKS). The both hands tracking and fingertip recognition approach consists of three stages. First, based on the CAMSHIFT, Motion Template and Shape Template Matching, the both hands were tracked by Multi Object Tracking CAMSHIFT. Then, the location of fingertip was localized precisely based on Motion Template. After those process, we have the Robust Shape Template Matching to recognize a fingertip. Experiments suggest that the proposed our method is capable of detecting fingertip recognition in a reliable manner even in a complex background under different light conditions without any markers. The Fingertip Recognition Visual Keyboard System in this paper is particularly advantageous for Human-computer Interaction (HCI) in that users can communicate with SMART TV by their favorite mean: fingertip gesturing. At the same time, they can perform typing with only their fingertip directly.

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

hi@scite.ai

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

A generic framework for the design of visual-based gesture control interface

Cited by 7 publications

References 10 publications

Interactive 3D animation system based on touch interface and efficient creation tools

Interactive 3D animation system based on touch interface and efficient creation tools

Local Operator Interface (LOI) Testing using Intelligent System

Visual Keyboard for Smart TV Using RGB Camera

Contact Info

Product

Resources

About