Survey on Gesture-Based Virtual Keyboard and Mouse

Abstract

Envisioning a future where the conventional mouse and keyboard inputs are supplanted by a touchless system that harnesses the power of eye tracking and hand gestures. This visionary transformation in human-computer interaction is not without its challenges, and at the heart of this pursuit lies the goal of achieving unmatched precision and user-friendliness. This innovative system is underpinned by a fusion of technology and creativity. Hand gestures, a symbol of human expressiveness, are seamlessly integrated with Haar Cascade, offering keyboard operation and mouse control. This elegant synergy empowers users to navigate digital landscapes intuitively, minimizing the barriers between humans and machines. However, this journey is marked by the quest for absolute precision and calibration. Insights from past research underscore the significance of precision in interpreting and responding to user gestures, be it the intricate movements of the hand or the subtleties of gaze tracking. Bridging this gap, it aim to make every interaction fluid and error-free, while maintaining a commitment to user-friendliness. Given methodology unfolds as an intricate dance of technology and innovation. It involves the real-time processing of hand gestures and eye tracking data, intricate data fusion in the Gesture Recognition System, and the seamless updating of the user interface. The potential applications of this technology are as diverse as they are impactful. From enhancing accessibility for individuals with disabilities to providing hygienic control of medical equipment in healthcare settings, from delivering immersive gaming experiences to facilitating interactive learning environments in education, the reach of this system extends across various domains. This research is a testament to the belief that technology should be an enabler, not an obstacle. It is a journey that involves overcoming challenges in pursuit of a user-centric experience. Key Words: AR, CNN, CPU, IMU, VR