AI Virtual Mouse Using Hand Gesture Recognition

Abstract

The mouse is one of HCI's (Human Computer Interaction) incredible inventions. A wireless mouse or a Bluetooth mouse still uses devices because a battery is needed for power and a dongle is needed to connect the mouse to the PC.Therefore, they are not totally device-free. The proposed AI virtual mouse system can solve this problem by using a webcam or built-in camera to record hand motions and identify hand tips using computer vision. The system's algorithm makes use of the machine learning algorithm. The computer can be controlled digitally and cando left-click, right-click, scrolling, and computer cursor functions based on hand motions without the need for a physical mouse. Deep learning is the basis for the hand detection method. As a result, by eliminating human contact and the requirement for external devices to operate the computer, the suggested strategy will stop the spread of COVID-19.