Integrated Head-Tilt and Electromyographic Cursor Control

Vojtech, Jennifer M.; Hablani, Surbhi; Cler, Gabriel J.; Stepp, Cara E.

doi:10.1109/tnsre.2020.2987144

Cited by 10 publications

(11 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Individual limitations in motion constraints were not considered in the current analysis method. In the future, THC could be equipped with a combination of IMUs and We have demonstrated the ability of the proposed method, THC 1,2 , to control the cursor and object orientation using head movements under various demanding conditions. In the video, the controls are moved slowly to mimic the movements of people with motor limitations.…”

Section: Discussionmentioning

confidence: 99%

“…The mouse cursor advances to the desired position, determined by the user's facial orientation. Head tilt and electromyography (EMG) integration were used to move the cursor control [1]. Computer vision speeds up target selection with head tilt, while EMG improves mean free path efficiency and target selection accuracy.…”

Section: A Mouse Head-controlmentioning

confidence: 99%

“…uman-computer interaction (HCI) has advanced recently, making computers more accessible to persons with the restricted motor ability [1,2]. Previous studies have developed various devices to assist disabled people using gestures and other non-contact techniques [3,4].…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Touchless Head-Control (THC): Head Gesture Recognition for Cursor and Orientation Control

Rahmaniar

Ma’arif

Lin

2022

IEEE Trans. Neural Syst. Rehabil. Eng.

View full text Add to dashboard Cite

The touchless techniques in humancomputer interaction (HCI) can effectively expand computer access capabilities for disabled people. This paper presents Touchless Head-Control (THC), an assistive system method for computer cursor control based on head pose captured with an RGB camera. Our work aimed to replace the standard cursor control using a device on the user's head. The convolutional neural networks with predicted fine-grained feature maps and binned classification were applied to estimate the head pose angles. The mouse pointer or cursor is moved to actual locations on the screen based on head movement (yaw and pitch) and the center position of the face. Head tilt to the right or left (roll) to control the mouse button. In addition, the proposed method can be used to simulate the movement of the robot or joystick using the head to control objects within three degrees of freedom (DOF). Various participants were involved in the interaction design evaluation, in which target selection accuracy, travel time, and path efficiency were measured. This technology allows people with limited motor skills to easily control a PC cursor and 3D object orientation without the use of additional equipment or sensors.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: A Mouse Head-controlmentioning

confidence: 99%

See 1 more Smart Citation

Touchless Head-Control (THC): Head Gesture Recognition for Cursor and Orientation Control

Rahmaniar

Ma’arif

Lin

2022

IEEE Trans. Neural Syst. Rehabil. Eng.

View full text Add to dashboard Cite

show abstract

“…For each participant, the inertial sensing component of the hybrid sEMG/IMU access method was secured to the center of the forehead—with the y-axis of the IMU parallel to the transverse axes of the head—and the EMG sensing component applied over the orbicularis oculi of the preferred eye. Computer access thresholds were calibrated by instructing each participant to comfortably tilt their head to the left and right twice, up and down twice, and wink or hard blink twice [ 11 , 28 ]. These data were used to tune the 2D range of cursor movement, as described in detail in [ 28 ].…”

Section: System Evaluationmentioning

confidence: 99%

“…Computer access thresholds were calibrated by instructing each participant to comfortably tilt their head to the left and right twice, up and down twice, and wink or hard blink twice [ 11 , 28 ]. These data were used to tune the 2D range of cursor movement, as described in detail in [ 28 ].…”

Section: System Evaluationmentioning

confidence: 99%

Ability-based Keyboards for Augmentative and Alternative Communication: Understanding How Individuals’ Movement Patterns Translate to More Efficient Keyboards

Mitchell

Cler

Fager

et al. 2022

CHI Conference on Human Factors in Computing Systems Extended Abstracts

View full text Add to dashboard Cite

This study presents the evaluation of ability-based methods extended to keyboard generation for alternative communication in people with dexterity impairments due to motor disabilities. Our approach characterizes user-specific cursor control abilities from a multidirectional point-select task to configure letters on a virtual keyboard based on estimated time, distance, and direction of movement. These methods were evaluated in three individuals with motor disabilities against a generically optimized keyboard and the ubiquitous QWERTY keyboard. We highlight key observations relating to the heterogeneity of the manifestation of motor disabilities, perceived importance of communication technology, and quantitative improvements in communication performance when characterizing an individual’s movement abilities to design personalized AAC interfaces.

show abstract

Evaluating Camera Mouse as a computer access system for augmentative and alternative communication in cerebral palsy: A case study

MacLellan,

Stepp,

Fager

et al. 2023

Assistive Technology

View full text Add to dashboard Cite

Integrated Head-Tilt and Electromyographic Cursor Control

Cited by 10 publications

References 39 publications

Touchless Head-Control (THC): Head Gesture Recognition for Cursor and Orientation Control

Touchless Head-Control (THC): Head Gesture Recognition for Cursor and Orientation Control

Ability-based Keyboards for Augmentative and Alternative Communication: Understanding How Individuals’ Movement Patterns Translate to More Efficient Keyboards

Evaluating Camera Mouse as a computer access system for augmentative and alternative communication in cerebral palsy: A case study

Contact Info

Product

Resources

About