Software switches: novel hands-free interaction techniques for quadriplegics based on respiration–machine interaction

Esiyok, Cagdas; Aşkın, Ayhan; Albayrak, Şahin

doi:10.1007/s10209-019-00645-2

Cited by 3 publications

(6 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…SITs are one of the most important assistive technology solutions for people with motor disabilities. Therefore, researchers and manufacturers developed plenty of different SITs which can be separated into two main groups as traditional hardware switches and virtual switches: while traditional switches are electronic devices varying from breath-activated ones [2] to tooth-click switches [3], virtual switches [4–6] are generally computer applications that imitate switch functions in a way that a specific body gesture detected via sensors or input devices (such as head nodding detected by a camera) is considered as an activated switch. They assist users to interact with their environment.…”

Section: Introductionmentioning

confidence: 99%

“…Currently, SIT evaluation is performed in three ways: (a) collecting subjective data [5, 10–13] via questionnaires, observations, and interviews by an interdisciplinary team; (b) collecting objective data [3, 6, 14–20] via performance tests; and (c) collecting both subjective and objective data [4, 21, 22]. Because the subjective data alone might be unreliable and manipulated easily for performance evaluation, it might be hard to succeed in determining the optimum switch setup on the first attempts in many cases by therapists.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

SITbench 1.0: A Novel Switch-Based Interaction Technique Benchmark

Esiyok

Albayrak

2019

Journal of Healthcare Engineering

Self Cite

View full text Add to dashboard Cite

Evaluation process of a switch-based interaction technique (SIT) requires an interdisciplinary team effort and takes a considerable amount of time. Collecting subjective evaluation data from the users is a very common approach, but the subjective evaluation data alone might be manipulated and unreliable for comparing performances in many cases. Thus, therapists generally cannot succeed in determining the optimum SIT setup (i.e., determining the most appropriate combination of setup variables such as the switch type or switch site) at first attempts since it is hard to evaluate the measurable performance by collecting subjective data instead of objective data. Inevitably, each unsuccessful attempt to reach the optimum SIT setup results in a loss of serious time and effort. On the contrary, a benchmark application is also required to make performance evaluation of SITs by using a number of standard tests and empirical attributes. It is obvious that a quicker and more accurate SIT evaluation process provides a better cost and schedule management considering the increasing number of SIT users in the world. Therefore, we propose a novel benchmark for performance evaluation called SITbench that provides a quicker and more accurate switch evaluation process by collecting and saving the objective data automatically. We conducted a user study with eight participants and demonstrated that the objective data collected via the SITbench helped to determine the optimum SIT setup accurately. Result of a questionnaire applied to evaluate the SITbench itself was also satisfactory. SITbench is expected to help researchers and therapists to make a better evaluation according to any change done in SIT setup variables (switch type, activation method, etc.) with the aim of reaching the optimum SIT setup, which leads to a better cost and schedule management. As the first benchmark application compatible with all SITs, which can emulate keyboard characters or mouse clicks, it can be utilized by assistive technology professionals to make comparisons and evaluations automatically via standardized tests.

show abstract

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

SITbench 1.0: A Novel Switch-Based Interaction Technique Benchmark

Esiyok

Albayrak

2019

Journal of Healthcare Engineering

Self Cite

View full text Add to dashboard Cite

show abstract

“…Similarly, Abiri et al [28] discussed a Brain Computer Interaction (BCI) based interaction system for controlling the cursor using EEG signals. Another interaction technique based on a person's respiration is presented in [29] where two methods are used to create an event in the system for interaction. In one of the two methods, a microphone is used to detect hard exhalation (person's breath) by the user.…”

Section: Embedded System To Interact With Desktop Computermentioning

confidence: 99%

Developing a Novel Hands-Free Interaction Technique Based on Nose and Teeth Movements for Using Mobile Devices

Islam¹,

Aadeeb²,

Khan³

et al. 2021

IEEE Access

View full text Add to dashboard Cite

Human-mobile interaction is aimed at facilitating interaction with the smartphone devices. The conventional way to interact with mobile devices is through manual input where most of the applications are made assuming that the end user has full control over their hand movements. However, this assumption excludes people who are unable to use their hands or have suffered limb damage. In this paper, we proposed a nose and teeth based interaction system, which allows the users to control their mobile devices completely hands free. The proposed system uses the front facing camera of the smartphone to track the position of the nose for cursor control on the smartphone screen. The system detects teeth for performing the touch screen events such as tap, scroll, long press, and drag. Viola-Jones algorithm is used to detect the face and teeth based on the Haar features. After detecting the face, the nose position is calculated and tracked continuously using Lucas Kanade's method for optical flow estimation. All the touch screen events have been implemented in the system so that the user can execute all the operations of the smartphone. To evaluate the performance and the effect of (smartphone) device type on the execution time, the proposed system was installed in 3 smartphone devices and 7 trials for each device were performed by 3 different able-bodied elderly persons. The result shows a significant success rate for the detection of nose and teeth, and for the execution of the operations. The execution time of each operation slightly varies by 0.72s on average because of the configuration of the smartphones.INDEX TERMS HCI, human-mobile interaction, gesture operations, disabled user, accessibility, mobile device, smartphone.

show abstract

“…HeadCam is based on a real-time video motion tracking algorithm which is similar with the study by Esiyok et al [6]. In principle, the user's head is tracked by a built-in camera or a standard web-cam to translate the roll movements of the user's head (as can be seen in Fig.…”

Section: Headcammentioning

confidence: 99%

“…As a result of our literature review, we identified two major problems of current head-operated interaction techniques with a single head-gesture access support: (1) requirement of dedicated devices, (2) compatibility with switch-accessible interfaces. To overcome these problems, we employed our software switch approach of which first examples were previously presented in Esiyok et al's study [6].…”

Section: Introductionmentioning

confidence: 99%

Novel hands-free interaction techniques based on the software switch approach for computer access with head movements

Esiyok

Aşkın

Albayrak

2020

Univ Access Inf Soc

Self Cite

View full text Add to dashboard Cite

Head-operated computer accessibility tools (CATs) are useful solutions for the ones with complete head control; but when it comes to people with only reduced head control, computer access becomes a very challenging task since the users depend on a single head-gesture like a head nod or a head tilt to interact with a computer. It is obvious that any new interaction technique based on a single head-gesture will play an important role to develop better CATs to enhance the users' self-sufficiency and the quality of life. Therefore, we proposed two novel interaction techniques namely HeadCam and HeadGyro within this study. In a nutshell, both interaction techniques are based on our software switch approach and can serve like traditional switches by recognizing head movements via a standard camera or a gyroscope sensor of a smartphone to translate them into virtual switch presses. A usability study with 36 participants (18 motor-impaired, 18 able-bodied) was also conducted to collect both objective and subjective evaluation data in this study. While HeadGyro software switch exhibited slightly higher performance than HeadCam for each objective evaluation metrics, HeadCam was rated better in subjective evaluation. All participants agreed that the proposed interaction techniques are promising solutions for computer access task.

show abstract

Software switches: novel hands-free interaction techniques for quadriplegics based on respiration–machine interaction

Cited by 3 publications

References 24 publications

SITbench 1.0: A Novel Switch-Based Interaction Technique Benchmark

SITbench 1.0: A Novel Switch-Based Interaction Technique Benchmark

Developing a Novel Hands-Free Interaction Technique Based on Nose and Teeth Movements for Using Mobile Devices

Novel hands-free interaction techniques based on the software switch approach for computer access with head movements

Contact Info

Product

Resources

About