A vision-based system for hand washing quality assessment with real-time feedback

Designing a Computer-Vision Application: A Case Study for Hand-Hygiene Assessment in an Open-Room Environment

“…Hand hygiene plays a critical role in reducing contamination in our food supply and in reducing disease transmission. Several image-and video-based systems have been developed to assess or assist hand hygiene for healthcare workers [5,6,[8][9][10][11][12] and people with dementia [4,[13][14][15]. In [8,9], image processing reports when hospital staff are present at a hand-washing station.…”

“…Robustness to lighting conditions is obtained by combining skin tone and motion during hand segmentation. A real-time and improved version of this system using linear discriminant analysis is presented in [5]. The COACH system (Cognitive Orthosis for Assisting aCtivities in the Home) is an interactive system that prompts patients with dementia to perform correct hand-hygiene when they are unable to perform it on their own [4].…”

“…One key difference between the system we develop here and the methods in [5,6,13] is that our cameras are not overhead, and the sink area where handwashing occurs may have extraneous objects. This increases the image and video processing challenges, but also opens up opportunities for the system to observe other food handling activities.…”

“…For example, we chose to passively observe people washing their hands which means they may not execute all steps and some actions may be out of camera view. In contrast, other handwashing systems have been designed to be interactive or even educational about what the next action to execute should be [4,5]. The interactive approach simplifies the image processing but constrains people to keep their hands over the sink in camera view during the washing activities.…”

“…We use the term "open-room environment" to contrast these environments with both the much smaller restrooms of our previous work and the top-down sink-only views of [4][5][6].…”