Vision-Based Methods for Food and Fluid Intake Monitoring: A Literature Review

Abstract

Food and fluid intake monitoring are essential for reducing the risk of dehydration, malnutrition, and obesity. The existing research has been preponderantly focused on dietary monitoring, while fluid intake monitoring, on the other hand, is often neglected. Food and fluid intake monitoring can be based on wearable sensors, environmental sensors, smart containers, and the collaborative use of multiple sensors. Vision-based intake monitoring methods have been widely exploited with the development of visual devices and computer vision algorithms. Vision-based methods provide non-intrusive solutions for monitoring. They have shown promising performance in food/beverage recognition and segmentation, human intake action detection and classification, and food volume/fluid amount estimation. However, occlusion, privacy, computational efficiency, and practicality pose significant challenges. This paper reviews the existing work (253 articles) on vision-based intake (food and fluid) monitoring methods to assess the size and scope of the available literature and identify the current challenges and research gaps. This paper uses tables and graphs to depict the patterns of device selection, viewing angle, tasks, algorithms, experimental settings, and performance of the existing monitoring systems.

NutriColoring: designing a doodling toolkit to support daily self-reported dietary assessment among office workers

“…Therefore, future research could explore coloring doodling in digital technologies to make it more adaptive and adjustable. One example could be the use of vision-based sensors, which provide non-intrusive solutions for food monitoring and show promising performance in food recognition, eating behavior detection, intake classification, and food amount estimation ( Chen and Kamavuako, 2023 ).…”

Technology to Automatically Record Eating Behavior in Real Life: A Systematic Review

“…Studies that did not report results were excluded. [ 151 ] 2023 This paper reviews the existing work […] on vision-based intake (food and fluid) monitoring methods to assess the size and scope of the available literature and identify the current challenges and research gaps. Not specified 253 (1) at least one kind of vision-based technology (e.g., RGB-D camera or wearable camera) was used in the paper; (2) eating or drinking activities or both identified in the paper; (3) the paper used human participants data; (4) at least one of the evaluation criteria (e.g., F1-score) was used for assessing the performance of the design …”

Smart Solutions for Diet-Related Disease Management: Connected Care, Remote Health Monitoring Systems, and Integrated Insights for Advanced Evaluation

“…Aligned with the concepts of connected care, integrated monitoring goes beyond conventional approaches by using advanced sensors, smart algorithms, and machine learning techniques [83]; • Adaptive framework implies real-time responsiveness: Integrated monitoring reflects the responsiveness demonstrated by connected care models through the development of an adaptable framework specifically designed for the real-time treatment of diet-related disorders. This approach enables continual assessment and change depending on new dietary patterns [84] as opposed to the static treatment programs used in traditional methods. Within the larger framework of connected care, integrated monitoring's realtime responsiveness guarantees that interventions match patients' changing dietary requests.…”