Multimodal Food Journaling

Oh, Hyungik; Nguyen, Jonathan; Soundararajan, Soundarya; Jain, Ramesh

doi:10.1145/3264996.3265000

Cited by 14 publications

(22 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Three studies only included participants with a chronic health condition, either having diabetes (n = 1) [29] or requiring dialysis (n = 2) [4], [13]. One study included a variety of accents [28].…”

Section: A Study Design 1) Participantsmentioning

confidence: 99%

“…The setting in which recordings took place fell into two categories: free living, where the participant has full control over food selection (n = 17) [4], [5], [8], [13]- [15], [19]- [21], [23]- [25], [27], [29], [30], [36], [41] and controlled, where the researchers have that control (n = 4). Where the recording was controlled researchers either: created a script for participants to read (n = 2) [26], [28]; pre-made the meal participants were asked to describe (n = 1) [22]; or provided a limited set of items (n = 1) [16].…”

Section: ) Settingmentioning

confidence: 99%

“…Four studies recorded some form of ground truth data for comparison with participant collected data. Three of these were studies in a controlled setting, so food identity and quantity were recorded independently by researchers and thus known [22], [26], [28]. The last study had participants freely pick food from a cafeteria that was uncontrolled, but had researchers record the exact items and weight before consumption [30].…”

Section: ) Comparatormentioning

confidence: 99%

See 2 more Smart Citations

Speech Recording for Dietary Assessment: A Systematic Literature Review

2022

View full text Add to dashboard Cite

Traditional methods of capturing people's dietary intake are complex and labour-intensive, requiring a high level of literacy and time. Speech recording has potential to reduce these barriers, and recent technological advances have greatly increased the viability of this approach. The aim of this paper is to establish the current state of research on the usage of speech records in dietary assessment. To this end, we performed a systematic literature review and summarised the current state of research along a conceptual framework that captures the components involved in using speech records for dietary assessment. Six databases from the nutrition and computing domains were interrogated, resulting in 21 relevant papers. Speech recording in an unstructured format was preferred when compared against other methods by all three studies reporting comparisons. High technological satisfaction and ease of use were noted by all eight studies reporting user acceptance. When recording data, 78% of studies focused on collecting prospective food records. The choice of device reflected this, with 15 of 18 studies reporting a form of handheld, portable collection device intended to be always available. To process data, nine studies performed automated speech transcription achieving an average accuracy of 83%, seven of which utilized a readily available commercial service. Of the five studies that used natural language processing to further automate analysis, an average accuracy of 82% was reported. Further research is required to adapt these prototypes to address practical challenges in dietary assessment and monitoring (e.g. self-monitoring for low-literacy users).

show abstract

Section: A Study Design 1) Participantsmentioning

confidence: 99%

Section: ) Settingmentioning

confidence: 99%

Section: ) Comparatormentioning

confidence: 99%

See 1 more Smart Citation

Speech Recording for Dietary Assessment: A Systematic Literature Review

2022

View full text Add to dashboard Cite

show abstract

“…For example, FoodLog [17] has contributed to a record of users' food intake simply by taking photos of their meals. Recently, multimodal foodlog [31] is proposed to automatically recognize the starting moment of eating, and then prompting the user to begin a voice command food journaling method. With the popularity of mobile devices and advanced sensing technologies, learning user's food preference via exploring food log will be one 7 http://nutrino.co/ Fig.…”

Section: B Personal Model Construction For Food Recommendationmentioning

confidence: 99%

Food Recommendation: Framework, Existing Solutions, and Challenges

Min

Jiang

Jain

2020

IEEE Trans. Multimedia

Self Cite

View full text Add to dashboard Cite

A growing proportion of the global population is becoming overweight or obese, leading to various diseases (e.g., diabetes, ischemic heart disease and even cancer) due to unhealthy eating patterns, such as increased intake of food with high energy and high fat. Food recommendation is of paramount importance to alleviate this problem. Unfortunately, modern multimedia research has enhanced the performance and experience of multimedia recommendation in many fields such as movies and POI, yet largely lags in the food domain. This article proposes a unified framework for food recommendation, and identifies main issues affecting food recommendation including building the personal model, analyzing unique food characteristics, incorporating various context and domain knowledge. We then review existing solutions for these issues, and finally elaborate research challenges and future directions in this field. To our knowledge, this is the first survey that targets the study of food recommendation in the multimedia field and offers a collection of research studies and technologies to benefit researchers in this field.

show abstract

“…A text-based conversational agent is proposed in [6] to improve nutritional lifestyle. Other solutions rely on automatic classification of chewing sound [3], recognition of eating moments trough analysis of heart rate and activity patterns [26], or scanning of grocery receipts [22]. Other systems, including the one proposed by Chi et al [8], provide accurate calories counts using a combination of cameras, connected kitchen scales, and food databases.…”

Section: Related Workmentioning

confidence: 99%

Recognition of cooking activities through air quality sensor data for supporting food journaling

Gerina

Massa

Moi

et al. 2020

Hum. Cent. Comput. Inf. Sci.

View full text Add to dashboard Cite

The 2018 Global Nutrition Report. 1 of the World Health Organization (WHO) reveals that malnutrition affects, in different forms, every country of the world. Malnutrition determines more health issues than any other cause, and progress towards better nutrition is still too slow. In particular, in developed countries, overweight and obesity in adults are a cause of several non-communicable diseases, including diabetes, heart disease, stroke, different types of cancer, musculoskeletal disorders, and respiratory symptoms. 2 Micronutrient deficiencies are also cause of severe health issues, such as anaemia.

show abstract

Multimodal Food Journaling

Cited by 14 publications

References 33 publications

Speech Recording for Dietary Assessment: A Systematic Literature Review

Speech Recording for Dietary Assessment: A Systematic Literature Review

Food Recommendation: Framework, Existing Solutions, and Challenges

Recognition of cooking activities through air quality sensor data for supporting food journaling

Contact Info

Product

Resources

About