From Multimedia Logs to Personal Chronicles

Oh, Hyungik; Jain, Ramesh

doi:10.1145/3123266.3123375

Cited by 32 publications

(17 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The use of WIoT technologies that capture in-the-moment experiences and contexts, such as the Oura ring and Samsung Gear Sport smartwatch, has been shown to improve the ecological validity of mental health assessments [58,59]. Thus, a goal of our prospective study is to use a multimodal assessment method that combines data from emerging WIoT technologies and personal chronicles in a daily activity logging framework (ie, the Personicle app) [60,61], to better understand the unique contexts and factors of stress and emotional well-being, as well as the risks and development of psychopathologies among young adults. More specifically, this study aims to investigate daily factors (ie, stressors and activities) and their relationship with the psychopathologies and daily emotions of college students.…”

Section: Objectivementioning

confidence: 99%

Assessing the Mental Health of Emerging Adults Through a Mental Health App: Protocol for a Prospective Pilot Study

Yunusova¹,

Lai²,

Rivera³

et al. 2021

JMIR Res Protoc

View full text Add to dashboard Cite

Background Individuals can experience different manifestations of the same psychological disorder. This underscores the need for a personalized model approach in the study of psychopathology. Emerging adulthood is a developmental phase wherein individuals are especially vulnerable to psychopathology. Given their exposure to repeated stressors and disruptions in routine, the emerging adult population is worthy of investigation. Objective In our prospective study, we aim to conduct multimodal assessments to determine the feasibility of an individualized approach for understanding the contextual factors of changes in daily affect, sleep, physiology, and activity. In other words, we aim to use event mining to predict changes in mental health. Methods We expect to have a final sample size of 20 participants. Recruited participants will be monitored for a period of time (ie, between 3 and 12 months). Participants will download the Personicle app on their smartphone to track their activities (eg, home events and cycling). They will also be given wearable sensor devices (ie, devices that monitor sleep, physiology, and physical activity), which are to be worn continuously. Participants will be asked to report on their daily moods and provide open-ended text responses on a weekly basis. Participants will be given a battery of questionnaires every 3 months. Results Our study has been approved by an institutional review board. The study is currently in the data collection phase. Due to the COVID-19 pandemic, the study was adjusted to allow for remote data collection and COVID-19–related stress assessments. Conclusions Our study will help advance research on individualized approaches to understanding health and well-being through multimodal systems. Our study will also demonstrate the benefit of using individualized approaches to study interrelations among stress, social relationships, technology, and mental health. International Registered Report Identifier (IRRID) DERR1-10.2196/25775

show abstract

Section: Objectivementioning

confidence: 99%

Assessing the Mental Health of Emerging Adults Through a Mental Health App: Protocol for a Prospective Pilot Study

Yunusova¹,

Lai²,

Rivera³

et al. 2021

JMIR Res Protoc

View full text Add to dashboard Cite

show abstract

“…The daily activity recognition could be further enhanced by merging the visual log with other multi-sensory data that can be collected using smartphones, wearable devices, and different IoT systems [7]. Some applications attempt to accomplish this task without using the visual logs to make the logging process more unobtrusive [37].…”

Section: Related Work 21 Daily Events Aggregation: Lifelogsmentioning

confidence: 99%

“…Building the Personal Event Chronicle is an active research topic, and many researchers are working on systems to recognize and combine daily life events from different sources and sensors in an unobtrusive manner. [37] describes a system that utilizes a smartphone to collect various data streams and segment an individual's day into widely recognized life events [23]. In this work, we propose to use any such system which recognizes a subset of life events and aggregate the output of those systems to recognize events that directly impact user's health in one or more ways.…”

Section: Events Aggregation Frameworkmentioning

confidence: 99%

“…These sensors are capable of tracking our life the whole day, every day. Lifelogging systems do precisely this [37], and track events related to a person's actions (such as exercise or food consumed), or their physical environment (such as exposure to smoke from a fire). Capturing all such events and data streams allows us to enhance the quality of continuous health monitoring systems.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Continuous Health Interface Event Retrieval

Pandey

Nag

Jain

2020

Proceedings of the 2020 International Conference on Multimedia Retrieval

Self Cite

View full text Add to dashboard Cite

Knowing the state of our health at every moment in time is critical for advances in health science. Using data obtained outside an episodic clinical setting is the first step towards building a continuous health estimation system. In this paper, we explore a system that allows users to combine events and data streams from different sources and retrieve complex biological events, such as cardiovascular volume overload, using measured lifestyle events. These complex events, which have been explored in biomedical literature and which we call interface events, have a direct causal impact on the relevant biological systems; they are the interface through which the lifestyle events influence our health. We retrieve the interface events from existing events and data streams by encoding domain knowledge using the event operator language. The interface events can then be utilized to provide a continuous estimate of the biological variables relevant to the user's health state. The event-based framework also makes it easier to estimate which event is causally responsible for a particular change in the individual's health state.

show abstract

“…Similar approaches can be used for ubiquitous computing and designing effective user interventions through smartphones, wearables, and IoT devices. We are constantly monitoring our life using a variety of devices and applications allowing us to estimate the state of different aspects of our life, health, and habits [4, 5]. We can take further advantage of this ubiquitous computing paradigm to develop a navigational approach to health, in which our computing services cater to our individual preferences and help actuate actions that lead us towards our health goals.…”

Section: Introductionmentioning

confidence: 99%

Ubiquitous Event Mining to Enhance Personal Health

Pandey

Nag

Jain

2018

Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computi

Self Cite

View full text Add to dashboard Cite

Advances in user interfaces, pattern recognition, and ubiquitous computing continue to pave the way for better navigation towards our health goals. Quantitative methods which can guide us towards our personal health goals will help us optimize our daily life actions, and environmental exposures. Ubiquitous computing is essential for monitoring these factors and actuating timely interventions in all relevant circumstances. We need to combine the events recognized by different ubiquitous systems and derive actionable causal relationships from an event ledger. Understanding of user habits and health should be teleported between applications rather than these systems working in silos, allowing systems to find the optimal guidance medium for required interventions. We propose a method through which applications and devices can enhance the user experience by leveraging event relationships, leading the way to more relevant, useful, and, most importantly, pleasurable health guidance experience.

show abstract

From Multimedia Logs to Personal Chronicles

Cited by 32 publications

References 30 publications

Assessing the Mental Health of Emerging Adults Through a Mental Health App: Protocol for a Prospective Pilot Study

Assessing the Mental Health of Emerging Adults Through a Mental Health App: Protocol for a Prospective Pilot Study

Continuous Health Interface Event Retrieval

Ubiquitous Event Mining to Enhance Personal Health

Contact Info

Product

Resources

About