This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
A wearable based long-term lifelogging system is desirable for the purpose of reviewing and improving users lifestyle habits. Energy harvesting (EH) is a promising means for realizing sustainable lifelogging. However, present EH technologies suffer from instability of the generated electricity caused by changes of environment, e.g., the output of a solar cell varies based on its material, light intensity, and light wavelength. In this paper, we leverage this instability of EH technologies for other purposes, in addition to its use as an energy source. Specifically, we propose to determine the variation of generated electricity as a sensor for recognizing "places" where the user visits, which is important information in the lifelogging system. First, we investigate the amount of generated electricity of selected energy harvesting elements in various environments. Second, we design a system called EHAAS (Energy Harvesters As A Sensor) where energy harvesting elements are used as a sensor. With EHAAS, we propose a place recognition method based on machine-learning and implement a prototype wearable system. Our prototype evaluation confirms that EHAAS achieves a place recognition accuracy of 88.5% F-value for nine different indoor and outdoor places. This result is better than the results of existing sensors (3-axis accelerometer and brightness). We also clarify that only two types of solar cells are required for recognizing a place with 86.2% accuracy.
With the spread of smart devices, people may obtain a variety of information on their surrounding environment thanks to sensing technologies. To design more context-aware systems, psychological user context (e.g., emotional status) is a substantial factor for providing useful information in an appropriate timing. As a typical use case that has a high demand for context awareness but is not tackled widely yet, we focus on the tourism domain. In this study, we aim to estimate the emotional status and satisfaction level of tourists during sightseeing by using unconscious and natural tourist actions. As tourist actions, behavioral cues (eye and head/body movement) and audiovisual data (facial/vocal expressions) were collected during sightseeing using an eye-gaze tracker, physical-activity sensors, and a smartphone. Then, we derived high-level features, e.g., head tilt and footsteps, from behavioral cues. We also used existing databases of emotionally rich interactions to train emotion-recognition models and apply them in a cross-corpus fashion to generate emotional-state prediction for the audiovisual data. Finally, the features from several modalities are fused to estimate the emotion of tourists during sightseeing. To evaluate our system, we conducted experiments with 22 tourists in two different touristic areas located in Germany and Japan. As a result, we confirmed the feasibility of estimating both the emotional status and satisfaction level of tourists. In addition, we found that effective features used for emotion and satisfaction estimation are different among tourists with different cultural backgrounds.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.