Augmented-Reality Computer-Vision Assisted Disaggregated Energy Monitoring and IoT Control Platform

Purmaissur, Jannish; Towakel, Praveer; Guness, Shivanand P.; Seeam, Amar; Bellekens, Xavier

doi:10.1109/iconic.2018.8601199

Cited by 12 publications

(13 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…An interaction device is a platform that visualizes AR content to the agent and it may also receive input from the agent. The interaction device can have many forms, such as a mobile device (e.g., smartphone, tablet PC) [10,11,[33][34][35][36][37]39,40,42,44,46,48,[50][51][52], HMD [12,38,41,45,49], PC/TV monitor [41,43,47], and projector [41].…”

Section: Interaction Devicesmentioning

confidence: 99%

“…In order to visualize AR content, an agent moves the camera of an interaction device to locate an identifier within the camera view. The identifier can be either printed images used as AR markers [10,[34][35][36]39,40,48], physical objects that can be recognized using object/image recognition [11,12,33,34,37,38,41,42,44,46,[49][50][51][52], or environments for using spatial data [39,45]. The second identified input source is the camera view for capturing an agent's hands.…”

Section: Inputmentioning

confidence: 99%

“…However, the second output source could be found in 11 out of 23 studies that used vision as an output modality. When an MI system allows for an agent to manipulate IoT devices through a touchscreen [10,11,34,40,42,[48][49][50][51][52] or by hand gestures [12], the result of IoT device manipulation is visually presented in the real-world to the agent. Thus, we categorized 11 studies that allowed the agent to control IoT devices into the vision modality category.…”

Section: Outputmentioning

confidence: 99%

See 2 more Smart Citations

Multimodal Interaction Systems Based on Internet of Things and Augmented Reality: A Systematic Literature Review

2021

View full text Add to dashboard Cite

Technology developments have expanded the diversity of interaction modalities that can be used by an agent (either a human or machine) to interact with a computer system. This expansion has created the need for more natural and user-friendly interfaces in order to achieve effective user experience and usability. More than one modality can be provided to an agent for interaction with a system to accomplish this goal, which is referred to as a multimodal interaction (MI) system. The Internet of Things (IoT) and augmented reality (AR) are popular technologies that allow interaction systems to combine the real-world context of the agent and immersive AR content. However, although MI systems have been extensively studied, there are only several studies that reviewed MI systems that used IoT and AR. Therefore, this paper presents an in-depth review of studies that proposed various MI systems utilizing IoT and AR. A total of 23 studies were identified and analyzed through a rigorous systematic literature review protocol. The results of our analysis of MI system architectures, the relationship between system components, input/output interaction modalities, and open research challenges are presented and discussed to summarize the findings and identify future research and development avenues for researchers and MI developers.

show abstract

Section: Interaction Devicesmentioning

confidence: 99%

Section: Inputmentioning

confidence: 99%

Section: Outputmentioning

confidence: 99%

See 1 more Smart Citation

Multimodal Interaction Systems Based on Internet of Things and Augmented Reality: A Systematic Literature Review

2021

View full text Add to dashboard Cite

show abstract

“…Another interesting work is shown in [ 14 ], where augmented reality and a set of data information provided by IoT devices are used to locate the real position of various wireless transmitters. In the case of the platform presented in [ 15 ], it aims to make users aware of the energy consumption of the various electronic equipment in their home. For this purpose, the authors developed an interactive system that can display the energy consumption, measured by several IoT devices.…”

Section: Related Workmentioning

confidence: 99%

“…The work proposed in the following sections of this paper was developed according to the concepts presented in [ 11 , 12 , 15 , 16 ] to create an information visualization system for IoT devices, in real-time, using augmented reality and adding a security layer to the AR. The work presented in [ 11 ] demonstrates how augmented reality can be used to expose information from IoT devices to the users, and in this case, using a simple smartphone to achieve that.…”

Section: Related Workmentioning

confidence: 99%

SAR.IoT: Secured Augmented Reality for IoT Devices Management

Fuentes

Correia

Costa

et al. 2021

Sensors

View full text Add to dashboard Cite

Currently, solutions based on the Internet of Things (IoT) concept are increasingly being adopted in several fields, namely, industry, agriculture, and home automation. The costs associated with this type of equipment is reasonably small, as IoT devices usually do not have output peripherals to display information about their status (e.g., a screen or a printer), although they may have informative LEDs, which is sometimes insufficient. For most IoT devices, the price of a minimalist display, to output and display the device’s running status (i.e., what the device is doing), might cost much more than the actual IoT device. Occasionally, it might become necessary to visualize the IoT device output, making it necessary to find solutions to show the hardware output information in real time, without requiring extra equipment, only what the administrator usually has with them. In order to solve the above, a technological solution that allows for the visualization of IoT device information in actual time, using augmented reality and a simple smartphone, was developed and analyzed. In addition, the system created integrates a security layer, at the level of AR, to secure the shown data from unwanted eyes. The results of the tests carried out allowed us to validate the operation of the solution when accessing the information of the IoT devices, verify the operation of the security layer in AR, analyze the interaction between smartphones, the platform, and the devices, and check which AR markers are most optimized for this use case. This work results in a secure augmented reality solution, which can be used with a simple smartphone, to monitor / manage IoT devices in industrial, laboratory or research environments.

show abstract

What We Know About the Greenability of Reality Technologies: A Systematic Literature Review

Khakpour

Sánchez‐Gordón

Colomo‐Palacios

2020

Contributions to Management Science

View full text Add to dashboard Cite

Augmented-Reality Computer-Vision Assisted Disaggregated Energy Monitoring and IoT Control Platform

Cited by 12 publications

References 17 publications

Multimodal Interaction Systems Based on Internet of Things and Augmented Reality: A Systematic Literature Review

Multimodal Interaction Systems Based on Internet of Things and Augmented Reality: A Systematic Literature Review

SAR.IoT: Secured Augmented Reality for IoT Devices Management

What We Know About the Greenability of Reality Technologies: A Systematic Literature Review

Contact Info

Product

Resources

About