Automated Creation of Cyber-Physical Museum Exhibits Using a Scientific Visualization System on a Chip

Ryabinin, Konstantin; Kolesnik, Mariia

doi:10.1134/s0361768821030099

Cited by 9 publications

(5 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Ahn S H analyzes the media factors in the museum tourism experience and designs a system of examination carrier of tourism activities, tourism environment, and tourism services [19]. With the deeper exploration and enrichment of the experience design theory, the economic activities that start from life situations and aim at changing consumer behavior through the shaping of user sensory experience and selfcognition constitute the experience economy, which provides a new research perspective for cultural and creative production services [20]. Experience design is an emerging interdisciplinary discipline that includes psychology, human-computer interaction, and information technology.…”

Section: Related Workmentioning

confidence: 99%

User Experience Perspectives on the Application of Interactivity Design Based on Sensor Networks in Digital Museum Product Display

Zhang

2022

Journal of Sensors

View full text Add to dashboard Cite

This paper designs a model of interactivity design in digital museum product display, constructs a sensor network model, and tests the sensor network-based interactivity design in digital museum product display under the perspective of user experience. This paper makes a museum user experience model based on sensory, behavioral, cognitive, and emotional experiences; establishes a user experience design framework; conducts specific theoretical analysis and research from four aspects; uncovers specific factors affecting museum user experience; analyzes the impact of each experience factor on user system design and possible design entry points; and proposes corresponding user system design strategies to guide subsequent design practice sessions. This paper also completes the hardware circuit and PCB board design of the wireless sensing node based on the CC2430 chip as the core. Tomcat WEB server and J2EE-based Spring MVC Web development framework are used as the leading implementation technology to complete the functions of real-time data query, network parameter setting, and historical data storage. The ideographic practice of visual representation of the digital museum is discussed around its optical system. Knowledge-based model dominates the digital museum representation, and examining the complex constitutive processes and characteristics of images involves not only the production of discursive order but also the production of presentation contexts as well as virtual spaces, which construct a new visual presentation of digital museums. However, the virtual representation practice of digital museums still has paradoxes, the absence of the sense of experience and the flatness of the virtual space, in which the audience cannot have a visual experience under this presentation.

show abstract

Section: Related Workmentioning

confidence: 99%

User Experience Perspectives on the Application of Interactivity Design Based on Sensor Networks in Digital Museum Product Display

Zhang

2022

Journal of Sensors

View full text Add to dashboard Cite

show abstract

“…Although the overall performance of this computer is fairly low (compared to desktop computers), it is enough to present different kinds of stimuli, including text, images, animations, videos and sound. Moreover, Orange Pi can be transparently integrated with tangible user interfaces [15], allowing to involve haptics modality.…”

Section: Stimuli Representation Pipelinementioning

confidence: 99%

“…Informant's Controls are used to give the informant potential control over the stimuli presented, for example, to navigate between them. Currently, pushbuttons are used, but in the future more specific hardware interfaces can be adopted, including tangible ones [15].…”

Section: Stimuli Representation Pipelinementioning

confidence: 99%

“…Right now, words (provided as a list), images (provided as PNG and JPG files), and sounds (provided as WAV, MP3, and OGG files) can be presented as stimuli, which covers all the preliminary experiments we have carried out for now. However, the SciVi platform already contains appropriate rendering tools to perform more complex scientific visualization on single-board microcomputers like Orange Pi and Raspberry Pi [15], so they can be used whenever needed.…”

Section: Data Flow Declarationmentioning

confidence: 99%

“…Although the visualization methods mentioned above are quite traditional, they are essential for conducting EEG-based experiments, so they should be included in any corresponding data processing pipeline. The SciVi visual analytics platform contains a lot of visual analytics tools [1,15] organized according to the principles of cognitive graphics [18]. In the future, we plan to adopt them for performing more complex visual analytics of EEG data.…”

Section: Visual Tools Supporting Eeg-based Bci Researchmentioning

confidence: 99%

See 2 more Smart Citations

Ontology-Driven Toolset for Audio-Visual Stimuli Representation in EEG-Based BCI Research

Ryabinin

Чуприна

Labutin

2021

Proceedings of the 31th International Conference on Computer Graphics and Vision. Volume 2

View full text Add to dashboard Cite

In the last decade, the recent advances in software and hardware facilitate the increase of interest in conducting experiments in the field of neurosciences, especially related to human-machine interaction. There are many mature and popular platforms leveraging experiments in this area including systems for representing the stimuli. However, these solutions often lack high-level adaptability to specific conditions, specific experiment setups, and third-party software and hardware, which may be involved in the experimental pipelines. This paper presents an adaptable solution based on ontology engineering that allows creating and tuning the EEG-based brain-computer interfaces. This solution relies on the ontology-driven SciVi visual analytics platform developed earlier. In the present work, we introduce new capabilities of SciVi, which enable organizing the pipeline for neuroscience-related experiments, including the representation of audio-visual stimuli, as well as retrieving, processing, and analyzing the EEG data. The distinctive feature of our approach is utilizing the ontological description of both the neural interface and processing tools used. This increases the semantic power of experiments, simplifies the reuse of pipeline parts between different experiments, and allows automatic distribution of data acquisition, storage, processing, and visualization on different computing nodes in the network to balance the computation load and to allow utilizing various hardware platforms, EEG devices, and stimuli controllers.

show abstract

Design of Visualization System Under Centralized Monitoring of Regional Power Grid Based on Data Mining Algorithm

Liu

Lou

et al. 2022

Cyber Security Intelligence and Analytics

View full text Add to dashboard Cite

Automated Creation of Cyber-Physical Museum Exhibits Using a Scientific Visualization System on a Chip

Cited by 9 publications

References 8 publications

User Experience Perspectives on the Application of Interactivity Design Based on Sensor Networks in Digital Museum Product Display

User Experience Perspectives on the Application of Interactivity Design Based on Sensor Networks in Digital Museum Product Display

Ontology-Driven Toolset for Audio-Visual Stimuli Representation in EEG-Based BCI Research

Design of Visualization System Under Centralized Monitoring of Regional Power Grid Based on Data Mining Algorithm

Contact Info

Product

Resources

About