Auditory augmented process monitoring for cyber physical production systems

Abstract

We describe two proof-of-concept approaches on the sonification of estimated operation states and conditions focusing on two scenarios: a laboratory setup of a manipulated 3D printer and an industrial setup focusing on the operations of a punching machine. The results of these studies form the basis for the development of an “intelligent” noise protection headphone as part of Cyber Physical Production Systems which provides auditorily augmented information to machine operators and enables radio communication between them. Further application areas are implementations in control rooms (equipped with multi-channel loudspeaker systems) and utilization for training purposes. As a first proof-of-concept, the data stream of error probability estimations regarding partly manipulated 3D printing processes were mapped to three sonification models, providing evidence about momentary operation states. The neural network applied indicates a high accuracy (> 93%) of the error estimation distinguishing between normal and manipulated operation states. None of the manipulated states could be identified by listening. An auditory augmentation, or sonification of these error estimations, provides a considerable benefit to process monitoring. For a second proof-of-concept, setup operations of a punching machine were recorded. Since all operations were apparently flawlessly executed, and there were no errors to be reported, we focused on the identification of operation phases. Each phase of a punching process could be algorithmically distinguished at an estimated probability rate of > 94%. In the auditory display, these phases were represented by different instrumentations of a musical piece in order to allow users to differentiate between operations auditorily.

Interactive Storytelling for Immersive Media, Augmented Manufacturing, and Digital Healthcare

“…The findings of AARiP's proofs-of-concept serve as the foundation for creating intelligent noisecancelling headphones as a component of Cyber-Physical Production Systems (CPPSs), which give machine operators auditorily enhanced information and enable radio communication between them. While the results have not been validated in a user study yet, the studies were presented and approved by the respective scientific community (Iber et al 2019;Iber et al 2021).…”

SonOpt: Sonifying Bi-objective Population-Based Optimization Algorithms

“…[2] also points towards benefits of adding sonification to visual representations, specifically targeted in security related process monitoring. In [13] additional evidence on performance improvement in process monitoring (of physical production systems) via sonification is provided.…”

Predicting Emotions Perceived from Sounds

“…n estimators : [50, 100, 150, 200, 250, 300], number of trees in the forests, -max depth : [5,10,20,30,50], maximum number of levels in each decision tree, -min samples split : [2,3,4,5,6,7], minimum number of data points placed in a node before the node is split, -min samples leaf : [1, 2, 3, 5], minimum number of data points allowed in a leaf node, -k : range(10, 30), number of features selected using KBest.…”