Combining convolutional neural networks with unsupervised learning for acoustic monitoring of robotic manufacturing facilities

Abstract

For automated robotic manufacturing, a key aspect of monitoring is the identification and segmentation of core actuation processes captured in sensor logs. Once segmented, the behavior of an industrial system during a particular actuation can be tracked to detect signs of degradation. This study presents a technique for performing such an analysis through a combination of machine learning techniques designed to work with an acoustic monitoring system. A spectrogram-based convolutional neural network (CNN) is first trained to identify and segment primary motion classes from acoustic data. Unsupervised clustering and feature-space analysis are then employed to further separate the data into motion sub-classes beyond the capabilities of the CNN. This approach was evaluated on acoustic recordings of a Selective Compliance Assembly Robot Arm (SCARA) system. The developed CNN performed primary robotic motion segmentation with a maximum actuation identification accuracy of 87% when compared to validation data. The unsupervised clustering process had mixed success in distinguishing more fine-grained motion sub-classes due to strong variances in signal energy for some sub-classes. Further refinement is required for improved segmentation accuracy as well as automatic feature generation. The application of this process for life-cycle system monitoring is discussed as well.

Dimensional Defect Detection Research on the Sculpture Surface Combining the Convolutional Neural Network and Gabor

“…The detection accuracy is detected by the actual defect area and the two algorithms. The ratio of defects is expressed [17].…”

Audio Perception in Robotic Assistance for Human Space Exploration: A Feasibility Study

“…These methods have been applied toward factory and technical applications for process monitoring for additive manufacturing [32] [33]. Furthermore, convolutional neural networks have been added for detecting the degradation state of robotic system [34]. However, the unknown spectral profiles or signals with high variances are still problematic.…”

A Review on AI for Smart Manufacturing: Deep Learning Challenges and Solutions

“…This can be achieved through vision-guided motion control [14]. Moreover, robots are expected to work collaboratively with humans and other robots in a shared environment while maintaining human safety [15]. Applications for supply chain management can be categorized into the domains of planning, supplier selection, logistics, and warehouse management.…”