A Versatile Machine Vision Algorithm for Real-Time Counting Manually Assembled Pieces

Abstract

The Industry 4.0 paradigm is based on transparency and co-operation and, hence, on monitoring and pervasive data collection. In highly standardized contexts, it is usually easy to gather data using available technologies, while, in complex environments, only very advanced and customizable technologies, such as Computer Vision, are intelligent enough to perform such monitoring tasks well. By the term “complex environment”, we especially refer to those contexts where human activity which cannot be fully standardized prevails. In this work, we present a Machine Vision algorithm which is able to effectively deal with human interactions inside a framed area. By exploiting inter-frame analysis, image pre-processing, binarization, morphological operations, and blob detection, our solution is able to count the pieces assembled by an operator using a real-time video input. The solution is compared with a more advanced Machine Learning-based custom object detector, which is taken as reference. The proposed solution demonstrates a very good performance in terms of Sensitivity, Specificity, and Accuracy when tested on a real situation in an Italian manufacturing firm. The value of our solution, compared with the reference object detector, is that it requires no training and is therefore extremely flexible, requiring only minor changes to the working parameters to translate to other objects, making it appropriate for plant-wide implementation.

One datum and many values for sustainable Industry 4.0: a prognostic and health management use case

“…It is versatile and can be customized to meet requirements and objectives of multiple actors starting from the same data collecting architecture. In a past work of by Pierleoni et al [60] the data collection architecture used for counting assembled pieces could be exploited for assembly check purposes with almost no additional investment, except for the algorithm development. Another promising example of data multiple-utilization inside the typical predictive maintenance context, is the exploitation of current consumption data.…”

A Computer Vision System for Staff Gauge in River Flood Monitoring

“…This decision arose from the fact that due to wind and small relative movements between the rod where the cam is fixed and the gauge framed, the position of the gauge is not fixed over the time. For this reason, we are going to use the custom ACF object detector for its easy training, accuracy, and speed of use [28]. Through this detector, we are sure to reduce the ROI coherently with the position of the gauge in the image under analysis.…”

Pointer Defect Detection Based on Transfer Learning and Improved Cascade-RCNN

“…With the popularization of automated production [ 1 , 2 , 3 , 4 , 5 ], detection technology based on machine vision [ 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 ] has greatly promoted the development of the automobile manufacturing industry. Compared with traditional manual inspection, it has the advantages of high efficiency and high accuracy.…”