Industrial Transfer Learning for Multivariate Time Series Segmentation: A Case Study on Hydraulic Pump Testing Cycles

Abstract

Industrial data scarcity is one of the largest factors holding back the widespread use of machine learning in manufacturing. To overcome this problem, the concept of transfer learning was developed and has received much attention in recent industrial research. This paper focuses on the problem of time series segmentation and presents the first in-depth research on transfer learning for deep learning-based time series segmentation on the industrial use case of end-of-line pump testing. In particular, we investigate whether the performance of deep learning models can be increased by pretraining the network with data from other domains. Three different scenarios are analyzed: source and target data being closely related, source and target data being distantly related, and source and target data being non-related. The results demonstrate that transfer learning can enhance the performance of time series segmentation models with respect to accuracy and training speed. The benefit can be most clearly seen in scenarios where source and training data are closely related and the number of target training data samples is lowest. However, in the scenario of non-related datasets, cases of negative transfer learning were observed as well. Thus, the research emphasizes the potential, but also the challenges, of industrial transfer learning.

TCN-GAT multivariate load forecasting model based on SHAP value selection strategy in integrated energy system

“…The results show that CapsNet outperforms CNN in image-based inference tasks, but whether it retains its superiority in the forecasting of multivariate loads remains to be investigated. Gaugel and Reichert. (2023) adopt the transfer learning method to pre-train deep learning network in the case of scarce industrial data.…”

Smart Chemical Sensor and Biosensor Networks for Healthcare 4.0

“…With its rapid development, Industry 4.0 has brought deep impacts to different aspects of society and our lives. In the healthcare sector, Industry 4.0 has promoted many advanced technologies to improve human health via advanced technologies [ 1 , 2 , 3 ]. This effort boosts a new concept, which is referred to as Healthcare 4.0.…”