Despite the increased exploration of machine learning (ML) techniques for the realization of autonomous optical networks, less attention has been paid to data quality, which is critical for ML performance. Failure management in optical networks using ML is constrained by the fact that some failures may occur more frequently than others, resulting in highly imbalanced datasets for the training of ML models. To address this limitation, a variational-autoencoder-based data augmentation technique is investigated in this paper, which can be used during data preprocessing to improve data quality. The synthetic data generated by the variational autoencoder are utilized to reduce imbalance in an experimental dataset used for training of neural networks (NNs) for failure management in optical networks. First, it is shown that, with a modified training dataset, the training time of NNs can be reduced. Reductions of up to 37.1% and 60.6% are achieved for failure detection and cause identification, respectively. Second, it is shown that improvement in the quality of the training dataset can reduce the computational complexity of NNs during the inference phase. As determined analytically, almost 68% reduction in computational complexity is achieved for the NN used for failure cause identification. Finally, data augmentation is shown to achieve improvement in classification accuracy. This work demonstrates improvement of up to 7.32%.
A deep autoencoder based approach was investigated with experimental data for alarms classification in optical networks. Differently from supervised machine learning techniques, the approach shows promising results without the need of manually labeled data.
We investigated data augmentation to train neural networks (NNs) for soft-failure cause identification, demonstrating its impacts on NN complexity. Results indicate up to 68% reduction in the computational complexity of NN for each inference.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.