Identification of new particle formation events with deep learning

Abstract

Abstract. New particle formation (NPF) in the atmosphere is globally an important source of climate relevant aerosol particles. Occurrence of NPF events is typically analyzed by researchers manually from particle size distribution data day by day, which is time consuming and the classification of event types may be inconsistent. To get more reliable and consistent results, the NPF event analysis should be automatized. We have developed an automatic analysis method based on deep learning, a subarea of machine learning, for NPF event identification. To our knowledge, this is the first time that a deep learning method, i.e., transfer learning of a convolutional neural network (CNN), has successfully been used to automatically classify NPF events into different classes directly from particle size distribution images, similarly to how the researchers carry out the manual classification. The developed method is based on image analysis of particle size distributions using a pretrained deep CNN, named AlexNet, which was transfer learned to recognize NPF event classes (six different types). In transfer learning, a partial set of particle size distribution images was used in the training stage of the CNN and the rest of the images for testing the success of the training. The method was utilized for a 15-yearlong dataset measured at San Pietro Capofiume (SPC) in Italy. We studied the performance of the training with different training and testing of image number ratios as well as with different regions of interest in the images. The results show that clear event (i.e., classes 1 and 2) and nonevent days can be identified with an accuracy of ca. 80 %, when the CNN classification is compared with that of an expert, which is a good first result for automatic NPF event analysis. In the event classification, the choice between different event classes is not an easy task even for trained researchers, and thus overlapping or confusion between different classes occurs. Hence, we cross-validated the learning results of CNN with the expert-made classification. The results show that the overlapping occurs, typically between the adjacent or similar type of classes, e.g., a manually classified Class 1 is categorized mainly into classes 1 and 2 by CNN, indicating that the manual and CNN classifications are very consistent for most of the days. The classification would be more consistent, by both human and CNN, if only two different classes are used for event days instead of three classes. Thus, we recommend that in the future analysis, event days should be categorized into classes of "quantifiable" (i.e., clear events, classes 1 and 2) and "nonquantifiable" (i.e., weak events, Class 3). This would better describe the difference of those classes: both formation and growth rates can be determined for quantifiable days but not both for nonquantifiable days. Furthermore, we investigated more deeply the days that are classified as clear events by experts and recognized as nonevents by the CNN and vice versa. Clear misclassifications seem to ...

A Software Package to Simplify Tikhonov Regularization with Examples for Matrix-Based Inversion of SMPS and HTDMA Data

“…It is expected that such denoised spectra will benefit unsupervised machine-learning approaches that seek to extract features from such datasets (e.g. Joutsensaari et al, 2018;Atwood et al, 2019), although this hypothesis has not been tested by the author. Revision of the numerical algorithms improves the speed of inversion by a factor~200.…”

New Particle Formation Events Detection with Deep Learning

“…The San Pietro Capofiume measurement station (SPC station) is located in a rural area (44°39 N, 11°37 E, 11 m a.s.l) in Po Valley, which is the largest industrial, trading, and agricultural area in Italy (Joutsensaari et al, 2018). The particle number size distribution measurements started from March 2002 and were carried out continuously, expect for occasional system malfunctions, until 2017.…”

“…The particle number size distribution measurements started from March 2002 and were carried out continuously, expect for occasional system malfunctions, until 2017. A detailed overview of the site and measurements can be found in Joutsensaari et al (2018). The analyzed particle number size distribution dataset collected in SPC covers 4177 days from 24 March 2002 until 16 May 2017 (5534 days in total).…”

Using machine learning to derive cloud condensation nuclei number concentrations from commonly available measurements

“…GEOS-Chem is a global 3D chemical transport model (CTM) driven by assimilated meteorological observations from the Goddard Earth Observing System (GEOS) of the NASA Global Modeling and Assimilation Office (GMAO). Several research groups develop and use this model, which contains numerous state-of-the-art modules treating emissions (van Donkelaar et al, 2008;Keller et al, 2014) and various chemical and aerosol processes (e.g., Bey et al, 2001;Evans and Jacob, 2005;Martin et al, 2003;Murray et al, 2012;Park, 2004;Pye and Seinfeld, 2010) for solving a variety of atmospheric composition research problems. The ISORROPIA II scheme (Fountoukis and Nenes, 2007) is used to calculate the thermodynamic equilibrium of inorganic aerosols.…”