Realization of Different Techniques for Anomaly Detection in Astronomical Databases

We present results from applying the SNAD anomaly detection pipeline to the third public data release of the Zwicky Transient Facility (ZTF DR3). The pipeline is composed of 3 stages: feature extraction, search of outliers with machine learning algorithms and anomaly identification with followup by human experts. Our analysis concentrates in three ZTF fields, comprising more than 2.25 million objects. A set of 4 automatic learning algorithms was used to identify 277 outliers, which were subsequently scrutinised by an expert. From these, 188 (68%) were found to be bogus light curves – including effects from the image subtraction pipeline as well as overlapping between a star and a known asteroid, 66 (24%) were previously reported sources whereas 23 (8%) correspond to non-catalogued objects, with the two latter cases of potential scientific interest (e. g. 1 spectroscopically confirmed RS Canum Venaticorum star, 4 supernovae candidates, 1 red dwarf flare). Moreover, using results from the expert analysis, we were able to identify a simple bi-dimensional relation which can be used to aid filtering potentially bogus light curves in future studies. We provide a complete list of objects with potential scientific application so they can be further scrutinised by the community. These results confirm the importance of combining automatic machine learning algorithms with domain knowledge in the construction of recommendation systems for astronomy. Our code is publicly available*.

show abstract

The Most Interesting Anomalies Discovered in ZTF DR3 from the SNAD-III Workshop

Aleo

Ishida

Kornilov

et al. 2020

Res. Notes AAS

View full text Add to dashboard Cite

The search for objects with unusual astronomical properties, or anomalies, is one of the most anticipated results to be delivered by the next generation of large scale astronomical surveys. Moreover, given the volume and complexity of current data sets, machine learning algorithms will undoubtedly play an important role in this endeavor. The SNAD team is specialized in the development, adaptation and improvement of such techniques with the goal of constructing optimal anomaly detection strategies for astronomy. We present here the preliminary results from the third annual SNAD workshop (https://snad.space/2020/) that was held on-line in 2020 July.

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

hi@scite.ai

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Realization of Different Techniques for Anomaly Detection in Astronomical Databases

Cited by 3 publications

References 25 publications

Layered isolation forest: A multi-level subspace algorithm for improving isolation forest

Layered isolation forest: A multi-level subspace algorithm for improving isolation forest

Anomaly detection in the Zwicky Transient Facility DR3

The Most Interesting Anomalies Discovered in ZTF DR3 from the SNAD-III Workshop

Contact Info

Product

Resources

About