Big Data in Astronomy: Surveys, Catalogs, Databases and Archives

Abstract

We present the modern situation in astronomy, where Big Data coming from the Universe put new tasks for catalogizing, storage, archiving, analysis and usage of the scientific information. The two major characteristics of modern astronomy are multiwavelength (MW) studies (from γ-ray to radio, as well as multi-messenger studies, using also neutrinos, gravitational waves, etc.) and Big Data (including data acquisition, storage and analysis). Present astronomical databases and archives contain billions of objects observed in various wavelengths, both Galactic and extragalactic, and the vast amount of data on them allows new studies and discoveries. Astronomers deal with big numbers. Surveys are the main source for discovery of astronomical objects and accumulation of observational data for further analysis, interpretation, and achieving scientific results. We review the main characteristics of astronomical surveys, we compare photographic and digital eras of astronomical studies (including the development of wide-field observations), we give the present state of MW surveys, and we discuss the Big Data in astronomy and related topics of Virtual Observatories and Computational Astrophysics. The review includes many numbers and data that can be compared to have a possibly overall understanding on the studied Universe, cosmic numbers and their relationship to modern computational possibilities.

Overview of Big Data Analytics in Modern Astronomy

“…Observational astronomy is undergoing a significant transformation due to the emergence of large digital sky surveys, which have become the primary source of astronomical data. These surveys currently encompass over 100 terabytes of data in major archives [11], and their volume is rapidly increasing. Today's typical sky survey involves approximately 10 terabytes of image data, around 1 billion detected sources, and about 100 measured attributes per source.…”

“…Figure 1: The Expansion of Light Collecting Area in Astronomical Telescopes since 1609. This information is sourced from [11]. IJMSCS ISSN: 2704-1077 eISSN 2704-1069 97…”

“…These observations have unlocked new horizons in our quest to understand the universe, offering insights that transcend the constraints of traditional astronomy [3]. This reference is drawn from [11].…”

“…These deep field projects have been pivotal in unveiling the most mysterious and remote objects concealed within the extensive datasets. To handle this vast amount of data, astronomers have leveraged the capabilities of advanced computing technologies, including clusters and grids [11].…”

“…Additionally, the global recognition of the necessity for data preservation and sharing has prompted the establishment of the World Data System (WDS). WDS is a unifying platform for data across a spectrum of scientific domains, including astronomy, promoting collaborative research initiatives [11].…”