Web Services as Building Blocks for Science Gateways in Astrophysics

Sánchez–Expósito, S.; Martin, Pablo Millares; Ruíz, José Enrique; Verdes–Montenegro, L.; Garrido, Julián; Sirvent, Raül; Falcó, A. Ruiz; Badía, Rosa M.; Lezzi, Daniele

doi:10.1007/s10723-016-9382-y

Cited by 11 publications

(9 citation statements)

References 18 publications

(22 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In general, a science gateway can be defined as a set of software, data collections, instrumentation and computational capabilities that are integrated -using different technologies and middleware [35] -via a Web portal (or a desktop application) in a user friendly and effective environment supporting the scientific research and education activities of a specific community. Science gateways are gaining an increasing interest in many communities [36,37], such as the astrophysics one [38,39,40], also because one of the best strategies to provide software and data to a scientific community is through a set of services designed following this paradigm. The portal we developed in the project and used for involving citizen scientists [6] is based on this paradigm.…”

Section: Citizen Astronomy and Its Implementationmentioning

confidence: 99%

A citizen science exploration of the X-ray transient sky using the EXTraS science gateway

D’Agostino

Law-Green

Watson

et al. 2020

Future Generation Computer Systems

View full text Add to dashboard Cite

Modern soft X-ray observatories can yield unique insights into time domain astrophysics, and a huge amount of information is stored -and largely unexploited -in data archives. Like a treasure-hunt, the EXTraS project harvested the hitherto unexplored temporal domain information buried in the serendipitous data collected by the European Photon Imaging Camera instrument onboard the XMM-Newton satellite in 20 years of observations. The result is a vast catalog, describing the temporal behaviour of hundreds of thousands of X-ray sources. But the catalogue is just a starting point because it has to be, in its turn, further analysed. During the project an education activity has been defined and run in several workshops for high school students in Italy, Germany and UK. The final goal is to engage the students, and in perspective citizen scientists, to go through the whole validation process: they look into the data and try to discover new sources, or to characterize already known sources. This paper describes how the EXTraS science gateway is used to accomplish these tasks and highlights the first discovery, a flaring X-ray source in the globular cluster NGC 6540.1 lying by chance in the instrument field of view, in the portion of the sky surrounding the target of the observation 2 http://nxsa.esac.esa.int/nxsa-web 3 https://heasarc.gsfc.nasa.gov/W3Browse/xmm-newton/xmmssc.html 7

show abstract

Section: Citizen Astronomy and Its Implementationmentioning

confidence: 99%

A citizen science exploration of the X-ray transient sky using the EXTraS science gateway

D’Agostino

Law-Green

Watson

et al. 2020

Future Generation Computer Systems

View full text Add to dashboard Cite

show abstract

“…COMPSs is used in production at MareNostrum supercomputer and has been used to implement different real world applications, specially in the area of BioInformatics and Computational Genomics [10] [13] [17], Big Data analytics [29] and as building block for several scientific cyber-infrastructures [45] [22]. Other examples of applications developed with COMPSs can be found in [7].…”

Section: Compss Overviewmentioning

confidence: 99%

Transparent Orchestration of Task-based Parallel Applications in Containers Platforms

et al. 2018

View full text Add to dashboard Cite

This paper presents a framework to easily build and execute parallel applications in container-based distributed computing platforms in a usertransparent way. The proposed framework is a combination of the COMP Superscalar (COMPSs) programming model and runtime, which provides a straightforward way to develop task-based parallel applications from sequential codes, and containers management platforms that ease the deployment of applications in computing environments (as Docker, Mesos or Singularity). This framework provides scientists and developers with an easy way to implement parallel distributed applications and deploy them in a one-click fashion. We have built a prototype which integrates COMPSs with different containers engines in different scenarios: i) a Docker cluster, ii) a Mesos cluster, and iii) Singularity in an HPC cluster. We have evaluated the overhead in the building phase, deployment and execution of two benchmark applications compared to a Cloud testbed based on KVM and OpenStack and to the usage of bare metal nodes. We have observed an important gain in comparison to cloud environments during the building and deployment phases. This enables better adaptation of resources with respect to the computational load. In contrast, we detected an extra overhead during the execution, which is mainly due to the multi-host Docker networking.

show abstract

“…Cloud orchestration within science applications has been tackled before by several authors, in works related to specific scientific areas such as bioinformatics and biomedical applications [40], neuroscience [79], phenomenology physics [9], astrophysics [77], environmental sciences [18], engineering [38], high energy physics [81], etc. This has been also addressed in more generic approaches, not bounded to a scientific discipline [84,37,15].…”

Section: Background and Related Workmentioning

confidence: 99%

Orchestrating Complex Application Architectures in Heterogeneous Clouds

et al. 2017

View full text Add to dashboard Cite

Private cloud infrastructures are now widely deployed and adopted across technology industries and research institutions. Although cloud computing has emerged as a reality, it is now known that a single cloud provider cannot fully satisfy complex user requirements. This has resulted in a growing interest in developing hybrid cloud solutions that bind together distinct and heterogeneous cloud infrastructures. In this paper we describe the orchestration approach for heterogeneous clouds that has been implemented and used within the INDIGO-DataCloud project. This orchestration model uses existing open-source software like OpenStack and leverages the OASIS Topology and Specification for Cloud Applications (TOSCA) open standard as the modeling language. Our approach uses virtual machines and Docker containers in an homogeneous and transparent way providing consistent application deployment for the users. This approach is illustrated by means of two different use cases in different scientific communities, implemented using the INDIGO-DataCloud solutions

show abstract

Web Services as Building Blocks for Science Gateways in Astrophysics

Cited by 11 publications

References 18 publications

A citizen science exploration of the X-ray transient sky using the EXTraS science gateway

A citizen science exploration of the X-ray transient sky using the EXTraS science gateway

Transparent Orchestration of Task-based Parallel Applications in Containers Platforms

Orchestrating Complex Application Architectures in Heterogeneous Clouds

Contact Info

Product

Resources

About