Architecting Scientific Data Systems in the Cloud

Abstract

Scientists, educators, decision makers, students, and many others utilize scientifi c data produced by science instruments. They study our universe, make new discoveries in areas such as weather forecasting and cancer research, and shape policy decisions that impact nations fi scally, socially, economically, and in many other ways. Over the past 20 years or so, the data produced by these scientifi c instruments have increased in volume, complexity, and resolution, causing traditional computing infrastructures to have diffi culties in scaling up to deal with them. This reality has led us, and others, to investigate the applicability of cloud computing to address the scalability challenges. NASA's Jet Propulsion Laboratory (JPL ) is at the forefront of transitioning its science applications to the cloud environment. Through the Apache Object Oriented Data Technology (OODT ) framework, for NASA's fi rst software released at the open-source Apache Software Foundation (ASF), engineers at JPL have been able to scale the storage and computational aspects of their scientifi c data systems to the cloud -thus achieving reduced costs and improved performance. In this chapter, we report on the use of Apache OODT for cloud computing, citing several examples in a number of scientifi c domains. Experience, specifi c performance, and numbers are also reported. Directions for future work in the area are also suggested.