How Will Astronomy Archives Survive the Data Tsunami?

This article by Steve Groom and myself was just published on-line in the Association for Computing Machinery Queue:

How Will Astronomy Archives Survive the Data Tsunami? – ACM Queue

In it, we describe the practices that can keep astronomy archives ahead of the tsunami, which will deposit an estimated 60-100 PB of data on-line by 2020.  We describe how archive performance is already being degraded by the rapid growth and data volume and growing use of sophisticated queries – see the figure below. We describe how practices such as rigorous evaluation of new technologies, partnerships between astronomers and computer scientists, and training of scientists in high-end software engineering engineering skills will all be necessary.

This entry was posted in archives, astroinformatics, Astronomy, cyberinfrastructure, data archives, Data Management, High performance computing, information sharing, Parallelization, programming, social networking, software engineering, software maintenance, software sustainability and tagged , , , , , , , , , , , , , , , . Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s