The Keck Observatory Archive: A Model for a TMT Archive?

One of the topics discussed at the TMT Science Forum was the need for a searchable archive that would allow PIs to access their data and, when data were public, would provide data access for a broader scientific community. The Keck Observatory was considered a model for the TMT operations concept, and I think that the Keck Observatory Archive (KOA) is also a good model for a TMT archive. KOA  is operational, hosts over 20 TB of data and is ingesting data from all active instruments. I presented a poster on this topic at the Forum, shown below.

First, though, let’s take a look at the specifications for the TMT archive, taken from Section 7.7 of the Operations Requirement Document (TMT.OPS.MGT.07.002.CCR) (September 23 2012):

req1
req2

KOA is a model for the Keck Archive because it meets many of these specifications already. It archives and curates the raw science and calibration files from multiple instruments and the associated metadata – including metadata on the program, telescope and instrument status etc – and performs QA on these data during the ingestion process. It implements a data access policy, and has procedures in place for managing exceptions to it. It has developed algorithms for automated associated calibration files with the science files. It has begun to work with the VO to develop VO-compatible services. Finally, it produces value-added browse products for all the instruments.

KOA TMT final

Advertisements
This entry was posted in archives, astroinformatics, Astronomy, data archives, Data Management, information sharing, Observatories, Operations, telescopes, TMT, W. M. Keck Observatory and tagged , , , , , , , , , . Bookmark the permalink.

One Response to The Keck Observatory Archive: A Model for a TMT Archive?

  1. John O'Meara says:

    I have a number of thoughts on the archive, both for TMT, and in ways we can enhance KOA, which is a great resource for the community. Some of it will require simple metadata enhancements, but others would require a bit more PI support (e.g. access to observing logs).

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s