Pan-STARRS: Learning to Ride the Data Tsunami

Maria Nieto-Santisteban, Yogesh Simmhan, Roger Barga, Laszlo Dobos, Jim Heasley, Conrad Holmberg, Nolan Li, Michael Shipway, Alexander S. Szalay, Catharine van Ingen, and Sue Werner

Abstract

The Panoramic Survey Telescope and Rapid Response System (Pan-STARRS) is the next generation of digital sky surveys that builds on the success of the Sloan Digital Sky Survey (SDSS) . The Pan-STARRS consortium is centered at the University of Hawai`i, Institute for Astronomy, and includes nine other institutions worldwide. The next generation system leverages SQL Server 2008, Windows Workflow Foundation and the Trident Scientific Workbench. This updated technology is needed to address the much larger data generated by Pan-STARRS and the need to make that data available to astronomers promptly. SDSS released survey data of about 4TB in size every 6 months; PS will have about 30TB of data per year, incrementally updated every week.

The currently deployed PS1 telescope is one of the four Pan-STARRS telescopes. PS1 tests the system end to end, including the optics, cameras, image processing algorithms, data loading workflows, user facing databases, and science analysis. The PS1 survey over the next 3.5 years

Details

Publication typeInproceedings
Published inMicrosoft eScience Workshop
URLhttp://research.microsoft.com/en-us/events/escience2008/agenda.aspx

Previous versions

Yogesh Simmhan, Roger Barga, Catharine van Ingen, Ed Lazowska, and Alex Szalay. Building the Trident Scientific Workflow Workbench for Data Management in the Cloud, IEEE, 11 October 2009.

Maria A. Nieto-Santisteban, Tamas Budavari, Laszlo Dobos, Nolan Li, Michael Shipway, Alexander Szalay, Ani Thakar, Suzanne Werner, Richard Wilton, Yogesh Simmhan, Catharine van Ingen, Jim Heasley, and Conrad Holmberg. GrayWulf: Conquering Astronomical Databases, Astronomical Society of the Pacific, November 2008.

Alexander S. Szalay, Gordon Bell, Jan Vandenberg, Alainna Wonders, Randal Burns, Dan Fay, Jim Heasley, Tony Hey, Maria Nieto-SantiSteban, Ani Thakar, Catharine van Ingen, and Richard Wilton. GrayWulf: Scalable Clustered Architecture for Data Intensive Computing, Microsoft, 15 September 2008.

Yogesh Simmhan, Maria Nieto-Santisteban, Roger Barga, Tamas Budavari, Laszlo Dobos, Nolan Li, Michael Shipway, Alexander S. Szalay, Ani Thakar, Jan Vandenberg, Alainna Wonders, Sue Werner, Richard Wilton, Dan Fay, Michael Thomassy, Catharine van Ingen, Jim Heasley, and Conrad Holmberg. GrayWulf: Scalable Software Architecture for Data Intensive Computing, IEEE Computer Society, January 2009.

Yogesh Simmhan, Roger Barga, Catharine van Ingen, Maria Nieto-Santisteban, Laszlo Dobos, Nolan Li, Michael Shipway, Alexander S. Szalay, Sue Werner, and Jim Heasley. GrayWulf: Scalable Software Architecture for Data Intensive Computing, Microsoft Research, 15 September 2008.

> Publications > Pan-STARRS: Learning to Ride the Data Tsunami