Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
Large-Scale Query and XMatch, Entering the Parallel Zone

Maria A. Nieto-Santisteban, Aniruddha R. Thakar, Alexander S. Szalay, and Jim Gray

Abstract

Current and future astronomical surveys are producing catalogs with millions and billions of objects. On-line access to such big datasets for data mining and cross-correlation is usually as highly desired as unfeasible. Providing these capabilities is becoming critical for the Virtual Observatory framework. In this paper we present various performance tests that show how using Relational Database Management Systems (RDBMS) and a Zoning algorithm to partition and parallelize the computation, we can facilitate large-scale query and cross-match.

Details

Publication typeInproceedings
Published inAstronomical Data Analysis Software and Systems XV
URLhttp://www.aspbooks.org/
Pages3
NumberMSR-TR-2005-169
InstitutionMicrosoft Research
AddressSan Lorenzo de El Escorial, Madrid, Spain
PublisherAstronomical Society of the Pacific
> Publications > Large-Scale Query and XMatch, Entering the Parallel Zone