Diagnosing Estimation Errors in Page Counts using Execution Feedback

Surajit Chaudhuri, Vivek Narasayya, and Ravi Ramamurthy

Abstract

Errors in estimating page counts can lead to poor choice of access methods and in turn to poor quality plans. Although there is past work in using execution feedback for accurate cardinality estimation, the problem of inaccurate estimation of page counts has not been addressed. In this paper, we present novel mechanisms for diagnosing errors in page count by monitoring query execution at low overhead. Detection of inaccuracy in the optimizer estimates of page count can be leveraged by database administrators to improve plan quality. We have prototyped our techniques in the Microsoft SQL Server engine, and our experiments demonstrate the ability to estimate page counts accurately using execution feedback with low overhead. For queries on several real world databases, we observe significant improvement in plan quality when page counts obtained from execution feedback are used instead of the traditional optimizer estimations.

Details

Publication typeInproceedings
Published in24th International Conference on Data Engineering
PublisherIEEE Computer Society
> Publications > Diagnosing Estimation Errors in Page Counts using Execution Feedback