First International Workshop on
Testing Database Systems


Co-located with ACM SIGMOD


Welcome to DBTest 2008!

Motivation and scope

The functionality provided by modern database management systems (DBMS) is continuously expanding. New trends in hardware architectures, new data storage requirements, and new usage patterns drive the need for continuous innovation and expansion in modern database engines. As a result, DBMS are becoming increasingly complex and difficult to validate. Moreover, while DBMS functionality has advanced significantly during the past 10 years, the methodology for testing and tuning has not evolved accordingly. Testing and tuning a database system are becoming increasingly expensive and are often dominating the release cycle of a database product. It is not unusual that fifty percent of the development cost is spent on testing and tuning and that several months are reserved for testing before a new release can be shipped. Without revolutionary new ideas, the situation is going to become even worse in future.

The purpose of this workshop is to expose to the academic community the challenges and practical impact of adequate database testing, and encourage further research in the area. The long term goal is to devise new technique that reduce the cost and time to test and tune database products so that users and vendors can spend more time and energy on actual innovations. Obviously, the general area of testing has attracted a great deal of attention in the software engineering community.However, testing DBMS imposes particular challenges and opportunities which have not been addressed in either the database or software engineering community.Only recently, DBMS testing has gained more attention in the database community.

The participants of this workshop will be from both industry and academia.In addition to novel techniques, the workshop will present war stories in order to define and better understand the problem space.


Topics of Interest

  • DBMS testing techniques
  • Generation of synthetic data for test databases
  • Generation of stochastic test models for large test matrices
  • Techniques and algorithms for automatic program verification
  • Maximizing code coverage of engine components
  • Testing correctness of DBMS components
  • Test-modeling of DBMS engines and components
  • Testing and designing systems that are robust to estimation inaccuracies
  • Testing the efficiency of adaptive policies and components
  • Minimizing, automating and ranking of engine tuning parameters
  • Identifying performance bottlenecks
  • Workload characterization with respect to performance metrics
  • Workload characterization with respect to engine components
  • Metrics for predictability of query and workload performance
  • Metrics for query plan robustness
  • Security and vulnerability testing
  • War Stories

DBTest Program


Sponsors


Microsoft SQL Server