Text Cube: Computing IR Measures for Multidimensional Text Database Analysis

Cindy Xide Lin, Bolin Ding, Jiawei Han, Feida Zhu, and Bo Zhao

Abstract

Since Jim Gray introduced the concept of ”data cube” in 1997, data cube, associated with online analytical processing (OLAP), has become a driving engine in data warehouse industry. Because the boom of Internet has given rise to an ever increasing amount of text data associated with other multidimensional information, it is natural to propose a data cube model that integrates the power of traditional OLAP and IR techniques for text. In this paper, we propose a Text-Cube model on multidimensional text database and study effective OLAP over such data. Two kinds of hierarchies are distinguishable inside: dimensional hierarchy and term hierarchy. By incorporating these hierarchies, we conduct systematic studies on efficient text-cube implementation, OLAP execution and query processing. Our performance study shows the high promise of our methods.

Details

Publication typeInproceedings
Published inProceedings of the 8th IEEE International Conference on Data Mining (ICDM 2008)
Pages905-910
PublisherIEEE Computer Society
> Publications > Text Cube: Computing IR Measures for Multidimensional Text Database Analysis