Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
Structural relevance: A common basis for the evaluation of structured document retrieval

M S. Ali, Mariano P. Consens, Gabriella Kazai, and Mounia Lalmas

Abstract

This paper presents a unified framework for the evaluation of a range of structured document retrieval (SDR) approaches and tasks. The framework is based on a model of tree retrieval, evaluated using a novel extension of the Structural elevance (SR) measure. The measure replaces the assumption of independence in traditional information retrieval (IR) with a notion of redundancy that takes into account the user navigation inside documents while seeking relevant information. Unlike existing metrics for SDR, our proposed framework does not require the computation of an ideal ranking which has, thus far, prevented the practical application of such measures. Instead, SR builds on a Markovian model of user navigation that can be estimated through the use of structural summaries. The results of this paper (supported by experimental validation using INEX data) show that SR defined over a tree retrieval model can provide a common basis for the evaluation of SDR approaches across various structured search tasks.

Details

Publication typeInproceedings
Published inCIKM '08: Proceeding of the 17th ACM Conference on Information and Knowledge Mining
Pages1153--1162
PublisherAssociation for Computing Machinery, Inc.
> Publications > Structural relevance: A common basis for the evaluation of structured document retrieval