Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
Exploring Content Models for Multi-Document Summarization

Aria Haghighi and Lucy Vanderwende

Abstract

We present an exploration of generative probabilistic models for multi-document summarization. Beginning with a simple word frequency based model (Nenkova and Vanderwende, 2005), we construct a sequence of models each injecting more structure into the representation of document set content and exhibiting ROUGE gains along the way. Our final model, HIERSUM, utilizes a hierarchical LDA-style model (Blei et al., 2004) to represent content specificity as a hierarchy of topic vocabulary distributions. At the task of producing generic DUC-style summaries, HIERSUM yields state-of-the-art ROUGE performance and in pairwise user evaluation strongly outperforms Toutanova et al. (2007)'s state-of-the-art discriminative system. We also explore HIERSUM's capacity to produce multiple 'topical summaries' in order to facilitate content discovery and navigation.

Details

Publication typeInproceedings
Published inProceedings of HLT-NAACL 2009
PublisherAssociation for Computational Linguistics
> Publications > Exploring Content Models for Multi-Document Summarization