Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
Identifying comparative sentences in text documents

Nitin Jindal and Bing Liu

Abstract

This paper studies the problem of identifying comparative sentences in text documents. The problem is related to but quite different from sentiment/opinion sentence identification or classification. Sentiment classification studies the problem of classifying a document or a sentence based on the subjective opinion of the author. An important application area of sentiment/opinion identification is business intelligence as a product manufacturer always wants to know consumers' opinions on its products. Comparisons on the other hand can be subjective or objective. Furthermore, a comparison is not concerned with an object in isolation. Instead, it compares the object with others. An example opinion sentence is "the sound quality of CD player X is poor". An example comparative sentence is "the sound quality of CD player X is not as good as that of CD player Y". Clearly, these two sentences give different information. Their language constructs are quite different too. Identifying comparative sentences is also useful in practice because direct comparisons are perhaps one of the most convincing ways of evaluation, which may even be more important than opinions on each individual object. This paper proposes to study the comparative sentence identification problem. It first categorizes comparative sentences into different types, and then presents a novel integrated pattern discovery and supervised learning approach to identifying comparative sentences from text documents. Experiment results using three types of documents, news articles, consumer reviews of products, and Internet forum postings, show a precision of 79% and recall of 81%. More detailed results are given in the paper.

Details

Publication typeInproceedings
Published inProceedings of SIGIR-06, the 29th annual international ACM SIGIR conference on Research and development in information retrieval
URLhttp://www.cs.uic.edu/~liub/publications/sigir06-comp.pdf
Pages244–251
ISBN1-59593-369-7
AddressSeattle, US
PublisherACM Press
> Publications > Identifying comparative sentences in text documents