Effective Multi-Label Active Learning for Text Classification

Labeling text data is quite time-consuming but essential for automatic text classification. Especially, manually creating multiple labels for each document may become impractical when a very large amount of data is needed for training multi-label text classifiers. To minimize the human-labeling efforts, we propose a novel multi-label active learning appproach which can reduce the required labeled data without sacrificing the classification accuracy. Traditional active learning algorithms can only handle single-label problems, that is, each data is restricted to have one label. Our approach takes into account the multi-label information, and aims to label data which can optimize the expected loss reduction. Specifically, the model loss is approximated by the size of version space, and we optimize the reduction rate of the size of version space with Support Vector Machines (SVM). Furthermore, we design an effective method to predict possible labels for each unlabeled data point, and approximate the expected loss by summing up losses on all labels according to the most confident result of label prediction. Experiments on seven real-world data sets (all are publicly available) demonstrate that our approach can obtain promising classification result with much fewer labeled data than state-of-the-art methods.

sigkdd09-yang.pdf
PDF file

In  The 15th ACM SIGKDD Conference On Knowledge Discovery and Data Mining

Publisher  Association for Computing Machinery, Inc.
Copyright © 2007 by the Association for Computing Machinery, Inc. Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Publications Dept, ACM Inc., fax +1 (212) 869-0481, or permissions@acm.org. The definitive version of this paper can be found at ACM’s Digital Library --http://www.acm.org/dl/.

Details

TypeInproceedings
> Publications > Effective Multi-Label Active Learning for Text Classification