Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
Lexicon Modeling for Query Understanding

Jingjing Liu, Xiao Li, Alex Acero, and Ye-Yi Wang


Lexicons are important resources for semantic tagging. However, commonly used lexicons collected from entity databases suffer from multiple problems, such as ambiguity, limited coverage and lack of relative importance. In this work we present a lexicon modeling technique that automatically expands the lexicon and assigns weights to its elements. For lexicon expansion, we use a generative model to extract patterns from query logs using known lexicon seeds, and discover new lexicon elements using the learned patterns. For lexicon weighting, we propose two approaches based on generative and discriminative models to learn the relative importance of lexicon elements from user click statistics. Experiments on text queries in multiple domains show that our lexicon modeling technique can significantly improve semantic tagging performance.


Publication typeInproceedings
Published inICASSP
> Publications > Lexicon Modeling for Query Understanding