Multilingual Named Entity Recognition using Parallel Data and Metadata from Wikipedia

Sungchul Kim, Kristina Toutanova, and Hwanjo Yu

Abstract

In this paper we propose a method to automatically label multi-lingual data with named entity tags. We build on prior work utilizing Wikipedia metadata and show how to effectively combine the weak annotations stemming from Wikipedia metadata with information obtained through English-foreign language parallelWikipedia sentences. The combination is achieved using a novel semi-CRF model for foreign sentence tagging in the context of a parallel English sentence. The model outperforms both standard annotation projection methods and methods based solely on Wikipedia metadata.

Details

Publication typeInproceedings
Published inACL
PublisherAssociation for Computational Linguistics
> Publications > Multilingual Named Entity Recognition using Parallel Data and Metadata from Wikipedia