Topic:
Cross Language
Evaluation Forum
Abstract:
The objective of the Cross-Language
Evaluation Forum (CLEF) is to promote research in the field of multilingual
system development. CLEF thus organizes annual evaluation campaigns in which a
series of tracks designed to test different aspects of mono- and cross-language
information retrieval (IR) are offered.
The intention is to encourage experimentation with all kinds of
multilingual information access – from the development of systems for
monolingual retrieval operating on many languages to the implementation of
complete multilingual multimedia search services. This has been achieved by
offering an increasingly complex and varied set of evaluation tasks over the
years. The aim is not only to meet but also to anticipate the emerging needs of
the R&D community and to encourage the development of next generation
multilingual IR systems. The talk will describe the organization of the CLEF
campaigns and (some of) the results achieved in the first seven years of
activity.
Recommended Reading:
·
Peters,
C. (2005) Comparative Evaluation of Cross-language Information Retrieval
Systems. In Matthias Hemmje, Claudia Niederee, Thomas Risse (eds.) From
Integrated Publication and Information Systems to Virtual Information and
Knowledge Environments, Springer LNCS 3379, pp152-161
·
Braschler
M., Peters C. - Cross-language evaluation forum: objectives, results,
achievements. In: Information Retrieval, Vol. 7, n. 1-2 (2004), pp. 7-31.
Kluwer, 2004.
·
Peters,
C., Gey, F.C., Gonzalo, J., Müller, H., Jones, G.J.F, Kluck, M,
Magnini, B, de Rijke, M. (2006).: Accessing Multilingual Information
Repositories, 6th Workshop of the Cross-Language Evaluation Forum, CLEF 2005,
Vienna, Austria, 21-23 September, 2005, Revised Selected Papers Springer 2006, 1013 p.
·
Nardi,
A., Peters, C., Vicedo, J.L. (2006). Results of the CLEF 2006 Cross-Language System Evaluation Campaign,
Working Notes for the CLEF 2006 Workshop. ISSN 1818-8044, ISBN
2-912335-23http://clef.isti.cnr.it/2006/working_notes/workingnotes2006/
Bio of the Speaker:
Carol Peters is employed by the
Institute for Information Science and Technologies of the Italian National
Research Council (ISTI-CNR), Pisa. Her current research activities are focused
on the development of multilingual access mechanisms for digital libraries and evaluation methodologies for
cross-language information retrieval systems. She is member of the
editorial boards of the International
Journal of Digital Libraries and ERCIM
News, the journal of the European Research Consortium in Informatics and
Mathematics. Since 2000, she has coordinated the Cross-Language Evaluation
Forum (CLEF), which promotes research into multilingual information access
system development and organizes annual evaluation campaigns. CLEF is an
activity of the DELOS Network of Excellence for Digital Libraries.
E-mail: Carol.Peters@isti.cnr.it
Additional Material (References, Slides & Lecture Notes):