Microsoft Research Ltd, 7 JJ Thomson Avenue, Cambridge CB3 0FB, UK Email: eminey [att] microsoft.com WWW: http://research.microsoft.com/~eminey/

I am an associate researcher in the Information Retrieval and Analysis Group in Microsoft Research Cambridge. My current work involves evaluation of retrieval systems, the effect of evaluation metrics on learning to rank problems and modelling user behaviour. My main interests are information retrieval and applications of information theory, statistics and machine learning.

Before joining Microsoft Research, I was a PhD student and a research assistant at Northeastern University. My work there mainly focused on decreasing the amount of judgment effort needed for large scale retrieval evaluation.

• A New Rank Correlation Coefficient for Information Retrieval
  Emine Yilmaz, Javed A. Aslam and Stephen Robertson. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development i n Information Retrieval pages 587-594. ACM Press, July 2008. [publisher's link]

• A Simple and Efficient Method for Estimating AP and NDCG
  Emine Yilmaz, Evangelos Kanoulas and Javed A. Aslam. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval pages 603-610. ACM Press, July 2008. [publisher's link]

• Relevance Assessment: Are Judges Exchangeable and Does it Matter
  Peter Bailey, Nick Craswell, Ian Soboroff, Paul Thomas, Arjen P. de Vries and Emine Yilmaz . In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval pages 667-674. ACM Press, July 2008. [publisher's link]

• Estimating Average Precision when Judgments are Incomplete
  Emine Yilmaz and Javed A. Aslam. In International Journal of Knowledge and Information Systems. Springer, 2007.

• Inferring Document Relevance from Incomplete Information
  Javed A. Aslam and Emine Yilmaz. In Proceedings of the Sixteenth International Conference on Information and Knowledge Management (CIKM) pages 633-642. ACM Press, November 2007. [publisher's link]

• Estimating Average Precision with Incomplete and Imperfect Information
  Emine Yilmaz and Javed A. Aslam. In Proceedings of the Fifteenth International Conference on Information and Knowledge Management (CIKM) pages 102-111. ACM Press, October 2006. [publisher's link]

• A Statistical Method for System Evaluation Using Incomplete Judgments
  Javed A. Aslam, Virgil Pavlu and Emine Yilmaz. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval pages 541-548. ACM Press, August 2006. [publisher's link]

• Inferring Document Relevance via Average Precision
  Javed A. Aslam and Emine Yilmaz. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval pages 601-602. ACM Press, August| 2006. [publisher's link]

• The Maximum Entropy Method for Analyzing Retrieval Measures
  Javed A. Aslam, Emine Yilmaz, and Virgil Pavlu. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval pages| 27-34. ACM Press, August| 2005. [publisher's link]

• A Geometric Interpretation of R-precision and Its Correlation with Average Precision
  Javed A. Aslam, Emine Yilmaz, and Virgil Pavlu. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval pages| 573-574. ACM Press, August| 2005. [publisher's link] [pdf]

• Measure-based Metasearch
  Javed A. Aslam, Virgil Pavlu and Emine Yilmaz. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval pages| 571-572. ACM Press, August| 2005. [publisher's link] [pdf]

• A Sampling Technique for Efficiently Estimating Measures of Query Retrieval Performance Using Incomplete Judgments
  Javed A. Aslam, Virgil Pavlu and Emine Yilmaz. In Proceedings of the 22nd ICML Workshop on Learning with Partially Classified Training Data pages| 57-66. August| 2005. [pdf]

Information Retrieval and Analysis Group's home page.