Recent Developments in the Evaluation of Information Retrieval Systems: Moving Towards Diversity and Practical Relevance‪.‬

Overview Paper The evaluation of information retrieval systems has gained considerable momentum in the last Jew years. Several evaluation initiatives are concerned with diverse retrieval applications, innovative usage scenarios and different aspects of system performance. These evaluation initiatives have led to a considerable increase in system performance. Data for evaluation efforts include multilingual corpora, structured data, scientific documents, Web pages as well as multimedia objects. This paper gives an overview of the current activities of the major evaluation initiatives. Special attention is given to the current tracks and developments within TREC, CLEF and NTCIR. The evaluation tasks and issues, as well as some results, will be presented.