A Statistical and Graphical Methodology for Comparing Bilingual to Monolingual Cross-Language Information Retrieval

Abstract

A new methodology for the evaluation of \ac{MLIA} systems is proposed. This two-fold methodology exploits both statistical analyses and graphical tools in order to provide \ac{MLIA} researchers guidelines, hints, and directions to drive the design and development of the next generation systems, and to provide a means to interpret and compare experimental results and to present these results to other research communities. An example of the application of this methodology is applied in the real-case study of the monolingual and bilingual tasks of the \ac{CLEF} 2005 and 2006