Participative Research laboratory for Multimedia and Multilingual Information Systems Evaluation (PROMISE) is a Network of Excellence, starting in conjunction with this first independent CLEF 2010 conference, and designed to support and develop the evaluation of multilingual and multimedia information access systems, largely through the activities taking place in Cross-Language Evaluation Forum (CLEF) today, and taking it forward in important new ways.
PROMISE is coordinated by the University of Padua, and comprises 10 partners: the Swedish Institute for Computer Science, the University of Amsterdam, Sapienza University of Rome, University of Applied Sciences of Western Switzerland, the Information Retrieval Facility, the Zurich University of Applied Sciences, the Humboldt University of Berlin, the Evaluation and Language Resources Distribution Agency, and the Centre for the Evaluation of Language Communication Technologies.
The single most important step forward for multilingual and multimedia information access which PROMISE will work towards is to provide an open evaluation infrastructure in order to support automation and collaboration in the evaluation process.
[1]
Nicola Ferro,et al.
6 – Towards an infrastructure for digital library performance evaluation
,
2009
.
[2]
Nicola Ferro.
CLEF, CLEF 2010, and PROMISEs: Perspectives for the Cross-Language Evaluation Forum
,
2010,
NTCIR.
[3]
Daniel A. Keim,et al.
Challenges in Visual Data Analysis
,
2006,
Tenth International Conference on Information Visualisation (IV'06).
[4]
A. M. Cox.
Evaluation of Digital Libraries: An Insight into Useful Applications and Methods
,
2010,
Program.