Information Retrieval Evaluation in a Changing World Lessons Learned from 20 Years of CLEF

This volume celebrates the twentieth anniversary of CLEF - the Cross-Language Evaluation Forum for the first ten years, and the Conference and Labs of the Evaluation Forum since – and traces its evolution over these first two decades. CLEF’s main mission is to promote research, innovation and develo...

Full description

Bibliographic Details
Other Authors: Ferro, Nicola (Editor), Peters, Carol (Editor)
Format: eBook
Language:English
Published: Cham Springer International Publishing 2019, 2019
Edition:1st ed. 2019
Series:The Information Retrieval Series
Subjects:
Online Access:
Collection: Springer eBooks 2005- - Collection details see MPG.ReNa
Table of Contents:
  • From Multilingual to Multimodal: The Evolution of CLEF over Two Decades
  • The Evolution of Cranfield
  • How to Run an Evaluation Task
  • An Innovative Approach to Data Management and Curation of Experimental Data Generated through IR Test Collections
  • TIRA Integrated Research Architecture
  • EaaS: Evaluation–as–a–Service and Experiences from the VISCERAL Project
  • Lessons Learnt from Experiments on the Ad-Hoc Multilingual Test Collections at CLEF
  • The Challenges of Language Variation in Information Access
  • Multi-lingual Retrieval of Pictures in ImageCLEF
  • Experiences From the ImageCLEF Medical Retrieval and Annotation Tasks
  • Automatic Image Annotation at ImageCLEF
  • Image Retrieval Evaluation in Specific Domains
  • ’Bout Sound and Vision: CLEF beyond Text Retrieval Tasks
  • The Scholarly Impact and Strategic Intent of CLEF eHealth Labs from 2012-2017
  • Multilingual Patent Text Retrieval Evaluation: CLEF-IP
  • Biodiversity Information Retrieval through Large Scale Content-Based Identification: A Long-Term Evaluation
  • From XML Retrieval to Semantic Search and Beyond
  • Results and Lessons of the Question Answering Track at CLEF
  • Evolution of the PAN Lab on Digital Text Forensics
  • RepLab: an Evaluation Campaign for Online Monitoring Systems
  • Continuous Evaluation of Large-scale Information Access Systems: A Case for Living Labs
  • The Scholarly Impact of CLEF 2010-2017
  • Reproducibility and Validity in CLEF
  • Visual Analytics and IR Experimental Evaluation
  • Adopting Systematic Evaluation Benchmarks in Operational Settings