Home page
DELOS offcial website
About Workpackage
Aims & objectives
DL Evaluation Resources
Testbeds & toolkits
Discussion Forum for WP Members

This work continues the 1st DELOS Network of Excellence Working Group on Evaluation (2000-2002).

Previous Working Group Website


added 26/09/05
New DELOS NoE Newsletter published
Newsletter No. 4
The fourth issue of the DELOS Newsletter, September 2005, has been published.

Contents of the newsletter:

  • Editorial
  • AVIVDiLib '05
  • Summer School
  • New Collaborative Effort
  • DELOS Researcher Exchange
  • Grid Technologies

added 26/09/05
JCDL 2006 Announcement
June 11-15, 2006 Chapel Hill, North Carolina, USA
The Joint Conference on Digital Libraries is a major international forum focusing on digital libraries and associated technical, practical, and social issues. JCDL encompasses the many meanings of the term "digital libraries," including (but not limited to) new forms of information institutions; operational information systems with all manner of digital content; new means of selecting, collecting, organizing, and distributing digital content; digital preservation and archiving; and theoretical models of information media, including document genres and electronic publishing

Important dates:

January 20, 2006: Submission deadline for full papers, panels, workshops, and tutorials
February 3, 2006: Submission deadline for short papers, demonstrations, and posters
April 7, 2006: Final decisions for accepted papers and abstracts

In cooperation with the American Society for Information Science and Technology (ASIS&T), Coalition for Networked Information (CNI) and DELOS Network of Excellence on Digital Libraries.

back to top

added 08/03/05
INEX 2005 Call for Participation
Initiative for the Evaluation of XML Retrieval Call for participation
April 2005 - December 2005

The DELOS Network of Excellence for Digital Libraries has issued an invitation for participation in an evaluation initiative for XML document retrieval. More detailed information about the aims, the procedures, the topics and the tasks can be found in the INEX website.

Schedule for INEX 2005:
Apr 08: Deadline for the submission of "Application for Participation".
Apr 09 - Apr 15: The collection of XML documents will be distributed to all participants on the receipt of their signed data handling agreement.
Apr 18: Participants will be provided with detailed instructions and formatting criteria for candidate topics/queries.
May 06: Submission deadline for candidate topics.
May 27: Distribution of final set of topics/queries to participants along with detailed information on the formatting requirements of the search results.
Aug 10: Submission deadline of search results.
Aug 26: Distribution of merged results to participants for relevance assessments.
Sep 20: Submission deadline for relevance assessments.
Oct 21: Distribution of XML test collection and evaluation scores to participants.
Nov 13: Submission of papers for the workshop pre-proceedings.

added 08/03/05
ICADL 2005 Call for Papers

8th International Conference on Asian Digital Libraries
Implementing Strategies and Sharing Experiences
12 - 15 December 2005, Bangkok, Thailand

ICADL2005 is the 8th in a well-established series of annual conferences on Asian Digital Libraries, and focuses on the creation, adoption, implementation and utilization of digital libraries. It provides an international forum for sharing experiences among researchers, educators, practitioners, and policy makers from a variety of disciplines such as computer science, library and information science, archival and museum studies, and knowledge management -- as well as many areas in the social sciences and humanities. Submissions of papers, panels, tutorials, and workshops are invited in all areas of digital libraries and related technologies, the management of knowledge in digital libraries, and the associated usability and social issues. Research, system, evaluation, policy, and position papers are all invited.

Suitable topics include but are not limited to:

Strategies with regard to
- economic issues
- legal issues
- organizational issues
- pedagogical issues
- policy issues
- social issues

Implementation experiences regarding
- collection development
- international collaboration
- quality of service
- system evaluation
- user communities
- user studies

- architecture
- concepts and models
- integration
- interoperability

- Asian information processing
- cross-language information access
- human-computer interaction
- information integration
- information mining
- information retrieval
- localization
- metadata
- multimedia
- ontologies
- personalization
- semantic web
- semi-structured data management
- web cataloguing
- web-page analysis

- access control
- content management
- intellectual property
- security and privacy
- service models

Application areas and concerns
- digital archives and museums
- digital preservation
- knowledge management
- education
- e-science
- Grid
- scholarly publishing

Further details about the conference including submission, steering, organizing and program committees, registration and conference location are posted on the conference Web site.

Important dates
Submission of paper abstracts: 8 June 2005
Submission of full papers: 15 June 2005
Submission of panel/tutorial/workshop proposals: 31 July 2005
Notification of acceptance: 31 August 2005
Camera-ready copy due date: 30 September 2005

added 24/01/05
CLEF 2005 Call for Participation
The CLEF series of system evaluation campaigns aims at promoting research into the design and development of user-friendly, multilingual, multimodal retrieval systems.

Registration opens for CLEF 2005 on 31 January.

The objective of CLEF 2005 will be to test different aspects of mono- and cross-language information retrieval system performance. There will be eight tracks this year:

1. Multilingual Document Retrieval on News Collections (Ad-Hoc)
2. Mono- and Cross-Language Information Retrieval on Structured Scientific Data (Domain-Specific)
3. Interactive Cross-Language Information Retrieval (iCLEF)
4. Multiple Language Question Answering (QAatCLEF)
5. Cross-language Retrieval in Image Collections (ImageCLEF)
6. Cross-Language Spoken Document Retrieval (CL-SR)
7. Multilingual Web Track (WebCLEF)
8. Cross-Language Geographical Retrieval (GeoCLEF)

Important dates:
Data Release - from 15 February 2005
Topic Release - from 15 March 2005
Submission of Runs by Participants - from 15 May 2005
Release of relevance assessments and individual results - from 15 July 2005
Submission of paper for Working Notes - 15 August 2005
Workshop - 21-23 September (in conjunction with ECDL 2005)

Test Collections
The CLEF 2005 multilingual corpora include:

  • news documents in 12 European languages
  • social science databases in German and Russian
  • historical photographs and medical image collections with text and/or annotations in English, French and German
  • spontaneous conversational speech
  • multilingual collection of web documents from European governmental sites

For full details on the CLEF Agenda and Task Description for 2005 and instructions on How to Participate, see http://www.clef-campaign.org.

For further information, contact:
Carol Peters - ISTI-CNR
Tel: +39 050 315 2987
Fax: +39 050 315 2810
E-mail: carol.peters@isti.cnr.it

back to top

New DELOS NoE Newsletter published
Joint Conference on Digital Libraries (JCDL) 2006 Announcement
INEX 2005 Call for Participation
ICADL 2005 Call for Papers
CLEF 2005 Call for Participation
News Archive
| Last update: 26-09-05 |
| Contact with webmaster
[remove spam protection] |
DELOS offcial website