Call for papers LREC'2000 Satellite Workshop "Using Evaluation within HLT Programs: Results and Trends" Organized jointly by the IST/HLT-CLASS project, the ELSNET Network and ELRA, the European Language Resource Association. to be held in Athens, Greece, on May 30, 2000 A half-day workshop, will be held in conjunction with the LREC Conference in Athens on May 30, 2000 (morning). The theme of the workshop is "what exists, how it's used and what is needed in terms of Evaluation" within Human Language Technology programs, such as the European IST-HLT program, the US HLT or TIDES programs or those organized by NIST, their Japanese counterparts, or other national programs. Both the evaluation of technologies (systems and components) and the evaluation of applications (user-oriented/usage evaluation) will be addressed across various areas of HLT processing encompassing, but not restricted to, written and spoken language processing: Textual and multimedia document retrieval, Cross-lingual information retrieval, Message and document understanding, Topic detection and tracking, Summarization, Machine translation, Speech recognition and dictation, Speech synthesis, Speech coding, Oral and multimodal dialog. Also experience and methodologies from related domains, such as OCR, Face recognition, Image segmentation and understanding, will be considered. This workshop concerns programs, both national and transnational, as well as projects where evaluation is used to compare technologies and approaches, or to measure progress. Participants and organizers of past or present evaluation programs across the world are encouraged to attend, as well as institutions or companies using or including evaluation in their R&D activities. Especially the former EC-supported projects are invited to present their experience in that field, and the new EC IST-HLT selected projects are most welcomed to present their approach or their needs for objective and subjective evaluation. We wish to get from the workshop presentations a better knowledge of how the various uses and needs of evaluation in the specific context of projects or programs relate to what is available in terms of tools, resources, practices and methodologies for evaluation. We expect to gather a large selection of actors interested or involved in evaluation for Human Language Processing (spoken and written), or related domains, in the hope that it will trigger multilingual and crosslingual international cooperation activities. We would like this workshop to be also a kind of trade-fair for Human Language Technologies and Applications Evaluation. Submission of papers Submissions should consist of an abstract of one page, plus a title page providing the following information: official title of the paper; names and affiliations of the authors; full address of the first author including phone, fax, email, URL; presentation facilities required. Only electronic submissions will be accepted. The submissions should be sent to classwork@limsi.fr. Reception of the submission will be acknowledged within 48 hours. If you do not get an acknowledgement, please check the email address of your submission, and send it again, or contact J. Mariani (mariani@limsi.fr) or P. Paroubek (pap@limsi.fr). Proceedings The workshop organizers will produce proceedings. Therefore, print-ready versions of the selected papers will have to be submitted according to LREC Guidelines for Authors which can be found at www.elda.fr/lrec2000.html. They should be up to 4-6 pages in length. These final versions should be submitted electronically to the same email address: classwork@limsi.fr. Important Dates Deadline for submissions of papers: March 20 Notification of acceptance: April 3 Final versions of papers for proceedings: May 15 Workshop: May 30 Further information Information about the workshop such as call, schedule, and program will be available on the LREC web-page: ( http://www.elda.fr/lrec2000.html ), where you will also find information about the LREC conference and other satellite workshops. Registration The registration fee for the workshop is: - 60 EURO for those not attending LREC - 40 EURO for those attending LREC Registration and payment are explained on the LREC web-page. Included in the registration fee are the proceedings and coffee at the= breaks. Questions For all questions with respect to the workshop focus, please contact the workshop organizers at classwork@limsi.fr . For all questions with respect to organizational issues, accommodation, etc., please contact the LREC secretariat: LREC2000@ilsp.gr. Organizing Committee - Chair: Joseph Mariani, LIMSI-CNRS, France - Niels Ole Bernsen, NIS, Odense University, Denmark - Stephane Chaudiron, University Paris 10 and MENRT, France - Khalid Choukri, ELRA-ELDA, France - Claude de Loupy, LIA, France - Robert Gaizauskas, Sheffield University, UK - Donna Harman, NIST - TREC group, USA - Lynette Hirschman, MITRE, USA - Christian Jacquemin, LIMSI-CNRS, France - Adam Kilgariff, ITRI, University of Brighton, UK - Patrick Paroubek, LIMSI-CNRS, France - Jose Pardo, ETSI, UPM, Spain - Martin Rajman, Swiss Federal Institute of Technology, Lausanne,= Switzerland - Herman Steeneken, TNO-IZF, The Netherlands - Oliviero Stock, IRST-ITC, Italy - Hans Uszkoreit, DFKI, Germany