RSS twitter Login
elra-elda-logo.png
Home Contact Login

Publications @ ELDA

Share this page!
twitter google-plus linkedin share

The following list shows the papers in English and in French that have been presented and/or published by the ELDA staff members. The papers are sorted alphabetically by the surname of the first author. The list also displays Research Reports and Dissertations. When available, the link to the online copy of the paper is provided.

Conferences, Workshops, Journals, Books


 

2024 |  2023 |  2022 | 2021 | 2020 | 2019 | 2018 | 2016 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000 | 1999 | 1998


2024

Automatic Speech Recognition and Understanding in Air Traffic Management Published by MDPI; Editors: Hartmut Helmke and Oliver Ohneiser.

2023

Juan Zuluaga-Gomez, Iuliia Nigmatulina, Amrutha Prasad, Petr Motlicek, Driss Khalil,
Srikanth Madikeri, Allan Tart, Igor Szoke, Vincent Lenders, Mickael Rigault and Khalid Choukri. Lessons Learned in Transcribing 5000 h of Air Traffic Control Communications for Robust Automatic Speech Understanding. In Aerospace Journal.

2022

Juan Zuluaga-Gomez, Iuliia Nigmatulina, Amrutha Prasad, Petr Motlicek, Driss Khalil, Srikanth Madikeri, Allan Tart, Igor Szoke, Vincent Lenders, Mickael Rigault and Khalid Choukri. Language Resources to Support Language Diversity – the ELRA Achievements. In Proceedings of the Thirthteenth International Conference on Language Resources and Evaluation (LREC 2022), June 2022, Marseille, France.

Mickaël Rigault, Victoria Arranz, Valérie Mapelli, Penny Labropoulou and Stelios Piperidis. Categorizing legal features in a metadata-oriented task: defining the conditions of use. In Proceedings of the Workshop on Ethical and Legal Issues in Human Language Technologies and Multilingual De-Identification of Sensitive Data In Language Resources (co-loacted with (LREC 2022), June 2022, Marseille, France.

Mickaël Rigault, Claudia Cevenini, Khalid Choukri, Martin Kocour, Karel Veselý, Igor Szoke, Petr Motlicek, Juan Pablo Zuluaga-Gomez, Alexander Blatt, Dietrich Klakow, Allan Tart, Pavel Kolčárek and Jan Černocký. Legal and Ethical Challenges in Recording Air Traffic Control Speech. In Proceedings of the Workshop on Ethical and Legal Issues in Human Language Technologies and Multilingual De-Identification of Sensitive Data In Language Resources (co-loacted with (LREC 2022), June 2022, Marseille, France.

Victoria Arranz, Khalid Choukri, Montse Cuadros, Aitor García Pablos, Lucie Gianola, Cyril Grouin, Manuel Herranz, Patrick Paroubek and Pierre Zweigenbaum. MAPA Project: Ready-to-Go Open-Source Datasets and Deep Learning Technology to Remove Identifying Information from Text Documents. In Proceedings of the Workshop on Ethical and Legal Issues in Human Language Technologies and Multilingual De-Identification of Sensitive Data In Language Resources (co-loacted with (LREC 2022), June 2022, Marseille, France.

2021

Martin Kocour, Karel Veselý, Igor Szöke, Santosh Kesiraju, Juan Zuluaga-Gomez, Alexander Blatt, Amrutha Prasad, Iuliia Nigmatulina, Petr Motlíček, Dietrich Klakow, Allan Tart, Hicham Atassi, Pavel Kolčárek, Jan Černocký, Claudia Cevenini, Khalid Choukri, Mickael Rigault, Fabian Landis, Saeed Sarfjoo and Chloe Salamin
Automatic Processing Pipeline for Collecting and Annotating Air-Traffic Voice Communication Data
In Engineering Proceedings Volume 13, Issue 1 - The Proceedings of the 9th OpenSky Symposium, November 18–19,  2021 (online).

Georg Rehm, Stelios Piperidis, Kalina Bontcheva, Jan Hajič, Victoria Arranz, Andrejs Vasiļjevs, Gerhard Backfried, José Manuel Gómez Pérez, Ulrich Germann, Rémi Calizzano, Nils Feldhus, Stefanie Hegele, Florian Kintzel, Katrin Marheinecke, Julián Moreno-Schneider, Dimitris Galanis, Penny Labropoulou, Miltos Deligiannis, Katerina Gkirtzou, Athanasia Kolovou, Dimitris Gkoumas, Leon Voukoutis, Ian Roberts, Jana Hamrlová, Dušan Variš, Lukáš Kačena, Khalid Choukri, Valérie Mapelli, Mickaël Rigault, Jūlija Meļņika, Miro Jánošík, Katja Prinz, Andres Garcia-Silva, Cristian Berrio, Ondrej Klejch, Steve Renals. European Language Grid: A Joint Platform for the European Language Technology Community. In Proceedings of the 16th conference of the European Chapter of the Association for Computational Linguistics (EACL 2021), April 19-23, 2021 (online).

2020

Penny Labropoulou, Katerina Gkirtzou, Maria Gavriilidou, Miltos Deligiannis, Dimitris Galanis, Stelios Piperidis, Georg Rehm, Maria Berger, Valérie Mapelli, Michael Rigault, Victoria Arranz, Khalid Choukri, Gerhard Backfried, Jose Manuel Gomez-Perez and Andres Garcia-Silva. Making Metadata Fit for Next Generation Language Technology Platforms: The Metadata Schema of the European Language Grid. In Proceedings of the Twelfth International Conference on Language Resources and Evaluation (LREC 2020), May 2020, Marseille, France.

Georg Rehm, Maria Berger, Ela Elsholz, Stefanie Hegele, Florian Kintzel, Katrin Marheinecke, Stelios Piperidis, Miltos Deligiannis, Dimitris Galanis, Katerina Gkirtzou, Penny Labropoulou, Kalina Bontcheva, David Jones, Ian Roberts, Jan Hajic, Jana Hamrlová, Lukáš Kačena, Khalid Choukri, Victoria Arranz, Andrejs Vasiļjevs, Orians Anvari, Andis Lagzdiņš, Jūlija Meļņika, Gerhard Backfried, Erinç Dikici, Miroslav Janosik, Katja Prinz, Christoph Prinz, Severin Stampler, Dorothea Thomas-Aniola, Jose Manuel Gomez-Perez, Andres Garcia Silva, Christian Berrío, Ulrich Germann, Steve Renals and Ondrej Klejch (2020). European Language Grid: An Overview. In Proceedings of the Twelfth International Conference on Language Resources and Evaluation (LREC 2020), May 2020, Marseille, France.

Georg Rehm, Katrin Marheinecke, Stefanie Hegele, Stelios Piperidis, Kalina Bontcheva, Jan Hajic, Khalid Choukri, Andrejs Vasiļjevs, Gerhard Backfried, Christoph Prinz, Jose Manuel Gomez-Perez, Luc Meertens, Paul Lukowicz, Josef van Genabith, Andrea Lösch, Philipp Slusallek, Morten Irgens, Patrick Gatellier, Joachim Köhler, Laure Le Bars, Dimitra Anastasiou, Albina Auksoriūtė, Núria Bel, António Branco, Gerhard Budin, Walter Daelemans, Koenraad De Smedt, Radovan Garabík, Maria Gavriilidou, Dagmar Gromann, Svetla Koeva, Simon Krek, Cvetana Krstev, Krister Lindén, Bernardo Magnini, Jan Odijk, Maciej Ogrodniczuk, Eiríkur Rögnvaldsson, Mike Rosner, Bolette Pedersen, Inguna Skadina, Marko Tadić, Dan Tufiș, Tamás Váradi, Kadri Vider, Andy Way and François Yvon (2020). The European Language Technology Landscape in 2020: Language-Centric and Human-Centric AI for Cross-Cultural Communication in Multilingual Europe. In Proceedings of the Twelfth International Conference on Language Resources and Evaluation (LREC 2020), May 2020, Marseille, France.

Georg Rehm, Kalina Bontcheva, Khalid Choukri, Jan Hajic, Stelios Piperidis, and Andrejs Vasiljevs, editors. Proceedings of the 1st International Workshop on Language Technology Platforms (IWLTP 2020, co-located with LREC 2020), Marseille, France, 2020. 16 May 2020.

Georg Rehm, Dimitrios Galanis, Penny Labropoulou, Stelios Piperidis, Martin Welß, Ricardo Usbeck, Joachim Köhler, Miltos Deligiannis, Katerina Gkirtzou, Johannes Fischer, Christian Chiarcos, Nils Feldhus, Julián Moreno-Schneider, Florian Kintzel, Elena Montiel, Víctor Rodríguez Doncel, John P. McCrae, David Laqua, Irina Patricia Theile, Christian Dittmar, Kalina Bontcheva, Ian Roberts, Andrejs Vasiljevs, and Andis Lagzdiņš. Towards an Interoperable Ecosystem of AI and LT Platforms: A Roadmap for the Implementation of Different Levels of Interoperability. In Georg Rehm, Kalina Bontcheva, Khalid Choukri, Jan Hajic, Stelios Piperidis, and Andrejs Vasiljevs, editors, Proceedings of the 1st International Workshop on Language Technology Platforms (IWLTP 2020, co-located with LREC 2020), pages 96-107, Marseille, France, 2020. 16 May 2020.

Juan Pablo Zuluaga Gómez, Karel Vesely, Alexander Blatt, Petr Motlicek, Dietrich Klakow, Allan Tart, Igor Szoke, Amrutha Prasad, Saeed Sarfjoo, Pavel Kolcarek, Martin Kocour, Honza Cernocky, Claudia Cevenini, Khalid Choukri, Mickael Rigault and Fabian Landis.
Automatic Callsign Detection: Matching Air Surveillance Data with Air Traffic Spoken Communications. See the Slides and the Video Presentation.
In Proceedings of the 8th OpenSky Symposium 2020. November 2020.

Claudia Cevenini, Khalid Choukri, Mickael Rigault, Petr Motlicek, Alexander Blatt, Honza Cernocky, Dietrich Klakow, Martin Kocour, Pavel Kolcarek, Fabian Landis, Amrutha Prasad, Saeed Sarfjoo, Igor Szoke, Allan Tart, Karel Vesely and Juan Pablo Zuluaga Gómez.
ATCO2 project: a first legal framework on air traffic control (ATC) data collection and sharing. See the Video Presentation


2019

Ahmed Ali, Suwon Shon, Younes Samih, Hamdy Mubarak, Ahmed Abdelali, James Glass, Steve Renals, Khalid Choukri (2019). The MGB-5 Challenge: Recognition and Dialect Identification of Dialectal Arabic Speech. IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Singapore, 2019, pp. 1026-1033, doi: 10.1109/ASRU46091.2019.9003960.

Luc Meertens, Khalid Choukri, Stefania Aguzzi, Andrejs Vasiljevs (2019). Final study report on CEF Automated Translation value proposition in the context of the European LT market/ecosystem. A study prepared for the European Commission DG Communications Networks, Content & Technology by Crosslang, ELDA, IDC and Tilde. © European Union, 2019. All rights reserved. Certain parts are licensed under conditions to the EU.


2018

Pawel Kamocki, Valérie Mapelli and Khalid Choukri (2018) Data Management Plan (DMP) for Language Data under the New General Data Protection Regulation (GDPR). In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), May 2018, Miyazaki, Japan.

Marc Kupietz, Harald Lüngen, Pawel Kamocki and Andreas Witt (2018).  The German Reference Corpus DeReKo: New Developments – New Opportunities. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), May 2018, Miyazaki, Japan.

Andrea Lösch, Valérie Mapelli, Stelios Piperidis, Andrejs Vasiļjevs, Lilli Smal, Thierry Declerck, Eileen Schnur, Khalid Choukri and Josef Van Genabith (2018). European Language Resource Coordination: Collecting Language Resources for Public Sector Multilingual Information Management . In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), May 2018, Miyazaki, Japan.

Valérie Mapelli, Victoria Arranz, Hélène Mazo, Pawel Kamocki and Vladimir Popescu (2018).  New Directions in ELRA Activities. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), May 2018, Miyazaki, Japan.

Houda Saadane, Hosni Seffih, Christian Fluhr, Khalid Choukri and Nasredine Semmar (2018). Automatic Identification of Maghreb Dialects Using a Dictionary-Based Approach. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), May 2018, Miyazaki, Japan.


2016

Khalid Choukri, Valérie Mapelli, Hélène Mazo and Vladimir Popescu (2016).  ELRA Activities and Services. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), May 2016, Portorož, Slovenia.

Thibault Grouas, Valérie Mapelli and Quentin Samier. Review on the Existing Language Resources for Languages of France. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), May 2016. Portorož, Slovenia

Valérie Mapelli, Vladimir Popescu, Lin Liu and Khalid Choukri (2016).  Language Resource Citation: the ISLRN Dissemination and Further Developments. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), May 2016, Portorož, Slovenia.

Vladimir Popescu, Lin Liu, Riccardo Del Gratta, Khalid Choukri and Nicoletta Calzolari (2016).  New Developments in the LRE Map. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), May 2016, Portorož, Slovenia.

Meritxell Fernández Barrera, Vladimir Popescu, Antonio Toral, Federico Gaspari and Khalid Choukri (2016).  Enhancing Cross-border EU E-commerce through Machine Translation: Needed Language Resources, Challenges and Opportunities. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), May 2016, Portorož, Slovenia.

Valérie Mapelli, Vladimir Popescu, Lin Liu, Fernández Barrera, Meritxell and Khalid Choukri (2016).  The ELRA License Wizard. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), May 2016, Portorož, Slovenia.


2014

Elisabet Comelles, Jordi Atserias, Victoria Arranz, Irene Castellon and Jordi Sesé (2014). VERTa: Facing a Multilingual Experience of a Linguistically-based MT Evaluation. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC 2014), May 2014, Reykjavik, Iceland

Victoria Arranz, Khalid Choukri, Valérie Mapelli and Hélène Mazo (2014). ELRA's Consolidated Services for the HLT Community. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC 2014), May 2014, Reykjavik, Iceland

Sylvie Brunessaux, Patrick Giroux, Bruno Grilheres, Mathieu Manta, Maylis Bodin, Khalid Choukri, Olivier Galibert, Juliette Kahn (2014). The Maurdor Project: Improving Automatic Processing of Digital Documents. In 2014 11th IAPR International Workshop on Document Analysis Systems, 7-10 April 2014, Tours, France (see IEEEXplore for the Abstract)

Olivier Galibert, Jeremy Leixa, Gilles Adda, Khalid Choukri and Guillaume Gravier (2014). The ETAPE Speech Processing Evaluation. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC 2014), May 2014, Reykjavik, Iceland

Stelios Piperidis, Harris Papageorgiou, Christian Spurk, Georg Rehm, Khalid Choukri, Olivier Hamon, Nicoletta Calzolari, Riccardo Del Gratta, Bernardo Magnini and Christian Girardi (2014). META-SHARE: One Year After. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC 2014), May 2014, Reykjavik, Iceland

Joseph Mariani, Patrick Paroubek, Gil Francopoulo, Olivier Hamon (2014). Rediscovering 15 Years of Discoveries in Language Resources and Evaluation: The LREC Anthology Analysis. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC 2014), May 2014, Reykjavik, Iceland


2012

Victoria Arranz and Olivier Hamon (2012). On the Way to a Legal Sharing of Web Applications in NLP. In Proceedings of the Eighth conference on International Language Resources and Evaluation (LREC 2012), May 2012, Istanbul, Turkey.

Christian Federmann, Byron Georgantopoulos, Christian Girardi, Olivier Hamon, Dimitris Mavroeidis, Minutoli Salvatore, and Marc Schröder (2012). META-SHARE v1 : An Open Network of Repositories for Language Resources including Data and Tools. In Proceedings of the Eighth conference on International Language Resources and Evaluation (LREC 2012), May 2012, Istanbul, Turkey.

Jungyeul Park, Victoria Arranz, Olivier Hamon, and Khalid Choukri (2012). Using the International Standard Language Resource Number : Practical and Technical Aspects. In Proceedings of LREC’12. Istanbul, Turkey, 2012.

Marc Poch Riera, Antonio Toral, Olivier Hamon, Valeria Quochi, and Núria Bel.Towards a User-Friendly Platform for Building Language Resources based on Web Services. In Proceedings of the Eighth conference on International Language Resources and Evaluation (LREC 2012), May 2012, Istanbul, Turkey.

Valérie Mapelli, Victoria Arranz, Matthieu Carré, Hélène Mazo, Djamel Mostefa and Khalid Choukri (2012). ELRA in the heart of a cooperative HLT world. InProceedings of the Eighth conference on International Language Resources and Evaluation (LREC 2012), May 2012, Istanbul, Turkey.

Aude Giraudel, Matthieu Carré, Valérie Mapelli, Juliette Kahn, Olivier Galibert and Ludovic Quintard (2012). The REPERE Corpus : a multimodal corpus for person recognition. In Proceedings of the Eighth conference on International Language Resources and Evaluation (LREC 2012), May 2012, Istanbul, Turkey.

Maria Gavrilidou, Penny Labropoulou, Elina Desipri, Stelios Piperidis, Haris Papageorgiou, Monica Monachini, Francesca Frontini, Thierry Declerck, Gil Francopoulo, Victoria Arranz and Valérie Mapelli (2012). The META-SHARE Metadata Schema for the Description of Language Resources. In Proceedings of the Eighth conference on International Language Resources and Evaluation (LREC 2012), May 2012, Istanbul, Turkey.


2011

Arranz Victoria, Hamon Olivier, Boudahmane Karim and Garnier-Rizet Martine (2011). Protocol and Lessons Learnt from the Production of Parallel Corpora for the Evaluation of Speech Translation Systems. In Proceedings of the International Workshop on Spoken Language Translation (IWSLT 2011). San Francisco, California, USA. December 8-9 2011.

Choukri Khalid, Park Jungyeul, Hamon Olivier, and Arranz Victoria (2011). Proposal for the International Standard Language Resource Number. In Proceedings of IJCNLP 2011 Workshop on Language Resources, Technology and Services in the Sharing Paradigm, Chiang Mai, Thailand. November 8-13, 2011.

Comelles Elisabet, Atserias Jordi, Arranz Victoria, Castellon Irene, Hamon Olivier (2011). VERTa : Exploring a Multidimensional Linguistically-Motivated Metric. In Proceedings of International Workshop on Using Linguistic Information for Hybrid Machine Translation LIHMT , Barcelona, Spain. November 18, 2011.

Gavrilidou Maria, Labropoulou Penny, Piperidis Stelios, Francopoulo Gil, Monachini Monica, Frontini Francesca, Arranz Victoria, Mapelli Valérie (2011). A Metadata Schema for the Description of Language Resources (LRs). In Proceedings of IJCNLP 2011 Workshop on Language Resources, Technology and Services in the Sharing Paradigm, Chiang Mai, Thailand. November 8-13, 2011. Hamon Olivier,

Choukri Khalid (2011). Evaluation Methodology and Results for English-to-Arabic MT. In Proceedings of MT Summit XIII, September 2011, Xiamen, China, pp. 480-487.


2010

Arranz Victoria : ELRA/ELDA : Activities on the Identification, Distribution and Production of Language Resources and on the Evaluation of Human Language TechnologiesGRIAL Seminar, University of Barcelona and Open University of Catalunya, Barcelona, Spain, July 9, 2010.

Arranz Victoria, Choukri Khalid (2010). ELRA’s Services 15 Years on...Sharing and Anticipating the Community, In Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC 2010), May 2010, Valletta, Malta.

Calzolari Nicoletta, Soria Claudia, Del Gratta Riccardo, Goggi Sara, Quochi Valeria, Russo Irene, Choukri Khalid, Mariani Joseph, Piperidis Stelios (2010). The LREC Map of Language Resources and Technologies, In Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC 2010), May 2010, Valletta, Malta.

Cieri Christopher, Choukri Khalid, Calzolari Nicoletta, Langendoen D. Terence, Leveling Johannes, Palmer Martha, Ide Nancy, Pustejovsky James (2010). A Road Map for Interoperable Language Resource Metadata, In Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC 2010), May 2010, Valletta, Malta.

Comelles Elisabet, Arranz Victoria and Castellón Irene. Constituency and Dependency Parsers Evaluation. Proceedings of XXVI Congreso de la Sociedad Española para el Procesamiento del Lenguaje Natural (SEPLN-2010), Valencia, Spain, September 8-10, 2010.

Giménez Jesús, Màrquez Lluís, Comelles Elisabet, Castellón Irene and Arranz Victoria. Document-level Automatic MT Evaluation based on Discourse Representations. Proceedings of the 5th Workshop on Statistical Machine Translation (at ACL 2010), Uppsala, Sweden, July 15-16, 2010.

Hamon Olivier (2010). Is my Judge a good One ?, In Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC 2010), May 2010, Valletta, Malta.

Maegaard Bente, Attia Mohamed, Choukri Khalid, Hamon Olivier, Krauwer Steven, Yaseen Mustafa (2010). Cooperation for Arabic Language Resources and Tools ― The MEDAR Project, In Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC 2010), May 2010, Valletta, Malta.

Moreau Nicolas, Hamon Olivier, Mostefa Djamel, Rosset Sophie, Galibert Olivier, Lamel Lori, Turmo Jordi, Comas Pere R., Rosso Paolo, Buscaldi Davide, Choukri Khalid (2010). Evaluation Protocol and Tools for Question-Answering on Speech Transcripts In Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC 2010), May 2010, Valletta, Malta.

Paroubek Patrick, Pak Alexander, Mostefa Djamel (2010). Annotations for Opinion Mining Evaluation in the Industrial Context of the DOXA project, InProceedings of the Seventh conference on International Language Resources and Evaluation (LREC 2010), May 2010, Valletta, Malta.


2009

Arranz Victoria (2009). Les systèmes de traduction automatique. In Workshop Les défis de la gestion des langues dans les entreprises mondialisées, i-expo 2009, Paris, France, June 17-18 2009.

Besançon Romaric, Mostefa Djamel, Timimi Ismaïl, Chaudiron Stéphane, Laïb Mariama and Choukri Khalid (2009). Arabic, English and French : Three Languages in a Filtering Systems Evaluation Project, In Proceedings of the Second International Conference on Arabic Language Resources and Tools, April 22-23, 2009 Cairo, Egypt.

Hamon Olivier, Fügen Christian, Mostefa Djamel, Arranz Victoria, Kolss Muntsin, Waibel Alex, Choukri Khalid (2009). End-to-End Evaluation in Simultaneous Translation. In Proceedings of the 12th Conference of the European Chapter of the ACL (EACL 2009), March 2009, Athens, Greece, pp. 345-353.

Mostefa Djamel, Laïb Mariama, Chaudiron Stéphane, Choukri Khalid and de Chalendar Gaël (2009). A Multilingual Named Entities Corpus for Arabic, English and French In Proceedings of the Second International Conference on Arabic Language Resources and Tools, April 22-23, 2009 Cairo, Egypt.

Nazarenko Adeline, Zargayouna Haïfa, Hamon, Olivier, van Puymbrouck Jonathan (2009). Evaluation des outils terminologiques : enjeux, difficultés et propositions. In T.A.L. : Traitement Automatique de la Langue, vol 50. n.1/2009, pp 257-281.

Paulsson Niklas, Choukri Khalid, Mostefa Djamel, DiPersio Denise, Glenn Meghan and Strassel Stephanie (2009). A Large Arabic Broadcast News Speech Data Collection In Proceedings of the Second International Conference on Arabic Language Resources and Tools, April 22-23, 2009 Cairo, Egypt.


2008

Arranz Victoria, Gandcher Franck, Mapelli Valérie, Choukri Khalid (2008). A Guide for the Production of Reusable Language Resources. In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC08), May 2008, Marrakech, Morocco.

Arranz Victoria, Mazo Hélène, Mapelli Valérie, Choukri Khalid (2008). Latest Developments in ELRA’s Services In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC08), May 2008, Marrakech, Morocco.

Bendahman Chomicha, Glenn Meghan, Mostefa Djamel, Paulsson Niklas and Strassel Stephanie (2008). Quick Rich Transcriptions of Arabic Broadcast News Speech Data In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC08), May 2008, Marrakech, Morocco.

Besançon Romaric, Chaudiron Stéphane, Mostefa Djamel, Hamon Olivier, Timimi Ismaïl, Choukri Khalid (2008). Overview of CLEF 2008 INFILE pilot track. In Working notes for the CLEF 2008 workshop, ECDL conference, September 2008, Aarhus, Denmark.

Besançon Romaric, Chaudiron Stéphane, Mostefa Djamel, Timimi Ismaïl and Choukri Khalid (2008). The INFILE Project : a Crosslingual Filtering Systems Evaluation Campaign, In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC08), May 2008, Marrakech, Morocco.

Bonastre Jean-François, Gravier Guillaume, Geoffrois Édouard, Choukri Khalid and Mostefa Djamel (2008). Évaluation des systèmes de transcription enrichie d’émissions radiophoniques In L’évaluation des technologies de traitement de la langue : les campagnes Technolangue (Traité IC2, série Cognition et traitement de l’information), Hermès, 2008.

Chaudiron Stéphane, Besançon Romaric, Mostefa Djamel, Timimi Ismaïl, Laïb Meriama and Choukri Khalid (2008). InFile : une campagne d’évaluation des logiciels de filtrage d’information textuelle In Actes du Colloque International en traductologie et TAL, Oran, Algeria, June 2008.

Choi D-L, Kim B-W, Um Yongnam, Lee Y-J, Paulsson Niklas, Choukri Khalid (2008).Creation and Assessment of LILA Korean Speech Database. In Proceedings of the Oriental COCOSDA Conference 2008, November 2008, Kyoto, Japan.

Forner Pamela, Peñas Anselmo, Alegria Iñaki, Forăscu Corina, Moreau Nicolas, Osenova Petya, Prokopidis Prokopis, Rocha Paulo, Sacaleanu Bogdan, Sutcliffe Richard and Tjong Kim Sang Erik (2008). Overview of the CLEF 2008 Multilingual Question Answering Track, In Working notes for the CLEF 2008 workshop, ECDL conference, September 2008, Aarhus, Denmark.

Hamon Olivier, Mostefa Djamel (2008). The Impact of Reference Quality on Automatic MT Evaluation. In Proceedings of Coling 2008, August 2008, Manchester, UK, pp. 37-40.

Hamon Olivier, Mostefa Djamel (2008). An Experimental Methodology for an End-to-End Evaluation in Speech-to-Speech Translation. In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC08), May 2008, Marrakech, Morocco.

Hamon Olivier, Mostefa Djamel, Arranz Victoria (2008). Diagnosing Human Judgments in MT Evaluation : an Example based on the Spanish Language. In Proceedings of MATMT, February, 2008, San Sebastian, Spain, pp 19-26.

Hamon Olivier, Paroubek Patrick, Mostefa Djamel (2008). Sews : un serveur d’évaluation orienté Web pour la Syntaxe. (pdf, in French) T.A.L. : Traitement Automatique de la Langue, vol. 49, n. 2/2008, pp 247-270.

Höge Harald, Kacic Zdravko, Kotnik Bojan, Rojc Matej, Moreau Nicolas and Hain Horst-Udo (2008). Evaluation of Modules and Tools for Speech Synthesis : The ECESS Framework, In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC08), May 2008 Marrakech, Morocco.

Lamel Lori, Rosset Sophie , Ayache Christelle, Mostefa Djamel, Turmo Jordi and Comas Pere (2008). Question Answering on Speech Transcriptions : the QAST evaluation in CLEF, In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC08), May 2008 Marrakech, Morocco.

Moreau Nicolas, Mostefa Djamel, Stiefelhagen Rainer, Burger Susanne and Choukri Khalid (2008). Data Collection for the CHIL CLEAR 2007 Evaluation Campaign, In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC08), May 2008 Marrakech, Morocco.

Mostefa Djamel and Vallée Arnaud (2008). New Telephone Speech Databases for French : a Children Database and an optimized Adult Corpus, In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC08), May 2008 Marrakech, Morocco.

Sanders Eric, Moreno Asuncion, Tropf Herbert, Melnar Lynette, Dekel Nurit, Gillies Breanna, Paulsson Niklas (2008). LILA : Cellular Telephone Speech Databases from Asia. In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC08), May 2008, Marrakech, Morocco.

Turmo Jordi, Comas Pere, Rosset Sophie, Lamel Lori, Moreau Nicolas, Mostefa Djamel (2008). Overview of QAST 2008, In Working notes for the CLEF 2008 workshop, ECDL conference, September 2008, Aarhus, Denmark.

Villemonte de la Clergerie Éric, Hamon Olivier, Mostefa Djamel, Ayache Christelle, Paroubek Patrick, Vilnat Anne (2008). PASSAGE : from French Parser Evaluation to Large Sized Treebank. In Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC08), May 2008 Marrakech, Morocco.

Vilnat Anne, Francopoulo Gilles, Hamon Olivier, Loiseau Sylvain, Paroubek Patrick, Villemonte de la Clergerie Eric (2008). Large Scale Production of Syntactic Annotations to Move Forward. In Proceedings of Coling 2008 Workshop on Cross-Framework and Cross-Domain Parser Evaluation, August 2008, Manchester, UK, pp. 36-43. 2007


2007

Choukri Khalid, Hamon Olivier, Mostefa Djamel (2007). MT Evaluation & TC-STAR. Presentation at the MT Summit XI Workshop on Automatic Procedures in Machine Translation Evaluation, Copenhagen, September 2007.

Estrella Paula, Hamon Olivier, Popescu-Belis Andrei (2007). How Much Data is Needed for Reliable MT Evaluation ? Using Bootstrapping to Study Human and Automatic Metrics. In Proceedings of MT Summit XI, September, 2007, Copenhagen, Denmark.

Hamon Olivier (2007). TC-STAR : WP5, Automatic End-to-End Evaluation Results. Presentation at the TC-STAR Workshop on Speech-to-Speech Translation,Aachen, June 2007.

Hamon Olivier (2007). Experience and Conclusions from the CESTA Evaluation Project. Presentation at the MT Summit XI Workshop on Automatic Procedures in Machine Translation Evaluation, Copenhagen, September 2007.

Hamon Olivier, Hartley Anthony, Popescu-Belis Andrei, Choukri Khalid (2007).Assessing Human and Automated Quality Judgments in the French MT Evaluation Campaign CESTA. In Proceedings of MT Summit XI, September, 2007, Copenhagen, Denmark.

Hamon Olivier, Mostefa Djamel, Choukri Khalid (2007). End-to-End Evaluation of a Speech-to-Speech Translation System in TC-STAR. In Proceedings of MT Summit XI, September, 2007, Copenhagen, Denmark.

Hamon Olivier, Popescu-Belis Andrei, Hartley Anthony, Mustafa El Hadi Widad, Rajman Martin (2007). CESTA : Campagne d’Evaluation des Systèmes de Traduction Automatique. In Chaudiron S. et al., eds., Bilan de l’Action Technolangue (2003-2006), Hermès, Paris, pp 93-116.

Mostefa Djamel, Hamon Olivier, Moreau Nicolas (2007). TC-STAR : Overview of the Evaluation Campaign. Presentation at the TC-STAR Workshop on Speech-to-Speech Translation, Aachen, June 2007.

Mostefa Djamel, Moreau Nicolas, Choukri Khalid, Potamianos Gerasimos, Chu Stephen, Tyagi Ambrish, Casas Josep, Turmo Jordi, Cristoforetti Luca, Tobia Francesco, Pnevmatikakis Aristodemos, Mylonakis Vassilis, Talantzis Fotios, Burger Susanne, Stiefelhagen Rainer, Bernardin Keni and Rochet Cedrick (2007).The CHIL audiovisual corpus for lecture and meeting analysis inside smart rooms In Language Resources and Evaluation, Vol. 41, No. 3. 16 December 2007, pp. 389-407.

Stiefelhagen Rainer, Bernardin Keni, Bowers Rachel, Garofolo John, Mostefa Djamel and Soundararajan Padmanabhan (2007). The CLEAR 2006 Evaluation In Multimodal Technologies for Perception of Humans, Lecture Notes of Computer Science, Volume 4122/2007, pp 1-44, 2007.

Turmo Jordi, Comas Pere, Ayache Christelle, Mostefa Djamel, Rosset Sophie and Lamel Lori (2007). Overview of QAST 2007 In Working Notes for the CLEF 2007 Workshop, September 2007, Budapest, Hungary

Véronis Jean, Hamon Olivier, Ayache Christelle, Belmouhoub Rachid, Kraif Olivier, Laurent Dominique, Nguyen Thi Minh Huyen, Semmar Nasredine, Stuck François, Zaghouani Wadji (2007). La Campagne d’Évaluation ARCADE II. In Chaudiron S. et al., eds., Bilan de l’Action Technolangue (2003-2006), Hermès, Paris, pp 47-69.

Zargayouna Haïfa, Hamon Olivier, Nazarenko Adeline (2007). Evaluation des outils terminologiques : état des lieux et propositions. In Actes des 7e rencontres Terminologiques et Intelligence Artificielle TIA’07, octobre 2007, Sophia Antipolis, pp XX-XX.


2006

Arora Karunesh, Arora Sunita, Agrawal S S, Paulsson Niklas, Choukri Khalid (2006). Experiences in Development of Hindi Speech Corpora based on ELDA standards. In Proceedings of the Oriental COCOSDA 2006 International Conference on Speech Databases and Assessment, December 2006, Penang, Malaysia.

Arranz Victoria, Comelles Elisabet and Farwell David (2006). Multi-Perspective Evaluation of the FAME Speech-to-Speech Translation System for Catalan, English and Spanish. In Recent Advances in NLP. Current Issues in Linguistic Theory, edited by Ruslan Mitkov and Nicolas Nicolov. John Benjamins Publishing Co., Amsterdam, The Netherlands.

Ayache Christelle, Grau Brigitte, Vilnat Anne (2006) EQueR: the French Evaluation campaign of Question-Answering Systems In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genoa, Italy, pp 1157-1160

Cieri Christopher and Liberman Mark (LDC), Arranz Victoria and Choukri Khalid (ELDA) (2006). Linguistic Data Resources. In Multilingual Speech Processing, edited by Tanja Schultz and Katrin Kirchhoff, Elsevier, U.S.A. ISBN : 0120885018

Galliano Sylvain, Geoffrois Édouard, Gravier Guillaume, Bonastre Jean-François, Mostefa Djamel, Choukri Khalid (2006). Corpus description of the ESTER Evaluation Campaign for the Rich Transcription of French Broadcast News, In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genova, Italy, pp 139-142

Gavrilidou Maria, Labropoulou Penny, Piperidis Stelios, Giouli Voula, Calzolari Nicoletta, Monachini Monica, Soria Claudia, Choukri Khalid (2006), Language Resources Production Models: the Case of the INTERA Multilingual Corpus and Terminology In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genoa, Italy, pp 609-614

Hamon Olivier, Popescu-Belis Andrei, Choukri Khalid, Dabbadie Marianne, Hartley Anthony, Mustafa El Hadi Widad, Rajman Martin, Timimi Ismaïl (2006). CESTA : First Conclusions of the Technolanguage MT Evaluation Campaign. In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genova, Italy, pp 179-184.

Hamon Olivier, Rajman Martin (2006). X-Score : Automatic Evaluation of Machine Translation Grammaticality. In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genova, Italy, pp 155-160.

Heuvel Henk van den, Choukri Khalid, Gollan Christian, Moreno Asuncion, Mostefa Djamel (2006) TC-STAR: New language resources for ASR and SLT purposes In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genoa, Italy, pp 2570-2573

Maegaard Bente, Krauwer Steven, Choukri Khalid, Jørgensen Lise Damsgaard (2006) The BLARK concept and BLARK for Arabic In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genoa, Italy, pp 773-778

Magnini Bernardo, Giampiccolo Danilo, Aunimo Lili, Ayache Christelle, Osenova Petya, Peñas Anselmo, de Rijke Maarten, Sacaleanu Bogdan, Santos Diana, Sutcliffe Richard (2006) The Multilingual Question Answering Track at CLEF In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genoa, Italy, pp 1153-1156

Maynard Hélène, Ayache Christelle, Bechet Frédéric, Denis Alexandre, Kuhn Anne, Lefevre Fabrice, Mostefa Djamel, Quignard Matthieu, Rosset Sophie, Servan Christophe, Villaneau Jeanne (2006). Results of the French Evalda-Media evaluation campaign for literal understanding In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genova, Italy, pp 2054-2059

Monachini Monica, Calzolari Nicoletta, Choukri Khalid, Friedrich Jochen, Maltese Giulio, Mammini Michele, Odijk Jan, Ulivieri Marisa (2006), Unified Lexicon and Unified Morphosyntactic Specifications for Written and Spoken Italian In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genoa, Italy, pp 1852-1857

Mostefa Djamel, Hamon Olivier, Choukri Khalid (2006). Evaluation of Automatic Speech Recognition and Speech Language Translation within TC-STAR : Results from the first evaluation campaign. In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genova, Italy, pp 149-154.

Mostefa Djamel, Garcia Marie-Neige, Choukri Khalid (2006). Evaluation of multimodal components within CHIL : The evaluation packages and results, In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genova, Italy, pp 915-918

Mustafa El Hadi Widad, Dabbadie Marianne, Timimi Ismaïl, Choukri Khalid, Hamon Olivier, Chiao, Yun-Chuang (2006). Terminological Resources Acquisition Tools : Toward a User-oriented Evaluation Model. In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genova, Italy, pp 945-948.

Paroubek Patrick, Robba Isabelle, Vilnat Anne, Ayache Christelle (2006), Data, Annotations and Measures in EASY the Evaluation Campaign for Parsers of French. In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genoa, Italy, pp 315-320

Stüker Sebastian, Zong Chengqing, Reichert Jürgen, Cao Wenjie, Kolss Muntsin, Xie Guodong, Peterson Kay, Ding Peng, Arranz Victoria, Yu Jian and Waibel Alex (2006). Speech-to-Speech Translation Services for the Olympic Games 2008. In 3rd Joint Conference on Multimodal Interaction and Related Machine Learning Algorithms (MLMI-2006), Washington DC, U.S.A., May 1-3 2006.

Yaseen M., Attia M., Maegaard B., Choukri K., Paulsson N., Haamid S., Krauwer S., Bendahman C., Fersoe H., Rashwan M., Haddad B., Mokbel C., Mouradi A., Al-Kufaishi A., Shahin M., Chenfour N., Ragheb A. (2006). Building Annotated Written and Spoken Arabic LRs in Nemlar Project. In Proceedings of the 5th International Conference on Language Resources and Evaluation (LREC06), May 2006, Genoa, Italy, p.533-538.

 


2005

Arranz Victoria, Atserias Jordi and Castillo Mauro (2005). Multiwords and Word Sense Disambiguation. In Lecture Notes in Computer Science, vol. 3406, Springer-Verlag, Berlin Heidelberg.

Arranz Victoria and Choukri Khalid (2005). Recent Activities within the European Language Resources Association. In 2nd Language and Technology Conference (L&T-2005), Poznan, Poland, April 21-23, 2005.

Metze F., Gieselmann P., Holzapfel H., Kluge T., Rogina I., Waibel A. and Wölfel M.(TH), Crowley J.L., Reignier P., Vaufreydaz D. (INPG), Bérard F., Cohen B., Coutaz J. and Rouillard S. (UJF) and Arranz V., Bertrán M. and Rodríguez H. (UPC) (2005).The FAME Interactive Space. In 2nd Joint Workshop on Multimodal Interaction and Related Machine Learning Algorithms (MLMI-2005), Edinburgh, UK, July 11-13 , 2005.

Arranz Victoria, Comelles Elisabet and Farwell David (2005). The FAME Speech-to-Speech Translation System for Catalan, English and Spanish. In 10th Machine Translation Summit(MT Summit X), Phuket, Thailand, September 13-15, 2005.

Arranz Victoria, Comelles Elisabet and Farwell David (2005). Sistema de Traducción Oral para el Castellano, Catalán e Inglés. In XXI Congreso de la Sociedad Española para el Procesamiento del Lenguaje Natural (SEPLN-2005),Granada, Spain, September 14-16, 2005.

Arranz Victoria (2005). ELRA/ELDA : The Importance of Sharing Linguistic Resources. In EU Enlargement and Integration Workshop : Exploiting Parallel Corpora in up to 20 Languages, Arona, Italy, September 26-27, 2005.

Arranz Victoria, Comelles Elisabet and Farwell David (2005). Speech-to-Speech Translation for Catalan. In Conference on Lesser Used Languages and Computer Linguistics (LULCL-2005), Bolzano, Italy, October 27-28, 2005.

Charlet Delphine, Krstulovic Sacha, Bimbot Frédéric, Boëffard Olivier, Fohr Dominique, Mella Odile, Korkmazsky Filip, Mostefa Djamel, Choukri Khalid, Vallee Arnaud (2005). Neologos : an optimized database for the development of new speech processing algorithm, In Proceedings of the 9th European Conference on Speech Communication and Technology (InterSpeech 2005), September 2005, Lisbon, Portugal

Galliano Sylvain, Geoffrois Edouard, Mostefa Djamel, Choukri Khalid, Bonastre Jean-François, Gravier Guillaume (2005). The ESTER Phase II Evaluation Campaign for the Rich Transcription of French Broadcast News. In Proceedings of the 9th European Conference on Speech Communication and Technology (InterSpeech 2005), September 2005, Lisbon, Portugal, pp 1149-1152.

Surcin Sylvain, Hamon Olivier, Hartley Anthony, Rajman Martin, Popescu-Belis Andrei, Mustafa El Hadi Widad, Timimi Ismaïl, Dabbadie Marianne, Choukri Khalid (2005). Evaluation of Machine Translation with Predictive Metrics beyond BLEU/NIST : CESTA Evaluation Campaign #1. In Proceedings of MT Summit X,September, 2005, Phuket, Thailand, pp 117-124.

Mustafa El Hadi Widad, Timimi Ismaïl, Choukri Khalid, Chiao Yun-Chuang, Hamon Olivier (2005). CESART : Campagne d’Evaluation de Systèmes d’Acquisition des Ressources Terminologiques. Atelier d’Evaluation des outils d’extraction terminologique dans le cadre des 6e Rencontres Terminologie et Intelligence Artificielle TIA’06, avril 2005, Rouen, France.


2004

Bonastre Jean-François, Choukri Khalid, Galliano Sylvain, Geoffrois Edouard, Gravier Guillaume, Mc Tait Kevin (2004). The ESTER Evaluation Campaign for the Rich Transcription of French Broadcast News In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC04), May 2004, Lisbon, Portugal

Braschler Martin, Choukri Khalid, Gonzalo Julio, Kluck Michael, Peters Carol (2004). The Future of Evaluation for Cross-Language Information Retrieval Systems In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC04), May 2004, Lisbon, Portugal

Calzolari Nicoletta, Choukri Khalid, Gavrilidou Maria, Maegaard Bente, Baroni Paola, Fersøe Hanne, Lenci Alessandro, Mapelli Valérie ,Monachini Monica, Piperidis Stelios (2004). ENABLER Thematic Network of National Projects : Technical, Strategic and Political Issues of LRs. In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC04), May 2004, Lisbon, Portugal pp 937-940.

Choukri Khalid (2004). Recent Activities within the European Language Resources Association: Issues on Sharing Language Resources and Evaluation In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC04), May 2004, Lisbon, Portugal

Choukri Khalid, Cresti Emanuela, Bacelar do Nascimento Fernanda, Martin Philippe, Moreno Sandoval Antonio, Veronis Jean (2004). The C-ORAL-ROM CORPUS. A Multilingual Resource of Spontaneous Speech for Romance Languages. In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC04), May 2004, Lisbon, Portugal

Choukri Khalid, Nikkhou Mahtab, Paulsson Niklas (2004). Network of Data Centres (NetDC) BNSC - An Arabic Broadcast News Speech Corpus. In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC04), May 2004, Lisbon, Portugal.

Devillers Laurence, Maynard Hélène, Rosset Sophie, Paroubek Patrick, McTait Kevin, Mostefa Djamel, Choukri Khalid, Charnay Laurent, Bousquet Caroline, Vigouroux Nadine, Béchet Frédéric, Romary Laurent, Antoine Jean-Yves, Villaneau Jeanne, Vergnes Myriam, Goulian Jérôme (2004). The French MEDIA/EVALDA project : the evaluation of the understanding capability of Spoken Language Dialogue Systems. In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC04), May 2004, Lisbon, Portugal

Iskra Dorota, Choukri Khalid, Emam Ossama, Noguieras Albino, Gedge Oren, Paulsson Niklas, Rainer Siemund, Comeyne Robrecht (200X). OrientTel : more than another SpeechDat for the Mediterranean and Middle East. In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC04), May 2004, Lisbon, Portugal.

Mapelli Valérie, Nava Maria, Surcin Sylvain, Mostefa Djamel, Choukri Khalid (2004). Technolangue : A Permanent Evaluation and Information Infrastructure. In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC04), May 2004, Lisbon, Portugal pp 381-384.

Maynard Hélène, Mctait Kevin, Mostefa Djamel, Devillers Laurence, Rosset Sophie, Paroubek Patrick, Bousquet-Vernhettes Caroline, Choukri Khalid, Goulian Jérôme, Antoine Jean-Yves, Béchet Frédéric, Bontron Olivier, Charnay Laurent, Romary Laurent, Vergnes Myriam, Vigouroux Nadine (2004). Constitution d’un corpus de dialogue oral pour l’évaluation automatique de la compréhension hors et en contexte du dialogue. In XXVe Journées d’Etude sur la Parole (JEP’2004), Avril 2004 Fès, Maroc, 19/04/2004-21/04/2004, LPL-ENS/Fes-AFCP-ISCA, ISBN 2-9518233-3-9, p 357-360.

Moreno Asunción, Choukri Khalid, Hall Phill, van den Heuvel Henk, Sanders Eric, Senia Francesco, Tropf Herbert (2004). Collection of SLR in the Asian-Pacific Area In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC04), May 2004, Lisbon, Portugal.

Pinto Elisabeth, Charlet Delphine, François Hélène, Mostefa Djamel, Boëffard Olivier, Fohr Dominique, Mella Odile, Bimbot Frédéric, Choukri Khalid, Philip Yann, Charpentier Francis (2004). Development of New Telephone Speech Databases for French : The NEOLOGOS Project. In Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC04), May 2004, Lisbon, Portugal.


2003

Mapelli Valérie, van den Heuvel Henk , Maegaard Bente, Höge Harald, Odijk Jan , Choukri Khalid (2003). Quality Control of Language Resources at ELRA, In Proceedings of Europspeech 2003

Mapelli Valérie, Choukri Khalid (2003). Towards an Extended LAnguage Resources Kit (EBLARK) : summary of ELDA’s report within the ENABLER thematic network ELRA Newsletter Vol.8 Nº2, April-June 2003


2002

Mapelli Valérie, Cresti Emanuela, Moneglia Massimo, Bacelar do Nascimento Fernanda, Moreno Sandoval Antonio, Veronis Jean, Martin Philippe , Falavigna Daniele, Cid Antonio, Blum Claude, Choukri Khalid (2002). The C-ORAL-ROM Project. New methods for spoken language archives in a multilingual romance corpus In Proceedings of the 3rd International Conference on Language Resources and Evaluation (LREC 2002), May 2002, La Palmas de Gran Canaria, Spain


2000

Allen Jeff, Choukri Khalid (2000) Survey of Language Engineering Needs: a Language Resources Perspective In Proceedings of the 2nd International Conference on Language Resources and Evaluation (LREC00), May 2000, Athens, Greece

Choukri Khalid, Mance Audrey, Mapelli Valérie (2000). Recent Developments within the European Language Resources Association (ELRA). In Proceedings of the 2nd International Conference on Language Resources and Evaluation (LREC00), May 2000, Athens, Greece pp 67-72.

Chaudiron Stéphane, Choukri Khalid, Mance Audrey, Mapelli Valérie (2000). For a repository of NLP tools. In Proceedings of the 2nd International Conference on Language Resources and Evaluation (LREC00), May 2000, Athens, Greece pp 1273-1278.

van den Heuvel Henk, Boves Lou, Khalid Choukri, Simo Goddijn, Eric Sanders (2000) SLR Validation: Present State of Affairs and Prospects In Proceedings of the 2nd International Conference on Language Resources and Evaluation (LREC00), May 2000, Athens, Greece


1999

Mapelli Valérie, Jeff Allen, Choukri Khalid (1999). New Developments within the European Language Resources Association (ELRA). In Proceedings of Europspeech 1999


1998

Choukri Khalid, Mapelli Valérie (1998). L’Association Européenne pour les Ressources Linguistiques (ELRA). In Actes des 22e Journées d’Etudes sur la Parole (JEP98), Martigny, Switzerland, 1998. pp 183-186

Research Reports

Gandcher Franck, Choukri Khalid, Hamon Olivier, Mapelli Valérie, Moreau Nicolas, Paulsson Niklas, Mostefa Djamel (2008). Réalisation d’un guide de production de resources linguistiques pour la veille, ELDA preliminary report, 2008.

Hamon Olivier (2008). Evaluation of UKA speech-to-speech system, Evaluation report, April 2008. Kleindienst Jan, Macek Tomas, Fanta Martin, Fleury Pascal, Hamon Olivier, Cattoni Roldano, Bilinski Eric, Stüker Sebastian, Kolss Muntsin, Perez Javier, Matusov Eric (2007). Technological Showcase and End-to-End Evaluation Architecture, Technology and Corpora for Speech to Speech Translation (TC-STAR) projectDeliverable D31, May 2007.

Mostefa Djamel, Hamon Olivier, Moreau Nicolas, Choukri Khalid (2007).Evaluation report, Technology and Corpora for Speech to Speech Translation (TC-STAR) projectDeliverable D30, May 2007.

Hamon Olivier, Hartley Anthony, Popescu-Belis Andrei, Rajman Martin, Choukri Khalid, Mustafa El Hadi Widad, Timimi Ismaïl (2007). Rapport du Projet CESTA, Campagne d’Evaluation des Systèmes de Traduction Automatique, Janvier 2007.

Mostefa Djamel, Garcia Marie-Neige, Hamon Olivier, Moreau Nicolas (2006).Evaluation report, Technology and Corpora for Speech to Speech Translation (TC-STAR) projectDeliverable D16, June 2006.

Choukri Khalid, Hamid Salah, Paulsson Niklas (2005). Specifications of the Arabic Broadcast News Speech Corpus. Nemlar Project, March 2005.

Fersoe Hanne, Paulsson Niklas (2005). Validation criteria for Nemlar Arabic Written Corpus. Nemlar Project, 2005.

Mostefa Djamel, Arranz Victoria, Choukri Khalid, Hamon Olivier, Surcin Sylvain (2005). Evaluation report, Technology and Corpora for Speech to Speech Translation (TC-STAR) projectDeliverable D12, June 2005.

Choukri Khalid, Paulsson Niklas (2004). Linguistic survey of Thailand. LILA Project, January 2004. Wegener Knudsen Malene, Bernsen Niels Ole, Dybkjaer Laila, Hansen Thomas, Mapelli Valérie, Martin Jean-Claude, Paulsson Niklas, Pelachaud Catherine, Witrtenburg Peter (2003). Guidelines for the Creation of NIMM Data Resources. ISLE Natural Interactivity and Multimodality Working Group. Deliverable 8.2., February 2003.

Dissertations

Hamon Olivier, 2010. Vers une architecture générique et pérenne pour l’évaluation en traitement automatique des langues : spécifications, méthodologies et mesures. Thèse d’Informatique, Université Paris-Nord, soutenue le 6 décembre 2010. Sous la direction d’Adeline Nazarenko.

Schnober, Carsten, 2010. Towards the Development of a Web-based Alignment Platform .MSc in Speech and Language Processing. The University of Edinburgh.

Hamon Olivier, 2004. Evaluation Automatisée et Méta-évaluation des Systèmes de Traduction Automatique. Mémoire de DEA d’Intelligence Artificielle et Optimisation Combinatoire, Université Paris-Nord, Villetaneuse, soutenu le 1er octobre 2004.

Hamon Olivier, 2004. Mise au Point d’un Environnement d’Evaluation Automatisé de Systèmes de Traduction Automatique. Rapport de Fin d’Etudes d’Ingénierie Logicielle, Université Paris-Nord, Villetaneuse, soutenu le 24 septembre 2004.