Rediscovering 15 Years of Discoveries in Language Resources and Evaluation: The LREC Anthology Analysis

Abstract

This paper aims at analyzing the content of the LREC conferences contained in the ELRA Anthology over the past 15 years (1998)(1999)(2000)(2001)(2002)(2003)(2004)(2005)(2006)(2007)(2008)(2009)(2010)(2011)(2012)(2013).It follows similar exercises that have been conducted, such as the survey on the IEEE ICASSP conference series from 1976 to 1990, which served in the launching of the ESCA Eurospeech conference, a survey of the Association of Computational Linguistics (ACL) over 50 years of existence, which was presented at the ACL conference in 2012, or a survey over the 25 years of the conferences contained in the ISCA Archive, presented at Interspeech 2013.It contains first an analysis of the evolution of the number of papers and authors over time, including the study of their gender, nationality and affiliation, and of the collaboration among authors.It then studies the funding sources of the research investigations that are reported in the papers.It conducts an analysis of the evolution of the research topics within the community over time.It finally looks at reuse and plagiarism in the papers.The survey shows the present trends in the conference series and in the Language Resources and Evaluation scientific community.Conducting this survey also demonstrated the importance of a clear and unique identification of authors, papers and other sources to facilitate the analysis.This survey is preliminary, as many other aspects also deserve attention.But we hope it will help better understanding and forging our community in the global village.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 13 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.