Title
TSNLP: Test Suites for Natural Language Processing
Abstract
The growing language technology industry needs measurement tools to allow researchers, engineers, managers, and customers to track development, evaluate and assure quality, and assess suitability for a variety of applications.The TSNLP (Test Suites for Natural Language Processing) project has investigated various aspects of the construction, maintenance and application of systematic test suites as diagnostic and evaluation tools for NLP applications. The paper summarizes the motivation and main results of TSNLP: besides the solid methodological foundation of the project, TSNLP has produced substantial (i.e. larger than any existing general test suites) multi-purpose and multi-user test suites for three European languages together with a set of specialized tools that facilitate the construction, extension, maintenance, retrieval, and customization of the test data.The publicly available results of TSNLP represent a valuable linguistic resource that has the potential of providing a wide-spread pre-standard diagnostic and evaluation tool for both developers and users of NLP applications.
Year
DOI
Venue
1996
10.3115/993268.993292
international conference on computational linguistics
Keywords
DocType
Volume
european language,existing general test suite,multi-user test suite,test suites,systematic test suite,test data,evaluation tool,nlp application,natural language processing,available result
Conference
cmp-lg/9607018
Citations 
PageRank 
References 
50
11.77
1
Authors
14
Name
Order
Citations
PageRank
Sabine Lehmann15113.14
Stephan Oepen253361.08
Sylvie Regnier-Prost35012.11
Klaus Netter414944.12
Veronika Lux59216.59
Judith Klein68032.08
Kirsten Falkedal76214.92
Frederik Fouvry86913.49
Dominique Estival920226.25
Eva Dauphin105212.58
Hervè Compagnion115011.77
Judith Baur1210222.57
Lorna Balkan135012.45
Doug Arnold145814.20