Title
Spoken term detection ALBAYZIN 2014 evaluation: overview, systems, results, and discussion
Abstract
Spoken term detection (STD) aims at retrieving data from a speech repository given a textual representation of the search term. Nowadays, it is receiving much interest due to the large volume of multimedia information. STD differs from automatic speech recognition (ASR) in that ASR is interested in all the terms/words that appear in the speech data, whereas STD focuses on a selected list of search terms that must be detected within the speech data. This paper presents the systems submitted to the STD ALBAYZIN 2014 evaluation, held as a part of the ALBAYZIN 2014 evaluation campaign within the context of the IberSPEECH 2014 conference. This is the first STD evaluation that deals with Spanish language. The evaluation consists of retrieving the speech files that contain the search terms, indicating their start and end times within the appropriate speech file, along with a score value that reflects the confidence given to the detection of the search term. The evaluation is conducted on a Spanish spontaneous speech database, which comprises a set of talks from workshops and amounts to about 7 h of speech. We present the database, the evaluation metrics, the systems submitted to the evaluation, the results, and a detailed discussion. Four different research groups took part in the evaluation. Evaluation results show reasonable performance for moderate out-of-vocabulary term rate. This paper compares the systems submitted to the evaluation and makes a deep analysis based on some search term properties (term length, in-vocabulary/out-of-vocabulary terms, single-word/multi-word terms, and in-language/foreign terms).
Year
DOI
Venue
2015
10.1186/s13636-015-0063-8
EURASIP J. Audio, Speech and Music Processing
Keywords
Field
DocType
Spoken term detection, Spanish, International evaluation, Search on spontaneous speech
Speech corpus,Textual representation,Computer science,Speech recognition,Natural language processing,Artificial intelligence,Multimedia information
Journal
Volume
Issue
ISSN
2015
1
1687-4722
Citations 
PageRank 
References 
5
0.53
57
Authors
10