Title
Syntactic and Semantic Features For Code-Switching Factored Language Models
Abstract
This paper presents our latest investigations on different features for factored language models for Code-Switching speech and their effect on automatic speech recognition (ASR) performance. We focus on syntactic and semantic features which can be extracted from Code-Switching text data and integrate them into factored language models. Different possible factors, such as words, part-of-speech tags, Brown word clusters, open class words and clusters of open class word embeddings are explored. The experimental results reveal that Brown word clusters, part-of-speech tags and open-class words are the most effective at reducing the perplexity of factored language models on the Mandarin-English Code-Switching corpus SEAME. In ASR experiments, the model containing Brown word clusters and part-of-speech tags and the model also including clusters of open class word embeddings yield the best mixed error rate results. In summary, the best language model can significantly reduce the perplexity on the SEAME evaluation set by up to 10.8% relative and the mixed error rate by up to 3.4% relative.
Year
DOI
Venue
2017
10.1109/TASLP.2015.2389622
Audio, Speech, and Language Processing, IEEE/ACM Transactions  
Keywords
Field
DocType
natural language processing,speech recognition,asr performance,brown word clusters,mandarin-english code-switching corpus,seame,automatic speech recognition,code-switching factored language models,code-switching speech,code-switching text data,open class word embeddings,part-of-speech tags,semantic features,syntactic features,automatic speech recognition (asr),recurrent neural networks,vectors,speech,speech processing,semantics
Perplexity,Factored language model,Cache language model,Computer science,Code-switching,Word error rate,Recurrent neural network,Speech recognition,Artificial intelligence,Natural language processing,Syntax,Language model
Journal
Volume
Issue
ISSN
abs/1710.01809
3
2329-9290
Citations 
PageRank 
References 
8
0.63
17
Authors
5
Name
Order
Citations
PageRank
Heike Adel16215.03
Ngoc Thang Vu222035.62
Katrin Kirchhoff3102695.24
Dominic Telaar4262.81
T. Schultz52423252.72