Title
Expanding the MOS: Development and Psychometric Evaluation of the MOS-R and MOS-X
Abstract
The Mean Opinion Scale (MOS) is a questionnaire used to obtain listeners' subjective assessments of synthetic speech. This paper documents the motivation, method, and results of six experiments conducted from 1999 to 2002 that investigated the psychometric properties of the MOS and expanded the range of speech characteristics it evaluates. Our initial experiments documented the reliability, validity, sensitivity, and factor structure of the P.L. Salza et al. (Acta Acustica, Vol. 82, pp. 650-656, 1996) MOS and used psychometric principles to revise and improve the scale. This work resulted in the MOS-Revised (MOS-R). Four subsequent experiments expanded the MOS-R beyond its previous focus on Intelligibility and Naturalness, to include measurement of the Prosody and Social Impression of synthetic voices. As a result of this work, we created the MOS-Expanded (MOS-X), a rating scale shown to be reliable, valid, and sensitive for high-quality evaluation of synthetic speech in applied industrial settings.
Year
DOI
Venue
2003
10.1023/A:1022390615396
I. J. Speech Technology
Keywords
Field
DocType
Mean Opinion Scale (MOS), subjective assessment of synthetic speech, psychometric evaluation
Prosody,Computer science,Naturalness,Speech recognition,Rating scale,Speech characteristics,Intelligibility (communication)
Journal
Volume
Issue
ISSN
6
2
1572-8110
Citations 
PageRank 
References 
9
1.49
18
Authors
2
Name
Order
Citations
PageRank
Melanie D. Polkosky1162.76
James R. Lewis21109119.18