Name
Title | ||
|---|---|---|
A Modeling of Singing Voice Robust to Accompaniment Sounds and Its Application to Singer Identification and Vocal-Timbre-Similarity-Based Music Information Retrieval |
Abstract | ||
|---|---|---|
This paper describes a method of modeling the characteristics of a singing voice from polyphonic musical audio signals including sounds of various musical instruments. Because singing voices play an important role in musical pieces with vocals, such representation is useful for music information retrieval systems. The main problem in modeling the characteristics of a singing voice is the negative influences caused by accompaniment sounds. To solve this problem, we developed two methods, accompaniment sound reduction and reliable frame selection . The former makes it possible to calculate feature vectors that represent a spectral envelope of a singing voice after reducing accompaniment sounds. It first extracts the harmonic components of the predominant melody from sound mixtures and then resynthesizes the melody by using a sinusoidal model driven by these components. The latter method then estimates the reliability of frame of the obtained melody (i.e., the influence of accompaniment sound) by using two Gaussian mixture models (GMMs) for vocal and nonvocal frames to select the reliable vocal portions of musical pieces. Finally, each song is represented by its GMM consisting of the reliable frames. This new representation of the singing voice is demonstrated to improve the performance of an automatic singer identification system and to achieve an MIR system based on vocal timbre similarity. |
Year | DOI | Venue |
|---|---|---|
2010 | 10.1109/TASL.2010.2041386 | Audio, Speech, and Language Processing, IEEE Transactions |
Keywords | Field | DocType |
Gaussian processes,audio signal processing,feature extraction,information retrieval,Gaussian mixture models,accompaniment sound reduction,frame selection reliability,musical instruments,polyphonic musical audio signals,predominant melody,singer identification,vocal-timbre-similarity-based music information retrieval,Music information retrieval (MIR),singer identification,singing voice,vocal,vocal timbre similarity | Melody,Audio signal,Music information retrieval,Computer science,Musical instrument,Speech recognition,Singing,Polyphony,Audio signal processing,Timbre | Journal |
Volume | Issue | ISSN |
18 | 3 | 1558-7916 |
Citations | PageRank | References |
39 | 1.32 | 18 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Hiromasa Fujihara | 1 | 216 | 15.38 |
| masataka goto | 2 | 2258 | 213.22 |
| Tetsuro Kitahara | 3 | 188 | 22.64 |
| Hiroshi G. Okuno | 4 | 2092 | 233.19 |