Paper Info
Title
Enriching music with synchronized lyrics, images and colored lights.
Abstract
We present a method to synchronize popular music with its lyrics at the stanza level. First we apply an algorithm to segment audio content into harmonically similar and/or contrasting progressions, i.e. the stanzas. We map the stanzas found to a sequence of labels, where stanzas with a similar progression are mapped to the same label. The lyrics are analyzed as well to compute a second sequence of labels. Using dynamic programming, an optimal match is found between the two sequences, resulting in a stanza-level synchronization of the lyrics and the audio. The synchronized lyrics can be used to compute a synchronized slide show to accompany the music, where the images are retrieved using the lyrics. For an additional enrichment of the experience, colored light effects are synchronized with the music that are computed from the sets of images. The song segmentation can be done reliably, while the mapping of the audio segments and lyrics gives encouraging results.
Year
Venue
Keywords
2008
AMBI-SYS
term identification,additional enrichment,ambience creation,light effect,song segmentation,enriching music,popular music,multimedia,segment audio content,color extraction,similar progression,audio segment,world wide web,slide show,optimal match,lyrics synchronization,dynamic programming,images,search engines,search engine,languages,algorithms
Field
DocType
Citations 
Dynamic programming,Colored,Synchronization,Computer science,Segmentation,Speech recognition,Popular music,Lyrics,Light effects,Stanza
Conference
2
PageRank 
References 
Authors
0.46
11
6
Name
Order
Citations
PageRank
Gijs Geleijnse117415.55
Dragan Sekulovski2354.90
Jan Korst317519.94
Steffen Pauws428932.61
Bram Kater520.46
Fabio Vignoli615012.49