Name
Title | ||
|---|---|---|
Toward an automatically generated soundtrack from low-level cross-modal correlations for automotive scenarios |
Abstract | ||
|---|---|---|
In this paper, we propose a novel recommendation policy for driving scenarios. While driving a car, listening to an audio track may enrich the atmosphere, conveying emotions that let the driver sense a more arousing experience. Here, we are introducing a recommendation policy that, given a video sequence taken by a camera mounted onboard a car, chooses the most suitable audio piece from a predetermined set of melodies. The mixing mechanism takes inspiration from a set of generic qualitative aesthetical rules for cross-modal linking, realized by associating audio and video features. The contribution of this paper is to translate such qualitative rules into quantitative terms, learning from an extensive training dataset cross-modal statistical correlations, and validating them in a thoroughly way. In this way, we are able to define what are the audio and video features that correlate at best (i.e., promoting or rejecting some aesthetical rules), and what are their correlation intensities. This knowledge is then employed for the realization of the recommendation policy. A set of user studies illustrate and validate the policy, thus encouraging further developments toward a real implementation in an automotive application. |
Year | DOI | Venue |
|---|---|---|
2010 | 10.1145/1873951.1874024 | ACM Multimedia 2001 |
Keywords | Field | DocType |
generic qualitative aesthetical rule,qualitative rule,video feature,extensive training dataset cross-modal,audio track,low-level cross-modal correlation,automotive scenario,suitable audio piece,novel recommendation policy,recommendation policy,aesthetical rule,video sequence,automotive | Melody,Computer vision,Computer science,Active listening,Artificial intelligence,Cross modality,User studies,Multimedia,Modal,Automotive industry | Conference |
Citations | PageRank | References |
9 | 0.58 | 17 |
Authors | ||
7 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| M. Cristani | 1 | 1928 | 109.03 |
| Anna Pesarin | 2 | 39 | 3.82 |
| Carlo Drioli | 3 | 127 | 24.21 |
| Vittorio Murino | 4 | 3277 | 207.20 |
| Antonio Rodà | 5 | 61 | 14.61 |
| Michele Grapulin | 6 | 9 | 0.58 |
| Nicu Sebe | 7 | 7013 | 403.03 |