Title
Photosense: Make sense of your photos with enriched harmonic music via emotion association
Abstract
This paper proposes a novel audiovisual presentation system, called PhotoSense, to enrich photo navigation experience by associating emotionally harmonic music with a given photo collection. Different from many conventional photo visualization systems which predominantly focus on the visual elements for presentation, we explore both visual and aural perspectives which can enhance the browsing experience from each other. This is achieved by building an emotion space shared by visual and aural domains, and a set of emotion classifiers which can associate each visual and aural element with this space. Furthermore, we design a sequence matching algorithm to associate a set of music with a photo collection by maximizing similarity in the emotion space. Photo-Sense represents one of the first mash-up applications which build a natural connection between the ever increasing personal photo collections on the Web and music-sharing sites. Experiments show that PhotoSense provides better browsing experience for photo collections.
Year
DOI
Venue
2011
10.1109/ICME.2011.6011994
ICME
Keywords
Field
DocType
aural element,browsing experience,personal photo collection,enriched harmonic music,emotion space,emotion,emotion association,photo collection,visual element,conventional photo visualization system,affective content analysis,photo navigation experience,aural perspective,aural domain,multimedia presentation,brightness,visual system,feature extraction,couplings,content analysis,niobium,visualization,support vector machines,harmonic analysis
Computer vision,Sequence matching,Computer science,Visualization,Support vector machine,Harmonic,Feature extraction,Artificial intelligence
Conference
ISSN
ISBN
Citations 
1945-7871 E-ISBN : 978-1-61284-349-0
978-1-61284-349-0
4
PageRank 
References 
Authors
0.65
9
4
Name
Order
Citations
PageRank
Ja-Hwung Su132924.53
Ming Hua Hsieh241268.90
Tao Mei34702288.54
Vincent S. Tseng42923161.33