Name
Title | ||
|---|---|---|
Multimodal representation, indexing, automated annotation and retrieval of image collections via non-negative matrix factorization |
Abstract | ||
|---|---|---|
Massive image collections are increasingly available on the Web. These collections often incorporate complementary non-visual data such as text descriptions, comments, user ratings and tags. These additional data modalities may provide a semantic complement to the image visual content, which could improve the performance of different image content analysis tasks. This paper presents a novel method based on non-negative matrix factorization to generate multimodal image representations that integrate visual features and text information. The proposed approach discovers a set of latent factors that correlate multimodal data in the same representation space. We evaluated the potential of this multimodal image representation in various tasks associated to image indexing and search. Experimental results show that the proposed method highly outperforms the response of the system in both tasks, when compared to multimodal latent semantic spaces generated by a singular value decomposition. |
Year | DOI | Venue |
|---|---|---|
2012 | 10.1016/j.neucom.2011.04.037 | Neurocomputing |
Keywords | Field | DocType |
multimodal representation,non-negative matrix factorization,multimodal image representation,additional data modality,image visual content,complementary non-visual data,multimodal data,latent semantic space,automated annotation,massive image collection,different image content analysis,latent factor,image indexing,image annotation,non negative matrix factorization,latent semantic indexing | Singular value decomposition,Automatic image annotation,Pattern recognition,Information retrieval,Computer science,Matrix decomposition,Search engine indexing,Image retrieval,Artificial intelligence,Non-negative matrix factorization,Probabilistic latent semantic analysis,Content-based image retrieval | Journal |
Volume | Issue | ISSN |
76 | 1 | 0925-2312 |
Citations | PageRank | References |
37 | 1.03 | 35 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Juan Correa-caicedo | 1 | 399 | 21.23 |
| Jaafar Ben-Abdallah | 2 | 53 | 2.10 |
| Fabio A. González | 3 | 566 | 55.03 |
| Olfa Nasraoui | 4 | 1515 | 164.53 |