Name
Abstract | ||
|---|---|---|
This work presents a method for the efficient indexing of tagged images. Tagged images are a common resource of social networks and occupy a large portion of the social media stream. Their basic characteristic is the co-existence of two heterogeneous information modalities, i.e. visual and tag, which refer to the same abstract meaning. This multi-modal nature of tagged images makes their efficient indexing a challenging task that apart from dealing with the heterogeneity of modalities, it needs to also exploit their complementary information capacity. Towards this objective, we propose the extension of probabilistic latent semantic analysis to higher order, so as to become applicable for more than two observable variables. Then, by treating images, visual features and tags as the three observable variables of an aspect model, we learn a space of latent topics that incorporates the semantics of both visual and tag information. Our novelty is on using the cross-modal dependencies learned from a corpus of images to approximate the joint distribution of the observable variables. By penalizing the co-existence of visual content and tags that are known from experience to exhibit low dependency, we manage to filter out the effect of noisy content in the resulting latent space. |
Year | DOI | Venue |
|---|---|---|
2013 | 10.1016/j.sigpro.2012.08.004 | Signal Processing |
Keywords | Field | DocType |
heterogeneous information modality,tag information,high order plsa,latent topic,probabilistic latent semantic analysis,resulting latent space,complementary information capacity,visual content,visual feature,observable variable,efficient indexing,social media | Modalities,Joint probability distribution,Observable,Pattern recognition,Computer science,Search engine indexing,Exploit,Probabilistic latent semantic analysis,Artificial intelligence,Novelty,Semantics | Journal |
Volume | Issue | ISSN |
93 | 8 | 0165-1684 |
Citations | PageRank | References |
9 | 0.48 | 42 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| S. Nikolopoulos | 1 | 9 | 0.48 |
| Stefanos Zafeiriou | 2 | 3129 | 150.99 |
| Ioannis Patras | 3 | 1960 | 123.15 |
| I. Kompatsiaris | 4 | 282 | 15.61 |