Title
SELF-AUGMENTED MULTI-MODAL FEATURE EMBEDDING
Abstract
Oftentimes, patterns can be represented through different modalities. For example, leaf data can be in the form of images or contours. Handwritten characters can also be either online or offline. To exploit this fact, we propose the use of self-augmentation and combine it with multi-modal feature embedding. In order to take advantage of the complementary information from the different modalities, the self-augmented multi-modal feature embedding employs a shared feature space. Through experimental results on classification with online handwriting and leaf images, we demonstrate that the proposed method can create effective embeddings.
Year
DOI
Venue
2021
10.1109/ICASSP39728.2021.9413974
2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021)
Keywords
DocType
Citations 
Self-augmented multi-modality, multi-modal embedding, gating neural networks
Conference
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Shinnosuke Matsuo100.68
Seiichi Uchida2790105.59
Brian Kenji Iwana376.58