Title
Multimodal Question Answering over Structured Data with Ambiguous Entities.
Abstract
In recent years, we have witnessed profound changes in the way people satisfy their information needs. For instance, with the ubiquitous 24/7 availability of mobile devices, the number of search engine queries on mobile devices has reportedly overtaken that of queries on regular personal computers. In this paper, we consider the task of multimodal question answering over structured data, in which a user supplies not just a natural language query but also an image. Our system addresses this by optimizing a non-convex objective function capturing multimodal constraints. Our experiments show that this enables it to answer even very challenging ambiguous entity queries with high accuracy.
Year
DOI
Venue
2017
10.1145/3041021.3054135
WWW (Companion Volume)
Field
DocType
Citations 
Data mining,World Wide Web,Question answering,Information needs,Search engine,Information retrieval,Computer science,Natural language user interface,Mobile device,Data model
Conference
2
PageRank 
References 
Authors
0.36
23
5
Name
Order
Citations
PageRank
Huadong Li131.42
Yafang Wang213413.56
Gerard de Melo372353.54
Changhe Tu428834.47
Baoquan Chen52095111.30