Title
Interactive Natural Language-Based Person Search
Abstract
In this work, we consider the problem of searching people in an unconstrained environment, with natural language descriptions. Specifically, we study how to systematically design an algorithm to effectively acquire descriptions from humans. An algorithm is proposed by adapting models, used for visual and language understanding, to search a person of interest (POI) in a principled way, achieving promising results without the need to re-design another complicated model. We then investigate an iterative question-answering (QA) strategy that enable robots to request additional information about the POI's appearance from the user. To this end, we introduce a greedy algorithm to rank questions in terms of their significance, and equip the algorithm with the capability to dynamically adjust the length of human-robot interaction according to model's uncertainty. Our approach is validated not only on benchmark datasets but on a mobile robot, moving in a dynamic and crowded environment.
Year
DOI
Venue
2020
10.1109/LRA.2020.2969921
IEEE ROBOTICS AND AUTOMATION LETTERS
Keywords
DocType
Volume
AI-based methods, human detection and tracking, cognitive human-robot interaction
Journal
5
Issue
ISSN
Citations 
2
2377-3766
0
PageRank 
References 
Authors
0.34
0
3
Name
Order
Citations
PageRank
Vikram Shree102.37
Wei-Lun Chao239119.32
Mark E. Campbell341255.16