Name
Title | ||
|---|---|---|
PPDM: Parallel Point Detection and Matching for Real-Time Human-Object Interaction Detection |
Abstract | ||
|---|---|---|
We propose a single-stage Human-Object Interaction (HOI) detection method that has outperformed all existing methods on HICO-DET dataset at 37 fps on a single Titan XP GPU. It is the first real-time HOI detection method. Conventional HOI detection methods are composed of two stages, i.e., human-object proposals generation, and proposals classification. Their effectiveness and efficiency are limited by the sequential and separate architecture. In this paper, we propose a Parallel Point Detection and Matching (PPDM) HOI detection framework. In PPDM, an HOI is defined as a point triplet <; human point, interaction point, object point>. Human and object points are the center of the detection boxes, and the interaction point is the midpoint of the human and object points. PPDM contains two parallel branches, namely point detection branch and point matching branch. The point detection branch predicts three points. Simultaneously, the point matching branch predicts two displacements from the interaction point to its corresponding human and object points. The human point and the object point originated from the same interaction point are considered as matched pairs. In our novel parallel architecture, the interaction points implicitly provide context and regularization for human and object detection. The isolated detection boxes unlikely to form meaningful HOI triplets are suppressed, which increases the precision of HOI detection. Moreover, the matching between human and object detection boxes is only applied around limited numbers of filtered candidate interaction points, which saves much computational cost. Additionally, we build a new application-oriented database named as HOI-A, which serves as a good supplement to the existing datasets. |
Year | DOI | Venue |
|---|---|---|
2020 | 10.1109/CVPR42600.2020.00056 | 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) |
Keywords | DocType | ISSN |
PPDM,real-time HOI detection method,human-object proposals generation,point triplet,human point,object point,point detection branch,point matching branch,isolated detection boxes,human object detection boxes,filtered candidate interaction points,parallel point detection,real-time human-object interaction detection,single-stage human-object interaction detection method,HICO-DET dataset,single Titan XP GPU,matching HOI detection framework,parallel architecture,HOI triplets,application-oriented database | Conference | 1063-6919 |
ISBN | Citations | PageRank |
978-1-7281-7169-2 | 9 | 0.46 |
References | Authors | |
20 | 5 | |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Yue Liao | 1 | 13 | 3.20 |
| Si Liu | 2 | 1891 | 86.89 |
| Fei Wang | 3 | 24 | 6.14 |
| Yanjie Chen | 4 | 12 | 1.87 |
| Jiashi Feng | 5 | 2165 | 140.81 |