Title
CADDY Underwater Stereo-Vision Dataset for Human-Robot Interaction (HRI) in the Context of Diver Activities.
Abstract
In this article, we present a novel underwater dataset collected from several field trials within the EU FP7 project “Cognitive autonomous diving buddy (CADDY)”, where an Autonomous Underwater Vehicle (AUV) was used to interact with divers and monitor their activities. To our knowledge, this is one of the first efforts to collect a large public dataset in underwater environments with the purpose of studying and boosting object classification, segmentation and human pose estimation tasks. The first part of the dataset contains stereo camera recordings (≈10 K) of divers performing hand gestures to communicate with an AUV in different environmental conditions. The gestures can be used to test the robustness of visual detection and classification algorithms in underwater conditions, e.g., under color attenuation and light backscatter. The second part includes stereo footage (≈12.7 K) of divers free-swimming in front of the AUV, along with synchronized measurements from Inertial Measurement Units (IMU) located throughout the diver’s suit (DiverNet), which serve as ground-truth for human pose and tracking methods. In both cases, these rectified images allow the investigation of 3D representation and reasoning pipelines from low-texture targets commonly present in underwater scenarios. This work describes the recording platform, sensor calibration procedure plus the data format and the software utilities provided to use the dataset.
Year
Venue
Field
2018
arXiv: Computer Vision and Pattern Recognition
Computer vision,Stereo camera,Stereopsis,Gesture,Pose,Artificial intelligence,Inertial measurement unit,Statistical classification,Geology,Climatology,Human–robot interaction,Underwater
DocType
Volume
Citations 
Journal
abs/1807.04856
0
PageRank 
References 
Authors
0.34
5
6
Name
Order
Citations
PageRank
Arturo Gomez Chavez152.85
Andrea Ranieri2698.28
Davide Chiarella321.04
Enrica Zereik4427.65
Anja Babic500.68
Andreas Birk651.49