Title
Self-supervised Feature Learning for 3D Medical Images by Playing a Rubik’s Cube
Abstract
Witnessed the development of deep learning, increasing number of studies try to build computer aided diagnosis systems for 3D volumetric medical data. However, as the annotations of 3D medical data are difficult to acquire, the number of annotated 3D medical images is often not enough to well train the deep learning networks. The self-supervised learning deeply exploiting the information of raw data is one of the potential solutions to loose the requirement of training data. In this paper, we propose a self-supervised learning framework for the volumetric medical images. A novel proxy task, i.e., Rubik's cube recovery, is formulated to pre-train 3D neural networks. The proxy task involves two operations, i.e., cube rearrangement and cube rotation, which enforce networks to learn translational and rotational invariant features from raw 3D data. Compared to the train-from-scratch strategy, fine-tuning from the pretrained network leads to a better accuracy on various tasks, e.g., brain hemorrhage classification and brain tumor segmentation. We show that our self-supervised learning approach can substantially boost the accuracies of 3D deep learning networks on the volumetric medical datasets without using extra data. To our best knowledge, this is the first work focusing on the self-supervised learning of 3D neural networks.
Year
DOI
Venue
2019
10.1007/978-3-030-32251-9_46
Lecture Notes in Computer Science
Keywords
DocType
Volume
Self-supervised learning,Rubik's cube recovery,3D medical images
Conference
11767
ISSN
Citations 
PageRank 
0302-9743
4
0.43
References 
Authors
0
6
Name
Order
Citations
PageRank
Xinrui Zhuang140.43
Yuexiang Li28311.51
Yifan Hu340.43
Kai Ma44918.48
Yang Yujiu564.51
Yefeng Zheng61391114.67