Title
Self Context and Shape Prior for Sensorless Freehand 3D Ultrasound Reconstruction
Abstract
3D ultrasound (US) is widely used for its rich diagnostic information. However, it is criticized for its limited field of view. 3D freehand US reconstruction is promising in addressing the problem by providing broad range and freeform scan. The existing deep learning based methods only focus on the basic cases of skill sequences, and the model relies on the training data heavily. The sequences in real clinical practice are a mix of diverse skills and have complex scanning paths. Besides, deep models should adapt themselves to the testing cases with prior knowledge for better robustness, rather than only fit to the training cases. In this paper, we propose a novel approach to sensorless freehand 3D US reconstruction considering the complex skill sequences. Our contribution is three-fold. First, we advance a novel online learning framework by designing a differentiable reconstruction algorithm. It realizes an end-to-end optimization from section sequences to the reconstructed volume. Second, a self-supervised learning method is developed to explore the context information that reconstructed by the testing data itself, promoting the perception of the model. Third, inspired by the effectiveness of shape prior, we also introduce adversarial training to strengthen the learning of anatomical shape prior in the reconstructed volume. By mining the context and structural cues of the testing data, our online learning methods can drive the model to handle complex skill sequences. Experimental results on developmental dysplasia of the hip US and fetal US datasets show that, our proposed method can outperform the start-of-the-art methods regarding the shift errors and path similarities.
Year
DOI
Venue
2021
10.1007/978-3-030-87231-1_20
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VI
Keywords
DocType
Volume
Self context, Shape prior, Freehand 3D ultrasound
Conference
12906
ISSN
Citations 
PageRank 
0302-9743
0
0.34
References 
Authors
0
9
Name
Order
Citations
PageRank
Mingyuan Luo100.68
Xin Yang2799.59
Xiaoqiong Huang342.51
Yuhao Huang403.72
Yuxin Zou501.01
Xindi Hu602.03
nishant ravikumar72312.43
Alejandro F. Frangi84333309.21
Dong Ni936737.37