Title
Deep-Learning Cardiac Motion Analysis For Human Survival Prediction
Abstract
Motion analysis is used in computer vision to understand the behaviour of moving objects in sequences of images. Optimizing the interpretation of dynamic biological systems requires accurate and precise motion tracking as well as efficient representations of high-dimensional motion trajectories so that these can be used for prediction tasks. Here we use image sequences of the heart, acquired using cardiac magnetic resonance imaging, to create time-resolved three-dimensional segmentations using a fully convolutional network trained on anatomical shape priors. This dense motion model formed the input to a supervised denoising autoencoder (4Dsurvival), which is a hybrid network consisting of an autoencoder that learns a task-specific latent code representation trained on observed outcome data, yielding a latent representation optimized for survival prediction. To handle right-censored survival outcomes, our network used a Cox partial likelihood loss function. In a study of 302 patients, the predictive accuracy (quantified by Harrell'sC-index) was significantly higher (P = 0.0012) for our modelC = 0.75 (95% CI: 0.70-0.79) than the human benchmark ofC = 0.59 (95% CI: 0.53-0.65). This work demonstrates how a complex computer vision task using high-dimensional medical image data can efficiently predict human survival.A fully convolutional neural network is used to create time-resolved three-dimensional dense segmentations of heart images. This dense motion model forms the input to a supervised system called 4Dsurvival that can efficiently predict human survival.
Year
DOI
Venue
2018
10.1038/s42256-019-0019-2
NATURE MACHINE INTELLIGENCE
Keywords
Field
DocType
Heart Failure,Hypertension, Pulmonary,Machine Learning,Magnetic Resonance Imaging, Cine,Motion,Survival
Autoencoder,Pattern recognition,Convolutional neural network,Computer science,Artificial intelligence,Cardiac magnetic resonance imaging,Deep learning,Motion analysis,Prior probability,Cardiac motion,Match moving
Journal
Volume
Issue
ISSN
1
2
Nature Machine Intelligence, 1, 95-104 (2019)
Citations 
PageRank 
References 
4
0.53
22
Authors
11
Name
Order
Citations
PageRank
Ghalib Bello1172.09
Timothy Dawes2795.34
Jinming Duan313019.92
Carlo Biffi4274.97
Antonio de Marvao550.90
Luke S. G. E. Howard640.53
J. Simon R. Gibbs740.53
Martin R. Wilkins840.53
Stuart A Cook91118.45
Daniel Rueckert109338637.58
Declan P. O'Regan1125816.33