Paper Info
Title
A knowledge representation framework for integration, classification of multi-scale imaging and non-imaging data: preliminary results in predicting prostate cancer recurrence by fusing mass spectrometry and histology
Abstract
The demand for personalized health care requires a wide range of diagnostic tools for determining patient prognosis and theragnosis (response to treatment). These tools present us with data that is both multi-modal (imaging and non-imaging) and multi-scale (proteomics, histology). By utilizing the information in these sources concurrently, we expect significant improvement in predicting patient prognosis and theragnosis. However, a prerequisite to realizing this improvement is the ability to effectively and quantitatively combine information from disparate sources. In this paper, we present a general fusion framework (GFF) aimed towards a combined knowledge representation predicting disease recurrence. To the best of our knowledge, GFF represents the first formal attempt to fuse biomedical image and non-image information directly at the data level as opposed to the decision level, thus preserving more subtle contributions in the original data. GFF represents the different data streams in separate embedding spaces via the application of dimensionality reduction (DR). Data fusion is then implemented by combining the individual reduced embedding spaces. A proof of concept example is considered for evaluating the GFF, whereby protein expression measurements from mass spectrometry are combined with histological image signatures to predict prostate cancer (CaP) recurrence in 6 CaP patients, following therapy. Preliminary results suggest that GFF offers an intelligent way to fuse image and non-image data structures for making prognostic and theragnostic predictions.
Year
DOI
Venue
2009
10.1109/ISBI.2009.5192987
ISBI
Keywords
Field
DocType
non-imaging data,multi-scale imaging,data level,original data,different data stream,data fusion,fusing mass spectrometry,patient prognosis,non-image information,preliminary result,non-image data structure,fuse biomedical image,fuse image,knowledge representation framework,histological image signature,dimensionality reduction,indexing terms,cancer,principal component analysis,data structure,feature extraction,proteins,spectroscopy,proof of concept,health care,mass spectrometry,histopathology,protein expression,titanium,mass spectroscopy,histology,image fusion,knowledge representation,molecular biophysics
Data mining,Data structure,Data stream mining,Knowledge representation and reasoning,Dimensionality reduction,Image fusion,Computer science,Feature extraction,Sensor fusion,Proof of concept
Conference
Citations 
PageRank 
References 
14
0.93
3
Authors
7
Name
Order
Citations
PageRank
George Lee1140.93
Scott Doyle232721.56
James Monaco31339.79
Anant Madabhushi41736139.21
Michael Feldman551835.49
Stephen R. Master6753.19
John E. Tomaszewski719818.60