Title
Opening The Black Box: Discovering And Explaining Hidden Variables In Type 2 Diabetic Patient Modelling
Abstract
Clinicians predict disease and related complications based on prior knowledge and each individual patient's clinical history. The prediction process is complex due to the existence of unmeasured risk factors, the unexpected development of complications and varying responses of patients to disease over time. Exploiting these unmeasured risk factors (hidden variables) can improve the modeling of disease progression and thus enables clinicians to focus on early diagnosis and treatment of unexpected conditions. However, the overuse of hidden variables can lead to complex models that can overfit and are not well understood (being 'black box' in nature). Identifying and understanding groups of patients with similar disease profiles (based on discovered hidden variables) makes it possible to better understand disease progression in different patients while improving prediction. We explore the use of a stepwise method for incrementally identifying hidden variables based on the Induction Causation (IC*) algorithm. We exploit Dynamic Time Warping and hierarchical clustering to cluster patients based upon these hidden variables to uncover their meaning with respect to the complications of Type 2 Diabetes Mellitus patients. Our results reveal that inferring a small number of targeted hidden variables and using them to cluster patients not only leads to an improvement in the prediction accuracy but also assists the explanation of different discovered sub-groups.
Year
DOI
Venue
2018
10.1109/BIBM.2018.8621484
PROCEEDINGS 2018 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM)
Keywords
Field
DocType
Time-series clustering, hidden variable discovery, Temporal Phenotype, Diabetic Patient Modeling, Dynamic Bayesian Networks
Black box (phreaking),Hierarchical clustering,Disease,Dynamic time warping,Computer science,Artificial intelligence,Hidden variable theory,Black box,Overfitting,Machine learning,Dynamic Bayesian network
Conference
ISSN
Citations 
PageRank 
2156-1125
0
0.34
References 
Authors
0
6
Name
Order
Citations
PageRank
Leila Yousefi111.40
Stephen Swift242731.32
Mahir Arzoky3105.22
Lucia Sacchi426932.52
Luca Chiovato543.20
Allan Tucker69213.51