Title
REMI: A framework of reusable elements for mining heterogeneous data with missing information - A Tale of Congestion in Two Smart Cities.
Abstract
Applications targeting smart cities tackle common challenges, however solutions are seldom portable from one city to another due to the heterogeneity of smart city ecosystems. A major obstacle involves the differences in the levels of available information. In this work, we present REMI, which is a mining framework that handles varying degrees of information availability by providing a meta-solution to missing data. The framework core concept is the REMI layered stack architecture, offering two complementary approaches to dealing with missing information, namely data enrichment (DARE) and graceful degradation (GRADE). DARE aims at inference of missing information levels, while GRADE attempts to mine the patterns using only the existing data.We show that REMI provides multiple ways for re-usability, while being fault tolerant and enabling incremental development. One may apply the architecture to different problem instantiations within the same domain, or deploy it across various domains. Furthermore, we introduce the other three components of the REMI framework backing the layered stack. To support decision making in this framework, we show a mapping of REMI into an optimization problem (OTP) that balances the trade-off between three costs: inaccuracies in inference of missing data (DARE), errors when using less information (GRADE), and gathering of additional data. Further, we provide an experimental evaluation of REMI using real-world transportation data coming from two European smart cities, namely Dublin and Warsaw.
Year
Venue
Field
2018
J. Intell. Inf. Syst.
Data science,Remi,Data mining,Architecture,Iterative and incremental development,Inference,Computer science,Fault tolerance,Smart city,Missing data,Optimization problem
DocType
Volume
Issue
Journal
51
2
Citations 
PageRank 
References 
1
0.38
12
Authors
6
Name
Order
Citations
PageRank
Avigdor Gal1232.45
Dimitrios Gunopulos27171715.85
Nikolaos Panagiotou3293.43
Nicolo Rivetti432.08
Arik Senderovich511814.58
Nikolas Zygouras6142.01