Title
Automated Image Data Preprocessing with Deep Reinforcement Learning.
Abstract
Data preparation, i.e. the process of transforming raw data into a format that can be used for training effective machine learning models, is a tedious and time-consuming task. For image data, preprocessing typically involves a sequence of basic transformations such as cropping, filtering, rotating or flipping images. Currently, data scientists decide manually based on their experience which transformations to apply in which particular order to a given image data set. Besides constituting a bottleneck in real-world data science projects, manual image data preprocessing may yield suboptimal results as data scientists need to rely on intuition or trial-and-error approaches when exploring the space of possible image transformations and thus might not be able to discover the most effective ones. To mitigate the inefficiency and potential ineffectiveness of manual data preprocessing, this paper proposes a deep reinforcement learning framework to automatically discover the optimal data preprocessing steps for training an image classifier. The framework takes as input sets of labeled images and predefined preprocessing transformations. It jointly learns the classifier and the optimal preprocessing transformations for individual images. Experimental results show that the proposed approach not only improves the accuracy of image classifiers, but also makes them substantially more robust to noisy inputs at test time.
Year
Venue
Field
2018
arXiv: Computer Vision and Pattern Recognition
Bottleneck,Pattern recognition,Computer science,Filter (signal processing),Data pre-processing,Raw data,Preprocessor,Artificial intelligence,Classifier (linguistics),Data preparation,Machine learning,Reinforcement learning
DocType
Volume
Citations 
Journal
abs/1806.05886
0
PageRank 
References 
Authors
0.34
0
4
Name
Order
Citations
PageRank
Ngoc Minh Tran1595.08
Mathieu Sinn25510.41
Hoang Thanh Lam301.01
Martin Wistuba415419.66