Title
Data and its (dis)contents: A survey of dataset development and use in machine learning research
Abstract
In this work, we survey a breadth of literature that has revealed the limitations of predominant practices for dataset collection and use in the field of machine learning. We cover studies that critically review the design and development of datasets with a focus on negative societal impacts and poor outcomes for system performance. We also cover approaches to filtering and augmenting data and modeling techniques aimed at mitigating the impact of bias in datasets. Finally, we discuss works that have studied data practices, cultures, and disciplinary norms and discuss implications for the legal, ethical, and functional challenges the field continues to face. Based on these findings, we advocate for the use of both qualitative and quantitative approaches to more carefully document and analyze datasets during the creation and usage phases.
Year
DOI
Venue
2021
10.1016/j.patter.2021.100336
PATTERNS
Keywords
DocType
Volume
datasets machine learning
Journal
2
Issue
ISSN
Citations 
11
2666-3899
3
PageRank 
References 
Authors
0.45
0
5
Name
Order
Citations
PageRank
Amandalynne Paullada130.79
Inioluwa Deborah Raji230.79
Emily M. Bender330.45
Emily Denton437825.96
Alex Hanna582.24