On the genealogy of machine learning datasets: A critical history of ImageNet
Abstract
In response to growing concerns of bias, discrimination, and unfairness perpetuated by algorithmic systems, the datasets used to train and evaluate machine learning models have come under increased scrutiny. Many of these examinations have focused on the contents of machine learning datasets, finding glaring underrepresentation of minoritized groups. In contrast, relatively little work has been done to examine the norms, values, and assumptions embedded in these datasets. In this work, we conceptualize machine learning datasets as a type of informational infrastructure, and motivate a genealogy as method in examining the histories and modes of constitution at play in their creation. We present a critical history of ImageNet as an exemplar, utilizing critical discourse analysis of major texts around ImageNet’s creation and impact. We find that assumptions around ImageNet and other large computer vision datasets more generally rely on three themes: the aggregation and accumulation of more data, the computational construction of meaning, and making certain types of data labor invisible. By tracing the discourses that surround this influential benchmark, we contribute to the ongoing development of the standards and norms around data development in machine learning and artificial intelligence research.
Cite this
Emily Denton, Alex Hanna, Razvan Amironesei, Andrew Smart, Hilary Nicole (2021). On the genealogy of machine learning datasets: A critical history of ImageNet. Big Data & Society. https://doi.org/10.1177/20539517211035955
@article{emily2021on,
title = {On the genealogy of machine learning datasets: A critical history of ImageNet},
author = {Denton, Emily and Hanna, Alex and Amironesei, Razvan and Smart, Andrew and Nicole, Hilary},
year = {2021},
journal = {Big Data & Society},
doi = {10.1177/20539517211035955}
}Citations in this library
Stored only when both papers are in the corpus — 220 citations exist upstream.