Measuring Racial Discrimination in Algorithms

Abstract

Algorithmic decision-making can lead to discrimination against legally protected groups, but measuring such discrimination is often hampered by a fundamental selection challenge. We develop new quasi-experimental tools to overcome this challenge and measure algorithmic discrimination in pretrial bail decisions. We show that the selection challenge reduces to the challenge of measuring four moments, which can be estimated by extrapolating quasi-experimental variation across as-good-as-randomly assigned decision-makers. Estimates from New York City show that both a sophisticated machine learning algorithm and a simpler regression model discriminate against Black defendants even though defendant race and ethnicity are not included in the training data.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 43 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.