SZodixStudyAcademic Library
ShelvesOpen access
Study · an open academic library·Metadata from OpenAlex (CC0)·Shelves·OpenAlex metadata, de-duplicated
Designing Disaggregated Evaluations of AI Systems: Choices, Considerations, and Tradeoffs
16 references·14 citing·33 second hop
Designing Disaggregated Evaluations of AI Systems: Choices, Considerations, and Tradeoffs (2021)Designing Disaggregated Evaluations of AI…What We Can't Measure, We Can't Understand (2021)What We Can't Measure, We Can…Measurement and Fairness (2021)Measurement and FairnessTowards a critical race methodology in algorithmic fairness (2020)Towards a critical race metho…Saving Face (2020)Saving FaceClosing the AI accountability gap (2020)Closing the AI accountability…Model Cards for Model Reporting (2019)Model Cards for Model Reporti…Fairness and Abstraction in Sociotechnical Systems (2019)Fairness and Abstraction in S…Facial recognition is the plutonium of AI (2019)Facial recognition is the plu…Dissecting racial bias in an algorithm used to manage the health of populations (2019)Dissecting racial bias in an …Actionable Auditing (2019)Actionable AuditingGender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification (2018)Gender Shades: Intersectional…Demarginalizing the Intersection of Race and Sex: A Black Feminist Critique of Antidiscrimination Doctrine, Feminist Theory, and Antiracist Politics [1989] (2018)Demarginalizing the Intersect…Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction Instruments (2017)Fair Prediction with Disparat…On the (im)possibility of fairness (2016)On the (im)possibility of fai…Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings (2016)Man is to Computer Programmer…Inherent Trade-Offs in the Fair Determination of Risk Scores (2016)Inherent Trade-Offs in the Fa…Artificial intelligence algorithm bias in information retrieval systems and its implication for library and information science professionals: A scoping review (2025)Artificial intelligence algor…Learning about Responsible AI On-The-Job: Learning Pathways, Orientations, and Aspirations (2024)Learning about Responsible AI…Farsight: Fostering Responsible AI Awareness During AI Application Prototyping (2024)Farsight: Fostering Responsib…Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML (2024)Can Fairness be Automated? Gu…A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations (2024)A Scoping Study of Evaluation…Which Skin Tone Measures Are the Most Inclusive? An Investigation of Skin Tone Measures for Artificial Intelligence (2023)Which Skin Tone Measures Are …Understanding and evaluating harms of AI-generated image captions in political images (2023)Understanding and evaluating …Pairwise Fairness in Ranking as a Dissatisfaction Measure (2023)Pairwise Fairness in Ranking …Judging facts, judging norms: Training machine learning models to judge humans requires a modified approach to labeling data (2023)Judging facts, judging norms:…Gender Artifacts in Visual Datasets (2023)Gender Artifacts in Visual Da…From Plane Crashes to Algorithmic Harm: Applicability of Safety Engineering Frameworks for Responsible ML (2023)From Plane Crashes to Algorit…Understanding Machine Learning Practitioners' Data Documentation Perceptions, Needs, Challenges, and Desiderata (2022)Understanding Machine Learnin…Evaluation Gaps in Machine Learning Practice (2022)Evaluation Gaps in Machine Le…Algorithmic Auditing and Social Justice: Lessons from the History of Audit Studies (2021)Algorithmic Auditing and Soci…Fairness through awareness (2012)Big Data's Disparate Impact (2014)Certifying and Removing Disparate Impact (2015)The role of artificial intelligence in achieving the Sustainable Development Goals (2020)A Survey on Bias and Fairness in Machine Learning (2021)Equality of Opportunity in Supervised Learning (2016)Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement (2015)Data Feminism (2020)On the Opportunities and Risks of Foundation Models (2021)The Social Construction of Facts and Artefacts: or How the Sociology of Science and the Sociology of Technology might Benefit Each Other (1984)Science in action : how to follow scientists and engineers through society (1987)Science in Action: How to Follow Scientists and Engineers through Society (1988)Accountability in algorithmic decision making (2016)How the machine ‘thinks’: Understanding opacity in machine learning algorithms (2016)Legal and human rights issues of AI: Gaps, challenges and vulnerabilities (2020)Roles for computing in social change (2020)Ethics of AI-Enabled Recruiting and Selection: A Review and Research Agenda (2022)Semantics derived automatically from language corpora contain human-like biases (2017)Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence (2020)Addressing bias in big data and AI for health care: A call for open science (2021)Algorithmic Bias in Education (2021)PRODUCT DEVELOPMENT: PAST RESEARCH, PRESENT FINDINGS, AND FUTURE DIRECTIONS (1995)Bridging the Gap Between Ethics and Practice (2020)Trustworthy AI: From Principles to Practices (2022)Trustworthy Artificial Intelligence: A Review (2022)The Ethics of AI Ethics: An Evaluation of Guidelines (2020)ChatGPT: A comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope (2023)AI Fairness 360: An extensible toolkit for detecting and mitigating algorithmic bias (2019)Social Data: Biases, Methodological Pitfalls, and Ethical Boundaries (2019)Fairness and Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, and Mitigation Strategies (2023)The Complexity of Intersectionality (2005)Intersectionality and research in psychology. (2009)Toward a Field of Intersectionality Studies: Theory, Applications, and Praxis (2013)
this work references cited by second hop

References

  • 2018Demarginalizing the Intersection of Race and Sex: A Black Feminist Critique of Antidiscrimination Doctrine, Feminist Theory, and Antiracist Politics [1989]9,508 cited
  • 2019Dissecting racial bias in an algorithm used to manage the health of populations7,086 cited
  • 2018Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification3,509 cited
  • 2019Model Cards for Model Reporting2,653 cited
  • 2017Fair Prediction with Disparate Impact: A Study of Bias in Recidivism Prediction Instruments2,157 cited
  • 2019Fairness and Abstraction in Sociotechnical Systems1,621 cited
  • 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings1,615 cited
  • 2020Closing the AI accountability gap1,445 cited
  • 2016Inherent Trade-Offs in the Fair Determination of Risk Scores942 cited
  • 2019Actionable Auditing650 cited
  • 2021Measurement and Fairness362 cited
  • 2020Saving Face298 cited
  • 2020Towards a critical race methodology in algorithmic fairness295 cited
  • 2016On the (im)possibility of fairness247 cited
  • 2019Facial recognition is the plutonium of AI139 cited

Only edges whose both ends are imported exist here. Widen the year window, or show the whole map. Back to the work

2021
What We Can't Measure, We Can't Understand
111 cited

Cited by

  • 2021Algorithmic Auditing and Social Justice: Lessons from the History of Audit Studies68 cited
  • 2022Evaluation Gaps in Machine Learning Practice65 cited
  • 2022Understanding Machine Learning Practitioners' Data Documentation Perceptions, Needs, Challenges, and Desiderata59 cited
  • 2024Farsight: Fostering Responsible AI Awareness During AI Application Prototyping55 cited
  • 2023Which Skin Tone Measures Are the Most Inclusive? An Investigation of Skin Tone Measures for Artificial Intelligence42 cited
  • 2024A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations40 cited
  • 2023From Plane Crashes to Algorithmic Harm: Applicability of Safety Engineering Frameworks for Responsible ML34 cited
  • 2024Learning about Responsible AI On-The-Job: Learning Pathways, Orientations, and Aspirations31 cited
  • 2023Pairwise Fairness in Ranking as a Dissatisfaction Measure26 cited
  • 2023Gender Artifacts in Visual Datasets24 cited
  • 2024Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML24 cited
  • 2025Artificial intelligence algorithm bias in information retrieval systems and its implication for library and information science professionals: A scoping review22 cited
  • 2023Judging facts, judging norms: Training machine learning models to judge humans requires a modified approach to labeling data14 cited
  • 2023Understanding and evaluating harms of AI-generated image captions in political images14 cited