Journal article
Algorithmic Bias and Risk Assessments: Lessons from Practice
Digital Society, Vol.1(2), 14
09/01/2022
DOI: 10.1007/s44206-022-00017-z
Abstract
In this paper, we distinguish between different sorts of assessments of algorithmic systems, describe our process of assessing such systems for ethical risk, and share some key challenges and lessons for future algorithm assessments and audits. Given the distinctive nature and function of a third-party audit, and the uncertain and shifting regulatory landscape, we suggest that second-party assessments are currently the primary mechanisms for analyzing the social impacts of systems that incorporate artificial intelligence. We then discuss two kinds of assessments: an ethical risk assessment and a narrower, technical algorithmic bias assessment. We explain how the two assessments depend on each other, highlight the importance of situating the algorithm within its particular socio-technical context, and discuss a number of lessons and challenges for algorithm assessments and, potentially, for algorithm audits. The discussion builds on our team’s experience of advising and conducting ethical risk assessments for clients across different industries in the last 4 years. Our main goal is to reflect on the key factors that are potentially ethically relevant in the use of algorithms and draw lessons for the nascent algorithm assessment and audit industry, in the hope of helping all parties minimize the risk of harm from their use.
Details
- Title: Subtitle
- Algorithmic Bias and Risk Assessments: Lessons from Practice
- Creators
- Ali Hasan - University of IowaShea Brown - University of IowaJovana Davidovic - University of IowaBenjamin Lange - Ludwig-Maximilians-Universität MünchenMitt Regan - Georgetown University
- Resource Type
- Journal article
- Publication Details
- Digital Society, Vol.1(2), 14
- Publisher
- Springer International Publishing
- DOI
- 10.1007/s44206-022-00017-z
- ISSN
- 2731-4650
- eISSN
- 2731-4669
- Language
- English
- Date published
- 09/01/2022
- Academic Unit
- Physics and Astronomy; Philosophy; Law Faculty
- Record Identifier
- 9984398550602771
Metrics
14 Record Views