Reconsidering the use of race, sex, and age in clinical algorithms to address bias in practice: A discussion paper
Clinical algorithms are commonly used as decision-support tools, incorporating patient-specific characteristics to predict health outcomes. Risk calculators are clinical algorithms particularly suited for resource allocation based on risk estimation. Although these calculators typically use physiolo...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-12-01
|
| Series: | International Journal of Nursing Studies Advances |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2666142X25000864 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1839630765813399552 |
|---|---|
| author | Reanna Panagides Jessica Keim-Malpass |
| author_facet | Reanna Panagides Jessica Keim-Malpass |
| author_sort | Reanna Panagides |
| collection | DOAJ |
| description | Clinical algorithms are commonly used as decision-support tools, incorporating patient-specific characteristics to predict health outcomes. Risk calculators are clinical algorithms particularly suited for resource allocation based on risk estimation. Although these calculators typically use physiologic data in estimation, they frequently include demographic variables such as race, sex, and age as well. In recent years, the inclusion of race as an input variable has been scrutinized for being reductive, serving as a poor proxy for biological differences, and contributing to the inequitable distribution of services. Little attention has been given to other demographic features, such as sex and age, and their potential to produce similar consequences. By applying a framework for understanding sources of harm throughout the machine learning life cycle and presenting case studies, this paper aims to examine sources of potential harms (i.e. representational and allocative harm) associated with including sex and age in clinical decision-making algorithms, particularly risk calculators. In doing so, this paper demonstrates how systematic discrimination, reductive measurement practices, and observed differences in risk estimation between demographic groups contribute to representational and allocative harm caused by including sex and age in clinical algorithms used for resource distribution. This paper ultimately, urges clinicians to scrutinize the practice of including reductive demographic features (i.e. race, binary-coded sex, and chronological age) as proxies for underlying biological mechanisms in their risk estimations as it violates the bioethical principles of justice and nonmaleficence. Practicing clinicians, including nurses, must have an underlying model literacy to address potential biases introduced in algorithm development, validation, and clinical practice. |
| format | Article |
| id | doaj-art-1dd1f1566eee4f0c9aa07ef8311c150d |
| institution | Matheson Library |
| issn | 2666-142X |
| language | English |
| publishDate | 2025-12-01 |
| publisher | Elsevier |
| record_format | Article |
| series | International Journal of Nursing Studies Advances |
| spelling | doaj-art-1dd1f1566eee4f0c9aa07ef8311c150d2025-07-13T04:55:01ZengElsevierInternational Journal of Nursing Studies Advances2666-142X2025-12-019100380Reconsidering the use of race, sex, and age in clinical algorithms to address bias in practice: A discussion paperReanna Panagides0Jessica Keim-Malpass1University of Virginia, School of Nursing, Charlottesville, VA, USA; Corresponding author at: Claude Moore Nursing Education Building, 225 Jeanette Lancaster Way, Charlottesville, VA 22903.University of Virginia, School of Medicine, Charlottesville VA, USAClinical algorithms are commonly used as decision-support tools, incorporating patient-specific characteristics to predict health outcomes. Risk calculators are clinical algorithms particularly suited for resource allocation based on risk estimation. Although these calculators typically use physiologic data in estimation, they frequently include demographic variables such as race, sex, and age as well. In recent years, the inclusion of race as an input variable has been scrutinized for being reductive, serving as a poor proxy for biological differences, and contributing to the inequitable distribution of services. Little attention has been given to other demographic features, such as sex and age, and their potential to produce similar consequences. By applying a framework for understanding sources of harm throughout the machine learning life cycle and presenting case studies, this paper aims to examine sources of potential harms (i.e. representational and allocative harm) associated with including sex and age in clinical decision-making algorithms, particularly risk calculators. In doing so, this paper demonstrates how systematic discrimination, reductive measurement practices, and observed differences in risk estimation between demographic groups contribute to representational and allocative harm caused by including sex and age in clinical algorithms used for resource distribution. This paper ultimately, urges clinicians to scrutinize the practice of including reductive demographic features (i.e. race, binary-coded sex, and chronological age) as proxies for underlying biological mechanisms in their risk estimations as it violates the bioethical principles of justice and nonmaleficence. Practicing clinicians, including nurses, must have an underlying model literacy to address potential biases introduced in algorithm development, validation, and clinical practice.http://www.sciencedirect.com/science/article/pii/S2666142X25000864Clinical decision-makingBiasResource allocationAlgorithmsSocial JusticeLiteracy |
| spellingShingle | Reanna Panagides Jessica Keim-Malpass Reconsidering the use of race, sex, and age in clinical algorithms to address bias in practice: A discussion paper International Journal of Nursing Studies Advances Clinical decision-making Bias Resource allocation Algorithms Social Justice Literacy |
| title | Reconsidering the use of race, sex, and age in clinical algorithms to address bias in practice: A discussion paper |
| title_full | Reconsidering the use of race, sex, and age in clinical algorithms to address bias in practice: A discussion paper |
| title_fullStr | Reconsidering the use of race, sex, and age in clinical algorithms to address bias in practice: A discussion paper |
| title_full_unstemmed | Reconsidering the use of race, sex, and age in clinical algorithms to address bias in practice: A discussion paper |
| title_short | Reconsidering the use of race, sex, and age in clinical algorithms to address bias in practice: A discussion paper |
| title_sort | reconsidering the use of race sex and age in clinical algorithms to address bias in practice a discussion paper |
| topic | Clinical decision-making Bias Resource allocation Algorithms Social Justice Literacy |
| url | http://www.sciencedirect.com/science/article/pii/S2666142X25000864 |
| work_keys_str_mv | AT reannapanagides reconsideringtheuseofracesexandageinclinicalalgorithmstoaddressbiasinpracticeadiscussionpaper AT jessicakeimmalpass reconsideringtheuseofracesexandageinclinicalalgorithmstoaddressbiasinpracticeadiscussionpaper |