This paper introduces the Team Card (TC) as a protocol to address harmful biases in the development of clinical artificial intelligence (AI) systems by emphasizing the often-overlooked role of researchers' positionality. While harmful bias in medical AI, particularly in Clinical Decision Support (CDS) tools, is frequently attributed to issues of data quality, this limited framing neglects how researchers' worldviews-shaped by their training, backgrounds, and experiences-can influence AI design and deployment. These unexamined subjectivities can create epistemic limitations, amplifying biases and increasing the risk of inequitable applications in clinical settings. The TC emphasizes reflexivity-critical self-reflection-as an ethical strategy to identify and address biases stemming from the subjectivity of research teams. By systematically documenting team composition, positionality, and the steps taken to monitor and address unconscious bias, TCs establish a framework for assessing how diversity within teams impacts AI development. Studies across business, science, and organizational contexts demonstrate that diversity improves outcomes, including innovation, decision-making quality, and overall performance. However, epistemic diversity-diverse ways of thinking and problem-solving-must be actively cultivated through intentional, collaborative processes to mitigate bias effectively. By embedding epistemic diversity into research practices, TCs may enhance model performance, improve fairness and offer an empirical basis for evaluating how diversity influences bias mitigation efforts over time. This represents a critical step toward developing inclusive, ethical, and effective AI systems in clinical care. A publicly available prototype presenting our TC is accessible at https://www.teamcard.io/team/demo.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11878906PMC
http://dx.doi.org/10.1371/journal.pdig.0000495DOI Listing

Publication Analysis

Top Keywords

team card
8
artificial intelligence
8
intelligence systems
8
introducing team
4
card enhancing
4
enhancing governance
4
governance medical
4
medical artificial
4
systems age
4
age complexity
4

Similar Publications

Background: Although electronic health record nursing summaries aim to provide a concise overview of patient data, they often fall short of meeting nurses' information needs, leading to underutilization. This gap arises from a lack of involvement of nurses in the design of health information technologies.

Objective: The purpose of this exploratory co-design case study was to solicit insights from nurses regarding nursing summary design considerations, including key information types and the preferred design prototype.

View Article and Find Full Text PDF

Background: Health-promoting strategies targeting the food retail environment can influence consumer purchasing behaviour. Most strategies require the healthiness of available food and beverages to be determined. Healthiness classification systems exist; however, no system is linked to remote food retail point-of-sale systems.

View Article and Find Full Text PDF

Assessing DNA methylation detection for primary human tissue using nanopore sequencing.

Genome Res

March 2025

National Institute on Aging, National Institute of Neurological Disorders and Stroke, National Institutes of Health, Northeastern University

DNA methylation most commonly occurs as 5-methylcytosine (5mC) in the human genome and has been associated with human diseases. Recent developments in single-molecule sequencing technologies (Oxford Nanopore Technologies (ONT) and Pacific Biosciences) have enabled readouts of long, native DNA molecules, including cytosine methylation. ONT recently upgraded their Nanopore sequencing chemistry and kits from the R9 to the R10 version, which yielded increased accuracy and sequencing throughput.

View Article and Find Full Text PDF

This paper introduces the Team Card (TC) as a protocol to address harmful biases in the development of clinical artificial intelligence (AI) systems by emphasizing the often-overlooked role of researchers' positionality. While harmful bias in medical AI, particularly in Clinical Decision Support (CDS) tools, is frequently attributed to issues of data quality, this limited framing neglects how researchers' worldviews-shaped by their training, backgrounds, and experiences-can influence AI design and deployment. These unexamined subjectivities can create epistemic limitations, amplifying biases and increasing the risk of inequitable applications in clinical settings.

View Article and Find Full Text PDF

A Review of "Access to Care" Issues in Aortic Stenosis Patients: A Negative Report Card.

Struct Heart

January 2025

Division of Cardiology, Department of Medicine, University of California San Francisco, San Francisco, California.

The identification and management of patients with aortic stenosis exist along a continuum that includes healthy living, latent progression, diagnosis, treatment, and posttreatment recovery. Barriers to the provision of appropriate care for these patients can occur at any stage along this continuum. Despite the presence of diagnostic echocardiograms, many patients with aortic stenosis are never clinically recognized, and the rate of mismanagement worsens among underrepresented minority groups and women.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!