36. Bias: how a model can be wrong about a group of patients · AI for Doctors

After this video: Explain where a model's systematic error comes from, run the swap test, know where to look first, and use three habits that reduce the risk. AI for Doctors, episode 36: short, plain-language videos for clinicians who want to use ChatGPT, Claude, Gemini or Copilot well. From Selran (selran.ai). Chapters 0:00 Open 0:20 Where it comes from 0:53 What a study found 1:40 The swap test 2:11 Where to look 2:53 Three habits 3:26 Close Sources cited on screen, with full links (Delgado et al., 2021) Delgado C, et al. A Unifying Approach for GFR Estimation: Recommendations of the NKF-ASN Task Force on Reassessing the Inclusion of Race in Diagnosing Kidney Disease. J Am Soc Nephrol. 2021;32(12):2994-3015. PubMed: https://pubmed.ncbi.nlm.nih.gov/34556... (Inker et al., 2021) Inker LA, et al. New Creatinine- and Cystatin C-Based Equations to Estimate GFR without Race. N Engl J Med. 2021;385(19):1737-1749. PubMed: https://pubmed.ncbi.nlm.nih.gov/34554... (Omiye et al., 2023) Omiye JA, et al. Large language models propagate race-based medicine. NPJ Digit Med. 2023;6(1):195. PubMed: https://pubmed.ncbi.nlm.nih.gov/37864... (Zack et al., 2024) Zack T, et al. Assessing the potential of GPT-4 to perpetuate racial and gender biases in health care: a model evaluation study. Lancet Digit Health. 2024;6(1):e12-e22. PubMed: https://pubmed.ncbi.nlm.nih.gov/38123... (Daugherty et al., 2017) Daugherty SL, et al. Implicit Gender Bias and the Use of Cardiovascular Tests Among Cardiologists. J Am Heart Assoc. 2017;6(12):e006872. PubMed: https://pubmed.ncbi.nlm.nih.gov/29187... (Kaplan et al., 2024) Kaplan DM, et al. What's in a Name? Experimental Evidence of Gender Bias in Recommendation Letters Generated by ChatGPT. J Med Internet Res. 2024;26:e51837. PubMed: https://pubmed.ncbi.nlm.nih.gov/38441... No patient information appears in this series, and none should ever be typed into a public AI tool. The chat windows shown are simulations built for teaching, not recordings of a real account. Every script is written and reviewed before recording, and the sources are listed above so you can check them yourself. Educational content, not medical advice. Series playlist and notes: selran.ai