527. AI for Testing Psychologists, Part 2: Ethics, Supervision, and Protecting Clinical Judgment in the AI Era

https://is1-ssl.mzstatic.com/image/thumb/Podcasts221/v4/99/80/29/9980298f-3f49-4026-8b70-6c48f0fd7f0e/mza_7131750907399033939.png/600x600bb.jpg

The Testing Psychologist Podcast

Dr. Jeremy Sharp: Licensed Psychologist & Private Practice Consultant

500 episodes

3 days ago

Come check it out as Dr. Jeremy Sharp covers everything you need to know to start or grow psychological assessment services in your private practice. We talk about finances, marketing, time management, self-care, technology, and life as a mental health practitioner. Jeremy chats with successful clinicians who share their experiences in testing and private practice to give you straightforward ideas for building thriving assessment services. Dr. Sharp is a Licensed Psychologist specializing in psychological and neuropsychological testing. Over the past seven years, he has grown the Colorado Center for Assessment & Counseling from a solo practice to a multi-clinician clinic with over 1000% revenue increase. http://www.thetestingpsychologist.com

All content for The Testing Psychologist Podcast is the property of Dr. Jeremy Sharp: Licensed Psychologist & Private Practice Consultant and is served directly from their servers with no modification, redirects, or rehosting. The podcast is not affiliated with or endorsed by Podjoint in any way.

527. AI for Testing Psychologists, Part 2: Ethics, Supervision, and Protecting Clinical Judgment in the AI Era

The Testing Psychologist Podcast

49 minutes 29 seconds

1 month ago

527. AI for Testing Psychologists, Part 2: Ethics, Supervision, and Protecting Clinical Judgment in the AI Era

Would you rather read the transcript? Click here.

In this episode, I step back from the nuts and bolts of AI tools and dig into the ethical, supervisory, and professional development challenges of using AI in psychological assessment. I share insights from aviation, medicine, and radiology to highlight risks like automation bias, skill decay, and over-reliance on AI. I also discuss how clinicians and trainees can protect their critical thinking, balance workload reduction with deliberate practice, and frame AI as a thought partner rather than a replacement for judgment. This conversation is designed to spark reflection on how AI is shaping not just our workflows, but our ethics, training practices, and professional identity as psychologists.

Main topics covered:

* Does reducing cognitive load always help—or can it erode clinical skill?

* Strategies to prevent skill decay and maintain clinical proficiency

* Over-reliance, automation bias, and how to resist it

* Structured reflection exercises to improve judgment

* The role of deliberate practice in training and supervision

* Using AI as a thought partner versus a worker

* How AI-supported education can preserve skill development pathways

* Frameworks for trainees: explain-to-verify and reflective reasoning

Cool Things Mentioned

* The Testing Psychologist mastermind groups and business consulting

* “Panel on AI & Testing (AAPdN Annual Conference, April 2025)”: https://www.theaapdn.org/

* “We’re All Wrong Sometimes: Blindspots, Biases, & Getting Better w/ Dr. Stephanie Nelson (The Testing Psychologist #276)”: https://thetestingpsychologist.com/276-were-all-wrong-sometimes-blindspots-biases-getting-better-w-dr-stephanie-nelson/

* “Reverb (AI-assisted report writing for psychologists)”: https://reverbreports.com/

* “Automation bias: a systematic review of frequency, effect, mediators, and mitigators (JAMIA, 2011)”: https://pmc.ncbi.nlm.nih.gov/articles/PMC3240751/

* “Humans and automation: use, misuse, disuse, abuse (Parasuraman & Riley, 1997)”: https://web.mit.edu/16.459/www/parasuraman.pdf

* “Automation-induced complacency: NASA review and experiments (Prinzel et al., 2001)”: https://ntrs.nasa.gov/api/citations/20020021642/downloads/20020021642.pdf

* “Cognitive forcing strategies in clinical decisionmaking (Croskerry, 2003)”: https://pubmed.ncbi.nlm.nih.gov/12514691/

* “Effect of availability bias and reflective reasoning on diagnostic accuracy (Mamede et al., JAMA 2010)”: https://jamanetwork.com/journals/jama/fullarticle/186585

* “The role of deliberate practice in the acquisition of expert performance (Eric...