Lasé Ajayi, MD
banner
laseajayi.com
Lasé Ajayi, MD
@laseajayi.com
Clinical Professor | Adult & Pediatric Palliative Care | Newborn Hospitalist | Digital Health Researcher | Health Policy Leader
Reposted by Lasé Ajayi, MD
And now we have the publication in @j-palliativemed.bsky.social!

Congratulations Mikaila, @laseajayi.com, @kpedmonds.com, & Rabia Atayee!

cc @ucsdpharmacy.bsky.social
Evaluating the Clinical Reasoning of Generative AI in Palliative Care: A Comparison with Five Years of Pharmacy Learners | Journal of Palliative Medicine
Context: Artificial intelligence (AI), particularly large language models (LLMs), offers the potential to augment clinical decision-making, including in palliative care pharmacy, where personalized treatment and assessments are important. Despite the growing interest in AI, its role in clinical reasoning within specialized fields such as palliative care remains uncertain. Objectives: This study examines the performance of four commercial-grade LLMs on a Script Concordance Test (SCT) designed for pharmacy students in a pain and palliative care elective, comparing AI outputs with human learners’ performance at baseline. Methods: Pharmacy students from 2018 to 2023 completed an SCT consisting of 16 clinical questions. Four LLMs (ChatGPT 3.5, ChatGPT 4.0, Gemini, and Gemini Advanced) were tested using the same SCT, with their responses compared to student performance. Results: The average score for LLMs (0.43) was slightly lower than that of students (0.47), but this difference was not statistically significant (p = 0.55). ChatGPT 4.0 achieved the highest score (0.57). Conclusions: While LLMs show potential for augmenting clinical decision-making, their limitations in patient-centered care highlight the necessity of human oversight and reinforce that they cannot replace human expertise in palliative care. This study was conducted in a controlled research setting, where LLMs were prompted to answer clinical reasoning questions despite default safety restrictions. However, this does not imply that such prompts should be used in practice. Future research should explore alternative methods for assessing AI decision-making without overriding safety mechanisms and focus on refining AI to better align with complex clinical reasoning. In addition, further studies are needed to confirm AI’s comparative effectiveness, given the sample size limitations.
www.liebertpub.com
September 11, 2025 at 4:00 AM
Hi! What session was from? Want to make sure I review their talk.
February 8, 2025 at 9:44 PM
Reposted by Lasé Ajayi, MD
January 22, 2025 at 4:56 PM