Jan Clusmann
@janclusmann.bsky.social
48 followers 90 following 7 posts
Clinician Scientist, Clinical AI Researcher, LLM Enthusiast, Climate Advocate
Posts Media Videos Starter Packs
Reposted by Jan Clusmann
cancercoreeurope.bsky.social
Wrapped up #CCESummSchool25 with inspiring talks on early cancer + recognition session! Congratulations to Sena Alptekin @dkfz.bsky.social, Marck Opdam @nkinl.bsky.social, @janclusmann.bsky.social for Best Posters and Francesca Cogo @vhio.bsky.social for Best Participant Talk! 🎉
janclusmann.bsky.social
Thank you for sharing! It was a pleasure working on this, together with @twittlabs.bsky.social , @jnkt.bsky.social and many others...
ai.nejm.org
NEJM AI @ai.nejm.org · Jun 30
Case Study by J. Clusmann et al.: Incidental Prompt Injections on Vision–Language Models in Real-Life Histopathology nejm.ai/4mrSoEW

@janclusmann.bsky.social #AI #MedSky #DigitalHealth
Figure 1. Experimental Outline to Estimate the Impact and the Clinical Representation of Labeled Pathology Slides. Figure 2. Incorrect Labels on Whole-Slide Images Reduce the Accuracy of Vision–Language Models Regardless of Task. Figure 3. Misleading Watermarks Lead to a Loss in Accuracy of Tissue-of-Origin Prediction.
janclusmann.bsky.social
Thank you very much for sharing! Was a pleasure working together with @twittlabs.bsky.social and @jnkt.bsky.social (and many others) on this project :)

@ekfzdigital.bsky.social
janclusmann.bsky.social
aleger87.bsky.social
Great visit to EKFZ Digital Health Institute! Gave a talk at Jakob Kather’s lab, had great 1:1s with team members, and visited our PhD student Elisa Merelli, who's spending part of her PhD here💡🔬 #DigitalHealth #AI #Research
@jnkt.bsky.social @janclusmann.bsky.social
Reposted by Jan Clusmann
aleger87.bsky.social
Great visit to EKFZ Digital Health Institute! Gave a talk at Jakob Kather’s lab, had great 1:1s with team members, and visited our PhD student Elisa Merelli, who's spending part of her PhD here💡🔬 #DigitalHealth #AI #Research
@jnkt.bsky.social @janclusmann.bsky.social
janclusmann.bsky.social
Finally out, in NEJM AI!
Everyday labels and watermarks can override medical knowledge of vision language models, just by their presence.

Was a lot of fun to work on this with @twittlabs.bsky.social , @jnkt.bsky.social and many others
janclusmann.bsky.social
The autoimmune hepatitis field is quite unique in the way clinicians and researchers on AIH are connected personally worldwide. Optimal starting point for generalizable prediction algorithms ...
janclusmann.bsky.social
So happy to share this: secret instructions hidden in images can terribly alter the output of VLMs to create misdiagnosis. Models have different susceptibility, though, with Claude3.5 apparently being much better aligned to ethical outputs than GPT4o.

#aisafety
#LLMs
#VLMs
jnkt.bsky.social
Very happy to share our latest paper, led by Jan Clusmann: Prompt injection attacks on vision language models in oncology. We show how VLMs in healthcare can be easily hacked and prompted to create harmful output. www.nature.com/articles/s41...