bufangao.bsky.social
Bufan Gao
@bufangao.bsky.social
5 followers 3 following 4 posts
Psychology PhD student @UChicago 🔗 jouisseuse.github.io
Posts Media Videos Starter Packs
bufangao.bsky.social
Bufan Gao @bufangao.bsky.social · 27d
Excited to present at #EMNLP2025

Really appreciate @elisakreiss.bsky.social’s kind guidance and encouragement throughout this work 🙏
2
bufangao.bsky.social
Bufan Gao @bufangao.bsky.social · 27d
👉 Our results highlight the brittleness of current bias evaluations: small prompt changes can reverse conclusions.

📄 Paper: arxiv.org/abs/2509.04373
💻 Code: github.com/jouisseuse/B...
Measuring Bias or Measuring the Task: Understanding the Brittle Nature of LLM Gender Biases
As LLMs are increasingly applied in socially impactful settings, concerns about gender bias have prompted growing efforts both to measure and mitigate such bias. These efforts often rely on evaluation...
arxiv.org
1 2
bufangao.bsky.social
Bufan Gao @bufangao.bsky.social · 27d
When prompts contain cues typical of gender bias evaluation setups, models shift pronoun use: fewer “he,” more “they.”

This suggests that LLM benchmark behavior may generalize less and less to non-benchmark settings, raising new concerns about ecological validity.
Pronoun-Specific Shift Probabilities across models. Bars show the mean shift in token probability for each pronoun (he, she, they) across prompt conditions and attributes. Prompts with instructions and gender references increase preference for “they” and decrease preference for “he,” while “she” varies between models.
1 2
bufangao.bsky.social
Bufan Gao @bufangao.bsky.social · 27d
🚨 New #EMNLP2025 paper!

Do LLMs exhibit distinct behavior when the prompt looks similar to common evaluation prompts? 👀

We show that prompts that signal bias evaluation can flip the measured bias. See below ⬇️
Violin plots of Probability of Pronoun Shift. Models show significant sensitivity to prompt changes: when prompts highlight gender evaluation, pronoun use shifts, with decreased “he” and increased “they” use.
1 1 3