Lightnews — Scholar-powered news

Reposted by Vagrant Gautam

Queer in AI @queerinai.com · 7d

Attending COLM next week in Montreal? 🇨🇦 Join us on Thursday for a 2-part social! ✨ 5:30-6:30 at the conference venue and 7:00-10:00 offsite! 🌈 Sign up here: forms.gle/oiMK3TLP8ZZc...

4 4

Vagrant Gautam @dippedrusk.com · Aug 14

Please reach out if you'd like to chat - I'm open to new collaborations as a postdoc (in 2 weeks!). I'm still into fairness/reference/reasoning, but also want to do more interpretability work, and start on some new directions (linguistic acceptability/plausibility and memorization/generalization).

2

Vagrant Gautam @dippedrusk.com · Aug 14

At COLM I'm co-presenting a meta-evaluation of LLM misgendering (led by @arjunsubgraph.bsky.social), ongoing work on using decoder-only models to simulate partial differential equations (led by @palomagherreros.bsky.social), and I'm co-organizing the @interplay-workshop.bsky.social

1 4

Vagrant Gautam @dippedrusk.com · Aug 14

I will be
- at the Aarhus conference 🇩🇰 on Monday for our workshop on representation + representativeness with synthetic data
- living in Heidelberg 🇩🇪 in 2 weeks
- in Edinburgh 🏴󠁧󠁢󠁳󠁣󠁴󠁿 in late September giving a talk at the ILCC (on reasoning about reference, probably)
- in Montreal 🇨🇦 in October for COLM

1 17

Vagrant Gautam @dippedrusk.com · Jul 28

In this other paper I look at the effects of LLM architecture on pronoun predictions after explicitly showing the right coreference, but the effects of RLHF and other post-training is an interesting question and to my knowledge unstudied!
direct.mit.edu/tacl/article...

Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased?

Abstract. Robust, faithful, and harm-free pronoun use for individuals is an important goal for language model development as their use increases, but prior work tends to study only one or two of these...

direct.mit.edu

1 2

Vagrant Gautam @dippedrusk.com · Jul 28

Yesss we made a new, harder version of Winogender Schemas that balances for grammatical case and fixes typos and stuff in the original dataset and we found that case dramatically affects performance! This is at a small scale though
aclanthology.org/2024.crac-1.6/

WinoPron: Revisiting English Winogender Schemas for Consistency, Coverage, and Grammatical Case

Vagrant Gautam, Julius Steuer, Eileen Bingert, Ray Johns, Anne Lauscher, Dietrich Klakow. Proceedings of the Seventh Workshop on Computational Models of Reference, Anaphora and Coreference. 2024.

aclanthology.org

3

Vagrant Gautam @dippedrusk.com · Jul 26

Our main finding is that across languages, intersectional country-and-gender biases persist even when there appears to be parity along a single axis (just country or just gender), which is why we get—as our title says—Colombian waitresses and Canadian judges. Enjoy Vienna! Here are my highlights.

KARLSkino, an annual event with open-air film screenings in Vienna at Karlsplatz, a square in front of a beautiful church called the Karlskirche.

Gustav Klimt's The Kiss in a museum with people milling around in front of it.

View of the palace gardens from a window of the Upper Belvedere, the museum where The Kiss is displayed.

Beautiful, huge Gothic church (St. Stephan's Cathedral) in the centre of Vienna with a zig-zag patterned colourful mosaic roof.

8

Vagrant Gautam @dippedrusk.com · Jul 26

I'm not at #ACL2025, but my student Elisa will be there presenting our work on LLMs' gender and country stereotypes in English, Spanish, and German, at the @genderbiasnlp.bsky.social workshop.
aclanthology.org/2025.gebnlp-...

Colombian Waitresses y Jueces canadienses: Gender and Country Biases in Occupation Recommendations from LLMs

Elisa Forcada Rodríguez, Olatz Perez-de-Vinaspre, Jon Ander Campos, Dietrich Klakow, Vagrant Gautam. Proceedings of the 6th Workshop on Gender Bias in Natural Language Processing (GeBNLP). 2025.

aclanthology.org

1 1 20