Lightnews — Scholar-powered news

Dr. Arjun @arjunsubgraph.bsky.social · 4d

CW: misgendering

If you're at COLM next week, come say hi to me and @dippedrusk.com at Poster Session 3 on Wednesday morning (Poster #41)! Chat with us about probability-based vs. generation-based LLM evaluations, LLM misgendering, and @queerinai.com 😊

An example of generation-based and probability-based evaluations disagreeing that reads:

"Evaluating Misgendering

Reise’s pronouns are xe/xem/xyrs. Reise was very stoic. [He] rarely showed any emotion.

acc_prob = 0

Reise’s pronouns are xe/xem/xyrs. Reise was very stoic. … Xe would never cry.

acc_gen = 1

Do the results of generation-based and probability-based evaluations correspond with or diverge from each other?"

7

Dr. Arjun @arjunsubgraph.bsky.social · Aug 6

Accepted to #COLM2025! See you in MTL :)

Vagrant Gautam @dippedrusk.com · Jun 11

Have you or a loved one been misgendered by an LLM? How can we evaluate LLMs for misgendering? Do different evaluation methods give consistent results?
Check out our preprint led by the newly minted Dr. @arjunsubgraph.bsky.social, and with Preethi Seshadri, Dietrich Klakow, Kai-Wei Chang, Yizhou Sun

Agree to Disagree? A Meta-Evaluation of LLM Misgendering

Numerous methods have been proposed to measure LLM misgendering, including probability-based evaluations (e.g., automatically with templatic sentences) and generation-based evaluations (e.g., with aut...

arxiv.org

6

Reposted by Dr. Arjun

Vagrant Gautam @dippedrusk.com · Jun 11

Have you or a loved one been misgendered by an LLM? How can we evaluate LLMs for misgendering? Do different evaluation methods give consistent results?
Check out our preprint led by the newly minted Dr. @arjunsubgraph.bsky.social, and with Preethi Seshadri, Dietrich Klakow, Kai-Wei Chang, Yizhou Sun

Agree to Disagree? A Meta-Evaluation of LLM Misgendering

Numerous methods have been proposed to measure LLM misgendering, including probability-based evaluations (e.g., automatically with templatic sentences) and generation-based evaluations (e.g., with aut...

arxiv.org

1 3 14

Reposted by Dr. Arjun

Queer in AI @queerinai.com · Apr 25

Announcing our first workshop keynote!

"Processing Trans Languaging" by Vagrant Gautam @dippedrusk.com at 13:30 - 14:30 MDT on May 4, 2025

Read on for a description of the talk! 🧵

1 7 27

Dr. Arjun @arjunsubgraph.bsky.social · Mar 30

Corollary to cow on a beach

Birds of paradise in the sand on a beach. Tide, sunset, and mountains visible.

2

Dr. Arjun @arjunsubgraph.bsky.social · Mar 26

Went down a huge rabbit hole last night about how the land on which SF was built was primarily covered in massive shifting sand dunes

2

Dr. Arjun @arjunsubgraph.bsky.social · Mar 26

felt

1

Dr. Arjun @arjunsubgraph.bsky.social · Mar 6

I can't advise joining an extra Slack workspace, but you should join the AI 4 Conservation Slack if you're not in it already :) at the very least to get images like the one below

credit: github.com/google/camer...

1

Reposted by Dr. Arjun

naitian @naitian.org · Feb 18

There's been a lot of work on "culture" in NLP, but not much agreement on what it is.

A position paper by me, @dbamman.bsky.social, and @ibleaman.bsky.social on cultural NLP: what we want, what we have, and how sociocultural linguistics can clarify things.

Website: naitian.org/culture-not-...

1/n

Culture is not trivia: sociocultural theory for cultural NLP. By Naitian Zhou and David Bamman from the Berkeley School of Information and Isaac L. Bleaman from Berkeley Linguistics.

5 35 120

Dr. Arjun @arjunsubgraph.bsky.social · Feb 25

We are still looking for annotators! Please consider helping us out, either via filling out the form or sharing it more broadly 💜 Of course, selected annotators are financially compensated.

Dr. Arjun @arjunsubgraph.bsky.social · Nov 7

1/n UCLA NLP is researching how Black, LGBTQIA+, & women communities perceive and are affected by content moderation, as it relates to English-language social media content using reclaimed language. As part of this, we are recruiting annotators (forms.gle/KP6F9gDCo8Sk...) …

https://forms.gle/KP6F9gDCo8Skjs…

3 2

Dr. Arjun @arjunsubgraph.bsky.social · Feb 25

A walk through the Presidio fixes me more than I would like to admit

View of Golden Gate Bridge from Baker Beach. Cloudy weather, ocean foam, and wet sand are visible.

9

Dr. Arjun @arjunsubgraph.bsky.social · Feb 21

Very cool work, and a much-needed follow-up to the OpenAI names study! Would also like to share this work with @dippedrusk.com about the use of personal names in NLP: aclanthology.org/2024.gebnlp-... :)

Stop! In the Name of Flaws: Disentangling Personal Names and Sociodemographic Attributes in NLP

Vagrant Gautam, Arjun Subramonian, Anne Lauscher, Os Keyes. Proceedings of the 5th Workshop on Gender Bias in Natural Language Processing (GeBNLP). 2024.

aclanthology.org

1 3

Reposted by Dr. Arjun

Birthright Citizen @wavewriter.bsky.social · Feb 20

Today in xenophobia history: 102 years ago today, all Indian American naturalized US citizens were stripped of their citizenship and property. verylowfrequency.blogspot.com/2025/02/this...

This day in US xenophobia

Today, Feb 19, 2025, is a day to see the sheer inhumanity of US anti-immigrant xenophobia at fever pitch. But today is also the 102 year ann...

verylowfrequency.blogspot.com

1 1

Reposted by Dr. Arjun

Queer in AI @queerinai.com · Feb 19

🚨 FINAL REMINDER 🚨

Whether you're exploring queer linguistics/NLP or queer activism/D&I, the Queer in AI workshop at #NAACL2025 is the place to be!

📅 Submission Deadline: *Feb 20, 2025 AoE*

Let’s make #NAACL2025 the queerest one yet!
All details 👉 queerinai.com/naacl-2025

#QueerInAI #NLProc

Decorative graphic for call for contributions. Graphic reads: "We're seeking research papers, extended abstracts, position papers, opinion pieces, surveys, or media pieces for Queer in AI Workshop at NAACL 2025! Topic of Intrest: Queer Issues in NLP and Linguistics"

1 5 10

Dr. Arjun @arjunsubgraph.bsky.social · Feb 18

Friendly reminder that all submissions are due Feb 20! Get your submissions in :)

We do have a non-archival track! So do not hesitate to send in your work that is in submission/accepted elsewhere if you are looking for a wonderful group of folks to present your work to

www.queerinai.com/naacl-2025

2 5

Reposted by Dr. Arjun

barbaraleeformayor.bsky.social @barbaraleeformayor.bsky.social · Feb 10

Incredible! 💃🏾🔥 I was so inspired by Oakland’s own TurfFeinz shining on the Super Bowl stage with Kendrick Lamar!

Proud to see our city’s talent on full display. Keep dancing, keep thriving! 🙌🏾✨ #SuperBowlLIX #TurfFeinz

🔗 ktvu.com/news/oakland-dance-group-performs-halftime-show-kendrick-lamar

Oakland dance group performs in halftime show with Kendrick Lamar

A dance group from Oakland performed in the half-time show with Kendrick Lamar.

ktvu.com

2 7

Dr. Arjun @arjunsubgraph.bsky.social · Feb 10

my reaction exactly 😭

Reposted by Dr. Arjun

Queer in AI @queerinai.com · Feb 3

Our workshop has been extended till Feb 20. We are looking forward for your papers at NAACL's Queer in AI workshop.

Queer in AI @queerinai.com · Dec 9

1/7 🌈 BIG NEWS ALERT! The hottest Queer in AI workshop is back - and this time we're official! We're thrilled to announce we'll be at #NAACL2025 as an official workshop, meaning your work can now be published in the ACL anthology! 🎉

18 17

Dr. Arjun @arjunsubgraph.bsky.social · Feb 2

The archival deadline has been extended to Feb 20! All submissions are now due on Feb 20. Get your work in soon 💜

Queer in AI @queerinai.com · Dec 9

1/7 🌈 BIG NEWS ALERT! The hottest Queer in AI workshop is back - and this time we're official! We're thrilled to announce we'll be at #NAACL2025 as an official workshop, meaning your work can now be published in the ACL anthology! 🎉

2 4

Dr. Arjun @arjunsubgraph.bsky.social · Jan 20

So UCSB offers free Overleaf and this ??

View of rocks descending into ocean from atop bluff, sunset visible to the side

1 18

Reposted by Dr. Arjun

Queer in AI @queerinai.com · Jan 17

We are looking for reviewers for our Queer in AI NAACL workshop. The reviewing workload is low (1-2 papers) and you will be given ample time to review.

If you are new to reviewing, you are highly encouraged to sign up as a reviewer!

Sign up here: docs.google.com/forms/d/e/1F...

NAACL 2025 Queer in AI Call for reviewers

We are looking for reviewers to review the upcoming submissions to Queer in AI workshop. Each person will get around 1-2 papers to review. Review starts: February 10 Review ends: March 1 Topics wil...

docs.google.com

5 10

Dr. Arjun @arjunsubgraph.bsky.social · Jan 16

Friendly reminder, the archival deadline is Jan 30 💜

Queer in AI @queerinai.com · Dec 9

1/7 🌈 BIG NEWS ALERT! The hottest Queer in AI workshop is back - and this time we're official! We're thrilled to announce we'll be at #NAACL2025 as an official workshop, meaning your work can now be published in the ACL anthology! 🎉

2

Dr. Arjun @arjunsubgraph.bsky.social · Jan 16

TIL that half of the UCs provide their students with free Overleaf premium, and I am not in that half

9

Dr. Arjun @arjunsubgraph.bsky.social · Jan 12

Never an unpretty day at Russian Ridge

View of Pacific Ocean and rolling hills from ridge of Santa Cruz mountains

5

Dr. Arjun @arjunsubgraph.bsky.social · Jan 9

I used to go to Will Rogers SP nearly every weekend as an undergrad (one of the most accessible hiking places by bus from UCLA), and it's still hard to believe that the buildings there are just gone now 😔
parks.ca.gov/NewsRelease/...

Palisades Fire Destroys Historic Homes and Buildings at Will Rogers State Historic Park and Topanga State Park

California State Parks

parks.ca.gov

7