Lightnews — Scholar-powered news

Hanna Wallach @hannawallach.bsky.social · Jul 16

This is happening now!!!

Hanna Wallach @hannawallach.bsky.social · Jul 15

If you're at @icmlconf.bsky.social this week, come check out our poster on "Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge" presented by the amazing @afedercooper.bsky.social from 11:30am--1:30pm PDT on Weds!!! icml.cc/virtual/2025...

ICML Poster Position: Evaluating Generative AI Systems Is a Social Science Measurement ChallengeICML 2025

icml.cc

4

A. Feder Cooper @afedercooper.bsky.social · Jul 16

1) (Tomorrow!) Wed 7/16, 11am-1:30 pm PT poster for "Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge" (E. Exhibition Hall A-B, E-503)

Work led by @hannawallach.bsky.social + @azjacobs.bsky.social

arxiv.org/abs/2502.00561

Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge

The measurement tasks involved in evaluating generative AI (GenAI) systems lack sufficient scientific rigor, leading to what has been described as "a tangle of sloppy tests [and] apples-to-oranges com...

arxiv.org

1 1 3

Hanna Wallach @hannawallach.bsky.social · Jul 15

Oh whoops! You are indeed correct -- it starts at 11am PT!

1

Hanna Wallach @hannawallach.bsky.social · Jul 15

If you're at @icmlconf.bsky.social this week, come check out our poster on "Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge" presented by the amazing @afedercooper.bsky.social from 11:30am--1:30pm PDT on Weds!!! icml.cc/virtual/2025...

ICML Poster Position: Evaluating Generative AI Systems Is a Social Science Measurement ChallengeICML 2025

icml.cc

1 10 32

Hanna Wallach @hannawallach.bsky.social · Jun 16

I also want to note that this paper has been in progress for many, many years, so we're super excited it's finally being published. It's also one of the most genuinely interdisciplinary projects I've ever worked on, which has made it particularly challenging and rewarding!!! ❤️

2

Hanna Wallach @hannawallach.bsky.social · Jun 16

Check out the camera-ready version of our ACL Findings paper ("Taxonomizing Representational Harms using Speech Act Theory") to learn more!!! arxiv.org/pdf/2504.00928

arxiv.org

1 2 10

Hanna Wallach @hannawallach.bsky.social · Jun 16

Why does this matter? You can't mitigate what you can't measure, and our framework and taxonomy help researchers and practitioners design better ways to measure and mitigate representational harms caused by generative language systems.

1 2

Hanna Wallach @hannawallach.bsky.social · Jun 16

Using this theoretical grounding, we provide new definitions for stereotyping, demeaning, and erasure, and break them down into a detailed taxonomy of system behaviors. By doing this, we unify many of the different ways representational harms have been previously defined.

1 1

Hanna Wallach @hannawallach.bsky.social · Jun 16

We bring some much-needed clarity by turning to speech act theory—a theory of meaning from linguistics that allows us to distinguish between a system output’s purpose and its real-world impacts.

1 1

Hanna Wallach @hannawallach.bsky.social · Jun 16

These are often called “representational harms,” and while they’re easy for people to recognize when they see them, definitions of these harms are commonly under-specified, leading to conceptual confusion. This makes them hard to measure and even harder to mitigate.

1 3

Hanna Wallach @hannawallach.bsky.social · Jun 16

Generative language systems are everywhere, and many of them stereotype, demean, or erase particular social groups.

1 2 9

Hanna Wallach @hannawallach.bsky.social · Jun 15

Check out the camera-ready version of our ICML position paper ("Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge") to learn more!!! arxiv.org/abs/2502.00561

(6/6)

Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge

The measurement tasks involved in evaluating generative AI (GenAI) systems lack sufficient scientific rigor, leading to what has been described as "a tangle of sloppy tests [and] apples-to-oranges com...

arxiv.org

3 10 42

Hanna Wallach @hannawallach.bsky.social · Jun 15

Real talk: GenAI systems aren't toys. Bad evaluations don't just waste people's time---they can cause real-world harms. It's time to level up, ditch the apples-to-oranges comparisons, and start doing measurement like we mean it.

(5/6)

1 11

Hanna Wallach @hannawallach.bsky.social · Jun 15

We propose a framework that cuts through the chaos: first, get crystal clear on what you're measuring and why (no more vague hand-waving); then, figure out how to measure it; and, throughout the process, interrogate validity like your reputation depends on it---because, honestly, it should.

(4/6)

1 2 21

Hanna Wallach @hannawallach.bsky.social · Jun 15

Here's our hot take: evaluating GenAI systems isn't just some techie puzzle---it's a social science measurement challenge.

(3/6)

1 8

Hanna Wallach @hannawallach.bsky.social · Jun 15

But there's a dirty little secret: the ways we evaluate GenAI systems are often sloppy, vague, and quite frankly... not up to the task.

(2/6)

1 4 17

Hanna Wallach @hannawallach.bsky.social · Jun 15

Alright, people, let's be honest: GenAI systems are everywhere, and figuring out whether they're any good is a total mess. Should we use them? Where? How? Do they need a total overhaul?

(1/6)

1 11 33

Hanna Wallach @hannawallach.bsky.social · Jun 10

I'm so excited this paper is finally online!!! 🎉 We had so much fun working on this with @emmharv.bsky.social!!! Thread below summarizing our contributions...

Emma Harvey @emmharv.bsky.social · Jun 9

📣 "Understanding and Meeting Practitioner Needs When Measuring Representational Harms Caused by LLM-Based Systems" is forthcoming at #ACL2025NLP - and you can read it now on arXiv!

🔗: arxiv.org/pdf/2506.04482
🧵: ⬇️

A screenshot of our paper:

Title: Understanding and Meeting Practitioner Needs When Measuring Representational Harms Caused by LLM-Based Systems

Authors: Emma Harvey, Emily Sheng, Su Lin Blodgett, Alexandra Chouldechova, Jean Garcia-Gathright, Alexandra Olteanu, Hanna Wallach

Abstract: The NLP research community has made publicly available numerous instruments for measuring representational harms caused by large language model (LLM)-based systems. These instruments have taken the form of datasets, metrics, tools, and more. In this paper, we examine the extent to which such instruments meet the needs of practitioners tasked with evaluating LLM-based systems. Via semi-structured interviews with 12 such practitioners, we find that practitioners are often unable to use publicly available instruments for measuring representational harms. We identify two types of challenges. In some cases, instruments are not useful because they do not meaningfully measure what practitioners seek to measure or are otherwise misaligned with practitioner needs. In other cases, instruments---even useful instruments---are not used by practitioners due to practical and institutional barriers impeding their uptake. Drawing on measurement theory and pragmatic measurement, we provide recommendations for addressing these challenges to better meet practitioner needs.

3 9

Hanna Wallach @hannawallach.bsky.social · May 20

Please spread the word to anyone who you think might be interested! We will begin reviewing applications on June 2.

5

Hanna Wallach @hannawallach.bsky.social · May 20

This program is open to candidates who will have completed their bachelor's degree (or equiv.) by Summer 2025 (inc. those who graduated previously and have been working or doing a master's degree) and who want to advance their research skills before applying to PhD programs.

1 6

Hanna Wallach @hannawallach.bsky.social · May 20

Exciting news: The Fairness, Accountability, Transparency and Ethics (FATE) group at Microsoft Research NYC is hiring a predoctoral fellow!!! 🎉

www.microsoft.com/en-us/resear...

FATE Research Assistant (“Pre-doc”) - Microsoft Research

The Fairness, Accountability, Transparency, and Ethics (FATE) Research group at Microsoft Research New York City (MSR NYC) is looking for a pre-doctoral research assistant (pre-doc) to start August 20...

www.microsoft.com

2 13 33

Hanna Wallach @hannawallach.bsky.social · May 3

Exciting news!!! This just got into @icmlconf.bsky.social as a position paper!!! 🎉 More updates to come as we work on the camera-ready version!!!

Hanna Wallach @hannawallach.bsky.social · Feb 4

Remember this @neuripsconf.bsky.social workshop paper? We spent the past month writing a newer, better, longer version!!! You can find it online here: arxiv.org/abs/2502.00561

11 51

Hanna Wallach @hannawallach.bsky.social · May 3

Thank you for posting! Very timely as the paper just got accepted to ICML's position paper track!

5

Agathe Balayn @amabalayn.bsky.social · Apr 25

At the #HEAL workshop, I'll present "Systematizing During Measurement Enables Broader Stakeholder Participation" on the ways we can further structure LLM evaluations and open them for deliberation. A project led by @hannawallach.bsky.social

1 3

Jenn Wortman Vaughan @jennwv.bsky.social · Apr 25

2. Also Saturday, @amabalayn.bsky.social will represent our piece arguing that systematization during measurement enables broad stakeholder participation in AI evaluation.

This came out of a huge group collaboration led by @hannawallach.bsky.social: bsky.app/profile/hann...

heal-workshop.github.io

1 1 4

Kate Kaye @katekaye.bsky.social · Apr 3

Reading - Evaluating Evaluations for GenAI from
@hannawallach.bsky.social madesai.bsky.social afedercooper.bsky.social et al-This work dovetails with our work at
@worldprivacyforum.bsky.social on measuring AI governance tools from governments, through privacy/ policy lens arxiv.org/pdf/2502.00561

1 3