Lightnews — Scholar-powered news

Reposted by Markus Strohmaier

Indira Sen @indiiigo.bsky.social · Jul 29

👋 #ACL2025NLP 🇦🇹 @marlutz.bsky.social and I are presenting our poster on demographic representativeness of LLMs today!

🕦 10:30-12:00
📍 Hall X5 (board 1 or 14 according to different sources 🧐)

Here’s the paper on ACL anthology: aclanthology.org/2025.finding...

Drop by!

7 22

Reposted by Markus Strohmaier

Sebastian Stier @sebstier.bsky.social · Jul 29

🚀 New postdoc position for Platform Data & Computational Social Science
Join us to drive @gesis.org' efforts around the Digital Services Act (DSA) and conduct research with online platform data
💼 TV-L EG 14 | Location: Cologne
📌 Apply now: www.gesis.org/en/institute...
#DSA #CSS #DataScience

Details

GESIS Leibniz Institut für Sozialwissenschaften

www.gesis.org

47 47

Reposted by Markus Strohmaier

Dirk Wulff @dirkwulff.bsky.social · Jul 23

🚨 New publication 🚨

Excited to see this published in Findings of #ACL2025, led by @zakashussain.bsky.social.

We critically evaluate claims that #LLMs are "just next token predictors" or "just machines" and call for a more measured discussion on LLM cognition.

aclanthology.org/2025.finding...

2 6

Reposted by Markus Strohmaier

Marc Keuschnigg @marckeuschnigg.bsky.social · Jul 23

Please vote for the best poster #ic2s2

2 20

Markus Strohmaier @mstrohm.bsky.social · Jul 23

Chair for Data Science in the Economic and Social Sciences at University of Mannheim having lots of fun at #ic2s2 @janajung.bsky.social @wanlo.bsky.social @indiiigo.bsky.social @jrupprec.bsky.social @maximiliankreutner.bsky.social and Stefano Balietti

4 21

Markus Strohmaier @mstrohm.bsky.social · Jul 22

opening slides #ic2s2

2 18

Markus Strohmaier @mstrohm.bsky.social · Jul 22

at the opening of #ic2s2

3

Reposted by Markus Strohmaier

Georg Ahnert @wanlo.bsky.social · Jul 18

Really excited to also present this work at #IC2S2 next week in Norrköping! 🎉 I'd love to discuss how to produce LLM survey responses at my poster on Wed at 13:30 (Poster Session 2, Poster ID 68) 📊

Georg Ahnert @wanlo.bsky.social · Jul 14

LLMs are trained to produce open-ended responses 📝, but most survey items require closed-ended responses instead 📊

This Wed 11:00–12:30 at #ESRA25, I'll discuss the large impact that Answer Production Methods have on prediction results + share recommendations for methods and parameters. 👈

A research setup for the evaluation of Answer Production Methods for closed-ended survey responses from LLMs. An LLM is prompted with a survey and an optional instruction, before a Answer Production Method is applied. These methods range from token-probabilities to open-ended text generation + classification. I then evaluated them against human survey answers and calculate individual-level accuracy as well as distribution alignment for sub-populations.

6 18

Reposted by Markus Strohmaier

Jana Jung @janajung.bsky.social · Jul 17

Very excited to head to #IC2S2 next week! 🎉

In our project, we tested whether a psychological assessment can measure sexism in LLMs, and found that applying such tools to LLMs is not as straightforward as it seems.

Find me and my poster at Poster Session 1 (Tue 12:30-14:30) — hope to see you there

4 9

Reposted by Markus Strohmaier

Maximilian Kreutner @maximiliankreutner.bsky.social · Jul 21

LLMs can understand political discourse, but can they actually predict votes of real politicians?

Excited to share my work at #IC2S2 this week!
I will present my poster on Tuesday between 1:30 and 3:30 p.m.

2 5

Reposted by Markus Strohmaier

Indira Sen @indiiigo.bsky.social · Jul 21

Do LLMs represent the people they're supposed simulate or provide personalized assistance to?

We review the current literature in our #ACL2025 Findings paper and investigating what researchers conclude about the demographic representativeness of LLMs:
osf.io/preprints/so...

1/

Screenshot of our paper "Missing the Margins: A Systematic Literature Review on the Demographic Representativeness of LLMs"

Details about what we annotated in our systematic review

2 8 23

Reposted by Markus Strohmaier

Indira Sen @indiiigo.bsky.social · Jul 21

Joint work w/ @marlutz.bsky.social, Elisa Rogers, @dgarcia.eu and @mstrohm.bsky.social

You can find our code and annotated dataset of papers here: github.com/Indiiigo/LLM...

We annotated way more things, e.g., LLM used, response format, so please check it out!

5/5

GitHub - Indiiigo/LLM_rep_review: Systematic Review of the Demographic Representativeness of LLMs

Systematic Review of the Demographic Representativeness of LLMs - Indiiigo/LLM_rep_review

github.com

2 2

Reposted by Markus Strohmaier

Georg Ahnert @wanlo.bsky.social · Jun 16

Excited to present our paper with @maxpe.bsky.social, @dgarcia.eu, and @mstrohm.bsky.social next week at #ICWSM! ✨

We extend social simulation with LLMs to a longitudinal setting by fine-tuning Temporal Adapters—here's how: 🧵

A lineplot that shows how scared people in the UK were over time, during the first COVID-19 lockdown. Our method (Llama 3 Temporal Adapters) produces similar estimates of as the survey data gathered by YouGov.

1 5 16