Lightnews — Scholar-powered news

LightNews

jessica dai

@jessica.bsky.social

510 followers 110 following 78 posts

go bears!!! jessicad.ai kernelmag.io

Posts Media Videos Starter Packs

Pinned

jessica dai @jessica.bsky.social · Jul 1

individual reporting for post-deployment evals — a little manifesto (& new preprints!)

tldr: end users have unique insights about how deployed systems are failing; we should figure out how to translate their experiences into formal evaluations of those systems.

jessica dai @jessica.bsky.social · Sep 9

congrats!!!

jessica dai @jessica.bsky.social · Aug 6

so close! that's standard error ❤️

jessica dai @jessica.bsky.social · Aug 6

i'm still pissed about this like the difference is literally too small to have been distinguishable with swe bench (500 samples) lmaoooo

jessica dai @jessica.bsky.social · Aug 6

hey wasn't this the same company that made a beautiful shiny "research" post about how AI evals should include error bars or something like that. or did they decide the CLT didn't apply here

jessica dai @jessica.bsky.social · Jul 1

I will be at ICML in a few weeks & would love to chat about how to make this real - I am a critic at heart and also hate self-promo so that’s how you know I really believe in this 🥲

jessica dai @jessica.bsky.social · Jul 1

various ways to read more 😀

blog post- argmin.net/p/individual...
position paper- arxiv.org/abs/2506.18133
fairness-oriented instantiation- arxiv.org/abs/2502.08166

& many thanks to brilliant collaborators
@rajiinio.bsky.social @irenetrampoline.bsky.social @beenwrekt.bsky.social & paula gradu !!

jessica dai @jessica.bsky.social · Jul 1

lots of other stuff I won’t get into rn (e.g., I think this is a prereq to any serious attempt at “democratic” AI!), and there’s also a ton of open research questions (stats, econ/ml, empirical methods, hci, …)

jessica dai @jessica.bsky.social · Jul 1

the core concept is individual reporting as a means to build collective knowledge. if one person has a bad experience, that doesn’t necessarily mean that there’s something wrong with the system — but if lots of people start reporting similar things, maybe we should pay attention.

jessica dai @jessica.bsky.social · Jul 1

we’ve already seen this informally with the chatgpt sycophancy debacle — a few days of twitter virality resulted in action and statements from openai — but what other, subtler, patterns are happening? what could we discover if we had better ways to listen to the public?

jessica dai @jessica.bsky.social · Jul 1

individual reporting for post-deployment evals — a little manifesto (& new preprints!)

tldr: end users have unique insights about how deployed systems are failing; we should figure out how to translate their experiences into formal evaluations of those systems.

Reposted by jessica dai

Ben Recht @beenwrekt.bsky.social · Jun 24

@jessica.bsky.social on individual reporting as a means to build collective knowledge.

Individual experiences and collective evidence

Jessica Dai on theory for the world as it could be

jessica dai @jessica.bsky.social · May 8

right but one would hope that the date of doom _does_ get further away as safety research improves

bsky.app/profile/jess...

jessica dai @jessica.bsky.social · Apr 18

like is it that the field has been ineffective (studied the wrong problems, advocated for the wrong positions, etc) or is it that every step of safety progress has been matched by 2 steps of capabilities progress (in which case, what are the best examples of safety work concretely reducing harm?)

jessica dai @jessica.bsky.social · May 2

help ..

jessica dai @jessica.bsky.social · Apr 24

where are the bullshit "x% of experts believe" polls when you need them lol

jessica dai @jessica.bsky.social · Apr 19

well probably, but i wanna know how folks who do believe in that happening think about the field

jessica dai @jessica.bsky.social · Apr 18

or is it a secret third thing idk. scared to ask this on Real Twitter but genuinely curious how people think about the role of this field

jessica dai @jessica.bsky.social · Apr 18

like is it that the field has been ineffective (studied the wrong problems, advocated for the wrong positions, etc) or is it that every step of safety progress has been matched by 2 steps of capabilities progress (in which case, what are the best examples of safety work concretely reducing harm?)

jessica dai @jessica.bsky.social · Apr 18

perhaps this is a stupid question but given that ai safety has been a pretty vibrant (+ well funded) field for the last 5-10 years... how should we be thinking about the concern that (ai) catastrophe still is, allegedly, imminent

jessica dai @jessica.bsky.social · Mar 11

in middle school we were asked to write a short story in the style of edgar allan poe. as you might expect, all of our little pieces (even, especially, the ones the students thought were "good") were hilariously bad. anyway, i had forgotten about that homework until now

x.com/sama/status/...

Sam Altman on X: "we trained a new model that is good at creative writing (not sure yet how/when it will get released). this is the first time i have been really struck by something written by AI; it got the vibe of metafiction so right. PROMPT: Please write a metafictional literary short story" / X

we trained a new model that is good at creative writing (not sure yet how/when it will get released). this is the first time i have been really struck by something written by AI; it got the vibe of metafiction so right. PROMPT: Please write a metafictional literary short story

jessica dai @jessica.bsky.social · Feb 10

back on bluesky to be mean about ai discourse

jessica dai @jessica.bsky.social · Feb 10

im ngl i think this kinda just means u are stupid

jessica dai @jessica.bsky.social · Jan 1

happy new year

letterstomyfriends.substack.com/p/how-to-hav...

how to have a good time in a phd

(not real advice)

letterstomyfriends.substack.com

jessica dai @jessica.bsky.social · Dec 18

i don't work well under deadline pressure but i also don't work well without it. therefore,

jessica dai @jessica.bsky.social · Dec 16

... didn't we just talk about this ...

jessica dai @jessica.bsky.social · Dec 14

ill read it