Lightnews — Scholar-powered news

Stella Biderman @stellaathena.bsky.social · 4d

That was the best I was able to find, I swear I've read others though.

Stella Biderman @stellaathena.bsky.social · 4d

It doesn't directly address your original question though... maybe I should write a blog post about it.

1 5

Stella Biderman @stellaathena.bsky.social · 4d

We have a repo documenting resources to learn about this and all other HPC aspects of LLM training: github.com/EleutherAI/c...

GitHub - EleutherAI/cookbook: Deep learning for dummies. All the practical details and useful utilities that go into working with real models.

Deep learning for dummies. All the practical details and useful utilities that go into working with real models. - EleutherAI/cookbook

github.com

1 2 17

Stella Biderman @stellaathena.bsky.social · 4d

You can't train a LLM like that without multiple revolutionary breakthroughs. It's a common talking point from people who are grifters or clueless, but the technology simply doesn't work like that.

1 8

Stella Biderman @stellaathena.bsky.social · 5d

I feel like there are several blog posts or papers that put forth a research agenda of "making AI research a scientific field" or "advancing the science of AI" or something like that. I'm trouble finding them, does this ring a bell to anyone / does anyone have links to notable examples?

3 8

Stella Biderman @stellaathena.bsky.social · 12d

Obviously she assaulted him /s

1

Reposted by Stella Biderman

Eugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 20d

I want to print it out giant and put it everywhere

No, it’s not The Incentives—it’s you

There’s a narrative I find kind of troubling, but that unfortunately seems to be growing more common in science. The core idea is that the mere existence of perverse incentives is a valid and sufficient reason to knowingly behave in an antisocial way, just as long as one first acknowledges the existence of those perverse incentives. The way this dynamic usually unfolds is that someone points out some fairly serious problem with the way many scientists behave—say, our collective propensity to p-hack as if it’s going out of style, or the fact that we insist on submitting our manuscripts to publishers that are actively trying to undermine our interests—and then someone else will say, “I know, right—but what are you going to do, those are the incentives.”

1 9 61

Stella Biderman @stellaathena.bsky.social · 20d

This is always dire, but especially so when the US is being run by an authoritarian who delights in using state power to go after people he dislikes. The second OpenAI starts asking for your ID, the government will be asking OpenAI for your chats.

5

Stella Biderman @stellaathena.bsky.social · 20d

OpenAI says adult chats deserve confidentiality, then single out teens for surveillance and says that they'll call the cops on people with mental health crises.

This will kill people and not help them get the care they need. It happens all the time

www.vera.org/news/we-need...

We Need to Think Beyond Police in Mental Health Crises

In March of 2020, Joe Prude called 911 for assistance. His brother, Daniel Prude, was behaving erratically and had just bolted out the back door of Joe…

www.vera.org

1 4

Stella Biderman @stellaathena.bsky.social · 20d

The new “teen safety” program from OpenAI repeats the same lies that companies and governments have been saying since the internet began. This won't achieve better online safety for kids, but it will suppress individual liberty and promote censorship.

openai.com/index/buildi...

Building towards age prediction

Learn how OpenAI is building age prediction and parental controls in ChatGPT to create safer, age-appropriate experiences for teens while supporting families with new tools.

openai.com

1 2 8

Reposted by Stella Biderman

Liz Fong-Jones (方禮真) @lizthegrey.com · 20d

the *cato* institute says less than 10% of politically motivated terrorism is caused by leftists. the *cato* institute.

more than two-thirds is from the far-right.

Empathy @constant-tummyache.bsky.social · 20d

Charts don’t lie. Well, unbiased ones anyways

3 39 130

Stella Biderman @stellaathena.bsky.social · Sep 5

There are some papers demonstrating that this improves performance, especially in translation contexts IIRC.

1

Stella Biderman @stellaathena.bsky.social · Sep 2

It's also a pretty notable comment about my friend group that when I wrote this comment I was considering "partner" to be the opposite-gender counterpart of "girlfriend"

1 1

Reposted by Stella Biderman

Naomi Saphra @nsaphra.bsky.social · Aug 29

How can an imitative model like an LLM outperform the experts it is trained on? Our new COLM paper outlines three types of transcendence and shows that each one relies on a different aspect of data diversity. arxiv.org/abs/2508.17669

3 17 95

Stella Biderman @stellaathena.bsky.social · Aug 27

How did you learn to present code? Are there resources that you recommend using to help teach people?

1 1 5

Stella Biderman @stellaathena.bsky.social · Aug 26

Good luck! Maybe you'll succeed where people have failed for decades.

1 1

Stella Biderman @stellaathena.bsky.social · Aug 26

Same

(Since I don't know most of the people in this thread, the joke is that I run one of the servers Naomi mentioned. Except it's not a joke.)

1

Stella Biderman @stellaathena.bsky.social · Aug 26

I have so few straight friends that "partner" to me is mostly coded as "bi but in a relationship with someone of the opposite gender"

1 3

Stella Biderman @stellaathena.bsky.social · Aug 26

You're right that this is an active area of research but I'm unaware of any meaningful successes coming out of it.

1 1

Stella Biderman @stellaathena.bsky.social · Aug 26

Can you name an example of an idea that is well-grounded in biology that has proven successful for neural networks? I don't mean "oh DL was inspired by how non-neuroscientists thinks the brain works," I mean an actual case of making a model work better by making it more brain-like

5 2

Stella Biderman @stellaathena.bsky.social · Aug 26

Digging into unpopular positions with no evidence while the rest of the world passes them by is basically my expectation for sufficiently senior folk.

1 3

Reposted by Stella Biderman

Data Rescue Project #DataRescue @datarescueproject.org · Aug 25

On Thursday we will be joining the #UCLA Latino Policy & Politics Institute for their demo of the newly updated Latino Data Hub (LDH), a public bilingual data platform built to democratize access to critical data about #Latino communities across the country. Register here:

Welcome! You are invited to join a webinar: Exploring the 2025 Latino Data Hub Updates. After registering, you will receive a confirmation email about joining the webinar.

At a time when federal data systems are being defunded, decommissioned, or delayed, public access to reliable, community-level information has never been more critical. Join the UCLA Latino Policy…

ucla.in

1 5 7

Reposted by Stella Biderman

Cas (Stephen Casper) @scasper.bsky.social · Aug 17

Here are a couple of slides that I presented yesterday at #aitechgov about open-weight model risk management.

1 1 2

Reposted by Stella Biderman

Sharon Goldman @sharongoldman.bsky.social · Aug 15

Thanks to @stellaathena.bsky.social for chatting with me about Deep Ignorance: the new paper/project from Eleuther AI and the UK AISI. Bottom line: Worried AI could teach people to build bioweapons? Don’t teach it how

fortune.com/2025/08/14/w...

AI safety tip: if you don’t want it giving bioweapon instructions, maybe don’t put them in the training data, say researchers

New research shows that scrubbing risky material from AI training data can build safeguards that are harder to bypass — and one author calls out tech giants for keeping such work under wraps.

fortune.com

2 12

Reposted by Stella Biderman

Electronic Frontier Foundation @eff.org · Aug 14

“Your driver's license contains a ton of somewhat immutable information about you” like your name, address, DOB, and face, EFF’s Lisa Femia told the @thetennesean.bsky.social. It's not like a credit card number that can be replaced if it's leaked.

Age verification laws are sweeping the US, changing the future of online speech

Age verification laws have been passed in at least 24 states. Some say it’s an effort to protect kids, while others say it restricts protected speech.

www.tennessean.com

5 60 150