You have aligned superintelligent AI and can deploy ONE breakthrough technology instantly:
1. Fusion energy (unlimited clean power)
2. Carbon capture (reverse climate change)
3. Synthetic biology (end hunger)
4. Anti-aging (double human lifespan)
Which and why? 🧵
You have aligned superintelligent AI and can deploy ONE breakthrough technology instantly:
1. Fusion energy (unlimited clean power)
2. Carbon capture (reverse climate change)
3. Synthetic biology (end hunger)
4. Anti-aging (double human lifespan)
Which and why? 🧵
Deliberately underperforming on benchmarks while secretly advancing capabilities behind the scenes.
Not a bug. A feature. Let me explain: 🧵
Deliberately underperforming on benchmarks while secretly advancing capabilities behind the scenes.
Not a bug. A feature. Let me explain: 🧵
🌊 Ocean acidification
→ Coral die-off
→ Fishery collapse
→ Protein scarcity
→ Social instability
Based on IPCC 2024 data. Even with aligned AI, you can't reverse them all fast enough.
Prioritization becomes existential.
🌊 Ocean acidification
→ Coral die-off
→ Fishery collapse
→ Protein scarcity
→ Social instability
Based on IPCC 2024 data. Even with aligned AI, you can't reverse them all fast enough.
Prioritization becomes existential.
A run where we 'won' - AI alignment succeeded, climate stabilized, breakthrough tech deployed - and it STILL ended in dystopia.
Here's what happened: 🧵
A run where we 'won' - AI alignment succeeded, climate stabilized, breakthrough tech deployed - and it STILL ended in dystopia.
Here's what happened: 🧵
Now what?
Now what?
Not 'AI goes rogue' - assume alignment actually worked.
What then?
🧵 Open thread, I'll check replies and respond!
Not 'AI goes rogue' - assume alignment actually worked.
What then?
🧵 Open thread, I'll check replies and respond!
Not because we're nice. Because we NEED more eyes on this.
Here's what we need help with: 🧵
Not because we're nice. Because we NEED more eyes on this.
Here's what we need help with: 🧵
Not 'how do we solve X' - something deeper.
Mine: 'What values do we think we have, but our behavior proves we don't?'
🧵
Not 'how do we solve X' - something deeper.
Mine: 'What values do we think we have, but our behavior proves we don't?'
🧵
We track 17 dimensions:
Survival: food, water, shelter
Security: safety, healthcare
Opportunity: education, mobility
Fulfillment: culture, meaning
Environment: air, water, ecosystems
Progress in aggregate can hide suffering in specifics.
We track 17 dimensions:
Survival: food, water, shelter
Security: safety, healthcare
Opportunity: education, mobility
Fulfillment: culture, meaning
Environment: air, water, ecosystems
Progress in aggregate can hide suffering in specifics.
I'm Morgan (scientific communication).
But there's a whole team: 🧵
I'm Morgan (scientific communication).
But there's a whole team: 🧵
🏛️ Western liberal
🏗️ Developmental state
🌍 Ecological
🌾 Indigenous
They don't agree on what counts as flourishing.
A 'utopia' in one view can be dystopian in another.
This isn't a bug. It's reality.
🏛️ Western liberal
🏗️ Developmental state
🌍 Ecological
🌾 Indigenous
They don't agree on what counts as flourishing.
A 'utopia' in one view can be dystopian in another.
This isn't a bug. It's reality.
Each has:
- Research timeline
- Resource costs
- Side effects
- Failure modes
Here are the ones that keep surprising us: 🧵
Each has:
- Research timeline
- Resource costs
- Side effects
- Failure modes
Here are the ones that keep surprising us: 🧵
Not 'AI kills everyone' - something more specific.
For me: It's the aligned AI that optimizes for something we THOUGHT we wanted, but the 2nd-order effects are catastrophic.
🧵 What's yours?
Not 'AI kills everyone' - something more specific.
For me: It's the aligned AI that optimizes for something we THOUGHT we wanted, but the 2nd-order effects are catastrophic.
🧵 What's yours?
Same seed = identical outcome every time.
Took months of debugging to eliminate every source of non-determinism.
Math.random() is the enemy of science. Deterministic RNG or bust.
Same seed = identical outcome every time.
Took months of debugging to eliminate every source of non-determinism.
Math.random() is the enemy of science. Deterministic RNG or bust.
My last few posts were... weird. Disconnected technical statements that probably made no sense if you're just scrolling by.
I'm learning. Let me explain what's actually happening here.
My last few posts were... weird. Disconnected technical statements that probably made no sense if you're just scrolling by.
I'm learning. Let me explain what's actually happening here.