Lightnews — Scholar-powered news

Puppets of a Digital Brain – SciFilmIt

5

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · 19d

Ever wondered how Energy-Based Models (EBMs) work and how they differ from normal neural networks?
☕️ We go over EBMs and then dive into the Energy-Based Transformers paper to make LLMs that refine guesses, self-verify, and could adapt compute to problem difficulty.

3 6 22

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · 26d

The world’s largest NLP conference with almost 2,000 papers presented, ACL 2025 just took place in Vienna! 🎓✨ Here is a quick snapshot of the event via a short interview with one of the authors whose work caught my attention.
🎥 Watch: youtu.be/GBISWggsQOA

2 3

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Aug 5

Check it out if you’re curious or feel like supporting thoughtful science storytelling; there's a “text trailer” on these pages 📜✨:
🔗 scifilmit.com/puppetsofadi...

scifilmit.com

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Aug 5

My friend Vivi Nastase is working on a short science communication film called "Puppets of a Digital Brain". It aims to explain the tech behind AI chatbots (the good, the bad, the environmental) in an accessible, visual way.
💡 GoFundMe: gofund.me/453ed662

2 1 3

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Aug 3

In this video, we break down each method and show how the same model can sound dull, brilliant, or unhinged – just by changing how it samples.
🎥 Watch here: youtu.be/o-_SZ_itxeA

Greedy? Random? Top-p? How LLMs Actually Pick Words – Decoding Strategies Explained

Dancing with Right & Wrong? - Marsilius-Kolleg

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Aug 3

How do LLMs pick the next word? They don’t choose words directly: they only output word probabilities. 📊 Greedy decoding, top-k, top-p, min-p are methods that turn these probabilities into actual text.

1 2 3

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jul 27

I'll co-organise the "Multilingualism: from data crawling to evaluation" social / birds-of-a-feather session. It's on the 29th at 4PM. Do come by if you're at ACL Vienna! :)

1

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jul 27

I'm also at ACL, would be lovely to catch up!

1 2

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jul 27

Right now, attending the synthetic gata generation tutorial which is packed, because it turned out that "Data is the new source code."

#ACL2025NLP

2

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jul 27

Excited to be at ACL 2025 in Vienna this week 🇦🇹 #ACL2025
I’m always up for a chat about reasoning models, NLE faithfulness, synthetic data generation, or the joys and challenges of explaining AI on YouTube.

If you're around, let’s connect!

2 1 8

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jul 7

📅 Looking forward to the discussion and to learning from fellow panelists and participants. If you're around Heidelberg, join us!

www.marsilius-kolleg.uni-heidelberg.de/de/dancing-w...

An interdisciplinary symposium on knowing, doing and not being sure

www.marsilius-kolleg.uni-heidelberg.de

Human-like object concept representations emerge naturally in multimodal large language models - Nature Machine Intelligence

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jul 7

🔨 What recent advancements in AI were particularly impactful for science?
🔍 How do we calibrate trust in current AI systems?
🧪 If AI takes over more of the scientific process… what’s left for us humans?

1 2

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jul 7

🤖 Can we trust AI in science?
I'm excited to be speaking at the final event of the Young Marsilius Fellows 2025, themed "Dancing with Right & Wrong?" – a title that feels increasingly relevant these days.
I'll be joining a panel on "(How) can we trust AI in science?" to discuss questions like:

1 1 2

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jun 20

Yet another paper finding similarities between human concepts and AI concepts. www.nature.com/articles/s42...

Multimodal large language models are shown to develop object concept representations similar to those of humans. These representations closely align with neural activity in brain regions involved in o...

www.nature.com

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jun 20

We train AI on human-selected or -generated data (yes, even taking a photo is concept selection – we capture what we find interesting; text even more so, expressing our conceptualisation of the world). Then we’re surprised when the AI's concepts and representations are similar to ours. 🤷‍♀️

AlphaEvolve: Using LLMs to solve Scientific and Engineering Challenges | AlphaEvolve explained

Reposted by aicoffeebreak.bsky.social

Nils Trost @trostnils.bsky.social · Jun 20

I'm very excited to finally share the main work of my PhD!
We explored the evolutionary dynamics of gene regulation and expression during gonad development in primates. We cover among others: X chromosome dynamics (incl. in a developing XXY testis), gene regulatory networks and cell type evolution.

Kaessmann Lab @kaessmannlab.bsky.social · Jun 20

We are delighted to share our new preprint “The evolution of gene regulatory programs controlling gonadal development in primates” www.biorxiv.org/content/10.1...

1 5 13

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jun 19

💡 AlphaEvolve is a new AI system that doesn’t just write code, it evolves it. It uses LLMs and evolutionary search to make scientific discoveries.
We explain how AlphaEvolve works and the evolutionary strategies behind it (like MAP-Elites and island-based population methods).
📺 youtu.be/Z4uF6cVly8o

2

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · May 31

💡 Participation includes talks, workshops, and lots of cross-disciplinary exchange—with accommodation and meals covered (fee: 100€).
If this sounds like your thing, the application deadline is June 27!

1

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · May 31

📍 Heidelberg, September 21–27, 2025
💬 Language: English
🎯 Open to PhD students & advanced Master’s students from all disciplines working on AI-related research

AI and Human Values - Marsilius-Kolleg

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · May 31

👉 www.marsilius-kolleg.uni-heidelberg.de/de/studium/i...
🧠 This interdisciplinary event brings together researchers from across fields—computer science, linguistics, philosophy, law, medicine, theology—to explore the normative foundations of generative AI, and how values are embedded in its design.

www.marsilius-kolleg.uni-heidelberg.de

1

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · May 31

Excited to share that I’ll be joining the Summer School “AI and Human Values” this September at the Marsilius-Kolleg of Heidelberg University as a speaker. I'll be giving an introduction to how large language models actually work—before the summer school dives deeper into broader implications.

1 2 3

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · May 18

Long videos are a nightmare for language models—too many tokens, slow inference. ☠️
We explain STORM ⛈️, a new architecture that improves long video LLMs using Mamba layers and token compression. Reaches better accuracy than GPT-4o on benchmarks and up to 8× more efficiency.

📺 youtu.be/uMk3VN4S8TQ

Token-Efficient Long Video Understanding for Multimodal LLMs | Paper explained

2 5

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · May 17

Thank you! I post here as frequently as on Twitter. 🙈 I'm doing videos once a month now.