Lightnews — Scholar-powered news

Reposted by Nils Trost

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · 18d

Ever wondered how Energy-Based Models (EBMs) work and how they differ from normal neural networks?
☕️ We go over EBMs and then dive into the Energy-Based Transformers paper to make LLMs that refine guesses, self-verify, and could adapt compute to problem difficulty.

3 6 22

Reposted by Nils Trost

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · 25d

The world’s largest NLP conference with almost 2,000 papers presented, ACL 2025 just took place in Vienna! 🎓✨ Here is a quick snapshot of the event via a short interview with one of the authors whose work caught my attention.
🎥 Watch: youtu.be/GBISWggsQOA

2 3

Reposted by Nils Trost

Kaessmann Lab @kaessmannlab.bsky.social · 28d

👇 !!!

Louis-Jeantet Foundation @louisjeantetfdn.bsky.social · Sep 9

Register to attend the #LouisJeantetSymposium on vertebrate genome #evolution. Organised by Svante Pääbo and
@kaessmannlab.bsky.social . Free event, full line up of speakers 👉 www.jeantet.ch/en/

📆Tuesday 14 October, 08h15
📍CMU - Auditoire Alex-F. Müller (A250)
@genevunige.bsky.social

3 5

Nils Trost @trostnils.bsky.social · Aug 14

Grob über den Daumen gepeilt hat also jeder Steuerzahler im Durschschnitt 2€ bezahlt um 0.000003875 Menschen an der Grenze zurückzuweisen.
Oder: ca 258.000€ pro zurückgewiesenem Menschen.

1 4

Reposted by Nils Trost

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Aug 3

How do LLMs pick the next word? They don’t choose words directly: they only output word probabilities. 📊 Greedy decoding, top-k, top-p, min-p are methods that turn these probabilities into actual text.

1 2 3

Reposted by Nils Trost

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jul 27

Excited to be at ACL 2025 in Vienna this week 🇦🇹 #ACL2025
I’m always up for a chat about reasoning models, NLE faithfulness, synthetic data generation, or the joys and challenges of explaining AI on YouTube.

If you're around, let’s connect!

2 1 8

Reposted by Nils Trost

Kaessmann Lab @kaessmannlab.bsky.social · Jul 16

Our study on a male-essential microRNA and the evolution of other dosage compensation mechanisms in birds is now out in Nature! www.nature.com/articles/s41...

A male-essential miRNA is key for avian sex chromosome dosage compensation - Nature

Birds have evolved a unique sex chromosome dosage compensation mechanism involving the male-biased microRNA (miR-2954), which is essential for male survival by regulating the expression of dosage-sens...

www.nature.com

10 58 120

Reposted by Nils Trost

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jul 7

📅 Looking forward to the discussion and to learning from fellow panelists and participants. If you're around Heidelberg, join us!

www.marsilius-kolleg.uni-heidelberg.de/de/dancing-w...

Dancing with Right & Wrong? - Marsilius-Kolleg

An interdisciplinary symposium on knowing, doing and not being sure

www.marsilius-kolleg.uni-heidelberg.de

1 1

Reposted by Nils Trost

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jul 7

🤖 Can we trust AI in science?
I'm excited to be speaking at the final event of the Young Marsilius Fellows 2025, themed "Dancing with Right & Wrong?" – a title that feels increasingly relevant these days.
I'll be joining a panel on "(How) can we trust AI in science?" to discuss questions like:

1 1 2

Nils Trost @trostnils.bsky.social · Jun 20

I want to take this opportunity to thank everyone at the @kaessmannlab.bsky.social (including the past members) for creating such a welcoming, stimulating and fun environment!
Special thanks to @amir-f.bsky.social, the shared first-author, who performed the majority of the sequencing experiments.

Nils Trost @trostnils.bsky.social · Jun 20

I'm very excited to finally share the main work of my PhD!
We explored the evolutionary dynamics of gene regulation and expression during gonad development in primates. We cover among others: X chromosome dynamics (incl. in a developing XXY testis), gene regulatory networks and cell type evolution.

Kaessmann Lab @kaessmannlab.bsky.social · Jun 20

We are delighted to share our new preprint “The evolution of gene regulatory programs controlling gonadal development in primates” www.biorxiv.org/content/10.1...

1 5 13

Reposted by Nils Trost

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · May 31

Excited to share that I’ll be joining the Summer School “AI and Human Values” this September at the Marsilius-Kolleg of Heidelberg University as a speaker. I'll be giving an introduction to how large language models actually work—before the summer school dives deeper into broader implications.

1 2 3

Nils Trost @trostnils.bsky.social · May 26

To give the print head of the the teleprinter enough time to reach the beginning of the new line!

2

Reposted by Nils Trost

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · May 18

Long videos are a nightmare for language models—too many tokens, slow inference. ☠️
We explain STORM ⛈️, a new architecture that improves long video LLMs using Mamba layers and token compression. Reaches better accuracy than GPT-4o on benchmarks and up to 8× more efficiency.

📺 youtu.be/uMk3VN4S8TQ

Token-Efficient Long Video Understanding for Multimodal LLMs | Paper explained

YouTube video by AI Coffee Break with Letitia

youtu.be

2 5

Reposted by Nils Trost

Karly Kingsley @karlykingsley.bsky.social · May 16

🎯

We're about 3 lines deep into the "first they came for" poem.
It's not a very long poem, folks

280 5.7K 26K

Reposted by Nils Trost

Kaessmann Lab @kaessmannlab.bsky.social · Apr 7

A great article highlighting the broader implications of the three parallel recent papers from our group and our wonderful colleagues in Spain and Belgium...

Quanta Magazine @quantamagazine.bsky.social · Apr 7

Calling someone bird-brained is, in fact, a way of calling someone highly intelligent. @yaseminsaplakoglu.bsky.social reports: www.quantamagazine.org/intelligence...

Intelligence Evolved at Least Twice in Vertebrate Animals | Quanta Magazine

Complex neural circuits likely arose independently in birds and mammals, suggesting that vertebrates evolved intelligence multiple times.

www.quantamagazine.org

7 28

Reposted by Nils Trost

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Mar 23

Just say “Wait…” – and your LLM gets smarter?!
We explain how just 1,000 training examples + a tiny trick at inference time = o1-preview level reasoning. No RL, no massive data needed.
🎥 Watch now → youtu.be/XuH2QTAC5yI

s1: Simple test-time scaling: Just “wait…” + 1,000 training examples? | PAPER EXPLAINED

YouTube video by AI Coffee Break with Letitia

youtu.be

3 4

Reposted by Nils Trost

Kaessmann Lab @kaessmannlab.bsky.social · Mar 16

How does gene regulation shape brain evolution? Our new preprint dives into this question in the context of mammalian cerebellum development! rb.gy/dbcxjz
Led by @ioansarr.bsky.social, @marisepp.bsky.social and @tyamadat.bsky.social, in collaboration with @steinaerts.bsky.social

4 69 190

Reposted by Nils Trost

Kaessmann Lab @kaessmannlab.bsky.social · Feb 13

So excited to announce that our study on the development and evolution of pallial cell types and structures in birds, led by @bassi-z.bsky.social, is now out in @science.org!
www.science.org/doi/10.1126/...

Developmental origins and evolution of pallial cell types and structures in birds

Innovations in the pallium likely facilitated the evolution of advanced cognitive abilities in birds. We therefore scrutinized its cellular composition and evolution using cell type atlases from chick...

www.science.org

3 29 73

Reposted by Nils Trost

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Jan 19

An educational and a bit historical deep dive into LLM research.
💡Learn what breakthroughs since 2017 paved the way for AI like ChatGPT (it wasn't overnight). We go through:
* Transformers
* Prompting
* Human Feedback, etc. and break it all down for you! 👇

📺 youtu.be/BprirYymXrg

LLMs Explained: A Deep Dive into Transformers, Prompts, and Human Feedback

YouTube video by AI Coffee Break with Letitia

youtu.be

1 3

Reposted by Nils Trost

aicoffeebreak.bsky.social @aicoffeebreak.bsky.social · Dec 8

New video about:
REPA (Representation Alignment), a clever trick to align diffusion transformers’ representations with pretrained transformers like DINOv2.

It accelerates training and improves the diff. model’s ability to do things other than image generation (like image classification).

REPA Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You ...

YouTube video by AI Coffee Break with Letitia

youtu.be

1 1 3