Nils Trost
@trostnils.bsky.social
Pinned
Nils Trost
@trostnils.bsky.social
· Jun 20
We are delighted to share our new preprint “The evolution of gene regulatory programs controlling gonadal development in primates” www.biorxiv.org/content/10.1...
I'm very excited to finally share the main work of my PhD!
We explored the evolutionary dynamics of gene regulation and expression during gonad development in primates. We cover among others: X chromosome dynamics (incl. in a developing XXY testis), gene regulatory networks and cell type evolution.
We explored the evolutionary dynamics of gene regulation and expression during gonad development in primates. We cover among others: X chromosome dynamics (incl. in a developing XXY testis), gene regulatory networks and cell type evolution.
Reposted by Nils Trost
Computerlinguistin und Geoinformatiker mit „KlarText-Preis“ ausgezeichnet – Hervorragende Wissenschaftskommunikation: Letitia Parcalabescu und Steffen Knoblauch präsentieren Ergebnisse ihrer Doktorarbeiten in allgemeinverständlicher Form www.uni-heidelberg.de/de/newsroom/... #wisskomm
November 14, 2025 at 9:52 AM
Computerlinguistin und Geoinformatiker mit „KlarText-Preis“ ausgezeichnet – Hervorragende Wissenschaftskommunikation: Letitia Parcalabescu und Steffen Knoblauch präsentieren Ergebnisse ihrer Doktorarbeiten in allgemeinverständlicher Form www.uni-heidelberg.de/de/newsroom/... #wisskomm
Reposted by Nils Trost
LLMs can memorize even a phone number seen once in training.🔒
Google’s VaultGemma fixes that, being the first open-weight LLM trained from scratch with differential privacy, so rare secrets leave no trace.
☕ new video explaining Differential Privacy through VaultGemma 👇
🎥 youtu.be/UwX5zzjwb_g
Google’s VaultGemma fixes that, being the first open-weight LLM trained from scratch with differential privacy, so rare secrets leave no trace.
☕ new video explaining Differential Privacy through VaultGemma 👇
🎥 youtu.be/UwX5zzjwb_g
What's up with Google's new VaultGemma model? – Differential Privacy explained
YouTube video by AI Coffee Break with Letitia
youtu.be
November 2, 2025 at 1:28 PM
LLMs can memorize even a phone number seen once in training.🔒
Google’s VaultGemma fixes that, being the first open-weight LLM trained from scratch with differential privacy, so rare secrets leave no trace.
☕ new video explaining Differential Privacy through VaultGemma 👇
🎥 youtu.be/UwX5zzjwb_g
Google’s VaultGemma fixes that, being the first open-weight LLM trained from scratch with differential privacy, so rare secrets leave no trace.
☕ new video explaining Differential Privacy through VaultGemma 👇
🎥 youtu.be/UwX5zzjwb_g
Reposted by Nils Trost
We explain diffusion models and flow-matching models side by side. Flow-Matching models are the new generation of AI image generators that are quickly replacing diffusion models. They take everything diffusion did well, but make it faster, smoother, and deterministic.
🎥 youtu.be/firXjwZ_6KI
🎥 youtu.be/firXjwZ_6KI
Diffusion Models and Flow-Matching explained side by side
YouTube video by AI Coffee Break with Letitia
youtu.be
October 19, 2025 at 12:20 PM
We explain diffusion models and flow-matching models side by side. Flow-Matching models are the new generation of AI image generators that are quickly replacing diffusion models. They take everything diffusion did well, but make it faster, smoother, and deterministic.
🎥 youtu.be/firXjwZ_6KI
🎥 youtu.be/firXjwZ_6KI
Reposted by Nils Trost
Did transposable elements shape brain evolution — and if so, which ones, and in which cell states and lineages? Led by @tyamadat.bsky.social, we explored this question in cerebellum development using sequence-based deep learning models!
www.biorxiv.org/content/10.1...
www.biorxiv.org/content/10.1...
October 16, 2025 at 10:01 PM
Did transposable elements shape brain evolution — and if so, which ones, and in which cell states and lineages? Led by @tyamadat.bsky.social, we explored this question in cerebellum development using sequence-based deep learning models!
www.biorxiv.org/content/10.1...
www.biorxiv.org/content/10.1...
Reposted by Nils Trost
We are thrilled to share our new preprint entitled “The origin and molecular evolution of the mammalian liver cell architecture” www.biorxiv.org/content/10.1...
October 15, 2025 at 12:51 PM
We are thrilled to share our new preprint entitled “The origin and molecular evolution of the mammalian liver cell architecture” www.biorxiv.org/content/10.1...
Reposted by Nils Trost
Ever wondered how Energy-Based Models (EBMs) work and how they differ from normal neural networks?
☕️ We go over EBMs and then dive into the Energy-Based Transformers paper to make LLMs that refine guesses, self-verify, and could adapt compute to problem difficulty.
☕️ We go over EBMs and then dive into the Energy-Based Transformers paper to make LLMs that refine guesses, self-verify, and could adapt compute to problem difficulty.
September 21, 2025 at 12:48 PM
Ever wondered how Energy-Based Models (EBMs) work and how they differ from normal neural networks?
☕️ We go over EBMs and then dive into the Energy-Based Transformers paper to make LLMs that refine guesses, self-verify, and could adapt compute to problem difficulty.
☕️ We go over EBMs and then dive into the Energy-Based Transformers paper to make LLMs that refine guesses, self-verify, and could adapt compute to problem difficulty.
Reposted by Nils Trost
The world’s largest NLP conference with almost 2,000 papers presented, ACL 2025 just took place in Vienna! 🎓✨ Here is a quick snapshot of the event via a short interview with one of the authors whose work caught my attention.
🎥 Watch: youtu.be/GBISWggsQOA
🎥 Watch: youtu.be/GBISWggsQOA
September 14, 2025 at 11:49 AM
The world’s largest NLP conference with almost 2,000 papers presented, ACL 2025 just took place in Vienna! 🎓✨ Here is a quick snapshot of the event via a short interview with one of the authors whose work caught my attention.
🎥 Watch: youtu.be/GBISWggsQOA
🎥 Watch: youtu.be/GBISWggsQOA
Reposted by Nils Trost
👇 !!!
Register to attend the #LouisJeantetSymposium on vertebrate genome #evolution. Organised by Svante Pääbo and
@kaessmannlab.bsky.social . Free event, full line up of speakers 👉 www.jeantet.ch/en/
📆Tuesday 14 October, 08h15
📍CMU - Auditoire Alex-F. Müller (A250)
@genevunige.bsky.social
@kaessmannlab.bsky.social . Free event, full line up of speakers 👉 www.jeantet.ch/en/
📆Tuesday 14 October, 08h15
📍CMU - Auditoire Alex-F. Müller (A250)
@genevunige.bsky.social
September 11, 2025 at 1:09 PM
👇 !!!
Reposted by Nils Trost
How do LLMs pick the next word? They don’t choose words directly: they only output word probabilities. 📊 Greedy decoding, top-k, top-p, min-p are methods that turn these probabilities into actual text.
August 3, 2025 at 12:06 PM
How do LLMs pick the next word? They don’t choose words directly: they only output word probabilities. 📊 Greedy decoding, top-k, top-p, min-p are methods that turn these probabilities into actual text.
Reposted by Nils Trost
Excited to be at ACL 2025 in Vienna this week 🇦🇹 #ACL2025
I’m always up for a chat about reasoning models, NLE faithfulness, synthetic data generation, or the joys and challenges of explaining AI on YouTube.
If you're around, let’s connect!
I’m always up for a chat about reasoning models, NLE faithfulness, synthetic data generation, or the joys and challenges of explaining AI on YouTube.
If you're around, let’s connect!
July 27, 2025 at 12:20 PM
Excited to be at ACL 2025 in Vienna this week 🇦🇹 #ACL2025
I’m always up for a chat about reasoning models, NLE faithfulness, synthetic data generation, or the joys and challenges of explaining AI on YouTube.
If you're around, let’s connect!
I’m always up for a chat about reasoning models, NLE faithfulness, synthetic data generation, or the joys and challenges of explaining AI on YouTube.
If you're around, let’s connect!
Reposted by Nils Trost
Our study on a male-essential microRNA and the evolution of other dosage compensation mechanisms in birds is now out in Nature! www.nature.com/articles/s41...
A male-essential miRNA is key for avian sex chromosome dosage compensation - Nature
Birds have evolved a unique sex chromosome dosage compensation mechanism involving the male-biased microRNA (miR-2954), which is essential for male survival by regulating the expression of dosage-sens...
www.nature.com
July 16, 2025 at 3:23 PM
Our study on a male-essential microRNA and the evolution of other dosage compensation mechanisms in birds is now out in Nature! www.nature.com/articles/s41...
Reposted by Nils Trost
📅 Looking forward to the discussion and to learning from fellow panelists and participants. If you're around Heidelberg, join us!
www.marsilius-kolleg.uni-heidelberg.de/de/dancing-w...
www.marsilius-kolleg.uni-heidelberg.de/de/dancing-w...
Dancing with Right & Wrong? - Marsilius-Kolleg
An interdisciplinary symposium on knowing, doing and not being sure
www.marsilius-kolleg.uni-heidelberg.de
July 7, 2025 at 5:03 PM
📅 Looking forward to the discussion and to learning from fellow panelists and participants. If you're around Heidelberg, join us!
www.marsilius-kolleg.uni-heidelberg.de/de/dancing-w...
www.marsilius-kolleg.uni-heidelberg.de/de/dancing-w...
Reposted by Nils Trost
🤖 Can we trust AI in science?
I'm excited to be speaking at the final event of the Young Marsilius Fellows 2025, themed "Dancing with Right & Wrong?" – a title that feels increasingly relevant these days.
I'll be joining a panel on "(How) can we trust AI in science?" to discuss questions like:
I'm excited to be speaking at the final event of the Young Marsilius Fellows 2025, themed "Dancing with Right & Wrong?" – a title that feels increasingly relevant these days.
I'll be joining a panel on "(How) can we trust AI in science?" to discuss questions like:
July 7, 2025 at 5:03 PM
🤖 Can we trust AI in science?
I'm excited to be speaking at the final event of the Young Marsilius Fellows 2025, themed "Dancing with Right & Wrong?" – a title that feels increasingly relevant these days.
I'll be joining a panel on "(How) can we trust AI in science?" to discuss questions like:
I'm excited to be speaking at the final event of the Young Marsilius Fellows 2025, themed "Dancing with Right & Wrong?" – a title that feels increasingly relevant these days.
I'll be joining a panel on "(How) can we trust AI in science?" to discuss questions like:
I'm very excited to finally share the main work of my PhD!
We explored the evolutionary dynamics of gene regulation and expression during gonad development in primates. We cover among others: X chromosome dynamics (incl. in a developing XXY testis), gene regulatory networks and cell type evolution.
We explored the evolutionary dynamics of gene regulation and expression during gonad development in primates. We cover among others: X chromosome dynamics (incl. in a developing XXY testis), gene regulatory networks and cell type evolution.
We are delighted to share our new preprint “The evolution of gene regulatory programs controlling gonadal development in primates” www.biorxiv.org/content/10.1...
June 20, 2025 at 8:37 AM
I'm very excited to finally share the main work of my PhD!
We explored the evolutionary dynamics of gene regulation and expression during gonad development in primates. We cover among others: X chromosome dynamics (incl. in a developing XXY testis), gene regulatory networks and cell type evolution.
We explored the evolutionary dynamics of gene regulation and expression during gonad development in primates. We cover among others: X chromosome dynamics (incl. in a developing XXY testis), gene regulatory networks and cell type evolution.
Reposted by Nils Trost
Excited to share that I’ll be joining the Summer School “AI and Human Values” this September at the Marsilius-Kolleg of Heidelberg University as a speaker. I'll be giving an introduction to how large language models actually work—before the summer school dives deeper into broader implications.
May 31, 2025 at 11:47 AM
Excited to share that I’ll be joining the Summer School “AI and Human Values” this September at the Marsilius-Kolleg of Heidelberg University as a speaker. I'll be giving an introduction to how large language models actually work—before the summer school dives deeper into broader implications.
Reposted by Nils Trost
Long videos are a nightmare for language models—too many tokens, slow inference. ☠️
We explain STORM ⛈️, a new architecture that improves long video LLMs using Mamba layers and token compression. Reaches better accuracy than GPT-4o on benchmarks and up to 8× more efficiency.
📺 youtu.be/uMk3VN4S8TQ
We explain STORM ⛈️, a new architecture that improves long video LLMs using Mamba layers and token compression. Reaches better accuracy than GPT-4o on benchmarks and up to 8× more efficiency.
📺 youtu.be/uMk3VN4S8TQ
Token-Efficient Long Video Understanding for Multimodal LLMs | Paper explained
YouTube video by AI Coffee Break with Letitia
youtu.be
May 18, 2025 at 12:02 PM
Long videos are a nightmare for language models—too many tokens, slow inference. ☠️
We explain STORM ⛈️, a new architecture that improves long video LLMs using Mamba layers and token compression. Reaches better accuracy than GPT-4o on benchmarks and up to 8× more efficiency.
📺 youtu.be/uMk3VN4S8TQ
We explain STORM ⛈️, a new architecture that improves long video LLMs using Mamba layers and token compression. Reaches better accuracy than GPT-4o on benchmarks and up to 8× more efficiency.
📺 youtu.be/uMk3VN4S8TQ
Reposted by Nils Trost
Reposted by Nils Trost
A great article highlighting the broader implications of the three parallel recent papers from our group and our wonderful colleagues in Spain and Belgium...
Calling someone bird-brained is, in fact, a way of calling someone highly intelligent. @yaseminsaplakoglu.bsky.social reports: www.quantamagazine.org/intelligence...
Intelligence Evolved at Least Twice in Vertebrate Animals | Quanta Magazine
Complex neural circuits likely arose independently in birds and mammals, suggesting that vertebrates evolved intelligence multiple times.
www.quantamagazine.org
April 7, 2025 at 3:49 PM
A great article highlighting the broader implications of the three parallel recent papers from our group and our wonderful colleagues in Spain and Belgium...
Reposted by Nils Trost
Just say “Wait…” – and your LLM gets smarter?!
We explain how just 1,000 training examples + a tiny trick at inference time = o1-preview level reasoning. No RL, no massive data needed.
🎥 Watch now → youtu.be/XuH2QTAC5yI
We explain how just 1,000 training examples + a tiny trick at inference time = o1-preview level reasoning. No RL, no massive data needed.
🎥 Watch now → youtu.be/XuH2QTAC5yI
s1: Simple test-time scaling: Just “wait…” + 1,000 training examples? | PAPER EXPLAINED
YouTube video by AI Coffee Break with Letitia
youtu.be
March 23, 2025 at 12:58 PM
Just say “Wait…” – and your LLM gets smarter?!
We explain how just 1,000 training examples + a tiny trick at inference time = o1-preview level reasoning. No RL, no massive data needed.
🎥 Watch now → youtu.be/XuH2QTAC5yI
We explain how just 1,000 training examples + a tiny trick at inference time = o1-preview level reasoning. No RL, no massive data needed.
🎥 Watch now → youtu.be/XuH2QTAC5yI
Reposted by Nils Trost
How does gene regulation shape brain evolution? Our new preprint dives into this question in the context of mammalian cerebellum development! rb.gy/dbcxjz
Led by @ioansarr.bsky.social, @marisepp.bsky.social and @tyamadat.bsky.social, in collaboration with @steinaerts.bsky.social
Led by @ioansarr.bsky.social, @marisepp.bsky.social and @tyamadat.bsky.social, in collaboration with @steinaerts.bsky.social
March 16, 2025 at 10:31 AM
How does gene regulation shape brain evolution? Our new preprint dives into this question in the context of mammalian cerebellum development! rb.gy/dbcxjz
Led by @ioansarr.bsky.social, @marisepp.bsky.social and @tyamadat.bsky.social, in collaboration with @steinaerts.bsky.social
Led by @ioansarr.bsky.social, @marisepp.bsky.social and @tyamadat.bsky.social, in collaboration with @steinaerts.bsky.social
Reposted by Nils Trost
So excited to announce that our study on the development and evolution of pallial cell types and structures in birds, led by @bassi-z.bsky.social, is now out in @science.org!
www.science.org/doi/10.1126/...
www.science.org/doi/10.1126/...
Developmental origins and evolution of pallial cell types and structures in birds
Innovations in the pallium likely facilitated the evolution of advanced cognitive abilities in birds. We therefore scrutinized its cellular composition and evolution using cell type atlases from chick...
www.science.org
February 13, 2025 at 10:17 PM
So excited to announce that our study on the development and evolution of pallial cell types and structures in birds, led by @bassi-z.bsky.social, is now out in @science.org!
www.science.org/doi/10.1126/...
www.science.org/doi/10.1126/...
Reposted by Nils Trost
An educational and a bit historical deep dive into LLM research.
💡Learn what breakthroughs since 2017 paved the way for AI like ChatGPT (it wasn't overnight). We go through:
* Transformers
* Prompting
* Human Feedback, etc. and break it all down for you! 👇
📺 youtu.be/BprirYymXrg
💡Learn what breakthroughs since 2017 paved the way for AI like ChatGPT (it wasn't overnight). We go through:
* Transformers
* Prompting
* Human Feedback, etc. and break it all down for you! 👇
📺 youtu.be/BprirYymXrg
LLMs Explained: A Deep Dive into Transformers, Prompts, and Human Feedback
YouTube video by AI Coffee Break with Letitia
youtu.be
January 19, 2025 at 1:06 PM
An educational and a bit historical deep dive into LLM research.
💡Learn what breakthroughs since 2017 paved the way for AI like ChatGPT (it wasn't overnight). We go through:
* Transformers
* Prompting
* Human Feedback, etc. and break it all down for you! 👇
📺 youtu.be/BprirYymXrg
💡Learn what breakthroughs since 2017 paved the way for AI like ChatGPT (it wasn't overnight). We go through:
* Transformers
* Prompting
* Human Feedback, etc. and break it all down for you! 👇
📺 youtu.be/BprirYymXrg
Reposted by Nils Trost
New video about:
REPA (Representation Alignment), a clever trick to align diffusion transformers’ representations with pretrained transformers like DINOv2.
It accelerates training and improves the diff. model’s ability to do things other than image generation (like image classification).
REPA (Representation Alignment), a clever trick to align diffusion transformers’ representations with pretrained transformers like DINOv2.
It accelerates training and improves the diff. model’s ability to do things other than image generation (like image classification).
REPA Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You ...
YouTube video by AI Coffee Break with Letitia
youtu.be
December 8, 2024 at 2:05 PM
New video about:
REPA (Representation Alignment), a clever trick to align diffusion transformers’ representations with pretrained transformers like DINOv2.
It accelerates training and improves the diff. model’s ability to do things other than image generation (like image classification).
REPA (Representation Alignment), a clever trick to align diffusion transformers’ representations with pretrained transformers like DINOv2.
It accelerates training and improves the diff. model’s ability to do things other than image generation (like image classification).