Lightnews — Scholar-powered news

Oussama Zekri

@ozekri.bsky.social

61 followers 120 following 20 posts

ENS Saclay maths dpt + UW Research Intern. Website : https://oussamazekri.fr Blog : https://logb-research.github.io/

oussamazekri.fr

Posts Media Videos Starter Packs

Pinned

Oussama Zekri @ozekri.bsky.social · Nov 26

🚀 Did you know you can use the in-context learning abilities of an LLM to estimate the transition probabilities of a Markov chains?

The results are pretty exciting ! 😄

Reposted by Oussama Zekri

Quentin Berthet @qberthet.bsky.social · Feb 10

🚨 New paper on regression and classification!

Adding to the discussion on using least-squares or cross-entropy, regression or classification formulations of supervised problems!

A thread on how to bridge these problems:

Oussama Zekri @ozekri.bsky.social · Feb 6

You mean, we don’t stop at the frontier of the convex set but just a bit further ?

Wow, does this trick have a name?

Oussama Zekri @ozekri.bsky.social · Feb 5

Looks nice!! Will stop by your notebooks

Oussama Zekri @ozekri.bsky.social · Feb 4

Working with him these past months has been both fun and inspiring. He’s an incredibly talented researcher! 🚀

If you haven’t heard of him, check out his work : he’s one of the pioneers of operator learning and pushing this field to new heights!

Nicolas Boullé

nboulle.github.io

Oussama Zekri @ozekri.bsky.social · Feb 4

Thanks for reading !

❤️ Work done during my 3-months internship at Imperial College!

A huge thanks to Nicolas Boullé (nboulle.github.io) for letting me work on a topic that interested me a lot during the internship.

Nicolas Boullé

nboulle.github.io

Oussama Zekri @ozekri.bsky.social · Feb 4

We fine-tuned a discrete diffusion model to respond to user prompts. In just 7k iterations (GPU poverty is real, haha), it outperforms the vanilla model ~75% of the time! 🚀

Oussama Zekri @ozekri.bsky.social · Feb 4

Building on this, we can correct the gradient direction to better **follow the flow**, using the implicit function theorem (cf @mblondel.bsky.social et al., arxiv.org/abs/2105.15183 )✨

The cool part? We only need to invert a linear system, whose inverse is known in closed form! 🔥

Oussama Zekri @ozekri.bsky.social · Feb 4

Inspired by Implicit Diffusion (@pierremarion.bsky.social @akorba.bsky.social @qberthet.bsky.social🤓, arxiv.org/abs/2402.05468), we sample using a specific CTMC, reaching the limiting distribution in an infinite time horizon. This effectively implements a gradient flow w.r.t. a Wasserstein metric!🔥

Oussama Zekri @ozekri.bsky.social · Feb 4

SEPO, like most policy optimization algorithms, alternates between sampling and optimization. But what if sampling itself was seen as an optimization procedure in distribution space? 🚀

Oussama Zekri @ozekri.bsky.social · Feb 4

If you have a discrete diffusion model (naturally designed for discrete data, e.g. language or DNA sequence modeling), you can finetune it with non-differentiable reward functions! 🎯

For example, this enables RLHF for discrete diffusion models, making alignment more flexible and powerful. ✅

Oussama Zekri @ozekri.bsky.social · Feb 4

The main gradient takes the form of a weighted log concrete score, echoing DeepSeek’s unified paradigm with the weighted log policy!🔥

From this, we can reconstruct any policy gradient method for discrete diffusion models (e.g. PPO, GRPO etc...). 🚀

Oussama Zekri @ozekri.bsky.social · Feb 4

The main bottleneck of Energy-Based Models is computing the normalizing constant Z.

Instead, recent discrete diffusion models skip Z by learning ratios of probabilities. This forms the concrete score, which a neural network models efficiently!⚡

The challenge? Using this score network as a policy.

Oussama Zekri @ozekri.bsky.social · Feb 4

🚀 Policy gradient methods like DeepSeek’s GRPO are great for finetuning LLMs via RLHF.

But what happens when we swap autoregressive generation for discrete diffusion, a rising architecture promising faster & more controllable LLMs?

Introducing SEPO !

📑 arxiv.org/pdf/2502.01384

🧵👇

Oussama Zekri @ozekri.bsky.social · Feb 4

Beautiful work!!

Ambroise Odonnat @ambroiseodt.bsky.social · Feb 4

🚀Proud to share our work on the training dynamics in Transformers with Wassim Bouaziz & @viviencabannes.bsky.social @Inria @MetaAI

📝Easing Optimization Paths arxiv.org/pdf/2501.02362 (accepted @ICASSP 2025 🥳)

📝Clustering Heads 🔥https://arxiv.org/pdf/2410.24050

🖥️ github.com/facebookrese...

1/🧵

Reposted by Oussama Zekri

Ambroise Odonnat @ambroiseodt.bsky.social · Feb 4

🚀Proud to share our work on the training dynamics in Transformers with Wassim Bouaziz & @viviencabannes.bsky.social @Inria @MetaAI

📝Easing Optimization Paths arxiv.org/pdf/2501.02362 (accepted @ICASSP 2025 🥳)

📝Clustering Heads 🔥https://arxiv.org/pdf/2410.24050

🖥️ github.com/facebookrese...

1/🧵

Reposted by Oussama Zekri

Ambroise Odonnat @ambroiseodt.bsky.social · Jan 25

Happy to see Disentangled In-Context Learning accepted at ICLR 2025 🥳

Make zero-shot reinforcement learning with LLMs go brrr 🚀

🖥️ github.com/abenechehab/...

📜 arxiv.org/pdf/2410.11711

Congrats Abdelhakim (abenechehab.github.io) for leading it, always fun working with nice and strong people 🤗

GitHub - abenechehab/dicl: Official implementation of DICL (Disentangled In-Context Learning), featured in the paper Zero-shot Model-based Reinforcement Learning using Large Language Models.

Official implementation of DICL (Disentangled In-Context Learning), featured in the paper Zero-shot Model-based Reinforcement Learning using Large Language Models. - abenechehab/dicl

Reposted by Oussama Zekri

lebellig @lebellig.bsky.social · Jan 20

For the French-speaking audience, S. Mallat's courses at the College de France on Data generation in AI by transport and denoising have just started. I highly recommend them, as I've learned a lot from the overall vision of his courses.

Recordings are also available: www.youtube.com/watch?v=5zFh...

Génération de données en IA par transport et débruitage (1) - Stéphane Mallat (2024-2025)

YouTube video by Mathématiques et informatique - Collège de France

www.youtube.com

Reposted by Oussama Zekri

Arnaud Doucet @arnauddoucet.bsky.social · Jan 10

Speculative sampling accelerates inference in LLMs by drafting future tokens which are verified in parallel. With @vdebortoli.bsky.social , A. Galashov & @arthurgretton.bsky.social , we extend this approach to (continuous-space) diffusion models: arxiv.org/abs/2501.05370

Oussama Zekri @ozekri.bsky.social · Dec 6

i couldn’t have say it better myself !

Reposted by Oussama Zekri

Konstantin Mishchenko @konstmish.bsky.social · Dec 6

The idea that one needs to know a lot of advanced math to start doing research in ML seems so wrong to me. Instead of reading books for weeks and forgetting most of them a year later, I think it's much better to try do things, see what knowledge gaps prevent you from doing them, and only then read.

Oussama Zekri @ozekri.bsky.social · Dec 4

This equivalence between LLMs and Markov chains seems useless, but it isn't! Among the contributions, the paper highlights bounds established thanks to this equivalence, and verifies the influence of bound terms on recents LLMs !

I invite you to take a look at the other contributions of the paper 🙂

Oussama Zekri @ozekri.bsky.social · Dec 4

This number is huge, but **finite**! Working with markov chains in a finite state space really gives non-trivial mathematical insights (existence and uniqueness of a stationary distribution for example...).

Reposted by Oussama Zekri

Vicki @vickiboykis.com · Dec 3

This seems like… what we started with, no? arxiv.org/abs/2410.02724

Large Language Models as Markov Chains

Large language models (LLMs) have proven to be remarkably efficient, both across a wide range of natural language processing tasks and well beyond them. However, a comprehensive theoretical analysis o...

Reposted by Oussama Zekri

Ambroise Odonnat @ambroiseodt.bsky.social · Dec 3

🚨So, you want to predict your model's performance at test time?🚨

💡Our NeurIPS 2024 paper proposes 𝐌𝐚𝐍𝐨, a training-free and SOTA approach!

📑 arxiv.org/pdf/2405.18979
🖥️https://github.com/Renchunzi-Xie/MaNo

1/🧵(A surprise at the end!)

Reposted by Oussama Zekri

Gabriel Peyré @gabrielpeyre.bsky.social · Nov 30

I wrote a summary of the main ingredients of the neat proof by Hugo Lavenant that diffusion models do not generally define optimal transport. github.com/mathematical...