Fabian Gloeckle
fabiangloeckle.bsky.social
Fabian Gloeckle
@fabiangloeckle.bsky.social
PhD student at FAIR at Meta and Ecole des Ponts with @syhw and @Amaury_Hayat, co-supervised by @wtgowers. Machine learning for mathematics and programming.
Reposted by Fabian Gloeckle
🔥Very happy to introduce BigO(Bench) dataset on @hf.co 🤗

✨3,105 coding problems and 1,190,250 solutions from CodeContests

✨Time/Space Complexity labels and curve coefficients

✨Up to 5k Runtime/Memory Footprint measures for each solution

huggingface.co/datasets/fac...
April 3, 2025 at 2:46 PM
Causal multi-token prediction at scale!

x.com/francoisfleure…
February 6, 2025 at 1:05 PM
Still a bit to go

x.com/DavidJAlba94/s…
February 6, 2025 at 1:05 PM
The PyTorch reference transformer implementation for researchers. Amazing work!

x.com/mathuvu_/statu…
February 6, 2025 at 1:05 PM
New generation of cross-lingual embedding models -- the same could work for code + math

x.com/JoaoMJaneiro/s…
February 6, 2025 at 1:05 PM
February 6, 2025 at 1:04 PM
awesome folks, awesome event - thanks @rajko_rad !

x.com/rajko_rad/stat…
February 6, 2025 at 1:04 PM
#ICML Looking for recommendations for posters and orals on
- LM pretraining losses
- non-autoregressive architectures, energy-based architectures
- planning, subgoals, task decomposition
- ML for math and reasoning

Please shamelessly self-promote, promote others, comment or DM!
February 6, 2025 at 1:04 PM
At #ICML this week to present Multi-token Prediction with @byoubii: poster session Wednesday 11.30 am - 1 pm Hall C 4-9 #915 - drop by to chat about pretraining losses with us!

icml.cc/virtual/2024/p…
ICML Poster Better & Faster Large Language Models via Multi-token Prediction
The ICML Logo above may be used on presentations. Right-click and choose download. It is a vector graphic and may be used at any scale.
icml.cc
February 6, 2025 at 1:04 PM
Please throw all your interpretability research and decoding tricks on these

x.com/syhw/status/18…
February 6, 2025 at 1:04 PM
February 6, 2025 at 1:04 PM
science starts in the appendix
February 6, 2025 at 1:04 PM