Kyle Lo
@kylelo.bsky.social
language model pretraining @ai2.bsky.social, co-lead of data research w/ @soldaini.net, statistics @uw, open science, tabletop, seattle, he/him,🧋 kyleclo.com
Pinned
Kyle Lo
@kylelo.bsky.social
· Dec 12
Olmo 3.1 is here. We extended our strongest RL run and scaled our instruct recipe to 32B—releasing Olmo 3.1 Think 32B & Olmo 3.1 Instruct 32B, our most capable models yet. 🧵
during neurips, we kept the RL run going & model kept getting better 😂
Olmo 3.1 is a..
🐡 32B Thinking, still best fully-open model to-date
🐠 32B Instruct, for ppl who hate long yapping, as good as qwen3
we added 10 more pages to the paper! thx for community feedback from convos at neurips
Olmo 3.1 is a..
🐡 32B Thinking, still best fully-open model to-date
🐠 32B Instruct, for ppl who hate long yapping, as good as qwen3
we added 10 more pages to the paper! thx for community feedback from convos at neurips
lucky to chat w sen. patty murray about olmo & importance of fully open AI
January 18, 2026 at 3:09 AM
lucky to chat w sen. patty murray about olmo & importance of fully open AI
using opus to extract research topics from papers & it was giving me useless words like "training", "datasets", and "evaluation"
kept prompting it w examples of more informative topics and it ended up with "LLM training", "LLM datasets", and "LLM evaluation"
thx
kept prompting it w examples of more informative topics and it ended up with "LLM training", "LLM datasets", and "LLM evaluation"
thx
January 17, 2026 at 1:07 AM
using opus to extract research topics from papers & it was giving me useless words like "training", "datasets", and "evaluation"
kept prompting it w examples of more informative topics and it ended up with "LLM training", "LLM datasets", and "LLM evaluation"
thx
kept prompting it w examples of more informative topics and it ended up with "LLM training", "LLM datasets", and "LLM evaluation"
thx
just realized ive had food on my face all day & nobody at office told me, thx ai2 frens 😫
January 16, 2026 at 12:05 AM
just realized ive had food on my face all day & nobody at office told me, thx ai2 frens 😫
bsky wish list
i like the idea of different feeds but i actually want my subscription to select feeds to be taken as a preference signal ("more like this") that informs a "home/default" feed.
i really dislike the UX of having to tab through each subscribed feed, esp when there's also post overlap
i like the idea of different feeds but i actually want my subscription to select feeds to be taken as a preference signal ("more like this") that informs a "home/default" feed.
i really dislike the UX of having to tab through each subscribed feed, esp when there's also post overlap
January 14, 2026 at 9:06 PM
bsky wish list
i like the idea of different feeds but i actually want my subscription to select feeds to be taken as a preference signal ("more like this") that informs a "home/default" feed.
i really dislike the UX of having to tab through each subscribed feed, esp when there's also post overlap
i like the idea of different feeds but i actually want my subscription to select feeds to be taken as a preference signal ("more like this") that informs a "home/default" feed.
i really dislike the UX of having to tab through each subscribed feed, esp when there's also post overlap
just in case it wasn’t clear which room this is
January 7, 2026 at 5:58 PM
just in case it wasn’t clear which room this is
just had hechalou’s yin yang milk tea and i think i’ve transcended 🤤
December 14, 2025 at 1:43 AM
just had hechalou’s yin yang milk tea and i think i’ve transcended 🤤
during neurips, we kept the RL run going & model kept getting better 😂
Olmo 3.1 is a..
🐡 32B Thinking, still best fully-open model to-date
🐠 32B Instruct, for ppl who hate long yapping, as good as qwen3
we added 10 more pages to the paper! thx for community feedback from convos at neurips
Olmo 3.1 is a..
🐡 32B Thinking, still best fully-open model to-date
🐠 32B Instruct, for ppl who hate long yapping, as good as qwen3
we added 10 more pages to the paper! thx for community feedback from convos at neurips
Olmo 3.1 is here. We extended our strongest RL run and scaled our instruct recipe to 32B—releasing Olmo 3.1 Think 32B & Olmo 3.1 Instruct 32B, our most capable models yet. 🧵
December 12, 2025 at 6:03 PM
during neurips, we kept the RL run going & model kept getting better 😂
Olmo 3.1 is a..
🐡 32B Thinking, still best fully-open model to-date
🐠 32B Instruct, for ppl who hate long yapping, as good as qwen3
we added 10 more pages to the paper! thx for community feedback from convos at neurips
Olmo 3.1 is a..
🐡 32B Thinking, still best fully-open model to-date
🐠 32B Instruct, for ppl who hate long yapping, as good as qwen3
we added 10 more pages to the paper! thx for community feedback from convos at neurips
I'll be at #NeurIPS2025 from Tues-Sat!
Come say hi 👋 if you wanna chat about
🦈 olmo 3 stories
🐟 pretraining data & evals
🍣 midtraining shouldnt exist
🐠 model specialization
🐡 AI for education
🍥 tabletop games
Come say hi 👋 if you wanna chat about
🦈 olmo 3 stories
🐟 pretraining data & evals
🍣 midtraining shouldnt exist
🐠 model specialization
🐡 AI for education
🍥 tabletop games
December 1, 2025 at 9:51 PM
I'll be at #NeurIPS2025 from Tues-Sat!
Come say hi 👋 if you wanna chat about
🦈 olmo 3 stories
🐟 pretraining data & evals
🍣 midtraining shouldnt exist
🐠 model specialization
🐡 AI for education
🍥 tabletop games
Come say hi 👋 if you wanna chat about
🦈 olmo 3 stories
🐟 pretraining data & evals
🍣 midtraining shouldnt exist
🐠 model specialization
🐡 AI for education
🍥 tabletop games
fml 🤦🏻♂️
CPSC Warns Consumers to Immediately Stop Using Batteries for E-Bikes from Rad Power Bikes Due to Fire Hazard; Risk of Serious Injury or Death www.cpsc.gov/Warnings/202...
November 24, 2025 at 8:02 PM
fml 🤦🏻♂️
we released Olmo 3! lot of exciting stuff but wanna focus on:
🐟Olmo 3 32B Base, the best fully-open base model to-date, near Qwen 2.5 & Gemma 3 on diverse evals
🐠Olmo 3 32B Think, first fully-open reasoning model approaching Qwen 3 levels
🐡12 training datasets corresp to different staged training
🐟Olmo 3 32B Base, the best fully-open base model to-date, near Qwen 2.5 & Gemma 3 on diverse evals
🐠Olmo 3 32B Think, first fully-open reasoning model approaching Qwen 3 levels
🐡12 training datasets corresp to different staged training
November 20, 2025 at 6:20 PM
we released Olmo 3! lot of exciting stuff but wanna focus on:
🐟Olmo 3 32B Base, the best fully-open base model to-date, near Qwen 2.5 & Gemma 3 on diverse evals
🐠Olmo 3 32B Think, first fully-open reasoning model approaching Qwen 3 levels
🐡12 training datasets corresp to different staged training
🐟Olmo 3 32B Base, the best fully-open base model to-date, near Qwen 2.5 & Gemma 3 on diverse evals
🐠Olmo 3 32B Think, first fully-open reasoning model approaching Qwen 3 levels
🐡12 training datasets corresp to different staged training
going live with a mukbang tmr 🍱
November 19, 2025 at 5:35 PM
going live with a mukbang tmr 🍱
not happy abt gpt 5.1 update. it's making way more mistakes compared to gpt 5 on basic stuff
latex table formatting errors (straight up missing "&" so columns misaligned, or dropping a whole column, or shifting values by 1 position), feels unusable imo 😒
latex table formatting errors (straight up missing "&" so columns misaligned, or dropping a whole column, or shifting values by 1 position), feels unusable imo 😒
November 14, 2025 at 12:26 PM
not happy abt gpt 5.1 update. it's making way more mistakes compared to gpt 5 on basic stuff
latex table formatting errors (straight up missing "&" so columns misaligned, or dropping a whole column, or shifting values by 1 position), feels unusable imo 😒
latex table formatting errors (straight up missing "&" so columns misaligned, or dropping a whole column, or shifting values by 1 position), feels unusable imo 😒
picking between 3 checkpoints w/ same benchmark scores but what if one of them is agi
November 12, 2025 at 5:31 PM
picking between 3 checkpoints w/ same benchmark scores but what if one of them is agi
why intern at Ai2?
🐟interns own major parts of our model development, sometimes even leading whole projects
🐡we're committed to open science & actively help our interns publish their work
reach out if u wanna build open language models together 🤝
links 👇
🐟interns own major parts of our model development, sometimes even leading whole projects
🐡we're committed to open science & actively help our interns publish their work
reach out if u wanna build open language models together 🤝
links 👇
November 5, 2025 at 11:11 PM
why intern at Ai2?
🐟interns own major parts of our model development, sometimes even leading whole projects
🐡we're committed to open science & actively help our interns publish their work
reach out if u wanna build open language models together 🤝
links 👇
🐟interns own major parts of our model development, sometimes even leading whole projects
🐡we're committed to open science & actively help our interns publish their work
reach out if u wanna build open language models together 🤝
links 👇
congrats to our olmo earth team 🌎
small multimodal foundation language models + system for finetuning for important uses like agriculture, wildfire management, conservation & more 🌿
small multimodal foundation language models + system for finetuning for important uses like agriculture, wildfire management, conservation & more 🌿
Introducing OlmoEarth 🌍, state-of-the-art AI foundation models paired with ready-to-use open infrastructure to turn Earth data into clear, up-to-date insights within hours—not years.
November 4, 2025 at 5:57 PM
congrats to our olmo earth team 🌎
small multimodal foundation language models + system for finetuning for important uses like agriculture, wildfire management, conservation & more 🌿
small multimodal foundation language models + system for finetuning for important uses like agriculture, wildfire management, conservation & more 🌿
woah guess VLMs for OCR the hottest research topic this week😆 since the first olmOCR, we've been..
🔥training our VLM using RLVR with binary unit test rewards🔥
it's incredibly effective & unit test creation easy to scale w synthetic data pipelines
check it out at olmocr.allen.ai
🔥training our VLM using RLVR with binary unit test rewards🔥
it's incredibly effective & unit test creation easy to scale w synthetic data pipelines
check it out at olmocr.allen.ai
October 22, 2025 at 6:02 PM
woah guess VLMs for OCR the hottest research topic this week😆 since the first olmOCR, we've been..
🔥training our VLM using RLVR with binary unit test rewards🔥
it's incredibly effective & unit test creation easy to scale w synthetic data pipelines
check it out at olmocr.allen.ai
🔥training our VLM using RLVR with binary unit test rewards🔥
it's incredibly effective & unit test creation easy to scale w synthetic data pipelines
check it out at olmocr.allen.ai
come say hi at posters this morning for OLMo 2 and fluid benchmarking posters 👋 and dont miss @valentinhofmann.bsky.social's talk in morning #colm2025 @ai2.bsky.social vry proud of my gifs
October 9, 2025 at 1:14 PM
come say hi at posters this morning for OLMo 2 and fluid benchmarking posters 👋 and dont miss @valentinhofmann.bsky.social's talk in morning #colm2025 @ai2.bsky.social vry proud of my gifs
@josephc.bsky.social @mariaa.bsky.social and I are at poster #21
findings from large scale survey of 800 researchers on how they use LMs in their research #colm2025
findings from large scale survey of 800 researchers on how they use LMs in their research #colm2025
October 8, 2025 at 8:12 PM
@josephc.bsky.social @mariaa.bsky.social and I are at poster #21
findings from large scale survey of 800 researchers on how they use LMs in their research #colm2025
findings from large scale survey of 800 researchers on how they use LMs in their research #colm2025
flyin to #colm2025 along w bunch of the @ai2.bsky.social team
come chat w me about pretraining horror stories, data & evals, what we're cookin for next olmo, etc
made a 🔥 poster for thursday sess, come say hi
come chat w me about pretraining horror stories, data & evals, what we're cookin for next olmo, etc
made a 🔥 poster for thursday sess, come say hi
October 6, 2025 at 3:20 PM
flyin to #colm2025 along w bunch of the @ai2.bsky.social team
come chat w me about pretraining horror stories, data & evals, what we're cookin for next olmo, etc
made a 🔥 poster for thursday sess, come say hi
come chat w me about pretraining horror stories, data & evals, what we're cookin for next olmo, etc
made a 🔥 poster for thursday sess, come say hi
not my project but I rlly like it
working w cancer research center to analyze clinical data, but private data cant leave the center.
so the team developed a tool that generates code for remote execution by the cancer center, developed on synthetic data, and now tested for realsies 🤩
working w cancer research center to analyze clinical data, but private data cant leave the center.
so the team developed a tool that generates code for remote execution by the cancer center, developed on synthetic data, and now tested for realsies 🤩
October 2, 2025 at 5:19 PM
not my project but I rlly like it
working w cancer research center to analyze clinical data, but private data cant leave the center.
so the team developed a tool that generates code for remote execution by the cancer center, developed on synthetic data, and now tested for realsies 🤩
working w cancer research center to analyze clinical data, but private data cant leave the center.
so the team developed a tool that generates code for remote execution by the cancer center, developed on synthetic data, and now tested for realsies 🤩
had to explain to first time submitter why AC recommended accept ended up as reject 😮💨 been publishing long enough that i get why such things happen but can be rough
September 19, 2025 at 12:07 AM
had to explain to first time submitter why AC recommended accept ended up as reject 😮💨 been publishing long enough that i get why such things happen but can be rough
LM benchmark design requires 3 decisions, how to:
🐟 select test cases
🐠 score LM on each test
🦈 aggregate scores to estimate perf
fluid benchmarking is simple:
🍣 find max informative test cases
🍥 estimate 'ability', not simple avg perf
why care? turn ur grey noisy benchmarks to red ones!
🐟 select test cases
🐠 score LM on each test
🦈 aggregate scores to estimate perf
fluid benchmarking is simple:
🍣 find max informative test cases
🍥 estimate 'ability', not simple avg perf
why care? turn ur grey noisy benchmarks to red ones!
September 17, 2025 at 6:17 PM
LM benchmark design requires 3 decisions, how to:
🐟 select test cases
🐠 score LM on each test
🦈 aggregate scores to estimate perf
fluid benchmarking is simple:
🍣 find max informative test cases
🍥 estimate 'ability', not simple avg perf
why care? turn ur grey noisy benchmarks to red ones!
🐟 select test cases
🐠 score LM on each test
🦈 aggregate scores to estimate perf
fluid benchmarking is simple:
🍣 find max informative test cases
🍥 estimate 'ability', not simple avg perf
why care? turn ur grey noisy benchmarks to red ones!
scathing takedown of recent K2 Think model
"evaluates on data it was trained on, relies on an external model and additional samples for its claimed performance gains, and artificially reduces the scores of compared models"
www.sri.inf.ethz.ch/blog/k2think
"evaluates on data it was trained on, relies on an external model and additional samples for its claimed performance gains, and artificially reduces the scores of compared models"
www.sri.inf.ethz.ch/blog/k2think
Debunking the Claims of K2-Think
K2-Think is a recently released LLM that claims performance on par with GPT-OSS 120B and DeepSeek v3.1, despite having fewer parameters. As we discuss below, the reported gains are overstated, relying...
www.sri.inf.ethz.ch
September 12, 2025 at 8:57 PM
scathing takedown of recent K2 Think model
"evaluates on data it was trained on, relies on an external model and additional samples for its claimed performance gains, and artificially reduces the scores of compared models"
www.sri.inf.ethz.ch/blog/k2think
"evaluates on data it was trained on, relies on an external model and additional samples for its claimed performance gains, and artificially reduces the scores of compared models"
www.sri.inf.ethz.ch/blog/k2think