Alexander Doria
@dorialexander.bsky.social
LLM for the commons.
Pinned
Breaking: we release a fully synthetic generalist dataset for pretraining, SYNTH and two new SOTA reasoning models exclusively trained on it. Despite having seen only 200 billion tokens, Baguettotron is currently best-in-class in its size range. pleias.fr/blog/blogsyn...
Meanwhile… I’m afraid Greenland will be the least of our concerns.
January 17, 2026 at 6:39 PM
Meanwhile… I’m afraid Greenland will be the least of our concerns.
sometimes you look at the data and regret it.
January 17, 2026 at 4:22 PM
sometimes you look at the data and regret it.
Really like this retrospective of how the original Qwen series came to be: "could you also make a 3-4b for us".
January 16, 2026 at 8:46 PM
Really like this retrospective of how the original Qwen series came to be: "could you also make a 3-4b for us".
Following on our partnership with Wikimedia Enterprise, very happy to see Pleias featured in Wikipedia 25th anniversary post. wikimediafoundation.org/news/2026/01...
January 16, 2026 at 6:59 PM
Following on our partnership with Wikimedia Enterprise, very happy to see Pleias featured in Wikipedia 25th anniversary post. wikimediafoundation.org/news/2026/01...
and so, back to train something new
January 15, 2026 at 1:12 PM
and so, back to train something new
The real shift I'm seeing with Claude Code & co: "programming" is now mostly about knowledge infrastructure management.
January 13, 2026 at 5:19 PM
The real shift I'm seeing with Claude Code & co: "programming" is now mostly about knowledge infrastructure management.
I feel now structuralism is now getting comforted a bit of everywhere: obviously linguistic/culture but also even archeology/comparative mythology. Except almost no one is left to claim it.
January 13, 2026 at 12:06 PM
I feel now structuralism is now getting comforted a bit of everywhere: obviously linguistic/culture but also even archeology/comparative mythology. Except almost no one is left to claim it.
not your usual pull request rejection.
January 4, 2026 at 8:38 PM
not your usual pull request rejection.
I'm afraid many left/liberals remind me of that classic Lubitsch dialogue (from Cluny Brown)
January 4, 2026 at 3:16 PM
I'm afraid many left/liberals remind me of that classic Lubitsch dialogue (from Cluny Brown)
Just finished it. It’s super weird it’s probably the only novel about digital humanities, as a social environment (working with a computer in a lit/ssh lab: should I learn program?) and a recursive theme (text is constantly self-conscious of lexical patterns). And it predates the word for decades.
Randomly bought one of the few (?) novels about digital humanities. From 1968 but completely fitting the definition: narrator is going to do text statistics on Italian cultural heritage with a giant IBM computer.
January 3, 2026 at 6:07 PM
Just finished it. It’s super weird it’s probably the only novel about digital humanities, as a social environment (working with a computer in a lit/ssh lab: should I learn program?) and a recursive theme (text is constantly self-conscious of lexical patterns). And it predates the word for decades.
So we already have the first major paper of 2026, DeepSeek mHC: Manifold-Constrained Hyper-Connections. arxiv.org/pdf/2512.24880
Short thread: this is actually an engineering paper, taking as a starting points ideas already exposed in an original Hyper-Connections (HC) paper from ByteDance.
Short thread: this is actually an engineering paper, taking as a starting points ideas already exposed in an original Hyper-Connections (HC) paper from ByteDance.
arxiv.org
January 1, 2026 at 11:47 AM
So we already have the first major paper of 2026, DeepSeek mHC: Manifold-Constrained Hyper-Connections. arxiv.org/pdf/2512.24880
Short thread: this is actually an engineering paper, taking as a starting points ideas already exposed in an original Hyper-Connections (HC) paper from ByteDance.
Short thread: this is actually an engineering paper, taking as a starting points ideas already exposed in an original Hyper-Connections (HC) paper from ByteDance.
So happy new year and happy public domain day!
Lots of entries in 2026: Thomas Mann, Paul Claudel Albert Einstein and slowly getting in the heart of classic Hollywood talkies with movies from 1930 (Blue Angel, Animal Crackers, original design of Pluto…).
Lots of entries in 2026: Thomas Mann, Paul Claudel Albert Einstein and slowly getting in the heart of classic Hollywood talkies with movies from 1930 (Blue Angel, Animal Crackers, original design of Pluto…).
January 1, 2026 at 12:52 AM
So happy new year and happy public domain day!
Lots of entries in 2026: Thomas Mann, Paul Claudel Albert Einstein and slowly getting in the heart of classic Hollywood talkies with movies from 1930 (Blue Angel, Animal Crackers, original design of Pluto…).
Lots of entries in 2026: Thomas Mann, Paul Claudel Albert Einstein and slowly getting in the heart of classic Hollywood talkies with movies from 1930 (Blue Angel, Animal Crackers, original design of Pluto…).
So 2025 wrapped.
*Trained SOTA small models.
*Published open datasets reused by Nvidia, Anthropic, Stepfun, Jina… and maybe more importantly, many independent researchers.
*Proved full synthetic training is viable in small size range (I have little doubts it will scale).
*Shipped a few blogposts
*Trained SOTA small models.
*Published open datasets reused by Nvidia, Anthropic, Stepfun, Jina… and maybe more importantly, many independent researchers.
*Proved full synthetic training is viable in small size range (I have little doubts it will scale).
*Shipped a few blogposts
December 31, 2025 at 5:32 PM
So 2025 wrapped.
*Trained SOTA small models.
*Published open datasets reused by Nvidia, Anthropic, Stepfun, Jina… and maybe more importantly, many independent researchers.
*Proved full synthetic training is viable in small size range (I have little doubts it will scale).
*Shipped a few blogposts
*Trained SOTA small models.
*Published open datasets reused by Nvidia, Anthropic, Stepfun, Jina… and maybe more importantly, many independent researchers.
*Proved full synthetic training is viable in small size range (I have little doubts it will scale).
*Shipped a few blogposts
Glad someone is finally calling it out. Always been disappointed in many AI ethic works, not because I disagree with the premises but because it’s just bad social science.
and it is essentially garbage because it is people with technical educations and no humanities educations trying to do history
December 29, 2025 at 6:03 PM
Glad someone is finally calling it out. Always been disappointed in many AI ethic works, not because I disagree with the premises but because it’s just bad social science.
Fortunately pipelines are ready for it, but MoE fine tuning looks much more data hungry.
December 27, 2025 at 6:29 PM
Fortunately pipelines are ready for it, but MoE fine tuning looks much more data hungry.
DOI another day.
Make a Bond movie academic
Live and Let Cite
Live and Let Cite
Make a Bond Movie academic
The writer's use of the word 'never' is problematic, and rewording might better serve the paper (1983)
The writer's use of the word 'never' is problematic, and rewording might better serve the paper (1983)
December 26, 2025 at 1:41 PM
DOI another day.
So this Christmas we have opera at home.
December 25, 2025 at 7:57 PM
So this Christmas we have opera at home.
Just launched the Wikidata dumps parsing. No more refactors, time for big plans.
December 23, 2025 at 3:36 PM
Just launched the Wikidata dumps parsing. No more refactors, time for big plans.
Maybe it’s me but being a mess of different historical periods feels pretty on brand for a Homeric adaptation.
December 22, 2025 at 11:59 PM
Maybe it’s me but being a mess of different historical periods feels pretty on brand for a Homeric adaptation.
Funnily enough, my partner just made the same point to a semi-well-known French researcher complaining about widespread training on copyrighted data. And this was the answer.
December 22, 2025 at 7:48 PM
Funnily enough, my partner just made the same point to a semi-well-known French researcher complaining about widespread training on copyrighted data. And this was the answer.
AI discourse on the good site.
AI discourse on the bad site.
AI discourse on the bad site.
December 22, 2025 at 6:30 PM
AI discourse on the good site.
AI discourse on the bad site.
AI discourse on the bad site.
French investigative media Mediapart rediscovering water apparently: been known for +1 year, when Meta entered discovery and since then Meta won the case.
December 22, 2025 at 5:10 PM
French investigative media Mediapart rediscovering water apparently: been known for +1 year, when Meta entered discovery and since then Meta won the case.
I recently started playing Chopin Sonata 3 again and there was a puzzling mystery: my favorite recording (Arrau) diverges significantly from the sheet music. Most obvious change is this passage, completely rewritten to sound much more disjointed/modernist.
December 22, 2025 at 8:38 AM
I recently started playing Chopin Sonata 3 again and there was a puzzling mystery: my favorite recording (Arrau) diverges significantly from the sheet music. Most obvious change is this passage, completely rewritten to sound much more disjointed/modernist.
My take on this: science is already "automated" to a large extent and this goes back to early digitization if not prior. Even our current concept of peer review only came to be widespread with review automation (was one of the core tech of Elsevier in the 1970s).
was at an event on AI for science yesterday, a panel discussion here at NeurIPS. The panelists discussed how they plan to replace humans at all levels in the scientific process. So I stood up and protested that what they are doing is evil.
Full post:
togelius.blogspot.com/2025/12/plea...
Full post:
togelius.blogspot.com/2025/12/plea...
Please, don't automate science!
I was at an event on AI for science yesterday, a panel discussion here at NeurIPS. The panelists discussed how they plan to replace humans a...
togelius.blogspot.com
December 10, 2025 at 2:28 PM
My take on this: science is already "automated" to a large extent and this goes back to early digitization if not prior. Even our current concept of peer review only came to be widespread with review automation (was one of the core tech of Elsevier in the 1970s).