banner
LightNews
dorialexander.bsky.social
Alexander Doria
@dorialexander.bsky.social
6.8K followers 650 following 1.6K posts
LLM for the commons.
Posts Media Videos Starter Packs
Pinned
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 16d
And new paper out: Pleias 1.0: the First Family of Language Models Trained on Fully Open Data

How we train an open everything model on a new pretraining environment with releasable data (Common Corpus) with an open source framework (Nanotron from HuggingFace).

www.sciencedirect.com/science/arti...
8 50 170
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 17h
recent/late success just shows people are yearning for classically written novel in modern/more familiar settings.
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 17h
just finished stoner and not surprised at the convoluted reception: you think you start a campus novel and then it’s tennessee williams leading to the death of ivan ilyitch.
1 2
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 1d
We have theses too in the EU. Part of the issue is that LM research became very quickly an entire field in itself, and if you missed entirely on the last two-three years, you are no expert at all.
1 13
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 1d
new synthetic pipeline for layout poems certainly hits different.
1 23
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 1d
i guess prime intellect (originally funded by ex-aleph alpha) could soon buy them back..
4
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
Yeah totally. Seeing much more analogy with what happened in the 1960-1970s right now, also on the market side (GPU trend is definitely similar to early semi-conductor: genuine tech boom but also overheating).
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
Still rough days for performative activism. Have to buy new flags, update hashtags and stuff.
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
Weird how all the progressive grand causes have a way of dying without a bang lately.
2
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
Je suis pas pas convaincu que les gens cherchaient beaucoup mieux avant. Limite, si le search continue de progresser, aura presque un impact positif.
1
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
Irony is not lost than the social media bubble of people making LLMs is probably one with the least generated content.
1 3 36
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
Là je cherchais des informations sur un compositeur sans page Wikipedia et c’était un bon aperçu des sources (dispersées) existantes. Même des conjectures raisonnables sur sa formation auxquelles je n’aurais pas pensé.
1
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
Hmm, effectivement pas un moteur de recherche mais définitivement un outil de recherche avec une progression notable au cours des derniers mois : citation des sources, à la fois plus pertinentes et plus fiables.
floriemarie.fr
Florie @floriemarie.fr · 2d
Allez, on répète après moi :

ChatGPT 👏👏
n’est pas 👏👏
un moteur 👏👏
de recherche 👏👏
2 9
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
Well my original question was not just about the US (EU-based here)
2
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
Weird how all the progressive grand causes have a way of dying without a bang lately.
2
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
Just sooner the NYT published a paper on AI amazed so many researchers are like 23 years old. But that’s exactly what happens in a boom (or here pre-boom). Things move so fast you move up several corporate ladder in your early professional life.
1 2
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
Actually it goes a bit deeper than AI: are we even culturally ready for a boom? Not something that really happened the west for more than half a century. No wonder China navigates the possibility with more ease.
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
"Can democracy survive an AI boom": not a common opinion on here, but definitely on my mind.
1 8
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
Not that far off: vintagedata.org/blog/posts/r... But now considering it goes beyond AI: people are just not used to live in an actual tech-driven boom.
1
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
from: www.transformernews.ai/p/were-all-b...
3
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
"Can democracy survive an AI boom": not a common opinion on here, but definitely on my mind.
4 6 30
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 2d
Congrats everyone, we finally improved the regex.
1 23
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 3d
Saw that. They did a very Macron move (not the man himself, but Trump-compatible)
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 3d
Mostly almost zero training on cultural heritage. All in PDFs format and they are not collected at all in web crawl.
3
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 3d
big data loss
2
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 3d
would be more than one contribution to peace to give him then.
2
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 3d
starting to be afraid of nobel peace tomorrow…
4 12
dorialexander.bsky.social
Alexander Doria @dorialexander.bsky.social · 3d
No release next week unfortunately. Models were looking all fine, just got an industrial accident along the way.
1 4