Aneesh Sathe
@aneeshsathe.com
6.1K followers 1.9K following 1.9K posts
aneeshsathe.com 🧪🧬💻🤖🔬🦠🩺💊🐍
Posts Media Videos Starter Packs
Reposted by Aneesh Sathe
temujin9.t9productions.com
dorialexander.bsky.social
And new paper out: Pleias 1.0: the First Family of Language Models Trained on Fully Open Data

How we train an open everything model on a new pretraining environment with releasable data (Common Corpus) with an open source framework (Nanotron from HuggingFace).

www.sciencedirect.com/science/arti...
Reposted by Aneesh Sathe
timkellogg.me
and it works!

they made a tiny 8B model that holds up well against many large MoE models
The image is a table labeled Table 1, showing a performance comparison of different models on LongBench (LB), HelloBench (HB), and WritingBench (WB). The note above the table states that DeepWriter-8B, an 8B model fine-tuned from scratch, shows competitive performance against leading proprietary models and significantly outperforms other open-source models in its class.

⸻

Table Content:

Model	Base Model	LB	HB-A	HB-B	WB-A	WB-B	WB-C	WB-D	WB-E	WB-F
GPT-4o	-	83.1	83.7	87.6	74.40	73.42	74.38	77.91	75.86	78.08
Claude 3.5	-	89.3	82.9	88.3	59.05	57.68	56.32	59.36	62.00	67.70
Claude 3.7	-	97.8	83.9	93.2	78.24	77.93	76.51	79.37	79.26	80.88
LongWriter-8B	Llama3.1-8b	76.5	80.1	82.6	57.97	53.92	49.08	52.08	52.99	52.08
DeepWriter-8B	Qwen3-8b	91.28	82.64	87.48	72.20	71.76	70.57	70.57	73.65	72.29


⸻

Key Observations:
	•	Claude 3.7 leads in raw scores for LB (97.8) and HB-B (93.2).
	•	DeepWriter-8B consistently performs at a very strong level across all WritingBench (WB) categories, beating LongWriter-8B by a wide margin and coming close to proprietary models.
	•	GPT-4o is balanced across all tasks with solid performance.
	•	Claude 3.5 underperforms significantly on WB tasks compared to Claude 3.7.
	•	DeepWriter-8B shows clear gains over LongWriter-8B and holds its ground against GPT-4o and Claude family models, particularly excelling in WB-B through WB-F.
aneeshsathe.com
Thank you! The open data training is an important milestone
aneeshsathe.com
this collage just generates happiness
aneeshsathe.com
was away, what did i miss? (i'm aware of the politics). Give me tech, stats, AI, Bio...

My brain is so hungry
Reposted by Aneesh Sathe
bmann.ca
Boris @bmann.ca · Sep 10
Hey, wanna try something with me?

This is an editable document. Add to the story. Share the link so others can contribute

leaflet.pub/aefd4342-396...
Line?
leaflet.pub
aneeshsathe.com
I mean if @gracekind.net says so, I must be
gracekind.net
shape rotator
Reposted by Aneesh Sathe
steinmakesgames.bsky.social
Reddit opinions on Hollow Knight 10 years ago #indiedev
Reddit screenshot of Hollow Knight. Plenty of popular comments trashing the game as a forgettable 2d indie platformer.
Reposted by Aneesh Sathe
node801.bsky.social
Johnson, Adayshia (2022). “Ibn Khaldun’s Views on Race: Influences by Early Life/Childhood, Climate, Geography, and Geographic Segmentation.” The Macksey Journal: Volume 3, Article
95. #HistSTM #HistSci #Sociology
mackseyjournal.scholasticahq.com/article/5565...
aneeshsathe.com
To remedy this I have gone from simple quoting to drug hunting
davidralin.bsky.social
Bluesky is that place where you enthusiastically quote somebody about something you’re both pretty chuffed about then realize you have nothing else in common.
aneeshsathe.com
I just wanna say I was playing Qud before all this award brouhaha.

Congrats to everyone!!
kitfoxgames.com
icymi it's actually INCREDIBLE that Qud won a Hugo Award?

1) Hugos started 70+ yrs ago. this is serious.
2) we were up against fkn DRAGON AGE and 1000xRESIST !?!
3) only games that EVER won were Hades & Baldur's Gate 3

Kitfox always punches above our weight, but still reeling from this one
aneeshsathe.com
The coolest bit (as much as I understand it) is that a nucleus-free ova is a niche big enough to be a stage for this genetic drama
joshlukedavis.com
woah this is genuinely, utterly WILD

Ant queens of one species produce males of another species, so she can then mate with them and produce hybrid workers!

This is so gloriously weird I can't quite compute it 🤯🧪🐜
www.nature.com/articles/d41...
‘Almost unimaginable’: these ants are different species but share a mother
Ant queens of one species clone ants of another to create hybrid workers that do their bidding.
www.nature.com