stochasm
banner
stochasticchasm.bsky.social
stochasm
@stochasticchasm.bsky.social
aspiring independent researcher exploring the loss landscape • 24 • interested in reasoning, creativity, intelligence
stochasm.blog
With some sort of scaling graph too! Wish they were more clear about what the x-axis represents
November 27, 2024 at 7:54 PM
Just a heads-up, link seems to be 404ing
November 25, 2024 at 4:39 PM
In my opinion you should be able to recreate this graph if you claim to have released a model trained like o1
November 23, 2024 at 7:19 PM
Standard reasons, I’d imagine. Release model and code so that the community can improve the models and techniques, contribute to research, etc.
another interesting thing to note — they swap to majority voting in their scaling graph after a bit, so their test-time scaling isn’t perfect
November 21, 2024 at 9:46 PM
They’ve stated that they plan to open-source this one as well!
November 21, 2024 at 9:42 PM
I’ll post my first blog post as my first post on this app. Hope you enjoy the read: stochasm.blog/posts/scalin...
November 19, 2024 at 6:00 AM