Mike Smith
@mjjsmith.com
AI researcher who likes self-supervised, unsupervised, and generative models
Was at Herts and aspiaspace.com, now at astroai.cfa.harvard.edu and @universetbd.org
Was at Herts and aspiaspace.com, now at astroai.cfa.harvard.edu and @universetbd.org
New AstroPT models are out 🔭🎉 This time trained with an improved DESI galaxy image dataset. Link here: huggingface.co/Smith42/astr...
Check out these new scaling curves!
We are still seeing improvement at 800M parameters where before we stalled at 100M. Maybe high quality data is all you need 🤔
Check out these new scaling curves!
We are still seeing improvement at 800M parameters where before we stalled at 100M. Maybe high quality data is all you need 🤔
June 2, 2025 at 6:56 PM
New AstroPT models are out 🔭🎉 This time trained with an improved DESI galaxy image dataset. Link here: huggingface.co/Smith42/astr...
Check out these new scaling curves!
We are still seeing improvement at 800M parameters where before we stalled at 100M. Maybe high quality data is all you need 🤔
Check out these new scaling curves!
We are still seeing improvement at 800M parameters where before we stalled at 100M. Maybe high quality data is all you need 🤔
me: i didn't know you were cool like that
val loss:
val loss:
February 6, 2025 at 10:32 AM
me: i didn't know you were cool like that
val loss:
val loss:
With r1 and o1, Yann Lecun's cake is now baked and ready
January 23, 2025 at 8:07 AM
With r1 and o1, Yann Lecun's cake is now baked and ready
first time spotting AI art in the wild
just look at that floating ship!
just look at that floating ship!
January 9, 2025 at 3:00 PM
first time spotting AI art in the wild
just look at that floating ship!
just look at that floating ship!
the nvidia digits case is so british-housing-core
January 8, 2025 at 2:14 PM
the nvidia digits case is so british-housing-core
new shoggoth just dropped 😤😤
December 15, 2024 at 1:16 PM
new shoggoth just dropped 😤😤
Brainstorming with Claude Sonnet 🥰
November 30, 2024 at 10:36 AM
Brainstorming with Claude Sonnet 🥰
Loss go brrr more to come 👀👀
November 27, 2024 at 12:05 PM
Loss go brrr more to come 👀👀
November 26, 2024 at 8:56 PM
Interesting read with a scary figure: www.imf.org/-/media/File...
November 22, 2024 at 10:51 AM
Interesting read with a scary figure: www.imf.org/-/media/File...
python getting existential on me
November 20, 2024 at 2:40 PM
python getting existential on me