Igor Carron
banner
igorcarron.bsky.social
Igor Carron
@igorcarron.bsky.social
LightOn, President
GenAI for enterprise, LLMs
Former Nuclear and Rocket Scientist
Nuit Blanche writer (Compressive Sensing, Matrix Factorizations to DL). Paris Machine Learning meetup cofounder
Reposted by Igor Carron
ModernBERT-embed-large is released under Apache 2.0 and is available on Hugging Face:
huggingface.co/lightonai/mo...

Congrats to @nohtow.bsky.social for this great work!
lightonai/modernbert-embed-large · Hugging Face
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
huggingface.co
January 14, 2025 at 4:42 PM
thanks. I'll remove my comment.
December 28, 2024 at 8:22 PM
Reposted by Igor Carron
Blog post: huggingface.co/blog/modernb...
Paper link: arxiv.org/abs/2412.13663

With @lightonai.bsky.social folks, we collaborated with @answerai.bsky.social (and friends!) to leverage the advances from recent years of work on LLMs (architecture and training) and apply them to a BERT-style model
Finally, a Replacement for BERT: Introducing ModernBERT
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
huggingface.co
December 19, 2024 at 5:36 PM
December 28, 2024 at 7:59 PM
on saturday morning?
December 22, 2024 at 6:15 PM
what was the Minsky slide about?
December 17, 2024 at 1:19 AM