Aaron Swaving
@aaronds.bsky.social
Head of Data Science at SkillLab | Principal Data Scientist | Interested in applying AI for the good of society
Reposted by Aaron Swaving
Years of constant AI hype + deliberate use of the umbrella term AI to refer to wholly unrelated applications such as text generation and values-based decision making (the main point of "AI Snake Oil") has confused the public enough that replacing civil servants with AI seems at least plausible. 1/2
February 11, 2025 at 5:13 PM
Years of constant AI hype + deliberate use of the umbrella term AI to refer to wholly unrelated applications such as text generation and values-based decision making (the main point of "AI Snake Oil") has confused the public enough that replacing civil servants with AI seems at least plausible. 1/2
Reposted by Aaron Swaving
📢CFP ComDem #ECREA conference "Automating Democracy: #AI Use Between #SocialJustice & Social Control"
📍Erasmus uni Rotterdam
📅22-23 May
⏳Deadline Jan 15
Guest speakers: @snatale.bsky.social & @mbusuioc.bsky.social
Discount registration fees available for PhDs & students!
tinyurl.com/5k3exu3d
📍Erasmus uni Rotterdam
📅22-23 May
⏳Deadline Jan 15
Guest speakers: @snatale.bsky.social & @mbusuioc.bsky.social
Discount registration fees available for PhDs & students!
tinyurl.com/5k3exu3d
Automating Democracy: AI Use Between Social Justice and Social Control
tinyurl.com
December 19, 2024 at 12:46 PM
📢CFP ComDem #ECREA conference "Automating Democracy: #AI Use Between #SocialJustice & Social Control"
📍Erasmus uni Rotterdam
📅22-23 May
⏳Deadline Jan 15
Guest speakers: @snatale.bsky.social & @mbusuioc.bsky.social
Discount registration fees available for PhDs & students!
tinyurl.com/5k3exu3d
📍Erasmus uni Rotterdam
📅22-23 May
⏳Deadline Jan 15
Guest speakers: @snatale.bsky.social & @mbusuioc.bsky.social
Discount registration fees available for PhDs & students!
tinyurl.com/5k3exu3d
Reposted by Aaron Swaving
I'll get straight to the point.
We trained 2 new models. Like BERT, but modern. ModernBERT.
Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, etc. Real practical stuff.
It's much faster, more accurate, longer context, and more useful. 🧵
We trained 2 new models. Like BERT, but modern. ModernBERT.
Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, etc. Real practical stuff.
It's much faster, more accurate, longer context, and more useful. 🧵
December 19, 2024 at 4:45 PM
I'll get straight to the point.
We trained 2 new models. Like BERT, but modern. ModernBERT.
Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, etc. Real practical stuff.
It's much faster, more accurate, longer context, and more useful. 🧵
We trained 2 new models. Like BERT, but modern. ModernBERT.
Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, etc. Real practical stuff.
It's much faster, more accurate, longer context, and more useful. 🧵
Reposted by Aaron Swaving
Now that "scale is all we need" has predictably faltered...
1. Small AI models often perform better in context.
2. Obsession w bigness has bad consequences, from climate, to power concentration, to research capture.
Me + @gaelvaroquaux.bsky.social @sashamtl.bsky.social
arxiv.org/abs/2409.14160
1. Small AI models often perform better in context.
2. Obsession w bigness has bad consequences, from climate, to power concentration, to research capture.
Me + @gaelvaroquaux.bsky.social @sashamtl.bsky.social
arxiv.org/abs/2409.14160
Hype, Sustainability, and the Price of the Bigger-is-Better Paradigm in AI
With the growing attention and investment in recent AI approaches such as large language models, the narrative that the larger the AI system the more valuable, powerful and interesting it is is increa...
arxiv.org
November 17, 2024 at 11:16 AM
Now that "scale is all we need" has predictably faltered...
1. Small AI models often perform better in context.
2. Obsession w bigness has bad consequences, from climate, to power concentration, to research capture.
Me + @gaelvaroquaux.bsky.social @sashamtl.bsky.social
arxiv.org/abs/2409.14160
1. Small AI models often perform better in context.
2. Obsession w bigness has bad consequences, from climate, to power concentration, to research capture.
Me + @gaelvaroquaux.bsky.social @sashamtl.bsky.social
arxiv.org/abs/2409.14160