Mark Jeffrey
banner
markjeffrey.bsky.social
Mark Jeffrey
@markjeffrey.bsky.social
Investoor, Authoor, Podcastoor
That's it, I'm out of here.

You can find me on Orange Sky.
December 2, 2024 at 7:21 AM
Agreed. It's weird.
The absence of verified profiles makes this almost unusable
November 22, 2024 at 6:42 AM
SUPER fascinating -- and something I've wondered about.

HOW is 'reasoning' baked into LLM's? If they're just performing a thousand million microplagiarisms based on mining sentience exhaust, then we shouldn't see active generalized reasoning.

But we do. Why???
How do LLMs learn to reason from data? Are they ~retrieving the answers from parametric knowledge🦜? In our new preprint, we look at the pretraining data and find evidence against this:

Procedural knowledge in pretraining drives LLM reasoning ⚙️🔢

🧵⬇️
November 21, 2024 at 9:26 PM
Oh nothing just a SKULL STARING AT US ALL RIGHT NOW floating in space.
The skull nebula
Image credit:- NASA Hubble.
November 21, 2024 at 9:21 PM
Hash Rate 080: Erik Voorhees on Venice.ai : uncensored, private, unstoppable AI.

youtu.be/MqktbYE9UyA?...
Hash Rate - Ep 080 - VeniceAI with Erik Voorhees
YouTube video by Hash Rate pod - Bitcoin, AI, DePIN, DeFi
youtu.be
November 20, 2024 at 6:58 AM