I mean. It was 10 years ago. Things were different 😇

The other possible X-Factor is that Drake showed he can learn from his mistake’s this year. It’s possible the farther he goes the better he’ll get at playoff football

Awesome. Done. My 13yo daughter loves fowl language and will be excited to read this.

Holy Hand Grenade?

This was my dad’s favorite cake (and hated it as a kid). I don’t think I’ve ever heard anyone talk about this outside of his bdays. Now I want to go find some, thanks for triggering some memories of him

If I say “Hi, how are ____” you are confidant of the next word. But if I say “This is ___” there are a lot of possibilities. LLMs have to choose the next word, then the next. Context does help improve the distribution of next words.

Researchers dive into transformers or training details, but that is the model and optimization, not the mechanism. They are just a simple next word predictor. The harder part is that they actually predict a distribution of possible next words, and they have to choose a word.

They are admittedly a lot more complex than that. They are a fixed parametric math model with some randomness. It would be more like giving a coin sorter a hundred different coins and tell it to predict the next coin. Then give it a Canadian quarter and force it to still predict.

If you care about the model and optimization details this is a barebones model: github.com/karpathy/nan...

The simplest explanation is they a nonlinear autoregressive model en.wikipedia.org/wiki/Autoreg...

Hard to find a good article that doesn’t get bogged down in technical details. LLMs are just a mathematical model to predict the next word based on a list of input words. Errors are due to random guessing when they are uncertain. Other details are just about the model and optimizing. Not intelligent

Wolfie!! Both my kids have that wolf. One of their favs.

I miss corn Taylor swift :)

It’s great for coaching soccer to 4th grade boys. “6-7 yards apart please!”

Not to mention they all forgot how to drive!

Wow. 2001 was the last time they were in the ALCS? I remember loving that team with Ichiro and Edgar Martinez.

Just finished a whole package this evening just now

Thanks Katie. Now Betelgeuse is back in my mind. Endlessly looking at brightness charts now 😂😂

I mean… you aren’t far from the truth. Its basic model is to just predict the next word in a sentence (not smart), and the question/answer datasets are mostly curated from AI bros.