Ragavan Thurairatnam 🛸 NeurlPS
@ragavan.bsky.social
Deep learning since 2012. Leading a new AI lab at Jack Dorsey's Block
Although @karpathy.bsky.social and Jurgen are right the REAL EARLIEST form of multiheaded self attention was first used in the early neolithic period by heating bones and looking where the cracks formed. The number of cracks as the heads and the something something farming
December 7, 2024 at 2:50 AM
Although @karpathy.bsky.social and Jurgen are right the REAL EARLIEST form of multiheaded self attention was first used in the early neolithic period by heating bones and looking where the cracks formed. The number of cracks as the heads and the something something farming