torchristensen.bsky.social
@torchristensen.bsky.social
Reposted
Most of the talk around AI and energy use refer to an older 2020 estimate of GPT-3 energy consumption, but a more recent paper directly measures energy use of Llama 65B as 3-4 joules per decoded token.

So an hour of streaming Netflix is equivalent to 70-90,000 65B tokens. arxiv.org/pdf/2310.03003
January 13, 2025 at 2:43 AM
Is Slack still a thing or did everyone switch to Bluesky? Or am Injust missing out?
January 16, 2025 at 7:56 AM
Sometimes old problems requires new solutions.
December 7, 2024 at 1:13 PM