@hanneshapke.bsky.social
Reposted
The post they are replying to was written on an MacBook Pro I upgraded to 64 GB of RAM specifically to be able to run 70B models
You can run Qwen3-Coder-30B on 32GB or RAM, and it's surprisingly capable at most coding tasks, even
You can run Qwen3-Coder-30B on 32GB or RAM, and it's surprisingly capable at most coding tasks, even
December 24, 2025 at 3:52 AM
The post they are replying to was written on an MacBook Pro I upgraded to 64 GB of RAM specifically to be able to run 70B models
You can run Qwen3-Coder-30B on 32GB or RAM, and it's surprisingly capable at most coding tasks, even
You can run Qwen3-Coder-30B on 32GB or RAM, and it's surprisingly capable at most coding tasks, even
@maxnum.bsky.social macht Mut. Hoffnung, keine Angst!
Wenn wir der extremen Rechten das Spielfeld überlassen, verlieren wir mehr als Wahlen. Wir verlieren Menschlichkeit. Politik bedeutet nicht, Angst zu machen - sondern Hoffnung zu geben. Das muss unser aller Ziel sein - von Grüne, Linke bis hin zur SPD!
December 21, 2025 at 3:32 AM
@maxnum.bsky.social macht Mut. Hoffnung, keine Angst!
Reposted
[YouTube] Mastering the JAX AI Stack
The Learning JAX video series is now live! 23 videos covering the entire JAX AI Stack to an intermediate/advanced level www.youtube.com/playlist?lis...
The Learning JAX video series is now live! 23 videos covering the entire JAX AI Stack to an intermediate/advanced level www.youtube.com/playlist?lis...
December 5, 2025 at 10:43 PM
[YouTube] Mastering the JAX AI Stack
The Learning JAX video series is now live! 23 videos covering the entire JAX AI Stack to an intermediate/advanced level www.youtube.com/playlist?lis...
The Learning JAX video series is now live! 23 videos covering the entire JAX AI Stack to an intermediate/advanced level www.youtube.com/playlist?lis...
Reposted
Humans really had the creative freedom to do anything and we chose racism and credit scores
September 7, 2025 at 5:46 AM
Humans really had the creative freedom to do anything and we chose racism and credit scores
Reposted
Reposted
TIL you can run an eval suite against OpenAI's gpt-oss-20b open weights model running in LM Studio with the following uv one-liner. Here's my full TIL: til.simonwillison.net/llms/gpt-oss...
![mkdir /tmp/aime25_openai
OPENAI_API_KEY=x \
uv run --python 3.13 --with 'gpt-oss[eval]' \
python -m gpt_oss.evals \
--base-url http://localhost:1234/v1 \
--eval aime25 \
--sampler chat_completions \
--model openai/gpt-oss-20b \
--reasoning-effort low \
--n-threads 2](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:kft6lu4trxowqmter2b6vg6z/bafkreib5inem3k2p7bv3sepg4w56r5a7vzsfcj6ilmvvvr6bgzrz6lu4wq@jpeg)
August 17, 2025 at 3:49 AM
TIL you can run an eval suite against OpenAI's gpt-oss-20b open weights model running in LM Studio with the following uv one-liner. Here's my full TIL: til.simonwillison.net/llms/gpt-oss...
Reposted
Fanny Mendelssohn (1805-1847)
composed more than 460 works, which were published under her lauded composer brother, Felix Mendelssohn's name #WomensArt
composed more than 460 works, which were published under her lauded composer brother, Felix Mendelssohn's name #WomensArt
August 15, 2025 at 2:51 AM
Fanny Mendelssohn (1805-1847)
composed more than 460 works, which were published under her lauded composer brother, Felix Mendelssohn's name #WomensArt
composed more than 460 works, which were published under her lauded composer brother, Felix Mendelssohn's name #WomensArt
I remember trying to deploy Llama1. Amazing how the ecosystem has changed!
⚡🤯
How fast is #gemma3 270M out of the box on a @raspberrypi.com 5? About 30 tok/s on CPU for the Q4_0 model using #ollama. Tried using #llamacpp, got about 32 tok/s. 🤯
Extremely promising for edge compute with no accelerator! Model is only ~250Mb on disk. Can't wait to fine-tune for my IoT projects 👨💻
Extremely promising for edge compute with no accelerator! Model is only ~250Mb on disk. Can't wait to fine-tune for my IoT projects 👨💻
August 15, 2025 at 6:21 AM
I remember trying to deploy Llama1. Amazing how the ecosystem has changed!
Reposted
Der öffentlich-rechtliche Rundfunk als Plattform für eine diverse und lebendige Zivilgesellschaft. Mein Plädoyer auf dem Monitor-Forum der re:publica. Mit Annika Brockschmidt, Constanze Kurz und Nadia Zaboura.
youtube.com/watch?v=C2_L...
youtube.com/watch?v=C2_L...
re:publica 25: MONITOR-Forum: Social Media regiert die Welt
YouTube video by re:publica
youtube.com
June 3, 2025 at 9:40 AM
Der öffentlich-rechtliche Rundfunk als Plattform für eine diverse und lebendige Zivilgesellschaft. Mein Plädoyer auf dem Monitor-Forum der re:publica. Mit Annika Brockschmidt, Constanze Kurz und Nadia Zaboura.
youtube.com/watch?v=C2_L...
youtube.com/watch?v=C2_L...
Reposted
Ausführlicher Rückblick auf die @re-publica.com bei ‹Breitband› im Deutschlandfunk Kultur: «Digitaler Faschismus und was dagegen hilft»
#rp25
www.deutschlandfunkkultur.de/re-publica-2...
#rp25
www.deutschlandfunkkultur.de/re-publica-2...
Republica 25: Netzgemeinde in Sorge um Demokratie
Republica 2025: Big Tech bedroht die Demokratie. Die Netzgemeinde diskutiert ernsthaft über digitalen Rassismus und sucht dringend nach Lösungen.
www.deutschlandfunkkultur.de
June 1, 2025 at 2:08 PM
Ausführlicher Rückblick auf die @re-publica.com bei ‹Breitband› im Deutschlandfunk Kultur: «Digitaler Faschismus und was dagegen hilft»
#rp25
www.deutschlandfunkkultur.de/re-publica-2...
#rp25
www.deutschlandfunkkultur.de/re-publica-2...
Reposted
BIG news for Gemma this week. Gemma 3n, MedGemma, and more. Watch Omar Sanseviero and I to learn what's new
Watch the full session →
youtu.be/o7Bv4r08FBM?...
Watch the full session →
youtu.be/o7Bv4r08FBM?...
What's new in the Gemmaverse
YouTube video by Google for Developers
youtu.be
May 24, 2025 at 12:57 PM
BIG news for Gemma this week. Gemma 3n, MedGemma, and more. Watch Omar Sanseviero and I to learn what's new
Watch the full session →
youtu.be/o7Bv4r08FBM?...
Watch the full session →
youtu.be/o7Bv4r08FBM?...
Reposted
I put together an annotated version of the new Claude 4 system prompt, covering both the prompt Anthropic published and the missing, leaked sections that describe its various tools
It's basically the secret missing manual for Claude 4, it's fascinating!
simonwillison.net/2025/May/25/...
It's basically the secret missing manual for Claude 4, it's fascinating!
simonwillison.net/2025/May/25/...
May 25, 2025 at 1:50 PM
I put together an annotated version of the new Claude 4 system prompt, covering both the prompt Anthropic published and the missing, leaked sections that describe its various tools
It's basically the secret missing manual for Claude 4, it's fascinating!
simonwillison.net/2025/May/25/...
It's basically the secret missing manual for Claude 4, it's fascinating!
simonwillison.net/2025/May/25/...
Today is a perfect math lesson: If you drop 10% and raise it by 10% again, you won't end up at the same value!
$100 * 90% = $90
$90 * 110% = $99
You see, $99 isn't $100.
Plain and simple. Don't get carried away by big gains!
$100 * 90% = $90
$90 * 110% = $99
You see, $99 isn't $100.
Plain and simple. Don't get carried away by big gains!
April 9, 2025 at 10:27 PM
Today is a perfect math lesson: If you drop 10% and raise it by 10% again, you won't end up at the same value!
$100 * 90% = $90
$90 * 110% = $99
You see, $99 isn't $100.
Plain and simple. Don't get carried away by big gains!
$100 * 90% = $90
$90 * 110% = $99
You see, $99 isn't $100.
Plain and simple. Don't get carried away by big gains!
Reposted
I needed to hear this. Maybe you do too.
“Fear has a way of being contagious… courage is also contagious.” — Kamala Harris
Man, I miss her.
“Fear has a way of being contagious… courage is also contagious.” — Kamala Harris
Man, I miss her.
April 4, 2025 at 12:45 AM
I needed to hear this. Maybe you do too.
“Fear has a way of being contagious… courage is also contagious.” — Kamala Harris
Man, I miss her.
“Fear has a way of being contagious… courage is also contagious.” — Kamala Harris
Man, I miss her.
I am excited to share my blog post about speculative decoding using vLLM and Google's Gemma. Big thanks to the GDE program for the Colab credits!
www.hanneshapke.com/speculative-...
www.hanneshapke.com/speculative-...
Speculative Decoding with vLLM using Gemma – Hannes
Improving LLM inferences with speculative decoding using Gemma
www.hanneshapke.com
March 1, 2025 at 5:21 PM
I am excited to share my blog post about speculative decoding using vLLM and Google's Gemma. Big thanks to the GDE program for the Colab credits!
www.hanneshapke.com/speculative-...
www.hanneshapke.com/speculative-...
Reposted
Andrej discusses the evolution of self-driving cars, comparing Tesla's and Waymo’s approaches, and the challenges ahead. They also cover Tesla’s humanoid robot, the bottlenecks of AI development today, and how AI capabilities could be further integrated with human cognition. #AI #selfdriving #tesla
No Priors Ep. 80 | With Andrej Karpathy from OpenAI and Tesla
YouTube video by No Priors: AI, Machine Learning, Tech, & Startups
www.youtube.com
December 30, 2024 at 3:06 PM
Andrej discusses the evolution of self-driving cars, comparing Tesla's and Waymo’s approaches, and the challenges ahead. They also cover Tesla’s humanoid robot, the bottlenecks of AI development today, and how AI capabilities could be further integrated with human cognition. #AI #selfdriving #tesla
Bench.co closed abruptly this morning. If you were using bench, check out digits.com
news.ycombinator.com/item?id=4252...
news.ycombinator.com/item?id=4252...
Bench
Bench.co
December 27, 2024 at 7:44 PM
Bench.co closed abruptly this morning. If you were using bench, check out digits.com
news.ycombinator.com/item?id=4252...
news.ycombinator.com/item?id=4252...
Reposted
🔥🔥A 2021 study found that Medicaid expansion as part of the ACA led to a substantial reduction in mortality, primarily driven by reductions in disease-related deaths. A 2018 study in the Journal of Political Economy found that, Medicaid reduced infant and child mortality since the 1960s and 1970s.🔥🔥
December 27, 2024 at 5:01 PM
🔥🔥A 2021 study found that Medicaid expansion as part of the ACA led to a substantial reduction in mortality, primarily driven by reductions in disease-related deaths. A 2018 study in the Journal of Political Economy found that, Medicaid reduced infant and child mortality since the 1960s and 1970s.🔥🔥
Reposted
🚀 Struggling to keep up with new RAG variants? Here’s a cheat sheet of 7 of the most popular RAG architectures by Weaviate
December 26, 2024 at 2:41 AM
🚀 Struggling to keep up with new RAG variants? Here’s a cheat sheet of 7 of the most popular RAG architectures by Weaviate
Reposted
Ilya Sutskever NeurIPS talk [video] Discussion
Ilya Sutskever NeurIPS 2024 full talk
www.youtube.com
December 14, 2024 at 2:20 PM
Ilya Sutskever NeurIPS talk [video] Discussion
Reposted
The price decline in LLMs is even faster than that of compute cost during the PC revolution or bandwidth during the dotcom boom: For an LLM of equivalent performance, the cost is decreasing by 10x every year. #ML #AI #LLM #OpenAI
Welcome to LLMflation - LLM inference cost is going down fast ⬇️ | Andreessen Horowitz
For LLM of equivalent performance, the inference cost is decreasing by 10x every year. What cost $60/million tokens in 2021 costs $.06/million tokens today.
a16z.com
November 15, 2024 at 12:57 PM