Robert Knight
@robertknight2.bsky.social
Frontend Developer. Machine learning in Rust. https://github.com/robertknight.
RTen v0.24 has been released. This adds support for int4 blockwise quantization, new LLM examples, optimization diagnostics and a new symbolic shape inference system which enables more complex graph optimizations (for attention fusions etc.) - github.com/robertknight...
github.com
December 23, 2025 at 3:08 PM
RTen v0.24 has been released. This adds support for int4 blockwise quantization, new LLM examples, optimization diagnostics and a new symbolic shape inference system which enables more complex graph optimizations (for attention fusions etc.) - github.com/robertknight...
NVIDIA are experimenting with a safe Rust interface to CUDA Tile - www.youtube.com/watch?v=_b4I... (See 1:18:03). The whole presentation is worth a watch, especially around the balancing act of portability vs. predictable performance.
December 21, 2025 at 8:40 AM
NVIDIA are experimenting with a safe Rust interface to CUDA Tile - www.youtube.com/watch?v=_b4I... (See 1:18:03). The whole presentation is worth a watch, especially around the balancing act of portability vs. predictable performance.
Reposted by Robert Knight
First time seeing this and it is really great! abseil.io/fast/hints.h...
abseil / Performance Hints
An open-source collection of core C++ library code
abseil.io
December 20, 2025 at 3:04 AM
First time seeing this and it is really great! abseil.io/fast/hints.h...
Reposted by Robert Knight
My "No Graphics API" blog post is live! Please repost :)
www.sebastianaaltonen.com/blog/no-grap...
I spend 1.5 years doing this. Full rewrite last summer and another partial rewrite last month. As Hemingway said: "First draft of everything is always shit".
www.sebastianaaltonen.com/blog/no-grap...
I spend 1.5 years doing this. Full rewrite last summer and another partial rewrite last month. As Hemingway said: "First draft of everything is always shit".
No Graphics API — Sebastian Aaltonen
Graphics APIs and shader languages have significantly increased in complexity over the past decade. It’s time to start discussing how to strip down the abstractions to simplify development, improve pe...
www.sebastianaaltonen.com
December 16, 2025 at 6:52 PM
My "No Graphics API" blog post is live! Please repost :)
www.sebastianaaltonen.com/blog/no-grap...
I spend 1.5 years doing this. Full rewrite last summer and another partial rewrite last month. As Hemingway said: "First draft of everything is always shit".
www.sebastianaaltonen.com/blog/no-grap...
I spend 1.5 years doing this. Full rewrite last summer and another partial rewrite last month. As Hemingway said: "First draft of everything is always shit".
One of the marquee features for the next release of RTen is built-in symbolic shape and type inference for ONNX graphs, which will make more complex optimizations possible - github.com/robertknight....
Add built-in shape and type inference by robertknight · Pull Request #1124 · robertknight/rten
Add a built-in system to infer the shapes and types of operator outputs. When
enabled, this runs before graph optimizations. This generates metadata that can
be used by the optimizer to verify that...
github.com
December 13, 2025 at 12:39 PM
One of the marquee features for the next release of RTen is built-in symbolic shape and type inference for ONNX graphs, which will make more complex optimizations possible - github.com/robertknight....
A convenient link to respond with when someone spams a community with a "vibeware" project: stopslopware.net. Credit: www.reddit.com/r/rust/comme...
Stop Slopware
stopslopware.net
December 7, 2025 at 1:04 PM
A convenient link to respond with when someone spams a community with a "vibeware" project: stopslopware.net. Credit: www.reddit.com/r/rust/comme...
I created a feedback issue asking what people are using Ocrs for - github.com/robertknight.... I was originally expecting it would mostly be document scans and photos, but a lot of usage seems to be related to parsing screenshots.
What are you using Ocrs for? · Issue #211 · robertknight/ocrs
If you are using Ocrs or tried to use it but chose an alternative, please comment briefly below about your use case. In particular I'm interested in what kinds of images (screenshots? photos? scans...
github.com
December 3, 2025 at 5:23 PM
I created a feedback issue asking what people are using Ocrs for - github.com/robertknight.... I was originally expecting it would mostly be document scans and photos, but a lot of usage seems to be related to parsing screenshots.
Reposted by Robert Knight
I always feel bad for people who spend a ton of time on a pull request that the project doesn’t want. You can avoid wasting a lot of time by first opening an issue describing what you’re thinking of doing to get feedback before you start coding.
December 2, 2025 at 3:54 PM
I always feel bad for people who spend a ton of time on a pull request that the project doesn’t want. You can avoid wasting a lot of time by first opening an issue describing what you’re thinking of doing to get feedback before you start coding.
I was trying to explain what I'm working on to a relative. I resorted to my favorite XKCD comic - xkcd.com/1838/.
Machine Learning
xkcd.com
November 27, 2025 at 8:55 AM
I was trying to explain what I'm working on to a relative. I resorted to my favorite XKCD comic - xkcd.com/1838/.
I think my favorite use of Claude is just being able to type "fix the merge conflicts" and letting it deal with them.
November 25, 2025 at 7:01 AM
I think my favorite use of Claude is just being able to type "fix the merge conflicts" and letting it deal with them.
Today's edition of malware on npm involves the official PostHog JS packages: news.ycombinator.com/item?id=4603...
Malware in PostHog NPM packages | Hacker News
news.ycombinator.com
November 24, 2025 at 9:11 AM
Today's edition of malware on npm involves the official PostHog JS packages: news.ycombinator.com/item?id=4603...
Don't ask a woman her age, a man his salary, or an ML engineer how his kernel handles NaNs and infinities.
November 22, 2025 at 9:36 AM
Don't ask a woman her age, a man his salary, or an ML engineer how his kernel handles NaNs and infinities.
"Translate from Gen Z to millenial" has been an unexpected use case I've had for AI.
November 18, 2025 at 10:30 AM
"Translate from Gen Z to millenial" has been an unexpected use case I've had for AI.
I created a proof-of-concept showing how to convert ML inference in Google's Magika file type detector from C++ (via ONNX Runtime) to Rust using RTen - github.com/google/magik...
Comparing google:main...robertknight:rten · google/magika
Fast and accurate AI powered file content types detection - Comparing google:main...robertknight:rten · google/magika
github.com
November 10, 2025 at 10:19 PM
I created a proof-of-concept showing how to convert ML inference in Google's Magika file type detector from C++ (via ONNX Runtime) to Rust using RTen - github.com/google/magik...
I'm working on getting Q4-quantized Llama 3 working at reasonable speed in RTen (ie. competitive with llama.cpp and ONNX Runtime on x86/Arm). Given the pace of change I'm tempted to describe this as retro computing in the release changelog.
November 7, 2025 at 12:42 PM
I'm working on getting Q4-quantized Llama 3 working at reasonable speed in RTen (ie. competitive with llama.cpp and ONNX Runtime on x86/Arm). Given the pace of change I'm tempted to describe this as retro computing in the release changelog.
Does the "Show fewer shorts" button on YouTube actually do anything or is it like the "push to wait" button at pedestrian crossings?
November 3, 2025 at 7:12 PM
Does the "Show fewer shorts" button on YouTube actually do anything or is it like the "push to wait" button at pedestrian crossings?
Reposted by Robert Knight
Your (or your employer's) financial support for the PSF would be very much appreciated this year! (And every other year too) bsky.app/profile/pyth...
In the end, it wasn’t a hard decision for the PSF to put our community and our values first, but it does mean we lost out on this large funding source. Donations and sponsorships will help us fill the gap, so we can continue supporting the Python ecosystem and living our values.
October 27, 2025 at 8:38 PM
Your (or your employer's) financial support for the PSF would be very much appreciated this year! (And every other year too) bsky.app/profile/pyth...
Reposted by Robert Knight
recently discovered that wikipedia volunteers have a hilariously high bar for what constitutes "unusual death"
October 27, 2025 at 12:38 PM
recently discovered that wikipedia volunteers have a hilariously high bar for what constitutes "unusual death"
Reposted by Robert Knight
I currently have availability for Rust coaching, adoption, or development; from a single call to ongoing 3 days/week. I can help your team get things done, adopt Rust and use it more effectively, or to accurately evaluate Rust as a new technology.
October 23, 2025 at 7:06 PM
I currently have availability for Rust coaching, adoption, or development; from a single call to ongoing 3 days/week. I can help your team get things done, adopt Rust and use it more effectively, or to accurately evaluate Rust as a new technology.
Reposted by Robert Knight
As an experiment, we (the Firefox team) wanted to try a new way to get feedback on which Interop proposals matter most.
So, here's a web app where you can rank the proposals you care about, giving us data we can use when reviewing which ones to champion.
interop-rank.jakearchibald.com
So, here's a web app where you can rank the proposals you care about, giving us data we can use when reviewing which ones to champion.
interop-rank.jakearchibald.com
Interop Feature Ranking
Rank the web platform features you care most about
interop-rank.jakearchibald.com
October 9, 2025 at 5:00 PM
As an experiment, we (the Firefox team) wanted to try a new way to get feedback on which Interop proposals matter most.
So, here's a web app where you can rank the proposals you care about, giving us data we can use when reviewing which ones to champion.
interop-rank.jakearchibald.com
So, here's a web app where you can rank the proposals you care about, giving us data we can use when reviewing which ones to champion.
interop-rank.jakearchibald.com
RTen v0.23 has been released! (github.com/robertknight...) The big new thing is that it can load ONNX models directly without requiring conversion to the custom `.rten` format. This makes it easier to switch between RTen and another machine learning runtime, or use it alongside another runtime.
github.com
October 16, 2025 at 6:53 AM
RTen v0.23 has been released! (github.com/robertknight...) The big new thing is that it can load ONNX models directly without requiring conversion to the custom `.rten` format. This makes it easier to switch between RTen and another machine learning runtime, or use it alongside another runtime.
Reposted by Robert Knight
Does widespread browser implementation of the Sec-Fetch-Site HTTP header mean we can protect against CSRF attacks without needing those hidden form tokens? It looks like the answer may be a cautious "yes"! simonwillison.net/2025/Oct/15/...
A modern approach to preventing CSRF in Go
Alex Edwards writes about the new http.CrossOriginProtection middleware that was added to the Go standard library in version 1.25 in August and asks: Have we finally reached the point where …
simonwillison.net
October 15, 2025 at 5:07 AM
Does widespread browser implementation of the Sec-Fetch-Site HTTP header mean we can protect against CSRF attacks without needing those hidden form tokens? It looks like the answer may be a cautious "yes"! simonwillison.net/2025/Oct/15/...
Reposted by Robert Knight
We’re hiring for two machine learning roles. A chance to do cutting edge things with ML to make this place a lot more personalized.
jobs.gem.com/bluesky/am9i...
jobs.gem.com/bluesky/am9i...
Bluesky Jobs
Bluesky Jobs
jobs.gem.com
October 1, 2025 at 1:14 AM
We’re hiring for two machine learning roles. A chance to do cutting edge things with ML to make this place a lot more personalized.
jobs.gem.com/bluesky/am9i...
jobs.gem.com/bluesky/am9i...
Reposted by Robert Knight
The crates.io team was notified of two malicious crates (with similar names as legitimate crates) which were actively searching file contents for Etherum private keys, Solana private keys, and arbitrary byte arrays for exfiltration.
See the blog post for details: blog.rust-lang.org/2025/09/24/c...
See the blog post for details: blog.rust-lang.org/2025/09/24/c...
crates.io: Malicious crates faster_log and async_println | Rust Blog
Empowering everyone to build reliable and efficient software.
blog.rust-lang.org
September 24, 2025 at 8:52 PM
The crates.io team was notified of two malicious crates (with similar names as legitimate crates) which were actively searching file contents for Etherum private keys, Solana private keys, and arbitrary byte arrays for exfiltration.
See the blog post for details: blog.rust-lang.org/2025/09/24/c...
See the blog post for details: blog.rust-lang.org/2025/09/24/c...