banner
adrianhill.de
Adrian Hill
@adrianhill.de
670 followers 510 following 79 posts
PhD student at @bifold.berlin, Machine Learning Group, TU Berlin. Automatic Differentiation, Explainable AI and #JuliaLang. Open source person: adrianhill.de/projects
Posts Media Videos Starter Packs
Pinned
adrianhill.de
Adrian Hill @adrianhill.de · Jan 30
You think Jacobian and Hessian matrices are prohibitively expensive to compute on your problem? Our latest preprint with @gdalle.bsky.social might change your mind!
arxiv.org/abs/2501.17737
🧵1/8
Figure comparing automatic differentiation (AD) and automatic sparse differentiation (ASD). (a) Given a function f, AD backends return a function computing vector-Jacobian products (VJPs). (b) Standard AD computes Jacobians row-by-row by evaluating VJPs with all standard basis vectors. (c) ASD reduces the number of VJP evaluations by first detecting a sparsity pattern of non-zero values, coloring orthogonal rows in the pattern and simultaneously evaluating VJPs of orthogonal rows. The concepts shown in this figure directly translate to forward-mode, which computes Jacobians column-by-column instead of row-by-row.
5 29 140
adrianhill.de
Adrian Hill @adrianhill.de · 8d
It was a pleasure to work with the fantastic @gdalle.bsky.social on this! :)
5
adrianhill.de
Adrian Hill @adrianhill.de · 8d
Perfect timing! If you are in Paris for @juliacon.bsky.social on Friday, join us for our talk on Automatic Sparse Differentiation at 11:30.

If you can't make it, check out both the paper and our introductory ICLR blog post: iclr-blogposts.github.io/2025/blog/sp...
1 2 10
adrianhill.de
Adrian Hill @adrianhill.de · 16d
That's awesome. Maybe we should just set one up?
3
adrianhill.de
Adrian Hill @adrianhill.de · 16d
Fair enough. You're probably right about the language bias affecting me.
adrianhill.de
Adrian Hill @adrianhill.de · 16d
Wouldn't Anthropic-scale inference pipelines also fall outside of the usual {Python plotting script} and {JS web app} training data?
1
adrianhill.de
Adrian Hill @adrianhill.de · 16d
Fantastic!
1
adrianhill.de
Adrian Hill @adrianhill.de · 16d
They scooped my boy 😭
1 1
adrianhill.de
Adrian Hill @adrianhill.de · 16d
I fully expect you to make the world's most niche song about it.
1 1
adrianhill.de
Adrian Hill @adrianhill.de · 16d
Based on my own mediocre experiences with LLM-assisted coding, I can't help but wonder whether this explains the recent engineering issues Anthrophic was facing.
gergely.pragmaticengineer.com
Gergely Orosz @gergely.pragmaticengineer.com · 19d
Talked with the Claude Code team on how they build Claude Code. It feels I get a peek into the future, and I get why Dario said 6 months ago that 90% of code will be written by AI.

This team works SO differently than any eng team I saw. Will share in-depth soon. One example:
3
adrianhill.de
Adrian Hill @adrianhill.de · 18d
I feel like this guy might have made a sticker about pip in the past
1 3
adrianhill.de
Adrian Hill @adrianhill.de · 19d
This also shows that @typst.app is already a viable alternative to LaTeX for top conferences in ML!
adrianhill.de
Adrian Hill @adrianhill.de · 19d
Our paper on XAI + Automatic Differentiation got accepted at #NeurIPS2025. Can't wait to share the camera-ready soon! 🥳
3 5 38
adrianhill.de
Adrian Hill @adrianhill.de · 19d
Our paper on XAI + Automatic Differentiation got accepted at #NeurIPS2025. Can't wait to share the camera-ready soon! 🥳
1 11
adrianhill.de
Adrian Hill @adrianhill.de · 20d
I guess we’ll have to wait for Python 3.141
1
adrianhill.de
Adrian Hill @adrianhill.de · 22d
Doing XAI research in #JuliaLang
A depressed and jaded Sisyphus pushing a boulder with the Python logo up a mild incline. A happy and fulfilled Sisyphus pushing a boulder with the Julia logo up a steep incline.
10
adrianhill.de
Adrian Hill @adrianhill.de · Sep 3
This is 100% true, including the H100 being 12.3 km away.
ericbrachmann.bsky.social
Eric Brachmann @ericbrachmann.bsky.social · Sep 3
Did you know in Germany, there are signs in every city indicating the way to the closest H100, in case of an upcoming deadline?
1 8
adrianhill.de
Adrian Hill @adrianhill.de · Aug 27
LinkedIn is another option, but I still need to warm up to that thought. 😬
1
adrianhill.de
Adrian Hill @adrianhill.de · Aug 27
As a side note, I'm really enjoying my BlueSky feed recently, so this is just about reaching more people.
1 1
adrianhill.de
Adrian Hill @adrianhill.de · Aug 27
Is anyone cross-posting on both Bsky and Mastodon? Is it worth the effort? If so, are there tools you would recommend?
1 1 2
adrianhill.de
Adrian Hill @adrianhill.de · Aug 25
Just noticed my "Julia for Machine Learning" course got 2^8 stars on GitHub, yay! 🎉
github.com/adrhill/juli...
GitHub - adrhill/julia-ml-course: Julia Programming for Machine Learning course at TU Berlin
Julia Programming for Machine Learning course at TU Berlin - adrhill/julia-ml-course
github.com
4 27
Reposted by Adrian Hill
simi.bsky.social
Simon Danisch @simi.bsky.social · Aug 7
I’m happy to announce BonitoBook, a Jupyter alternative with a focus on plotting, customizability, dashboards and AI integration.

Visit the website to learn more:

bonitobook.org

Or the repository:

github.com/SimonDanisch...
2 18
adrianhill.de
Adrian Hill @adrianhill.de · Aug 1
These look like a reproduction of Murakami's cherries!
Takashi Murakami - 20th Century & Contemporary Art Evening Sale Hong Kong Saturday, November 23, 2019 | Phillips
View Cherries by Takashi Murakami, sold at 20th Century & Contemporary Art Evening Sale on Hong Kong Auction 24 November 2019. Learn more about the piece and artist, and its final selling price.
www.phillips.com
1 1
adrianhill.de
Adrian Hill @adrianhill.de · Jul 31
🤙🤙
An Ominum Mini Cargo Bike with a sticker-bombed mudguard.
2 1 2
adrianhill.de
Adrian Hill @adrianhill.de · Jul 31
The cute Dispatch sticker! 😍 @movraxrax.bsky.social
1 1 2
adrianhill.de
Adrian Hill @adrianhill.de · Jul 28
Jokes aside, you probably don't want to use this for NeurIPS:

"For authors, please refrain from submitting images in your rebuttal with any “tricks” (such as encoding your image in base64). We will allow reviewers/ACs/SACs to disregard those (and even decrease their scores because of those)"
adrianhill.de
Adrian Hill @adrianhill.de · Jul 28
The perfect use case for UnicodePlots.jl!
github.com/JuliaPlots/U...
A variety of plots drawn with unicode characters, as rendered by the "UnicodePlots.jl" package. Includes line-, scatter–, contour- and box-plots, histograms and heatmaps among others.
3 8