Jacob Bamberger
@jacobbam.bsky.social
360 followers 140 following 11 posts
ML PhD student at University of Oxford. Interested in Geometric Deep Learning
Posts Media Videos Starter Packs
jacobbam.bsky.social
Presenting at poster session 4 east.
📅Wednesday, July 16th
🕓4:30-7:00 PM
📈#E-2802
jacobbam.bsky.social
🔑 Takeaways:
✅ Long-range can be formalized & measured
✅ Reveals new insights into models & datasets
🚀 Time to rethink evaluation: not just accuracy, but how models solve tasks
jacobbam.bsky.social
Why does this matter?

"Long-range" is often just a dataset intuition or model label.

We offer a measurable way to:
💡Understand models
🧪Test benchmarks
🦮Guide model design
🚀Go beyond performance gaps
jacobbam.bsky.social
We reassess LRGB, the go-to long-range benchmark, by checking if model range correlates with performance—expected for truly long-range tasks.

Surprisingly:
❌ Peptides-func: negative correlation, suggests not long-range
✅ VOC: positive correlation, suggests long-range
jacobbam.bsky.social
We validate our framework in three steps:

👷Construct synthetic tasks with analytically-known range
💯Show trained GNNs can approximate the true task range
🔬Use range as a proxy to evaluate real benchmarks
jacobbam.bsky.social
Our measure uses the model's Jacobian (for node tasks) and Hessian (for graph tasks) to quantify input-output influence, works with any distance metric, and supports analysis at all granularities—node, graph, and dataset.
jacobbam.bsky.social
We propose a formal range measure for any graph operator, derived from natural axioms (like locality, additivity, homogeneity) — and show it’s the unique measure satisfying these.

This measure applies to both node- and graph-level tasks, and across architectures.
jacobbam.bsky.social
"Long-range tasks" are a central yet vague challenge in graph learning.

What makes a task long-range? How can we tell if a model actually captures long-range interactions?
jacobbam.bsky.social
🚨 ICML 2025 Paper 🚨

"On Measuring Long-Range Interactions in Graph Neural Networks"

We formalize the long-range problem in GNNs:
💡Derive a principled range measure
🔧 Tools to assess models & benchmarks
🔬Critically assess LRGB

🧵 Thread below 👇
Reposted by Jacob Bamberger
ffabffrasca.bsky.social
🌟 GLOW is coming back in December with amazing speakers: Emily Jin and @joshsouthern.bsky.social !

🗓️ Dec 18th @ 17 CET on Zoom, don't miss that!

🌐 Find more here: sites.google.com/view/graph-l...
jacobbam.bsky.social
It’s a wrap! Thank you to everyone that joined LoG-ox, the Oxford local meet up for @logconference.bsky.social!