Lightnews — Scholar-powered news

Christoph Molnar @christophmolnar.bsky.social · Jul 8

Using feature importance to interpret your models?

This paper might be of interest to you. Papers by @gunnark.bsky.social are always worth checking out.

Gunnar König @gunnark.bsky.social · Jul 7

In many XAI applications, it is crucial to determine whether features contribute individually or only when combined. However, existing methods fail to reveal cooperations since they entangle individual contributions with those made via interactions and dependencies. We show how to disentangle them!

3 11

Christoph Molnar @christophmolnar.bsky.social · Apr 8

Read more in my latest blog post: mindfulmodeler.substack.com/p/whos-reall...

Who’s Really Making the Decisions?

LLMs, tariffs, and the silent takeover of decisions

mindfulmodeler.substack.com

1

Christoph Molnar @christophmolnar.bsky.social · Apr 8

My stock portfolio is deep in the red, and tariffs by the Trump admin might be the cause. Could an LLM have been used to calculate them? It made me rethink how LLMs shape decisions, from big global-economy-wrecking ones to everyday decisions.

Who’s Really Making the Decisions?

LLMs, tariffs, and the silent takeover of decisions

mindfulmodeler.substack.com

1 3 8

Christoph Molnar @christophmolnar.bsky.social · Apr 1

SHAP interpretations depend on background data — change the data, change the explanation. A critical but often overlooked issue in model interpretability.

Read more:

SHAP Interpretations Depend on Background Data — Here’s Why

Or why height doesn't matter in the NBA

mindfulmodeler.substack.com

2 13

Christoph Molnar @christophmolnar.bsky.social · Mar 28

🎧 Listen here: www.buzzsprout.com/2186686/epis...

Part 2 drops soon—stay tuned!

Supervised machine learning for science with Christoph Molnar and Timo Freiesleben, Part 1 - The AI Fundamentalists

Machine learning is transforming scientific research across disciplines, but many scientists remain skeptical about using approaches that focus on prediction over causal understanding. That’s why...

www.buzzsprout.com

1 4

Christoph Molnar @christophmolnar.bsky.social · Mar 28

I recently joined The AI Fundamentalists with my co-author Timo Freiesleben to discuss our book Supervised Machine Learning for Science. We explored how scientists can leverage ML while maintaining rigor and embedding domain knowledge.

Supervised machine learning for science with Christoph Molnar and Timo Freiesleben, Part 1 - The AI Fundamentalists

Machine learning is transforming scientific research across disciplines, but many scientists remain skeptical about using approaches that focus on prediction over causal understanding. That’s why...

www.buzzsprout.com

1 1 12

Christoph Molnar @christophmolnar.bsky.social · Mar 13

The 3rd edition of Interpretable Machine Learning is out! 🎉 Major cleanup, better examples, and new chapters on Data & Models, Interpretability Goals, Ceteris Paribus, and LOFO Importance.

The book remains free to read for everyone. But you can also buy ebook or paperback.

4 16

Christoph Molnar @christophmolnar.bsky.social · Mar 12

Has anyone seen Counterfactual Explanations for machine learning models somewhere in the wild?

They are often discussed in research papers, but I have yet to see them being used somewhere in an actual process or product.

1 2 11

Christoph Molnar @christophmolnar.bsky.social · Mar 12

I've found the Quarto documentation to be really good, especially the search: quarto.org

Quarto

An open source technical publishing system for creating beautiful articles, websites, blogs, books, slides, and more. Supports Python, R, Julia, and JavaScript.

quarto.org

1 1 1

Christoph Molnar @christophmolnar.bsky.social · Mar 12

It's still hard to predict for me when it fails. For example, told it to simply check for placements of citations in a markdown file, which should be doable with a regex. And Claude failed. But a similar task worked out the other day.

1 2

Christoph Molnar @christophmolnar.bsky.social · Mar 12

Trying Claude Code for some tasks. Paradoxically, it's most expensive when it doesn't work because it fails, then tries a couple of times again, burning through tokens.

So sometimes it's 20 cents for saving you 20 minutes of work.

Other times it's $1 for wasting 10 minutes.

4 4 77

Christoph Molnar @christophmolnar.bsky.social · Mar 7

Only waiting for the print proof, but if it looks good, I'll publish the third edition of Interpretable Machine Learning next week.

As always, it was more work than anticipated—especially moving the entire book project from Bookdown to Quarto, which took a bit of effort.

1 18

Christoph Molnar @christophmolnar.bsky.social · Feb 25

Can an office game outperform machine learning?

My most recent post on Mindful Modeler dives into the wisdom of the crowds and prediction markets.

Read the full story here:

Can an office game outperform machine learning?

Wisdom of the crowds, prediction markets, and more fun in the work place.

buff.ly

5

Christoph Molnar @christophmolnar.bsky.social · Feb 4

5/ It was stressful, but I don’t regret it. I learned a lot and definitely feel validated in my skills again.

Full story & solution details: https://buff.ly/4gHZYHD

How to win an ML competition beyond predictive performance

A dive into the challenges and winning solution

mindfulmodeler.substack.com

11

Christoph Molnar @christophmolnar.bsky.social · Feb 4

4/ Writing Supervised ML for Science at the same time was a huge plus—competition & book writing fed into each other (e.g., uncertainty quantification).

1 5

Christoph Molnar @christophmolnar.bsky.social · Feb 4

3/ One key insight: SHAP’s reference data matters! I used historical forecasts for interpretability. Also combined SHAP with ceteris paribus profiles for sensitivity analysis.

1 4

Christoph Molnar @christophmolnar.bsky.social · Feb 4

2/ My approach:
✅ XGBoost ensemble, quantile loss
✅ SHAP for explainability + custom waterfall plots + ceteris paribus plots
✅ Conformal prediction to fix interval coverage
✅ Auto-generated reports with Quarto

1 2

Christoph Molnar @christophmolnar.bsky.social · Feb 4

1/ Years ago, I went full-time into writing & cut ML practice. At some point, I felt like an impostor writing about ML but no longer practicing. This competition about water supply forecasting on DrivenData (500k prize pool) was a way back in.

1 2

Christoph Molnar @christophmolnar.bsky.social · Feb 4

A year ago, I took a risk & spent quite some time on a ML competition. It paid off—I won 4th place overall & 1st in explainability!

Here's a summary of the journey, challenges, & key insights from my winning solution (water supply forecasting)

1 1 22

Christoph Molnar @christophmolnar.bsky.social · Jan 29

OpenAI right now

double button meme. Guy (labeled openai) presses two buttons simultaneously. First one says "Training on other's work is okay" The other says it's not okay

2 17 110

Christoph Molnar @christophmolnar.bsky.social · Jan 22

deprecated was maybe the wrong word. It's no longer the default in the shap package. There are faster alternatives

4

Christoph Molnar @christophmolnar.bsky.social · Jan 22

The connection between SHAP and LIME is only when we represent features differently for LIME and use a different weight function.
My take is that, while interesting, it can be misleading as SHAP and original LIME are very different, as you also say.

1 1

Christoph Molnar @christophmolnar.bsky.social · Jan 22

The original SHAP paper has been cited over 30k times.

The paper showed that attribution methods, like LIME and LRP, compute Shapley values (with some adaptations).

The paper also introduces estimation methods for Shapley values, like KernelSHAP, which today is deprecated.

3 2 26

Christoph Molnar @christophmolnar.bsky.social · Jan 21

Not planned so far

Christoph Molnar @christophmolnar.bsky.social · Jan 21

To this day, the Interpretable Machine Learning book is still my most impactful project. But as time went on, I dreaded working on it. Fortunately, I found the motivation again and I'm working on the 3rd edition. 😁

Read more here:

Why I almost stopped working on Interpretable Machine Learning

7 years ago I started writing the book Interpretable Machine Learning.

buff.ly

1 3 21