Lightnews — Scholar-powered news

BlackboxNLP @blackboxnlp.bsky.social · Aug 12

📢 Call for Papers! 📢
#BlackboxNLP 2025 invites the submission of archival and non-archival papers on interpreting and explaining NLP models.

📅 Deadlines: Aug 15 (direct submissions), Sept 5 (ARR commitment)
🔗 More details: blackboxnlp.github.io/2025/call/

1 9

BlackboxNLP @blackboxnlp.bsky.social · Aug 6

Writing your technical report for the MIB shared task?
Take a look at the task page for guidelines and tips!

BlackboxNLP @blackboxnlp.bsky.social · Jul 28

📝 Technical report guidelines are out!

If you're submitting to the MIB Shared Task at #BlackboxNLP, feel free to take a look to help you prepare your report: blackboxnlp.github.io/2025/task/

2

BlackboxNLP @blackboxnlp.bsky.social · Aug 6

The report deadline was also extended to August 10th!
Note that this is a final extension. We look forward to reading your reports! ✍️

BlackboxNLP @blackboxnlp.bsky.social · Jul 29

Results deadline extended by one week!
Following requests from participants, we’re extending the MIB Shared Task submission deadline by one week.

🗓️ New deadline: August 8, 2025
Submit your method via the MIB leaderboard!

1 2

BlackboxNLP @blackboxnlp.bsky.social · Aug 3

Just 5 days left to submit your method to the MIB Shared Task at #BlackboxNLP!

Have last-minute questions or need help finalizing your submission?
Join the Discord server: discord.gg/n5uwjQcxPR

1 1

BlackboxNLP @blackboxnlp.bsky.social · Jul 30

Results + technical report deadline: August 8, 2025
Full task details: blackboxnlp.github.io/2025/task/

BlackboxNLP 2025

The Eight Workshop on Analyzing and Interpreting Neural Networks for NLP

blackboxnlp.github.io

BlackboxNLP @blackboxnlp.bsky.social · Jul 30

With the new extended deadline, there's still plenty of time to submit your method to the MIB Shared Task!

We welcome submissions of existing methods, experimental POCs, or any approach addressing circuit discovery or causal variable localization 💡

1 1 2

BlackboxNLP @blackboxnlp.bsky.social · Jul 29

Results deadline extended by one week!
Following requests from participants, we’re extending the MIB Shared Task submission deadline by one week.

🗓️ New deadline: August 8, 2025
Submit your method via the MIB leaderboard!

1 3

BlackboxNLP @blackboxnlp.bsky.social · Jul 28

📝 Technical report guidelines are out!

If you're submitting to the MIB Shared Task at #BlackboxNLP, feel free to take a look to help you prepare your report: blackboxnlp.github.io/2025/task/

1 3

BlackboxNLP @blackboxnlp.bsky.social · Jul 23

Just 10 days to go until the results submission deadline for the MIB Shared Task at #BlackboxNLP!

If you're working on:
🧠 Circuit discovery
🔍 Feature attribution
🧪 Causal variable localization
now’s the time to polish and submit!

Join us on Discord: discord.gg/n5uwjQcxPR

1 3

Reposted by BlackboxNLP

Martin Tutek @mtutek.bsky.social · Jul 17

Are you attending ICML? 👀

I'm sadly not, but if you are, you should check out the MIB 🕶️poster at 11AM: icml.cc/virtual/2025...

The benchmark is used as the shared task at this year's
@blackboxnlp.bsky.social (blackboxnlp.github.io/2025/task/) - there's still time to participate 🏆

1 4

BlackboxNLP @blackboxnlp.bsky.social · Jul 13

⏳ Three weeks left! Submit your work to the MIB Shared Task at #BlackboxNLP, co-located with @emnlpmeeting.bsky.social

Whether you're working on circuit discovery or causal variable localization, this is your chance to benchmark your method in a rigorous setup!

2 4

BlackboxNLP @blackboxnlp.bsky.social · Jul 9

Have you started working on your submission for the MIB shared task yet? Tell us what you’re exploring!

New featurization methods?
Circuit pruning?
Better feature attribution?

We'd love to hear about it 👇

1 2

BlackboxNLP @blackboxnlp.bsky.social · Jul 8

🗓️ Deadline: August 1
📜 Full task details: blackboxnlp.github.io/2025/task/
💬 Join the discussion: discord.gg/n5uwjQcxPR

BlackboxNLP 2025

The Eight Workshop on Analyzing and Interpreting Neural Networks for NLP

blackboxnlp.github.io

2

BlackboxNLP @blackboxnlp.bsky.social · Jul 8

Working on feature attribution, circuit discovery, feature alignment, or sparse coding?
Consider submitting your work to the MIB Shared Task, part of this year’s #BlackboxNLP

We welcome submissions of both existing methods and new or experimental POCs!

1 3 5

BlackboxNLP @blackboxnlp.bsky.social · Jul 7

New to mechanistic interpretability?
The MIB shared task is a great opportunity to experiment:
✅ Clean setup
✅ Open baseline code
✅ Standard evaluation

Join the discord server for ideas and discussions: discord.gg/n5uwjQcxPR

3 9

Reposted by BlackboxNLP

Gabriele Sarti @gsarti.com · Jul 4

The wait is over! 🎉 Our speakers for #BlackboxNLP 2025 are finally out!

BlackboxNLP @blackboxnlp.bsky.social · Jul 4

🚨 Excited to announce two invited speakers at #BlackboxNLP 2025!

Join us to hear from two leading voices in interpretability:
🎙️ Quanshi Zhang (Shanghai Jiao Tong University)
🎙️ Verna Dankers (McGill University)

‪@vernadankers.bsky.social‬

2 5

BlackboxNLP @blackboxnlp.bsky.social · Jul 4

🚨 Excited to announce two invited speakers at #BlackboxNLP 2025!

Join us to hear from two leading voices in interpretability:
🎙️ Quanshi Zhang (Shanghai Jiao Tong University)
🎙️ Verna Dankers (McGill University)

‪@vernadankers.bsky.social‬

8

BlackboxNLP @blackboxnlp.bsky.social · Jul 3

That’s a great idea, thank you for the suggestion! We’ll make sure to keep the channel going beyond the deadline

1

BlackboxNLP @blackboxnlp.bsky.social · Jul 1

📜 Check out the full task description: blackboxnlp.github.io/2025/task/

📅 Submission deadline: August 1

📢 Join the discord server for ideas, brainstorming, and q&a: discord.gg/n5uwjQcxPR

Join the BlackboxNLP Shared Task Discord Server!

Check out the BlackboxNLP Shared Task community on Discord - hang out with 54 other members and enjoy free voice and text chat.

discord.gg

1

BlackboxNLP @blackboxnlp.bsky.social · Jul 1

A typical pipeline:
• Build contrastive input pairs differing only in the target variable.
• (If supervised) train the featurizer on these pairs.
• To evaluate: Transform activation, intervene in feature space, transform back out, and check if behavior shifts as expected.

1

BlackboxNLP @blackboxnlp.bsky.social · Jul 1

One month to go! ⏰
Working on featurization methods - ways to transform LM activations to better isolate causal variables?
Submit your work to the Causal Variable Localization Track of the MIB Shared Task!

1 1 2

BlackboxNLP @blackboxnlp.bsky.social · Jun 30

Working on the MIB shared task?
Join the discord server: discord.gg/n5uwjQcxPR

🔍 Check out submission ideas
🔍 Brainstorm possible directions
🔍 Ask questions and get help with setup issues

Full task description: blackboxnlp.github.io/2025/task/

1 1 3

BlackboxNLP @blackboxnlp.bsky.social · Jun 24

Check out the full task description: blackboxnlp.github.io/2025/task/

Important dates:
🗓️ Deadline for results: August 1
📄 Technical report: August 8

Join the discord server: discord.gg/n5uwjQcxPR

BlackboxNLP 2025

The Eight Workshop on Analyzing and Interpreting Neural Networks for NLP

blackboxnlp.github.io

1

BlackboxNLP @blackboxnlp.bsky.social · Jun 24

The Circuit Localization Track benchmarks methods for discovering causal circuits, subgraphs of a model responsible for specific behavior.

These methods typically:
• Score model components or edges
• Ablate all but the top-ranked ones
• Evaluate the performance of the resulting subgraph

1 2

BlackboxNLP @blackboxnlp.bsky.social · Jun 24

Working on circuit discovery in LMs?
Consider submitting your work to the MIB Shared Task, part of #BlackboxNLP at @emnlpmeeting.bsky.social 2025!

The goal: benchmark existing MI methods and identify promising directions to precisely and concisely recover causal pathways in LMs >>

1 4 5