Lightnews — Scholar-powered news

Reposted by Chandan Singh

Naomi Saphra @nsaphra.bsky.social · Aug 29

How can an imitative model like an LLM outperform the experts it is trained on? Our new COLM paper outlines three types of transcendence and shows that each one relies on a different aspect of data diversity. arxiv.org/abs/2508.17669

3 17 95

Reposted by Chandan Singh

Alexander Huth @alexanderhuth.bsky.social · Aug 18

New paper with @rjantonello.bsky.social @csinva.bsky.social, Suna Guo, Gavin Mischler, Jianfeng Gao, & Nima Mesgarani: We use LLMs to generate VERY interpretable embeddings where each dimension corresponds to a scientific theory, & then use these embeddings to predict fMRI and ECoG. It WORKS!

bioRxiv Neuroscience @biorxiv-neursci.bsky.social · Aug 13

Evaluating scientific theories as predictive models in language neuroscience https://www.biorxiv.org/content/10.1101/2025.08.12.669958v1

1 8 16

Reposted by Chandan Singh

RJ Antonello @rjantonello.bsky.social · Aug 18

In our new paper, we explore how we can build encoding models that are both powerful and understandable. Our model uses an LLM to answer 35 questions about a sentence's content. The answers linearly contribute to our prediction of how the brain will respond to that sentence. 1/6

1 9 25

Chandan Singh @csinva.bsky.social · Aug 14

This was a huge effort with a wonderful team:
@rjantonello.bsky.social (co-first), Suna Guo, Gavin Mischler, Jianfeng Gao, Nima Mesgarani, & @alexanderhuth.bsky.social Excited to see how folks use it!

Chandan Singh @csinva.bsky.social · Aug 14

These maps largely agree with prior findings (from Neurosynth neurosynth.org) and new findings (from a follow-up fMRI experiment using generative causal testing
arxiv.org/abs/2410.00812), suggesting this method is an effective, *automated* way test new hypotheses!

1

Chandan Singh @csinva.bsky.social · Aug 14

The model is small enough that we can visualize the whole thing. No feature importances or post-hoc summaries, just 35 questions and a map showing their linear weights for each brain voxel.

1

Chandan Singh @csinva.bsky.social · Aug 14

We scale up our prior method that builds interpretable embeddings by asking LLMs yes/no questions. We use bigger LLMs, more data, and stability selection to build a 35-question model that generalizes across subjects and modalities bsky.app/profile/csin...

Chandan Singh @csinva.bsky.social · Dec 7

At NeurIPS this week, presenting our work on crafting *interpretable embeddings* by asking yes/no questions to black-box LLMs.

Drop me a message if you want to chat about interpretability/language neuroscience!

1

Chandan Singh @csinva.bsky.social · Aug 14

New paper: Ask 35 simple questions about sentences in a story and use the answers to predict brain responses. Interpretable, compact, & surprisingly high performance in both fMRI and ECoG. 🧵 biorxiv.org/content/10.1...

1 1

Reposted by Chandan Singh

George Pearkes @peark.es · Aug 5

We’ve discovered a literal miracle with almost unlimited potential and it’s being scrapped for *no reason whatsoever*. This isn’t even nihilism, it’s outright worship of death and human suffering.

Jen Bendery @jbendery.bsky.social · Aug 5

"The U.S. Department of Health and Human Services (HHS) today announced the beginning of a coordinated wind-down of its mRNA vaccine development activities...."

cc: Sen. Bill Cassidy

49 3.3K 10K

Reposted by Chandan Singh

Jeffrey Bowers @jeffreybowers.bsky.social · Jun 26

Binz et al. (in press, Nature) developed an LLM called Centaur that better predicts human responses in 159 of 160 behavioural experiments compared to existing cognitive models. See: arxiv.org/abs/2410.20268

3 23 64

Reposted by Chandan Singh

Bo Liu (Benjamin Liu) @benjamin-eecs.bsky.social · Jul 1

We're excited about self-play unlocking continuously improving agents. RL selects CoT patterns from LLMs. Games=perfect testing grounds.
SPIRAL: models learn via self-competition. Kuhn Poker → +8.7% math, +18.1 Minerva Math! 🃏
Paper: huggingface.co/papers/2506....
Code: github.com/spiral-rl/spiral

2 5 17

Reposted by Chandan Singh

Paul Bogdan @pbogdan.bsky.social · Jun 24

🚨 New preprint 🚨

Prior work has mapped how the brain encodes concepts: If you see fire and smoke, your brain will represent the fire (hot, bright) and smoke (gray, airy). But how do you encode features of the fire-smoke relation? We analyzed fMRI with embeddings extracted from LLMs to find out 🧵

1 8 32

Reposted by Chandan Singh

Martin Hebart @martinhebart.bsky.social · Jun 23

What makes humans similar or different to AI? In a paper out in @natmachintell.nature.com led by @florianmahner.bsky.social & @lukasmut.bsky.social, w/ Umut Güclü, we took a deep look at the factors underlying their representational alignment, with surprising results.

www.nature.com/articles/s42...

Dimensions underlying the representational alignment of deep neural networks with humans - Nature Machine Intelligence

An interpretability framework that compares how humans and deep neural networks process images has been presented. Their findings reveal that, unlike humans, deep neural networks focus more on visual ...

www.nature.com

2 36 100

Reposted by Chandan Singh

Mark Lescroart @neuromdl.bsky.social · Jun 12

🚨Paper alert!🚨
TL;DR first: We used a pre-trained deep neural network to model fMRI data and to generate images predicted to elicit a large response for each many different parts of the brain. We aggregate these into an awesome interactive brain viewer: piecesofmind.psyc.unr.edu/activation_m...

Cortex Feature Visualization

piecesofmind.psyc.unr.edu

2 6 10

Reposted by Chandan Singh

Greta Tuckute @gretatuckute.bsky.social · May 23

What are the organizing dimensions of language processing?

We show that voxel responses during comprehension are organized along 2 main axes: processing difficulty & meaning abstractness—revealing an interpretable, topographic representational basis for language processing shared across individuals

3 30 71

Reposted by Chandan Singh

Lindia Tjuatja @lindiatjuatja.bsky.social · Jun 9

When it comes to text prediction, where does one LM outperform another? If you've ever worked on LM evals, you know this question is a lot more complex than it seems. In our new #acl2025 paper, we developed a method to find fine-grained differences between LMs:

🧵1/9

2 21 70

Reposted by Chandan Singh

Science Magazine @science.org · Apr 21

Five people have seen a color never before visible to the naked human eye, thanks to a new retinal stimulation technique called Oz.

Learn more in #ScienceAdvances: scim.ag/442Hjn6

Novel color via stimulation of individual photoreceptors at population scale

Image display by cell-by-cell retina stimulation, enabling colors impossible to see under natural viewing.

scim.ag

4 11 74

Reposted by Chandan Singh

Nature Portfolio @natureportfolio.nature.com · Apr 16

Two clinical trials reported in Nature demonstrate the safety of stem cell therapies for Parkinson’s disease. The papers investigate the use of cells derived from human induced pluripotent stem cells and human embryonic stem cells. go.nature.com/4ikcJc2
go.nature.com/4jfSRYX 🧪

This is figure 2 from “Phase I/II trial of iPS-cell-derived dopaminergic cells for Parkinson’s disease,” which shows chronological changes in clinical end points.

9 42

Reposted by Chandan Singh

Erica Busch @elbusch.bsky.social · Apr 3

New preprint! Excited to share our latest work “Accelerated learning of a noninvasive human brain-computer interface via manifold geometry” ft. outstanding former undergraduate Chandra Fincke, @glajoie.bsky.social, @krishnaswamylab.bsky.social, and @wutsaiyale.bsky.social's Nick Turk-Browne 1/8

Accelerated learning of a noninvasive human brain-computer interface via manifold geometry

Brain-computer interfaces (BCIs) promise to restore and enhance a wide range of human capabilities. However, a barrier to the adoption of BCIs is how long it can take users to learn to control them. W...

doi.org

2 20 66

Reposted by Chandan Singh

Leyla Isik @lisik.bsky.social · Mar 14

New preprint “Monkey See, Model Knew: LLMs accurately predict visual responses in humans AND NHPs”
Led by Colin Conwell with @emaliemcmahon.bsky.social Akshay Jagadeesh, Kasper Vinken @amrahs-inolas.bsky.social @jacob-prince.bsky.social George Alvarez @taliakonkle.bsky.social & Marge Livingstone 1/n

1 19 50

Reposted by Chandan Singh

Nanthia Suthana @suthanalab.bsky.social · Mar 10

🚨 New lab paper!🚨

A dream study of mine for nearly 20 yrs not possible until now thanks to NIH 🧠 funding & 1st-author lead @seeber.bsky.social

We tracked hippocampal activity as people walked memory-guided paths & imagined them again. Did brain patterns reappear?🧵👇

www.nature.com/articles/s41...

Human neural dynamics of real-world and imagined navigation - Nature Human Behaviour

Seeber et al. studied brain recordings from implanted electrodes in freely moving humans. Neural dynamics encoded actual and imagined routes similarly, demonstrating parallels between navigational, im...

www.nature.com

10 81 270

Reposted by Chandan Singh

Naomi Saphra @nsaphra.bsky.social · Mar 3

2018: Saliency maps give plausible interpretations of random weights, triggering skepticism and catalyzing the mechinterp cultural movement, which now advocates for SAEs.

2025: SAEs give plausible interpretations of random weights, triggering skepticism and ...

Sanity Checks for Saliency Maps
Julius Adebayo, Justin Gilmer, Michael Muelly, Ian Goodfellow, Moritz Hardt, Been Kim
Saliency methods have emerged as a popular tool to highlight features in an input deemed relevant for the prediction of a learned model. Several saliency methods have been proposed, often guided by visual appeal on image data. In this work, we propose an actionable methodology to evaluate what kinds of explanations a given method can and cannot provide. We find that reliance, solely, on visual assessment can be misleading. Through extensive experiments we show that some existing saliency methods are independent both of the model and of the data generating process. Consequently, methods that fail the proposed tests are inadequate for tasks that are sensitive to either data or model, such as, finding outliers in the data, explaining the relationship between inputs and outputs that the model learned, and debugging the model. We interpret our findings through an analogy with edge detection in images, a technique that requires neither training data nor model. Theory in the case of a linear model and a single-layer convolutional neural network supports our experimental findings.

Sparse Autoencoders Can Interpret Randomly Initialized Transformers
Thomas Heap, Tim Lawson, Lucy Farnik, Laurence Aitchison
Sparse autoencoders (SAEs) are an increasingly popular technique for interpreting the internal representations of transformers. In this paper, we apply SAEs to 'interpret' random transformers, i.e., transformers where the parameters are sampled IID from a Gaussian rather than trained on text data. We find that random and trained transformers produce similarly interpretable SAE latents, and we confirm this finding quantitatively using an open-source auto-interpretability pipeline. Further, we find that SAE quality metrics are broadly similar for random and trained transformers. We find that these results hold across model sizes and layers. We discuss a number of number interesting questions that this work raises for the use of SAEs and auto-interpretability in the context of mechanistic interpretability.

2 15 95

Reposted by Chandan Singh

Ilyass Moummad @ilyassmoummad.bsky.social · Feb 18

Yi Ma & colleagues managed to simplify DINO & DINOv2 by removing many ingredients and adding a robust regularization term from information theory (coding rate) that learn informative decorrelated features. Happy to see principled approaches advance deep representation learning!

1 3 6

Reposted by Chandan Singh

Pablo Samuel Castro @pcastr.bsky.social · Feb 10

Can LLMs be used to discover interpretable models of human and animal behavior?🤔

Turns out: yes!

Thrilled to share our latest preprint where we used FunSearch to automatically discover symbolic cognitive models of behavior.
1/12

3 44 130

Reposted by Chandan Singh

Antonino Greco @agreco.bsky.social · Dec 24

"...responses of V4 neurons under naturalistic conditions can be explained by a hierarchical three-stage model where each stage consists entirely of units like those found in area V1"

#NeuroAI

www.biorxiv.org/content/10.1...

16 39