Lightnews — Scholar-powered news

Amin Nejatbakhsh @aminejat.bsky.social · Jul 16

Our work establishes a framework for modeling neural data under interventions. Our paper and code are available here:

Paper: openreview.net/pdf?id=n7qKt...
Code: github.com/amin-nejat/i...

Finally, a huge thanks to my co-author Yixin Wang for her contributions (n/n).

openreview.net

1

Amin Nejatbakhsh @aminejat.bsky.social · Jul 16

In electrophysiological recordings from the monkey prefrontal cortex during electrical micro-stimulation, we show that iSSM generalizes to unseen test interventions, an important property of identifiable models (8/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Jul 16

We apply iSSM to calcium recordings and photo-stimulation from mice's ALM area during a short-term memory task. We show that the latent variables inferred by the iSSM can distinguish between correct and incorrect trials, showing their behavioral relevance (7/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Jul 16

In the linear models of persistent activity in working memory, we show that iSSM can recover the true connectivity matrix with a high precision. For partial observations, this identification problem was originally posed as an open problem in the literature (Qian et al 2024) (6/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Jul 16

In models of motor cortex dynamics with linear dynamics and nonlinear observations, we show that iSSM can identify the underlying dynamics and emissions, and recover the true latent variables. The accuracy of this recovery improves when more interventions are applied (5/n).

1 1

Amin Nejatbakhsh @aminejat.bsky.social · Jul 16

Under some assumptions (bounded completeness of the observation noise, injectivity of the mixing function, and faithfulness) we prove that, under sufficiently diverse interventions, iSSM is able to recover the true latents, dynamics, emissions, and noise parameters (4/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Jul 16

We propose interventional state space models (iSSM), a statistical framework for the joint modeling of observational and interventional data. Compared to SSM, iSSM models interventions in a causal manner, where the interventions decouple nodes from their causal parents (3/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Jul 16

Can we use interventional data to identify the dynamics? Intuitively, interventions kick the state of the system outside of its attractor manifold, allowing for the exploration of the state space (Jazayeri et al 2017) (2/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Jul 16

In neuroscience we often ask which dynamical system model generated the data? However, our ability to distinguish between dynamical hypotheses from data is hindered by model non-identifiability. For example, the two systems below are indistinguishable using observational data (1/n).

1 1

Amin Nejatbakhsh @aminejat.bsky.social · Jul 16

Pleased to announce that our paper on "Identifying Neural Dynamics Using Interventional State Space Models" has been selected for a poster presentation in #ICML2025. Please check the thread for paper details (0/n).

Presentation info: icml.cc/virtual/2025....

1 3 12

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

Huge thanks to my co-authors @vgeadah.bsky.social , @itsneuronal.bsky.social and @lipshutz.bsky.social for their contributions. This work was funded by the Simons Foundation (n/n).

Code: github.com/amin-nejat/n...
Paper: arxiv.org/pdf/2412.14421

GitHub - amin-nejat/netrep: Some methods for comparing network representations in deep learning and neuroscience.

Some methods for comparing network representations in deep learning and neuroscience. - GitHub - amin-nejat/netrep: Some methods for comparing network representations in deep learning and neurosc...

github.com

3

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

We compute pairwise distances for 2 pretrained models and 10 input prompts. Our results suggest that Causal OT (and SSD) mainly depend on the prompt, regardless of the model. This is reflected in the similar pattern in the four quadrants of the distance matrices (11/n).

1 1

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

Our final result is on latent text-to-image diffusion models. We took pretrained models and generated text-conditional samples and mean trajectories decoded into images. The lack of structure in means suggests that stochasticity and dynamics are critical for image generation (10/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

We show that Causal OT can utilize the across time correlations to distinguish between the three systems (9/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

Our second example focuses on distinguishing between flow fields. We generated data from three dynamical systems (saddle, point attractor, and line attractor) and adversarially tuned the parameters such that the marginal distributions from all these systems become the same (8/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

We apply this intuition to the leading model of preparatory dynamics in the motor cortex. We show Causal OT can distinguish between the readout (i.e. muscle activity) and motor dynamics even when preparatory activity lies in the low-variance dimensions of population dynamics (7/n).

1 1

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

Our first experiment on a toy 1-d example builds an important intuition that Causal OT can distinguish between systems where the past can be more or less predictive of the future, even when the marginal statistics are exactly the same (6/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

We then introduce Causal OT, a distance metric that respects both stochasticity and dynamics. Causal OT admits a closed-form solution for Gaussian Processes and importantly, it respects time causality, a property useful for processes with various predictability characteristics (5/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

We argue that neither stochasticity nor dynamics alone is sufficient to capture similarities in noisy dynamical systems. This is important because many recent models have both of these components (e.g. diffusion models and biological systems) (4/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

Several distance metrics have been proposed to measure representational similarities, covering a range of assumptions. Almost all methods assume deterministic responses to the inputs, while more recent methods assume stochastic or dynamic responses (3/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

This paradigm allows us to analyze the shape space, a space where each point corresponds to a network and distances reflect the (dis)similarity between representations. Williams et al (2021) showed that analyzing shape space helps us understand the variability of representations across models (2/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

A central question in AI is to understand how hidden representations are shaped in models. A useful paradigm is to define metric spaces that quantify differences in representations across networks. Given two networks, the goal is to compare the high-dimensional responses to the same inputs (1/n).

1

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

Excited to announce that our paper on "Comparing noisy neural population dynamics using optimal transport distances" has been selected for an oral presentation in #ICLR2025 (1.8% top papers). Check the thread for paper details (0/n).

Presentation info: iclr.cc/virtual/2025....

ICLR 2025 Comparing noisy neural population dynamics using optimal transport distances OralICLR 2025

iclr.cc

1 7 23

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

We apply this intuition to the leading model of preparatory dynamics in the motor cortex. We show Causal OT can distinguish between the readout (i.e. muscle activity) and motor dynamics even when preparatory activity lies in the low-variance dimensions of population dynamics (7/n).

Amin Nejatbakhsh @aminejat.bsky.social · Apr 22

Our first experiment on a toy 1-d example builds an important intuition that Causal OT can distinguish between systems where the past can be more or less predictive of the future, even when the marginal statistics are exactly the same (6/n).

1 1