Research Fellow @imperialcollegeldn.bsky.social and @imperial-ix.bsky.social
Funded by @schmidtsciences.bsky.social
What is the smallest / simplest model for your phenomenon of interest.
Some recent work, cited in the article, shows that very small models can be surprisingly powerful.
And often we may be far above the lower bound, which then hinders interpretability
What is the smallest / simplest model for your phenomenon of interest.
Some recent work, cited in the article, shows that very small models can be surprisingly powerful.
And often we may be far above the lower bound, which then hinders interpretability
In physics, many breakthroughs have come from abstracting away complexity, as this article highlights!
doi.org/10.1111/ejn....
In physics, many breakthroughs have come from abstracting away complexity, as this article highlights!
doi.org/10.1111/ejn....
1. The multi-billion parameter model discussed in the article was developed by Meta but then fine-tuned by neuroscientists (for research).
This could become more common, or neuroscientists could start to train their own "foundation" models from scratch.
1. The multi-billion parameter model discussed in the article was developed by Meta but then fine-tuned by neuroscientists (for research).
This could become more common, or neuroscientists could start to train their own "foundation" models from scratch.
So the ones which do get reviewed tend to be high-quality!
Even if, like the paper @neural-reckoning.org is referring to, the reviewers don't agree with everything.
So the ones which do get reviewed tend to be high-quality!
Even if, like the paper @neural-reckoning.org is referring to, the reviewers don't agree with everything.
You may be interested in our recent work too!
We define 128 RNN architectures then compare their behaviour and dynamics (using gradient-based metrics).
bsky.app/profile/marc...
@neuralreckoning.bsky.social & I explore this in our new preprint:
doi.org/10.1101/2025...
🤖🧠🧪
🧵1/9
You may be interested in our recent work too!
We define 128 RNN architectures then compare their behaviour and dynamics (using gradient-based metrics).
bsky.app/profile/marc...
* AI in Science (2 years) - www.imperial.ac.uk/ix-ai-in-sci...
* ICRF (4 years) - www.imperial.ac.uk/research-and...
* AI in Science (2 years) - www.imperial.ac.uk/ix-ai-in-sci...
* ICRF (4 years) - www.imperial.ac.uk/research-and...
I'm not quite ready to post my applications online, but am happy to share them privately.
Just DM or email me 🙂
I'm not quite ready to post my applications online, but am happy to share them privately.
Just DM or email me 🙂
We think these models (pRNNs) are exciting for thinking about structure-function relations in artificial and biological neural networks.
bsky.app/profile/marc...
@neuralreckoning.bsky.social & I explore this in our new preprint:
doi.org/10.1101/2025...
🤖🧠🧪
🧵1/9
We think these models (pRNNs) are exciting for thinking about structure-function relations in artificial and biological neural networks.
bsky.app/profile/marc...
Hopefully see you somewhere in Europe soon!
Hopefully see you somewhere in Europe soon!