Hsuan-Pei Huang
pikapei.bsky.social
Hsuan-Pei Huang
@pikapei.bsky.social
PhD student in Taiwan. He/him.
Reposted by Hsuan-Pei Huang
I think there will be tools that are better or worse at "carving nature at its joints" to help us find the simplest way to capture most of what we care about. I'm saying (eg, here www.sciencedirect.com/science/arti...) that we should try some empirical methods to get a handle on what those tools are
Testing methods of neural systems understanding
Neuroscientists apply a range of analysis tools to recorded neural activity in order to glean insights into how neural circuits drive behavior in orga…
www.sciencedirect.com
November 24, 2025 at 4:01 PM
Reposted by Hsuan-Pei Huang
This one is an all time favorite of mine:

direct.mit.edu/neco/article...

(tho maybe not that relevant to the "rescue" thing)
Natural Gradient Works Efficiently in Learning
Abstract. When a parameter space has a certain underlying structure, the ordinary gradient of a function does not represent its steepest direction, but the natural gradient does. Information geometry ...
direct.mit.edu
November 24, 2025 at 4:23 PM