Bowen Zheng
@bwz-brain.bsky.social
67 followers 180 following 6 posts
MIT BCS | grad part-time reductionist, full time human
Posts Media Videos Starter Packs
Reposted by Bowen Zheng
shahabbakht.bsky.social
The way Sutton himself interprets the “bitter lesson” in this interview definitely caught a lot of bitter lesson enthusiasts off guard.
LLMs not actually being an example of the bitter lesson was quite a nuance no one saw coming.

youtu.be/21EYKqUsPfg?...
Richard Sutton – Father of RL thinks LLMs are a dead end
YouTube video by Dwarkesh Patel
youtu.be
Reposted by Bowen Zheng
toddgureckis.bsky.social
So far, learning traps seem robust to social learning in our cases. Surprisingly, despite many manipulations that have tried to reduce this learning trap, the most effective has been simply being a child (see @emilyliquin.bsky.social's work on traps in children) osf.io/preprints/ps...
OSF
osf.io
Reposted by Bowen Zheng
markhisted.org
The New York Times piece today about US science is terrible and wrong—in many ways.

I could write a whole article about this, but as one example:

“To close observers, the original crisis began well before any of this…”
No. I’m a close observer of science, and this is incorrect.
bwz-brain.bsky.social
This is in principle justified by Rao-Blackwell theorem? one abstracts the problem enough such that the data we do have is a suffcient statistics for the inference problem.
Reposted by Bowen Zheng
ricardsole.bsky.social
Can a single cell learn? Even without a brain, some microbes show simple forms of cognition. Can this basal cognition be engineered? Check our new paper with @jordiplam.bsky.social on the minimal synthetic circuits & their cognitive limits. @drmichaellevin.bsky.social www.biorxiv.org/content/10.1...
bwz-brain.bsky.social
I’m not sure how useful this form is for characterizing part of the brain that does specific computation though. The heart is an important part of keep me alive to do face processing, but it does’t seem useful to say face processing -> heart is active. though it’s logically correct.
Reposted by Bowen Zheng
Reposted by Bowen Zheng
antihebbiann.bsky.social
I wrote a Comment on neurotheory, and now you can read it!

Some thoughts on where neurotheory has and has not taken root within the neuroscience community, how it has shaped those subfields, and where we theorists might look next for fresh adventures.

www.nature.com/articles/s41...
Theoretical neuroscience has room to grow
Nature Reviews Neuroscience - The goal of theoretical neuroscience is to uncover principles of neural computation through careful design and interpretation of mathematical models. Here, I examine...
www.nature.com
Reposted by Bowen Zheng
carnage4life.bsky.social
MIT’s NANDA initiative found that 95% of generative AI deployments fail after interviewing 150 execs, surveying 350 workers, and analyzing 300 projects. The real “productivity gains” seem to come from layoffs and squeezing more work from fewer people not AI.
MIT report: 95% of generative AI pilots at companies are failing
There’s a stark difference in success rates between companies that purchase AI tools from vendors and those that build them internally.
fortune.com
Reposted by Bowen Zheng
maguilera.net
Our paper just out in Nature Communications!
www.nature.com/articles/s41...

We introduce curved neural networks naturally introducing high-order interactions showing:
• explosive phase transitions
• enhanced memory retrieval via self-annealing
• increased memory capacity through geometric curvature
Explosive neural networks via higher-order interactions in curved statistical manifolds - Nature Communications
Higher-order interactions shape complex neural dynamics but are hard to model. Here, authors use a generalization of the maximum entropy principle to introduce a family of curved neural networks, reve...
www.nature.com
Reposted by Bowen Zheng
jrclimer.bsky.social
So what drives drift? We looked closely at the neurons and found that a small group of them were stable. These stable neurons were more excitable than neighboring cells, making the fate of the cells predictable.
Reposted by Bowen Zheng
alisonphipps.bsky.social
DO EVERYTHING YOU CAN TO GET FOOD AND WATER IN TO GAZA.
This is from Lemkin Institute begging..... we are all begging.
The Lemkin Institute for Genocide Prevention is
calling on every single leader in the world: DO EVERYTHING YOU CAN TO GET FOOD &
WATER INTO GAZA RIGHT AWAY. Even if it takes bypassing the reports, meetings, endless conferences, parliamentary sessions, UN sessions, and all the other regular diplomatic
channels that have led nowhere. Just do it. Genocide must not be allowed to continue while we all
watch. We must not allow mass starvation in Gaza.
We cannot wait any longer. IF YOU HAVE POWER, USE IT. HISTORY WILL DEMONSTRATE THE RECTITUDE OF
YOUR ACTIONS.
Reposted by Bowen Zheng
bwz-brain.bsky.social
“this is an unfair comparison because the model has not been trained on all data that has ever existed and on all future data that will be digitalized! Our foundation model is omniscient which renders the concept of generalization null!!!!”
Reposted by Bowen Zheng
rademaker.bsky.social
Who doesn't like a good model of the brain? Yet, from simple regression to neural nets, some limitations keep popping up (e.g., overfitting) @mjwolff.bsky.social & I saw some cool but puzzling data, ran a quick analysis & found one such limitation: model mimicry. Now in #naturecommunications &🧵below
Model mimicry limits conclusions about neural tuning and can mistakenly imply unlikely priors
Nature Communications - Model mimicry limits conclusions about neural tuning and can mistakenly imply unlikely priors
rdcu.be
Reposted by Bowen Zheng
hannahpayne.bsky.social
My latest Aronov lab paper is now published @Nature!

When a chickadee looks at a distant location, the same place cells activate as if it were actually there 👁️

The hippocampus encodes where the bird is looking, AND what it expects to see next -- enabling spatial reasoning from afar

bit.ly/3HvWSum
Reposted by Bowen Zheng
loreandordure.com
It occurred to me last night that microwaves are kinda like LLMs.
Remember when they first came out, people bought microwave cookbooks, and special vented plastic cookware, and they were going to change the way we cooked and ate forever?
Now we use them for defrosting mince, and reheating cold tea.
Reposted by Bowen Zheng
guidomeijer.com
Kilosort4 detects a LOT of neurons, I recorded 15k neurons in one year 🤯 Traditionally, one would curate these detected units to see if they are well isolated single neurons. This is not feasible anymore, so today let's look at three options that are out there to automate this process! 🤖👇
Reposted by Bowen Zheng
I’m hiring a full-time lab tech for two years starting May/June. Strong coding skills required, ML a plus. Our research on the human brain uses fMRI, ANNs, intracranial recording, and behavior. A great stepping stone to grad school. Apply here:
careers.peopleclick.com/careerscp/cl...
......
Technical Associate I, Kanwisher Lab
MIT - Technical Associate I, Kanwisher Lab - Cambridge MA 02139
careers.peopleclick.com
Reposted by Bowen Zheng
markhaselgrove.bsky.social
In contrast to the wide spread applause that this piece seems to be getting, I disagree with a lot of what is said here.

1/N
masudhusain.bsky.social
Why academia is sleepwalking into self-destruction. My editorial @brain1878.bsky.social If you agree with the sentiments please repost. It's important for all our sakes to stop the madness
academic.oup.com/brain/articl...