Phillip Isola
phillipisola.bsky.social
Phillip Isola
@phillipisola.bsky.social
Associate Professor in EECS at MIT. Neural nets, generative models, representation learning, computer vision, robotics, cog sci, AI.

https://web.mit.edu/phillipi/
Reposted by Phillip Isola
Join us TODAY for the 3rd Perception Test Challenge perception-test-challenge.github.io @iccv.bsky.social

Ballroom B, Full day

Amazing lineup of speakers: Ali Farhadi, @alisongopnik.bsky.social, Phlipp Krahenbul, @phillipisola.bsky.social
October 19, 2025 at 6:14 PM
Over the past year, my lab has been working on fleshing out theory + applications of the Platonic Representation Hypothesis.

Today I want to share two new works on this topic:

Eliciting higher alignment: arxiv.org/abs/2510.02425
Unpaired learning of unified reps: arxiv.org/abs/2510.08492

1/9
October 10, 2025 at 10:13 PM
Interesting reaction from ChatGPT to the HHS mRNA memo. It finds it so implausible that it thinks it's fake. From the perspective of a ~2024(?) trained model, 2025 policies are so absurd as to be unbelievable...

chatgpt.com/share/689364...
August 6, 2025 at 2:40 PM
Reposted by Phillip Isola
#CVPR2025 provided coaching for all orals. Do you think the talks were improved compared to last year?

* Better than last year
* About the same
* Worse than last year

Share your thoughts in the thread!
June 19, 2025 at 7:51 PM
Our computer vision textbook is now available for free online here:
visionbook.mit.edu

We are working on adding some interactive components like search and (beta) integration with LLMs.

Hope this is useful and feel free to submit Github issues to help us improve the text!
Foundations of Computer Vision
The print version was published by
visionbook.mit.edu
June 15, 2025 at 3:45 PM
Reposted by Phillip Isola
Behind every great conference is a team of dedicated reviewers. Congratulations to this year’s #CVPR2025 Outstanding Reviewers!

cvpr.thecvf.com/Conferences/...
May 10, 2025 at 1:59 PM
Reposted by Phillip Isola
PINEAPPLE, LIGHT, HAPPY, AVALANCHE, BURDEN

Some of these words are consistently remembered better than others. Why is that?
In our paper, just published in J. Exp. Psychol., we provide a simple Bayesian account and show that it explains >80% of variance in word memorability: tinyurl.com/yf3md5aj
APA PsycNet
tinyurl.com
April 10, 2025 at 2:38 PM
Lots of different definitions of reasoning floating around.
How about this?

Reasoning is planning in knowledge space.

Planning = find a sequence of actions that achieves a goal.

Reasoning = find a sequence of inferences that answers a query.

Then it's no surprise that RL can amortize both.
February 3, 2025 at 3:40 AM
Something I don't quite understand: deepseek showed that each gpu is more valuable than we thought. You can do more with fewer.

So why did chip stocks crash?

Is it because people assume that AI demand will satiate at a certain level of intelligence? Or is there some other explanation
January 29, 2025 at 4:08 AM
When I was a kid I was fascinated by SETI, the Search for Extraterrestrial Intellitence.

Now we live in an era when it is becoming meaningful to search for "extraterrestrial life" not just in our universe but in simulated universes as well.

This project provides new tools toward that dream:
Introducing ASAL: Automating the Search for Artificial Life with Foundation Models

Blog: sakana.ai/asal/

We propose a new method called Automated Search for Artificial Life (ASAL) which uses foundation models to automate the discovery of the most interesting and open-ended artificial lifeforms!
December 24, 2024 at 3:19 AM
Reposted by Phillip Isola
Personal vision tasks–like detecting *your mug*--are hard; they’re data scarce and fine-grained.

In our new paper, we show you can adapt general-purpose vision models to these tasks from just three photos!

📝: arxiv.org/abs/2412.16156
💻: github.com/ssundaram21/...

(1/n)
December 23, 2024 at 5:26 PM
At NeurIPS this year my lab is sharing a few papers and talks.

They are all about the following question: how to characterize the geometry of deep learning problems, and in particular how to measure *distance*?

Each paper/talk gives a rather different answer, detailed below:
December 10, 2024 at 6:52 PM
Making a lecture on inference methods for deep nets. Here is my attempt at mapping out the interplay between training and inference.

A few items I wasn't sure where to put. You could break it down differently. What did I get wrong?
December 3, 2024 at 3:55 AM
Sharing some new work!

A big dream in AI is to create world models of sufficient quality that you can train agents within them.

Classic simulators lack visual diversity and realism. GenAI lacks physical accuracy. But combining the two can work pretty well!

Paper: arxiv.org/abs/2411.00083
November 14, 2024 at 1:30 AM
I think I will start posting about research, and maybe other thoughts, here.

Hope we can get a critical mass like there was on science Twitter!
November 8, 2024 at 2:08 AM