Nick Stracke
rmsnorm.bsky.social
Nick Stracke
@rmsnorm.bsky.social
PhD Student at Ommer Lab (Stable Diffusion)
Trying to understand motion...

🌐 https://nickstracke.dev
We show you can, with just 30 minutes of task-agnostic finetuning on a single GPU. 🤯

No noise. Better features. Better performance. Across many tasks.

And no timestep searching headaches! 👇
December 4, 2024 at 11:31 PM
They need noisy images as input - and the right noise level for each task.
So we have to find the right timestep for every downstream task? 🤯

What if you could ditch all of that? 👇
December 4, 2024 at 11:31 PM
🤔 Why do we extract diffusion features from noisy images? Isn’t that destroying information?

Yes, it is - but we found a way to do better. 🚀

Here’s how we unlock better features, no noise, no hassle.

📝 Project Page: compvis.github.io/cleandift
💻 Code: github.com/CompVis/clea...

🧵👇
December 4, 2024 at 11:31 PM
me right now..
November 20, 2024 at 2:22 PM