Thanks to the amazing team
Yifei Zhang, @holynski.bsky.social, Alexei A. Efros, and Angjoo Kanazawa!

From the state you can also predict unseen parts. This also improves as you see more.

Key insight is to store 3D information in a latent persistent state that gets continuously updated as images come in. This enables it to continuously refine its predictions as it sees more images!

Late to post, but excited to introduce CUT3R!

An online 3D reasoning framework for many 3D tasks directly from just RGB. For static or dynamic scenes. Video or image collections, all in one!

Project Page: cut3r.github.io
Code and Model: github.com/CUT3R/CUT3R