Lightnews — Scholar-powered news

Jun-Yan Zhu

@junyanz.bsky.social

1.3K followers 140 following 3 posts

Assistant Professor of the Generative Intelligence Lab at Carnegie Mellon University. Understanding and creating pixels. All the code and models are available at http://github.com/junyanz.

Videos

Environmental science 55%

Geography 16%

Posts Media Videos Starter Packs

Reposted by Zhu -

James Tompkin @jamestompkin.bsky.social · Jun 12

AI for Content Creation workshop @ #CVPR2025 - Grand Ballroom A1 - 4pm - panel on "Open Source in AI and the Creative Industry" - with @magrawala.bsky.social (Stanford), Cherry Zhao (Adobe), Ishan Misra (Meta) and @jonbarron.bsky.social (Google) - go go!

1 2

Reposted by Zhu -

James Tompkin @jamestompkin.bsky.social · Jun 12

The AI for Content Creation workshop is kicking off today at #CVPR2025 - Grand Ballroom A1 - @magrawala.bsky.social Kai Zhang (Adobe), Charles Herrmann (Google), Mark Boss (Stability AI), Yutong Bai (UC Berkeley), Cherry Zhao (Adobe), Ishan Misra (Meta) and @jonbarron.bsky.social ! See you soon!

2 1

Jun-Yan Zhu @junyanz.bsky.social · May 10

[2/2] Work led by @avalovelace.bsky.social, @kangledeng.bsky.social, Ruixuan Liu, and CMU faculty Changliu Liu and Deva Ramanan. LegoGPT is a small first step towards generative manufacturing of physical objects. Current version is limited to 20x20x20, 21 object categories, and simple brick types.

Jun-Yan Zhu @junyanz.bsky.social · May 10

[1/2] We've released the code for LegoGPT. Our autoregressive model generates physically stable and buildable designs from text prompts by integrating physics laws and assembly constraints into LLM training and inference.

Code: github.com/AvaLovelace1...
Website: avalovelace1.github.io/LegoGPT/

4 24 70

Reposted by Zhu -

Reve @reveai.bsky.social · Mar 26

Reve Image is our first step towards world-class image generation — and you can experience it for free today 🌜
(🔊)

1 4 6

Reposted by Zhu -

James Tompkin @jamestompkin.bsky.social · Mar 14

The AI for Content Creation workshop #CVPR2025 is accepting paper submissions. ai4cc.net Deadline March 21st 2025 midnight PST. 4 page extended abstracts, 8 pagers, and previously published work (ECCV, NeurIPS, even CVPR)! Many topics 📷📹🎬🎲✒️📃🖼️👗👔🏢 - come spend the day with us!

AI4CC 2025

ai4cc.net

1 5 9

Reposted by Zhu -

nupurkmr9.bsky.social @nupurkmr9.bsky.social · Feb 11

Can we generate a training dataset of the same object in different contexts for customization? Check out our work SynCD, which uses Objaverse assets and shared attention in text-to-image models for the same.
cs.cmu.edu/~syncd-proje...
w/ Xi Yin, @junyanz.bsky.social, Ishan Misra, and Samaneh Azadi

SynCD: Generating Multi-Image Synthetic Data for Text-to-Image Customization

cs.cmu.edu

1 4

Reposted by Zhu -

Elliott / Shangzhe Wu @elliottwu.bsky.social · Feb 1

Excited to bring the 5th CV4Animals Workshop to #CVPR2025

We welcome submissions in 2 tracks:
1) unpublished work up to 4 pages
2) papers published within last 2 years

Submit by Mar 28 & join us with amazing speakers in Nashville:
www.cv4animals.com
🦒🪼🐬🐿️🦩🐢🦘🦜🦥🦋

@cvprconference.bsky.social

4 10

Reposted by Zhu -

Aaron Hertzmann @aaronhertzmann.com · Jan 30

One day walking home, I noticed a dry cleaners across the street. “Was that always there?” I thought. A little Googling revealed that it was on my street longer than I have.
Here's a blog post on why we often miss what's right in front of us. #visionscience
aaronhertzmann.com/2024/05/09/i...

The Illusion of Awareness: Why We See Much Less Than We Think We Do

A few years ago, while walking home, I noticed a dry cleaners across the street from my house. “Was that always there?” I thought, surprised. I’d walked by that spot many, many times over the years, b...

aaronhertzmann.com

4 17

Reposted by Zhu -

ruihangao.bsky.social @ruihangao.bsky.social · Dec 11

3D content creation with touch!

We exploit tactile sensing to enhance geometric details for text- and image-to-3D generation.

Check out our #NeurIPS2024 work on Tactile DreamFusion: Exploiting Tactile Sensing for 3D Generation: ruihangao.github.io/TactileDream...
1/3

1 6 13

Reposted by Zhu -

CMU Robotics Institute @cmurobotics.bsky.social · Dec 9

Huge congratulations to RI Ph.D. Sheng-Yu Wang for receiving a 2024 Google Fellowship! 🙌

The two year fellowship supports Wang’s work in data attribution for text-to-image models.

Read about his achievement in our news site! www.ri.cmu.edu/robotics-ins...

Robotics Institute Ph.D. Awarded 2024 Google Fellowship - Robotics Institute Carnegie Mellon University

Sheng-Yu Wang, fifth-year Ph.D. at the Carnegie Mellon University Robotics Institute. Sheng-Yu Wang, fifth-year Ph.D. student at the Carnegie Mellon University Robotics Institute, has received a Goo...

www.ri.cmu.edu

1 11

Jun-Yan Zhu @junyanz.bsky.social · Dec 5

Check out Maxwell et al.'s recent SIGGRAPH Asia paper on model customization with a single image pair. The code is available at github.com/PairCustomiz...

1 9

Reposted by Zhu -

Maxwell Jones @maxwelljones14.bsky.social · Dec 4

I created a huggingface space for my current work PairCustomization - You can choose from a set of pretrained LoRAs trained with our method, and run inference with our novel style guidance:
huggingface.co/spaces/pairc...

I demo'ed this at #SIGRAPHASIA2024 and it went great! :)
3/3

1 3

Reposted by Zhu -

Golan Levin @golan.bsky.social · Dec 2

#JobAlert! Come join me at Carnegie Mellon's School of Art— we're hiring an open-rank tenure-track professor in "Experimental Animation and Emerging Media Practices"! Deadline is Jan 5: art.cmu.edu/employment/#...

Employment - School of Art | Carnegie Mellon University

The School of Art seeks professional artists, educators and administrators with an interest in interdisciplinary practice and expanding what it means to be a school in the 21st Century.

art.cmu.edu

1 26 61

Reposted by Zhu -

Jia-Bin Huang @jbhuang0604.bsky.social · Nov 26

Introducing Generative Omnimatte:

A method for decomposing a video into complete layers, including objects and their associated effects (e.g., shadows, reflections).

It enables a wide range of cool applications, such as video stylization, compositions, moment retiming, and object removal.

3 20 130

Reposted by Zhu -

Shiry Ginosar @shiryginosar.bsky.social · Nov 12

I am recruiting exceptional PhD students & postdocs with an adventurous soul for my 💫new TTIC AI lab💫! We aim to understand intelligence, one pixel at a time, inspired by psychology, neuroscience, language, robotics, and the arts. Apply: www.ttic.edu/studentappli...

sites.google.com/ttic.edu/ope...

7 31