Reposted by Praneet
I wrote a post on multimodal interpretability techniques, including sparse feature circuit discovery, exploiting the shared text-image space of CLIP, and training adapters.
soniajoseph.ai/multimodal-i... 💜
soniajoseph.ai/multimodal-i... 💜
Multimodal interpretability in 2024
Multimodal interpretability, from sparse feature circuits with SAEs, to vision transformers leveraging CLIP's shared text-image space.
soniajoseph.ai
October 11, 2024 at 2:20 PM
I wrote a post on multimodal interpretability techniques, including sparse feature circuit discovery, exploiting the shared text-image space of CLIP, and training adapters.
soniajoseph.ai/multimodal-i... 💜
soniajoseph.ai/multimodal-i... 💜