The Evidence: Look at the spectral decay (scree plots).

Whether it’s Mistral LoRAs or Vision Transformers, the variance drops off a cliff. A tiny handful of 'unique' directions capture nearly ALL the information.

It’s not random. It’s a signature.

The "Independence" Myth: We usually assume that a model trained on medical X-rays lives in a different parameter space than one trained on satellite imagery.

We found the opposite.

Using spectral decomposition, we saw that weights from disjoint tasks converge to the same principal directions.