These results provide a novel, mechanistic explanation of how perceptual and neural alignment across individuals is shaped by idiosyncrasies in prior experience.

Moreover, variations in participants' internal models predicted inter-subject correlations in BOLD time courses in the lateral occipital and lateral prefrontal cortices.

Individuals with more similar internal models showed more similar scene categorization performance and judged several scene properties (typicality, usability, and complexity) more similarly.

We then used the inter-subject similarities in internal models to predict inter-subject similarities in perceptual task performances and neural responses to a fully independent set of natural scenes.

To characterize these internal models, participants drew what they considered the most typical version of a given scene category. Using a combination of deep learning tools, we quantified inter-subject similarities in these drawings.

Here, we propose that idiosyncrasies in internal models—mental representations of what the world should look like—shape how individuals perceive and process natural scenes.

Every individual person perceives the visual world in their own unique way, yet we still know little about the origins of these individual differences.