We emphasize the need for diverse samples, method validation, transparency, and ethical considerations to ensure robust, generalizable findings free from demographic biases. We advocate for rigor and replicability over convenience in integrating AI into psych research.

We further demonstrate that smaller, simpler, more transparent, and importantly reproducible methods can often match or surpass the performance of these large complex models.

We introduce the concept of "GPTology" – the rapid and uncritical use of Large Language Models (LLMs) in psychology, which risks producing misleading research due to biases and opaque methodologies.

We investigate the application of LLMs in psychological research, addressing both their applications in text analysis and as stand-ins for human participants.

New Preprint: "Perils and Opportunities in Using Large Language Models in Psychological Research." osf.io/tg79n

@mdehghani.bsky.social @aliomrani.bsky.social @mohammadatari.bsky.social