banner
fresejoris.bsky.social
Joris Frese
@fresejoris.bsky.social
3.5K followers 1.4K following 220 posts
PhD candidate in political science at the EUI. Interested in political behavior, quantitative methods, metascience. https://www.jorisfrese.com/
www.jorisfrese.com
Posts Media Videos Starter Packs
Pinned
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · May 21
🇪🇺🇦🇫 Published Today in CPS 🇪🇺🇦🇫

“Stand by those who share our values” – how refugees fleeing the Taliban improved European attitudes toward immigration

Article: journals.sagepub.com/doi/10.1177/...

Pre-print: osf.io/preprints/os...

Thread: 1/8
4 39 110
Reposted by Joris Frese
tiagoventura.bsky.social
Tiago Ventura @tiagoventura.bsky.social · 1d
How common are “survey professionals” - people who take dozens of online surveys for pay - across online panels, and do they harm data quality?

Our paper, FirstView at @politicalanalysis.bsky.social, tackles this question using browsing data from three U.S. samples (Facebook, YouGov, and Lucid):
4 49 130
Reposted by Joris Frese
ssreditorial.bsky.social
Social Science Research @ssreditorial.bsky.social · 2d
Work from Diana Roxana Galos and @fresejoris.bsky.social examines online social class cues and employability. This article is open access here: www.sciencedirect.com/science/arti...
3 12
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · 7d
Congratulations! 🥳
1 1
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · 22d
Thanks for sharing, Arnout!
1
Reposted by Joris Frese
arnoutvanderijt.bsky.social
Arnout van de Rijt @arnoutvanderijt.bsky.social · 23d
Brextinction!

From our student @fresejoris.bsky.social and colleagues @juhoharkonen.bsky.social @simonhix.bsky.social

ejpr.onlinelibrary.wiley.com/doi/10.1111/...
Brextinction? How cohort replacement has transformed support for Brexit
Public support for Brexit has declined since the 2016 referendum. We argue that part of this decline is due to cohort replacement where many older voters (who support Brexit) have passed away, while ...
ejpr.onlinelibrary.wiley.com
1 6 19
Reposted by Joris Frese
robinwigglesworth.ft.com
Robin Wigglesworth @robinwigglesworth.ft.com · 29d
Sentiment analysis on four decades worth of FT newspaper articles. 🥳 Rreally cool stuff from @joelsuss.ft.com. on.ft.com/4n2TVBq
10 35 110
Reposted by Joris Frese
andrew.heiss.phd
Andrew Heiss @andrew.heiss.phd · Sep 6
oh noooo
compared to last year’s results.” However, I take issue with the author’s subsequent interpretation of the most recent test scores which reflects poorly on his/her understanding of basic statistics. The differences in proficiency rates cited in throughout the article are overwhelmingly NOT STATISTICALLY SIGNIFICANT. Using a standard p-value of 0.05, any improvement in scores must show at least a gain of five percentage points in order to be considered as statistically significant. So, for example, even the slight decline in 4th grade ISAT scores in Idaho (2024 67.1%, 2025 64.6) is not significant. Similarly, the following assertion made by the author of the article is incorrect and misleading. “Students scoring in the advanced range of the proficient category saw a slight increase, with 23.2% scoring advanced in 2024 compared to 23.6% in 2025.” In order to have been statistically significant, 28.2% of students must have scored proficient in the language arts subtest.
20 64 410
Reposted by Joris Frese
britishelectionstudy.com
The British Election Study @britishelectionstudy.com · Sep 6
🚨DATA RELEASE 🚨

The BES team are pleased to announce the release of Wave 30 of the British Election Study Internet Panel.

Please follow the link below, and we look forward to seeing your research!

www.britishelectionstudy.com/bes-resource...
Release Note: British Election Study Internet Panel Wave 30 - The British Election Study
www.britishelectionstudy.com
1 12 27
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · Sep 6
🤯
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · Sep 5
This thread is a great takedown of a recent paper published in one of the top neurology journals. More evidence to bolster my impression that there is a LOT of really weak nutrition science out there getting disproportionate amounts of (uncritical) media coverage.
sophieehill.bsky.social
Sophie E. Hill @sophieehill.bsky.social · Sep 5
"Sweeteners can harm cognitive health equivalent to 1.6 years of ageing, study finds"

Or does it? Let's take a look at this "study"...

www.theguardian.com/food/2025/se...
Sweeteners can harm cognitive health equivalent to 1.6 years of ageing, study finds
Researchers say low- and no-calorie sweeteners appear to affect thinking and memory in middle age
www.theguardian.com
2 3 10
Reposted by Joris Frese
turnbulldugarte.com
Stuart Turnbull-Dugarte @turnbulldugarte.com · Sep 5
Radical right accommodation really does not work.

New paper out with this exceptionally talented team
@katharinalawall.bsky.social @robjohns75.bsky.social @drjennings.bsky.social @sarahobolt.bsky.social @zachdickson.bsky.social @danjdevine.bsky.social & @jack-bailey.co.uk

doi.org/10.31235/osf...
58 990 2.2K
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · Sep 4
Herzlichen Glückwunsch! 🥳
1 1
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · Aug 9
I personally have used z-curves in a meta-analytic paper of mine: journals.sagepub.com/doi/10.1177/.... See the brief excerpt of my appendix where I give some reasons why I prefer them over p-curves. The cited studies by Bartos, Brunner, and Schimmack go into much more detail on this.
2
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · Aug 9
This is a fantastic paper and thread, demonstrating clearly what many have suspected for years: p-curves don't really do what they purport to do. Better alternatives are out there!
richarddmorey.bsky.social
Richard D. Morey @richarddmorey.bsky.social · Aug 8
Paper drop, for anyone interested in #metascience, #statistics, or #metaanalysis! @clintin.bsky.social and I show in a new paper in JASA that the P-curve, a popular forensic meta-analysis method, has deeply undesirable statistical properties. www.tandfonline.com/doi/full/10.... 1/?
Cover page for the manuscript: Morey, R. D., & Davis-Stober, C. P. (2025). On the poor statistical properties of the P-curve meta-analytic procedure. Journal of the American Statistical Association, 1–19. https://doi.org/10.1080/01621459.2025.2544397 Abstract for the paper: The P-curve (Simonsohn, Nelson, & Simmons, 2014; Simonsohn, Simmons, & Nelson, 2015) is a widely-used suite of meta-analytic tests advertised for detecting problems in sets of studies. They are based on nonparametric combinations of p values (e.g., Marden, 1985) across significant (p < .05) studies and are variously claimed to detect “evidential value”, “lack of evidential value”, and “left skew” in p values. We show that these tests do not have the properties ascribed to them. Moreover, they fail basic desiderata for tests, including admissibility and monotonicity. In light of these serious problems, we recommend against the use of the P-curve tests.
1 5
Reposted by Joris Frese
aufdroeseler.bsky.social
Lukas Röseler @aufdroeseler.bsky.social · Aug 8
Thank you for this very impressive resource of 50 (!) reproducibility/replicability metrics; also includes a searchable online table at rachelheyard.com/reproducibil...
2 8
Reposted by Joris Frese
simonhix.bsky.social
Simon Hix @simonhix.bsky.social · Aug 7
Please share this thread. It is important that political scientists, in Europe and across the world, understand why EPSS exists and why we are encouraging people to attend our inaugural conference, in Belfast next June.
epssnet.bsky.social
EPSS @epssnet.bsky.social · Aug 7
EPSA have announced that they will hold a conference in July 2026.

😵‍💫 We understand that there might be some confusion about EPSS and EPSA.

👉🏽 So we thought we would clarify some things.

A short 🧵
1 74 120
Reposted by Joris Frese
behaviour-eui.bsky.social
EUI Political Behaviour Colloquium @behaviour-eui.bsky.social · Aug 6
📢 CALL FOR PAPERS!

We’re looking for presenters for the upcoming term (early October to mid-December 2025).

If you’d like to present, please fill out the form here: docs.google.com/forms/d/e/1F...

🗓 Deadline for proposals: August 31
EUI Political Behaviour Colloquium
Please fill in the details below to submit your proposal. Kindly provide the title and abstract of your paper, as well as your availability to present. The Colloquium is held every Tuesday from 17:00 ...
docs.google.com
2 21 25
Reposted by Joris Frese
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · Jul 21
🇨🇭🇪🇺 Just Published in Royal Society Open Science!

A scoping review on metrics to quantify reproducibility:
royalsocietypublishing.org/doi/10.1098/...

Ever conducted a replication and pondered when/how to conclude if it was (un)successful?
We have just the paper for you (led by Rachel Heyard)! 1/14
1 18 47
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · Jul 21
PS: Many thanks also to @forrt.bsky.social and @irise-eu.bsky.social for facilitating this interdisciplinary collaboration!
1 2
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · Jul 21
Rachel Heyard did an incredible job leading this project. Anyone interested in replication and open science should definitely check out her other work! 14/14
1 2
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · Jul 21
We hope that this paper can be useful for anyone conducting replication studies, as it provides a comprehensive, yet accessible, overview of the many ways to quantify replication success, and helps to pinpoint those that most closely align with the specific aims of a given study. 13/14
1 2
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · Jul 21
In the brief excerpts of the Table here, you may already identify several metrics that could be more suitable for the stylized examples described earlier in this thread (compared to a simple significance test), such as meta-analytic tests for (i) and tests based on effect sizes for (ii). 12/14
1 2
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · Jul 21
There are lots of informative summary statistics on all these parameters in the review, but the heart and the main contribution of our paper is Table 4, where we offer an overview of each of the 50 different reproducibility metrics and their use-cases. 11/14
1 2
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · Jul 21
… whether they are quantitative or qualitative, whether they were originally introduced as reproducibility metrics or for other purposes, which precise questions they help to answer, etc. 10/14
1 3
fresejoris.bsky.social
Joris Frese @fresejoris.bsky.social · Jul 21
For these papers, a team of six coders extracted information on all metrics for the assessment of replication success, including their names, their description, their exact purpose (e.g., to quantify, to classify, or to predict reproducibility), the data inputs they require, 9/14
1 3