Bob C-J and Geoff Cumming
@thenewstats.bsky.social
Open science, estimation statistics, and random thoughts from Bob Calin-Jageman and Geoff Cumming. https://thenewstatistics.com/itns/
Pinned
Look what you can find in the latest version of JASP:
**esci**
That's right, all your favorite estimation-focused analyses, strong hypothesis testing, and meta-analysis are available in the esci module for JASP 0.95.
#stats #metascience
Many thanks to the good people at @jaspstats.bsky.social
**esci**
That's right, all your favorite estimation-focused analyses, strong hypothesis testing, and meta-analysis are available in the esci module for JASP 0.95.
#stats #metascience
Many thanks to the good people at @jaspstats.bsky.social
So excited to see DaBest 2.0 is out: get bootstrapped estimation statistics for simple through complex designs, all with beautiful visualization, available in R and Python.
Check it out!
Pre-print describing new features for complex designs: www.biorxiv.org/content/10.6...
#stats
Check it out!
Pre-print describing new features for complex designs: www.biorxiv.org/content/10.6...
#stats
Getting over ANOVA: Estimation graphics for multi-group comparisons
Data analysis in experimental science mainly relies on null-hypothesis significance testing, despite its well-known limitations. A powerful alternative is estimation statistics, which focuses on effect-size quantification. However, current estimation tools struggle with the complex, multi-group comparisons common in biological research. Here we introduce DABEST 2.0, an estimation framework for complex experimental designs, including shared-control, repeated-measures, two-way factorial experiments, and meta-analysis of replicates. ### Competing Interest Statement The authors have declared no competing interest.
www.biorxiv.org
January 29, 2026 at 3:08 PM
So excited to see DaBest 2.0 is out: get bootstrapped estimation statistics for simple through complex designs, all with beautiful visualization, available in R and Python.
Check it out!
Pre-print describing new features for complex designs: www.biorxiv.org/content/10.6...
#stats
Check it out!
Pre-print describing new features for complex designs: www.biorxiv.org/content/10.6...
#stats
Looking forward to reading this retrospective on the promise and perils of organizing an RRR with in-person data collected.
From: @aggieerin.bsky.social , @psforscher.bsky.social , and others.
#stats
doi.org/10.1111/spc3...
From: @aggieerin.bsky.social , @psforscher.bsky.social , and others.
#stats
doi.org/10.1111/spc3...
The Challenges and Solutions of In‐Person Big‐Team Science
Big-Team Science (BTS) offers a powerful framework for advancing psychological research through large-scale collaboration, yet the unique challenges of conducting in-person BTS studies remain under-e....
doi.org
January 26, 2026 at 1:42 AM
Looking forward to reading this retrospective on the promise and perils of organizing an RRR with in-person data collected.
From: @aggieerin.bsky.social , @psforscher.bsky.social , and others.
#stats
doi.org/10.1111/spc3...
From: @aggieerin.bsky.social , @psforscher.bsky.social , and others.
#stats
doi.org/10.1111/spc3...
Reposted by Bob C-J and Geoff Cumming
Comparing registrations to published papers is essential to research integrity - and almost no one does it routinely because it's slow, messy, and time-demanding.
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
RegCheck
RegCheck is an AI tool to compare preregistrations with papers instantly.
regcheck.app
January 22, 2026 at 11:05 AM
Comparing registrations to published papers is essential to research integrity - and almost no one does it routinely because it's slow, messy, and time-demanding.
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
RegCheck was built to help make this process easier.
Today, we launch RegCheck V2.
🧵
regcheck.app
esci 1.0.9 is now on CRAN.
No big changes, just a couple of bug fixes and some compatibility changes for statpsych 1.9. Still a great easy way to get effect sizes and fair tests for many common designs.
cran.r-project.org/web/packages...
#stats
No big changes, just a couple of bug fixes and some compatibility changes for statpsych 1.9. Still a great easy way to get effect sizes and fair tests for many common designs.
cran.r-project.org/web/packages...
#stats
esci: Estimation Statistics with Confidence Intervals
A collection of functions and 'jamovi' module for the estimation approach to inferential statistics, the approach which emphasizes effect sizes, interval estimates, and meta-analysis. Nearly all funct...
cran.r-project.org
January 16, 2026 at 11:58 PM
esci 1.0.9 is now on CRAN.
No big changes, just a couple of bug fixes and some compatibility changes for statpsych 1.9. Still a great easy way to get effect sizes and fair tests for many common designs.
cran.r-project.org/web/packages...
#stats
No big changes, just a couple of bug fixes and some compatibility changes for statpsych 1.9. Still a great easy way to get effect sizes and fair tests for many common designs.
cran.r-project.org/web/packages...
#stats
thenewstatistics.com/itns/2026/01...
A statistics textbook for the AI era
A statistics textbook for the AI era
January 16, 2026 at 10:44 PM
thenewstatistics.com/itns/2026/01...
A statistics textbook for the AI era
A statistics textbook for the AI era
January 16, 2026 at 10:41 PM
The Faculty for Undergraduate Teaching Workshop is back this summer, July16-19, right outside of Chicago. A great conference with great people. Registration and abstract submission are open… it is going to be great!
#neuroscience
www.funfaculty.org/conference_2...
#neuroscience
www.funfaculty.org/conference_2...
January 15, 2026 at 9:50 PM
The Faculty for Undergraduate Teaching Workshop is back this summer, July16-19, right outside of Chicago. A great conference with great people. Registration and abstract submission are open… it is going to be great!
#neuroscience
www.funfaculty.org/conference_2...
#neuroscience
www.funfaculty.org/conference_2...
Another threat to stereotype threat?
An RRR (in press, AMPPS) shows the ~0 impact of stereotype threat on female math performance.
Fantastic, arduous work from leads Andrea Stoevenbelt, Paulette C. Flore, and Jelte Wicherts (and DU alum @luis-a-gomez.bsky.social) #stats
osf.io/preprints/ps...
An RRR (in press, AMPPS) shows the ~0 impact of stereotype threat on female math performance.
Fantastic, arduous work from leads Andrea Stoevenbelt, Paulette C. Flore, and Jelte Wicherts (and DU alum @luis-a-gomez.bsky.social) #stats
osf.io/preprints/ps...
![The stereotype-threat effect among
women was virtually null and not significant (N = 1275, g = 0.04, SE = 0.08, 95% CI [-0.11; 0.20]), and considerably smaller than the original study (N = 45, d = -0.82; 95% CI [-1.45; -0.18]).](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:e5f5rq7efhdu5bfrwv6wrtgq/bafkreie6nkepnzjuyosfaftnl4jxvpvp6mhyouont2op6pljvxxmgngqri@jpeg)
January 14, 2026 at 2:31 PM
Another threat to stereotype threat?
An RRR (in press, AMPPS) shows the ~0 impact of stereotype threat on female math performance.
Fantastic, arduous work from leads Andrea Stoevenbelt, Paulette C. Flore, and Jelte Wicherts (and DU alum @luis-a-gomez.bsky.social) #stats
osf.io/preprints/ps...
An RRR (in press, AMPPS) shows the ~0 impact of stereotype threat on female math performance.
Fantastic, arduous work from leads Andrea Stoevenbelt, Paulette C. Flore, and Jelte Wicherts (and DU alum @luis-a-gomez.bsky.social) #stats
osf.io/preprints/ps...
Some frank talk about paper mills from @sfnjournals.bsky.social .
(maybe @cbmetznancy.bsky.social ).
Really hard to see how the integrity of scientific publishing will hold up against the incentives and the tools to cheat.
#neuroscience
www.eneuro.org/content/13/1...
(maybe @cbmetznancy.bsky.social ).
Really hard to see how the integrity of scientific publishing will hold up against the incentives and the tools to cheat.
#neuroscience
www.eneuro.org/content/13/1...
AI-Generated Scientific Papers: Crisis? What Crisis?
Picture a man in a deckchair, umbrella overhead, relaxing with a drink in hand—while surrounded by industrial wasteland and decay. This was the iconic 1975 album cover for Supertramp's Crisis? What Cr...
www.eneuro.org
January 14, 2026 at 2:14 PM
Some frank talk about paper mills from @sfnjournals.bsky.social .
(maybe @cbmetznancy.bsky.social ).
Really hard to see how the integrity of scientific publishing will hold up against the incentives and the tools to cheat.
#neuroscience
www.eneuro.org/content/13/1...
(maybe @cbmetznancy.bsky.social ).
Really hard to see how the integrity of scientific publishing will hold up against the incentives and the tools to cheat.
#neuroscience
www.eneuro.org/content/13/1...
Most neuroscience data is *not* normally distributed... so what should you do about it?
Here's a great tutorial from @mikemalekahmadi.bsky.social focused on regression techniques for non-normal data: www.eneuro.org/content/13/1...
#stats
#neuroscience
Here's a great tutorial from @mikemalekahmadi.bsky.social focused on regression techniques for non-normal data: www.eneuro.org/content/13/1...
#stats
#neuroscience
Most Neuroscience Data Is Not Normally Distributed: Analyzing Your Data in a Non-normal World
While the most common statistical tests assume that the error of the dependent variable follows a normal distribution, dependent variables in translational neuroscience studies often fail to meet this...
www.eneuro.org
January 9, 2026 at 4:02 PM
Most neuroscience data is *not* normally distributed... so what should you do about it?
Here's a great tutorial from @mikemalekahmadi.bsky.social focused on regression techniques for non-normal data: www.eneuro.org/content/13/1...
#stats
#neuroscience
Here's a great tutorial from @mikemalekahmadi.bsky.social focused on regression techniques for non-normal data: www.eneuro.org/content/13/1...
#stats
#neuroscience
Another paper I want to read, this one on the interpretation of effect sizes, with data on actual use in psychology.
Seems to be another contribution to sentiment that we need to get over Cohen's d -- raw score effect sizes are usually best!
doi.org/10.1057/s415...
Seems to be another contribution to sentiment that we need to get over Cohen's d -- raw score effect sizes are usually best!
doi.org/10.1057/s415...
The use and interpretation of unstandardized and standardized effect sizes in psychology: current practices and challenges - Humanities and Social Sciences Communications
Humanities and Social Sciences Communications - The use and interpretation of unstandardized and standardized effect sizes in psychology: current practices and challenges
doi.org
December 30, 2025 at 11:11 PM
Another paper I want to read, this one on the interpretation of effect sizes, with data on actual use in psychology.
Seems to be another contribution to sentiment that we need to get over Cohen's d -- raw score effect sizes are usually best!
doi.org/10.1057/s415...
Seems to be another contribution to sentiment that we need to get over Cohen's d -- raw score effect sizes are usually best!
doi.org/10.1057/s415...
This looks like an interesting discussion of I2 and its interpretation for meta-analysis: doi.org/10.1017/rsm....
Reflections on the I-squared index for measuring inconsistency in meta-analysis | Research Synthesis Methods | Cambridge Core
Reflections on the I-squared index for measuring inconsistency in meta-analysis
doi.org
December 30, 2025 at 11:00 PM
This looks like an interesting discussion of I2 and its interpretation for meta-analysis: doi.org/10.1017/rsm....
Here's an intriguing new(ish) finding from our lab: as a memory is forgotten, transcription seems to fade more rapidly than memory expression.
This is a project we completed in 2019 and finally had a chance to write about: www.biorxiv.org/content/10.6...
#neuroscience
This is a project we completed in 2019 and finally had a chance to write about: www.biorxiv.org/content/10.6...
#neuroscience
Transcriptional Changes Fade Prior to Long-Term Memory for Sensitization of the Aplysia Siphon-Withdrawal Reflex
Forming a long-term memory requires changes in neuronal transcription. What happens, though, as the memory is forgotten? And how does the transcriptional state relate to the maintenance and recall of ...
www.biorxiv.org
December 30, 2025 at 10:37 PM
Here's an intriguing new(ish) finding from our lab: as a memory is forgotten, transcription seems to fade more rapidly than memory expression.
This is a project we completed in 2019 and finally had a chance to write about: www.biorxiv.org/content/10.6...
#neuroscience
This is a project we completed in 2019 and finally had a chance to write about: www.biorxiv.org/content/10.6...
#neuroscience
Whoever did this, I love you: www.youtube.com/watch?v=pGfN...
1. I watched 40+ hours of Sapolsky neuroscience videos. Madness.
YouTube video by phoboukaideimou
www.youtube.com
December 8, 2025 at 2:00 PM
Whoever did this, I love you: www.youtube.com/watch?v=pGfN...
Reposted by Bob C-J and Geoff Cumming
New paper in press at JPSP! An adversarial collaboration focusing on a large-scale test of how strongly implicit racial attitudes predict discriminatory behavior. Pre-print here: osf.io/preprints/ps...
December 2, 2025 at 2:14 PM
New paper in press at JPSP! An adversarial collaboration focusing on a large-scale test of how strongly implicit racial attitudes predict discriminatory behavior. Pre-print here: osf.io/preprints/ps...
An unbiased tally of social science experiments shows less than 1/3 of hypotheses were supported. This is what our research literature *should* look like.
Biggest predictor of success was sample size, but largely due to ability to detect trivial effects.
Biggest predictor of success was sample size, but largely due to ability to detect trivial effects.
Needed - larger samples, more realism about (the lack of) heterogeneous treatment effects:
-"less than a third of proposed hypotheses were supported... the largest predictor of positive exp. results was sample size"
-"moderation hypotheses were rarely significant"
academic.oup.com/poq/advance-...
-"less than a third of proposed hypotheses were supported... the largest predictor of positive exp. results was sample size"
-"moderation hypotheses were rarely significant"
academic.oup.com/poq/advance-...
An Audit of Social Science Survey Experiments
Abstract. Survey experiments have become a popular methodology for causal inference across the social sciences. We study the efficacy of survey experiment
academic.oup.com
November 30, 2025 at 4:08 PM
An unbiased tally of social science experiments shows less than 1/3 of hypotheses were supported. This is what our research literature *should* look like.
Biggest predictor of success was sample size, but largely due to ability to detect trivial effects.
Biggest predictor of success was sample size, but largely due to ability to detect trivial effects.
Today's a good day to register for PsychTerms, an online workshop on the teaching of statistics and methods that will be held Dec 10-11: www.psychterms.com
Lots of great presentations to help pump up your teaching mojo for spring semester.
#stats
Lots of great presentations to help pump up your teaching mojo for spring semester.
#stats
Conference
Information
Learn more about the conference!
www.psychterms.com
November 27, 2025 at 7:51 PM
Today's a good day to register for PsychTerms, an online workshop on the teaching of statistics and methods that will be held Dec 10-11: www.psychterms.com
Lots of great presentations to help pump up your teaching mojo for spring semester.
#stats
Lots of great presentations to help pump up your teaching mojo for spring semester.
#stats
Estimation is catching on!
The esci module in @jamovi.bsky.social was installed over 3,000 times in November. The R package in CRAN is getting an additional 250 downloads a month.
Are you estimation curious? So easy to get started with esci: rcalinjageman.github.io/esci/
#stats
The esci module in @jamovi.bsky.social was installed over 3,000 times in November. The R package in CRAN is getting an additional 250 downloads a month.
Are you estimation curious? So easy to get started with esci: rcalinjageman.github.io/esci/
#stats
November 25, 2025 at 8:30 PM
Estimation is catching on!
The esci module in @jamovi.bsky.social was installed over 3,000 times in November. The R package in CRAN is getting an additional 250 downloads a month.
Are you estimation curious? So easy to get started with esci: rcalinjageman.github.io/esci/
#stats
The esci module in @jamovi.bsky.social was installed over 3,000 times in November. The R package in CRAN is getting an additional 250 downloads a month.
Are you estimation curious? So easy to get started with esci: rcalinjageman.github.io/esci/
#stats
We're not shocked at all the fake conference/paper inquiries we get but:
I got an email from an editor at Elsevier asking me to adapt a presentation they had seen me make at SFN.... a presentation I had *not* ended up making.
Why do we just shrug off routine mendacity like this?
#neuroskyence
I got an email from an editor at Elsevier asking me to adapt a presentation they had seen me make at SFN.... a presentation I had *not* ended up making.
Why do we just shrug off routine mendacity like this?
#neuroskyence
November 25, 2025 at 8:04 PM
We're not shocked at all the fake conference/paper inquiries we get but:
I got an email from an editor at Elsevier asking me to adapt a presentation they had seen me make at SFN.... a presentation I had *not* ended up making.
Why do we just shrug off routine mendacity like this?
#neuroskyence
I got an email from an editor at Elsevier asking me to adapt a presentation they had seen me make at SFN.... a presentation I had *not* ended up making.
Why do we just shrug off routine mendacity like this?
#neuroskyence
Here's a nice discussion of effect sizes in cognitive neuroscience, with real examples and an discussion of using null intervals. Lots of good advice here; if you've been interested in inference by interval, this is a great resource.
#Neuroskyence #stats
doi.org/10.1016/j.dc...
#Neuroskyence #stats
doi.org/10.1016/j.dc...
Redirecting
doi.org
November 23, 2025 at 4:13 PM
Here's a nice discussion of effect sizes in cognitive neuroscience, with real examples and an discussion of using null intervals. Lots of good advice here; if you've been interested in inference by interval, this is a great resource.
#Neuroskyence #stats
doi.org/10.1016/j.dc...
#Neuroskyence #stats
doi.org/10.1016/j.dc...
New analysis of statistical (mal)practice in top journals shows widespread problems in how correlations are reported and interpreted.
What is the word I keep reaching for that would mean: not surprised and yet still deeply shocked?
arxiv.org/abs/2511.14092
@nature.com,
@natneuro.nature.com
What is the word I keep reaching for that would mean: not surprised and yet still deeply shocked?
arxiv.org/abs/2511.14092
@nature.com,
@natneuro.nature.com
The Prevalence of Misreporting and Misinterpreting Correlation Coefficients in Biomedical Literature
Correlation coefficient is widely used in biomedical and biological literature, yet its frequent misuse and misinterpretation undermine the credibility and reproducibility of the scientific findings. ...
arxiv.org
November 20, 2025 at 7:27 PM
New analysis of statistical (mal)practice in top journals shows widespread problems in how correlations are reported and interpreted.
What is the word I keep reaching for that would mean: not surprised and yet still deeply shocked?
arxiv.org/abs/2511.14092
@nature.com,
@natneuro.nature.com
What is the word I keep reaching for that would mean: not surprised and yet still deeply shocked?
arxiv.org/abs/2511.14092
@nature.com,
@natneuro.nature.com
Another CREP study out in print: online.ucpress.edu/collabra/art...
Congrats to all the students and dedicated faculty mentors involved, like @aggieerin.bsky.social ky.social and @jorowags.bsky.social
Get your students involved in CREP: www.crep-psych.org!
#stats #psychology
Congrats to all the students and dedicated faculty mentors involved, like @aggieerin.bsky.social ky.social and @jorowags.bsky.social
Get your students involved in CREP: www.crep-psych.org!
#stats #psychology
Collaborative Registered Replication of Griskevicius et al. (2010): Can Pro-environmental Behavior Be Promoted by Priming Status Motivation?
The present study presents the results of a collaborative registered replication of Griskevicius et al. (2010, Experiment 1). As part of the Collaborative Replication and Education Project, 24 student...
online.ucpress.edu
September 18, 2025 at 3:23 PM
Another CREP study out in print: online.ucpress.edu/collabra/art...
Congrats to all the students and dedicated faculty mentors involved, like @aggieerin.bsky.social ky.social and @jorowags.bsky.social
Get your students involved in CREP: www.crep-psych.org!
#stats #psychology
Congrats to all the students and dedicated faculty mentors involved, like @aggieerin.bsky.social ky.social and @jorowags.bsky.social
Get your students involved in CREP: www.crep-psych.org!
#stats #psychology
September 4, 2025 at 12:00 AM
What We’ll Never Know
thenewstatistics.com/itns/2025/09...
Use these to lobby your politicians, not only if you are in the U.S. Suggest further makers of videos: [email protected]
thenewstatistics.com/itns/2025/09...
Use these to lobby your politicians, not only if you are in the U.S. Suggest further makers of videos: [email protected]
What We’ll Never Know | Introduction to the New Statistics
Message just in from James Pennebaker, President of the APS, about a sadly highly important project by Tim Wilson. Tim is collecting a bunch of short punchy videos on the theme of 'what we'll never kn...
thenewstatistics.com
September 3, 2025 at 11:56 PM
What We’ll Never Know
thenewstatistics.com/itns/2025/09...
Use these to lobby your politicians, not only if you are in the U.S. Suggest further makers of videos: [email protected]
thenewstatistics.com/itns/2025/09...
Use these to lobby your politicians, not only if you are in the U.S. Suggest further makers of videos: [email protected]