Isaac Handley-Miner
@ihandleyminer.bsky.social
Psychology postdoc studying how people think about truth and credibility, and interested in open science and metascience.
Reposted by Isaac Handley-Miner
Here's the link to our ever-expanding Collections! journals.sagepub.com/collection-i...
Advances in Methods and Practices in Psychological Science: Special collections
Subscription and open access journals from Sage, the world's leading independent academic publisher.
journals.sagepub.com
December 20, 2025 at 5:41 PM
Here's the link to our ever-expanding Collections! journals.sagepub.com/collection-i...
Reposted by Isaac Handley-Miner
The Max Planck Society has begun an exploratory round table for open science. We are drafting some recommendations to leadership. Still a long way to go! But here are my notes on the most recent draft, just so you all know how I am trying to steer things.
December 17, 2025 at 11:33 AM
The Max Planck Society has begun an exploratory round table for open science. We are drafting some recommendations to leadership. Still a long way to go! But here are my notes on the most recent draft, just so you all know how I am trying to steer things.
Reposted by Isaac Handley-Miner
Reposted by Isaac Handley-Miner
We're excited to share the application for the next Research Transparency and Reproducibility Training (RT2)! Join us May 19 - 21, 2026 in Berkeley for hands-on training in open science tools and methods.
Apply by Feb 8: cega.submittable.com/submit/34383...
Apply by Feb 8: cega.submittable.com/submit/34383...
Center for Effective Global Action Submission Manager
cega.submittable.com
December 15, 2025 at 7:44 PM
We're excited to share the application for the next Research Transparency and Reproducibility Training (RT2)! Join us May 19 - 21, 2026 in Berkeley for hands-on training in open science tools and methods.
Apply by Feb 8: cega.submittable.com/submit/34383...
Apply by Feb 8: cega.submittable.com/submit/34383...
Reposted by Isaac Handley-Miner
I'm teaching Statistical Rethinking again starting Jan 2026. This time with live lectures, divided into Beginner and Experienced sections. Will be a lot more work for me, but I hope much better for students.
I will record lectures & all will be found at this link: github.com/rmcelreath/s...
I will record lectures & all will be found at this link: github.com/rmcelreath/s...
December 9, 2025 at 1:58 PM
I'm teaching Statistical Rethinking again starting Jan 2026. This time with live lectures, divided into Beginner and Experienced sections. Will be a lot more work for me, but I hope much better for students.
I will record lectures & all will be found at this link: github.com/rmcelreath/s...
I will record lectures & all will be found at this link: github.com/rmcelreath/s...
Reposted by Isaac Handley-Miner
We're thrilled to open registration for our 1st 2026 Replication Games. The event will be at the University of Zurich on January 19th.
Psych, public health, pol sci and econ studies will be reproduced! Register here: www.surveymonkey.ca/r/Replicatio...
Psych, public health, pol sci and econ studies will be reproduced! Register here: www.surveymonkey.ca/r/Replicatio...
December 11, 2025 at 1:29 PM
We're thrilled to open registration for our 1st 2026 Replication Games. The event will be at the University of Zurich on January 19th.
Psych, public health, pol sci and econ studies will be reproduced! Register here: www.surveymonkey.ca/r/Replicatio...
Psych, public health, pol sci and econ studies will be reproduced! Register here: www.surveymonkey.ca/r/Replicatio...
Reposted by Isaac Handley-Miner
Just published in Behavior Research Methods:
The individual-level precision of implicit measures
w/ @ianhussey.mmmdata.io
🧵👇
link.springer.com/article/10.3...
The individual-level precision of implicit measures
w/ @ianhussey.mmmdata.io
🧵👇
link.springer.com/article/10.3...
The individual-level precision of implicit measures - Behavior Research Methods
Implicit measures are used extensively in psychological science. One fundamental goal of these measures is to provide information diagnostic of an individual’s attitudes or beliefs. After 25 years of ...
link.springer.com
December 9, 2025 at 11:20 AM
Just published in Behavior Research Methods:
The individual-level precision of implicit measures
w/ @ianhussey.mmmdata.io
🧵👇
link.springer.com/article/10.3...
The individual-level precision of implicit measures
w/ @ianhussey.mmmdata.io
🧵👇
link.springer.com/article/10.3...
Reposted by Isaac Handley-Miner
Join the virtual SIPS@SPSP 2026: Community Action Meeting — “Improving Open Science Resources for Social-Personality Psychology.”
💡 Topics: Registered reports, open data, replications, diversity & inclusion
🧠 Hands-on sessions + hackathons
🌍 All career stages welcome!
🔗
💡 Topics: Registered reports, open data, replications, diversity & inclusion
🧠 Hands-on sessions + hackathons
🌍 All career stages welcome!
🔗
Preconferences | SPSP
Explore SPSP Annual Convention preconferences—specialized sessions offering in-depth insights, networking, and collaboration in personality and social psychology.
buff.ly
December 5, 2025 at 3:04 PM
Join the virtual SIPS@SPSP 2026: Community Action Meeting — “Improving Open Science Resources for Social-Personality Psychology.”
💡 Topics: Registered reports, open data, replications, diversity & inclusion
🧠 Hands-on sessions + hackathons
🌍 All career stages welcome!
🔗
💡 Topics: Registered reports, open data, replications, diversity & inclusion
🧠 Hands-on sessions + hackathons
🌍 All career stages welcome!
🔗
Reposted by Isaac Handley-Miner
Join us in Berkeley on April 16th for the BITSS annual meeting
cega.berkeley.edu/event/bitss-...
cega.berkeley.edu/event/bitss-...
BITSS Annual Meeting 2026
The BITSS Annual Meeting brings together actors from academia, scholarly publishing, and policy to share novel research and discuss efforts to improve the credibility of social science by...
cega.berkeley.edu
December 3, 2025 at 10:00 PM
Join us in Berkeley on April 16th for the BITSS annual meeting
cega.berkeley.edu/event/bitss-...
cega.berkeley.edu/event/bitss-...
Reposted by Isaac Handley-Miner
If the field did an order of magnitude fewer studies total, and instead pooled resources to do more of these, knowledge production would dramatically accelerate.
We learn more from this one paper than from 50 one-offs examining the predictive validity of implicit measures.
We learn more from this one paper than from 50 one-offs examining the predictive validity of implicit measures.
December 2, 2025 at 2:46 PM
If the field did an order of magnitude fewer studies total, and instead pooled resources to do more of these, knowledge production would dramatically accelerate.
We learn more from this one paper than from 50 one-offs examining the predictive validity of implicit measures.
We learn more from this one paper than from 50 one-offs examining the predictive validity of implicit measures.
Reposted by Isaac Handley-Miner
In case you have missed Simine Vazire's excellent webinar yesterday, here is the link to watch it online: youtu.be/_vb1CNwC3CM Thanks again @simine.com for staying up so late and thanks to the audience for the great questions!
PCI Webinar series #13 - Simine Vazire - Recognizing and responding to a replication crisis
youtu.be
December 2, 2025 at 10:17 AM
In case you have missed Simine Vazire's excellent webinar yesterday, here is the link to watch it online: youtu.be/_vb1CNwC3CM Thanks again @simine.com for staying up so late and thanks to the audience for the great questions!
“We are hungry for the curtain to be pulled back … we want all the gory details and imperfections of a study out on the table, open and transparent for deep consideration. It is with and through this transparency that we step from the world of less good practices to the world of better ones.”
My time as Editor of AMPPS is coming to an end-- here are some parting thoughts. journals.sagepub.com/doi/full/10.... .
Taking Stock of Advances in Methods and Practices in Psychological Science at the End of the Beginning - David A. Sbarra, 2025
journals.sagepub.com
November 27, 2025 at 12:56 PM
“We are hungry for the curtain to be pulled back … we want all the gory details and imperfections of a study out on the table, open and transparent for deep consideration. It is with and through this transparency that we step from the world of less good practices to the world of better ones.”
Reposted by Isaac Handley-Miner
Interesting new special issue in Psychological Assessment.
Edited by Kristin Naragon-Gainey and @kstanton.bsky.social
Here's their overview paper: psycnet.apa.org/record/2026-...
And here's our contribution, which will win us no friends:
psycnet.apa.org/record/2026-...
Edited by Kristin Naragon-Gainey and @kstanton.bsky.social
Here's their overview paper: psycnet.apa.org/record/2026-...
And here's our contribution, which will win us no friends:
psycnet.apa.org/record/2026-...
October 24, 2025 at 4:00 PM
Interesting new special issue in Psychological Assessment.
Edited by Kristin Naragon-Gainey and @kstanton.bsky.social
Here's their overview paper: psycnet.apa.org/record/2026-...
And here's our contribution, which will win us no friends:
psycnet.apa.org/record/2026-...
Edited by Kristin Naragon-Gainey and @kstanton.bsky.social
Here's their overview paper: psycnet.apa.org/record/2026-...
And here's our contribution, which will win us no friends:
psycnet.apa.org/record/2026-...
Reposted by Isaac Handley-Miner
ANSWER: 0 (yes, ZERO!)
This is a result of an analysis done by a student in my grad seminar, using a large dataset (N=307,313).
What this result might mean: Nobody's personality is truly "average," and people's personality profiles (at least Big 5) might be more "jagged" than we think.
(🧵 1/5)
This is a result of an analysis done by a student in my grad seminar, using a large dataset (N=307,313).
What this result might mean: Nobody's personality is truly "average," and people's personality profiles (at least Big 5) might be more "jagged" than we think.
(🧵 1/5)
Imagine you have Big 5 personality scores from over 300,000 people. You designate the scores in the "mean +/- 0.25 SDs" range for each trait (~20%) as the average range.
QUESTION: How many people in this >300K sample do you think fall in the average range for ALL 5 TRAITS?
What's your answer?
QUESTION: How many people in this >300K sample do you think fall in the average range for ALL 5 TRAITS?
What's your answer?
September 7, 2025 at 3:03 PM
ANSWER: 0 (yes, ZERO!)
This is a result of an analysis done by a student in my grad seminar, using a large dataset (N=307,313).
What this result might mean: Nobody's personality is truly "average," and people's personality profiles (at least Big 5) might be more "jagged" than we think.
(🧵 1/5)
This is a result of an analysis done by a student in my grad seminar, using a large dataset (N=307,313).
What this result might mean: Nobody's personality is truly "average," and people's personality profiles (at least Big 5) might be more "jagged" than we think.
(🧵 1/5)
Reposted by Isaac Handley-Miner
v1.108 is rolling out today 🚚
Now live, at long last: Bookmarks, aka Saved Posts. For all those posts you'll definitely plan to come back to!
Update the app and give it a try. The button is right down there 👇
Now live, at long last: Bookmarks, aka Saved Posts. For all those posts you'll definitely plan to come back to!
Update the app and give it a try. The button is right down there 👇
September 8, 2025 at 6:24 PM
v1.108 is rolling out today 🚚
Now live, at long last: Bookmarks, aka Saved Posts. For all those posts you'll definitely plan to come back to!
Update the app and give it a try. The button is right down there 👇
Now live, at long last: Bookmarks, aka Saved Posts. For all those posts you'll definitely plan to come back to!
Update the app and give it a try. The button is right down there 👇
Reposted by Isaac Handley-Miner
As part of the Pilot Reporting Task Force, founded at @improvingpsych.org conference 2023, I would like to share a preprint with you: osf.io/preprints/ps.... We are looking for feedback on our perspective piece, promoting more transparency in the reporting of piloting in psychological science. 1/4
OSF
osf.io
September 3, 2025 at 4:07 PM
As part of the Pilot Reporting Task Force, founded at @improvingpsych.org conference 2023, I would like to share a preprint with you: osf.io/preprints/ps.... We are looking for feedback on our perspective piece, promoting more transparency in the reporting of piloting in psychological science. 1/4
Reposted by Isaac Handley-Miner
"Don't seat the baby near the door" 👶 Thanks to @infantstudies.bsky.social for the chance to discuss our task force work on making pilot study insights more transparent to improve psyc science!
@agataboch.bsky.social #OpenScience #DevPsySky #PilotStudies #PsychScience #Transparency
@agataboch.bsky.social #OpenScience #DevPsySky #PilotStudies #PsychScience #Transparency
New on the Baby Blog - Making pilots public and improving developmental science by @agataboch.bsky.social and @mbneff.bsky.social #EarlyYears #DevPsySky #PsychSciSky #science #research #infantstudies infantstudies.org/making-pilot...
September 3, 2025 at 9:01 AM
"Don't seat the baby near the door" 👶 Thanks to @infantstudies.bsky.social for the chance to discuss our task force work on making pilot study insights more transparent to improve psyc science!
@agataboch.bsky.social #OpenScience #DevPsySky #PilotStudies #PsychScience #Transparency
@agataboch.bsky.social #OpenScience #DevPsySky #PilotStudies #PsychScience #Transparency
Reposted by Isaac Handley-Miner
For those interested, here's our full preprint on the call for more transparent pilot study reporting: osf.io/preprints/ps...
@ihandleyminer.bsky.social #OpenScience #PilotStudies
@ihandleyminer.bsky.social #OpenScience #PilotStudies
"Don't seat the baby near the door" 👶 Thanks to @infantstudies.bsky.social for the chance to discuss our task force work on making pilot study insights more transparent to improve psyc science!
@agataboch.bsky.social #OpenScience #DevPsySky #PilotStudies #PsychScience #Transparency
@agataboch.bsky.social #OpenScience #DevPsySky #PilotStudies #PsychScience #Transparency
New on the Baby Blog - Making pilots public and improving developmental science by @agataboch.bsky.social and @mbneff.bsky.social #EarlyYears #DevPsySky #PsychSciSky #science #research #infantstudies infantstudies.org/making-pilot...
September 3, 2025 at 9:05 AM
For those interested, here's our full preprint on the call for more transparent pilot study reporting: osf.io/preprints/ps...
@ihandleyminer.bsky.social #OpenScience #PilotStudies
@ihandleyminer.bsky.social #OpenScience #PilotStudies
Reposted by Isaac Handley-Miner
New 📰
Demand characteristics are a fundamental methodological concern in research with humans
Yet little is known about the magnitude and consistency of these effects
In a new paper, I, M. Wyatt, and @mcxfrank.bsky.social take stock of what we’ve learned via meta-analysis
doi.org/10.1525/coll...
Demand characteristics are a fundamental methodological concern in research with humans
Yet little is known about the magnitude and consistency of these effects
In a new paper, I, M. Wyatt, and @mcxfrank.bsky.social take stock of what we’ve learned via meta-analysis
doi.org/10.1525/coll...
A Meta-Analysis of the Impact and Heterogeneity of Explicit Demand Characteristics
Demand characteristics are a fundamental methodological concern in experimental psychology. Yet, little is known about the direction, magnitude, and consistency of their effects. We conducted a three-...
doi.org
August 14, 2025 at 4:39 PM
New 📰
Demand characteristics are a fundamental methodological concern in research with humans
Yet little is known about the magnitude and consistency of these effects
In a new paper, I, M. Wyatt, and @mcxfrank.bsky.social take stock of what we’ve learned via meta-analysis
doi.org/10.1525/coll...
Demand characteristics are a fundamental methodological concern in research with humans
Yet little is known about the magnitude and consistency of these effects
In a new paper, I, M. Wyatt, and @mcxfrank.bsky.social take stock of what we’ve learned via meta-analysis
doi.org/10.1525/coll...
Reposted by Isaac Handley-Miner
Funding opportunity for SIPS members!
The Society for the Improvement of Psychological Science and Peer Community In Registered Reports invite researchers to submit research projects for consideration for research funding from SIPS and a recommendation decision from PCI-RR.
buff.ly/AigqCod
The Society for the Improvement of Psychological Science and Peer Community In Registered Reports invite researchers to submit research projects for consideration for research funding from SIPS and a recommendation decision from PCI-RR.
buff.ly/AigqCod
July 23, 2025 at 7:20 AM
Funding opportunity for SIPS members!
The Society for the Improvement of Psychological Science and Peer Community In Registered Reports invite researchers to submit research projects for consideration for research funding from SIPS and a recommendation decision from PCI-RR.
buff.ly/AigqCod
The Society for the Improvement of Psychological Science and Peer Community In Registered Reports invite researchers to submit research projects for consideration for research funding from SIPS and a recommendation decision from PCI-RR.
buff.ly/AigqCod
Reposted by Isaac Handley-Miner
Experimentology is out today!!! A group of us wrote a free online textbook for experimental methods, available at experimentology.io - the idea was to integrate open science into all aspects of the experimental workflow from planning to design, analysis, and writing.
July 1, 2025 at 6:26 PM
Experimentology is out today!!! A group of us wrote a free online textbook for experimental methods, available at experimentology.io - the idea was to integrate open science into all aspects of the experimental workflow from planning to design, analysis, and writing.
Reposted by Isaac Handley-Miner
I'm working on PaperCheck today, and would love to take queries about whether it could do something you'd like to accomplish more easily in your metascience workflow. I'll try to show you how, and maybe even get you to collaborate on adding a module!
scienceverse.github.io/papercheck/
scienceverse.github.io/papercheck/
Check Scientific Papers for Best Practices
A modular, extendable system for automatically checking scientific papers for best practices using text search, R code, and/or LLM queries.
scienceverse.github.io
June 25, 2025 at 10:56 AM
I'm working on PaperCheck today, and would love to take queries about whether it could do something you'd like to accomplish more easily in your metascience workflow. I'll try to show you how, and maybe even get you to collaborate on adding a module!
scienceverse.github.io/papercheck/
scienceverse.github.io/papercheck/
Reposted by Isaac Handley-Miner
Many-analysts approaches can help uncover analytical insecurity. The Journal of Robustness Reports publishes short reports that check alternative analytical approaches for articles. Very cool! 💪 #SIPS2025 @improvingpsych.org #OpenScience
June 25, 2025 at 12:11 PM
Many-analysts approaches can help uncover analytical insecurity. The Journal of Robustness Reports publishes short reports that check alternative analytical approaches for articles. Very cool! 💪 #SIPS2025 @improvingpsych.org #OpenScience
Reposted by Isaac Handley-Miner
We're back, with a fresh new lineup of talks and workshops!
Get your place while you still can to learn about how to make your research more robust and how to deal with scientific fraud!
This event is free and open to all: tinyurl.com/3ewaduvm
Get your place while you still can to learn about how to make your research more robust and how to deal with scientific fraud!
This event is free and open to all: tinyurl.com/3ewaduvm
June 11, 2025 at 9:44 AM
We're back, with a fresh new lineup of talks and workshops!
Get your place while you still can to learn about how to make your research more robust and how to deal with scientific fraud!
This event is free and open to all: tinyurl.com/3ewaduvm
Get your place while you still can to learn about how to make your research more robust and how to deal with scientific fraud!
This event is free and open to all: tinyurl.com/3ewaduvm
Reposted by Isaac Handley-Miner
My editorial on how journals can earn trust.
We often use journal names as proxies for quality. This is bad bc it’s not valid. But it could be. Editors could make journal name a valid signal. And we could place value on journals that show us how they do that.
journals.sagepub.com/doi/full/10....
We often use journal names as proxies for quality. This is bad bc it’s not valid. But it could be. Editors could make journal name a valid signal. And we could place value on journals that show us how they do that.
journals.sagepub.com/doi/full/10....
May 8, 2025 at 9:25 AM
My editorial on how journals can earn trust.
We often use journal names as proxies for quality. This is bad bc it’s not valid. But it could be. Editors could make journal name a valid signal. And we could place value on journals that show us how they do that.
journals.sagepub.com/doi/full/10....
We often use journal names as proxies for quality. This is bad bc it’s not valid. But it could be. Editors could make journal name a valid signal. And we could place value on journals that show us how they do that.
journals.sagepub.com/doi/full/10....