Daniel Lakens
@lakens.bsky.social
Metascience, statistics, psychology, philosophy of science. Eindhoven University of Technology, The Netherlands. Omnia probate. 🇪🇺
Pinned
Daniel Lakens
@lakens.bsky.social
· Apr 14
OSF
osf.io
My paper on concerns about replicability, theorizing, relevance, generalizability, and methodology across 2 crises is now in press at the International Review of Social Psychology. After revisions it was 17500 words, so it is split in 2 parts: osf.io/dtvs7_v2 and osf.io/g6kja_v1
Second keynote of the day, Femke Truijens, from the Erasmus University, talking about what it means to be an 'error' in mental health research. #PSE8 After this we will have posters, drinks, and continue discussions over dinner!
February 11, 2026 at 3:07 PM
Second keynote of the day, Femke Truijens, from the Erasmus University, talking about what it means to be an 'error' in mental health research. #PSE8 After this we will have posters, drinks, and continue discussions over dinner!
Now Finn Luebber from the University of Lübeck discussing if the benefits of peer review for grants is worth the costs. In his talk he will also go into lotteries as an alternative approach to fund research. #PSE8
February 11, 2026 at 1:45 PM
Now Finn Luebber from the University of Lübeck discussing if the benefits of peer review for grants is worth the costs. In his talk he will also go into lotteries as an alternative approach to fund research. #PSE8
We are back after lunch, and continue with Rink Hoekstra, with a talk calling for more transparency and accountability in scientific publishing. #PSE8
February 11, 2026 at 1:06 PM
We are back after lunch, and continue with Rink Hoekstra, with a talk calling for more transparency and accountability in scientific publishing. #PSE8
Now the first keynote of the conference, Vlasta Sikimić, who will talk about the importance of intellectual virtues, and their role in a future in which we might have a bigger role of AI in the evaluation or review of scientific grants and papers. #PSE8
February 11, 2026 at 10:26 AM
Now the first keynote of the conference, Vlasta Sikimić, who will talk about the importance of intellectual virtues, and their role in a future in which we might have a bigger role of AI in the evaluation or review of scientific grants and papers. #PSE8
When we want to distinguish erroneous results from true effects, we need to perform replication studies where we systematically vary factors that aim to isolate the source of the error in repeated conceptual and direct replications. We need to "probe" for sources of error!
February 11, 2026 at 9:35 AM
When we want to distinguish erroneous results from true effects, we need to perform replication studies where we systematically vary factors that aim to isolate the source of the error in repeated conceptual and direct replications. We need to "probe" for sources of error!
Douglas Allchin summarizes many examples in the history of science where artifacts replicate very well. #PSE8
Lovely examples (like N-rays) of the trivial truth that successful replications do not imply the truth. But replications are essential to figure out what's what!
Lovely examples (like N-rays) of the trivial truth that successful replications do not imply the truth. But replications are essential to figure out what's what!
February 11, 2026 at 9:31 AM
Douglas Allchin summarizes many examples in the history of science where artifacts replicate very well. #PSE8
Lovely examples (like N-rays) of the trivial truth that successful replications do not imply the truth. But replications are essential to figure out what's what!
Lovely examples (like N-rays) of the trivial truth that successful replications do not imply the truth. But replications are essential to figure out what's what!
Now Douglas Allchin from the University of Minnesota, taking a history of science perspective on errors in science. #PSE8 He will dig into Joseph Priestley's 1771 experiment on the restoration of air (unknown to most audience members!)
February 11, 2026 at 9:23 AM
Now Douglas Allchin from the University of Minnesota, taking a history of science perspective on errors in science. #PSE8 He will dig into Joseph Priestley's 1771 experiment on the restoration of air (unknown to most audience members!)
Can scientist perhaps recognize true signals among all errors? Aurélien thinks this might be the case. Scientists can at least rank order effect sizes, although they are overly positive about the actual effect size.
February 11, 2026 at 9:07 AM
Can scientist perhaps recognize true signals among all errors? Aurélien thinks this might be the case. Scientists can at least rank order effect sizes, although they are overly positive about the actual effect size.
Now Aurélien Allard with the second talk of #PSE8: How is it possible that there is massive scientific progress, even thought there is a lot of scientific error?
February 11, 2026 at 8:51 AM
Now Aurélien Allard with the second talk of #PSE8: How is it possible that there is massive scientific progress, even thought there is a lot of scientific error?
Without publication bias, we might not need many replications. With publication bias, 20% to 40% might be justified (but of course, extremely dependent on the assumptions in the simulations!). If the field is a mess, we need a lot of replication studies to clean up!
February 11, 2026 at 8:40 AM
Without publication bias, we might not need many replications. With publication bias, 20% to 40% might be justified (but of course, extremely dependent on the assumptions in the simulations!). If the field is a mess, we need a lot of replication studies to clean up!
In her simulations, she observes an intriguing finding that there are diminishing returns of large sample sizes, if there is no publication bias. With publication bias and small samples, progress can be negative, and doing replications matters little. #PSE8
February 11, 2026 at 8:38 AM
In her simulations, she observes an intriguing finding that there are diminishing returns of large sample sizes, if there is no publication bias. With publication bias and small samples, progress can be negative, and doing replications matters little. #PSE8
First talk of the Perspectives on Scientific Error conference under way! Kaitlyn Harper from LMU, Munich, talking about how we should balance novelty and replication.
February 11, 2026 at 8:24 AM
First talk of the Perspectives on Scientific Error conference under way! Kaitlyn Harper from LMU, Munich, talking about how we should balance novelty and replication.
Reposted by Daniel Lakens
How do we know our research results are REAL? We replicate them! Most folks agree but lament on how hard it is to publish these replications.
My dearest gentle reader, lament no more! Delighted to unveil: Replication Studies, a new section of Behavioral Ecology 1/
academic.oup.com/beheco/artic...
My dearest gentle reader, lament no more! Delighted to unveil: Replication Studies, a new section of Behavioral Ecology 1/
academic.oup.com/beheco/artic...
Replication studies: a win-win for early-career training and behavioral ecology
Replicating previous research builds confidence that results are real and meaningful. But close replications are rare due to limitations in resources and d
academic.oup.com
February 10, 2026 at 7:42 PM
How do we know our research results are REAL? We replicate them! Most folks agree but lament on how hard it is to publish these replications.
My dearest gentle reader, lament no more! Delighted to unveil: Replication Studies, a new section of Behavioral Ecology 1/
academic.oup.com/beheco/artic...
My dearest gentle reader, lament no more! Delighted to unveil: Replication Studies, a new section of Behavioral Ecology 1/
academic.oup.com/beheco/artic...
Reposted by Daniel Lakens
so excited to join #PSE8! can’t wait to meet friends IRL and get some inspiration on what to do with my academic life in the age of AI 😅 the line-up is 🔥 perspectivesonscientificerror2026.wordpress.com and they even got @fbartos.bsky.social as a keynote! 😊
Everything is ready for the Perspectives on Scientific Error conference that starts tomorrow in Leiden! I look forward to hanging out with the mix of metascientists, philosophers of science, and statisticians! So many old friends will be there (and hopefully some new ones)! #PSE8
February 10, 2026 at 5:38 PM
so excited to join #PSE8! can’t wait to meet friends IRL and get some inspiration on what to do with my academic life in the age of AI 😅 the line-up is 🔥 perspectivesonscientificerror2026.wordpress.com and they even got @fbartos.bsky.social as a keynote! 😊
Everything is ready for the Perspectives on Scientific Error conference that starts tomorrow in Leiden! I look forward to hanging out with the mix of metascientists, philosophers of science, and statisticians! So many old friends will be there (and hopefully some new ones)! #PSE8
February 10, 2026 at 5:10 PM
Everything is ready for the Perspectives on Scientific Error conference that starts tomorrow in Leiden! I look forward to hanging out with the mix of metascientists, philosophers of science, and statisticians! So many old friends will be there (and hopefully some new ones)! #PSE8
I think @annaveer.bsky.social is the local!
February 10, 2026 at 4:11 PM
I think @annaveer.bsky.social is the local!
Reposted by Daniel Lakens
NEW BLOG!
Ruxandra Teslo @ruxandrabio.bsky.social, Adam Kroetsch, Manjari Narayan @neurostats.org, Witold Więcek and I have started a joint blog on clinical trial reform.
We'll aim to publish weekly on how to make clinical trials more efficient.
Subscribe: clinicaltrialsabundance.blog
Ruxandra Teslo @ruxandrabio.bsky.social, Adam Kroetsch, Manjari Narayan @neurostats.org, Witold Więcek and I have started a joint blog on clinical trial reform.
We'll aim to publish weekly on how to make clinical trials more efficient.
Subscribe: clinicaltrialsabundance.blog
February 9, 2026 at 4:50 PM
NEW BLOG!
Ruxandra Teslo @ruxandrabio.bsky.social, Adam Kroetsch, Manjari Narayan @neurostats.org, Witold Więcek and I have started a joint blog on clinical trial reform.
We'll aim to publish weekly on how to make clinical trials more efficient.
Subscribe: clinicaltrialsabundance.blog
Ruxandra Teslo @ruxandrabio.bsky.social, Adam Kroetsch, Manjari Narayan @neurostats.org, Witold Więcek and I have started a joint blog on clinical trial reform.
We'll aim to publish weekly on how to make clinical trials more efficient.
Subscribe: clinicaltrialsabundance.blog
My colleague Krist Vaessen wrote a new book: “Neomania: How our obsession with innovation is failing science, and how to restore trust”. It's a great analysis how the drive for novelty hinders reliable scientific progress. Open Access, so read it here: books.openbookpublishers.com/10.11647/obp...
do.call
February 9, 2026 at 3:47 PM
My colleague Krist Vaessen wrote a new book: “Neomania: How our obsession with innovation is failing science, and how to restore trust”. It's a great analysis how the drive for novelty hinders reliable scientific progress. Open Access, so read it here: books.openbookpublishers.com/10.11647/obp...
Reposted by Daniel Lakens
New blog post, inspired by the excellent recent qualitative paper by Makel and colleagues: On the reliability and reproducibility of qualitative research.
I reflect on how I will incorporate realist ontologies in my own qualitative research.
daniellakens.blogspot.com/2026/02/on-r...
I reflect on how I will incorporate realist ontologies in my own qualitative research.
daniellakens.blogspot.com/2026/02/on-r...
On the reliability and reproducibility of qualitative research
With my collaborators, I am increasingly performing qualitative research. I find qualitative research projects a useful way to improve my un...
daniellakens.blogspot.com
February 8, 2026 at 7:46 AM
New blog post, inspired by the excellent recent qualitative paper by Makel and colleagues: On the reliability and reproducibility of qualitative research.
I reflect on how I will incorporate realist ontologies in my own qualitative research.
daniellakens.blogspot.com/2026/02/on-r...
I reflect on how I will incorporate realist ontologies in my own qualitative research.
daniellakens.blogspot.com/2026/02/on-r...
New blog post, inspired by the excellent recent qualitative paper by Makel and colleagues: On the reliability and reproducibility of qualitative research.
I reflect on how I will incorporate realist ontologies in my own qualitative research.
daniellakens.blogspot.com/2026/02/on-r...
I reflect on how I will incorporate realist ontologies in my own qualitative research.
daniellakens.blogspot.com/2026/02/on-r...
On the reliability and reproducibility of qualitative research
With my collaborators, I am increasingly performing qualitative research. I find qualitative research projects a useful way to improve my un...
daniellakens.blogspot.com
February 8, 2026 at 7:46 AM
New blog post, inspired by the excellent recent qualitative paper by Makel and colleagues: On the reliability and reproducibility of qualitative research.
I reflect on how I will incorporate realist ontologies in my own qualitative research.
daniellakens.blogspot.com/2026/02/on-r...
I reflect on how I will incorporate realist ontologies in my own qualitative research.
daniellakens.blogspot.com/2026/02/on-r...
Indeed, it is perhaps surprising this has not been pointed out, but as far as I know, qualitative research is among the most replicable research areas in science. Or at least, all the replication studies I have seen are basically successful replications. It might not be 100%, but it is high!
Note that this in itself is a well-replicated finding. At least a dozen studies show that when researchers replicate qualitative research, or re-analyze it, they come to basically identical themes. There is nothing special about qualitative research with respect to replicability.
This is a great qualitative research paper. It sheds light on questionable research practices. But more importantly it demonstrates direct replications in qualitative research work as you would expect: independent teams reach basically the same conclusions royalsocietypublishing.org/rsos/article...
February 7, 2026 at 9:41 PM
Indeed, it is perhaps surprising this has not been pointed out, but as far as I know, qualitative research is among the most replicable research areas in science. Or at least, all the replication studies I have seen are basically successful replications. It might not be 100%, but it is high!
Note that this in itself is a well-replicated finding. At least a dozen studies show that when researchers replicate qualitative research, or re-analyze it, they come to basically identical themes. There is nothing special about qualitative research with respect to replicability.
This is a great qualitative research paper. It sheds light on questionable research practices. But more importantly it demonstrates direct replications in qualitative research work as you would expect: independent teams reach basically the same conclusions royalsocietypublishing.org/rsos/article...
‘Don’t hate the players, hate the game’: qualitative insights from education researchers on questionable and open research practices
Abstract. Both questionable (e.g. p-hacking) and open (e.g. pre-registration) research practices are prevalent in education research. We sought to understa
royalsocietypublishing.org
February 7, 2026 at 9:26 PM
Note that this in itself is a well-replicated finding. At least a dozen studies show that when researchers replicate qualitative research, or re-analyze it, they come to basically identical themes. There is nothing special about qualitative research with respect to replicability.
This is a great qualitative research paper. It sheds light on questionable research practices. But more importantly it demonstrates direct replications in qualitative research work as you would expect: independent teams reach basically the same conclusions royalsocietypublishing.org/rsos/article...
‘Don’t hate the players, hate the game’: qualitative insights from education researchers on questionable and open research practices
Abstract. Both questionable (e.g. p-hacking) and open (e.g. pre-registration) research practices are prevalent in education research. We sought to understa
royalsocietypublishing.org
February 7, 2026 at 9:22 PM
This is a great qualitative research paper. It sheds light on questionable research practices. But more importantly it demonstrates direct replications in qualitative research work as you would expect: independent teams reach basically the same conclusions royalsocietypublishing.org/rsos/article...
I think desk rejection is often too ideosyncratic so if that happens, I do not blame authors. An editor might like a paper, or not, and I am not even sure some have high test-retest reliability 🤣 But desk rejection is also fast, and wastes little time.
February 7, 2026 at 4:54 PM
I think desk rejection is often too ideosyncratic so if that happens, I do not blame authors. An editor might like a paper, or not, and I am not even sure some have high test-retest reliability 🤣 But desk rejection is also fast, and wastes little time.