ERROR
@error.reviews
ERROR is a bug bounty program for science
https://error.reviews/
PIs: @malte.the100.ci & @ruben.the100.ci
Chief Recommender: @ianhussey.mmmdata.io
Recommender: @jamiecummins.bsky.social
https://error.reviews/
PIs: @malte.the100.ci & @ruben.the100.ci
Chief Recommender: @ianhussey.mmmdata.io
Recommender: @jamiecummins.bsky.social
Congratulations to @simine.com for winning the Einstein Foundation Individual Award! 🎉
A well-deserved recognition for her seminal efforts to improve scientific rigor, which includes instituting detailed checks for errors and computational reproducibility at Psychological Science.
A well-deserved recognition for her seminal efforts to improve scientific rigor, which includes instituting detailed checks for errors and computational reproducibility at Psychological Science.
November 24, 2025 at 1:21 PM
Congratulations to @simine.com for winning the Einstein Foundation Individual Award! 🎉
A well-deserved recognition for her seminal efforts to improve scientific rigor, which includes instituting detailed checks for errors and computational reproducibility at Psychological Science.
A well-deserved recognition for her seminal efforts to improve scientific rigor, which includes instituting detailed checks for errors and computational reproducibility at Psychological Science.
Reposted by ERROR
I think this is an overly pessimistic take from the @bmj.com.
Sharing data does not inherently increase trust, rather it enables verification which allows for trust calibration.
This example is a win. Serious issues were rapidly detected that would not have been without mandatory data sharing.
Sharing data does not inherently increase trust, rather it enables verification which allows for trust calibration.
This example is a win. Serious issues were rapidly detected that would not have been without mandatory data sharing.
November 14, 2025 at 8:18 PM
I think this is an overly pessimistic take from the @bmj.com.
Sharing data does not inherently increase trust, rather it enables verification which allows for trust calibration.
This example is a win. Serious issues were rapidly detected that would not have been without mandatory data sharing.
Sharing data does not inherently increase trust, rather it enables verification which allows for trust calibration.
This example is a win. Serious issues were rapidly detected that would not have been without mandatory data sharing.
Synchronous Robustness Reports could explore implications of different analytical choices – but they could still suffer from bias. Hardwicke argues that preregistration is crucial to prevent it.
@tomhardwicke.bsky.social
@tomhardwicke.bsky.social
Risk of bias in robustness reports: https://osf.io/wj26e
November 14, 2025 at 2:54 PM
Synchronous Robustness Reports could explore implications of different analytical choices – but they could still suffer from bias. Hardwicke argues that preregistration is crucial to prevent it.
@tomhardwicke.bsky.social
@tomhardwicke.bsky.social
Are methodological and causal inference errors creating a false impression that the gut microbiome causes autism? In this strong analysis, Mitchell, Dahly, and Bishop question the evidence.
They show that triangulation in science requires multiple robust lines of research.
They show that triangulation in science requires multiple robust lines of research.
The link between the gut #microbiome and autism is not backed by science, researchers say.
Read the full opinion piece in @cp-neuron.bsky.social: spkl.io/63322AbxpA
@wiringthebrain.bsky.social, @statsepi.bsky.social, & @deevybee.bsky.social
Read the full opinion piece in @cp-neuron.bsky.social: spkl.io/63322AbxpA
@wiringthebrain.bsky.social, @statsepi.bsky.social, & @deevybee.bsky.social
November 14, 2025 at 12:49 PM
Are methodological and causal inference errors creating a false impression that the gut microbiome causes autism? In this strong analysis, Mitchell, Dahly, and Bishop question the evidence.
They show that triangulation in science requires multiple robust lines of research.
They show that triangulation in science requires multiple robust lines of research.
New Nature podcast episode about ERROR and the Perspectives on Scientific Error workshop!
Researchers are trialling all sorts of inventive ways to root out errors.
Scientists are human. So, sometimes mistakes slip through the cracks. To make science as robust as possible, though, they've created all sorts of methods to seal those cracks.
I explore these in a new @nature.com podcast.
Scientists are human. So, sometimes mistakes slip through the cracks. To make science as robust as possible, though, they've created all sorts of methods to seal those cracks.
I explore these in a new @nature.com podcast.
AI, bounties and culture change, how scientists are taking on errors
Hear the biggest stories from the world of science | 21/07/25
www.nature.com
July 30, 2025 at 7:18 AM
New Nature podcast episode about ERROR and the Perspectives on Scientific Error workshop!
Reposted by ERROR
“We pay experts to examine important and influential scientific publications for errors ... We expect most published research to contain some errors ... our reward system pays bonuses to both authors and reviewers even when minor errors are found ..."
statmodeling.stat.columbia.edu/2025/07/13/e...
statmodeling.stat.columbia.edu/2025/07/13/e...
The ERROR project: “We pay experts to examine important and influential scientific publications for errors . . . We expect most published research to contain at least some errors . . . our reward sy...
statmodeling.stat.columbia.edu
July 13, 2025 at 1:12 PM
“We pay experts to examine important and influential scientific publications for errors ... We expect most published research to contain some errors ... our reward system pays bonuses to both authors and reviewers even when minor errors are found ..."
statmodeling.stat.columbia.edu/2025/07/13/e...
statmodeling.stat.columbia.edu/2025/07/13/e...
Reposted by ERROR
✨ ERROR (@error.reviews) is a bug-bounty program for science that seeks to estimate the prevalence and nature of errors. error.reviews
Home
ERROR is a bug bounty program for science to systematically detect and report errors in academic publications
error.reviews
July 24, 2025 at 2:52 PM
✨ ERROR (@error.reviews) is a bug-bounty program for science that seeks to estimate the prevalence and nature of errors. error.reviews
Reposted by ERROR
EU legislation requiring clothes be reused and recycled may be based on a numerical error in a 2017 NGO report where $460 billion was added instead of subtracted.
www.frontiersin.org/journals/sus...
www.frontiersin.org/journals/sus...
Frontiers | The Emperor’s old clothes: a critical review of circular fashion in gray literature
www.frontiersin.org
February 15, 2025 at 10:23 AM
EU legislation requiring clothes be reused and recycled may be based on a numerical error in a 2017 NGO report where $460 billion was added instead of subtracted.
www.frontiersin.org/journals/sus...
www.frontiersin.org/journals/sus...
Reposted by ERROR
Thank you for sharing this! Reposting to note a @nature.com feature from Aug 2024 by @plantnerd.bsky.social on the ERROR project. 🧪 www.nature.com/articles/d41...
January 22, 2025 at 6:59 PM
Thank you for sharing this! Reposting to note a @nature.com feature from Aug 2024 by @plantnerd.bsky.social on the ERROR project. 🧪 www.nature.com/articles/d41...
Reposted by ERROR
My first time acting as a recommender for the ERROR project.
Huge props to the authors @erichehman.bsky.social et al. for exposing themselves to this detailed post-pub peer review and to Will Lowe @conjugateprior.org for his detailed review and reproduction.
Huge props to the authors @erichehman.bsky.social et al. for exposing themselves to this detailed post-pub peer review and to Will Lowe @conjugateprior.org for his detailed review and reproduction.
New report! Hehman et al. (2018) "Disproportionate Use of Lethal Force in Policing Is Associated With Regional Racial Biases". Based on the review by @conjugateprior.org, we find a Major Error that affects a core conclusion. We recommend the authors seek a correction.
error.reviews/reviews/hehm...
error.reviews/reviews/hehm...
Hehman et al. (2018)
ERROR is a bug bounty program for science to systematically detect and report errors in academic publications
error.reviews
January 20, 2025 at 1:29 PM
My first time acting as a recommender for the ERROR project.
Huge props to the authors @erichehman.bsky.social et al. for exposing themselves to this detailed post-pub peer review and to Will Lowe @conjugateprior.org for his detailed review and reproduction.
Huge props to the authors @erichehman.bsky.social et al. for exposing themselves to this detailed post-pub peer review and to Will Lowe @conjugateprior.org for his detailed review and reproduction.
Reposted by ERROR
Really amazingly heartening to see that academic discourse can also be like this
We've had a paper reviewed by ERROR, which has concluded we had a "major error that affects a core conclusion"
Few comments on the conclusion and the process in general
1/n
Few comments on the conclusion and the process in general
1/n
New report! Hehman et al. (2018) "Disproportionate Use of Lethal Force in Policing Is Associated With Regional Racial Biases". Based on the review by @conjugateprior.org, we find a Major Error that affects a core conclusion. We recommend the authors seek a correction.
error.reviews/reviews/hehm...
error.reviews/reviews/hehm...
January 20, 2025 at 7:42 PM
Really amazingly heartening to see that academic discourse can also be like this
Reposted by ERROR
One of our main goals with @error.reviews is to shift scientific culture to identify, acknowledge, and correct errors in the literature. Eric’s response to the recent report on his work is a perfect example of embodying these values. Kudos to the authorship team and reviewer Will Lowe.
We've had a paper reviewed by ERROR, which has concluded we had a "major error that affects a core conclusion"
Few comments on the conclusion and the process in general
1/n
Few comments on the conclusion and the process in general
1/n
New report! Hehman et al. (2018) "Disproportionate Use of Lethal Force in Policing Is Associated With Regional Racial Biases". Based on the review by @conjugateprior.org, we find a Major Error that affects a core conclusion. We recommend the authors seek a correction.
error.reviews/reviews/hehm...
error.reviews/reviews/hehm...
January 20, 2025 at 10:27 PM
One of our main goals with @error.reviews is to shift scientific culture to identify, acknowledge, and correct errors in the literature. Eric’s response to the recent report on his work is a perfect example of embodying these values. Kudos to the authorship team and reviewer Will Lowe.
Reposted by ERROR
It is an honor for anyone to care enough about your work to check it, so thanks dudes. A mistake I suggest others not make is failing to ensure that all the data, from download, to merge, to analysis is available and each step, not just the final analysis, is reproducible.
We are grateful to Will Lowe for his diligent examination of the article and its materials, and to @erichehman.bsky.social, @jkflake.bsky.social, & @jimmycalanchini.bsky.social for their willingness to have their impactful work examined for errors.
January 20, 2025 at 10:15 PM
It is an honor for anyone to care enough about your work to check it, so thanks dudes. A mistake I suggest others not make is failing to ensure that all the data, from download, to merge, to analysis is available and each step, not just the final analysis, is reproducible.
Reposted by ERROR
This sounds like the same error I blogged about a few years ago, the common error of trying to control for population (or body size or many etc) by dividing the outcome variable by it. Props to the authors for seeking review and taking the issue seriously. Role models for us all.
January 21, 2025 at 7:38 AM
This sounds like the same error I blogged about a few years ago, the common error of trying to control for population (or body size or many etc) by dividing the outcome variable by it. Props to the authors for seeking review and taking the issue seriously. Role models for us all.
Reposted by ERROR
A ⭐️⭐️⭐️⭐️⭐️ model response to finding problems in your published research. If you’ve published more than a few papers, you too have almost certainly made at least one mistake, so we should normalise addressing them like this!
Great to see @error.reviews approaching error detection so sensitively
Great to see @error.reviews approaching error detection so sensitively
We've had a paper reviewed by ERROR, which has concluded we had a "major error that affects a core conclusion"
Few comments on the conclusion and the process in general
1/n
Few comments on the conclusion and the process in general
1/n
New report! Hehman et al. (2018) "Disproportionate Use of Lethal Force in Policing Is Associated With Regional Racial Biases". Based on the review by @conjugateprior.org, we find a Major Error that affects a core conclusion. We recommend the authors seek a correction.
error.reviews/reviews/hehm...
error.reviews/reviews/hehm...
January 21, 2025 at 9:34 AM
A ⭐️⭐️⭐️⭐️⭐️ model response to finding problems in your published research. If you’ve published more than a few papers, you too have almost certainly made at least one mistake, so we should normalise addressing them like this!
Great to see @error.reviews approaching error detection so sensitively
Great to see @error.reviews approaching error detection so sensitively
Reposted by ERROR
THIS is how science works. A great and honorable reaction - especially in these times of resistance to facts and smug self-righteousness. Thanks to @erichehman.bsky.social & @error.reviews!
We've had a paper reviewed by ERROR, which has concluded we had a "major error that affects a core conclusion"
Few comments on the conclusion and the process in general
1/n
Few comments on the conclusion and the process in general
1/n
New report! Hehman et al. (2018) "Disproportionate Use of Lethal Force in Policing Is Associated With Regional Racial Biases". Based on the review by @conjugateprior.org, we find a Major Error that affects a core conclusion. We recommend the authors seek a correction.
error.reviews/reviews/hehm...
error.reviews/reviews/hehm...
January 20, 2025 at 8:44 PM
THIS is how science works. A great and honorable reaction - especially in these times of resistance to facts and smug self-righteousness. Thanks to @erichehman.bsky.social & @error.reviews!
Reposted by ERROR
We've had a paper reviewed by ERROR, which has concluded we had a "major error that affects a core conclusion"
Few comments on the conclusion and the process in general
1/n
Few comments on the conclusion and the process in general
1/n
New report! Hehman et al. (2018) "Disproportionate Use of Lethal Force in Policing Is Associated With Regional Racial Biases". Based on the review by @conjugateprior.org, we find a Major Error that affects a core conclusion. We recommend the authors seek a correction.
error.reviews/reviews/hehm...
error.reviews/reviews/hehm...
Hehman et al. (2018)
ERROR is a bug bounty program for science to systematically detect and report errors in academic publications
error.reviews
January 20, 2025 at 6:32 PM
We've had a paper reviewed by ERROR, which has concluded we had a "major error that affects a core conclusion"
Few comments on the conclusion and the process in general
1/n
Few comments on the conclusion and the process in general
1/n
New report! Hehman et al. (2018) "Disproportionate Use of Lethal Force in Policing Is Associated With Regional Racial Biases". Based on the review by @conjugateprior.org, we find a Major Error that affects a core conclusion. We recommend the authors seek a correction.
error.reviews/reviews/hehm...
error.reviews/reviews/hehm...
Hehman et al. (2018)
ERROR is a bug bounty program for science to systematically detect and report errors in academic publications
error.reviews
January 20, 2025 at 1:14 PM
New report! Hehman et al. (2018) "Disproportionate Use of Lethal Force in Policing Is Associated With Regional Racial Biases". Based on the review by @conjugateprior.org, we find a Major Error that affects a core conclusion. We recommend the authors seek a correction.
error.reviews/reviews/hehm...
error.reviews/reviews/hehm...
Reposted by ERROR
ERROR is our scientific bug-bounty program.
We pay reviewers and authors of impactful published articles to do a deep dive on results, data, code, etc to check for errors.
Our second report of 2025 (and my first acting as Recommender for the review) is out now!
We pay reviewers and authors of impactful published articles to do a deep dive on results, data, code, etc to check for errors.
Our second report of 2025 (and my first acting as Recommender for the review) is out now!
Excited to announce our second report of 2025! Fernbach et al. (2019) "Extreme opponents of genetically modified foods know the least but think they know the most". Based on the review by R Chris Fraley, we find Minor Errors which do not affect core conclusions. error.reviews/reviews/fern...
Fernbach et al. (2019)
ERROR is a bug bounty program for science to systematically detect and report errors in academic publications
error.reviews
January 10, 2025 at 3:46 PM
ERROR is our scientific bug-bounty program.
We pay reviewers and authors of impactful published articles to do a deep dive on results, data, code, etc to check for errors.
Our second report of 2025 (and my first acting as Recommender for the review) is out now!
We pay reviewers and authors of impactful published articles to do a deep dive on results, data, code, etc to check for errors.
Our second report of 2025 (and my first acting as Recommender for the review) is out now!
Excited to announce our second report of 2025! Fernbach et al. (2019) "Extreme opponents of genetically modified foods know the least but think they know the most". Based on the review by R Chris Fraley, we find Minor Errors which do not affect core conclusions. error.reviews/reviews/fern...
Fernbach et al. (2019)
ERROR is a bug bounty program for science to systematically detect and report errors in academic publications
error.reviews
January 10, 2025 at 3:44 PM
Excited to announce our second report of 2025! Fernbach et al. (2019) "Extreme opponents of genetically modified foods know the least but think they know the most". Based on the review by R Chris Fraley, we find Minor Errors which do not affect core conclusions. error.reviews/reviews/fern...
Reposted by ERROR
ERROR is our scientific bug-bounty program.
We pay reviewers (and authors!) of impactful published articles to do a deep dive on results, data, code, etc to check for errors.
Our second report is out now!
More information about the program here: error.reviews
We pay reviewers (and authors!) of impactful published articles to do a deep dive on results, data, code, etc to check for errors.
Our second report is out now!
More information about the program here: error.reviews
January 8, 2025 at 4:27 PM
ERROR is our scientific bug-bounty program.
We pay reviewers (and authors!) of impactful published articles to do a deep dive on results, data, code, etc to check for errors.
Our second report is out now!
More information about the program here: error.reviews
We pay reviewers (and authors!) of impactful published articles to do a deep dive on results, data, code, etc to check for errors.
Our second report is out now!
More information about the program here: error.reviews