MetaROR
@metaror.bsky.social
MetaROR is a community initiative led jointly by RoRI and AIMOS. It provides a platform that leverages the publish–review-curate model to improve the dissemination and evaluation of metaresearch.
That's great news, Serhii! Congratulations on the JDIS acceptance 👏
Congratulations, @metaror.bsky.social! 🎉 Thank you for proving that the publish-review-curate model really works - this morning I received an acceptance from #JDIS based on a MetaROR review. ✌️ Looking forward to seeing MetaROR shape the future of metaresearch even more in its second year!
November 21, 2025 at 4:41 PM
That's great news, Serhii! Congratulations on the JDIS acceptance 👏
🎈 Time flies! Exactly one year ago today @rorinstitute.bsky.social and @aimosinc.bsky.social launched MetaROR, a platform to publish metaresearch through the publish-review-curate approach.
Over the course of the year, we published 28 articles reviewed by 59 different reviewers.
[1/3]
Over the course of the year, we published 28 articles reviewed by 59 different reviewers.
[1/3]
MetaROR Turns One - MetaROR
An exciting year of open, community-driven evaluation of metaresearch One [...]
metaror.org
November 21, 2025 at 1:39 PM
🎈 Time flies! Exactly one year ago today @rorinstitute.bsky.social and @aimosinc.bsky.social launched MetaROR, a platform to publish metaresearch through the publish-review-curate approach.
Over the course of the year, we published 28 articles reviewed by 59 different reviewers.
[1/3]
Over the course of the year, we published 28 articles reviewed by 59 different reviewers.
[1/3]
Reposted by MetaROR
Discussion about next steps for MetaROR @metaror.bsky.social A partnership between @aimosinc.bsky.social and @rorinstitute.bsky.social
Led by @alexh.bsky.social and @aidybarnett.bsky.social
#AIMOS2025
Led by @alexh.bsky.social and @aidybarnett.bsky.social
#AIMOS2025
November 20, 2025 at 4:38 AM
Discussion about next steps for MetaROR @metaror.bsky.social A partnership between @aimosinc.bsky.social and @rorinstitute.bsky.social
Led by @alexh.bsky.social and @aidybarnett.bsky.social
#AIMOS2025
Led by @alexh.bsky.social and @aidybarnett.bsky.social
#AIMOS2025
Reposted by MetaROR
More people need to know about MetaROR @metaror.bsky.social! If you are doing meta-research, then you get that the for-profit publishing system is a headache – you can help sideline journals by having your preprints handled by the MetaROR team for the peer review process. #AIMOS2025
November 20, 2025 at 10:13 AM
More people need to know about MetaROR @metaror.bsky.social! If you are doing meta-research, then you get that the for-profit publishing system is a headache – you can help sideline journals by having your preprints handled by the MetaROR team for the peer review process. #AIMOS2025
Our newest study "reviews and categorises 15 publications that debate the epistemic function of replications."
Reviewers found the question important, yet had some concerns about the small number of pubs selected and how they were chosen.
👇 Read the editorial assessment, reviews and full text now
Reviewers found the question important, yet had some concerns about the small number of pubs selected and how they were chosen.
👇 Read the editorial assessment, reviews and full text now
The Epistemic Function of Replication: Mapping the Domains of the Debate - MetaROR
metaror.org
November 19, 2025 at 10:31 AM
Our newest study "reviews and categorises 15 publications that debate the epistemic function of replications."
Reviewers found the question important, yet had some concerns about the small number of pubs selected and how they were chosen.
👇 Read the editorial assessment, reviews and full text now
Reviewers found the question important, yet had some concerns about the small number of pubs selected and how they were chosen.
👇 Read the editorial assessment, reviews and full text now
Our latest article uses simulations to "explore ways in which decision reliability, bias, extent of decision randomisation and other factors interact".
Reviewers consider it timely and "methodologically sound" while challenging some of the assumptions and offering suggestions.
👇 Read it here
Reviewers consider it timely and "methodologically sound" while challenging some of the assumptions and offering suggestions.
👇 Read it here
Reliability, bias and randomisation in peer review: a simulation - MetaROR
metaror.org
November 14, 2025 at 10:24 AM
Our latest article uses simulations to "explore ways in which decision reliability, bias, extent of decision randomisation and other factors interact".
Reviewers consider it timely and "methodologically sound" while challenging some of the assumptions and offering suggestions.
👇 Read it here
Reviewers consider it timely and "methodologically sound" while challenging some of the assumptions and offering suggestions.
👇 Read it here
Reposted by MetaROR
Revised preprint: "Establishing trust in automated reasoning"
osf.io/preprints/me...
Based on two very helpful reviews from @metaror.bsky.social:
metaror.org/kotahi/artic...
More references, better discussion of unfamiliar concepts (e.g. conviviality), and more.
🧪 #metasci #compsci
osf.io/preprints/me...
Based on two very helpful reviews from @metaror.bsky.social:
metaror.org/kotahi/artic...
More references, better discussion of unfamiliar concepts (e.g. conviviality), and more.
🧪 #metasci #compsci
OSF
osf.io
November 6, 2025 at 9:26 AM
Revised preprint: "Establishing trust in automated reasoning"
osf.io/preprints/me...
Based on two very helpful reviews from @metaror.bsky.social:
metaror.org/kotahi/artic...
More references, better discussion of unfamiliar concepts (e.g. conviviality), and more.
🧪 #metasci #compsci
osf.io/preprints/me...
Based on two very helpful reviews from @metaror.bsky.social:
metaror.org/kotahi/artic...
More references, better discussion of unfamiliar concepts (e.g. conviviality), and more.
🧪 #metasci #compsci
How are national systems for assessing publicly funded research evolving? That's the question our latest article poses.
Reviewers consider the work "valuable and timely", noting its relevance to reform initiatives like @coarassessment.bsky.social
👇 Read the assessment, reviews & full article here
Reviewers consider the work "valuable and timely", noting its relevance to reform initiatives like @coarassessment.bsky.social
👇 Read the assessment, reviews & full article here
A new typology of national research assessment systems: continuity and change in 13 countries
metaror.org
November 4, 2025 at 3:39 PM
How are national systems for assessing publicly funded research evolving? That's the question our latest article poses.
Reviewers consider the work "valuable and timely", noting its relevance to reform initiatives like @coarassessment.bsky.social
👇 Read the assessment, reviews & full article here
Reviewers consider the work "valuable and timely", noting its relevance to reform initiatives like @coarassessment.bsky.social
👇 Read the assessment, reviews & full article here
Between open reviews and cases of abusing anonymity, the authors of our latest article argue for "pseudo-anonymous" (i.e., traceable) reviews.
The reviewers support the general idea while also offering amendments and alternative solutions.
👇 Read the assessment, reviews & full article now
The reviewers support the general idea while also offering amendments and alternative solutions.
👇 Read the assessment, reviews & full article now
Open Reviews is a good first step. Pseudo-Anonymous Reviews can take it further.
metaror.org
October 24, 2025 at 10:22 AM
Between open reviews and cases of abusing anonymity, the authors of our latest article argue for "pseudo-anonymous" (i.e., traceable) reviews.
The reviewers support the general idea while also offering amendments and alternative solutions.
👇 Read the assessment, reviews & full article now
The reviewers support the general idea while also offering amendments and alternative solutions.
👇 Read the assessment, reviews & full article now
Reposted by MetaROR
Just finished my @metaror.bsky.social journey – two rounds of #OpenPeerReview, valuable feedback, a stronger paper, and finally a journal submission. Open review takes time, but it’s worth every week for the transparency and trust it brings. doi.org/10.70744/Met... #OpenScience #Publishing
APC waivers and Ukraine’s publishing output in Gold OA journals: Evidence from five commercial publishers
doi.org
October 14, 2025 at 8:31 AM
Just finished my @metaror.bsky.social journey – two rounds of #OpenPeerReview, valuable feedback, a stronger paper, and finally a journal submission. Open review takes time, but it’s worth every week for the transparency and trust it brings. doi.org/10.70744/Met... #OpenScience #Publishing
Reposted by MetaROR
I just published my first paper on MetaROR (MetaResearch Open Review). The #PublishReviewCurate model brings reviewing and editorial decision making into the open.
To me, it can become a real game changer in #ScholarlyCommunication. I got great reviews and look forward to revise my manuscript!
To me, it can become a real game changer in #ScholarlyCommunication. I got great reviews and look forward to revise my manuscript!
🆕 Our latest study asks how authors incorporate the PRISMA guideline into workflows when conducting reviews.
Both reviewers highlighted the study's importance yet also requested more information and details from the author.
👇 Read the full editorial assessment, reviews and paper on MetaROR
Both reviewers highlighted the study's importance yet also requested more information and details from the author.
👇 Read the full editorial assessment, reviews and paper on MetaROR
From Form to Formation. Biomedical Reporting Standards in Practice
metaror.org
October 14, 2025 at 7:37 AM
I just published my first paper on MetaROR (MetaResearch Open Review). The #PublishReviewCurate model brings reviewing and editorial decision making into the open.
To me, it can become a real game changer in #ScholarlyCommunication. I got great reviews and look forward to revise my manuscript!
To me, it can become a real game changer in #ScholarlyCommunication. I got great reviews and look forward to revise my manuscript!
🆕 Our latest study asks how authors incorporate the PRISMA guideline into workflows when conducting reviews.
Both reviewers highlighted the study's importance yet also requested more information and details from the author.
👇 Read the full editorial assessment, reviews and paper on MetaROR
Both reviewers highlighted the study's importance yet also requested more information and details from the author.
👇 Read the full editorial assessment, reviews and paper on MetaROR
From Form to Formation. Biomedical Reporting Standards in Practice
metaror.org
October 9, 2025 at 2:05 PM
🆕 Our latest study asks how authors incorporate the PRISMA guideline into workflows when conducting reviews.
Both reviewers highlighted the study's importance yet also requested more information and details from the author.
👇 Read the full editorial assessment, reviews and paper on MetaROR
Both reviewers highlighted the study's importance yet also requested more information and details from the author.
👇 Read the full editorial assessment, reviews and paper on MetaROR
Reposted by MetaROR
Very glad to see the ANU Journal of Law and Technology has agreed to be @metaror.bsky.social's first partner journal from the field of law: cms.metaror.org/partner-jour...
MetaROR partners accept MetaROR reviews as part of their editorial process, making the publishing ecosystem more efficient.
MetaROR partners accept MetaROR reviews as part of their editorial process, making the publishing ecosystem more efficient.
October 8, 2025 at 12:17 AM
Very glad to see the ANU Journal of Law and Technology has agreed to be @metaror.bsky.social's first partner journal from the field of law: cms.metaror.org/partner-jour...
MetaROR partners accept MetaROR reviews as part of their editorial process, making the publishing ecosystem more efficient.
MetaROR partners accept MetaROR reviews as part of their editorial process, making the publishing ecosystem more efficient.
A qualified statistician's review can improve study designs. But who has access to one? Our new article surveys this among Australian human research ethics committees.
Reviewers liked the article yet were disappointed by the response rate. They suggested minor changes.
👇Read it now on MetaROR
Reviewers liked the article yet were disappointed by the response rate. They suggested minor changes.
👇Read it now on MetaROR
The varying perceptions of a statistician’s value, from “critical” to “not needed for 99.9% of applications”: A national study of human research ethics committees
metaror.org
September 12, 2025 at 12:04 PM
A qualified statistician's review can improve study designs. But who has access to one? Our new article surveys this among Australian human research ethics committees.
Reviewers liked the article yet were disappointed by the response rate. They suggested minor changes.
👇Read it now on MetaROR
Reviewers liked the article yet were disappointed by the response rate. They suggested minor changes.
👇Read it now on MetaROR
📠 Why should we trust automated reasoning systems? That's the question posed in our latest article by @khinsen.scholar.social.ap.brid.gy.
The two reviewers generally praise the ideas but ask for more detail and share some concerns.
👇 Read the editorial assessment, reviews and full paper at MetaROR
The two reviewers generally praise the ideas but ask for more detail and share some concerns.
👇 Read the editorial assessment, reviews and full paper at MetaROR
Establishing trust in automated reasoning
metaror.org
September 10, 2025 at 2:16 PM
📠 Why should we trust automated reasoning systems? That's the question posed in our latest article by @khinsen.scholar.social.ap.brid.gy.
The two reviewers generally praise the ideas but ask for more detail and share some concerns.
👇 Read the editorial assessment, reviews and full paper at MetaROR
The two reviewers generally praise the ideas but ask for more detail and share some concerns.
👇 Read the editorial assessment, reviews and full paper at MetaROR
Reposted by MetaROR
Thank you Hans for sharing your positive experience with @metaror.bsky.social, using your reviews and assessment to publish at our partner journal, Quantitative Science Studies: www.openscience.nl/en/cases/the...
The MetaROR Publish-Review-Curate Model: our experience as authors | Open Science NL
www.openscience.nl
September 10, 2025 at 3:08 AM
Thank you Hans for sharing your positive experience with @metaror.bsky.social, using your reviews and assessment to publish at our partner journal, Quantitative Science Studies: www.openscience.nl/en/cases/the...
Reposted by MetaROR
🔓 It's great to see authors sharing their experiences with publishing on MetaROR (MetaResearch Open Review) — our open review platform for metascience using the publish–review–curate model: www.openscience.nl/en/cases/the...
September 9, 2025 at 11:42 AM
🔓 It's great to see authors sharing their experiences with publishing on MetaROR (MetaResearch Open Review) — our open review platform for metascience using the publish–review–curate model: www.openscience.nl/en/cases/the...
⌛ How is preprinting adopted over time across disciplines and regions? Our latest article attempts to answer this.
The reviewers praised the comprehensive analysis & clear presentation, while requesting more background information & addressing data availability issues.
👇 Read it now on MetaROR
The reviewers praised the comprehensive analysis & clear presentation, while requesting more background information & addressing data availability issues.
👇 Read it now on MetaROR
Adoption of Preprinting Across Scientific Disciplines and Geographical Regions (1991-2023)
metaror.org
September 3, 2025 at 1:43 PM
⌛ How is preprinting adopted over time across disciplines and regions? Our latest article attempts to answer this.
The reviewers praised the comprehensive analysis & clear presentation, while requesting more background information & addressing data availability issues.
👇 Read it now on MetaROR
The reviewers praised the comprehensive analysis & clear presentation, while requesting more background information & addressing data availability issues.
👇 Read it now on MetaROR
MetaROR will be present at the @stienid2025.bsky.social conference this week!
We are excited for all the presentations, discussions and inspiration to come and we would be more than happy to greet you at our stand 👋
www.stienid2025.org
We are excited for all the presentations, discussions and inspiration to come and we would be more than happy to greet you at our stand 👋
www.stienid2025.org
Home | STI-ENID2025
Official website of the 29th Annual STI ENID Conference 2025
www.stienid2025.org
September 2, 2025 at 1:41 PM
MetaROR will be present at the @stienid2025.bsky.social conference this week!
We are excited for all the presentations, discussions and inspiration to come and we would be more than happy to greet you at our stand 👋
www.stienid2025.org
We are excited for all the presentations, discussions and inspiration to come and we would be more than happy to greet you at our stand 👋
www.stienid2025.org
This great new initiative highlights lots of interesting research and initiatives, including (on p.40) a primer on what MetaROR is doing, by @andre-brasil.bsky.social
👏 Congratulations to everyone involved for producing such a great magazine!
👏 Congratulations to everyone involved for producing such a great magazine!
🌟 REACH is live!
A new digital magazine on research integrity & open science.
📖 In this issue:
✨ Launch of the Science Integrity Alliance
✨ Coverage of the U.S. Conference on Research Integrity
✨ COPE’s evolution in publication ethics
...and more!
🔗 Read here: www.sci-integrity.com/reach-inaugu...
A new digital magazine on research integrity & open science.
📖 In this issue:
✨ Launch of the Science Integrity Alliance
✨ Coverage of the U.S. Conference on Research Integrity
✨ COPE’s evolution in publication ethics
...and more!
🔗 Read here: www.sci-integrity.com/reach-inaugu...
September 1, 2025 at 5:17 PM
This great new initiative highlights lots of interesting research and initiatives, including (on p.40) a primer on what MetaROR is doing, by @andre-brasil.bsky.social
👏 Congratulations to everyone involved for producing such a great magazine!
👏 Congratulations to everyone involved for producing such a great magazine!
Reposted by MetaROR
Great question!
Indeed @metaror.bsky.social and @peercommunityin.bsky.social have a lot in common, and in fact the MetaROR model was partly inspired by the great work done by Peer Community In (PCI).
However, there are also various differences between MetaROR and PCI. Let me highlight two of them.
Indeed @metaror.bsky.social and @peercommunityin.bsky.social have a lot in common, and in fact the MetaROR model was partly inspired by the great work done by Peer Community In (PCI).
However, there are also various differences between MetaROR and PCI. Let me highlight two of them.
August 15, 2025 at 10:09 AM
Great question!
Indeed @metaror.bsky.social and @peercommunityin.bsky.social have a lot in common, and in fact the MetaROR model was partly inspired by the great work done by Peer Community In (PCI).
However, there are also various differences between MetaROR and PCI. Let me highlight two of them.
Indeed @metaror.bsky.social and @peercommunityin.bsky.social have a lot in common, and in fact the MetaROR model was partly inspired by the great work done by Peer Community In (PCI).
However, there are also various differences between MetaROR and PCI. Let me highlight two of them.
👇 MetaROR is very proud and excited to announce this new partnership with @plosbiology.org 🙏
As part of this, "PLOS Biology will formally consider meta-research articles that are peer-reviewed on the MetaROR platform", in order to "improve transparency" and "[prevent] futile cycles of peer review".
As part of this, "PLOS Biology will formally consider meta-research articles that are peer-reviewed on the MetaROR platform", in order to "improve transparency" and "[prevent] futile cycles of peer review".
We are proud to announce a new agreement with @rorinstitute.bsky.social and @aimosinc.bsky.social to become a partner journal with MetaResearch Open Review (MetaRoR) @metaror.bsky.social
#metaresearch #openscience 🧪
Learn more: plos.io/45wPZB9
#metaresearch #openscience 🧪
Learn more: plos.io/45wPZB9
PLOS Biology announces agreement to become a MetaROR partner journal - The Official PLOS Blog
Note: PLOS issued the following press release on Thursday, August 14th. SAN FRANCISCO, CA — Today, PLOS Biology announced a new agreement…
plos.io
August 14, 2025 at 1:58 PM
👇 MetaROR is very proud and excited to announce this new partnership with @plosbiology.org 🙏
As part of this, "PLOS Biology will formally consider meta-research articles that are peer-reviewed on the MetaROR platform", in order to "improve transparency" and "[prevent] futile cycles of peer review".
As part of this, "PLOS Biology will formally consider meta-research articles that are peer-reviewed on the MetaROR platform", in order to "improve transparency" and "[prevent] futile cycles of peer review".
🔒Our latest study regards "the effect of APC waivers on the participation of Ukrainian researchers in fully Gold OA journals".
The reviewers call it "well-developed", "timely" & "important" while questioning the focus on only 5 publishers.
👇Read the assessment, reviews & author response on MetaROR
The reviewers call it "well-developed", "timely" & "important" while questioning the focus on only 5 publishers.
👇Read the assessment, reviews & author response on MetaROR
The effect of APC discounts on Ukraine's participation in gold open access journals
metaror.org
August 8, 2025 at 9:48 AM
🔒Our latest study regards "the effect of APC waivers on the participation of Ukrainian researchers in fully Gold OA journals".
The reviewers call it "well-developed", "timely" & "important" while questioning the focus on only 5 publishers.
👇Read the assessment, reviews & author response on MetaROR
The reviewers call it "well-developed", "timely" & "important" while questioning the focus on only 5 publishers.
👇Read the assessment, reviews & author response on MetaROR
Reposted by MetaROR
Exciting news! @metaror.bsky.social has joined Lifecycle Journal's growing list of evaluation service partners, & will review & assess metaresearch submissions.
Under LJ's innovative model of scholarly communication, research is published first, then openly reviewed.
🔎: lifecyclejournal.org/about/
Under LJ's innovative model of scholarly communication, research is published first, then openly reviewed.
🔎: lifecyclejournal.org/about/
LinkedIn
This link will take you to a page that’s not on LinkedIn
lnkd.in
August 7, 2025 at 8:18 PM
Exciting news! @metaror.bsky.social has joined Lifecycle Journal's growing list of evaluation service partners, & will review & assess metaresearch submissions.
Under LJ's innovative model of scholarly communication, research is published first, then openly reviewed.
🔎: lifecyclejournal.org/about/
Under LJ's innovative model of scholarly communication, research is published first, then openly reviewed.
🔎: lifecyclejournal.org/about/
📢 MetaROR is excited to announce our partnership with Lifecycle Journal.
We have joined LCJ's growing group of evaluation services and will review and assess metaresearch submissions.
👇 LCJ joins our ever-increasing list of partner journals. Please find the full list in the link below
[1/2]
We have joined LCJ's growing group of evaluation services and will review and assess metaresearch submissions.
👇 LCJ joins our ever-increasing list of partner journals. Please find the full list in the link below
[1/2]
Partnership with journals - MetaROR
About Our Partner Journals About Our Partner Journals Leveraging reviews for streamlined journal submissions Leveraging reviews for streamlined journal submissions
After peer review and editori...
metaror.org
August 7, 2025 at 1:48 PM
📢 MetaROR is excited to announce our partnership with Lifecycle Journal.
We have joined LCJ's growing group of evaluation services and will review and assess metaresearch submissions.
👇 LCJ joins our ever-increasing list of partner journals. Please find the full list in the link below
[1/2]
We have joined LCJ's growing group of evaluation services and will review and assess metaresearch submissions.
👇 LCJ joins our ever-increasing list of partner journals. Please find the full list in the link below
[1/2]