Peer Review Congress #PRC10
@peerreviewcongress.bsky.social
230 followers 40 following 200 posts
Encouraging research into the quality and credibility of peer review and scientific publication, to establish the evidence base on which scientists can improve the conduct, reporting, and dissemination of scientific research. peerreviewcongress.org.
Posts Media Videos Starter Packs
Reposted by Peer Review Congress #PRC10
ndevito1.bsky.social
In addition to being truly a giant in the field, Drummond also is the source for one of my favorite 2 slide transitions I've ever put in a talk. It shows the rapid change in sentiment on clinical trial registration in the early 2000s (in the wake of the Paroxetine scandal).
A quote from a JAMA piece from 2003 in which Drummond Rennie and Kay Dickersin bemoan the lack of knowledge, and therefore action, on clinical trial registration.

“One of the biggest barriers to comprehensive trials registration is the relative obscurity of this issue in the lay and biomedical press…Because there is no new reporting that trials registers exist, there is no written record of it and scientists get the message that their community does not think registers are important.” (2003) A quote from another JAMA paper in 2004 on the widespread awareness of the importance of clinical trial registration.

“Physicians and the public are now well aware of the importance of the registration of clinical trials.”
Reposted by Peer Review Congress #PRC10
jama.com
JAMA @jama.com · 18d
Editorial: "Remembering Drummond Rennie—Champion of Integrity in Science and Scientific Publication."

ja.ma/422578O
A tribute to Drummond Rennie, a champion of integrity in science. The image features Rennie at his desk, talking on the phone with a laptop and papers. Article mentions his work as a physician, scientist, editor, climber, and mentor.
Reposted by Peer Review Congress #PRC10
cochranedkcebmo.bsky.social
Earlier this month, Cecilie, @helenavbk.bsky.social, Mette, and @alundh.bsky.social presented their research at the 10th International Congress on Peer Review and Scientific Publication in Chicago! #PRC10

Read more about our team and the research we do on our website: www.sdu.dk/en/forskning...
Reposted by Peer Review Congress #PRC10
aacrjournals.bsky.social
An AACR study presented at the 10th International Congress on Peer Review & Scientific Publication found authors & reviewers for the AACR journals are increasingly using generative AI, but only a small proportion are disclosing this usage as required by the journals. @peerreviewcongress.bsky.social
peerreviewcongress.bsky.social
Drummond’s family invites those wishing to honor his memory to make a gift to the

Rogue Valley Manor Foundation
crm.bloomerang.co/Ho...

or

Earth Justice
earthjustice.org/don...

@jama.com @bmj.com
peerreviewcongress.bsky.social
The Peer Review Congress celebrates the life of Drummond Rennie. His intellect and vision created the Congress and the field of meta-research, and sustained both for over 40 year. He was a champion of inclusion, a consummate teacher, and a wonderful friend who enriched us all. Godspeed Drummond.
Reposted by Peer Review Congress #PRC10
reeserichardson.bsky.social
Today, our article "The entities enabling scientific fraud at scale are large, resilient, and growing rapidly" is finally published in PNAS. I hope that it proves to be a wake-up-call for the whole scientific community.

reeserichardson.blog/2025/08/04/a...
A do-or-die moment for the scientific enterprise
Reflecting on our paper “The entities enabling scientific fraud at scale are large, resilient, and growing rapidly”
reeserichardson.blog
Reposted by Peer Review Congress #PRC10
peerreviewresearch.bsky.social
👏 keynote Ana Marušić (#PeerReviewWorkbench advisory board member) “Forward to the Past – Making Contributors Accountable” concluding that authorship hasn't been replaced by contributorship; we'll need systemic approach to balance scientific credit, career advancement & ethical responsibility #PRC10
Reposted by Peer Review Congress #PRC10
kitchenmagician.bsky.social
So much to absorb from a week in Chicago at @peerreviewcongress.bsky.social. Grateful to all who organized and spoke at this incredible meeting! #PRC10
Reposted by Peer Review Congress #PRC10
davidblanco-91.bsky.social
Check out out research on the factors associated with trial registration and related practices in collaboration with @bmj.com
peerreviewcongress.bsky.social
Comparing improperly vs properly registered RCTs submitted to @bmj.com, 2019-23, proper registration was associated w larger sample size, more authors, nonprofit funding. Trials with authors from Asia had higher odds of improper registration, per @eloder.bsky.social and #BMJ colleagues
Retrospective registration was common, and most improperly registered trials rejected by The BMJ were later published in other ICMJE-affiliated journals. ICMJE journals should strengthen processes to better identify and reject improperly registered trials.
peerreviewcongress.bsky.social
Will investigate - thanks for letting us know.
peerreviewcongress.bsky.social
That’s a wrap on the 10th Peer Review Congress! Thanks to all for attending & following - we will repost in the following days & weeks to keep it all alive. Thanks to contributors and superfans @lexbouter.bsky.social @elisabethbik.bsky.social @abalkina.bsky.social and others for the amplification!
peerreviewcongress.bsky.social
Comparing #LLM vs human #PeerReview of 5 @bmj.com mss, LLM reviews matched or exceeded humans on key elements of identifying strengths/weaknesses, commenting on writing, organization, and Tables and Figures, and constructiveness
peerreviewcongress.o...
LLM-generated reviews matched or exceeded human reviewers on a few key dimensions of review quality. A fuller analysis will shed more light on the potential value of LLM peer reviews and how they could complement human peer reviewers’ work.
peerreviewcongress.bsky.social
Methods to detect #LLM-generated #PeerReview: in ms, add command to LLM to:
1. Watermark (insert a random start string, fake citation, or technical term)
2. Hidden prompt (insert white-colored text, different language, font manipulation)
@cmu.edu
Detecting LLM-Generated Peer Reviews
The integrity of peer review is fundamental to scientific progress, but the rise of large language models (LLMs) has introduced concerns that some reviewers may rely on these tools to generate...
arxiv.org
peerreviewcongress.bsky.social
A pilot study testing the ability of #MachineLearning models trained on well-annotated datasets to automate detection of hype in biomedical research writing (eg ‘groundbreaking', ‘revolutionary’) showed 70-80% accuracy vs human detection
peerreviewcongress.o...
The annotation process underscored the subjective nature of assessing promotional language, particularly for context-dependent adjectives like emerging and latest, and the need for refined constructs to capture gradations of promotional language. Despite these limitations, the pilot study indicates the potential for machine learning models trained on well-annotated datasets to contribute to the automated detection of hype. Future steps include modifying the annotation systems and experimenting with large language models under zero/few-shot regimes.
peerreviewcongress.bsky.social
In the #PubMedCentral-OA dataset, 34% (981 of 2898) of citation quotations were erroneous. #LLMs (@GeminiApp @GPT4oGPT) can be trained to detect citation errors with moderate accuracy, according to @uofilsystem.bsky.social researchers
#AI
Automated verification of citations could help journals and peer reviewers identify questionable citation practices and reduce propagation of misinformation, improving the trustworthiness of scientific evidence.
peerreviewcongress.bsky.social
@asapresearch.parkinsonsroadmap.org’s #OpenScience policy and compliance workflow — requiring grantees to post preprints, deposit research outputs, unambiguously i.d. research inputs — led to increases in all outcomes and activities.
peerreviewcongress.o...
A funder-led intervention to monitor and support a robust open science policy can foster the posting of preprints and the sharing of data, code, protocols, and key lab materials.