Lightnews — Scholar-powered news

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · 29d

@theaacr.bsky.social found that 23% of abstracts in manuscripts and 5% of peer-review reports submitted to its journals in 2024 contained text that was probably generated by large language models (#LLMs)
www.nature.com/articles/d41...
#AI #metaresearch

AI tool detects LLM-generated text in research papers and peer reviews

Authors and peer reviewers are failing to disclose the use of LLMs despite journal policies limiting their use.

www.nature.com

4 4

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Sep 5

In the #PubMedCentral-OA dataset, 34% (981 of 2898) of citation quotations were erroneous. #LLMs (@GeminiApp @GPT4oGPT) can be trained to detect citation errors with moderate accuracy, according to @uofilsystem.bsky.social researchers
#AI

Automated verification of citations could help journals and peer reviewers identify questionable citation practices and reduce propagation of misinformation, improving the trustworthiness of scientific evidence.

1 3

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Sep 5

A pilot study testing the ability of #MachineLearning models trained on well-annotated datasets to automate detection of hype in biomedical research writing (eg ‘groundbreaking', ‘revolutionary’) showed 70-80% accuracy vs human detection
peerreviewcongress.o...

The annotation process underscored the subjective nature of assessing promotional language, particularly for context-dependent adjectives like emerging and latest, and the need for refined constructs to capture gradations of promotional language. Despite these limitations, the pilot study indicates the potential for machine learning models trained on well-annotated datasets to contribute to the automated detection of hype. Future steps include modifying the annotation systems and experimenting with large language models under zero/few-shot regimes.

1 5

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Sep 5

Methods to detect #LLM-generated #PeerReview: in ms, add command to LLM to:
1. Watermark (insert a random start string, fake citation, or technical term)
2. Hidden prompt (insert white-colored text, different language, font manipulation)
@cmu.edu

Detecting LLM-Generated Peer Reviews

The integrity of peer review is fundamental to scientific progress, but the rise of large language models (LLMs) has introduced concerns that some reviewers may rely on these tools to generate...

arxiv.org

2 4

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Sep 5

Comparing #LLM vs human #PeerReview of 5 @bmj.com mss, LLM reviews matched or exceeded humans on key elements of identifying strengths/weaknesses, commenting on writing, organization, and Tables and Figures, and constructiveness
peerreviewcongress.o...

LLM-generated reviews matched or exceeded human reviewers on a few key dimensions of review quality. A fuller analysis will shed more light on the potential value of LLM peer reviews and how they could complement human peer reviewers’ work.

3 5

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Sep 5

#ZakKohane on #AI in #PeerReview: the surge in scientific publication is straining the conventional review system beyond capacity. @ai.nejm.org piloting AI-augmented fast track review: manuscripts w high prior of being good gets assigned to #GPT5 + a human, disposition reviewed by editorial team!

4 8

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Sep 3

Full abstract at

Quantifying and Assessing the Use of Generative AI by Authors and Reviewers in the Cancer Research Field - Peer Review Congress

Daniel S. Evanko,1 Michael Di Natale1 Objective This study assessed the ability to reliably detect the use of generative artificial intelligence (genAI) by authors and reviewers in the field of cancer research, quantified this usage over time, and measured the impact of a change in policy on use of genAI by reviewers. Design In this Read more...

peerreviewcongress.org

1 4

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Sep 3

Detection of #AI-generated text at 10 @theaacr.bsky.social journals increased Q1 '23 after public release of ChatGPT; a policy prohibiting its use slowed detections in reviewer comments. Presence in mss was assoc'd w a higher rejection rate before peer review @evanko.bsky.social #cancer

1 2 6

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Sep 3

Full abstract at

Notifying Authors That They Have Cited a Retracted Article and Future Citations of Retracted Articles: The RetractoBot Randomized Controlled Trial - Peer Review Congress

Nicholas J. DeVito,1 Christine Cunningham,1 Ben Goldacre1 Objective Continued citation of retracted articles is an ongoing issue.1 RetractoBot examines whether informing authors that they cited a retracted paper reduces future citations to those articles.2 Design This was a parallel-group, 2-group, superiority trial. We identified and randomized retracted articles in PubMed published since 2000. The study Read more...

peerreviewcongress.org

2 5

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Sep 3

#RetractoBot auto-emails authors when papers they've cited are retracted. An RCT comparing it vs no notice showed no diffs in 1y citations
@bengoldacre.bsky.social @ndevito1.bsky.social @bennettoxford.bsky.social
@ox.ac.uk @oxprimarycare.bsky.social
www.retracted.net/
cc: @retractionwatch.com

The effect of our intervention was not statistically significant (mean citation rate, −0.007; 95% CI, −0.055 to 0.041) and held for all prespecified sensitivity analyses.

1 4 11

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Sep 3

Full abstract at

How a Questionable Research Network Manipulated Scholarly Publishing - Peer Review Congress

Leslie D. McIntosh,1 Hélène Draux,1 Elizabeth Smee,1 Cynthia Hudson Vitale2 Objective To understand the broad impact of one questionable network on publishing, including the publishers, countries, and institutions involved and affected by the network’s activity. Design We examined the Pharmakon Neuroscience Research Network (PNN), a questionable entity listed in funding statements, acknowledgments, and author affiliations Read more...

peerreviewcongress.org

2 3

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Sep 3

The #Pharmakon Neuroscience Network, involving 361 authors from 40 countries in 123 articles/56 journals from 12 publishers 2019-2025, appears to have grown too rapidly to have developed naturally
@fauxsci.bsky.social @helenedraux.bsky.social @digital-science.com
(see also: doi.org/10.48550/arX...)

The PNN involved 56 journals across 12 publishers, with Springer Nature (n = 29), Elsevier (n = 26), and Bentham Science Publishers (n = 25) having the most articles involved out of the total (n = 123). The involved
authors were affiliated with 40 countries and 232 organizations.

1 2 4

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Sep 3

Scanning electron microscope image (SEM) metadata did not match the SEM manufacturer or model listed in the text in 21.2% of 11.3K materials science and engineering articles, a potential indicator of irreproducibility.
@reeserichardson.bsky.social
Read the full report at journals.plos.org/pl...

Unexplained textual similarities (eg, the same unlikely typo appearing in dozens of articles) common to many of these articles suggest the involvement of paper mills, organizations that mass produce, sell authorship on, and publish fraudulent scientific manuscripts at scale.

1 2 3

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Sep 3

Among 2078 retracted articles flagged for problematic image manipulation by @retractionwatch.com, gel blots were the most frequently cited image type (52%); image duplication was most common retraction cause (88%)
@phillcardenuto.bsky.social @loyolachicago.bsky.social @unicampoficial.bsky.social

Gel blots (eg, Western blots) were the most frequently cited image type in problematic retractions, appearing in 1074 articles (51.68%). Between-article image reuse, where an image and its associated data are duplicated across different publications, was the most common context of misuse, identified in 1241 cases (59.72%). Notably, 982 retractions (47.28%) were attributed to paper mills. Image duplication was the predominant cause of retraction, accounting for 1827 cases (87.92%). Only 1 retraction was attributed to computer-or artificial intelligence–generated manipulation.

1 4 6

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Aug 6

Unraveling Spin & Selective Reporting in Medical #AI Research: A Cross-Sectional #MetaResearch Study

from #UNSWSydney researchers

is a poster presentation all 3 PRC days

Register to stop by, ask questions, say hello!

Learn more and register at peerreviewcongress.org

@jama.com @bmj.com

International Congress on Peer Review and Scientific Publication

Enhancing the quality and credibility of science.

peerreviewcongress.org

2 3

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Aug 7

Authorship and Contributorship Criteria and Practices at Annals of African Surgery

from EIC James Kigera and AAS colleagues

is a poster presentation all 3 days of the PRC

Register to stop by, ask questions, say hello!

Learn more at peerreviewcongress.org

#AfricanScience

@jama.com @bmj.com

International Congress on Peer Review and Scientific Publication

Enhancing the quality and credibility of science.

peerreviewcongress.org

1 2

Reposted by Isabelle Boutron

Peer Review Congress #PRC10 @peerreviewcongress.bsky.social · Aug 9

Development of a Tool for Addressing #COIs in Trials (TACIT) for Use in Systematic Reviews

from @alundh.bsky.social @isabelleboutron.bsky.social
@cochranedkcebmo.bsky.social @upcite.bsky.social

is a PRC poster presentation

Register to stop by, ask the authors questions!

peerreviewcongress.org

International Congress on Peer Review and Scientific Publication

Enhancing the quality and credibility of science.

peerreviewcongress.org

4 5

Reposted by Isabelle Boutron

Cochrane Bias Methods Group @cochranebias.bsky.social · Jun 19

The latest Bias Methods Group newsletter is live! Dive into fresh insights and essential updates on tackling bias in research, as well as a call for abstracts for the 2025 annual meeting! Read it on the BMG website: methods.cochrane.org/bias/about-u...

Newsletters | Cochrane Bias

methods.cochrane.org

4 4

Reposted by Isabelle Boutron

Cochrane Bias Methods Group @cochranebias.bsky.social · Jun 19

Are you interested in presenting your research at the annual Bias Methods Group meeting? If so, please do not forget to submit your abstract to [email protected] by August 11. For more information, please click here: methods.cochrane.org/bias/news/20...

2025 annual meeting(s) and call for abstracts | Cochrane Bias

methods.cochrane.org

2 2

Reposted by Isabelle Boutron

CRESS UMR1153 @cressumr1153.bsky.social · Jun 12

Two modules of the International Summer School in Public Health came to their conclusion yesterday. @cressumr1153.bsky.social and Institut Paris Public Health. After two days of intensive exchanges, workshops and teaching, these modules came to a close in a constructive and collaborative spirit.

1 1

Reposted by Isabelle Boutron

Christian Cao @christiancao.bsky.social · Jun 12

A special shout out to:
@rohitarorayyc.bsky.social
@paullusla.bsky.social
@jzsang.bsky.social

for working tirelessly to make this dream happen <3

And our advisors:
@isabelleboutron.bsky.social
David Moher
@geochurch.bsky.social
@nikbobrovitz.bsky.social

1 1 3

Isabelle Boutron @isabelleboutron.bsky.social · Jun 4

Excellent opportunity to learn innovative design, to interact with outstanding researchers in the field of epidemiology and statistics!!!

The international summer school of the @cressumr1153.bsky.social in the centre of Paris

CRESS UMR1153 @cressumr1153.bsky.social · Jun 4

Retour sur la 2ᵉ journée de l’École d’Été en Santé Publique du @cressumr1153.bsky.social & de l'Institut Paris Public Health !
Une journée animée autour d'ateliers pratiques et échanges pluridisciplinaires sur les grands enjeux de santé publique. @inserm.fr @upcite.bsky.social @univ-spn.bsky.social

3

Reposted by Isabelle Boutron

CRESS UMR1153 @cressumr1153.bsky.social · Jun 4

Retour sur la 2ᵉ journée de l’École d’Été en Santé Publique du @cressumr1153.bsky.social & de l'Institut Paris Public Health !
Une journée animée autour d'ateliers pratiques et échanges pluridisciplinaires sur les grands enjeux de santé publique. @inserm.fr @upcite.bsky.social @univ-spn.bsky.social

1 2

Reposted by Isabelle Boutron

CRESS UMR1153 @cressumr1153.bsky.social · May 19

On March 20, Astrid Chevance of the METHODS team at @cressumr1153.bsky.social and Luz Ascarate (philosopher) organized an interdisciplinary study day entitled “Suffering and pain”.

cress-umr1153.fr/en/rethinkin...

@inserm.fr
@upcite.bsky.social
@univ-spn.bsky.social
@inrae-france.bsky.social

Rethinking the role of suffering in healthcare: Reflections on the interdisciplinary study day of March 20, 2025 - CRESS - Centre de Recherche en Epidémiologie et Statistiques

cress-umr1153.fr

1 2

Reposted by Isabelle Boutron

CRESS UMR1153 @cressumr1153.bsky.social · Jun 2

L’École d'été internationale en Santé Publique organisée par @cressumr1153.bsky.social et l'Institut Paris Public Health débute aujourd'hui ! Du 02 au 13 juin, deux semaines de formation de haut niveau en Santé Publique. @upcite.bsky.social @univ-spn.bsky.social @inserm.fr @inrae-france.bsky.social

1 2