Lightnews — Scholar-powered news

Lukas Röseler @aufdroeseler.bsky.social · 9d

How to decide what to replicate or reproduce? We recommend priotizing studies with "high value" or unclear results, considering practical limits, watching for bias, and always communicate choices openly.

Handbook chapter: forrt.org/replication_handbook/choosing_study.html

3 Choosing the Target Study – Handbook for Reproduction and Replication Studies

How to carry out reproductions and replications in the social, cognitive, and behavioral sciences

forrt.org

3

Lukas Röseler @aufdroeseler.bsky.social · 14d

Timestamped link (27:48): youtu.be/0NJ87tYE8_s?... from #PCI webinar by @deevybee.bsky.social

PCI Webinar-Dorothy Bishop-How negligent publishers subvert quality control in scientific publishing

YouTube video by Peer Community In

youtu.be

Lukas Röseler @aufdroeseler.bsky.social · 14d

I think this is just on point:"The publishers, I mean these are businesses, and businesses go for growth ... There just isn't that much good material that needs to be published. And so what they're ending up publishing is stuff that should never be published."-Bishop

www.youtube.com/watch?v=0NJ8...

1 1 2

Lukas Röseler @aufdroeseler.bsky.social · 16d

"The proof established by the test must have a specific form, namely, repeatability." (Dunlap, 1926). And researchers have more and more done so. Read why replications are important and how the last years have seen a strong rise of replications in our open handbook: forrt.org/replication_...

Number of published replications over year from 1955 to 2025 with a positive trend

1 3

Reposted by Lukas Röseler

Veli-Matti Karhulahti @mkarhulahti.bsky.social · 18d

Just learned about this diamond journal, which has apparently been running since 2015! Looks like a very nice place for any meta-sciency work & probably deserves some visibility.

septentrio.uit.no/index.php/no...

Nordic Perspectives on Open Science

Nordic-Baltic journal of Open Access to publications, data, peer review and open science.

septentrio.uit.no

2 7 18

Lukas Röseler @aufdroeseler.bsky.social · 22d

Also, I think this is a great opportunity to conduct a reproduction/replication that you can later submit to our new replication journal 👀

1

Lukas Röseler @aufdroeseler.bsky.social · 22d

The Münster Replication Games will take place on November 28, 2025!
+ 1 day event to conduct reproduction/replication
+ connect with fellow researchers interested in OS
+ refine your coding skills
+ become a co-author on a meta-paper
Register here: indico.uni-muenster.de/event/3526

1 2 7

Reposted by Lukas Röseler

Lukas Röseler @aufdroeseler.bsky.social · May 13

Just a friendly reminder to check who owns the preprint servers that you are using and to choose a non-commercial one: en.wikipedia.org/wiki/List_of...

4 6

Lukas Röseler @aufdroeseler.bsky.social · 27d

It also depends on if you are discussing a theory or a finding/phenomenon. A single failed replication could falsify an entire theory but it could not raise doubts over a phenomenon as easily. We discuss this a bit here: forrt.org/replication_...

7 Discussion – Handbook for Reproduction and Replication Studies

How to carry out reproductions and replications in the social, cognitive, and behavioral sciences

forrt.org

Lukas Röseler @aufdroeseler.bsky.social · 27d

I think I generally agree. For some cases it is much easier than making a pair of shoes, though (eg online replications in ML1). There are cases where it is then up to the original authors to show that their finding was not a false positive.

Lukas Röseler @aufdroeseler.bsky.social · 29d

www.ore.eu

Björn Brembs @brembs.mastodon.social.ap.brid.gy · Sep 3

This should have been big news!

Ten funding agencies from eight European countries have pledged to support a public infrastructure that is poised to replace academic journals:
FWF 🇦🇹
RCN 🇳🇴
Forte 🇸🇪
ARIS 🇸🇮
SRC 🇸🇪
FCT 🇵🇹
CSIC 🇪🇸
DFG 🇩🇪
Formas 🇸🇪
ANR 🇫🇷
Only two of them issued press releases in […]

Original post on mastodon.social

mastodon.social

3

Lukas Röseler @aufdroeseler.bsky.social · 29d

Another thought regarding follow-ups: Replications are already risky (difficult to publish) and you may never find out why the replication failed. For example, we had 6 replications in one case and still don't know why they did not work: doi.org/10.15626/MP.... at some point, you may want to publish

LnuOpen | Meta-Psychology

doi.org

1

Lukas Röseler @aufdroeseler.bsky.social · 29d

I'm not sure. Sometimes, researchers choose studies with a 50-50 chance of successful replication. So if results diverge, the need for a follow-up is not that high. And if you can re-use the exact same materials from a recent study, you could assume them to be piloted in the original study.

2

Lukas Röseler @aufdroeseler.bsky.social · Sep 8

Yes! We were aware of your article on that and cite it: As Buttliere (2024) put it: “Who gets better results, 39 people doing it the first time or one person doing it 39 times?”

It is in chapter 6.4: forrt.org/replication_...

6 Execution of Replications – Handbook for Reproduction and Replication Studies

How to carry out reproductions and replications in the social, cognitive, and behavioral sciences

forrt.org

1 2

Reposted by Lukas Röseler

Alice Fleerackers (she/her) @fleerackers.bsky.social · Sep 4

Have you ever heard of predatory journals?

Our new study—published this week in Journalism Practice—suggests many science journalists haven't.

When they were familiar with predatory journals, most said they weren't worried, confident they'd "be able to spot one if they saw one."

Details in 🧵👇

Screenshot of journal article titled "I'd like to think I'd be able to spot one": How journalists navigate predatory journals

Authors: Alice Fleerackers, Laura Moorhead, Juan Pablo Alperin

2 13 22

Lukas Röseler @aufdroeseler.bsky.social · Sep 3

my joint first author @lukaswallrich.bsky.social, @helenahartmann.com, Luisa Altegoer, Veronica Boyce, Sarahanne Field, @janikgoltermann.bsky.social, Joachim Hüffmeier, @drcpennington.bsky.social, @mmpittelkow.bsky.social, @priyasilverstein.com, @donvanraven.bsky.social & @flavioazevedo.bsky.social

2 10

Lukas Röseler @aufdroeseler.bsky.social · Sep 3

Again, I am in awe of how @forrt.bsky.social is a place where researchers come together to support open scholarship most enthusiastically and constructively and where everybody is welcome! This would not have been possible without the dedication of many experts: Thank you very much to...

forrt.org

1 1 8

Lukas Röseler @aufdroeseler.bsky.social · Sep 3

Naturally, this is an open educational resource: It is free and will forever stay free. We are also considering making it a living book: There are a few areas that we think deserve more attention. If you are an expert on something that you think is missing from this work, please get in touch!

1 1 5

Lukas Röseler @aufdroeseler.bsky.social · Sep 3

At the FORRT Replication Hub, our mission is to support researchers who want to replicate previous findings. We have now published a big new component with which we want to fulfill this mission: An open access handbook for reproduction and replication studies: forrt.org/replication_...

2 35 59

Lukas Röseler @aufdroeseler.bsky.social · Aug 26

I strongly recommend Hoyningen-Huene's systematicity theory. It is descriptive, concerns all sciences and humanities, and is actually useful for improving how you do research.

1

Reposted by Lukas Röseler

Daniel Lakens @lakens.bsky.social · Aug 25

If you are preparing your bachelor statistics course and would like to add optional material for students to better understand statistics on a conceptual level (see topics in the screenshot) my free textbook provides a state of the art overview. lakens.github.io/statistical_...

4 68 210

Reposted by Lukas Röseler

Framework for Open and Reproducible Research Training @forrt.bsky.social · Aug 11

🚀Making Replications Count Hackathon - in-person🚀

3 days. 2 open tools. 1 goal: make replication studies impossible to ignore

📅22–24 Oct 2025 | Münster, Germany ✈️Travel & accommodation covered (UKRI-funded)

Find out more below 👇
#OpenScience #Metascience #Replication #Hackathon #CodingForScience

Making Replications Count Hackathon
22-24 Oct 2025, Munster
Join us for a three-day hackathon to boost the visibility of replication studies!
Apply by September 7th

1 19 34

Lukas Röseler @aufdroeseler.bsky.social · Aug 8

Thank you for this very impressive resource of 50 (!) reproducibility/replicability metrics; also includes a searchable online table at rachelheyard.com/reproducibil...

2 8

Lukas Röseler @aufdroeseler.bsky.social · Aug 6

If you consume or produce research, I say that you must learn about the commercial publishing system. Start with @forrt.bsky.social's glossary (forrt.org/glossary/eng...), watch the Paywall Movie (www.youtube.com/watch?v=zAzT...) and learn about OA types. Think about who you want to do research for.

1 1

Lukas Röseler @aufdroeseler.bsky.social · Aug 6

Another one on the list of public communication about researchers wasting tax money by Focus+:

"The big business of fake research"

a few months after Maithink X's "Tax scandal: science behind paywalls".

Ironically, it's paywalled...

www.focusplus.de/wissen/gross...
www.zdf.de/video/shows/...

1 1