Lightnews — Scholar-powered news

Reposted by Lucija Batinovic

Joseph Rezek @rezekjoe.bsky.social · 2d

I fucking love buying books.

Reposted by Lucija Batinovic

Melissa Kline Struhl @mekline.bsky.social · 2d

Hi #openscience friends! As Psych-DS moves forward (stay tuned for an R package update...), we're applying in parallel for renewal of the NIH grant that funds this work.

If you (a) have NIH funding and (b) plan or would like to use Psych-DS for resulting datasets, please drop me a line!

3 2

Reposted by Lucija Batinovic

Lukas Röseler @aufdroeseler.bsky.social · 2d

ReplicationResearch.org is now open for submissions!

Submit replications and reproductions from many different fields, as well as conceptual contributions. With diamond OA, open and citable peer review reports, and reproducibility checks, we push the boundaries of open and fair publishing.

3 47 72

Lucija Batinovic @metahag.bsky.social · 5d

Putting high hopes in this one. Happy birthday to me 🥳

6

Lucija Batinovic @metahag.bsky.social · 8d

I think time is just a proxy for cognitive bandwidth

2

Lucija Batinovic @metahag.bsky.social · 12d

Feedback is very welcome, particularly if you spot mistakes or unclear interpretations!

Lucija Batinovic @metahag.bsky.social · 12d

Understanding how different parts of evidence synthesis inform the final result is crucial for trusting meta-analytic findings, which often carry more weight than single studies when it comes to shaping policies and opinions.

1

Lucija Batinovic @metahag.bsky.social · 12d

This post is an attempt to introduce meta-analytic concepts and relate them to the GRADE approach, using a few simple examples to show how different parts of a meta-analysis can inform different GRADE domains, which is something I often struggle with as it feels so subjective and nuanced.

1

Lucija Batinovic @metahag.bsky.social · 12d

Many meta-analyses in education research (and probably other fields outside of medicine), often overlook aspects such as heterogeneity, publication bias, and quality of evidence when drawing conclusions about the state of the field.

1 1

Lucija Batinovic @metahag.bsky.social · 12d

New post: connecting meta-analysis concepts with the GRADE framework for assessing certainty of evidence. elucidatescience.netlify.app/posts/ma-gra...

GRADE your meta-analysis – eLucidate science

An introduction to meta-analysis, following the GRADE assessment domains for evaluation

elucidatescience.netlify.app

1 5

Lucija Batinovic @metahag.bsky.social · Sep 12

Thank you! I didn’t realize I had 4.6.0 because I recently updated packages so I assumed that was the latest version. Updating to 4.8.0 worked.

2

Lucija Batinovic @metahag.bsky.social · Sep 12

Is anyone else getting this error or am I missing something: Error: 'se' is not an exported object from 'namespace:metafor'?
#rstats @wviechtb.bsky.social

1 1

Reposted by Lucija Batinovic

Jack Wilkinson @jdwilko.bsky.social · Sep 5

www.medrxiv.org/content/10.1...

INSPECT-SR: A tool for assessing trustworthiness of randomised controlled trials.

INSPECT-SR: a tool for assessing trustworthiness of randomised controlled trials

The integrity of evidence synthesis is threatened by problematic randomised controlled trials (RCTs). These are RCTs where there are serious concerns about the trustworthiness of the data or findings....

www.medrxiv.org

3 34 66

Reposted by Lucija Batinovic

Ian Hussey @ianhussey.mmmdata.io · Aug 27

Yet another example of original authors being allowed to say anything they want in replies to critiques unconstrained by verifiable facts.

Reply states we didn’t consider things we explicitly did, and says the original article never said things it explicitly did.

Read Jamie’s thread for details:

Jamie Cummins @jamiecummins.bsky.social · Aug 27

This has now been published in PNAS!

www.pnas.org/doi/10.1073/...

The original authors also posted a reply:

www.pnas.org/doi/10.1073/...

Quick thread on some additional thoughts and then I'm probably done talking about this one 🧵

6 14

Reposted by Lucija Batinovic

Ian Hussey @ianhussey.mmmdata.io · Aug 15

I wrote an R package that creates standardized R project structures that are compliant with @mekline.bsky.social's psych-DS...ish.

It also creates additional features for reproducibility and teaching like a readme, license, .gitignore and Quarto templates

+ can validate existing projects

Creating and validating standardized R project structures that are psych-DS compliant-ish

Making psychological code and data FAIR is hard, in part because different projects organize their code and data very differently. Sometimes this is for good reasons, such as due to the demands of a g...

mmmdata.io

7 26 64

Reposted by Lucija Batinovic

Jamie Cummins @jamiecummins.bsky.social · Jul 25

ERROR @error.reviews was awarded a Commendation from the Society for the Improvement of Psychological Science!

Society for the Improvement of Psychological Science (SIPS) @improvingpsych.org · Jul 24

✨ ERROR (@error.reviews) is a bug-bounty program for science that seeks to estimate the prevalence and nature of errors. error.reviews

Home

ERROR is a bug bounty program for science to systematically detect and report errors in academic publications

error.reviews

3 18

Lucija Batinovic @metahag.bsky.social · Jul 16

For anyone who’s published systematic reviews, how often did you succeed in getting unpublished data by reaching out to authors? I don’t mean additional/IP data from published papers, but new data or data they could not get published. #evidencesynthesis

Lucija Batinovic @metahag.bsky.social · Jul 15

I asked with the same prompt and z-curve was not mentioned at all. I got too long of a reply but it mentioned:

Among commonly used tests, Peters’ test seems to strike a good balance:
– better power than Begg’s,
– lower false positive rate than Egger’s when heterogeneity is present.

1 1

Reposted by Lucija Batinovic

Daniel Lakens @lakens.bsky.social · Jul 9

A lot of discussions about open science in psychology happened on blogs. I have been archiving them and will make their content available. I remember 37 blogs (with 2827 posts!) but which blogs did I forget, and are not on my list? Please share and reply with any that are missing!

8 15 21

Reposted by Lucija Batinovic

moin syed @syeducation.bsky.social · Jul 5

New post! "A Tale of Two Science Reform Movements," in which I compare the recent #Metascience2025 and #SIPS2025 conferences, and find that I am much more at home at one than the other. getsyeducated.substack.com/p/a-tale-of-...

A Tale of Two Science Reform Movements

Reflections from meetings of Metascience 2025 and the Society for the Improvement of Psychological Science

getsyeducated.substack.com

14 42 130

Reposted by Lucija Batinovic

Lucija Batinovic @metahag.bsky.social · Jul 2

Agreed, I feel like the overall direction of the entire conference felt too abstract and almost like it’s engaging in “meta-washing”

1 1 2

Lucija Batinovic @metahag.bsky.social · Jul 2

Agreed, I feel like the overall direction of the entire conference felt too abstract and almost like it’s engaging in “meta-washing”

1 1 2

Lucija Batinovic @metahag.bsky.social · Jun 30

Yes, very slow, no matter which browser used. It’s been like that since they had the crash…

2

Reposted by Lucija Batinovic

COSIG @cosig.net · Jun 4

Anyone can do post-publication peer review.
Anyone can be a steward of the scientific literature.
Anyone can do forensic metascience.
Anyone can sleuth.

That's why we are launching COSIG: the Collection of Open Science Integrity Guides, an open source resource for all of the above.

cosig.net

4 58 100

Lucija Batinovic @metahag.bsky.social · May 27

What came first, the paper idea or the acronym

Eike Mark Rinke @emrinke.bsky.social · May 23

Most weeks I recommend to our Leeds @ukrepro.bsky.social network an "Open Research Friday Reading". Why not share it here, too?

Today I shared "A Manifesto for a Globally DEI Open Science" by @sakshighai.bsky.social et al. - important read for any social scientist ☝️

www.nature.com/articles/s44...

A manifesto for a globally diverse, equitable, and inclusive open science - Communications Psychology

Psychology must embrace more responsible practices in design, reporting, generalisation, and evaluation of research to counteract the spectre of Questionable Generalisability Practices and the issue o...

www.nature.com