Lightnews — Scholar-powered news

Reposted by Olivia Kirtley

simine vazire @simine.com · 1d

My blog has moved! It’s now at sometimesimwrongblog.wordpress.com If you have links to posts in your syllabus, let me know if you have any trouble finding the corresponding post!

1 11 24

Reposted by Olivia Kirtley

Benjamin Kunc @benjaminkunc.bsky.social · 9d

Are you an ESM item measuring the quality of social experiences looking for validation? 👀

Because if you are, I've got some bad news for you. Our new preprint is out: osf.io/preprints/ps...

@gudruneisele.bsky.social @ginettelafit.bsky.social @lisapeeters.bsky.social @oliviajkirtley.bsky.social

OSF

osf.io

2 5 6

Reposted by Olivia Kirtley

Society for the Improvement of Psychological Science (SIPS) @improvingpsych.org · 9d

Don't let minor submission errors delay the publication of your research! 📝 🔬

Remember to check the full guidelines when submitting the manuscript to PsyArXiv (buff.ly/M3cRBW2).

Below, we also have a few friendly reminders!

9 11

Reposted by Olivia Kirtley

Dorothy Bishop @deevybee.bsky.social · 10d

Open Science Workshop - detecting errors and misconduct in science
Dates: 20-22 October
Location: Radboud University, Nijmegen, The Netherlands
Registration link: tinyurl.com/3xkd8twf
ONLY PHYSICAL ATTENDENCE POSSIBLE! NO ONLINE POSSIBILITIES.

2 21 36

Reposted by Olivia Kirtley

Lisa Peeters @lisapeeters.bsky.social · 16d

The first preprint of my PhD is out! Our review maps choices that researchers make throughout an ESM study from start to finish, including reporting and open science practices. We compare our findings to previous literature where possible, but also provide novel insights! osf.io/preprints/ps...

OSF

osf.io

1 6 16

Reposted by Olivia Kirtley

Society for the Improvement of Psychological Science (SIPS) @improvingpsych.org · 21d

🥳 PsyArXiv is back to normal operations 🥳

Thanks to the fantastic team of moderators (thank you all🙏), PsyArXiv has resumed normal operations. You can expect any newly posted or edited preprint to be moderated within 24-72 hours of submission.

Learn more from our blog post👇
buff.ly/OtpsKhm

10 45

Olivia Kirtley @oliviajkirtley.bsky.social · Sep 1

Congratulations!

2

Reposted by Olivia Kirtley

Society for the Improvement of Psychological Science (SIPS) @improvingpsych.org · Aug 30

Is your preprint still pending moderation? See our recent post about how to make sure getting it approved is a smooth process:
bsky.app/profile/impr...

(pro tip: you can make edits even while it's in the moderation queue!)

Society for the Improvement of Psychological Science (SIPS) @improvingpsych.org · Aug 27

(1) Only submit to PsyArXiv if your contribution is within scope. Is it scholarly, and is it psychology?

(2) Include a title page with a descriptive title, all authors' names, and a contact email.

3 2

Reposted by Olivia Kirtley

Society for the Improvement of Psychological Science (SIPS) @improvingpsych.org · Aug 30

PsyArXiv is now down to only ~40% of the backlog we started with, thanks to our amazing moderators 🎉 To all mods: thank you so much for your hard work!

Did one of your preprints get approved recently? Help us show our thanks by liking and sharing this post :)

#PsyArXiv #PsychSciSky

1 35 110

Reposted by Olivia Kirtley

Society for the Improvement of Psychological Science (SIPS) @improvingpsych.org · Aug 24

Just passed 25% of the backlog cleared 🎉🎉🎉

The dedication of our volunteers is impressive!

Mods: Please feel free to come to office hours on Monday if you want to work in community.

Mods-to-be: Hope to see you at Training #3 at 8 pm ET!

Society for the Improvement of Psychological Science (SIPS) @improvingpsych.org · Aug 22

We are in awe of our community's response -- over 300 people have volunteered to moderate PsyArXiv! We’ve already cleared 13% of the backlog and expect to make even faster progress next week. Thank you for your patience as we work through this, and special thanks to our volunteers! 🎉 #PsychSciSky

6 23

Reposted by Olivia Kirtley

Katie Corker @katiecorker.bsky.social · Aug 21

New and improved 😆 Those who were at the first training will know we needed to 🤦‍♀️

See you tomorrow, we're so thrilled to see all of the interest in supporting @psyarxivbot.bsky.social

Society for the Improvement of Psychological Science (SIPS) @improvingpsych.org · Aug 21

Want to help moderate preprints on PsyArXiv? We're hosting a training tomorrow morning. Register here: us06web.zoom.us/j/8114764450... More trainings are coming as well! Already registered using the other form? Check your spam folder -- some of our email invitations are going to spam. #PsychSciSky

Welcome! You are invited to join a meeting: PsyArXiv Moderator Training #2. After registering, you will receive a confirmation email about joining the meeting.

us06web.zoom.us

6 6

Reposted by Olivia Kirtley

Katie Corker @katiecorker.bsky.social · Aug 15

🧠🧠🧠 PsyArXiv needs you! Please sign up to join our moderator team. First cohort is getting trained on next Monday, with more trainings to come. Easy way to give back to this crucial community resource. Students, postdocs, faculty, all welcome - come one and all!

Society for the Improvement of Psychological Science (SIPS) @improvingpsych.org · Aug 15

PsyArXiv is seeking new moderators to help combat an increase in AI submissions! If you've ever posted a preprint to PsyArXiv, please consider joining. Minimum commitment 1h/month, there's a training session this Monday @ 1pm ET. More info here: forms.gle/9LB1rEtxHAeZ... #PsychSciSky

Expression of Interest in Serving as a PsyArXiv Moderator

As you might have heard, PsyArXiv is having some issues with an increase in low-quality submissions, ranging from AI generated manuscripts to inflate citation metrics, incoherent or nonsensical docume...

forms.gle

16 19

Reposted by Olivia Kirtley

Katie Corker @katiecorker.bsky.social · Aug 12

My conclusion from this is that preprint servers (and journals!) are entering a new phase of cat and mouse trying to contain AI slop (n.b., not mundane AI use, but nonsense generation). Peer review as a filter scarcely does better to ID this stuff. We need new & better tools to ID trustworthy works.

Richard Van Noorden @richvn.bsky.social · Aug 12

Preprint servers are strugging with an influx of AI content. "How do you do quality assurance while keeping things relatively light touch so the system doesn’t collapse on itself?"
by Traci Watson | @nature.com

www.nature.com/articles/d41...

AI content is tainting preprints: how moderators are fighting back

Preprint servers are seeing a rise in submissions seemingly produced by paper mills or with help from AI tools.

www.nature.com

4 13 18

Olivia Kirtley @oliviajkirtley.bsky.social · Aug 14

Indeed! Another of our frequent posters.

2

Olivia Kirtley @oliviajkirtley.bsky.social · Aug 13

Another question is why now? Having gone through all PsyArXiv preprints from July, there were only about six from SDI. So they are not frequent posters relative to other users who've posted 50+ preprints. Also, the example @deevybee.bsky.social posted, was published in 2023. Not exactly a preprint.

2

Olivia Kirtley @oliviajkirtley.bsky.social · Aug 13

Thoughtful piece about the influx of suspicious #preprints (some involving AI) to PsyArXiv & other preprint servers. Wee mention of me and some of the preprint monitoring I've been doing in collaboration with PsyArXiv. Servers are not going to take this lying down. #OpenScience

Nature @nature.com · Aug 12

Preprint servers are seeing a rise in submissions seemingly produced by paper mills or with help from AI tools

go.nature.com/47sqZxw

AI content is tainting preprints: how moderators are fighting back

Preprint servers are seeing a rise in submissions seemingly produced by paper mills or with help from AI tools.

go.nature.com

1 7

Olivia Kirtley @oliviajkirtley.bsky.social · Aug 13

This is exactly what the last lot of Sciencedomain International preprints looked like back in July. I don't think they've been bounced from anywhere.

1

Olivia Kirtley @oliviajkirtley.bsky.social · Aug 13

Well, I have a feeling that some of these belong to the other investigation I'm conducting into Sciencedomain International, but why is indeed the question, given no citation benefit for authors from preprint as preprint has another author.

2

Reposted by Olivia Kirtley

Dorothy Bishop @deevybee.bsky.social · Aug 5

Does anyone know of a direct comparison between EU countries in terms of metrics used to evaluate universities and/or academic researchers? I'm especially interested in whether one can contrast countries that use N publications with those that don't. I suspect it's not so simple though

7 8 13

Reposted by Olivia Kirtley

Science Magazine @science.org · Aug 4

A new study, based on an analysis of thousands of publications and their authors and editors, shows paper mills are just part of a complex, interconnected system that includes publishers, journals, and brokers. scim.ag/3H9kwwQ

Scientific fraud has become an ‘industry,’ alarming analysis finds

Sophisticated global networks are infiltrating journals to publish fake papers

scim.ag

2 48 100

Olivia Kirtley @oliviajkirtley.bsky.social · Jul 28

Thanks! Mostly made it, but with some failures. Try, try again.

1 1

Olivia Kirtley @oliviajkirtley.bsky.social · Jul 28

Watching to see if my code will stall or keep grinding through downloading preprints with the OSF API is *almost* as tense as last night's penalties... 🙃. #OpenScience

1 1

Reposted by Olivia Kirtley

Rory O’Connor @roryoc.bsky.social · Jul 28

🆕 Following requests from authors, we have increased the word limit for all regular papers in Archives of Suicide Research to 5,000 words (Introduction, Methods, Results & Discussion)

4 13

Olivia Kirtley @oliviajkirtley.bsky.social · Jul 26

Since the 1st of these that I spotted, I've been working to download and document them all to try & identify patterns, repeat users, particular metadata, features of the preprint, etc. I've been reporting them to @cos.io support & working with the PsyArXiv moderation team. #OpenScience

5

Olivia Kirtley @oliviajkirtley.bsky.social · Jul 26

Glad to see @cos.io coming out with a statement about this after an influx of suspicious preprints hit PsyArXiv at the start of July. Many more have appeared since the first one I spotted. I Automated checks can only go so far & documenting all of them is a lot of work. #OpenScience

Brian Nosek @briannosek.bsky.social · Jul 26

Open infrastructures align transparency and rigor. By increasing the ease of sharing, researchers are more accountable to rigor, and readers are better able to evaluate it.

AI can upset that alignment creating a big challenge for open infrastructure.

www.cos.io/blog/evaluat...

A Shared Challenge: Evaluating AI’s Impact on Open Research Infrastructure

OSF was designed to make open scholarship possible and easy to adopt, while upholding the values of transparency, credibility, and accountability. As we navigate the evolving role of AI in research, C...

www.cos.io

1 5 16