Research on Research Institute (RoRI)
@rorinstitute.bsky.social
2.8K followers 450 following 160 posts
RoRI’s mission is to accelerate transformational research on research systems, cultures & decision-making.
Posts Media Videos Starter Packs
rorinstitute.bsky.social
Australia’s universities are rethinking how they assess learning and research in the age of AI.

The Australian reports that AI “cheats” are almost impossible to detect - and RoRI partner Australian Research Council is reviewing its AI policy for grant assessment.

Read more(£): tinyurl.com/3tzfvvpk
rorinstitute.bsky.social
“Using metrics to assess researchers can be ‘very dodgy terrain,’” says @jameswilsdon.bsky.social.

Great overview of how research assessment is changing worldwide in @nature.com , featuring recent work by RoRI with the Global Research Council: www.nature.com/articles/d41...
rorinstitute.bsky.social
At our UCL seminar, ESRC Exec Chair @stianwestlake.bsky.social said UKRI’s analytic capacity is “pretty limited” and “geared towards compliance need.” Better use of data will be key for stronger investment decisions and to act as the UK’s “strategic brain” for R&D: tinyurl.com/5n742x5w
rorinstitute.bsky.social
New in @nature.com: Funding the Frontier, an AI tool to map & predict research impacts.

The piece cites RoRI's @jameswilsdon.bsky.social, who warns such algorithms risk reinforcing past successes over future potential: www.nature.com/articles/d41...
rorinstitute.bsky.social
Yesterday, we hosted Stian Westlake (@ukri.org ESRC) for a seminar at UCL on how analytics & experimentation can strengthen research funding and UKRI’s role as a “strategic brain” for UK R&D. With great responses from Molly Morgan Jones (British Academy) & Sarah Chaytor (UCL).
rorinstitute.bsky.social
DOIs may seem like a technical detail, but they’re central to how research outputs are recognised.

In a new blog post, RoRI's @ludowaltman.bsky.social & @andre-brasil.bsky.social discuss why we need good practices for DOI registration for publish-review-curate platforms: tinyurl.com/y632m7kz
rorinstitute.bsky.social
🧠 Does STI policy need a strategic brain?

Join us next Tuesday at UCL for a talk by @stianwestlake.bsky.social (Executive Chair, @ukri.org ESRC) on the future of UK R&D, with responses from @britishacademy.bsky.social's Molly Morgan Jones & UCL’s Sarah Chaytor: tinyurl.com/vekzka23
Reposted by Research on Research Institute (RoRI)
jameswilsdon.bsky.social
Does STI policy need a strategic brain?

Join us at 5pm on 30 Sept for a talk by @stianwestlake.bsky.social, Executive Chair, ESRC @ukri

Hosted by STEaPP-UCL & RoRI, w/ responses by @britishacademy.bsky.social’s Molly Morgan-Jones & UCL’s Sarah Chaytor

www.eventbrite.co.uk/e/does-sti-p...
Does STI policy need a strategic brain?
A seminar on how metascience might sharpen investment decisions across the UK’s research system
www.eventbrite.co.uk
rorinstitute.bsky.social
🧠 Does STI policy need a strategic brain?

Join us at UCL on 30 Sep for a discussion with @stianwestlake.bsky.social, Executive Chair of @ukri.org's ESRC, with responses from Molly Morgan Jones (@britishacademy.bsky.social) and Sarah Chaytor (@uclpublicpolicy.bsky.social): tinyurl.com/vekzka23
rorinstitute.bsky.social
Join RoRI's Peter Kolarz tomorrow for a discussion on how to build impact into grant applications ⬇️
scientifyresearch.org
Learn how to build real-world impact into your grant applications & align with policy priorities. Join us on 17 Sept at 15:00 CET for this insightful webinar hosted by #scientifyRESEARCH and @overton.io
Register now: www.scientifyresearch.org/event/succes...
#ResearchFunding #Overton
how do you demonstrate impact? success with research funding building impact into applications and understanding policy priorities free webinar overton scientifyRESEARCH
rorinstitute.bsky.social
RoRI's @tomstafford.mastodon.online.ap.brid.gy has shared reflections on his Substack about our recent study with @volkswagenstiftung.de on distributed peer review.

If you’ve read the paper, this is your chance to see the “director’s commentary” - and if not, it’s a great place to start ⬇️
tomstafford.mastodon.online.ap.brid.gy
New newsletter. I cross the #decisionmaking and #metascience streams and write about recent work we've been doing at the @RoRInstitute

https://open.substack.com/pub/tomstafford/p/distributed-peer-review

It's the academic equivalent of those video […]

[Original post on mastodon.online]
Distributed Peer Review
A new method for evaluating research project proposals shows us how much we don't know about collective decision making.
rorinstitute.bsky.social
“The discipline of Sociology has taught me that systems usually don’t want to change, and will often resist change even if their longevity depends on it. For the grant-funding system, change is here."

RoRI's Peter Kolarz on the future of research funding: www.scientifyresearch.org/blog/grant-f...
rorinstitute.bsky.social
📢 New RoRI paper out in Science & Technology Studies

The study explores how 8 research funders navigate the ambiguous role of “excellence” - not simply as a matter of fact, but increasingly as a matter of concern requiring reconfiguration: sciencetechnologystudies.journal.fi/article/view...
rorinstitute.bsky.social
🔓 It's great to see authors sharing their experiences with publishing on MetaROR (MetaResearch Open Review) — our open review platform for metascience using the publish–review–curate model: www.openscience.nl/en/cases/the...
rorinstitute.bsky.social
"Much of what shapes a scientific paper never sees the light of day."

RoRI's André Brasil writes about MetaROR (MetaResearch Open Review) and opening the black box of peer review in the inaugural issue of REACH by @sci-integrity.com: www.sci-integrity.com/reach-inaugu...
rorinstitute.bsky.social
🇦🇹 How are researchers in Austria doing?

RoRI partner @fwf-at.bsky.social has just published Austria’s largest survey of the research community.

Over 3,300 researchers shared their views on careers, working conditions, and funding: www.fwf.ac.at/en/news/deta...
Reposted by Research on Research Institute (RoRI)
sciencebusiness.net
#AI is reshaping #science, but not without risks. At Metascience 2025, researchers praised AlphaFold yet warned of spam, fake papers and hype drowning real discovery.
🔎https://sciencebusiness.net/news/ai/ai-science-it-useful
AI in science: is it useful?
Artificial intelligence might be useful to scientists in some circumstances, but it’s unlikely to revolutionise the job, according to presentations at a conference held last month that discussed the t...
sciencebusiness.net
rorinstitute.bsky.social
Distributed peer review cuts funding decision time, our new paper shows; but the approach also raises important questions about fairness, bias, and gaming the system.

Great to see our study with @volkswagenstiftung.de featured in @sciencebusiness.net (£): sciencebusiness.net/news/r-d-fun...
Reposted by Research on Research Institute (RoRI)
rorinstitute.bsky.social
Great to see our new study on distributed peer review featured in ResearchProfessional (£).

Together with @volkswagenstiftung.de, we tested if asking applicants themselves to review each other’s grant proposals could speed up the funding process: www.researchprofessionalnews.com/rr-news-euro...
Radical method cuts time on peer review by 60%, trial finds - Research Professional News
Grant proposals also get more attention under distributed peer review, experiment shows
www.researchprofessionalnews.com