Lightnews — Scholar-powered news

Reposted by Gary Collins

Richard Riley (R²) @richarddriley.bsky.social · 8d

Giving a talk today which anyone can watch online: 1pm - 2pm
"The Importance of Sample Size for the Development and Evaluation of Clinical Prediction Models"
- intended for a broad audience (anyone doing or using prediction model research)
imperial-ac-uk.zoom.us/webinar/regi...

Welcome! You are invited to join a webinar: Research Methods Academy: Seminar - The Importance of Sample Size for the Development and Evaluation of Clinical Prediction Models. After registering, you w...

Led by Professor Richard Riley Join this Online Seminar on clinical prediction models estimate individual risk for outcomes from disease. Many studies lack rigorous design; this session will focus o...

imperial-ac-uk.zoom.us

7 13

Reposted by Gary Collins

Journal of Clinical Epidemiology @jclinepi.bsky.social · 20d

Peer review of prediction model studies in oncology needs improvement: a systematic review of open peer review reports from BMC journals - Journal of Clinical Epidemiology www.jclinepi.com/article/S089...

Peer review of prediction model studies in oncology needs improvement: a systematic review of open peer review reports from BMC journals

To evaluate the completeness and quality of open peer review reports from BMC journals for regression-based clinical prediction model studies in oncology, focusing on adherence to methodological stand...

www.jclinepi.com

2 5

Reposted by Gary Collins

Tim Feeney @tfeend.bsky.social · 23d

Saddened to hear of the passing of Drummond Rennie, a quite influential figure. retractionwatch.com/2025/09/15/d...

Drummond Rennie (1936-2025), in his own words

Drummond Rennie I first became aware of the work of Drummond Rennie almost by accident: By borrowing his office. It was the summer of 1997, and as a rising fourth-year medical student, I was spendi…

retractionwatch.com

4 3

Gary Collins @gscollins.bsky.social · 23d

NEW PAPER "The STARD-AI reporting guideline for diagnostic accuracy studies using #artificialintelligence"

--> www.nature.com/articles/s41...

#machinelearning #MLsky #statssky #digitalhealth #transparency

4 10

Reposted by Gary Collins

Jack Wilkinson @jdwilko.bsky.social · Sep 5

www.medrxiv.org/content/10.1...

INSPECT-SR: A tool for assessing trustworthiness of randomised controlled trials.

INSPECT-SR: a tool for assessing trustworthiness of randomised controlled trials

The integrity of evidence synthesis is threatened by problematic randomised controlled trials (RCTs). These are RCTs where there are serious concerns about the trustworthiness of the data or findings....

www.medrxiv.org

3 34 66

Reposted by Gary Collins

Simon Gates @sim0ngates.bsky.social · Aug 13

Job available for a statistician to work on a clinical trials methodology project on improving statistical methods for paediatric cancer ttrials.

Cancer Research UK Clinical Trials Unit, University of Birmingham

Closes 22 September

edzz.fa.em3.oraclecloud.com/hcmUI/Candid...

Biostatistician - Cancer Research UK Clinical Trials Unit - 105965 - Grade 7

This post is for a Biostatistician to be the main statistical scientist for a methodological project on improving statistical methods for the design and analysis of clinical trials in paediatric cance...

edzz.fa.em3.oraclecloud.com

1 7 3

Reposted by Gary Collins

JAMA @jama.com · Aug 10

📌 The SPIRIT 2025 statement updates the guidelines for randomized trial protocols to enhance their completeness, transparency, and consistency, benefiting stakeholders involved in clinical research.

ja.ma/4fzMVZS

Figure. SPIRIT 2025 Diagram of the Schedule of Enrollment, Interventions, and Assessments

20 32

Gary Collins @gscollins.bsky.social · Aug 4

TRIPOD+AI and CHART target different studies.

TRIPOD+AI is for studies describing the development/evaluation of non-generative AI models for diagnosis/prognosis.

CHART is for studies evaluating generative AI driven chatbots that summarise clinical evidence and providing health advice.

1

Reposted by Gary Collins

Jason Moore @moorejh.bsky.social · Aug 4

Reporting guideline for chatbot health advice studies: the Chatbot Assessment Reporting Tool (CHART) statement bmjmedicine.bmj.com/content/4/1/... #llms #chatbots #bioinformatics #healthcare

Reporting guideline for chatbot health advice studies: the Chatbot Assessment Reporting Tool (CHART) statement

The Chatbot Assessment Reporting Tool (CHART) is a reporting guideline developed to provide reporting recommendations for studies evaluating the performance of generative artificial intelligence (AI)-...

bmjmedicine.bmj.com

5 7

Reposted by Gary Collins

Research Professional News @resprofnews.bsky.social · Aug 4

UKRI award rate halves in seven years as grant applications double. www.researchprofessionalnews.com/rr-news-uk-r...

UKRI award rate halves in seven years as grant applications double - Research Professional News

Trends across research councils prompt warning that system is “overstretched or broken”

www.researchprofessionalnews.com

18 19

Gary Collins @gscollins.bsky.social · Aug 3

NEW PAPER: the CHART reporting guideline for studies evaluating generative AI models like #ChatGPT & other #LLMs for providing health advice

--> bmjmedicine.bmj.com/content/4/1/...

The explanation & elaboration paper

--> www.bmj.com/content/390/...

#genAI #chatbots #healthadvice #reporting

1 3 13

Reposted by Gary Collins

Richard Riley (R²) @richarddriley.bsky.social · Jul 29

New paper in BMJ (Research Methods & Reporting):

“Dealing with continuous variables and modelling non-linear associations in healthcare data: practical guide”

led by Pedro Lopez-Ayala & Tobias Zimmermann with & myself

www.bmj.com/content/390/...

Dealing with continuous variables and modelling non-linear associations in healthcare data: practical guide

Proper handling of continuous variables is crucial in healthcare research, for example, within regression modelling for descriptive, explanatory, or predictive purposes. However, inadequate methods ar...

www.bmj.com

1 10 40

Reposted by Gary Collins

The BMJ @bmj.com · Jul 25

Many high street health tests are unfit for purpose and need greater regulation, warn researchers in two studies.

These studies highlight issues over accuracy and suitability for public use, they say
www.bmj.com/content/390/...
www.bmj.com/content/390/...

11 10

Reposted by Gary Collins

Tim Morris @timpmorris.bsky.social · Jul 23

Post just up: Is multiple imputation making up information?

tldr: no.

Includes a cheeky simulation study to demonstrate the point.
open.substack.com/pub/tpmorris...

Cover picture with blog title & subtitle, and results graph in the background

3 11 40

Reposted by Gary Collins

The BMJ @bmj.com · Jul 21

This article provides an overview of the current state of handling continuous variables in healthcare research.

It discusses the potential limitations of assuming a linear relationship between independent and dependent variables
www.bmj.com/content/390/...

Linear predictor plot for three modelling approaches to analyse continuous variables in a case study of cerebrospinal fluid glucose and acute bacterial meningitis

3 17 39

Reposted by Gary Collins

Florian Naudet @floriannaudet.bsky.social · Jul 17

Peer review reports of randomized controlled trials in oncology can be short and superficial

To evaluate the quality of open peer review reports published alongside articles of randomized controlled trials (RCTs) in oncology.

www.jclinepi.com

1 5 4

Gary Collins @gscollins.bsky.social · Jul 16

NEW PAPER in @bmj.com "Dealing with continuous variables and modelling non-linear associations in healthcare data: practical guide"

--> www.bmj.com/content/390/...

#methodologymatters #StatsSky #EpiSky

1 17 51

Reposted by Gary Collins

Richard Riley (R²) @richarddriley.bsky.social · Jul 8

**NEW OPEN-ACCESS PAPER**

“A decomposition of Fisher’s information to inform sample size for developing or updating fair and precise clinical prediction models for individual risk—part 1: binary outcomes"

- published in Diagnostic & Prognostic Research
- implemented in pmstabilityss

1/n

3 11 25

Gary Collins @gscollins.bsky.social · Jul 1

NEW PAPER in @jclinepi.bsky.social looking at the content of open peer-review reports of RCTs in the field of oncology

www.jclinepi.com/article/S089...

Peer review reports [...] were short (median 276 words), superficial, and rarely constructive

#metascience #peerreview #RCTs

4 9

Reposted by Gary Collins

Norm Matloff (你有冇諗清楚呀?) @matloff.bsky.social · Jun 27

Very nice summary of the confusing and often ill-posed metrics.

Gary Collins @gscollins.bsky.social · Jun 26

NEW PREPRINT "Critical Appraisal of Fairness Metrics in Clinical Predictive AI"

-> arxiv.org/abs/2506.17035

We identified 62 fairness metrics (and growing) - unsurprisingly it's all a bit of a mess...with most metrics not fit for purpose

#predictiveAI #fairness #machinelearning #StatsSky #MLSky

2 3

Reposted by Gary Collins

Richard Riley (R²) @richarddriley.bsky.social · Jun 27

* New preprint led by Joao Matos & @gscollins.bsky.social

"Critical Appraisal of Fairness Metrics in Clinical Predictive AI"

- Important, rapidly growing area
- But confusion exists
- 62 fairness metrics identified so far
- Better standards & metrics needed for healthcare
arxiv.org/abs/2506.17035

5 10

Gary Collins @gscollins.bsky.social · Jun 26

NEW PREPRINT "Critical Appraisal of Fairness Metrics in Clinical Predictive AI"

-> arxiv.org/abs/2506.17035

We identified 62 fairness metrics (and growing) - unsurprisingly it's all a bit of a mess...with most metrics not fit for purpose

#predictiveAI #fairness #machinelearning #StatsSky #MLSky

5 15

Reposted by Gary Collins

World Conferences on Research Integrity @wcrifoundation.bsky.social · Jun 24

And the exciting announcement! The 9th WCRI is set to take place in Vancouver, Canada, in 2026! Look forward to seeing you all there!

1 5 10

Reposted by Gary Collins

Anne-Laure Boulesteix @boulesteixlaure.bsky.social · Jun 23

For researchers with limited background in statistics, we have written this gentle introduction to simulation studies (with @timpmorris.bsky.social and other people from the STRATOS initiative):
bmjopen.bmj.com/content/10/1...

Introduction to statistical simulations in health research

In health research, statistical methods are frequently used to address a wide variety of research questions. For almost every analytical challenge, different methods are available. But how do we choos...

bmjopen.bmj.com

1 18 40

Reposted by Gary Collins

Research Professional News @resprofnews.bsky.social · Jun 22

REF 2029: splitting staff from outputs ‘distressing’ in jobs crisis.

Decision to hold fast on portability prompts criticism over potential impact on early career researchers.

One of our most-read articles this week.

www.researchprofessionalnews.com/rr-news-uk-r...

REF 2029: splitting staff from outputs ‘distressing’ in jobs crisis - Research Professional News

Decision to hold fast on portability prompts criticism over potential impact on early career researchers

www.researchprofessionalnews.com

2 3 5