Lightnews — Scholar-powered news

Matthew B. Jané @matthewbjane.bsky.social · Jun 28

Wanna write a meta-analysis error report? matthewbjane.quarto.pub/meta-analysi...

matthewbjane.quarto.pub

Matthew B. Jané @matthewbjane.bsky.social · Jun 19

Update on Error Report #2: The impact of acoustic stimulation during sleep on memory and sleep architecture: A meta-analysis

The article has been retracted by agreement with the journal editor and authors #metascience

1 9

Reposted by Matthew B. Jané

Nick Holmes @thehandlab.bsky.social · May 26

"Meta-meta-analyses trade precision & rigor for expediency. If your aim is rigor, there’s no substitute for doing the hard work."

Preach!

I once read a #meta-analysis that mistook SE for SD. Since then I am suspicious of all such studies.

Do the hard work!

matthewbjane.github.io/blog-posts/b...

When Evidence Synthesis Obscures: A Critique of Meta-Meta-Analyses – Matthew B. Jané

Meta-analyses are often seen as the gold standard of evidence synthesis–systematic, quantitative, and rigorous (at least when done well). So it’s no surprise that some researchers have taken things a ...

matthewbjane.github.io

1 1 4

Reposted by Matthew B. Jané

Paul Whaley @dangerwhale.bsky.social · May 25

This is very nice from @matthewbjane.bsky.social as to why umbrella reviews are basically useless (sorry!), essentially because they compound up the issues with the meta analyses they include. I have the same concerns but articulate them less eloquently. matthewbjane.github.io/blog-posts/b...

When Evidence Synthesis Obscures: A Critique of Meta-Meta-Analyses – Matthew B. Jané

Meta-analyses are often seen as the gold standard of evidence synthesis–systematic, quantitative, and rigorous (at least when done well). So it’s no surprise that some researchers have taken things a ...

matthewbjane.github.io

3 18

Matthew B. Jané @matthewbjane.bsky.social · May 24

No a meta-meta-analysis-analysis

1 1 3

Matthew B. Jané @matthewbjane.bsky.social · May 24

I think my reaction to the first time I saw it was something along the lines of “wait you can just do that?”

1

Reposted by Matthew B. Jané

James Steele @jamessteeleii.bsky.social · May 24

I've moaned about meta-analyses of meta-analyses for a while and had several interesting experiences reviewing them... Now I can save time and just send people to Matt's post to explain why not to do them.

Matthew B. Jané @matthewbjane.bsky.social · May 23

Happy Friday everyone! I just posted what I think is an important blog post on my website. It is a critique of meta-meta-analyses: meta-analyses of meta-analyses.

Link: matthewbjane.github.io/blog-posts/b...

#stats #metascience

2 11

Matthew B. Jané @matthewbjane.bsky.social · May 24

Yeah I might do that. Maybe I’ll make it into a pre-print for now

1 8

Reposted by Matthew B. Jané

Matthew B. Jané @matthewbjane.bsky.social · May 23

Happy Friday everyone! I just posted what I think is an important blog post on my website. It is a critique of meta-meta-analyses: meta-analyses of meta-analyses.

Link: matthewbjane.github.io/blog-posts/b...

#stats #metascience

6 26 85

Matthew B. Jané @matthewbjane.bsky.social · May 23

Happy Friday everyone! I just posted what I think is an important blog post on my website. It is a critique of meta-meta-analyses: meta-analyses of meta-analyses.

Link: matthewbjane.github.io/blog-posts/b...

#stats #metascience

6 26 85

Matthew B. Jané @matthewbjane.bsky.social · May 23

I’ve been hearing it’s good. No spoilers please, still gotta watch it

1

Matthew B. Jané @matthewbjane.bsky.social · Apr 29

Most meta-analyses are bad, some are useful

2 17

Reposted by Matthew B. Jané

Brendan Nyhan @brendannyhan.bsky.social · Apr 29

I'm calling for a total and complete shutdown of JAMA Pediatrics until we can figure out what is going on goodscience.substack.com/p/the-resear... I mean, come ON

11 46 180

Matthew B. Jané @matthewbjane.bsky.social · Apr 28

(#metascience) A good article by @stuartbuck.bsky.social on the Fluoride and IQ meta-analysis: goodscience.substack.com/p/the-resear.... Summarizes some of the points in our forensic review of it (see the forensic review as a pre-print here: osf.io/preprints/os...). Very nice excerpt below:

1 5 8

Matthew B. Jané @matthewbjane.bsky.social · Apr 25

We tried to. Best we can do for now is submit to meta-psychology and post a pub-peer comment

1

Matthew B. Jané @matthewbjane.bsky.social · Apr 24

Nah y’all are right.

2

Reposted by Matthew B. Jané

JAMES HEATHERS @jamesheathers.bsky.social · Apr 24

When a STALT error messes up your pagination.

3 11

Reposted by Matthew B. Jané

Matthew B. Jané @matthewbjane.bsky.social · Apr 23

Error Report #4: matthewbjane.quarto.pub/meta-analysi...

The meta-analysis on Fluoride and IQ by Taylor et al (2025) is methodologically flawed and has data integrity issues. The full report by me, @jamesheathers.bsky.social, and @drg.bsky.social is on OSF: osf.io/preprints/os...
#metascience

5 22 69

Matthew B. Jané @matthewbjane.bsky.social · Apr 24

What does the pin emoji do?

2

Matthew B. Jané @matthewbjane.bsky.social · Apr 23

Error Report #4: matthewbjane.quarto.pub/meta-analysi...

The meta-analysis on Fluoride and IQ by Taylor et al (2025) is methodologically flawed and has data integrity issues. The full report by me, @jamesheathers.bsky.social, and @drg.bsky.social is on OSF: osf.io/preprints/os...
#metascience

5 22 69

Matthew B. Jané @matthewbjane.bsky.social · Apr 23

Don’t do it

1 3

Reposted by Matthew B. Jané

James Steele @jamessteeleii.bsky.social · Apr 17

Spent the past couple days looking at meta-analyses in body comp literature to get reasonable parameter estimates to use in simulations for a study we're planning and really trying to avoid giving myself a to-do list of meta-analyses that I need to correct/redo 🙃 cc: @matthewbjane.bsky.social

2 1 3

Reposted by Matthew B. Jané

Noah Greifer @noahgreifer.bsky.social · Apr 22

livefreeordichotomize.com by @lucystats.bsky.social

matthewbjane.github.io/blog.html by @matthewbjane.bsky.social

www.andrewheiss.com/blog/ by the king @andrew.heiss.phd

ngreifer.github.io/blog/ by yours truly (can't resist a self-promotion 😉)

Stats blogs are the best!

Posts | Noah Greifer

Statistical Consultant and Programmer

ngreifer.github.io

3 8 21

Matthew B. Jané @matthewbjane.bsky.social · Apr 11

Coding RCTs for a meta-analysis…

3 3 36

Reposted by Matthew B. Jané

Matthew B. Jané @matthewbjane.bsky.social · Apr 8

The meta-analysis on the relationship between Fluoride and IQ by Taylor et al. (2025) that RFK Jr. has cited contains major methodological flaws and data integrity issues that we describe in the following pre-print (submitted to meta-psychology): osf.io/preprints/os...

5 56 95