Ian Hussey
banner
ianhussey.mmmdata.io
Ian Hussey
@ianhussey.mmmdata.io

Meta-scientist and psychologist. Senior lecturer @unibe.ch‬. Chief recommender @error.reviews. "Jumped up punk who hasn't earned his stripes." All views a product of my learning history. If behaviorism did not exist, it would be necessary to invent it. .. more

Psychology 66%
Sociology 10%
Pinned
Lego Science is research driven by modular convenience.

When researchers combine methods or concepts, more out of convenience than any deep curiosity in the resulting research question, to create publishable units.

"What role does {my favourite construct} play in {task}?"

Reposted by Ian Hussey

This is good. Authors ask an LLM to write a systematic review. The LLM states ‘prospectively registered’ and includes a fake registration number. When queried, authors send a corrected reg number…which has been created after the query. You love to see it. Happy new year!

Reposted by Ian Hussey

Tomorrow I’ll be speaking on a panel for the WHO webinar Social Health and Digital Play: A Conversation, Not a Conclusion. I’ll be sharing insights from a recent Delphi study focusing on priorities and future directions in video game research.

If this topic is of interest, feel free to join!
Social Health and Digital Play: A Conversation, Not a Conclusion
Join us for a public webinar on Social Health and Digital Play: A Conversation, Not a Conclusion where we aim to share insights from WHO’s work on social connection; reflect on the current state of th...
www.who.int

Reposted by Ian Hussey

Left as an exercise to the reader
Too many significance tests!!

Made this little graphic for my #stats class, showing the various kinds of (N)HST and how interpreting confidence intervals can replace all of them.

Made with #rstats #ggplot (duh)

There’s nothing about those publications to brag about

Is it a bad time to tell you I had 12 publications upon graduation? That lab was trained in 🔪🥓

One thing to bear in mind is that people can postdoc here for a much longer time from what I know of the US, and this changes what the role is imo. There are even small numbers of tenured postdoc positions. There are many highly technical 7th+ year postdocs around.

Seconded for OS, and not even as a virtue: many PIs have OS expectations or requirements on them that they might not have the skills to fulfill alone, and rely on postdocs to drive forward.

I presume you mean that 5+ would raise eyebrows in a good way?

I think technical skills are in high demand, from what I see around Belgium/NL/German/Switzerland.

Reposted by Ian Hussey

hey European hivemind, I need some help...PhD students here, especially foreign ones, are feeling a lot of concern related to evolving immigration restrictions here. Those students are increasingly looking to postdocs in EU. To help advise them better, what are expectations for postdocs?

1/2

Me: surely at least the statistics literature has its house in order.

The stats literature:

Reposted by Ian Hussey

Stupid idea that has been plaguing me all weekend
🔍 Sleuthing challenge 🔍

How many suspicious patterns can you find in this table?

(You don't need to know what the variables are.)

Hints in next post! 👇

Standards are nowhere near as universal as the cohen ones. The {effectsize} R package collects and implements guidelines for interpretation, it’s a good go-to for a standard with references. I don’t know if my comment is in compliance with it. But the effect sizes are substantively very large.

More than 18 months have passed since I contacted the authors of this meta-analysis about serious flaws that substantially change the results.

More than 6 have passed since the published was involved.

No action taken.

One of the component studies has since been retracted.
PubPeer - Effect of acceptance and commitment therapy for depressive d...
There are comments on PubPeer for publication: Effect of acceptance and commitment therapy for depressive disorders: a meta-analysis (2023)
pubpeer.com

There are discrepancies between Table 3 and Table 4.

If you recalculate from Table 3, the primary outcome is Cohen's d = 21 (!)

pubpeer.com/publications...

Seems like they have a mix of SDs and SEs

Perhaps there are other inconsistencies - I only looked at PSS at post.

My calculator takes rounding into account and lets you explore if SE has been confused for SE - I think that’s likely here. It still comes out as d = 3.7 if you assume they are SEs though.

errors.shinyapps.io/recalc_indep...
recalc: Bounds of an independent t-test's p-value and Cohen's d from M/SD/N
errors.shinyapps.io

Seems like there are inconsistencies in the summary stats repeated between Table 3 and Table 4. I think you’ve used those from table 4. When I use those from table 3 I get cohens d of about 21 (!)
recalc: Bounds of an independent t-test's p-value and Cohen's d from M/SD/N
errors.shinyapps.io
“These findings provide clear evidence that data collected on MTurk simply cannot be trusted.”

You have huge signal boosting power, and I think that comes with the responsibility not to contribute to misunderstanding in this space. Every existing critique of this literature emphasises that causal claims are routinely made with weak or no causal evidence. Let’s learn from that.

I think you’re missing my point. We can’t squeeze causal claims out of longitudinal data, only inject causal assumptions. What we as readers can do is not repeat these causal statements as if they’re evidenced rather than assumed.
First MEP report.

Medical research often uses non-parametric tests. We looked, and noticed that small-sample rank-based tests (i.e. M-W, Wilcoxon) have significant granularity... like p-values!

So, here's GRIM for U values -- GRIM-U.

Enjoy.

medicalevidenceproject.org/grim-u-obser...
GRIM-U: A GRIM-like observation to establish impossible p values from ranked tests - Medical Evidence Project
The Medical Evidence Project uses forensic metascientific methods to examine medical research publications that have a disproportionately high impact on human health. Our aim is to determine where pro...
https://medicalevidenceproject.org/grim-u-observation-establish-impossible-p-values-ranked-tests/"

Surely our job is to critically evaluate research, not merely repeat authors' talking points.

Your opening tweet is a clearly causal claim that you've repeated, which immediately doesn't stand up to scrutiny. This is a ubiquitous critique of this type of work.

Reposted by Ian Hussey

This hasn't received much attention, but it looks like scammers also hacked into Francesca Gino's MTurk account, and asked MTurkers to buy her book Rebel Talent to boost the first-week sales of the book.

Poor lady cannot catch a break.

(links in comments)
How long should it take to retract a paper with incontrovertible signs of data fabrication? Sleuths think 2 months is too long, particularly when clinical risks are involved. deevybee.blogspot.com/2026/01/an-o...
#retraction #stemcells #cardiology
@erictopol.bsky.social
An Open Letter to the BMJ Editorial Board
to: Editor in chief, Kamran Abbasi , [email protected]      Executive editor, Theodora Bloom , [email protected]      Head of research, Elizab...
deevybee.blogspot.com

Reposted by Ian Hussey

so maybe @mdpiopenaccess.bsky.social could make a resolution to remove all editors and reviewers who have accepted nonsensical papers. It would be quite a cull
As a pioneer in Open Access scholarly publishing, MDPI upholds high ethical publishing standards across its journals.

Learn more about how MDPI continues to strengthen its publication ethics policies: buff.ly/nssdnLb

#MDPI #PublicationEthics #OpenAccess
As a pioneer in Open Access scholarly publishing, MDPI upholds high ethical publishing standards across its journals.

Learn more about how MDPI continues to strengthen its publication ethics policies: buff.ly/nssdnLb

#MDPI #PublicationEthics #OpenAccess