Ian Hussey
@ianhussey.mmmdata.io
3.1K followers 820 following 650 posts

Meta-scientist and psychologist. Senior lecturer @unibe.ch‬. Chief recommender @error.reviews. "Jumped up punk who hasn't earned his stripes." All views a product of my learning history.

Psychology 66%
Sociology 10%
Posts Media Videos Starter Packs
Pinned
ianhussey.mmmdata.io
Lego Science is research driven by modular convenience.

When researchers combine methods or concepts, more out of convenience than any deep curiosity in the resulting research question, to create publishable units.

"What role does {my favourite construct} play in {task}?"

ianhussey.mmmdata.io
The picture is the exact materials given to the participant, and they were also shown physical props of each (dummy poop in a plastic bag and a bowl of Lindt chocolates). I think the materials did not imply subtler distinctions like in vs out of bag, but also did not explicitly say vs the chocolate.

ianhussey.mmmdata.io
Yes here’s how they asked bsky.app/profile/ianh...
ianhussey.mmmdata.io
The original study used these questions, which did not actually ask about "desirability"!

ianhussey.mmmdata.io
I forgot to add: we use a 1-7 scale.

ianhussey.mmmdata.io
The original authors could not tell us which specific version of Cohen's d was used, but it was likely a within-subjects version of it. Between subjects versions of it applied to the M/SD dont reproduce the reported value.

We'll use Cohen's d_rm: within-subjects, taking correlation into account.

ianhussey.mmmdata.io
Our questions are:
"How desirable is human poop in a toilet bowl?" vs "How desirable is a bowl of chocolates?", with pictures of both, from "Very undesirable" to "Very desirable"
We also have other qs, but this is the one I want predictions for.

ianhussey.mmmdata.io
The original study used these questions, which did not actually ask about "desirability"!

ianhussey.mmmdata.io
This study is useful for building intuitions for the upper bound of plausible effect sizes.

Precision of the original estimate is an issue: the original study had 20 participants and didn't report confidence intervals; ours has 500.

ianhussey.mmmdata.io
Make an effect size prediction!

@jamiecummins.bsky.social and I are replicating Balcetis & Dunning's (2010) "chocolate is more desirable than poop" (Cohen's d = 4.52)

Let us known in the replies what effect size you think we'll find. Details of the study in the thread below.

Reposted by Ian Hussey

matti.vuorre.com
This is really nice.

But at the same time it is sad that a separate journal for replications is needed. Replications are not a different kind of thing but instead a foundational aspect of normal run of the mill science biz. We should not reinforce the idea that they should be treated differently.
aufdroeseler.bsky.social
ReplicationResearch.org is now open for submissions!

Submit replications and reproductions from many different fields, as well as conceptual contributions. With diamond OA, open and citable peer review reports, and reproducibility checks, we push the boundaries of open and fair publishing.
aufdroeseler.bsky.social
ReplicationResearch.org is now open for submissions!

Submit replications and reproductions from many different fields, as well as conceptual contributions. With diamond OA, open and citable peer review reports, and reproducibility checks, we push the boundaries of open and fair publishing.
jrgptrs.bsky.social
New DP @i4replication.bsky.social: Meta-analysis on green nudges correcting for publication bias. "Behavioral interventions on households and individuals are unlikely to deliver material climate benefits." www.econstor.eu/bitstream/10...

ianhussey.mmmdata.io
Me: I cannot afford to take on a new side project.

Also me:

ianhussey.mmmdata.io
"We regret to inform you that your application for tenure has been denied."

ianhussey.mmmdata.io
It said 'data available upon request' but when I clicked the button nothing happens

ianhussey.mmmdata.io
Please someone help me figure out the rest of this joke

Reposted by Ian Hussey

cghlewis.bsky.social
Issue 16 of RDM Weekly is out! 📬

It includes:
- Data is Not Available Upon Request @ianhussey.mmmdata.io
- AI Generated Participants in Social Science @jamiecummins.bsky.social @science.org
- Why’s it Hard to Teach Data Cleaning? @randyau.com
and more!

rdmweekly.substack.com/p/rdm-weekly...
RDM Weekly - Issue 016
A weekly roundup of Research Data Management resources.
rdmweekly.substack.com

ianhussey.mmmdata.io
“Something response, which could include antidepressant, natural improvement, regression to the mean, and others”

ianhussey.mmmdata.io
Let’s say that only some of this was satire.

bsky.app/profile/ianh...
ianhussey.mmmdata.io
Data is available upon request … but only in the form of one hundred non sequential 3.5” floppy disks containing a segmented zip file, inside of which are confusingly named files that can only be opened using the 1996 application StatView for Apple Mackintosh. Enclose a cashiers check for postage.

ianhussey.mmmdata.io
You raise a good point that research to date has focused on whether authors share data directly when contacted but not whether, if the don’t, that the journal will step in to try to uphold the policy when asked.

ianhussey.mmmdata.io
Kind of you, but my study was quite small. It does give more of a peek into authors’ wild responses than others, but the largest/best one out there is probably Tedersoo et al, which is really large scale and shows the same results.

ianhussey.mmmdata.io
In my experience, many journals don’t stand over their own policies either. I’ve had editors treat me as hostile for taking journal policy and authors statements seriously and asking for data promised.

ianhussey.mmmdata.io
My article "Data is not available upon request" was published in Meta-Psychology. Very happy to see this out!
open.lnu.se/index.php/me...
LnuOpen | Meta-Psychology
open.lnu.se

Reposted by Ian Hussey

ianhussey.mmmdata.io
The FDA announced that it would expand the use of leucovorin as “a promising treatment for symptoms of autism” citing 23 publications. Those 23 studies have a total N=46 with a specific genetic disorder, not for autism generally.

www.thetransmitter.org/spectrum/exc...
Exclusive: The 23 studies the FDA based its expanded leucovorin label on
The studies include 46 people, mostly toddlers, who have cerebral folate deficiency due to variants in a folate transporter.
www.thetransmitter.org
absolutely-not.bsky.social
i looked at the methodology for this and it is
a. sex addiction counseling group in texas did a surveymonkey and extrapolated the results to the entire us population which is the sort of research design that earns you an ff on an intro methods class (the extra f is for extra effort), and
b. p-hacked
the-independent.com
Nearly a third of Americans have had a ‘romantic relationship’ with an AI bot, new survey says
1 in 3 Americans have had a ‘romantic relationship’ with an AI bot, new survey says
www.independent.co.uk