Lightnews — Scholar-powered news

Reposted by Niklas Jakobsson

Institute for Replication @i4replication.bsky.social · Aug 27

#GDRI_rep Update 8a: Major updates coming up over the next few weeks.

1st update: We reproduced "Parent–teacher meetings and student outcomes" some time ago. The paper was then retracted by the editors of the Euro Econ Rev.

Additional studies are connected (see diagram)
🧵

1 13 17

Reposted by Niklas Jakobsson

Johanna Rickne @johannarickne.bsky.social · May 9

🚨 REPLICATION REPORT UPDATE: One year ago, a tweet by John Holbein alerted me, @ollefolke.bsky.social, and @jopieboy.bsky.social to a paper with a shocking result about Sweden’s law criminalizing the purchase of sex.🧵

7 200 390

Reposted by Niklas Jakobsson

Institute for Replication @i4replication.bsky.social · May 9

A re-analysis of Ciacci's (2024) "Banning the purchase of sex increases cases of rape: Evidence from Sweden" Journal of Population Economics reveals major issues. A year ago, reproducers Adema, Folke, and Rickne found coding errors driving the paper's key results. Let's unpack this in a 🧵

2 25 51

Reposted by Niklas Jakobsson

Andreas Ortmann @impartialspectator.bsky.social · Apr 26

Where we stand on the Islam-GDRI-Monash saga. A tally and some questions ...

a-ortmann.medium.com/tallying-the...

Tallying the fallout of the A. Islam — GDRI — Monash saga (so far) and questions prompted by it …

The I4R has reproduced hundreds of studies over the past three years, and we’ve never seen anything of this scale, said Brodeur. Brendan…

a-ortmann.medium.com

2 6

Reposted by Niklas Jakobsson

Andreas Ortmann @impartialspectator.bsky.social · Apr 16

More traction for the Islam - GDRI saga. Monash claiming that he “holds no official position with GDRI and has not received any personal or material benefit from GDRI since its inception in 2010”. Hmmmh.

www.theaustralian.com.au/education/mo...

www.theaustralian.com.au

3 5

Reposted by Niklas Jakobsson

Retraction Watch @retractionwatch.com · Apr 11

A Bangladesh-based organization focused on development economics and its founder have been churning out papers filled with misstatements, inconsistencies, ethical lapses and “statistically improbable data,” according to researchers involved in an ongoing effort to replicate the work.

Replication probe finds ‘statistically improbable data’ tied to institute in Bangladesh

Asad Islam A Bangladesh-based organization focused on development economics and its founder have been churning out papers filled with misstatements, inconsistencies, ethical lapses and “statistical…

retractionwatch.com

4 16

Reposted by Niklas Jakobsson

Andreas Ortmann @impartialspectator.bsky.social · Apr 10

The Islam - GDRI saga is gaining some traction.

retractionwatch.com/2025/04/10/r...

Replication probe finds ‘statistically improbable data’ tied to institute in Bangladesh

Asad Islam A Bangladesh-based organization focused on development economics and its founder have been churning out papers filled with misstatements, inconsistencies, ethical lapses and “statistical…

retractionwatch.com

1 4 14

Niklas Jakobsson @nikljako.bsky.social · Apr 4

Fantastic coauthors made this forensic data investigation fire!

Olle Hammar @ollehammar.bsky.social · Apr 4

Great to see our comment now available online in the European Economic Review! (w/ @carlbonander.bsky.social, @nikljako.bsky.social, @flxhlzmstr.bsky.social, Gunther Bensch & Abel Brodeur @i4replication.bsky.social) 🙌

“Try to balance the baseline”: A comment on “parent-teacher meetings and student outcomes: Evidence from a developing country” by Islam (2019)

Islam (2019) reports results from a randomized field experiment in Bangladesh that examines the effects of parent-teacher meetings on student test sco…

www.sciencedirect.com

1

Reposted by Niklas Jakobsson

Olle Hammar @ollehammar.bsky.social · Mar 27

The original paper is now retracted and our comment accepted for publication in the European Economic Review 🔥

4 13

Niklas Jakobsson @nikljako.bsky.social · Mar 27

I am very happy that the editors took our report seriously. Hope more retractions will follow.

Institute for Replication @i4replication.bsky.social · Mar 27

#GDRI_rep Update 7: Retraction! Our comment of "Parent–teacher meetings and student outcomes: Evidence from a developing country" has led to the paper being retracted. Our comment is accepted as is.

Short 🧵

1 4 14

Reposted by Niklas Jakobsson

Institute for Replication @i4replication.bsky.social · Mar 25

#GDRI_rep Update 6: Some of the authors have responded to our report on "Raising Health Awareness in Rural Communities" @ The Review of Economics and Statistics. Authors received our report Feb 6. A short 🧵

1 6 17

Reposted by Niklas Jakobsson

Andreas Ortmann @impartialspectator.bsky.social · Mar 16

Excellent find. How do you do this organizationally? How many enumerators do you need? How do you pay them? How do you get respondents to respond so well that your attrition rate over four waves is only 1.7%? The authors are rather shy on these issues and the costs. Clearly, GDRI worked magically.

Andreas Kotsadam @kotsadam.bsky.social · Mar 15

This gem is hidden in the response to the response. ”…within a few hours and under extreme time pressure 11,843 households were visited and 22,686 respondents interviewed (two spouses in each household).” Indeed hard to believe 🫠

3 7

Niklas Jakobsson @nikljako.bsky.social · Mar 15

Some would probably say it is impossible. Or maybe everyone?

Andreas Kotsadam @kotsadam.bsky.social · Mar 15

This gem is hidden in the response to the response. ”…within a few hours and under extreme time pressure 11,843 households were visited and 22,686 respondents interviewed (two spouses in each household).” Indeed hard to believe 🫠

1

Reposted by Niklas Jakobsson

Andreas Kotsadam @kotsadam.bsky.social · Mar 15

This gem is hidden in the response to the response. ”…within a few hours and under extreme time pressure 11,843 households were visited and 22,686 respondents interviewed (two spouses in each household).” Indeed hard to believe 🫠

1 10 20

Reposted by Niklas Jakobsson

Institute for Replication @i4replication.bsky.social · Mar 14

Since we started mass reproducing GDRI, we have requested several replication packages. We have not managed to get a single new replication package as of today (excluding updated packages for one article at the request of editors).

4 12

Reposted by Niklas Jakobsson

Institute for Replication @i4replication.bsky.social · Mar 14

#GDRI_rep Update 5: We have a new report. We reproduced the paper entitled "Partisan Effects of Information Campaigns in Competitive Authoritarian Elections: Evidence from Bangladesh" by Ahmed, Hodler and Islam published at the Economic Journal. See below for links to report and authors' responses.

1 13 19

Niklas Jakobsson @nikljako.bsky.social · Mar 13

Bli min kollega! Denna gång söker vi en statistiker (eller liknande) som gärna får jobba både i nationalekonomi och statistik.

Universitetslektor i statistik

Beskrivning Handelshögskolan vid Karlstads universitet (Karlstad Business School) grundades år 2009 och består av arbetsvetenskap, företagsekonomi, informatik, juridik, nationalekonomi och statist

kau.varbi.com

2 2

Reposted by Niklas Jakobsson

Olle Hammar @ollehammar.bsky.social · Mar 11

In a new @i4replication.bsky.social report we replicate Islam (2019). Main issue: the randomized controlled trial was not randomized. And many other things on top of that. See full report for details. (w/ @carlbonander.bsky.social, @nikljako.bsky.social, @flxhlzmstr.bsky.social, Bensch & Brodeur)

Institute for Replication @i4replication.bsky.social · Mar 11

#GDRI_rep Update 4: We have a new report. We reproduced the paper entitled "Parent–teacher meetings and student outcomes" by Islam @ European Economic Review. See below for links to report and author's response.

2 9 24

Reposted by Niklas Jakobsson

Institute for Replication @i4replication.bsky.social · Mar 11

#GDRI_rep Update 4: We have a new report. We reproduced the paper entitled "Parent–teacher meetings and student outcomes" by Islam @ European Economic Review. See below for links to report and author's response.

1 15 20

Reposted by Niklas Jakobsson

Institute for Replication @i4replication.bsky.social · Mar 9

#GDRI_rep Update 3: The paper "Improving Hygiene and Sanitation through Parental Skill Training" by Asadul Islam, Umair Khalil and Tabassum Rahman was conditionally accepted at Economic Development and Cultural Change. We requested a replication package. It has now been withdrawn

1 11 32

Reposted by Niklas Jakobsson

Essi Kujansuu @essieconomist.bsky.social · Mar 3

We have a new report out about the #GDRI_rep. The paper has not been retracted but all three authors have withdrawn their names.

Institute for Replication @i4replication.bsky.social · Mar 3

#GDRI_rep Update 2: I4R sent a report to the original authors for the PLOS One article "“Food insecurity and mental health of women during COVID-19: Evidence from a developing country". All authors have now emailed PLOS One to withdraw their names. osf.io/7tzek/

7 10

Reposted by Niklas Jakobsson

Institute for Replication @i4replication.bsky.social · Mar 3

#GDRI_rep Update 2: I4R sent a report to the original authors for the PLOS One article "“Food insecurity and mental health of women during COVID-19: Evidence from a developing country". All authors have now emailed PLOS One to withdraw their names. osf.io/7tzek/

1 9 9

Reposted by Niklas Jakobsson

Manne Gerell @mannegerell.bsky.social · Mar 3

Kom och jobba hos mig! Jag behöver minst en forskningsassistent, heltid i ett år, tillträde snarast.

Meriterande med dokumenterad erfarenhet av:
* Enkäter/intervjuer
* Statistisk/geografisk analys
* Kunskap brottslighetens/otrygghetens geografi
* Brottsdata

web103.reachmee.com/ext/I005/101...

Forskningsassistent i kriminologi, minst en.

Malmö universitet är ett nyskapande, urbant och internationellt lärosäte som tack vare engagerade och erfarna

web103.reachmee.com

7 11

Reposted by Niklas Jakobsson

Institute for Replication @i4replication.bsky.social · Mar 3

#GDRI_rep Update 1: I4R are now reproducing all published papers that use data from GDRI, or are closely related in other ways. Here is a first update on our work. 🧵

1 20 27

Niklas Jakobsson @nikljako.bsky.social · Feb 25

Fantastic project where I participated. Lots of work from many involved researchers. And interesting findings on the effects of data cleaning on results.

Nick Huntington-Klein @nickchk.com · Feb 25

After a long wait, the working paper for the Many-Economists Project: The Sources of Researcher Variation in Economics. We had 146 teams perform the same research three times, each time with less freedom. What source of freedom leads to different choices and results? papers.ssrn.com/sol3/papers....

The Sources of Researcher Variation in Economics

We use a rigorous three-stage many-analysts design to assess how different researcher decisions—specifically data cleaning, research design, and the interpretat

papers.ssrn.com

3