Lightnews — Scholar-powered news

Reposted

Item Response Warehouse @itemrespwarehouse.bsky.social · Sep 5

Publication describing the IRW now out! link.springer.com/article/10.3...
Over 1000 datasets in there with tools for pulling directly from R!

An introduction to the Item Response Warehouse (IRW): A resource for enhancing data usage in psychometrics - Behavior Research Methods

The Item Response Warehouse (IRW) is a collection and standardization of a large volume of item response datasets in a free and open-source platform for researchers. We describe key elements of the da...

link.springer.com

1 2

jbgilbert.bsky.social @jbgilbert.bsky.social · Jun 20

New paper out today in Journal of Policy Analysis and Management: doi.org/10.1002/pam.... @itemrespwarehouse.bsky.social

Estimating heterogeneous treatment effects with item‐level outcome data: Insights from Item Response Theory

Analyses of heterogeneous treatment effects (HTE) are common in applied causal inference research. However, when outcomes are latent variables assessed via psychometric instruments such as educationa....

doi.org

1 1

Reposted

Item Response Warehouse @itemrespwarehouse.bsky.social · Jun 2

Analysis of treatment effects on psychological networks using data from the IRW: "Our results show that causal effects on network strength are both common and uncorrelated with effects on network state." New work from @jbgilbert.bsky.social

psycnet.apa.org/doiLanding?d...

1 1

Reposted

Klint Kanopka @klint.bsky.social · Apr 1

Join us at the intersection of causal inference and psychometrics as we host Josh Gilbert (@jbgilbert.bsky.social) at the PRIISM Seminar.

Wednesday @ 10a: Estimating heterogeneous treatment effects with item-level data: Insights from Item Response Theory

steinhardt.nyu.edu/events/estim...

PRIISM | Estimating heterogeneous treatment effects with item-level data

Join PRIISM and Josh Gilbert to learn how to unmask hidden treatment effects within individual test items using Item Response Theory and to understand how to overcome the limitations of traditional si...

steinhardt.nyu.edu

2 2 8

jbgilbert.bsky.social @jbgilbert.bsky.social · Apr 2

very closely related! see, e.g. arxiv.org/abs/2409.03502 and edworkingpapers.com/ai24-1082

Testing Whether Reported Treatment Effects are Unduly Dependent on the Specific Outcome Measure Used

This paper addresses the situation in which treatment effects are reported using educational or psychological outcome measures comprised of multiple questions or "items." A distinction is made between...

arxiv.org

1

jbgilbert.bsky.social @jbgilbert.bsky.social · Apr 2

The key idea is like @klint.bsky.social described. Say I have a new fractions curriculum. If I look at the impact of this curriculum on the state math test, perhaps fractions items improve but geometry items don't. So it's more about our understanding of the intervention than an individual.

1

jbgilbert.bsky.social @jbgilbert.bsky.social · Mar 6

New paper out yesterday in Behavior Research Methods (BRM): link.springer.com/epdf/10.3758...

@itemrespwarehouse.bsky.social

Polytomous explanatory item response models for item discrimination: Assessing negative-framing effects in social-emotional learning surveys

link.springer.com

1 1

jbgilbert.bsky.social @jbgilbert.bsky.social · Feb 5

To any colleagues attending the @ncme38.bsky.social conference in Denver this April, I will be offering a training session on Wed. 4/23 at 1pm. Learn more at the links below:

Session Info: lnkd.in/et7P8xXS
Article: lnkd.in/e4Kawn76

3

Reposted

Item Response Warehouse @itemrespwarehouse.bsky.social · Dec 12

1/ What might data-rich #psychometrics research look like? As a first example, consider @jbgilbert.bsky.social on heterogeneous treatment effects (HTE). Josh uses #irt to examine item-level HTE, with insights drawn from 75 datasets across 48 randomized trials (arxiv.org/abs/2405.00161).

Estimating Heterogeneous Treatment Effects with Item-Level Outcome Data: Insights from Item Response Theory

Analyses of heterogeneous treatment effects (HTE) are common in applied causal inference research. However, when outcomes are latent variables assessed via psychometric instruments such as educational...

arxiv.org

1 2 6