Gabe Loewinger
@gabeloewinger.bsky.social
Machine learning research scientist @ NIMH interested in statistics, optimization, ML, neuroscience, Brazilian jiu-jitsu, cats.
In fact, we propose analyses to probe the causal effect of treatment on expectancy/belief/blinding integrity in the MSM/sequentially randomized design manuscript section (e.g., testing how expectancy changes over time in response to different treatment sequences).
January 26, 2026 at 5:40 PM
In fact, we propose analyses to probe the causal effect of treatment on expectancy/belief/blinding integrity in the MSM/sequentially randomized design manuscript section (e.g., testing how expectancy changes over time in response to different treatment sequences).
Thanks for your question! Our warning against conditioning on post-treatment belief does *not* extend to cautioning against testing blinding success. Testing for causal effects of experimentally manipulated variables (e.g., treatment) on outcomes like blinding/belief/expectancy is totally valid.
January 26, 2026 at 5:32 PM
Thanks for your question! Our warning against conditioning on post-treatment belief does *not* extend to cautioning against testing blinding success. Testing for causal effects of experimentally manipulated variables (e.g., treatment) on outcomes like blinding/belief/expectancy is totally valid.
Why This Matters:
• For advocates & those skeptical of psychedelics' benefits, this provides a framework to quantify drug effects + expectancy contributions
• Brings rigorous analytical tools to complement existing study design solutions
• Applicable to other functionally unmasked interventions
• For advocates & those skeptical of psychedelics' benefits, this provides a framework to quantify drug effects + expectancy contributions
• Brings rigorous analytical tools to complement existing study design solutions
• Applicable to other functionally unmasked interventions
December 9, 2025 at 5:41 PM
Why This Matters:
• For advocates & those skeptical of psychedelics' benefits, this provides a framework to quantify drug effects + expectancy contributions
• Brings rigorous analytical tools to complement existing study design solutions
• Applicable to other functionally unmasked interventions
• For advocates & those skeptical of psychedelics' benefits, this provides a framework to quantify drug effects + expectancy contributions
• Brings rigorous analytical tools to complement existing study design solutions
• Applicable to other functionally unmasked interventions
• CDEs can be estimated from existing trial data if the right variables are measured
• We use modern semiparametric estimation methods that can incorporate flexible machine learning
• We propose sequentially randomized designs to probe the durability of effects of the treatment and expectancy
• We use modern semiparametric estimation methods that can incorporate flexible machine learning
• We propose sequentially randomized designs to probe the durability of effects of the treatment and expectancy
December 9, 2025 at 5:41 PM
• CDEs can be estimated from existing trial data if the right variables are measured
• We use modern semiparametric estimation methods that can incorporate flexible machine learning
• We propose sequentially randomized designs to probe the durability of effects of the treatment and expectancy
• We use modern semiparametric estimation methods that can incorporate flexible machine learning
• We propose sequentially randomized designs to probe the durability of effects of the treatment and expectancy
We propose to address functional unmasking by quantifying treatment effects at fixed expectancy levels
• We specifically target controlled direct effect (CDE) causal mediation quantities
• We propose both experimental and observational causal inference approaches
• We specifically target controlled direct effect (CDE) causal mediation quantities
• We propose both experimental and observational causal inference approaches
December 9, 2025 at 5:41 PM
We propose to address functional unmasking by quantifying treatment effects at fixed expectancy levels
• We specifically target controlled direct effect (CDE) causal mediation quantities
• We propose both experimental and observational causal inference approaches
• We specifically target controlled direct effect (CDE) causal mediation quantities
• We propose both experimental and observational causal inference approaches
It is natural to try to statistically adjust for unmasking w/regression or stratifying
But post-treatment variables require careful analytical handling: intuitive approaches like stratifying results on perceived treatment can make even beneficial interventions appear harmful due to collider bias!
But post-treatment variables require careful analytical handling: intuitive approaches like stratifying results on perceived treatment can make even beneficial interventions appear harmful due to collider bias!
December 9, 2025 at 5:41 PM
It is natural to try to statistically adjust for unmasking w/regression or stratifying
But post-treatment variables require careful analytical handling: intuitive approaches like stratifying results on perceived treatment can make even beneficial interventions appear harmful due to collider bias!
But post-treatment variables require careful analytical handling: intuitive approaches like stratifying results on perceived treatment can make even beneficial interventions appear harmful due to collider bias!
Key insight: Unmasking isn't about confounding, it's about mediation through expectancy 🧠
Even "successfully masked" studies can yield misleading results if post-treatment expectancy levels differ across arms
So how do we address unmasking?
Even "successfully masked" studies can yield misleading results if post-treatment expectancy levels differ across arms
So how do we address unmasking?
December 9, 2025 at 5:41 PM
Key insight: Unmasking isn't about confounding, it's about mediation through expectancy 🧠
Even "successfully masked" studies can yield misleading results if post-treatment expectancy levels differ across arms
So how do we address unmasking?
Even "successfully masked" studies can yield misleading results if post-treatment expectancy levels differ across arms
So how do we address unmasking?
Our team of statisticians and psychedelic researchers (@awlevis.bsky.social, Mats Stensrud + Sandeep Nayak & David Yaden of @jhpsychedelics.bsky.social) developed a causal inference framework for functional unmasking in psychedelic RCTs.
See our pre-print + analysis guide/code:
tinyurl.com/yhwez25p
See our pre-print + analysis guide/code:
tinyurl.com/yhwez25p
Causal Inference in Studies with Functional Unmasking: Psychedelics and Beyond
In clinical trials for mental health treatments, functional unmasking (unblinding) is a widespread challenge wherein participants become aware of their assigned treatment. Unmasking is especially conc...
tinyurl.com
December 9, 2025 at 5:41 PM
Our team of statisticians and psychedelic researchers (@awlevis.bsky.social, Mats Stensrud + Sandeep Nayak & David Yaden of @jhpsychedelics.bsky.social) developed a causal inference framework for functional unmasking in psychedelic RCTs.
See our pre-print + analysis guide/code:
tinyurl.com/yhwez25p
See our pre-print + analysis guide/code:
tinyurl.com/yhwez25p
Thank you! Great question-nesting neurons in subjects does seem natural (esp if you want interpretation of animal population as opposed to neuron population). I've found FLMM is way better for finding subpopulations than e.g. clustering raw traces. I've done methods work on this. Happy to discuss!
March 20, 2025 at 12:55 PM
Thank you! Great question-nesting neurons in subjects does seem natural (esp if you want interpretation of animal population as opposed to neuron population). I've found FLMM is way better for finding subpopulations than e.g. clustering raw traces. I've done methods work on this. Happy to discuss!
March 18, 2025 at 10:09 PM
• We release R+Python packages and user guides. The methods can be applied to other neural data types too!
• Paper: elifesciences.org/articles/95802
• Code and user guides: github.com/gloewing/pho... 13/13
• Paper: elifesciences.org/articles/95802
• Code and user guides: github.com/gloewing/pho... 13/13
A statistical framework for analysis of trial-level temporal dynamics in fiber photometry experiments
A fiber photometry analysis framework based on functional mixed models enhances the detection of effects by testing signal-variable associations at each trial timepoint and accounting for between-anim...
elifesciences.org
March 18, 2025 at 10:05 PM
• We release R+Python packages and user guides. The methods can be applied to other neural data types too!
• Paper: elifesciences.org/articles/95802
• Code and user guides: github.com/gloewing/pho... 13/13
• Paper: elifesciences.org/articles/95802
• Code and user guides: github.com/gloewing/pho... 13/13
FLMM finds effects obscured by standard analyses! For example, FLMM reveals effects that “wash out” when analyzed with AUCs. In published work, Cue Period AUC finds no effects because it averages over time-windows (1) and (2) that have opposing effects. 12/13
March 18, 2025 at 10:05 PM
FLMM finds effects obscured by standard analyses! For example, FLMM reveals effects that “wash out” when analyzed with AUCs. In published work, Cue Period AUC finds no effects because it averages over time-windows (1) and (2) that have opposing effects. 12/13
FLMM can disentangle components with distinct temporal dynamics. It can also be used to run analogues of standard hypothesis tests (e.g., ANOVAs, correlations) at each trial timepoint. Below is an example akin to the FLMM version of a paired t-test. 11/13
March 18, 2025 at 10:05 PM
FLMM can disentangle components with distinct temporal dynamics. It can also be used to run analogues of standard hypothesis tests (e.g., ANOVAs, correlations) at each trial timepoint. Below is an example akin to the FLMM version of a paired t-test. 11/13
Informally, functional random-effects allow one to model variability across animals in the signal “shape.” 10/13
March 18, 2025 at 10:05 PM
Informally, functional random-effects allow one to model variability across animals in the signal “shape.” 10/13
Functional random-effects allow one to model how the dynamics of signal-covariate associations vary across animals. 9/13
March 18, 2025 at 10:05 PM
Functional random-effects allow one to model how the dynamics of signal-covariate associations vary across animals. 9/13
FLMM plots can be conceptualized as pooling signal values (dF/F) at a given trial time-point (e.g., 1.7 sec) across animals and trials, correlating it with covariate(s) (e.g., Latency-to-press) and plotting the slope of the correlation. 8/13
March 18, 2025 at 10:05 PM
FLMM plots can be conceptualized as pooling signal values (dF/F) at a given trial time-point (e.g., 1.7 sec) across animals and trials, correlating it with covariate(s) (e.g., Latency-to-press) and plotting the slope of the correlation. 8/13
FLMM outputs a coefficient estimate plot that shows how the signal– covariate association evolves across trial timepoints. 7/13
March 18, 2025 at 10:05 PM
FLMM outputs a coefficient estimate plot that shows how the signal– covariate association evolves across trial timepoints. 7/13
FLMMs exploit autocorrelation to construct *joint* 95% CIs (light grey) that show time windows where effects are statistically significant (any intervals that do not contain 0). All you need to do is visually inspect! 6/13
March 18, 2025 at 10:05 PM
FLMMs exploit autocorrelation to construct *joint* 95% CIs (light grey) that show time windows where effects are statistically significant (any intervals that do not contain 0). All you need to do is visually inspect! 6/13
FLMM combines the benefits of 1) Mixed Models to account for between-animal heterogeneity, and 2) Functional Regression to model effects at each trial timepoint. 5/13
March 18, 2025 at 10:05 PM
FLMM combines the benefits of 1) Mixed Models to account for between-animal heterogeneity, and 2) Functional Regression to model effects at each trial timepoint. 5/13
Solution: We propose an analysis framework based on Functional Linear Mixed Models (FLMM) that allows one to analyze signal–covariate associations at every trial timepoint. 4/13
March 18, 2025 at 10:05 PM
Solution: We propose an analysis framework based on Functional Linear Mixed Models (FLMM) that allows one to analyze signal–covariate associations at every trial timepoint. 4/13
Problem: Photometry is often applied in nested longitudinal experiments with multiple trials per session and sessions per animal. This induces correlation, missing data, etc., that can obscure effects if not accounted for statistically. 3/13
March 18, 2025 at 10:05 PM
Problem: Photometry is often applied in nested longitudinal experiments with multiple trials per session and sessions per animal. This induces correlation, missing data, etc., that can obscure effects if not accounted for statistically. 3/13
Problem: Common photometry analysis methods reduce detection of effects because, among other things, they average across trials and use summary statistics (e.g., AUC, peak amplitude). 2/13
March 18, 2025 at 10:05 PM
Problem: Common photometry analysis methods reduce detection of effects because, among other things, they average across trials and use summary statistics (e.g., AUC, peak amplitude). 2/13