Alex Chohlas-Wood
@alexchohlaswood.com
580 followers 710 following 53 posts
Assistant professor at NYU interested in computational public policy and the criminal justice system. Co-direct @comppolicylab.bsky.social.📍NYC 🏳️‍🌈 alexchohlaswood.com
Posts Media Videos Starter Packs
Pinned
alexchohlaswood.com
Have you ever forgotten an important date—like a birthday for a loved one?

Now imagine if forgetting meant ending up in jail.

Two years ago, we ran a randomized experiment that found that text message reminders reduce jail stays for missed court dates by over 20%.
A hand holding a smartphone displaying a court date reminder on screen.
alexchohlaswood.com
Learn more about our study in this thread from two years ago:
bsky.app/profile/alex...
alexchohlaswood.com
In a new randomized experiment at the Santa Clara County Public Defender Office, my colleagues and I found that text message reminders reduce *incarceration* for missed court dates by over 20%! More in the 🧵 below. alexchohlaswood.com/assets/paper... 1/11
alexchohlaswood.com
Reminders alone are unlikely to dramatically reduce overall jail populations, as jail stays for missed court dates are often short.

But stacking them with other small, common-sense reforms could substantially improve our justice system.
alexchohlaswood.com
Reminders also help everyone by saving precious public resources instead of paying for these wasteful jail stays.

The reminders themselves cost about 60¢ per case—less than the costs of paying for someone’s arrest and incarceration, even for a single night.
alexchohlaswood.com
We found that a broad swath of clients appeared to benefit from reminders—even people facing low-level charges.

Think of a DUI case: make a bad mistake one night, then forget a court date, and suddenly you’re in jail for a few days. A minor case just became much more serious.
alexchohlaswood.com
Court date reminders may seem small, but they make a big difference.

Our study was conducted with public defender clients who can’t afford a lawyer.

These nudges are a huge boon for low-income clients, helping them avoid the high costs of a disruptive stay in jail.
alexchohlaswood.com
Have you ever forgotten an important date—like a birthday for a loved one?

Now imagine if forgetting meant ending up in jail.

Two years ago, we ran a randomized experiment that found that text message reminders reduce jail stays for missed court dates by over 20%.
A hand holding a smartphone displaying a court date reminder on screen.
alexchohlaswood.com
The ASA's Law & Justice Statistics committee is hosting an upcoming webinar featuring George Mohler. Join us on September 30 from 1–1:30pm ET! Register here: amstat.zoom.us/webinar/regi...
alexchohlaswood.com
Calling all professors—we're enrolling new courses in our ongoing randomized study of AI in education!

Get free access to a customized virtual tutor, and receive an honorarium at the end of the semester if you participate. Details below.
comppolicylab.bsky.social
Instructors at 2- and 4-year colleges! Give your students free access to a virtual tutor optimized for learning by taking part in our study on using AI to improve education. Instructors receive a $1,000 honorarium.

Apps received by 8/8 receive priority: pingpong.hks.harvard.edu/eduaccess
PingPong 🏓
pingpong.hks.harvard.edu
alexchohlaswood.com
Come join us and teach a great class this fall!
daphna.bsky.social
NYC-based people - I'm looking for an adjunct instructor to teach an undergraduate course *this fall* at NYU called Power and Politics of Data. There's a lot of flexibility in what the course could look like, but I'm also happy to share ideas and the job ad. DM me if you think you're interested.
alexchohlaswood.com
(And I'll be teaching a course like this next spring at NYU so I'd love to hear what else you find!)
alexchohlaswood.com
Job alert!

We're hiring a clinical (teaching-based) Assistant Professor of Applied Statistics for Social Science Research at NYU!

Application review begins on February 10, and the position would start on September 1.

Apply here: apply.interfolio.com/162021
Two students collaborating on a plot on a whiteboard.
Reposted by Alex Chohlas-Wood
hannahli.bsky.social
Yes to evaluating the *outcomes* of these systems rather than as a standalone algorithm! This is something that's been bothering me for a while about ML assisted decisions
alexchohlaswood.com
Ultimately, we’ll likely achieve better outcomes if we think of algorithms as *policies* — and design them in a way that aims for the specific policy goals we desire.

(17/17)

bsky.app/profile/alex...
alexchohlaswood.com
NEW in Management Science!

My coauthors and I came up with a new consequentialist approach to designing equitable algorithms.

Instead of imposing fairness criteria on an algorithm (like equal false negative rates), we aim for good outcomes.

More in the 🧵 below! (1/)
A screenshot of the first page of our paper, Learning to Be Fair, showing the title and abstract.
alexchohlaswood.com
Learn more in our open-access paper, “Learning to be Fair: A Consequentialist Approach to Equitable Decision Making”, with @madisoncoots.com, Henry Zhu, Emma Brunskill, and @5harad.com!

pubsonline.informs.org/doi/10.1287/...

(16/)
Learning to Be Fair: A Consequentialist Approach to Equitable Decision Making | Management Science
pubsonline.informs.org
alexchohlaswood.com
Many studies have framed fairness as a mathematical problem, proposing axioms without considering the consequences.

In contrast, our approach:
- Focuses on outcomes
- Devises a computational framework for learning to be fair in an efficient and cost-effective manner
(15/)
alexchohlaswood.com
We use data from the Santa Clara County Public Defender to show that this approach would result in higher utility:
- During the learning phase AND
- After we stop learning!

Of course, this approach applies in any resource-constrained setting, not just for rides to court!
(14/)
A chart of regret vs. iteration. Random assignment methods accumulate a lot of regret over the course of an experiment, whereas bandit methods like UCB and Thompson sampling accumulate minimal regret. A chart of performance vs. iteration. Bandit methods like UCB and Thompson sampling are quick to learn good policies, while other methods learn good policies more slowly.
alexchohlaswood.com
The framework we designed uses contextual bandits and optimization to:
- Learn how people respond to rides, and then provide rides to people who need them—even while we’re still learning
- Equitably allocate rides by modeling preferences as parameters in a convex objective
(13/)
alexchohlaswood.com
But randomized controlled trials are costly in a couple ways.

First, people who would really benefit from a ride might be excluded if they’re randomized to a control arm.

Second, we might waste money on rides for people who don’t need transportation assistance.
(12/)
alexchohlaswood.com
How could we make decisions like this in the real world?

One approach would be to run a randomized controlled trial to learn how people respond to rides.

We could then estimate the tradeoffs at hand, and choose an tradeoff that best reflects our preferences.
(11/)
A Pareto curve, showing the tradeoff between helping people get to court and the proportion of people in a target group who get the benefit of rides. The chart also shows a slider bar indicating a survey response, with the selection corresponding to the point of maximum utility.
alexchohlaswood.com
This suggests that there’s no one-size-fits-all definition of fairness.

Instead, we should make decisions in a way that reflects our preference for how to make difficult tradeoffs.

(In practice, one could run a survey like the above to elicit preferences from people.)
(10/)
A Pareto curve, showing the tradeoff between helping people get to court and the proportion of people in a target group who get the benefit of rides. The chart also includes a vertical line indicating demographic parity, which is not at the same point as maximum utility.