Lightnews — Scholar-powered news

Teague Henry @teaguerhenry.bsky.social · May 29

1

Teague Henry @teaguerhenry.bsky.social · May 1

"PLEASE read the title"

a man with a beard is saying no in a blurry photo

ALT: a man with a beard is saying no in a blurry photo

media.tenor.com

3

Teague Henry @teaguerhenry.bsky.social · Apr 30

Yes! I tell my class that regression coefficients are the "unique" relationships of a variable. If variables are not "unique", there is less information available to make the SEs "smaller." It's always either multicollinearity or normality assumptions that you've got to disabuse students of!

2

Reposted by Teague Henry

Will Lowe @conjugateprior.org · Apr 29

2 6 39

Teague Henry @teaguerhenry.bsky.social · Apr 17

Wait, you're telling me that a study in 20 children with ADHD showing an increased correlation between 2 arbitrarily defined brain regions doesn't represent a paradigm shift in how we could treat ADHD with respect to possible targeted pharmaceuticals?

2

Reposted by Teague Henry

Margaret Mitchell @mmitchell.bsky.social · Apr 9

The one simple trick to avoid > 75% of bad uses of AI that AI ethicists don't want you to know!

Read a science fiction book and if your goal aligns with the bad guys in that book don't do it.

-- Credit @stellaathena.bsky.social on the Bad Site.

Gif of police officer, dramatic high contrast lighting, looking confused and asking, "Are we the baddies?"

5 18 71

Teague Henry @teaguerhenry.bsky.social · Apr 8

I mean, why do journals give due dates on RRs if not to encourage us to submit at the very last second?

1

Teague Henry @teaguerhenry.bsky.social · Mar 26

Me, moments before I unknowingly hit reply all on the faculty listserv: "We are currently clean on OPSEC"

3

Teague Henry @teaguerhenry.bsky.social · Mar 25

Homebrew warlock patron "The P-factor" that lets you summon and bind fiends by drawing path diagrams for multi-level SEMs.

At level 17 you gain the ability to measure constructs ... without error!

4

Reposted by Teague Henry

Crystal Lewis @cghlewis.bsky.social · Mar 23

In 2018 I gave a presentation on research data management to a group of graduate students. Not surprisingly, most of the problems and solutions I discussed 7 years ago, are still the same problems and solutions I see today. #databs

5 25

Reposted by Teague Henry

UVA Department of Psychology @uvapsychology.bsky.social · Mar 18

🧠 Applying to Psychology PhD programs? Join @UVA's virtual panel April 14 at 12:30PM! Current faculty & PhD students will share tips on choosing programs & creating competitive applications. All welcome, especially those from underrepresented groups. Register via QR code! #PsychPhD #GradSchool

5 5

Reposted by Teague Henry

dennyborsboom.bsky.social @dennyborsboom.bsky.social · Feb 18

This year I have the honour of serving the Psychometric Society as its President, and we have been working hard on the program for the International Meeting of the Psychometric Society (IMPS) psychometricsociety.org/imps-2025 You can submit an abstract here: imps2025.exordo.com

IMPS 2025 - Psychometric Society

July 15-18, 2025 (Short Courses July 14)

psychometricsociety.org

1 7 14

Reposted by Teague Henry

McSweeney's @mcsweeneys.net · Feb 15

"You want to stop, but the amount of time and energy you’ve put into this makes it hard to quit."

Elden Ring or Tenure-Track Professor?

1. You’ve invested an enormous amount of time and energy, and you still have no idea what is happening. 2. Everybody you meet speaks in half riddle...

buff.ly

34 110

Reposted by Teague Henry

Eiko Fried @eikofried.bsky.social · Feb 13

1/3

Tutorial on exploring ecological momentary assessment data is online at AMPPS, with:
- Accessible ways to visualize data for better understanding
- Models to get some first insights
- Further reading boxes for more advanced topics
- Reproducible pipeline you can run over your own data

6 78 150

Reposted by Teague Henry

Jonas Haslbeck @jmbh.bsky.social · Feb 13

New preprint by Anja Ernst and me on Modeling Qualitative Between-Person Heterogeneity in Time-Series using Latent Class Vector Autoregressive Models (osf.io/preprints/ps...)

1 1 5

Teague Henry @teaguerhenry.bsky.social · Feb 11

... to use human raters to reconcile any ambiguities. I think this is fascinating work, and a great example of how to use LLMs as a true tool for analyzing data (rather than just asking an LLM to analyze data). Joy is currently working on an extension to discover new topics, which is very exciting!

4

Teague Henry @teaguerhenry.bsky.social · Feb 11

We found that ensembles of small LLMs tended to have reasonable (better than chance) performance at identifying topics. It wasn't perfect, but it is good enough to be a reasonable first pass through a large dataset. The idea is to first identify the cases that are easy to classify, then...

1 2

Teague Henry @teaguerhenry.bsky.social · Feb 11

We compared the LLM topics to human raters topics. Now, importantly, Joy used an ensemble of LLMs (equivalent to having several human raters). Why? Well, we wanted for this method to be able to run locally, as there are a number of privacy issues with using consumer LLMs to analyze health data.

1 1

Teague Henry @teaguerhenry.bsky.social · Feb 11

She applied this method to both a massive dataset of Reddit posts from eating disorder related forums, and a smaller dataset of free-text responses from patients with eating disorders (courtesy of @cherilev.bsky.social), and compared how well these LLMs could identify a prespecified set of topics.

1 2

Teague Henry @teaguerhenry.bsky.social · Feb 11

So, Joy decided to use LLMs to query free-text data to extract "topics." For example, if a study collected responses regarding stressful events, then a topic might be a description like "work stressor" or "interpersonal stressor."

1 1

Teague Henry @teaguerhenry.bsky.social · Feb 11

Enter LLMs! While I have a number of thoughts on LLMs that I won't get into here, for this project we conceptualized them as "tools that can comprehend free-text," with comprehension being akin to human reading comprehension (do LLMs comprehend? No, but they sure do seem like they do!)

1 1

Teague Henry @teaguerhenry.bsky.social · Feb 11

Traditionally, this is done via teams of human raters. Researchers will put together groups of raters (usually grad students, possibly RAs) that will go through the free text responses and quantify them in some way. This takes an enormous amount of time and resources.

1

Teague Henry @teaguerhenry.bsky.social · Feb 11

Free-text responses are a wonderful way of collecting nuanced information about any number of psychological phenomena, but the issue is, of course, that they are free-text responses. To perform quantitative analysis on them, you need to convert them into some set of numbers.

1

Teague Henry @teaguerhenry.bsky.social · Feb 11

Can I interest y'all in a preprint in these trying times? My student Joy Qiu recently completed work on using ensembles of LLMs to perform coding of free text response data. A 🧵

Ensemble of Large Language Models for Curated Labeling and Rating of Free-text Data

Free-text responses are commonly collected in psychological studies, providing rich qualitative insights that quantitative measures may not capture. Labeling curated topics of research interest in fre...

arxiv.org

1 5 11

Teague Henry @teaguerhenry.bsky.social · Feb 8

We originally thought about this project from an EMA perspective, trying to optimize for participant burden. So that’s where we are coming from!