Lightnews — Scholar-powered news

Reposted by Gudrun Eisele

Benjamin Kunc @benjaminkunc.bsky.social · 9d

Are you an ESM item measuring the quality of social experiences looking for validation? 👀

Because if you are, I've got some bad news for you. Our new preprint is out: osf.io/preprints/ps...

@gudruneisele.bsky.social @ginettelafit.bsky.social @lisapeeters.bsky.social @oliviajkirtley.bsky.social

OSF

osf.io

2 5 6

Gudrun Eisele @gudruneisele.bsky.social · 14d

Interested in ESM/EMA research?
Check out @lisapeeters.bsky.social's review of methodological variation in recent ESM studies.

It provides detailed numbers on current practices across the entire research pipeline—from research questions and study design to reporting.

Lisa Peeters @lisapeeters.bsky.social · 15d

The first preprint of my PhD is out! Our review maps choices that researchers make throughout an ESM study from start to finish, including reporting and open science practices. We compare our findings to previous literature where possible, but also provide novel insights! osf.io/preprints/ps...

OSF

osf.io

3

Reposted by Gudrun Eisele

Leonie Vogelsmeier @leonievogelsmeier.bsky.social · 16d

🚨 New preprint: We compared 13 methods for detecting momentary careless responding in the WARN-D data (206k+ obs.). Tutorials guide you through each method. The takeaway? Diverging results, inherent subjectivity (to varying degrees), and a clear need for further validation.
osf.io/preprints/ps...

OSF

osf.io

2 16 43

Gudrun Eisele @gudruneisele.bsky.social · Aug 8

with @inezgermeys.bsky.social @robin8.bsky.social @lisapeeters.bsky.social Joana De Calheiros Velozo, Thomas Vaessen & Aleksandra Lachowicz

3

Gudrun Eisele @gudruneisele.bsky.social · Aug 8

New preprint!

Does data quality drop when participants respond to #EMA / #ESM surveys in the presence of others?

We explored this in a pooled analysis of 4 ESM studies and found (subtle) shifts in burden & response behavior depending on participants’ social context:
doi.org/10.31234/osf...

OSF

doi.org

1 6 20

Reposted by Gudrun Eisele

Omid V. Ebrahimi @omidvebrahimi.bsky.social · Aug 7

How Accurate & Consistent are Self-Report responses via Visual Analogue Scales (VAS) in Ecological Momentary Assessment & Digital Studies?

Examined in a massive EMA study (N = 3,761), our new #OpenAccess piece on this is just out:

online.ucpress.edu/collabra/art...

#PsychSciSky #AcademicSky

🧵:

Accuracy and Consistency of Visual Analog Scales in Ecological Momentary Assessment and Digital Studies

The ubiquity of digital technologies has increased assessments of thoughts, behaviors, and experiences via electronic devices. Surveys on smartphones or laptops often implement Visual Analogue Scales ...

online.ucpress.edu

2 28 64

Reposted by Gudrun Eisele

PsyArXivBot @psyarxivbot.bsky.social · Jul 22

Experienced, bothered by, or both: People differ in how they understand the Patient Health Questionnaire (PHQ) items: https://doi.org/10.31234/osf.io/jcsq8_v1

9 20

Reposted by Gudrun Eisele

Ruben C. Arslan @ruben.the100.ci · Jun 13

Our paper "A fragmented field" has just been accepted at AMPPS. We find it's not just you, psychology is really getting more confusing (construct and measure fragmentation is rising).
We updated the preprint with the (substantial) revision, please check it out.
osf.io/preprints/ps...

Treemap showing measurement fragmentation across subfields in psychology. Hill-Shannon Diversity 𝐷=1626.05

How often measures in the APA PsycTESTS database are (re)used according to the APA PsycInfo database: rarely, the majority are never reused.

Our fragmentation index (Hill-Shannon diversity) over time across subdisciplines shows fragmentation rising.

1 59 150

Reposted by Gudrun Eisele

Jonas Dora @jonasdora.bsky.social · May 27

While I was unfortunately unable to travel to Belgium for the conference, I have uploaded the recording+slides+code for my #SAA2025 talk on multilevel multiple imputation for EMA research here: osf.io/xjg24/files/...

3 14 43

Reposted by Gudrun Eisele

Olivia Kirtley @oliviajkirtley.bsky.social · May 26

Happening now at #SAA2025! @gudruneisele.bsky.social leading a symposium on ESM data quality & quantity. Kicking us off @ccp-kuleuven.bsky.social PhD student, @millapihlajamaki.bsky.social on careless responding. Preprint: osf.io/preprints/ps... #ProudSupervisor

10 32

Reposted by Gudrun Eisele

The ESM Item Repository @esmrepository.bsky.social · May 21

Do you like coffee ☕, ambulatory assessment 📱and #OpenScience 🔑? We are hosting a contributors’ café during lunch breaks & poster sessions @saa2025leuven.bsky.social. Come find the café to have a cup of coffee and contribute your items to the repository! #SAA2025 🧵 ⬇️ 1/4

ESM Item Repository

www.esmitemrepositoryinfo.com

1 6 10

Gudrun Eisele @gudruneisele.bsky.social · May 20

Deviations from preregistrations seem to be the norm, not the exception. Great to see more guidance on how to navigate them thoughtfully.
Emily Willroth and @oliviaatherton.bsky.social's paper is another helpful resource:
doi.org/10.1177/2515...

4

Reposted by Gudrun Eisele

Leonie Vogelsmeier @leonievogelsmeier.bsky.social · May 6

New article in MBR⭐: www.tandfonline.com/doi/full/10.... We show that latent Markov factor analysis (LMFA) can detect different types of careless responding in experience sampling data while also accounting for changes in attentive responding. With Esther Ulitzsch and @joranjongerling.bsky.social

Accounting for Measurement Invariance Violations in Careless Responding Detection in Intensive Longitudinal Data: Exploratory vs. Partially Constrained Latent Markov Factor Analysis

Intensive longitudinal data (ILD) collection methods like experience sampling methodology can place significant burdens on participants, potentially resulting in careless responding, such as random...

www.tandfonline.com

5 17

Gudrun Eisele @gudruneisele.bsky.social · Mar 18

It was a pleasure to present some work on improving ESM/EMA assessments at the Center for Self-Report Science at USC yesterday. What a bunch of great people with so many interesting perspectives – I’ve already learned a ton!

Marta Walentynowicz @martawalentyna.bsky.social · Mar 18

Yesterday, the Center for Self-Report Science had the pleasure of hosting @gudruneisele.bsky.social for a fascinating talk on her impactful contributions to measurement in ambulatory assessment. We’re thrilled to have her visiting us for the entire month—what a treat!

1 7

Reposted by Gudrun Eisele

Olivia Kirtley @oliviajkirtley.bsky.social · Mar 13

Are you heading to @saa2025leuven.bsky.social? Fancy extending your stay in Leuven to learn more about #OpenScience for Experience Sampling Method research with @ginettelafit.bsky.social & I? We are running a one-day course after the conference! More info here: tinyurl.com/334rytta

6 9

Reposted by Gudrun Eisele

The ESM Item Repository @esmrepository.bsky.social · Mar 13

📣 New blog post! What if ESM data grew on trees? 🌳 Read more about the EMOTE database in our latest blog by Imogen Smith, Pete Koval, @elisekalo.bsky.social, & Daniel Russo-Batterham! esmitemrepositoryinfo.com/blog-posts#E... #ESM #EMA #OpenScience

Blog posts | ESM Item Repository

esmitemrepositoryinfo.com

7 16

Reposted by Gudrun Eisele

Milla Pihlajamäki @millapihlajamaki.bsky.social · Feb 27

The first preprint from my PhD is out: osf.io/preprints/ps...! 🥳

We explored the temporal dynamics of four careless responding indicators (response time, within-beep standard deviation, an inconsistency index, occasion-person correlation) in ESM data across different samples.

Thread below🧵

OSF

osf.io

6 15 47

Gudrun Eisele @gudruneisele.bsky.social · Feb 21

Effects were robust across various model specifications but contrast with previous findings on ESM data quality and compliance. We discuss possible explanations and implications for study design.

With Wolfgang Viechtbauer, Oliver Lüdtke, Inez Myin-Germeys, Gabriel Nagy, & Steffen Nestler

2

Gudrun Eisele @gudruneisele.bsky.social · Feb 21

Effect of higher sampling frequencies (3 vs 6 vs 9 beeps per day) became more pronounced over time. See below for attentiveness probabilities over study days and beeps.

1 3

Gudrun Eisele @gudruneisele.bsky.social · Feb 21

We applied mixture modeling of response times to existing experimental ESM data & found that higher sampling frequencies led to more careless responding, while longer questionnaires did not. Co-led by Esther Ulitzsch. Accepted at Psychol Assess, preprint: doi.org/10.31234/osf.io/2s38a_v1

OSF

doi.org

1 2 9

Gudrun Eisele @gudruneisele.bsky.social · Feb 18

With an amazing team of participating experts and the ESM item repository team: Anu Hiekkaranta, Yoram Kunkels, Inez Myin-Germeys, & @oliviajkirtley.bsky.social

@esmrepository.bsky.social

2

Gudrun Eisele @gudruneisele.bsky.social · Feb 18

What makes a good ESM item?

We asked 42 ESM/EMA experts this question in a Delphi study, and the result is the ESM-Q: A consensus-based quality assessment tool for ESM items. Now accepted at #psynomBRM. Updated preprint: osf.io/preprints/ps...
Thread below.

2 9 24

Gudrun Eisele @gudruneisele.bsky.social · Nov 21

Im also not aware of systematic investigations of this. In our qualitative work, participants complain about repetitiveness and some say they answer in autopilot mode-> mixing up the item order may help. But as Leonie says, this could have other unwanted effects. Someone should look into this!

Gudrun Eisele @gudruneisele.bsky.social · Sep 2

Well-deserved SIPS commendation for the ESM Preprocessing Gallery! Since many errors happen during preprocessing, we can't stress its importance enough! This excellent tool helps applied researchers navigate all the steps they have to take before analyzing their ESM/EMA data

Ginette Lafit @ginettelafit.bsky.social · Sep 2

Since I'm new here I will start with some good news. I'm happy to share that the ESM Preprocessing Repository was awarded a SIPS commendation 🥳
preprocess.esmtools.com

1 1 2

Reposted by Gudrun Eisele

Leonie Vogelsmeier @leonievogelsmeier.bsky.social · Aug 28

🌟New preprint on using latent Markov factor analysis for detecting careless responding in intensive longitudinal data when the measurement model of the attentive responses is non-invariant.
osf.io/preprints/ps...
with @joranjongerling.bsky.social and Esther Ulitzsch

OSF

osf.io

2 5