Lightnews — Scholar-powered news

Reposted by Judith Holler

Neil Cohn @neilcohn.bsky.social · May 15

In a new paper, @anakrajinovic.bsky.social, @cogirmak.bsky.social, and I show that living vs. non-living entities are marked differently for motion in graphics. This is similar to spoken languages, so we propose a possible universal across modalities onlinelibrary.wiley.com/doi/10.1111/...

Motion lines and circumfixing lines appearing for living and non-living characters in comics panels

Data showing that inanimate entities receive more motion lines than animates across different types of comics

1 9 24

Judith Holler @judithholler.bsky.social · May 12

I absolutely agree, these are really interesting questions and points, and I hope lots of future research will embark on trying to find answers!

Judith Holler @judithholler.bsky.social · May 12

New review out on facial signalling in conversation, making the argument that the notion of ‘speech acts’ is outdated due to its unimodal focus, especially in the light of the fundamental contributions of the face towards social action communication www.sciencedirect.com/science/arti...

Facial clues to conversational intentions

It has long been known that we use words to perform speech acts foundational to everyday conversation, such as requesting, informing, proposing, or co…

www.sciencedirect.com

3 14 36

Judith Holler @judithholler.bsky.social · Apr 23

Very proud of this part of @marlijnterbekke.bsky.social’s PhD work being out, our first work combining avatars, gestures and EEG! 🎉

Marlijn ter Bekke @marlijnterbekke.bsky.social · Apr 23

🎉 New paper out today! We used virtual avatars and EEG to show that listeners use meaningful gestures to predict what someone might say next 🧠👋

Read it here in Psychological Science 👉 doi.org/10.1177/0956..., with @lindadrijvers.bsky.social and @judithholler.bsky.social

Co-Speech Hand Gestures Are Used to Predict Upcoming Meaning - Marlijn ter Bekke, Linda Drijvers, Judith Holler, 2025

In face-to-face conversation, people use speech and gesture to convey meaning. Seeing gestures alongside speech facilitates comprehenders’ language processing, ...

doi.org

2 9

Judith Holler @judithholler.bsky.social · Mar 31

Early bird registration and pre-conference workshop registrations now open!
www.isgs10.nl

1 2

Judith Holler @judithholler.bsky.social · Mar 29

It was great to have you! Thank you so much for coming to Nijmegen, for your very inspiring talk, and for your wonderful contributions to Marlijn‘s defense!

3

Judith Holler @judithholler.bsky.social · Mar 24

Super proud of @marlijnterbekke.bsky.social who was awarded her PhD on Friday based on a wonderful thesis and a stellar defense! Congratulations dr ter Bekke!!! 💐🍾🥳

10

Judith Holler @judithholler.bsky.social · Mar 21

This paper combining corpus and experimental avatar studies from Paul’s PhD work is finally out, demonstrating systematic relations between verbal repair formats and eyebrow movements, as well an influence of addressees’ eyebrow furrows on speakers’ speech.

Max Planck Institute for Psycholinguistics @mpi-nl.bsky.social · Mar 20

Eyebrow movements as signals of communicative problems in human face-to-face interaction. New paper by Paul Hömke, Stephen C. Levinson, Alexandra K. Emmendorfer & @judithholler.bsky.social
doi.org/10.1098/rsos.241632

Eyebrow movements as signals of communicative problems in human face-to-face interaction | Royal Society Open Science

Repair is a core building block of human communication, allowing us to address problems of understanding in conversation. Past research has uncovered the basic mechanisms by which interactants signal ...

doi.org

1 3 15

Judith Holler @judithholler.bsky.social · Feb 26

Very happy that this is out, and congrats on your first publication, Ari! 🥳🥳

Ari Dyer @aridyer.bsky.social · Feb 26

Our paper has been published open access!
(My first publication!)

This project was part of my MSc thesis with @jamestrujillo.bsky.social & @judithholler.bsky.social.

We explored the relationship between dyadic differences in EQ scores, and kinematic & prosodic similarity🧵
doi.org/10.1080/0163...

Dyadic differences in empathy scores are associated with kinematic similarity during conversational question–answer pairs

During conversation, speakers coordinate and synergize their behaviors at multiple levels, and in different ways. The extent to which individuals converge or diverge in their behaviors during inter...

www.tandfonline.com

4

Judith Holler @judithholler.bsky.social · Feb 3

Very happy that this new paper with @jamestrujillo.bsky.social is now out, suggesting that visual signals contribute information especially during question beginnings in Dutch face-to-face conversation.

James Trujillo @jamestrujillo.bsky.social · Feb 3

Excited to have another paper coming out from my postdoc time with @judithholler.bsky.social !
www.tandfonline.com/doi/full/10....
We looked at how visual signals, like facial expressions and hand gestures, are associated with the the amount of linguistic information, in spoken conversations 🧵

Multimodal information density is highest in question beginnings, and early entropy is associated with fewer but longer visual signals

When engaged in spoken conversation, speakers convey meaning using both speech and visual signals, such as facial expressions and manual gestures. An important question is how information is distri...

www.tandfonline.com

2 19

Reposted by Judith Holler

Max Planck Institute for Psycholinguistics @mpi-nl.bsky.social · Jan 24

Facial signals shape predictions about the nature of upcoming conversational responses. New paper by @alexemmendorfer.bsky.social & @judithholler.bsky.social
doi.org/10.1038/s41598-025-85192-y

Facial signals shape predictions about the nature of upcoming conversational responses - Scientific Reports

Scientific Reports - Facial signals shape predictions about the nature of upcoming conversational responses

doi.org

7 26

Reposted by Judith Holler

Kobin Kendrick @kobinkendrick.bsky.social · Dec 16

@judithholler.bsky.social and I have written an entry on 'Conversation' for the new Open Encyclopedia of Cognitive Science edited by Mike Frank and @asifamajid.bsky.social. Happy to have contributed to such a fantastic resource! oecs.mit.edu/pub/gx9ypm4x...

5 16

Reposted by Judith Holler

Max Planck Institute for Psycholinguistics @mpi-nl.bsky.social · Dec 5

Conversation. New chapter by Kobin H. Kendrick &
@judithholler.bsky.social

doi.org/10.21428/e2759450.3c00b537

Conversation

doi.org

3 9

Reposted by Judith Holler

Matthias Nau @matthiasnau.bsky.social · Dec 5

Writing a grant is great for developing ideas, but does your proposal actually affect whether or not you get funded?

Turns out, your full proposal does not affect your ranking much! Whaat? 😯

Simsek et al. 2024: link.springer.com/article/10.1...

19 44 100

Reposted by Judith Holler

Sebastian Sauppe @sebastiansauppe.bsky.social · Nov 27

In our new paper 📝 @plos.bsky.social PLOS Biology, we use #eyetracking to study how great apes understand who-does-what-to-whom — surprisingly similar to human adults! Thus suggests that the event cognition basis for language was present in our common ancestor. ➡️ journals.plos.org/plosbiology/...

1 3 8

Judith Holler @judithholler.bsky.social · Nov 19

Come join us as a PhD student 🧑‍🎓 on NWO project 'Multimodal Signalling in Face-to-Face Communication' at the Donders Centre for Cognition. Deadline 12th January! Dutch language proficiency advantageous.
ru.varbi.com/en/what:job/...

PhD Position: Multimodal Signalling and Processing in Face-to-face Communication at the Donders Centre for Cognition

1. Introduction How do we communicate our intentions to one another in conversational face-to-face interaction? What role do visual bodily signals play in this process, and how do they interact with l

ru.varbi.com

5 7

Judith Holler @judithholler.bsky.social · Nov 19

Come join us as a post-doc on NWO project 'Multimodal Signalling in Face-to-Face Communication' 😃 at the Donders Centre for Cognition. Deadline 8th December! Dutch language proficiency required.
ru.varbi.com/what:job/job...

Postdoc Position: Multimodal Signalling in Face-to-Face Communication at the Donders Centre for Cognition

1. Introduction How do we communicate our intentions to one another in conversational face-to-face interaction? What role do visual bodily signals play in this process, and how do they interact with l

ru.varbi.com

25 22

Judith Holler @judithholler.bsky.social · Nov 19

👍🏻😊

Judith Holler @judithholler.bsky.social · Nov 18

Interesting work, looking forward to read it!

Neil Cohn @neilcohn.bsky.social · Nov 18

When measuring brain responses, this recent paper finds that when placed after sentences, face emoji are more congruent than non-face emoji: "Face emojis vs. Non-face emojis: Exploring neural mechanisms in text processing": www.sciencedirect.com/science/arti...

Brain responses to face emoji and non face emoji that end sentences

1 6

Reposted by Judith Holler

Patti Adank @pattiadank.bsky.social · Nov 18

We have funded PhD studentships available in Speech Hearing and Phonetic Sciences (SHaPS) at UCL for UK students only, please contact a potential supervisor in SHaPS to agree on a PhD project first: www.ucl.ac.uk/pals/researc...

SHaPS People

www.ucl.ac.uk

3 2

Judith Holler @judithholler.bsky.social · Nov 18

Great, include me please :) thanks!

1 1

Reposted by Judith Holler

Janina Wildfeuer @neous.bsky.social · Nov 15

2 weeks left to submit an abstract!

Save your spot in the program and meet #multimodalists from around the world in Groningen!

Janina Wildfeuer @neous.bsky.social · Oct 1

#12ICOM - Call for Papers now open! #cfp

Join us for the 12th International Conference on Multimodality at the University of Groningen, "The Multimodal Multiverse" from October 29-31, 2025!

All details, submissions rules and options:
bit.ly/12ICOM

12ICOM Groningen

Submissions are open! | deadline 1 Dec '24 12th International Conference on Multimodality in Groningen

bit.ly

4 5

Reposted by Judith Holler

Asifa Majid @asifamajid.bsky.social · Nov 14

Come shape the study of English language and
communication at Oxford!

Colin Phillips @colinphillips.bsky.social · Nov 12

Come join us in Oxford! Or encourage your friends to apply, so you can visit them here! We are looking to fill the Professorship in Language and Communication, a senior professor position. my.corehr.com/pls/uoxrecru...
.

2 4 7

Judith Holler @judithholler.bsky.social · Nov 14

great! please add me, thanks!

1