Lightnews — Scholar-powered news

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 6d

"I would be so entertained if I found out an AI lab had wasted their time cheating on my dumb benchmark!" 😆@simonwillison.net

Reposted by Auditory-Visual Speech Association (AVISA)

speechpapers.bsky.social @speechpapers.bsky.social · 7d

Mapping the task-general and task-specific neural correlates of speech production: Meta-analysis and fMRI direct comparisons of category fluency and picture naming https://pubmed.ncbi.nlm.nih.gov/41030322/

1 3

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 6d

Terrific video - and such an excellent project! 👍

1 1

Reposted by Auditory-Visual Speech Association (AVISA)

James Trujillo @jamestrujillo.bsky.social · 6d

Check out our fantastic new EnvisionBOX intro video made by Markus Küpper! This video and nomination really feels like another step in professionalizing the platform and making it even more visible, and so hopefully becoming useful to even more people. Thanks everyone for the nominations!

wimpouw @wimpouw.bsky.social · 6d

www.envisionbox.org has been shortlisted for the Leo Waaijers Open Science price: ukb.nl/en/news/shor...

@babajideowoyele.bsky.social @jamestrujillo.bsky.social @sarkadava.bsky.social @DavideAhmar @acwiek.bsky.social

Amazing Markus Küpper made an animated video:
www.youtube.com/watch?v=HduI...

EnvisionBOX overview2025

YouTube video by Wim Pouw

www.youtube.com

2 1 3

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 8d

Metacognitive Awareness of Lipreading Gains in Young and Older Adults pubs.asha.org/doi/10.1044/... Investigated the extent older & younger adults are metacognitively aware of AV benefits, focused on: 1) performance improvements 2) changes in confidence & listening effort 3) internal evaluations

Metacognitive Awareness of Lipreading Gains in Young and Older Adults

Purpose: When listening to speech in noise, lipreading can facilitate communication. However, beyond its objective benefits, individuals' percept...

pubs.asha.org

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 8d

The Shared Book Reading Corpus: An audiovisual collection of 44 multimodal caregiver-infant interactions www.nature.com/articles/s41... A collection of AV recordings of English-speaking caregivers and 13–14-month-old infants (N = 44 dyads) reading together in a controlled lab setting

The Shared Book Reading Corpus: An audiovisual collection of 44 multimodal caregiver-infant interactions - Scientific Data

Scientific Data - The Shared Book Reading Corpus: An audiovisual collection of 44 multimodal caregiver-infant interactions

www.nature.com

1 1

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 9d

Multisensory assessment for hearing phenotypes www.sciencedirect.com/science/arti... "these findings suggest that visual performance and visual sensory weighting—more than AV integration per se—are modulated by hearing loss"

Multisensory assessment for hearing phenotypes

Despite growing evidence of neural and behavioral plasticity following sensory loss, it remains unclear how multisensory processing varies across clin…

www.sciencedirect.com

1 2

Reposted by Auditory-Visual Speech Association (AVISA)

speechpapers.bsky.social @speechpapers.bsky.social · 11d

Visual contributions to the perception of speech in noise

https://www.biorxiv.org/content/10.1101/2025.09.26.678636v1

2 1

Reposted by Auditory-Visual Speech Association (AVISA)

Katrin Vogt @katrinvogt.bsky.social · 12d

How is valence computed in the brain? Check out our new preprint about a single cell that integrates excitatory and inhibitory input across modalities according to valence and impacts behavioral decisions. An exciting collaboration across many labs. Enjoy reading!
www.biorxiv.org/content/10.1...

A multisensory, bidirectional, valence encoder guides behavioral decisions

A key function of the brain is to categorize sensory cues as repulsive or attractive and respond accordingly. While we have some understanding of how sensory information is processed in the sensory pe...

www.biorxiv.org

2 36 89

Reposted by Auditory-Visual Speech Association (AVISA)

Martina Saltafossi @martinasaltafossi.bsky.social · 13d

I'm thrilled to share that our new paper is now published in Psychophysiology (Open Access):
onlinelibrary.wiley.com/doi/10.1111/...

@zacndr.bsky.social @teamlabuda.bsky.social @fraferri.bsky.social @danlikesbrains.bsky.social

1 16 32

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 15d

I was thinking more along the lines of your answers "When you’re a cognitive scientist, you sometimes have to make choices… I’m not saying they’re good or smart choices. But they’re the decisions you have to make, because no one else can make them. That’s the burden of being a cognitive scientist."

1 1

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 15d

Would yours be like the Henry VIII and Oliver Cromwell interviews? : )

1 1

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 17d

Graduation vs. reality meme - gradate throws cap in air - 2 weeks later at 3:00 AM trying to remember the code

3

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 20d

Temporal integration in human auditory cortex is predominantly yoked to absolute time www.nature.com/articles/s41... There's a difference between integrating across absolute time & structure (say) phonemes. Do cortical computations reflect time or structure? Results showed time-yoked computations ⏱️

Temporal integration in human auditory cortex is predominantly yoked to absolute time - Nature Neuroscience

Temporal integration throughout the human auditory cortex is predominantly locked to absolute time and does not vary with the duration of speech structures such as phonemes or words.

www.nature.com

1 3 12

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 21d

Distinct Cortical Populations Drive Multisensory Modulation of Segregated Auditory Sources www.jneurosci.org/content/45/3... "findings suggest .. modulatory multisensory behavior is supported by nSTRF neurons and identifies...a functional differentiation between the role that STRF and nSTRF neurons"

Distinct Cortical Populations Drive Multisensory Modulation of Segregated Auditory Sources

Auditory perception can be modulated by other sensory stimuli. However, we do not fully understand the neural mechanisms that support multisensory behavior. Here, while male nonhuman primates detected...

www.jneurosci.org

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 22d

The rhythm of sensory input shapes AV temporal processing bpspsychub.onlinelibrary.wiley.com/doi/10.1111/... Expts. used simultaneity judgement tasks & pulsing AV streams amplitude-modulated according to different regular frequencies or following purely rhythmic vs. quasi-rhythmic envelopes.

bpspsychub.onlinelibrary.wiley.com

1

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 23d

Measuring the dual-task costs of audiovisual speech processing across levels of background noise. psycnet.apa.org/doiLanding?d... 4 experiments evaluated how AV speech affects dual-task costs during speech perception - reduce effort in difficult listing conditions but increase it in easier ones?

APA PsycNet

psycnet.apa.org

1

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 25d

Semi-related "Semantic language decoding across participants and stimulus modalities" www.cell.com/current-biol... - shows semantic decoders can be transferred across participants

Semantic language decoding across participants and stimulus modalities

Tang and Huth demonstrate that semantic decoders can be transferred across participants using functional alignment, and that this alignment can be performed using responses to either stories or movies...

www.cell.com

1

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 25d

Large-scale color biases in the retinotopic functional architecture are region specific and shared across human brains www.jneurosci.org/content/earl... "predicted what color someone is seeing based on their brain activity, using only knowledge of color responses from other observers' brains"

1 2 7

Reposted by Auditory-Visual Speech Association (AVISA)

speechpapers.bsky.social @speechpapers.bsky.social · 26d

Disentanglement of prosodic meaning: Toward a framework for the analysis of nonverbal information in speech https://pubmed.ncbi.nlm.nih.gov/40938709/

2 1

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 26d

Mouth and facial informativeness norms for 2276 English words link.springer.com/article/10.3... Mouth & facial informativeness for words, i.e., how visually informative words are based on their corresponding mouth & facial movements - norms are accessible via Open Science Framework (osf.io/mna8j/)

Mouth and facial informativeness norms for 2276 English words - Behavior Research Methods

Mouth and facial movements are part and parcel of face-to-face communication. The primary way of assessing their role in speech perception has been by manipulating their presence (e.g., by blurring th...

link.springer.com

3

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 26d

Prior expectations guide multisensory integration during face-to-face communication journals.plos.org/ploscompbiol... Is there a stronger prior tendency to integrate audiovisual signals that convey the same communicative intention (& is this based on an optimal Bayesian decision)?

Prior expectations guide multisensory integration during face-to-face communication

Author summary Face-to-face communication is complex: what we say is coupled with bodily signals, offset in time, which may or may not work in concert to convey meaning. Yet, the brain rapidly determi...

journals.plos.org

1 5

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 27d

| |
| Bridging |
| speech |
| and. |
| sight. |
| ... academic.oup.com/braincomms/a... Ticker-tape synaesthesia - 17 synesthetes & 17 controls diffusion-weighted MRI -> ticker-tapers ⬆️ white matter underlying the SMG + connecting SMG & mid & posterior STG

Bridging speech and sight: white matter anatomy in ticker-tape synaesthesia

Delsanti et al. reported that ticker-tape synaesthesia, a developmental condition in which people see automatically the written form of the words which the

academic.oup.com

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 27d

Beat gestures facilitate lexical access in constraining sentence contexts psycnet.apa.org/doiLanding?d... Tested if beat gestures, visual prominence cues, can aid lexical access (RT) even in situations where other cues (semantics) are supportive of word recognition & if alignment with stress matters

APA PsycNet

psycnet.apa.org

1

Auditory-Visual Speech Association (AVISA) @avsp.bsky.social · 28d

The tracking umbrella: Diverse interpretations under a common neural term nyaspubs.onlinelibrary.wiley.com/doi/10.1111/... Review critically examines neural tracking from both theoretical and methodological perspectives, highlighting how its interpretation varies across studies & how it is measured

NYAS Publications

This paper critically examines neural tracking from both theoretical and methodological perspectives, highlighting how its interpretation varies across studies. A central debate concerns whether neur....

nyaspubs.onlinelibrary.wiley.com

1 3