Lightnews — Scholar-powered news

Reposted by jgyou

Ted Underwood @tedunderwood.com · 8d

Implementing “reasoning” as “just keep talking to yourself” feels so weird & hacky.

But maybe not, according to this? They show that just-predicting-the-next-word is inherently unable to learn to solve some (permutation) problems unless you “pad” with extra thought tokens. arxiv.org/abs/2509.24125

In this technical note, we study the problem of inverse permutation learning in decoder-only transformers. Given a permutation and a string to which that permutation has been applied, the model is tasked with producing the original ("canonical") string. We argue that this task models a natural robustness property across a variety of reasoning tasks, including long-context retrieval, multiple choice QA and in-context learning. Our primary contribution is an impossibility result: we show that an arbitrary depth, decoder-only transformer cannot learn this task. This result concerns the expressive capacity of decoder-only transformer models and is agnostic to training dynamics or sample complexity. We give a pair of alternative constructions under which inverse permutation learning is feasible. The first of these highlights the fundamental role of the causal attention mask, and reveals a gap between the expressivity of encoder-decoder transformers and the more popular decoder-only architecture. The latter result is more surprising: we show that simply padding the input with "scratch tokens" yields a construction under which inverse permutation learning is possible. We conjecture that this may suggest an alternative mechanism by which chain-of-thought prompting or, more generally, intermediate "thinking" tokens can enable reasoning in large language models, even when these tokens encode no meaningful semantic information (e.g., the results of intermediate computations).

9 4 63

Reposted by jgyou

arxiv cs.SI @arxiv-cs-si.bsky.social · 9d

Message passing for epidemiological interventions on networks with loops
https://arxiv.org/abs/2509.21596

5 4

jgyou @jgyou.bsky.social · 14d

Had missed this paper!
It's great
arxiv.org/abs/2502.01177

Insights from Network Science can advance Deep Graph Learning

Deep graph learning and network science both analyze graphs but approach similar problems from different perspectives. Whereas network science focuses on models and measures that reveal the organizati...

arxiv.org

4 13

Reposted by jgyou

Ben Kawam @benkawam.bsky.social · Sep 4

Are you studying animal sociality? Confused about the "non-independence" of social network data: what on earth are they? are they threatening your results? should you attempt to get rid of them?

A thread summarising a part of our new paper (ecoevorxiv.org/repository/v...).

Five misunderstandings in animal social network analysis

ecoevorxiv.org

1 11 19

Reposted by jgyou

João Franco @okfranco.bsky.social · Sep 1

🎓 I've joined the PhD in Complex Systems & Data Science at @vcsi.bsky.social to work w/ @lhd.bsky.social & @juniperlov.bsky.social to explore social (complex) dynamics

🔬 Huge thanks to @joanagsa.bsky.social & Lília Perfeito for helping me get ready for this chapter

🚀 Excited for this next step!

1 3 18

Reposted by jgyou

Daniel Redhead @danielredhead.bsky.social · Aug 4

🐒🕸️ New preprint! Confused about how to model animal social networks?

ASNA can be confusing—but also full of opportunity. We break down 5 common misunderstandings in animal social network analysis and share solutions from behavioural ecology, anthro, stats, & network science. Hope it helps!

A 🧵

Five misunderstandings in animal social network analysis

ecoevorxiv.org

2 23 43

Reposted by jgyou

Daniel Redhead @danielredhead.bsky.social · Aug 4

All from an amazing interdisciplinary group 👥: @benkawam.bsky.social 🌟, @jgyou.bsky.social, Dan Franks, Connor Philson, Marijtje van Duijn, @jordanhart96.bsky.social, MB McElreath, @rmcelreath.bsky.social, @eapower.bsky.social, Cody Ross, @steglich.bsky.social, & @ljnbrent.bsky.social!

1 4

Reposted by jgyou

Hiroki Sayama @hirokisayama.bsky.social · Jun 4

Leto Peel officially opens #NetSci2025, followed by Sonia Kefi's keynote

2 11

jgyou @jgyou.bsky.social · May 19

And the code is live here: github.com/DynamicaLab/...

With @allard.bsky.social and the never-online Simon Lizotte (but you can find him at siliz4.github.io)

2 12

Reposted by jgyou

Science of Health at Columbia University @cusciofhealth.bsky.social · May 1

Hear me discuss our new paper written with the inimitable Laurent Hébert-Dufresne and colleagues! @lhd.bsky.social #Complexity #Physiology #Governance www.nature.com/articles/s44...

5 11

Reposted by jgyou

Laurent Hébert-Dufresne @lhd.bsky.social · Apr 24

On this day in 2023, the Vermont Complex Systems Institute (vermontcomplexsystems.org), TGIR Center (www.med.uvm.edu/tgircobre/home) & @sfiscience.bsky.social joined for an event on interacting contagions

Our work, "One pathogen does not an epidemic make," is now online: arxiv.org/abs/2504.15053

1 3 16

Reposted by jgyou

Sen Pei @senpei.bsky.social · Apr 17

So glad to have @jgyou.bsky.social give an intriguing lecture on contagion modeling and network inference in our network science class!

1 23

Reposted by jgyou

Alec Kirkley @captainkirk1041.bsky.social · Apr 5

I've been guest editing a focus issue for Journal of Physics: Complexity with @jgyou.bsky.social, @gcant.bsky.social, and Cate De Bacco on Statistical Inference and Machine Learning for Complex Networks. See iopscience.iop.org/collections/..., and feel free to get in touch with any questions!

Focus Issue on Statistical Inference and Machine Learning for Complex Networks - IOPscienceSearch

iopscience.iop.org

1 4 4

Reposted by jgyou

Chris Miller @iamcurious.bsky.social · Mar 13

You should find that haircut again.

1 4

Reposted by jgyou

Daryl Fairweather ⛅ @hatethegamebook.com · Mar 11

Hate The Game, the book, is only one month away! Pre-order yours anywhere books are sold. 📖✨

Freakonomics coauthor Steven Levitt called it “Fabulous—unlike any economics book I’ve ever read!

5 2 34

jgyou @jgyou.bsky.social · Mar 11

We're excited to share our MAR10 day discounts!
- $1 off of Mario's Time Machine
- A free wallpaper

Amanda Blain @amandablain.bsky.social · Mar 11

Happy Super Mario Day :)
(Mar 10)
#videogames

1

Reposted by jgyou

Francisco Rodriguez-Sanchez @frodsan.bsky.social · Feb 19

1/ New paper @pnas.org on the structure of mutualistic #networks between individuals plants and frugivore species.

Last chapter of @elequintero.bsky.social's PhD thesis

doi.org/10.1073/pnas... #ecopubs

Downscaling mutualistic networks from species to individuals reveals consistent interaction niches and roles within plant populations

Species-level networks emerge as the combination of interactions spanning multiple individuals, and their study has received considerable attention over the past 30 y. However, less is known about the structure of interaction configurations within species, even though individuals are the actual interacting units in nature. We compiled 46 empirical, individual-based, interaction networks on plant-animal seed dispersal mutualisms, comprising 1,037 plant individuals across 29 species from various regions. We compared the structure of individual-based networks to that of species-based networks and, by extending the niche concept to interaction assemblages, we explored individual plant specialization. Using a Bayesian framework to account for uncertainty derived from sampling, we examined how plant individuals “explore” the interaction niche of their populations. Both individual-based and species-based networks exhibited high variability in network properties, lacking remarkable structural and topological differences between them. Within populations, frugivores’ interaction allocation among plant individuals was highly heterogeneous, with one to three frugivore species dominating interactions. Regardless of species or bioregion, plant individuals displayed a variety of interaction profiles across populations, with a consistently-small percentage of individuals playing a central role and exhibiting high diversity in their interaction assemblage. Plant populations showed variable mid to low levels of niche specialization; and individuals’ interaction niche “breadth” accounted for 70% of the population interaction diversity, on average. Our results highlight how downscaling from species to individual-based networks helps understanding the structuring of interactions within ecological communities.

2 12 42

Reposted by jgyou

Alessandro Vespignani @alexvespi.bsky.social · Feb 12

Wastewater from airplane toilets?
We introduce a global Aircraft-Based Wastewater Surveillance Network (WWSN) for pandemic monitoring in Nature Medicine 🔗 doi.org/10.1038/s415...

Aircraft-based wastewater surveillance allows for real-time, non-invasive monitoring of global pathogen spread
Short 🧵

Pandemic monitoring with global aircraft-based wastewater surveillance networks - Nature Medicine

By simulating the implementation of airport-based wastewater surveillance sites at the global level, a modeling study shows how this early warning system would perform in identifying sources of pandem...

doi.org

5 77 180

Reposted by jgyou

Will Thompson @willthompson.bsky.social · Nov 23

On a similar note I got spoiled by Dr Watson in Julia. Is there a good Python equivalent?

Aviral Chawla @lucretiusbot.bsky.social · Nov 22

In discussion with, @willthompson.bsky.social- Are there packages to simplify complex SLURM submissions?

1 4

Reposted by jgyou

Andrew Mercer @awmercer.bsky.social · Jan 14

We are reaching the time of year when I start hearing from undergrads who are looking for summer internships. Obviously, they should all apply to Pew, but what other research orgs have internship programs that I can tell them about? What other opportunities can I share with them?

6 19 73

jgyou @jgyou.bsky.social · Jan 14

24h left to apply to the REU experience at UVM!

Harnessing the Data Revolution for Vermont: The Science of Online Corpora, Knowledge, and Stories (SOCKS)

socks.w3.uvm.edu/socks/node/65

SOCKS Undergraduate Internships | SOCKS

socks.w3.uvm.edu

1

Reposted by jgyou

Michael Boo-tancourt @betanalpha.bsky.social · Dec 20

Comparison may be a thief of joy, but it is an undoubtably interesting statistical modeling problem. In my latent chapter I go deep into the general problem of modeling comparisons between pairs of abstract items.

HTML: betanalpha.github.io/assets/chapt...
PDF: betanalpha.github.io/assets/chapt...

Pairwise Comparison Modeling

betanalpha.github.io

2 6 31

Reposted by jgyou

Tim Waring @twaring.bsky.social · Dec 17

Fully-funded PhD position on the cultural evolution of environmental management!

Link evolution, ecology and behavioral science to study how people manage environmental challenges in the ACE Lab (timwaring.info).

Position Details: timwaring.info/wp-content/u...

ACE Lab: Applied Cultural Evolution Laboratory

culture, evolution, cooperation, and sustainability

timwaring.info

10 12

jgyou @jgyou.bsky.social · Dec 16

I preemptively declare paper bankruptcy. Anything published on arXiv during the next 3 weeks will be permanently memory black holed.

1 10

Reposted by jgyou

Laurent Hébert-Dufresne @lhd.bsky.social · Dec 10

A project with friends from the Vermont Complex Systems Institute @juniperlov.bsky.social @jstonge.bsky.social @nwlandry.bsky.social @jgyou.bsky.social

Funded by an ambitious AUDACE project from friends and co-authors from Université de Sherbrooke.

Started in the Green Mountains two years ago.

Fall retreat in Vermont where the project was started. Panorama with a field and hills in the distance.

3 17