Lightnews — Scholar-powered news

Mirco Musolesi @mircomusolesi.bsky.social · 6h

New preprint: “Complexity-Driven Policy Optimization”. The paper discusses a novel complexity-driven policy optimisation solution for efficient and robust approximation in Reinforcement Learning. Essentially, entropy alone is not sufficient, we also need "structure".

gfranceschelli.bsky.social @gfranceschelli.bsky.social · 9h

📢 New Paper!

We replace the entropy bonus in PPO with a *complexity* bonus, encouraging structured and stochastic policies that are robust to different scaling factors and can work in environments with variable exploration needs.

Read more:
arxiv.org/abs/2509.20509

w/ @mircomusolesi.bsky.social

Complexity-Driven Policy Optimization

Policy gradient methods often balance exploitation and exploration via entropy maximization. However, maximizing entropy pushes the policy towards a uniform random distribution, which represents an un...

arxiv.org

1

Mirco Musolesi @mircomusolesi.bsky.social · 1d

Book website: libraryoflostmaps.com

The Library of Lost Maps

libraryoflostmaps.com

Mirco Musolesi @mircomusolesi.bsky.social · 1d

Received a copy of “The Library of Lost Maps” by my colleague James Cheshire at @uclgeography.bsky.social in the internal mail. Really beautiful (and very interesting) book. Thanks a lot James!

1 1 2

Mirco Musolesi @mircomusolesi.bsky.social · 4d

For the geeks among you: just discovered the Apple Calculator app has a "Programmer" mode, complete with binary, hex, and related operations.

3

Mirco Musolesi @mircomusolesi.bsky.social · 6d

The problem is still relevant - we now have Amazon delivery vans instead to play with. 2/2

Mirco Musolesi @mircomusolesi.bsky.social · 6d

I was thinking about this some weeks ago. The Travelling Salesman Problem (finding the shortest path through a list of cities, visiting each only once), a classic in Computer Science/Maths, is becoming something of the past without actual salesmen on the roads. 1/2

The Economist @economist.com · 7d

In the 1980s and 1990s salesmen slogged up and down Britain’s motorways. Today that “road-warrior” lifestyle has disappeared. There are several reasons why

British men are driving less, and a culture is vanishing

Farewell to the road warriors

econ.st

1

Mirco Musolesi @mircomusolesi.bsky.social · 16d

Wonders of the natural world. I inherited an office cactus from a colleague who left. In a matter of days, out of nothing the cactus has developed a very long stem (with flowers).

1

Mirco Musolesi @mircomusolesi.bsky.social · Aug 6

Today Charlie Westphal will present our paper "Feature Selection for Network Intrusion Detection" in the main Research Track of ACM KDD 2025 in Toronto.

Link to the paper: dl.acm.org/doi/pdf/10.1...

#KDD2025

2

Mirco Musolesi @mircomusolesi.bsky.social · Jun 19

Dream jobs and where to find them. linkedin.com/jobs/view/42...

1

Mirco Musolesi @mircomusolesi.bsky.social · Jun 14

Liza Tennant (liza-tennant.github.io) and her #RLDM2025 poster on “Dynamics of Moral Behaviour in Heterogenous Populations of Learning Agents".

Paper: ojs.aaai.org/index.php/AI...

5

Mirco Musolesi @mircomusolesi.bsky.social · Jun 13

Lorenz Wolf (profiles.ucl.ac.uk/90553-lorenz...) and his #RLDM2025 poster on “Heterogeneous Knowledge for Augmented Modular Reinforcement Learning”.

Preprint: arxiv.org/abs/2306.01158

1 3

Mirco Musolesi @mircomusolesi.bsky.social · Jun 11

If you are attending #RLDM2025 in Dublin this week, do not miss the posters by Liza Tennant (liza-tennant.github.io) and Lorenz Wolf (profiles.ucl.ac.uk/90553-lorenz...) showcasing the work of our lab!

rldm.org

@rldmdublin2025.bsky.social

1 1

Mirco Musolesi @mircomusolesi.bsky.social · Jun 10

"Mr. Atkinson is credited with inventing many of the key aspects of graphical computing, such as “pull down” menus, and popularizing the “double-click” gesture, which allows users to open files, folders and applications by clicking a mouse button twice in succession..." 2/2

Mirco Musolesi @mircomusolesi.bsky.social · Jun 10

Many posts about Apple announcements following WWDC25. I definitely like the glassy widgets. Less attention has been paid to the passing of Bill Atkinson, a real (personal) computer pioneer. This NYT obituary is quite good: www.nytimes.com/2025/06/07/t... 1/2

Bill Atkinson, Who Made Computers Easier to Use, Is Dead at 74

www.nytimes.com

1

Mirco Musolesi @mircomusolesi.bsky.social · Jun 7

8 days left to apply!

Mirco Musolesi @mircomusolesi.bsky.social · May 29

The second call for applications to the CDT in Cyber-Physical Risk is now open. I am offering two projects in the area of AI and cybersecurity. I would be happy to chat about this opportunity if you are interested.

www.ucl.ac.uk/security-cri...

Closing date: 15 June 2025.

1

Mirco Musolesi @mircomusolesi.bsky.social · May 29

The second call for applications to the CDT in Cyber-Physical Risk is now open. I am offering two projects in the area of AI and cybersecurity. I would be happy to chat about this opportunity if you are interested.

www.ucl.ac.uk/security-cri...

Closing date: 15 June 2025.

1

Mirco Musolesi @mircomusolesi.bsky.social · May 21

Also, presented in the Blue Sky Track, so this seems the right place to advertise it.

Mirco Musolesi @mircomusolesi.bsky.social · May 21

Today our paper with James Rudd-Jones and María Pérez-Ortiz "Multi-Agent Reinforcement Learning Simulation for Environmental Policy Synthesis" will be presented at the #AAMAS2025 Conference in Detroit.

Time: 2pm ET
Room: Richard

Link to the paper: arxiv.org/abs/2504.12777

@aamasconf.bsky.social

2

Mirco Musolesi @mircomusolesi.bsky.social · May 21

Today our paper with James Rudd-Jones and María Pérez-Ortiz "Multi-Agent Reinforcement Learning Simulation for Environmental Policy Synthesis" will be presented at the #AAMAS2025 Conference in Detroit.

Time: 2pm ET
Room: Richard

Link to the paper: arxiv.org/abs/2504.12777

@aamasconf.bsky.social

2 5

Mirco Musolesi @mircomusolesi.bsky.social · May 15

Congratulations to Liza Tennant (liza-tennant.github.io) for passing her PhD viva today with a thesis on “Moral Alignment of Agentic AI Systems”! Well done Liza! And thanks to the examiners @jzleibo.bsky.social and John Shawe-Taylor for examining Liza’s dissertation.

4

Mirco Musolesi @mircomusolesi.bsky.social · May 3

If you are attending #AISTAT2025, do not miss Charlie's presentation tomorrow.

Mirco Musolesi @mircomusolesi.bsky.social · May 2

Our paper "Partial Information Decomposition for Data Interpretability and Feature Selection" with Charlie Westphal and Steve Hailes will be presented at #AISTAT2025 on Sunday.

Session details: Spot 151 in Session 2 (Sun, May 4).

Link to the paper: openreview.net/attachment?i...

Mirco Musolesi @mircomusolesi.bsky.social · May 2

Our paper "Partial Information Decomposition for Data Interpretability and Feature Selection" with Charlie Westphal and Steve Hailes will be presented at #AISTAT2025 on Sunday.

Session details: Spot 151 in Session 2 (Sun, May 4).

Link to the paper: openreview.net/attachment?i...

Mirco Musolesi @mircomusolesi.bsky.social · Apr 28

Our paper on model-based reinforcement learning for causal discovery is now out in Proceedings of the Royal Society A.

@royalsocietypublishing.org
@uclengineering.bsky.social

Victor-Alexandru Darvariu @vadarvariu.bsky.social · Apr 28

Our paper "Tree search in DAG space with model-based reinforcement learning for causal discovery" has just been published in Proceedings of the Royal Society A. Joint work with Steve Hailes and @mircomusolesi.bsky.social 🧵 1/

Screenshot of the paper title, authors, abstract and miscellaneous bibliographical information as it appears in the published journal PDF.

1 4

Mirco Musolesi @mircomusolesi.bsky.social · Apr 26

Having been quite interested in the idea of the Animal-AI Olympics (github.com/Kinds-of-Int...) in the past, I am very happy to see that ICLR is colocated with PetExpo this year. #ICLR2025

1 3

Mirco Musolesi @mircomusolesi.bsky.social · Apr 25

This afternoon Liza Tennant will present our paper "Moral Alignment for LLM Agents" at @iclr-conf.bsky.social 2025.

Time: 3pm Singapore time
Location: Hall 3 + Hall 2B #238

Paper: openreview.net/pdf?id=MeGDm...

Poster+video: iclr.cc/virtual/2025...

#ICLR2025 #ICLR25

3

Mirco Musolesi @mircomusolesi.bsky.social · Apr 16

...it took me a while to find out that this was the cause of the problem.