If you could not attend, here is a recorded version of my talk: youtube.com/watch?v=RCA2... 📽️

As usual, @ewrl18.bsky.social was a wonderful experience.

I had the pleasure of presenting my research as a Contributed Talk 🎉

Special thanks to the organizers for making it happen!

Looking forward to @rl-conference.bsky.social !

I will be presenting 4 posters. Feel free to come and exchange with me during the conference, at the Finding the Frame workshop, or at the Inductive Biases workshop🙂

Had an amazing time presenting my research @cohereforai.bsky.social yesterday 🎤

In case you could not attend, feel free to check it out 👉

youtu.be/RCA22JWiiY8?...

Many thanks to Rahul Narava for the invitation!

More information here: cohere.com/events/Coher...

🎤 Very excited to give a talk @cohereforai.bsky.social next week Friday 🎤

I will be presenting the research I have been working on for the last 2 years with Carlo D'Eramo, @jan-peters.bsky.social, and many more collaborators!

IAS is at RLDM 2025! We have many exiting works to share (see 👇), so come to our posters and talk to us!

Sparse network -> sparse poster

I will be presenting Eau De Q-Network today @rldmdublin2025.bsky.social Feel free to come and exchange at Poster #28 🎤

bsky.app/profile/theo...

Excited to present our latest work at RLDM 2025! If you’re curious about tactile sensing, active perception, or RL in robotics, stop by my poster. Here’s what we’ve been up to:
🧵
#Robotics #TactileSensing #ReinforcementLearning #Transformers #ActivePerception @ias-tudarmstadt.bsky.social

It was amazing to work on this project with Tim Faust, Yogesh Tripathi, @jan-peters.bsky.social, and Carlo D'Eramo!

Thanks to the funding agencies @ias-tudarmstadt.bsky.social, @cs-tudarmstadt.bsky.social, @dfki.bsky.social, @hessianai.bsky.social, and @uni-wuerzburg.de🏦

Very excited to present 🎉Eau De Q-Network🎉 on Thursday @rldmdublin2025.bsky.social Poster #28

🔍Eau De Q-Network gradually prunes the network weights at the agent's learning pace, ultimately reaching a final sparsity level that is discovered by the algorithm!🔎

👉📰 arxiv.org/pdf/2503.01437

Learn more at the workshop website: egoact.github.io/rss2025

Happy to be organizing this with @georgiachal.bsky.social, Yu Xiang, @danfei.bsky.social and @galasso.bsky.social!

Very happy to announce that iterated Q-Network (i-QN) has been published in TMLR 🎉

i-QN learns several Bellman iterations in parallel instead of learning them sequentially via repeated target updates ✨ This directly translates to performance improvements on the Atari and MuJoCo benchmarks 🚀

Iterated $Q$-Network: Beyond One-Step Bellman Updates in Deep Reinforcement Learning

Théo Vincent, Daniel Palenicek, Boris Belousov, Jan Peters, Carlo D'Eramo

Action editor: Pablo Castro

https://openreview.net/forum?id=Lt2H8Bd8jF

#reinforcement #iterative #iterations

The RL (and some non-RL folks) starter pack is almost full. Pretty clear that the academic move here has succeeded
go.bsky.app/3WPHcHg

I guess it depends on how off-policy you want to be. If you want to tune the RB size, I think it is a good idea to start with a large one (as @bramgrooten.bsky.social says) and reduce it if the agent struggles to learn.