Giovanni Beltrame
@beltrame.mistlab.ca
Professor in Computer Engineering at Polytechnique Montreal. Field and Swarm Robotics. Mila-Quebec affiliate. Director of MIST Lab and Astrolith (astrolith.ca)
Took some time, but we have released the code for our swarm distributed caging and transport system. Info and paper on GitHub:
github.com/MISTLab/Swar...
github.com/MISTLab/Swar...
July 9, 2025 at 7:10 AM
Took some time, but we have released the code for our swarm distributed caging and transport system. Info and paper on GitHub:
github.com/MISTLab/Swar...
github.com/MISTLab/Swar...
🧠💤 New research in personalized #BrainStimulation using the Portiloop device: our latest paper shows how #AI can learn to improve detection of #sleep spindles (EEG signals linked to memory consolidation) for each specific subject.
📖 Paper: iopscience.iop.org/article/10.1...
#PersonalizedMedicine
📖 Paper: iopscience.iop.org/article/10.1...
#PersonalizedMedicine
July 8, 2025 at 10:04 AM
🧠💤 New research in personalized #BrainStimulation using the Portiloop device: our latest paper shows how #AI can learn to improve detection of #sleep spindles (EEG signals linked to memory consolidation) for each specific subject.
📖 Paper: iopscience.iop.org/article/10.1...
#PersonalizedMedicine
📖 Paper: iopscience.iop.org/article/10.1...
#PersonalizedMedicine
An excellent opportunity for world-calibre scientists. Come and join us @polymtl.bsky.social !
www.polymtl.ca/carriere/en/...
www.polymtl.ca/carriere/en/...
Professor - Canada Excellence Research Chair for Critical Innovations to Strengthen Canadian Technology Sovereignty
Polytechnique Montréal is an internationally recognized engineering university. Located in the heart of Montréal on Mount Royal, it is renowned for the high quality of the training offered at all levels, and for its multidisciplinary and multisectoral research, at the forefront of the local,...
www.polymtl.ca
April 23, 2025 at 9:49 PM
An excellent opportunity for world-calibre scientists. Come and join us @polymtl.bsky.social !
www.polymtl.ca/carriere/en/...
www.polymtl.ca/carriere/en/...
1/3 We have released our #multi-robot #exploration #planner for #space applications! Designed for complex unconstrained environments, it mixes a local grid with a global graph planner, with the global graphs being synchronised when robots are in comms range. #field #robotics #autonomous #systems
February 4, 2025 at 11:22 AM
1/3 We have released our #multi-robot #exploration #planner for #space applications! Designed for complex unconstrained environments, it mixes a local grid with a global graph planner, with the global graphs being synchronised when robots are in comms range. #field #robotics #autonomous #systems
Reposted by Giovanni Beltrame
Pls share: Konstanz School of Collective behavior from 21st July - 8th August. Application deadline: April, 15. An amazing line up of speakers spanning all aspects of collective behavior . For info: www.exc.uni-konstanz.de/kscb/
@cbehav.bsky.social @mpi-animalbehav.bsky.social
@cbehav.bsky.social @mpi-animalbehav.bsky.social
February 3, 2025 at 5:58 AM
Pls share: Konstanz School of Collective behavior from 21st July - 8th August. Application deadline: April, 15. An amazing line up of speakers spanning all aspects of collective behavior . For info: www.exc.uni-konstanz.de/kscb/
@cbehav.bsky.social @mpi-animalbehav.bsky.social
@cbehav.bsky.social @mpi-animalbehav.bsky.social
Giving a talk at the #Science of #Intelligence cluster at TU Berlin and online (Zoom) next week, "Field Collective Robotics: Challenges and Applications". You're welcome to join to see some of our recent developments.
www.scienceofintelligence.de/event/giovan...
www.scienceofintelligence.de/event/giovan...
Giovanni Beltrame (Polytechnique Montreal), "Field collective robotics: Challenges and applications" - scienceofintelligence.de
Giovanni Beltrame is a Professor in the Department of Computer and Software Engineering at Polytechnique Montréal, where he leads the Making Innovative Space
www.scienceofintelligence.de
January 15, 2025 at 11:36 AM
Giving a talk at the #Science of #Intelligence cluster at TU Berlin and online (Zoom) next week, "Field Collective Robotics: Challenges and Applications". You're welcome to join to see some of our recent developments.
www.scienceofintelligence.de/event/giovan...
www.scienceofintelligence.de/event/giovan...
VLMs everywhere, I'm curious to see where these models for navigation will lead. Interesting work from NVIDIA/UCSD:
Website: navila-bot.github.io
arXiv: arxiv.org/abs/2412.04453
Website: navila-bot.github.io
arXiv: arxiv.org/abs/2412.04453
NaVILA: Legged Robot Vision-Language-Action Model for Navigation
navila-bot.github.io
December 11, 2024 at 2:09 AM
VLMs everywhere, I'm curious to see where these models for navigation will lead. Interesting work from NVIDIA/UCSD:
Website: navila-bot.github.io
arXiv: arxiv.org/abs/2412.04453
Website: navila-bot.github.io
arXiv: arxiv.org/abs/2412.04453
Reposted by Giovanni Beltrame
The rise of robotics 🤖 and autonomous systems is transforming cities 🌆! This global study identifies 32 opportunities, such as advanced eco-monitoring 🌿, and 38 challenges, including RAS waste 🛠️. It highlights the need for proactive policies to balance urban innovation with sustainability 🌍.
#robot
#robot
A global horizon scan of the future impacts of robotics and autonomous systems on urban ecosystems - Nature Ecology & Evolution
The future challenges and potential opportunities of robotics and autonomous systems in urban ecosystems, and how they may impact biodiversity, are explored and prioritized via a global horizon scan o...
www.nature.com
December 7, 2024 at 4:46 PM
The rise of robotics 🤖 and autonomous systems is transforming cities 🌆! This global study identifies 32 opportunities, such as advanced eco-monitoring 🌿, and 38 challenges, including RAS waste 🛠️. It highlights the need for proactive policies to balance urban innovation with sustainability 🌍.
#robot
#robot
Reposted by Giovanni Beltrame
Our recent cave neuroscience expedition, with @hrjourde.bsky.social and @beltrame.mistlab.ca:
www.concordia.ca/news/stories...
See also our thoughts about how to take cognitive neuroscience outside of the box!
www.sciencedirect.com/science/arti...
#cognition #speleology #interdisciplinary
www.concordia.ca/news/stories...
See also our thoughts about how to take cognitive neuroscience outside of the box!
www.sciencedirect.com/science/arti...
#cognition #speleology #interdisciplinary
A caving expedition yields valuable insight into the challenges of field research - Concordia University
Learning how to practice science in extreme environments offers lessons far beyond the lab, new Concordia study shows
www.concordia.ca
December 5, 2024 at 7:08 PM
Our recent cave neuroscience expedition, with @hrjourde.bsky.social and @beltrame.mistlab.ca:
www.concordia.ca/news/stories...
See also our thoughts about how to take cognitive neuroscience outside of the box!
www.sciencedirect.com/science/arti...
#cognition #speleology #interdisciplinary
www.concordia.ca/news/stories...
See also our thoughts about how to take cognitive neuroscience outside of the box!
www.sciencedirect.com/science/arti...
#cognition #speleology #interdisciplinary
Reposted by Giovanni Beltrame
𝗦𝗲𝗹𝗳-𝗢𝗿𝗴𝗮𝗻𝗶𝘇𝗶𝗻𝗴 𝗦𝘆𝘀𝘁𝗲𝗺𝘀: 𝗪𝗵𝗮𝘁, 𝗛𝗼𝘄, 𝗮𝗻𝗱 𝗪𝗵𝘆?
Good intro by Carlos Gershenson
#complexity
www.preprints.org/manuscript/2...
Good intro by Carlos Gershenson
#complexity
www.preprints.org/manuscript/2...
November 29, 2024 at 5:16 PM
𝗦𝗲𝗹𝗳-𝗢𝗿𝗴𝗮𝗻𝗶𝘇𝗶𝗻𝗴 𝗦𝘆𝘀𝘁𝗲𝗺𝘀: 𝗪𝗵𝗮𝘁, 𝗛𝗼𝘄, 𝗮𝗻𝗱 𝗪𝗵𝘆?
Good intro by Carlos Gershenson
#complexity
www.preprints.org/manuscript/2...
Good intro by Carlos Gershenson
#complexity
www.preprints.org/manuscript/2...
Reposted by Giovanni Beltrame
I'm really excited about structure from motion, which is having a real renaissance (ACE0, FlowMap, MASt3R-SfM, VGGSfM, GLOMAP, etc). It will be cool to see how SfM methods interact with VLMs -- SfM always seems like the last problem to jump on the latest bandwagon, but maybe that will change.
November 27, 2024 at 4:02 PM
I'm really excited about structure from motion, which is having a real renaissance (ACE0, FlowMap, MASt3R-SfM, VGGSfM, GLOMAP, etc). It will be cool to see how SfM methods interact with VLMs -- SfM always seems like the last problem to jump on the latest bandwagon, but maybe that will change.
To quote Douglas Adams, I love the whooshing sound deadlines make as they fly by
SIGGRAPH'25 (form): 48 days.
RSS'25 (abs): 49 days.
SIGGRAPH'25 (paper-md5): 55 days.
RSS'25 (paper): 56 days.
ICML'25: 62 days.
RLC'25 (abs): 77 days.
RLC'25 (paper): 84 days.
ICCV'25: 97 days.
RSS'25 (abs): 49 days.
SIGGRAPH'25 (paper-md5): 55 days.
RSS'25 (paper): 56 days.
ICML'25: 62 days.
RLC'25 (abs): 77 days.
RLC'25 (paper): 84 days.
ICCV'25: 97 days.
November 29, 2024 at 1:24 PM
To quote Douglas Adams, I love the whooshing sound deadlines make as they fly by
Reposted by Giovanni Beltrame
The Beyond A* paper is fascinating. In it they use algorithmic techniques (A*) to solve a problem to produce a large dataset of training data to use to train a neural network to reach the same level of performance as the algorithm… 1/2
arxiv.org/abs/2402.14083
arxiv.org/abs/2402.14083
Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping
While Transformers have enabled tremendous progress in various application settings, such architectures still trail behind traditional symbolic planners for solving complex decision making tasks. In t...
arxiv.org
November 28, 2024 at 6:27 PM
The Beyond A* paper is fascinating. In it they use algorithmic techniques (A*) to solve a problem to produce a large dataset of training data to use to train a neural network to reach the same level of performance as the algorithm… 1/2
arxiv.org/abs/2402.14083
arxiv.org/abs/2402.14083
Reposted by Giovanni Beltrame
Thank you to the @neuripsconf.bsky.social for this recognition of the Generative Adversarial Nets paper published ten years ago with @ian-goodfellow.bsky.social, Jean Pouget-Abadie, @memimo.bsky.social, Bing Xu, David Warde-Farley, Sherjil Ozair and Aaron Courville.
blog.neurips.cc/2024/11/27/a...
blog.neurips.cc/2024/11/27/a...
Announcing the NeurIPS 2024 Test of Time Paper Awards – NeurIPS Blog
blog.neurips.cc
November 28, 2024 at 2:36 PM
Thank you to the @neuripsconf.bsky.social for this recognition of the Generative Adversarial Nets paper published ten years ago with @ian-goodfellow.bsky.social, Jean Pouget-Abadie, @memimo.bsky.social, Bing Xu, David Warde-Farley, Sherjil Ozair and Aaron Courville.
blog.neurips.cc/2024/11/27/a...
blog.neurips.cc/2024/11/27/a...
Very interesting paper, not only for neuroscientists
Nature Neuroscience
Inferring neural activity before plasticity as a foundation for learning beyond backpropagation
www.nature.com/articles/s41...
Inferring neural activity before plasticity as a foundation for learning beyond backpropagation
www.nature.com/articles/s41...
Inferring neural activity before plasticity as a foundation for learning beyond backpropagation - Nature Neuroscience
This paper introduces ‘prospective configuration’, a new principle for learning in neural networks, which differs from backpropagation and is more efficient in learning and more consistent with data o...
www.nature.com
November 28, 2024 at 9:54 PM
Very interesting paper, not only for neuroscientists
Reposted by Giovanni Beltrame
🤔 Can you turn your vision-language model from a great zero-shot model into a great-at-any-shot generalist?
Turns out you can, and here is how: arxiv.org/abs/2411.15099
Really excited to this work on multimodal pretraining for my first bluesky entry!
🧵 A short and hopefully informative thread:
Turns out you can, and here is how: arxiv.org/abs/2411.15099
Really excited to this work on multimodal pretraining for my first bluesky entry!
🧵 A short and hopefully informative thread:
November 28, 2024 at 2:33 PM
🤔 Can you turn your vision-language model from a great zero-shot model into a great-at-any-shot generalist?
Turns out you can, and here is how: arxiv.org/abs/2411.15099
Really excited to this work on multimodal pretraining for my first bluesky entry!
🧵 A short and hopefully informative thread:
Turns out you can, and here is how: arxiv.org/abs/2411.15099
Really excited to this work on multimodal pretraining for my first bluesky entry!
🧵 A short and hopefully informative thread:
Reposted by Giovanni Beltrame
Voici un résumé des activités de commémoration du 6 décembre 1989 qui auront lieu au cours des prochains jours.
polymtl.info/Fp1bi
polymtl.info/Fp1bi
November 28, 2024 at 2:27 PM
Voici un résumé des activités de commémoration du 6 décembre 1989 qui auront lieu au cours des prochains jours.
polymtl.info/Fp1bi
polymtl.info/Fp1bi
Reposted by Giovanni Beltrame
For my first post on Bluesky, this recent talk I did at the recent BMVA one day meeting on World Models is a good summary of my work on Computer Vision, Robotics and SLAM, and my thoughts on a bigger picture of #SpatialAI.
youtu.be/NLnPG95vNhQ?...
youtu.be/NLnPG95vNhQ?...
1 Andrew Davison, Imperial College London - BMVA Symposium: Robotics Foundation & World Models
YouTube video by BMVA: British Machine Vision Association
youtu.be
November 28, 2024 at 2:22 PM
For my first post on Bluesky, this recent talk I did at the recent BMVA one day meeting on World Models is a good summary of my work on Computer Vision, Robotics and SLAM, and my thoughts on a bigger picture of #SpatialAI.
youtu.be/NLnPG95vNhQ?...
youtu.be/NLnPG95vNhQ?...
Reposted by Giovanni Beltrame
Introducing “MAGiC-SLAM: Multi-Agent Gaussian Globally Consistent SLAM”! We do SLAM with novel view synthesis capabilities on multiple simultaneously operating agents!
vladimiryugay.github.io/magic_slam/i...
1/7
vladimiryugay.github.io/magic_slam/i...
1/7
November 27, 2024 at 5:34 AM
Introducing “MAGiC-SLAM: Multi-Agent Gaussian Globally Consistent SLAM”! We do SLAM with novel view synthesis capabilities on multiple simultaneously operating agents!
vladimiryugay.github.io/magic_slam/i...
1/7
vladimiryugay.github.io/magic_slam/i...
1/7
Reposted by Giovanni Beltrame
My deep learning course at the University of Geneva is available on-line. 1000+ slides, ~20h of screen-casts. Full of examples in PyTorch.
fleuret.org/dlc/
And my "Little Book of Deep Learning" is available as a phone-formatted pdf (nearing 700k downloads!)
fleuret.org/lbdl/
fleuret.org/dlc/
And my "Little Book of Deep Learning" is available as a phone-formatted pdf (nearing 700k downloads!)
fleuret.org/lbdl/
November 26, 2024 at 6:15 AM
My deep learning course at the University of Geneva is available on-line. 1000+ slides, ~20h of screen-casts. Full of examples in PyTorch.
fleuret.org/dlc/
And my "Little Book of Deep Learning" is available as a phone-formatted pdf (nearing 700k downloads!)
fleuret.org/lbdl/
fleuret.org/dlc/
And my "Little Book of Deep Learning" is available as a phone-formatted pdf (nearing 700k downloads!)
fleuret.org/lbdl/
Frustrating, yet incredibly exciting. The amount of progress in manipulation is fantastic. I wonder if they had any ripped shirts or things flying off the tables (probably).
Source of the video: www.physicalintelligence.company/blog/pi0
Source of the video: www.physicalintelligence.company/blog/pi0
November 25, 2024 at 10:54 AM
Frustrating, yet incredibly exciting. The amount of progress in manipulation is fantastic. I wonder if they had any ripped shirts or things flying off the tables (probably).
Source of the video: www.physicalintelligence.company/blog/pi0
Source of the video: www.physicalintelligence.company/blog/pi0
Reposted by Giovanni Beltrame
Check out the Distributed Robotics Systems Starter Pack:
It features researchers exploring swarm robotics, multi-robot systems, modular robots, and more!
Know someone who should be included? Suggest yourself or others in the replies! 🐝🤖
#Robotics #SwarmRobotics #DistributedRobotics #Swarm
It features researchers exploring swarm robotics, multi-robot systems, modular robots, and more!
Know someone who should be included? Suggest yourself or others in the replies! 🐝🤖
#Robotics #SwarmRobotics #DistributedRobotics #Swarm
November 24, 2024 at 9:15 PM
Check out the Distributed Robotics Systems Starter Pack:
It features researchers exploring swarm robotics, multi-robot systems, modular robots, and more!
Know someone who should be included? Suggest yourself or others in the replies! 🐝🤖
#Robotics #SwarmRobotics #DistributedRobotics #Swarm
It features researchers exploring swarm robotics, multi-robot systems, modular robots, and more!
Know someone who should be included? Suggest yourself or others in the replies! 🐝🤖
#Robotics #SwarmRobotics #DistributedRobotics #Swarm
That's an interesting idea! I think it falls under the umbrella of robotics for #climate #change: precision agriculture, recuperation of rare earths from tailing mounds, maintenance of clean energy infrastructure... Good to see people looking into this!
I'm psyched about the potential of open-world robotics for recycling discarded electronics and batteries. Who else is working on this?
November 24, 2024 at 9:19 PM
Reposted by Giovanni Beltrame
There are now several benchmarks testing spatial reasoning and agent capabilities of LLMs and VLMs:
- arxiv.org/abs/2410.06468 (does spatial cognition ...)
- arxiv.org/abs/2307.06281 (MMBench)
- arxiv.org/abs/2411.13543 (BALROG) - additional points for the LOTR ref.
- arxiv.org/abs/2410.06468 (does spatial cognition ...)
- arxiv.org/abs/2307.06281 (MMBench)
- arxiv.org/abs/2411.13543 (BALROG) - additional points for the LOTR ref.
November 24, 2024 at 5:19 PM
There are now several benchmarks testing spatial reasoning and agent capabilities of LLMs and VLMs:
- arxiv.org/abs/2410.06468 (does spatial cognition ...)
- arxiv.org/abs/2307.06281 (MMBench)
- arxiv.org/abs/2411.13543 (BALROG) - additional points for the LOTR ref.
- arxiv.org/abs/2410.06468 (does spatial cognition ...)
- arxiv.org/abs/2307.06281 (MMBench)
- arxiv.org/abs/2411.13543 (BALROG) - additional points for the LOTR ref.
The 2nd workshop on #Cooperative #Multi-Agent Systems #Decision-Making and #Learning: Human-Multi-Agent Cognitive Fusion will be held on 03/03/2025 in conjunction with #AAAI. We invite everyone to share your works as a paper contribution or an extended abstract.
Site: www.is3rlab.org/aaai25-cmasd...
Site: www.is3rlab.org/aaai25-cmasd...
Cooperative Multi-Agent Systems Decision-making and Learning: Human-Multi-Agent Cognitive Fusion
www.is3rlab.org
November 24, 2024 at 1:03 PM
The 2nd workshop on #Cooperative #Multi-Agent Systems #Decision-Making and #Learning: Human-Multi-Agent Cognitive Fusion will be held on 03/03/2025 in conjunction with #AAAI. We invite everyone to share your works as a paper contribution or an extended abstract.
Site: www.is3rlab.org/aaai25-cmasd...
Site: www.is3rlab.org/aaai25-cmasd...