Vincent Mai
@vincentmai.bsky.social
2.1K followers 890 following 42 posts
ML/RL research scientist
Posts Media Videos Starter Packs
vincentmai.bsky.social
You are right. I am sorry. I will remove my post.

It is very difficult, and stressful, to see the US going there. Being outside and therefore unable to do anything about it makes me feel powerless. I wish more would be done by those who can.
It is unfair to judge though. I am not in this position.
vincentmai.bsky.social
To friends worried about the US some months ago, I said things were OK as long as people like Kimmel could make fun of the president night after night in a large audience TV show.

This is not OK anymore. This country is running at fast speed into dark territory. Gotta wake up, American people. Now.
vincentmai.bsky.social
It's among my favorite projects because 1) we used DL to reduce the costs of clean energy production 2) we managed to deal with many real-world and real-time constraints, and 3) it's fun to use neural nets to control enormous machines!
vincentmai.bsky.social
We ran this on a real turbine and achieved a 42% reduction of strain amplitude after only 7 startups, compared to the standard one. It's significant! We now aim at making it generally applicable for different types of turbines (this was for a Francis, Kaplans have an additional dimension).
vincentmai.bsky.social
Once the model is trained with enough data (or when we have used most of the startup budget), we finalize by optimizing the strain only. The parameters are always tested on the turbine, allowing to confirm the predictions with ground truth measurements.
vincentmai.bsky.social
The virtual sensors are integrated in a black box optimization loop, which also includes a turbine dynamics simulator. For several startups, we use active learning, with an ensemble and optimism under uncertainty, to output the parameters to run next to get the most informative data for the model.
vincentmai.bsky.social
This is where machine learning comes into play. We use a neutral networks to create a "virtual sensor" predicting the strain amplitude for a given turbine strain. It is trained on the trajectories we currently have measured.
vincentmai.bsky.social
The challenge is that the sensors for strain (which leads to fatigue and cracks) don't last long on such turbines. They get flushed away! We have ~10 tries only to find the best set of parameters which will reduce the strain amplitude.
vincentmai.bsky.social
The strain is what leads to fatigue and cracks. As every turbine is different, it's hard to know in advance which startup parameters lead to the lowest strain. We have to figure it out during the commissioning campaign, when the turbine is placed in the dam.
vincentmai.bsky.social
There are different ways to start a turbine. Startup parameters control the vane opening/rotation speed trajectory until the desired speed is reached. They lead to different strains on the turbine blades.
vincentmai.bsky.social
As renewable energies are integrated in the power grid, hydroelectric turbines are expected to be stopped and started more frequently. But startups are a major source of fatigue on the turbine blades and reduce turbines' lifetime.
vincentmai.bsky.social
One of the most fun projects I worked on.
It's not everyday you can train a neural net on a laptop in a hydroelectric dam to provide commands in real time to start a gigantic turbine!
authors.elsevier.com/a/1lfNk3QJ-d...
authors.elsevier.com
Reposted by Vincent Mai
yoshuabengio.bsky.social
It was a pleasure to meet Prime Minister @mark-carney.bsky.social and Minister Evan Solomon today as part of an official visit at @mila-quebec.bsky.social with many collaborators from our AI ecosystem. We discussed AI risk mitigation, sovereignty & economic potential among other important topics.
Reposted by Vincent Mai
cathywu.bsky.social
This project was 4 years in the making and it's finally out!

We found that controlling vehicle speeds to mitigate traffic across a city can cut carbon emissions between 11 and 22 percent. To do this, we used deep reinforcement learning to optimize one million eco-driving scenarios. 🚗🤖🧠
vincentmai.bsky.social
It is not only impressive, it is absolutely fascinating. One cannot be scientifically curious and not be thrilled. Yet the consequences of this new knowledge may be harmful, because of society.
This is hard to grapple with for someone who believes knowledge should be inherently good.
Reposted by Vincent Mai
rl4rsworkshop.bsky.social
Eugene Vinitsky: Building capable, controllable simulation agents through reinforcement learning

RL4RS Workshop at @rl-conference.bsky.social
Reposted by Vincent Mai
rl4rsworkshop.bsky.social
📍 The RL4RS Workshop is happening tomorrow at
University of Alberta, as part of @rl-conference.bsky.social.

Join us for a focused day on real-world applications of Reinforcement Learning.

🗓️ Full Schedule: rl4rs.github.io/RL4RS/schedu...

We hope to see you there.
Reposted by Vincent Mai
rl-conference.bsky.social
Propose some socials for RLC! Research topics, affinity groups, niche interests, whatever comes to mind!

rl-conference.cc/call_for_soc...
RLC Call for Workshops
rl-conference.cc
Reposted by Vincent Mai
rl4rsworkshop.bsky.social
We’ve received several requests from authors, and in response, the submission deadline for the RL4RS Workshop at RLC has been extended to June 2nd (Anywhere on Earth).

Check out the Call for Papers and submission link below — we look forward to your contributions!

rl4rs.github.io/RL4RS/
Workshop on RL4RS
Workshop on on Practical Insights into RL for Real Systems.
rl4rs.github.io
Reposted by Vincent Mai
rl-conference.bsky.social
Reminder that early registration for RLC closes on the 30th! Please register early to save yourself some money and help us get the word out.
Reposted by Vincent Mai
rl4rsworkshop.bsky.social
🚨 10 days left to submit to RL4RS workshop @ RLC 2025! 🤖💡

Consider sharing your insights if you're working on applied RL in industry, society, or critical systems!

Cfp: rl4rs.github.io/RL4RS/call_f...
Call For Papers
Workshop on on Practical Insights into RL for Real Systems.
rl4rs.github.io
vincentmai.bsky.social
Ça a été une leçon d'humilité et une occasion d'apprentissage? (Un peu moins négatif?)