A good benchmark measures progress on a specific problem. I don't think it's possible to capture all aspects or applications of RL in one benchmark, so we'd first need to agree on what problem we even want to solve and then build a benchmark that acts as a (hopefully good) proxy for that problem.

Sounds like we need to prioritize building better benchmarks

maybe afternoon? it gets pretty cold once the sun sets

maybe embarcadero or waterfront park? would love to join

Yes I'd love to chat! I'll DM you

That's a very valid question but unfortunately not something I'm in a position to answer as a mere PhD student :-)

Congrats Nathan! Looking forward to reading it!

Thanks so much Mei! It was great to chat

Awesome, thank you!