Rupesh Srivastava
banner
rupspace.bsky.social
Rupesh Srivastava
@rupspace.bsky.social
AI Researcher. (Co)developed Highway Networks, Upside-Down RL, Bayesian Flow Networks, EvoTorch
📜 Learning is compression
https://rupeshks.cc/
So this case is not related to technical abilities of LLMs, but the challenges of providing good conversational answers to billions of people around the world for free.
January 17, 2025 at 10:46 PM
Reposted by Rupesh Srivastava
So I'm not here because it's a left-leaning space or anything like that. I'm here because helping prop up a propaganda machine feels really distasteful to me
November 30, 2024 at 2:09 PM
I want to say to bsky users that public open datasets are a net good! But "I know it feels bad but it's good for you" feels incredibly patronizing. People should make their own choices.
So again, it is @bsky.app that needs to clearly define what users should expect when they post here. (3/3)
November 30, 2024 at 12:19 AM
This is not an easy question! Some will say "public" obviously means you have no choice whatsoever. Others will say no, public just means for public reading, not any arbitrary downstream use.

As an ML researcher, of course I'd like more open datasets. But why should I decide for others? (2/3)
November 30, 2024 at 12:19 AM
Hi! 👋🏽
November 24, 2024 at 11:00 AM
They're the research lab of Chinese hedge fund High-Flyer, and have put out very nice LLMs together with detailed tech reports stuffed with insights about training them. I'm a fan :)

These should help you learn more about "the Whale":
archive.is/kD4sC
mp.weixin.qq.com/s/Cajwfve7f-...
疯狂的幻方:一家隐形AI巨头的大模型之路
务必要疯狂地怀抱雄心,且还要疯狂地真诚。
mp.weixin.qq.com
November 22, 2024 at 11:26 PM
(3/3) So it appears possible to have LIDAR sensors and have a low cost too. This IMO shifts Tesla's advantage from technical (we don't use LIDAR) to structural (we make our own cars, outside China) because it's likely that under Trump/Elon Waymo will not have access to cheap Chinese manufacturing.
November 22, 2024 at 9:33 PM
(2/3) The sort of ambitious number floated by Elon was under $30K/car, and it is believed that Waymo's cars might currently cost about $100K-150K. So obviously that would be a huge deal. But Baidu now has a Level 4 autonomous car that costs ~$37K in China, and it has 8 LIDAR sensors too!
November 22, 2024 at 9:33 PM
Oh no checkpoint overwrite bug?
November 22, 2024 at 6:18 PM