banner
LightNews
terrytangyuan.xyz
Yuan Tang
@terrytangyuan.xyz
16K followers 270 following 690 posts
Senior Principal Software Engineer at Red Hat AI | Open Source Leader at Argo, Kubeflow, Kubernetes, CNCF | Maintainer of KServe, XGBoost, TensorFlow | Keynote Speaker | Author | Technical Advisor More info: http://terrytangyuan.xyz We are hiring!
terrytangyuan.xyz
Posts Media Videos Starter Packs
Pinned
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · Dec 9
Super excited to announce that my book Distributed Machine Learning Patterns from Manning Publications is now available in both Chinese and Korean by leading publishers Tsinghua University Press and Hanbit Media!
4 40
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 2d
It was great to see such a strong turnout for my KServe session. Thank you to everyone who joined and asked questions! And a special shoutout to Michelle Kovac, for curating such a fantastic lineup of speakers and sessions.
1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 2d
It was also amazing to see a single slide that includes many of my favorite projects vLLM, llm-d, LMCache, and KServe.

Each year, this conference keeps getting better with more energy, more innovation, and more inspiring people driving open technology forward.
1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 2d
Wrapping up another incredible IBM TechXchange!

The Community Day continues to be my favorite part of the event. I had the chance to connect in person with so many great collaborators from the open source community.
1 3
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 3d
The Best Choice for AI Inference: vLLM https://medium.com/open-5g-hypercore/episode-xxx-the-best-choice-for-ai-inference-vllm-286b2af2df71
2
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 4d
Nick Hill, Nir Rozenbaum, Maroon Ayoub, Greg Pereira, Jooho Lee, Carlos Costa, Sasa Zelenovic, Yuan Tang
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 4d
👉 Check out the October newsletter here: https://inferenceops.substack.com/p/state-of-the-model-serving-communities-269
👉 Subscribe to get future issues in your inbox: https://inferenceops.substack.com/

🚀 Thanks to everyone who subscribed so far!

Kudos to all contributors to this edition!
1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 4d
The response has been incredible and we’ve gained over 𝟲𝟬𝟬 𝘀𝘂𝗯𝘀𝗰𝗿𝗶𝗯𝗲𝗿𝘀!

Our goal with this newsletter is to give a clear, community-driven view of what’s happening across the model serving ecosystem, including updates from vLLM, KServe, llm-d, @kubernetes.io, and Llama Stack.
1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 4d
📢 𝗧𝗵𝗲 𝗦𝘁𝗮𝘁𝗲 𝗼𝗳 𝗠𝗼𝗱𝗲𝗹 𝗦𝗲𝗿𝘃𝗶𝗻𝗴 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝗶𝗲𝘀: 𝗢𝗰𝘁𝗼𝗯𝗲𝗿 𝗘𝗱𝗶𝘁𝗶𝗼𝗻 𝗶𝘀 𝗼𝘂𝘁!

We recently launched our newsletter publicly after sharing it internally at Red Hat AI for over a year.
1 1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 14d
💙

#KServe #CNCF #OpenSource #ModelServing #AI #MLOps #CloudNative #Kubeflow #Kubernetes #k8s @kubefloworg.bsky.social
2
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 14d
Stay tuned! We’ll be publishing a detailed announcement blog soon with more insights on what this means for users, contributors, and the future of model serving on @kubernetes.io.

For now: thank you to the community for making this possible.
1 1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 14d
🙌 Huge thanks to everyone who contributed to this journey from writing code, reviewing docs, to supporting governance and community growth.
1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 14d
Now, the vote has officially passed and KServe is joining the @cncf.io as an incubating project.

This is a major milestone for the community and a big step forward for cloud-native model serving.
1 1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 14d
🎉 𝗞𝗦𝗲𝗿𝘃𝗲 𝗵𝗮𝘀 𝗯𝗲𝗲𝗻 𝗮𝗰𝗰𝗲𝗽𝘁𝗲𝗱 𝗮𝘀 𝗮 𝗖𝗡𝗖𝗙 𝗜𝗻𝗰𝘂𝗯𝗮𝘁𝗶𝗻𝗴 𝗣𝗿𝗼𝗷𝗲𝗰𝘁! 🚀

Just a short time ago, we shared that our application was under public comment.
1 2 5
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 17d
I was fortunate not only to get a tour of the house, but also to share many inspiring conversations with Josh. Encounters like this are a reminder that 𝗼𝗽𝗲𝗻 𝘀𝗼𝘂𝗿𝗰𝗲 𝗶𝘀 𝗯𝘂𝗶𝗹𝘁 𝗻𝗼𝘁 𝗷𝘂𝘀𝘁 𝗼𝗻 𝗰𝗼𝗱𝗲, 𝗯𝘂𝘁 𝗼𝗻 𝗽𝗲𝗼𝗽𝗹𝗲 𝗮𝗻𝗱 𝗿𝗲𝗹𝗮𝘁𝗶𝗼𝗻𝘀𝗵𝗶𝗽𝘀.
1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 17d
The photo was taken in front of his mom’s historic home - a stately mansion anchoring Lafayette’s Historic Ninth Street Hill. 🏛️ www.basedinlafayette.com/p/a-look-ins...
A look inside the historic Ball home on Ninth Street Hill
Opened for an October tour, the Ball Mansion is something to see
www.basedinlafayette.com
1 1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 17d
For years, Josh has been a driving force behind the Kubeflow community - encouraging contributors, strengthening community health, and creating the kind of welcoming environment that makes open source thrive.

This was our first time meeting in person after years of collaboration online.
1 1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 17d
Today I had the pleasure of finally meeting Josh Bottum - the original Kubeflow Community Manager that every @kubefloworg.bsky.social community member should know. 🙌
1 1 3
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 19d
#KubeCon #Keynote #K8s #CNCF #KServe @cncf.io @kubernetes.io Red Hat AI
1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 19d
It was an unforgettable moment on stage in front of thousands of community members, and I can’t wait to do it again - this time diving into the critical topic of 𝘁𝗿𝘂𝘀𝘁 𝗮𝗻𝗱 𝗶𝗱𝗲𝗻𝘁𝗶𝘁𝘆 𝗶𝗻 𝘁𝗵𝗲 𝗔𝗜 𝗲𝗿𝗮.

🙌 If you’re heading to Atlanta, I’d love to see you in the audience!
1 1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 19d
My first keynote was at KubeCon 2022 in Detroit, where I had the honor of joining Priyanka Sharma and Heba Elayoty on the opening keynote to share our experience as open source project maintainers.
1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 19d
➡️ 𝗔𝗻𝗰𝗵𝗼𝗿𝗶𝗻𝗴 𝗧𝗿𝘂𝘀𝘁 𝗶𝗻 𝘁𝗵𝗲 𝗔𝗴𝗲 𝗼𝗳 𝗔𝗜: 𝗜𝗱𝗲𝗻𝘁𝗶𝘁𝗶𝗲𝘀 𝗔𝗰𝗿𝗼𝘀𝘀 𝗛𝘂𝗺𝗮𝗻𝘀, 𝗠𝗮𝗰𝗵𝗶𝗻𝗲𝘀, 𝗮𝗻𝗱 𝗠𝗼𝗱𝗲𝗹𝘀
📌 Session link: https://sched.co/27dCb

This will be my second time on the KubeCon keynote stage.
1 1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 19d
Excited to share that I’ll be delivering a 𝗸𝗲𝘆𝗻𝗼𝘁𝗲 𝗮𝘁 𝗞𝘂𝗯𝗲𝗖𝗼𝗻 𝗡𝗼𝗿𝘁𝗵 𝗔𝗺𝗲𝗿𝗶𝗰𝗮 𝗶𝗻 𝗔𝘁𝗹𝗮𝗻𝘁𝗮 𝘁𝗵𝗶𝘀 𝗡𝗼𝘃𝗲𝗺𝗯𝗲𝗿!

On the first day of the main conference, I’ll be on stage with Anjali Telang for:
1 5
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 22d
I’ve collected these reflections into one place here 👉 https://open.substack.com/pub/terrytangyuan/p/eight-lessons-on-open-source-leadership

💬 Which of these lessons resonates most with your journey in open source or leadership?
2
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 22d
🌟 Open source mentorship isn’t about having all the answers – it’s about creating space for growth
🔥 In open source, you don’t assign tasks - you inspire contribution
🎓 Advice for new CS graduates entering the job market
1
terrytangyuan.xyz
Yuan Tang @terrytangyuan.xyz · 22d
🔑 Technical leadership in open source isn’t about control – it’s about stewardship
🌱 Want to get started in open source?
💙 Sustainability in open source is about care
👥 Open source is powered by people – not just code
🏆 In open source, small wins are the big wins
1 1