Umar Jamil
@hkproj.bsky.social
My cat teaches ML at https://www.youtube.com/@umarjamilai
Moving to China was the best experience of my life. Learnt a new language, met my wife, discovered a new cuisine I’m in love with (especially the one from Xi’an) and I finally understood what it means to work hard consistently, while cherishing the present. Highly recommend to everyone who’s “lost”!
November 25, 2024 at 12:14 PM
Moving to China was the best experience of my life. Learnt a new language, met my wife, discovered a new cuisine I’m in love with (especially the one from Xi’an) and I finally understood what it means to work hard consistently, while cherishing the present. Highly recommend to everyone who’s “lost”!
Amazing job by CharacterAI as usual: research.character.ai/optimizing-a...
Optimizing AI Inference at Character.AI (Part Deux)
At Character.AI, we’re building personalized AI entertainment. In order to offer our users engaging, interactive experiences, it's critical we achieve highly efficient inference, or the process by whi...
research.character.ai
November 22, 2024 at 7:12 AM
Amazing job by CharacterAI as usual: research.character.ai/optimizing-a...
In this video, I'll be deriving and coding Flash Attention from scratch. No prior knowledge of CUDA or Triton is required.
Link to the video: youtu.be/zy8ChVd_oTM
All the code will be written in Python with Triton, but no prior knowledge of Triton is required.
Link to the video: youtu.be/zy8ChVd_oTM
All the code will be written in Python with Triton, but no prior knowledge of Triton is required.
Flash Attention derived and coded from first principles with Triton (Python)
YouTube video by Umar Jamil
youtu.be
November 19, 2024 at 10:22 AM
In this video, I'll be deriving and coding Flash Attention from scratch. No prior knowledge of CUDA or Triton is required.
Link to the video: youtu.be/zy8ChVd_oTM
All the code will be written in Python with Triton, but no prior knowledge of Triton is required.
Link to the video: youtu.be/zy8ChVd_oTM
All the code will be written in Python with Triton, but no prior knowledge of Triton is required.