Darragh Hanley
@darraghh.bsky.social
Here for AI, politics and a bit of sport. Kaggle GM ✨✨
Reposted by Darragh Hanley
💡 We've just released KV cache quantization in kvpress, our open source package for KV cache compression. Check it out : github.com/NVIDIA/kvpress.
Special thanks for Arthur Zucker and Marc Sun from @huggingface.bsky.social for their support 🤗
Special thanks for Arthur Zucker and Marc Sun from @huggingface.bsky.social for their support 🤗
November 26, 2024 at 1:24 PM
💡 We've just released KV cache quantization in kvpress, our open source package for KV cache compression. Check it out : github.com/NVIDIA/kvpress.
Special thanks for Arthur Zucker and Marc Sun from @huggingface.bsky.social for their support 🤗
Special thanks for Arthur Zucker and Marc Sun from @huggingface.bsky.social for their support 🤗