Shubham Panchal
@shubham0204.bsky.social
On-Device ML | Android | Blogger
Running a vector-search on Android with wgpu (Rust API). The compute time is not good and the shader needs to be improved. I would also test on other mobile phones with better GPU cores.
October 12, 2025 at 4:12 AM
Running a vector-search on Android with wgpu (Rust API). The compute time is not good and the shader needs to be improved. I would also test on other mobile phones with better GPU cores.
SmolChat is now available on Google Play in 170+ countries and in two languages, English and simplified Chinese.
SmolChat allows users to download LLMs and use them offline, with a clean and easy-to-use interface.
SmolChat allows users to download LLMs and use them offline, with a clean and easy-to-use interface.
May 20, 2025 at 4:40 AM
SmolChat is now available on Google Play in 170+ countries and in two languages, English and simplified Chinese.
SmolChat allows users to download LLMs and use them offline, with a clean and easy-to-use interface.
SmolChat allows users to download LLMs and use them offline, with a clean and easy-to-use interface.
Technical details: The lookup table is available on @hf.co as a safetensors file, which is read by a small Rust library. JNI bindings are then written for the library, that are used in the Android library.
Project: github.com/shubham0204/...
model2vec: github.com/MinishLab/mo...
Project: github.com/shubham0204/...
model2vec: github.com/MinishLab/mo...
March 17, 2025 at 3:33 AM
Technical details: The lookup table is available on @hf.co as a safetensors file, which is read by a small Rust library. JNI bindings are then written for the library, that are used in the Android library.
Project: github.com/shubham0204/...
model2vec: github.com/MinishLab/mo...
Project: github.com/shubham0204/...
model2vec: github.com/MinishLab/mo...
✨ How do you search for images given a textual query, just like Google Photos?
On-device inference for OpenAI's CLIP using GGUF, enabling image-text similarity & zero-shot classification.
GitHub: github.com/shubham0204/...
#android #softwaredevelopment #programming #machinelearning #ondeviceml
On-device inference for OpenAI's CLIP using GGUF, enabling image-text similarity & zero-shot classification.
GitHub: github.com/shubham0204/...
#android #softwaredevelopment #programming #machinelearning #ondeviceml
November 23, 2024 at 12:15 PM
✨ How do you search for images given a textual query, just like Google Photos?
On-device inference for OpenAI's CLIP using GGUF, enabling image-text similarity & zero-shot classification.
GitHub: github.com/shubham0204/...
#android #softwaredevelopment #programming #machinelearning #ondeviceml
On-device inference for OpenAI's CLIP using GGUF, enabling image-text similarity & zero-shot classification.
GitHub: github.com/shubham0204/...
#android #softwaredevelopment #programming #machinelearning #ondeviceml