YouTube video by CloudThrill

Curious what LLM embeddings really are and how they power tools like RAG? This guide breaks it down simply - from text-to-vector magic to fast retrieval. Bonus: explore how KV cache speeds up inference in vLLM.

vLLM Production Stack tackles usual issues that come with scaling LLM serving (slow recovery, High GPU bills) with a community-maintained layer that wraps vanilla vLLM, adds a Python-native router, LMCache-powered KV-cache network, autoscaling hooks and Grafana dashboards—all deployable in a single Helm chart. Let's dive into it!✍🏻

YouTube video by CloudDude

Learn how to debug and fix the recursive .gitignore issue in Git repositories. Avoid unintended file exclusions and master .gitignore best practices with this comprehensive guide.

In this post, we’ll walk through setting up Kubernetes auth with an external Vault, so your K8s workloads can securely authenticate and pull secrets without hardcoded tokens. We’ll walk through using the TokenReview API, handling service account tokens in modern K8s , and securely wiring Vault to your cluster for workload identity.

🎯Everything you need to pass the GitHub Actions certification in one place. ✔️ Clear examples, ✔️Cheat Sheet ✔️CLI syntax, and what to expect in the test.

In this final part, we’ll shift from theory to practice, covering how to deploy vLLM across different environments, from source builds to docker containers. In this series, we aim to provide a solid foundation of vLLM core concepts to help you understand how it works and why it’s emerging as a de facto choice for LLM deployment.

Today we’ll show you how to deploy an end-to-end Kubernetes cluster on a Civo Cloud with terraform . You’ll learn how to build and automate a cluster with Traefik, cert manager , letsencrypt issuer, Grafana , Prometheus.

YouTube video by CloudDude

In this series, we aim to provide a solid foundation of vLLM core concepts to help you understand how it works and why it’s emerging as a defacto choice for LLM deployment.

Struggling with Azure credential management in your CI/CD pipelines? Both Azure and GitHub Actions now support OpenID Connect (OIDC) for secure deployments by simplifying the process, and aligning with modern security practices. With GitHub’s OIDC provider, you can authenticate directly from your workflows using managed identities without the need for static access keys.

In this series, we aim to provide a solid foundation of vLLM core concepts to help you understand how it works and why it’s emerging as a defacto choice for LLM deployment.

Tech Beats Unplugged · Episode

n this guide, you'll learn how to set up a local Vault server using Raft storage and TLS in a WSL (Windows Subsystem for Linux) environment. Whether you're just starting with secrets management, prepp...

Event posted by about Explore OCI DevOps: Pipeline your Terraform Stack from GitHub to OCI on AIOUG.

YouTube video by CloudDude