CloudThrill
banner
cloudthrill.bsky.social
CloudThrill
@cloudthrill.bsky.social
5 followers 1 following 21 posts
Welcome to CloudThrill, a dynamic consulting firm specializing in cloud automation and DevOps services. Founded and led by our passionate @clouddude.bsky.social , follow us in linkedin linkedin.com/company/cloudthrill
Posts Media Videos Starter Packs
Reposted by CloudThrill
Still thinking of hosting your on AI Backend?
our FREE vLLM POC is still live - but not forever.
๐Ÿ“ข๐—”๐—ฝ๐—ฝ๐—น๐˜† ๐—ป๐—ผ๐˜„ โ†’ cloudthrill.ca/ai-poc

Run AI assistants, RAG, or open models privately in the cloud:
โœ… No external APIs
โœ… No vendor lock-in
โœ… Total data control

Your Infra. Your Models. Your rules.๐Ÿ†๐Ÿ
๐Ÿ’ก In this 5-min read you'll learn:
โœ… How embeddings work โ€“ in the simplest way possible
๐Ÿ” Chunk sizes, overlaps, and text splitters
๐Ÿ“ฆ Vector DBs, popular embedding models used today

๐Ÿ’กOh,& donโ€™t forget, our Private ๐—”๐—œ ๐—œ๐—ป๐—ณ๐—ฒ๐—ฟ๐—ฒ๐—ป๐—ฐ๐—ฒ campaign is still running, with a ๐‹๐ˆ๐Œ๐ˆ๐“๐„๐ƒ FREE ๐๐Ž๐‚ cloudthrill.ca/ai-poc
๐ŸWeโ€™re excited to share that CloudThrill has been awarded a ๐๐ซ๐จ๐’๐ž๐ซ๐ฏ๐ข๐œ๐ž๐ฌ ๐ฉ๐ซ๐ž๐ช๐ฎ๐š๐ฅ๐ข๐Ÿ๐ข๐œ๐š๐ญ๐ข๐จ๐ง๐Ÿ‘๐Ÿผ with ๐๐ฎ๐›๐ฅ๐ข๐œ ๐’๐ž๐ซ๐ฏ๐ข๐œ๐ž๐ฌ ๐š๐ง๐ ๐๐ซ๐จ๐œ๐ฎ๐ซ๐ž๐ฆ๐ž๐ง๐ญ ๐‚๐š๐ง๐š๐๐š !
๐Ÿ‘‹๐Ÿป Work with a ๐ฉ๐ฎ๐›๐ฅ๐ข๐œ ๐š๐ ๐ž๐ง๐œ๐ฒ ? Letโ€™s talk about your challenges - weโ€™d love to hear from you! cloudthrill.ca/contact-us
#CloudThrill #ProServices #GovernmentOfCanada
Check out our new ๐ฏ๐‹๐‹๐Œ ๐๐ซ๐จ๐๐ฎ๐œ๐ญ๐ข๐จ๐ง ๐’๐ญ๐š๐œ๐ค blog๐Ÿ‘‡๐Ÿผ
๐Ÿ’ŽWe cover:
โœ… What is ๐ฏ๐‹๐‹๐Œ production stack ?
โœ… Request Flow & Architecture breakdown
โœ… Serving Engine, Request Router & KV-Cache Netwrk
โœ… Autoscaling & built-in fault-tolerance
โœ… One-click Helm install

#LLMs #Kubernetes #Cloudthrill #vLLM
๐Ÿš€#NewBlog #vLLM
๐Ÿ“– ๐ฏ๐‹๐‹๐Œ ๐ฉ๐ซ๐จ๐๐ฎ๐œ๐ญ๐ข๐จ๐ง-๐ฌ๐ญ๐š๐œ๐ค: AI inference for enterprises๐Ÿ’ซ

๐ŸขProduction-stack is the K8s-native, enterprise-ready inference setup that supercharges vLLM inference at scale, across Clouds.

๐Ÿ‘‰Start here: cloudthrill.ca/vllm-product...

#AI #LLM #vLLM #Kubernetes #MLOps #KVCache #LMCache
vLLM production-stack: LLM inference for Enterprises (part1) - Cloudthrill
vLLM Production Stack tackles usual issues that come with scaling LLM serving (slow recovery, High GPU bills) with a community-maintained layer that wraps vanilla vLLM, adds a Python-native router, LMCache-powered KV-cache network, autoscaling hooks and Grafana dashboardsโ€”all deployable in a single Helm chart. Let's dive into it!โœ๐Ÿป
cloudthrill.ca
Hereโ€™s a full recap from #CloudThrill team of the vLLM beginners series, broken in 3 parts ๐Ÿ’ซ share and enjoy!
๐Ÿ“ฆ#vLLM for ๐๐ž๐ ๐ข๐ง๐ง๐ž๐ซ๐ฌ ๐›๐ฎ๐ง๐๐ฅ๐ž: from basics to deployment! ๐Ÿ‘‡Missed our vLLM series this summer? Hereโ€™s a full recap
Part1๏ธโƒฃ: ๐…undamentals cloudthrill.ca/what-is-vllm
Part2๏ธโƒฃ: ๐Šey ๐…eatures cloudthrill.ca/what-is-vllm...
part3๏ธโƒฃ: ๐ƒeployment ๐Žptions cloudthrill.ca/vllm-deloyment
#vllm_project #lmcache #LLMs
๐Ÿ” Learn the key to easy and production-grade secret management on K8s ๐Ÿ‘‡๐Ÿผ
๐‹๐ข๐ค๐ž ๐ญ๐ก๐ข๐ฌ ๐ค๐ข๐ง๐ ๐จ๐Ÿ ๐ฌ๐ญ๐ฎ๐Ÿ๐Ÿ? Subscribe here ๐Ÿ‘‰ tinyurl.com/CloudThrillBlogs
๐Ÿš€ #NewBlog @hashicorp.com Vault blog series
๐๐š๐ซ๐ญ ๐Ÿ‘: ๐’๐ž๐ญ๐ฎ๐ฉ ๐Š๐ฎ๐›๐ž๐ซ๐ง๐ž๐ญ๐ž๐ฌ ๐€๐ฎ๐ญ๐ก๐ž๐ง๐ญ๐ข๐œ๐š๐ญ๐ข๐จ๐ง ๐ฐ๐ข๐ญ๐ก ๐•๐š๐ฎ๐ฅ๐ญ
๐Ÿ‘‰ tinyurl.com/k8sAuthVault

๐Ÿ’กIn this 5 minutes tuto you'll learn:
โœ… Diff Vault auth scenarios for k8s
โœ… Setup up K8s Vault Auth with SA/Client JWT & OIDC

#k8s #HashiCorp #Vault #SecretsManagement #DevOps
HashiCorp Vault for Dummies: K8s Auth setup in an External Vault (WSL) - Cloudthrill
In this post, weโ€™ll walk through setting up Kubernetes auth with an external Vault, so your K8s workloads can securely authenticate and pull secrets without hardcoded tokens. Weโ€™ll walk through using the TokenReview API, handling service account tokens in modern K8s , and securely wiring Vault to your cluster for workload identity.
tinyurl.com
Get your teams to level up their CI/CD skills with this GithubActions cert guide ๐Ÿ‘‡๐Ÿป
๐Ÿš€ #NewBlog How to ๐๐š๐ฌ๐ฌ ๐ญ๐ก๐ž ๐†๐ข๐ญ๐‡๐ฎ๐› ๐€๐œ๐ญ๐ข๐จ๐ง๐ฌ ๐‚๐ž๐ซ๐ญ๐ข๐Ÿ๐ข๐œ๐š๐ญ๐ข๐จ๐ง!
๐Ÿ‘‰Complete guide here cloudthrill.ca/how-i-passed...
๐ŸŽฏ I included all you need to ace it:
โœ…Free exam practice
โœ… Most exhaustive Cheat Sheet (all topics covered)
โœ…CliffsNotes, & exam expectations
#Cloudthrill #Certification #GitHubActions
How to pass the GitHub Actions certification (cheat-sheet) - Cloudthrill
๐ŸŽฏEverything you need to pass the GitHub Actions certification in one place. โœ”๏ธ Clear examples, โœ”๏ธCheat Sheet โœ”๏ธCLI syntax, and what to expect in the test.
cloudthrill.ca
#NewBlog: final part of our #VLLM blog series๐Ÿ”ฅ
๐Ÿ’ŽThis, we shift from theory to practice, covering #vLLM installs across platforms? check our new blog, where we break it down in 5 sections๐Ÿ˜Ž#TherYouGo
๐Ÿš€#BlogSeries #vllm๐Ÿ”ฅ
๐ฏ๐‹๐‹๐Œ ๐Ÿ๐จ๐ซ ๐๐ž๐ ๐ข๐ง๐ง๐ž๐ซ๐ฌ ๐๐š๐ซ๐ญ ๐Ÿ‘:๐Ÿ“– ๐ƒ๐ž๐ฉ๐ฅ๐จ๐ฒ๐ฆ๐ž๐ง๐ญ ๐Ž๐ฉ๐ญ๐ข๐จ๐ง๐ฌ
Learn to deploy #vLLM everywhere! Even on CPU๐Ÿคซ

โœ…Platform & model Support Matrix
โœ…Install on GPU & CPU
โœ…Build Wheel from scratch | Python vLLM package
โœ…Docker/Kubernetes Deployment
โœ…Running vLLM server (Offline + Online inference)
vLLM for beginners: Deployment Options (PartIII) - Cloudthrill
In this final part, weโ€™ll shift from theory to practice, covering how to deploy vLLM across different environments, from source builds to docker containers. In this series, we aim to provide a solid foundation of vLLM core concepts to help you understand how it works and why itโ€™s emerging as a de facto choice for LLM deployment.
cloudthrill.ca
New week, new blog! ๐Ÿ‘‡๐Ÿผ
#NewBlog from ๐™๐ž๐ซ๐จ ๐ญ๐จ @CivoCloud ๐Ÿš€
๐Ÿ’ŽDeploy your full fledged Talos ๐Š๐ฎ๐›๐ž๐ซ๐ง๐ž๐ญ๐ž๐ฌ stack with Terraform in one command.
check it out๐Ÿ‘‰: tinyurl.com/CivoK8stf
โœ… Includes Grafana, Prometheus, Let's Encrypt & more
๐Ÿ“– My Repo: tinyurl.com/k8sCivoRepo
#Civo #Grafana #Terraform #Kubernetes #Tutorial
Zero to Civo: Deploy Talos Kubernetes with Terraform (incl Grafana & Prometheus) - Cloudthrill
Today weโ€™ll show you how to deploy an end-to-end Kubernetes cluster on a Civo Cloud with terraform . Youโ€™ll learn how to build and automate a cluster with Traefik, cert manager , letsencrypt issuer, Grafana , Prometheus.
tinyurl.com
๐Ÿ‘‹๐ŸผSee you next Thursday! #Livestream #LLMs #Quantization
๐ŸŽ™๏ธ Join our ๐Ÿ”ด๐“๐ž๐œ๐ก ๐๐ž๐š๐ญ๐ฌ ๐‹๐ข๐ฏ๐ž Show!
๐Ÿ—“๏ธ Thursday 17th 11:30 AM EDT
๐ŸŽฏ A chill livestream unpacking LLM #Quantization: #vllm vs #ollama. Learn about the What & How.

๐Ÿ”ฅDope guest stars:
#bartowski from arcee.ai & Eldar Kurtic from #RedHat

๐Ÿ”—Stream on YouTube & Linkedin:
www.youtube.com/watch?v=XTE0...
๐Ÿ”ดTechBeats live : LLM Quantization "vLLM vs. Ollama"
YouTube video by CloudDude
www.youtube.com
#NewBlog part 2 of our #VLLM blog series ๐Ÿ”ฅ
๐Ÿ’ŽWhat makes #VLLM the Rolls Royce of inference? ๐Ÿ‘‡๐Ÿปcheck our new blog, where we break it down in 5 performance-packed layers๐Ÿ˜Ž#TherYouGo
๐Ÿš€#NewBlog #vllm๐Ÿ”ฅ
๐ฏ๐‹๐‹๐Œ ๐Ÿ๐จ๐ซ ๐๐ž๐ ๐ข๐ง๐ง๐ž๐ซ๐ฌ ๐๐š๐ซ๐ญ ๐Ÿ:๐Ÿ“–๐Š๐ž๐ฒ ๐…๐ž๐š๐ญ๐ฎ๐ซ๐ž๐ฌ & ๐Ž๐ฉ๐ญ๐ข๐ฆ๐ข๐ณ๐š๐ญ๐ข๐จ๐งs
๐Ÿ’Ž What makes #vLLM the Rolls Royce of inference?
๐Ÿ‘‰check it out: cloudthrill.ca/what-is-vllm...

โœ… #PagedAttention #PrefixCaching #ChunkedPrefill
โœ… #SpeculativeDecoding #FlashAttention #lmcache
โœ… Tensor & #PipelineParallelismโšก
vLLM for beginners: Key Features & Performance Optimization(PartII) - Cloudthrill
In this series, we aim to provide a solid foundation of vLLM core concepts to help you understand how it works and why itโ€™s emerging as a defacto choice for LLM deployment.
cloudthrill.ca
Reposted by CloudThrill
๐Ÿš€#NewBlog ๐†๐ข๐ญ๐‡๐ฎ๐› actions Azure deploy with ๐Ž๐ˆ๐ƒ๐‚!
๐Ÿ’กOver ๐Ÿ๐Ÿ‘ ๐ฆ๐ข๐ฅ๐ฅ๐ข๐จ๐ง๐ฌ secrets were exposed in #GitHub last year๐Ÿ’€ & ๐Ÿ“๐ŸŽK+ #Huggingface tokens leaks every month!
๐Ÿ›ก๏ธSwitch to ๐ฌ๐ž๐œ๐ซ๐ž๐ญ๐ฅ๐ž๐ฌ๐ฌ with Pipeline identity now!
๐Ÿ‘‰We show you how: cloudthrill.ca/github-actio...
#Azure #NHI #CICD #Terraform #ManagedIdentity
Terraform Pipelines for Dummies Part3: GitHub Actions Azure Deploy with OIDC - Cloudthrill
Struggling with Azure credential management in your CI/CD pipelines? Both Azure and GitHub Actions now supportย OpenID Connect (OIDC) for secure deployments by simplifying the process, and aligning with modern security practices. With GitHubโ€™s OIDC provider, you can authenticate directly from your workflows using managed identities without the need for static access keys.
cloudthrill.ca
Want to learn about @VLLm ? start here ๐Ÿ‘‡๐Ÿป
๐Ÿš€#NewBlogAlert "What is #vLLM ?"
Weโ€™re kicking off our ๐ฏ๐‹๐‹๐Œ ๐Ÿ๐จ๐ซ ๐๐ž๐ ๐ข๐ง๐ง๐ž๐ซ๐ฌ ๐ฌ๐ž๐ซ๐ข๐ž๐ฌ with
๐๐š๐ซ๐ญ ๐Ÿ:๐Ÿ“– ๐“๐ก๐ž ๐…๐ฎ๐ง๐๐š๐ฆ๐ž๐ง๐ญ๐š๐ฅ๐ฌ๐Ÿ’ซ
New to vLLM ? This one's for you๐Ÿ‘‡๐Ÿป: cloudthrill.ca/what-is-vllm

โœ… What is vLLM ( vLLM vs Ollama)
โœ… Core Architecture (Engine, Sched, Execution, Memory)
โœ… Offline and Online inference
vLLM for beginners: The Fundamentals - Cloudthrill
In this series, we aim to provide a solid foundation of vLLM core concepts to help you understand how it works and why itโ€™s emerging as a defacto choice for LLM deployment.
cloudthrill.ca
๐Ÿšจ As proud sponsors, we're excited to share the latest episode of #TechBeatsUnplugged! ๐ŸŽงTune in as Steve Giguere digs through every attack vectorโ˜ข๏ธon your GitHub workflows and how to protect you๐Ÿ›ก๏ธfrom them.
๐ŸŽ™๐“๐ž๐œ๐ก ๐๐ž๐š๐ญ๐ฌ ๐”๐ง๐ฉ๐ฅ๐ฎ๐ ๐ ๐ž๐ is BACK #Episode 06 !!!๐Ÿ‘Š๐Ÿป
๐ŸŽง๐Ÿ”ฅ"๐†๐ข๐ญ๐‡๐ฎ๐› ๐’๐ž๐œ๐ฎ๐ซ๐ข๐ญ๐ฒ ๐ก๐จ๐ซ๐ซ๐จ๐ซ ๐ฌ๐ญ๐จ๐ซ๐ข๐ž๐ฌ with
#SteveGiguere "โ˜ข๏ธ...tons of ๐š๐ญ๐ญ๐š๐œ๐ค ๐ฏ๐ž๐œ๐ญ๐จ๐ซ๐ฌ, best practices, and a lot of laughs๐Ÿ˜…. You don't wanna miss this !
Thank you Steve๐Ÿ™๐Ÿป
๐Ÿ‘‰๐Ÿป spoti.fi/4dYicES ๐Ÿ‘ˆ๐Ÿป
Ep06: "GitHub Security horror stories " (withย Steveย Giguere)
Tech Beats Unplugged ยท Episode
spoti.fi
New Blog drop!! ๐Ÿ‘‹๐Ÿป
๐Ÿง Your AI workloads are nothing without securing credentials.
๐Ÿš€ #NewBlogAlert ๐Ÿ›ก๏ธ #HashiCorpVault
I'm kicking off a ๐•๐š๐ฎ๐ฅ๐ญ ๐Ÿ๐จ๐ซ ๐ƒ๐ฎ๐ฆ๐ฆ๐ข๐ž๐ฌ ๐ฌ๐ž๐ซ๐ข๐ž๐ฌ with
๐๐š๐ซ๐ญ ๐Ÿ:๐Ÿ” ๐‡๐จ๐ฐ ๐ญ๐จ ๐’๐ž๐ญ ๐”๐ฉ ๐‡๐š๐ฌ๐ก๐ข๐‚๐จ๐ซ๐ฉ ๐•๐š๐ฎ๐ฅ๐ญ with ๐‘๐š๐Ÿ๐ญ & ๐“๐‹๐’
๐Ÿ‘‰check it out: tinyurl.com/HashiVault-f...
@cloudthrill.bsky.social
HashiCorp Vault for Dummies: Setup your 1st Vault with TLS (WSL) - Cloudthrill
n this guide, you'll learn how to set up a local Vault server using Raft storage and TLS in a WSL (Windows Subsystem for Linux) environment. Whether you're just starting with secrets management, prepp...
tinyurl.com
๐Ÿšจ@CloudThrill is excited to announce its membership in the NVIDIA Inception Program! ๐Ÿ‘๐Ÿป๐Ÿ‘๐Ÿป๐Ÿ‘๐Ÿป
Read full statement: cloudthrill.ca/cloudthrill-...
#NVIDIAInception Program for Startups!
Check out our team's new article how to Ace your #CNCF Certified Kubernetes Administrator exam๐Ÿ”ฅ #CKA
#NewBlog ๐‡๐จ๐ฐ ๐ญ๐จ ๐๐š๐ฌ๐ฌ ๐ญ๐ก๐ž ๐‚๐Š๐€ ๐‚๐ž๐ซ๐ญ๐ข๐Ÿ๐ข๐œ๐š๐ญ๐ข๐จ๐ง โ€“ ๐๐จ ๐‘๐ž๐ญ๐š๐ค๐ž๐ฌ!๐Ÿš€
Time to refocus on your goalsโ€”like finally crushing that elusive ๐‚๐Š๐€ ๐ž๐ฑ๐š๐ฆ with my curated guide on:
โœ… Best resources, hands-on labs, time investment tips
โœ… D-day strategies, CLI tricks that save you time
๐Ÿ”ฅJust Do it๐Ÿ’ช
๐Ÿ‘‰๐Ÿป buff.ly/S60cXwN #CNCF
How to pass the CKA certification - Cloudthrill
CKA is 100% hands-onโ€”no multiple-choice, just real-world challenges. In this post, Iโ€™ll break down:โœ… Exam structure & key domainsโœ… How I prepared (resources, labs, and time investment)โœ… Tips to ace it...
cloudthrill.ca
๐Ÿง  ๐†๐๐“ ๐Œ๐จ๐๐ž๐ฅ๐ฌ ๐Ÿ๐จ๐ซ ๐๐ฎ๐ฆ๐ฆ๐ข๐ž๐ฌ #cheatsheet
๐Ÿค” If youโ€™ve opened #ChatGPT lately and thought:
โ€œ๐–๐š๐ข๐ญโ€ฆ ๐ฐ๐ก๐š๐ญโ€™๐ฌ ๐จ๐Ÿ‘? ๐€๐ง๐ ๐ฐ๐ก๐ฒ ๐š๐ซ๐ž ๐ญ๐ก๐ž๐ซ๐ž ๐ฌ๐จ ๐ฆ๐š๐ง๐ฒ ๐ฆ๐จ๐๐ž๐ฅ๐ฌ ๐ง๐จ๐ฐ?โ€ Youโ€™re not alone. Today #openAI finally answered๐Ÿ™‹๐Ÿปโ€โ™€๏ธ
๐Ÿ‘‰๐Ÿปhttps://platform.openai.com/docs/models/compare
Check out our team's new article how to expose you web apps demos through Zero trust ๐Ÿš€ @openziti.bsky.social
๐Ÿš€#NewBlogpost ๐๐จ ๐๐ฎ๐›๐ฅ๐ข๐œ ๐ˆ๐? ๐๐จ ๐๐ซ๐จ๐›๐ฅ๐ž๐ฆ!
Turn Your ๐‹๐จ๐œ๐š๐ฅ๐ก๐จ๐ฌ๐ญt into a FREE public URL
with ๐™๐ซ๐จ๐ค from @openziti!โ€” This ๐™๐ž๐ซ๐จ๐“๐ซ๐ฎ๐ฌ๐ญ tool allows you to securely expose your local apps to the internet for FREE! ๐Ÿ”„ ๐Ÿ‘‰ cloudthrill.ca/ngrok-vs-zrok-part1
Turn Your Localhost into a FREE Public URL with Ngrok & Zrok -part 1 - Cloudthrill
Ngrok VS Zrok allow you to securely expose your local services to the internet. Plus, they provide free static domainsโ€”no extra configuration needed. Letโ€™s dive in!
cloudthrill.ca
๐Ÿ“ขNext week, learn more about
๐Ÿง ๐๐ซ๐ข๐ง๐ ๐ข๐ง๐  ๐€๐ˆ ๐ˆ๐ง๐Ÿ๐ž๐ซ๐ž๐ง๐œ๐ž ๐‚๐ฅ๐จ๐ฌ๐ž๐ซ ๐ญ๐จ ๐ฒ๐จ๐ฎ๐ซ ๐๐ž๐ฏ๐ฌ: deploy ๐€๐ˆ ๐„๐ง๐๐ฉ๐จ๐ข๐ง๐ญ๐ฌ ๐ข๐ง ๐Ž๐Š๐„ from our own๐Ÿ”ฅOracle #ACE @clouddude.bsky.social

โ™ ๏ธCheck out the entire agenda ๐Ÿ‘‰๐Ÿป social.ora.cl/60170pPYS
โ™ ๏ธ Register for free ๐Ÿ‘‰๐Ÿป social.ora.cl/60120pPYa

@oracleace.bsky.social #AIInference #K8s #ollama
#๐Ÿ’กNewBlogAlert! What is hashtag#Quantization ๐Ÿ™‹๐Ÿปโ€โ™€๏ธโ‰๏ธ
llama.cpp, GGML GGUF, Bets K Quants,The Microsoft BitNet Quants .. Everything you need to know about quantization in one article ๐Ÿ”ฅ
#LLMs#LLAMA#Quantization #Kquants #INT8 #AI #AIevals
hello ๐Ÿ‘‹๐Ÿผ