CloudThrill
            
            @cloudthrill.bsky.social
          
          5 followers
          1 following
          21 posts
        
          Welcome to CloudThrill, a dynamic consulting firm specializing in cloud automation and DevOps services. Founded and led by our passionate  
@clouddude.bsky.social , follow us in linkedin linkedin.com/company/cloudthrill
      
        Posts
        Media
        Videos
        Starter Packs
      
    
        
      Reposted by CloudThrill
    
  
  
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท Sep 24
        
        
          
      ๐#NewBlog #vLLM
๐ ๐ฏ๐๐๐ ๐ฉ๐ซ๐จ๐๐ฎ๐๐ญ๐ข๐จ๐ง-๐ฌ๐ญ๐๐๐ค: AI inference for enterprises๐ซ
๐ขProduction-stack is the K8s-native, enterprise-ready inference setup that supercharges vLLM inference at scale, across Clouds.
๐Start here: cloudthrill.ca/vllm-product...
#AI #LLM #vLLM #Kubernetes #MLOps #KVCache #LMCache
      
          ๐ ๐ฏ๐๐๐ ๐ฉ๐ซ๐จ๐๐ฎ๐๐ญ๐ข๐จ๐ง-๐ฌ๐ญ๐๐๐ค: AI inference for enterprises๐ซ
๐ขProduction-stack is the K8s-native, enterprise-ready inference setup that supercharges vLLM inference at scale, across Clouds.
๐Start here: cloudthrill.ca/vllm-product...
#AI #LLM #vLLM #Kubernetes #MLOps #KVCache #LMCache
vLLM production-stack: LLM inference for Enterprises (part1) - Cloudthrill
          vLLM Production Stack tackles usual issues that come with scaling LLM serving (slow recovery, High GPU bills) with a community-maintained layer that wraps vanilla vLLM, adds a Python-native router, LMCache-powered KV-cache network, autoscaling hooks and Grafana dashboardsโall deployable in a single Helm chart. Let's dive into it!โ๐ป
        
          
          cloudthrill.ca
        
      
  
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท Sep 2
        
        
          
      ๐ฆ#vLLM for ๐๐๐ ๐ข๐ง๐ง๐๐ซ๐ฌ ๐๐ฎ๐ง๐๐ฅ๐: from basics to deployment!  ๐Missed our vLLM series this summer? Hereโs a full recap 
Part1๏ธโฃ: ๐ undamentals cloudthrill.ca/what-is-vllm
Part2๏ธโฃ: ๐ey ๐ eatures cloudthrill.ca/what-is-vllm...
part3๏ธโฃ: ๐eployment ๐ptions cloudthrill.ca/vllm-deloyment
#vllm_project #lmcache #LLMs
        Part1๏ธโฃ: ๐ undamentals cloudthrill.ca/what-is-vllm
Part2๏ธโฃ: ๐ey ๐ eatures cloudthrill.ca/what-is-vllm...
part3๏ธโฃ: ๐eployment ๐ptions cloudthrill.ca/vllm-deloyment
#vllm_project #lmcache #LLMs
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท Aug 19
        
        
          
      ๐ #NewBlog @hashicorp.com Vault blog series
๐๐๐ซ๐ญ ๐: ๐๐๐ญ๐ฎ๐ฉ ๐๐ฎ๐๐๐ซ๐ง๐๐ญ๐๐ฌ ๐๐ฎ๐ญ๐ก๐๐ง๐ญ๐ข๐๐๐ญ๐ข๐จ๐ง ๐ฐ๐ข๐ญ๐ก ๐๐๐ฎ๐ฅ๐ญ
๐ tinyurl.com/k8sAuthVault
๐กIn this 5 minutes tuto you'll learn:
โ Diff Vault auth scenarios for k8s
โ Setup up K8s Vault Auth with SA/Client JWT & OIDC
#k8s #HashiCorp #Vault #SecretsManagement #DevOps
      
          ๐๐๐ซ๐ญ ๐: ๐๐๐ญ๐ฎ๐ฉ ๐๐ฎ๐๐๐ซ๐ง๐๐ญ๐๐ฌ ๐๐ฎ๐ญ๐ก๐๐ง๐ญ๐ข๐๐๐ญ๐ข๐จ๐ง ๐ฐ๐ข๐ญ๐ก ๐๐๐ฎ๐ฅ๐ญ
๐ tinyurl.com/k8sAuthVault
๐กIn this 5 minutes tuto you'll learn:
โ Diff Vault auth scenarios for k8s
โ Setup up K8s Vault Auth with SA/Client JWT & OIDC
#k8s #HashiCorp #Vault #SecretsManagement #DevOps
HashiCorp Vault for Dummies: K8s Auth setup in an External Vault (WSL) - Cloudthrill
          In this post, weโll walk through setting up Kubernetes auth with an external Vault, so your K8s workloads can securely authenticate and pull secrets without hardcoded tokens. Weโll walk through using the TokenReview API, handling service account tokens in modern K8s , and securely wiring Vault to your cluster for workload identity.
        
          
          tinyurl.com
        
      
  
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท Aug 13
        
        
          
      ๐ #NewBlog How to ๐๐๐ฌ๐ฌ ๐ญ๐ก๐ ๐๐ข๐ญ๐๐ฎ๐ ๐๐๐ญ๐ข๐จ๐ง๐ฌ ๐๐๐ซ๐ญ๐ข๐๐ข๐๐๐ญ๐ข๐จ๐ง! 
๐Complete guide here cloudthrill.ca/how-i-passed...
๐ฏ I included all you need to ace it:
โ Free exam practice
โ Most exhaustive Cheat Sheet (all topics covered)
โ CliffsNotes, & exam expectations
#Cloudthrill #Certification #GitHubActions
      
          ๐Complete guide here cloudthrill.ca/how-i-passed...
๐ฏ I included all you need to ace it:
โ Free exam practice
โ Most exhaustive Cheat Sheet (all topics covered)
โ CliffsNotes, & exam expectations
#Cloudthrill #Certification #GitHubActions
How to pass the GitHub Actions certification (cheat-sheet) - Cloudthrill
          ๐ฏEverything you need to pass the GitHub Actions certification in one place. โ๏ธ Clear examples, โ๏ธCheat Sheet โ๏ธCLI syntax, and what to expect in the test.
        
          
          cloudthrill.ca
        
      
  
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท Aug 5
        
        
          
       ๐#BlogSeries #vllm๐ฅ
๐ฏ๐๐๐ ๐๐จ๐ซ ๐๐๐ ๐ข๐ง๐ง๐๐ซ๐ฌ ๐๐๐ซ๐ญ ๐:๐ ๐๐๐ฉ๐ฅ๐จ๐ฒ๐ฆ๐๐ง๐ญ ๐๐ฉ๐ญ๐ข๐จ๐ง๐ฌ
Learn to deploy #vLLM everywhere! Even on CPU๐คซ
โ Platform & model Support Matrix
โ Install on GPU & CPU
โ Build Wheel from scratch | Python vLLM package
โ Docker/Kubernetes Deployment
โ Running vLLM server (Offline + Online inference)
      
          ๐ฏ๐๐๐ ๐๐จ๐ซ ๐๐๐ ๐ข๐ง๐ง๐๐ซ๐ฌ ๐๐๐ซ๐ญ ๐:๐ ๐๐๐ฉ๐ฅ๐จ๐ฒ๐ฆ๐๐ง๐ญ ๐๐ฉ๐ญ๐ข๐จ๐ง๐ฌ
Learn to deploy #vLLM everywhere! Even on CPU๐คซ
โ Platform & model Support Matrix
โ Install on GPU & CPU
โ Build Wheel from scratch | Python vLLM package
โ Docker/Kubernetes Deployment
โ Running vLLM server (Offline + Online inference)
vLLM for beginners: Deployment Options (PartIII) - Cloudthrill
          In this final part, weโll shift from theory to practice, covering how to deploy vLLM across different environments, from source builds to docker containers. In this series, we aim to provide a solid foundation of vLLM core concepts to help you understand how it works and why itโs emerging as a de facto choice for LLM deployment.
        
          
          cloudthrill.ca
        
      
  
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท Jul 29
        
        
          
      #NewBlog from ๐๐๐ซ๐จ ๐ญ๐จ @CivoCloud ๐
๐Deploy your full fledged Talos ๐๐ฎ๐๐๐ซ๐ง๐๐ญ๐๐ฌ stack with Terraform in one command.
check it out๐: tinyurl.com/CivoK8stf
โ Includes Grafana, Prometheus, Let's Encrypt & more
๐ My Repo: tinyurl.com/k8sCivoRepo
#Civo #Grafana #Terraform #Kubernetes #Tutorial
      
          ๐Deploy your full fledged Talos ๐๐ฎ๐๐๐ซ๐ง๐๐ญ๐๐ฌ stack with Terraform in one command.
check it out๐: tinyurl.com/CivoK8stf
โ Includes Grafana, Prometheus, Let's Encrypt & more
๐ My Repo: tinyurl.com/k8sCivoRepo
#Civo #Grafana #Terraform #Kubernetes #Tutorial
Zero to Civo: Deploy Talos Kubernetes with Terraform (incl Grafana & Prometheus) - Cloudthrill
          Today weโll show you how to deploy an end-to-end Kubernetes cluster on a Civo Cloud with terraform . Youโll learn how to build and automate a cluster with Traefik, cert manager , letsencrypt issuer, Grafana , Prometheus.
        
          
          tinyurl.com
        
      
  
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท Jul 10
        
        
          
      ๐๏ธ Join our ๐ด๐๐๐๐ก ๐๐๐๐ญ๐ฌ ๐๐ข๐ฏ๐ Show! 
๐๏ธ Thursday 17th 11:30 AM EDT
๐ฏ A chill livestream unpacking LLM #Quantization: #vllm vs #ollama. Learn about the What & How.
๐ฅDope guest stars:
#bartowski from arcee.ai & Eldar Kurtic from #RedHat
๐Stream on YouTube & Linkedin:
www.youtube.com/watch?v=XTE0...
      
          ๐๏ธ Thursday 17th 11:30 AM EDT
๐ฏ A chill livestream unpacking LLM #Quantization: #vllm vs #ollama. Learn about the What & How.
๐ฅDope guest stars:
#bartowski from arcee.ai & Eldar Kurtic from #RedHat
๐Stream on YouTube & Linkedin:
www.youtube.com/watch?v=XTE0...
๐ดTechBeats live : LLM Quantization "vLLM vs. Ollama"
          YouTube video by CloudDude
        
          
          www.youtube.com
        
      
  
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท Jul 2
        
        
          
      ๐#NewBlog #vllm๐ฅ
๐ฏ๐๐๐ ๐๐จ๐ซ ๐๐๐ ๐ข๐ง๐ง๐๐ซ๐ฌ ๐๐๐ซ๐ญ ๐:๐๐๐๐ฒ ๐ ๐๐๐ญ๐ฎ๐ซ๐๐ฌ & ๐๐ฉ๐ญ๐ข๐ฆ๐ข๐ณ๐๐ญ๐ข๐จ๐งs
๐ What makes #vLLM the Rolls Royce of inference?
๐check it out: cloudthrill.ca/what-is-vllm...
โ #PagedAttention #PrefixCaching #ChunkedPrefill
โ #SpeculativeDecoding #FlashAttention #lmcache
โ Tensor & #PipelineParallelismโก
      
          ๐ฏ๐๐๐ ๐๐จ๐ซ ๐๐๐ ๐ข๐ง๐ง๐๐ซ๐ฌ ๐๐๐ซ๐ญ ๐:๐๐๐๐ฒ ๐ ๐๐๐ญ๐ฎ๐ซ๐๐ฌ & ๐๐ฉ๐ญ๐ข๐ฆ๐ข๐ณ๐๐ญ๐ข๐จ๐งs
๐ What makes #vLLM the Rolls Royce of inference?
๐check it out: cloudthrill.ca/what-is-vllm...
โ #PagedAttention #PrefixCaching #ChunkedPrefill
โ #SpeculativeDecoding #FlashAttention #lmcache
โ Tensor & #PipelineParallelismโก
vLLM for beginners: Key Features & Performance Optimization(PartII) - Cloudthrill
          In this series, we aim to provide a solid foundation of vLLM core concepts to help you understand how it works and why itโs emerging as a defacto choice for LLM deployment.
        
          
          cloudthrill.ca
        
      
  
        
      Reposted by CloudThrill
    
  
          
              Kosseila (CloudDude)
              @clouddude.bsky.social
          
              ยท Jun 24
        
        
        
            Terraform Pipelines for Dummies Part3: GitHub Actions Azure Deploy with OIDC - Cloudthrill
            Struggling with Azure credential management in your CI/CD pipelines? Both Azure and GitHub Actions now supportย OpenID Connect (OIDC) for secure deployments by simplifying the process, and aligning with modern security practices. With GitHubโs OIDC provider, you can authenticate directly from your workflows using managed identities without the need for static access keys.
          
            
            cloudthrill.ca
          
        
      
    
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท Jun 17
        
        
          
      ๐#NewBlogAlert "What is #vLLM ?"
Weโre kicking off our ๐ฏ๐๐๐ ๐๐จ๐ซ ๐๐๐ ๐ข๐ง๐ง๐๐ซ๐ฌ ๐ฌ๐๐ซ๐ข๐๐ฌ with
๐๐๐ซ๐ญ ๐:๐ ๐๐ก๐ ๐ ๐ฎ๐ง๐๐๐ฆ๐๐ง๐ญ๐๐ฅ๐ฌ๐ซ
New to vLLM ? This one's for you๐๐ป: cloudthrill.ca/what-is-vllm
 
โ What is vLLM ( vLLM vs Ollama)
โ Core Architecture (Engine, Sched, Execution, Memory)
โ Offline and Online inference
      
          Weโre kicking off our ๐ฏ๐๐๐ ๐๐จ๐ซ ๐๐๐ ๐ข๐ง๐ง๐๐ซ๐ฌ ๐ฌ๐๐ซ๐ข๐๐ฌ with
๐๐๐ซ๐ญ ๐:๐ ๐๐ก๐ ๐ ๐ฎ๐ง๐๐๐ฆ๐๐ง๐ญ๐๐ฅ๐ฌ๐ซ
New to vLLM ? This one's for you๐๐ป: cloudthrill.ca/what-is-vllm
โ What is vLLM ( vLLM vs Ollama)
โ Core Architecture (Engine, Sched, Execution, Memory)
โ Offline and Online inference
vLLM for beginners: The Fundamentals - Cloudthrill
          In this series, we aim to provide a solid foundation of vLLM core concepts to help you understand how it works and why itโs emerging as a defacto choice for LLM deployment.
        
          
          cloudthrill.ca
        
      
  
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท Jun 10
        
        
          
      ๐๐๐๐๐ก ๐๐๐๐ญ๐ฌ ๐๐ง๐ฉ๐ฅ๐ฎ๐ ๐ ๐๐ is BACK #Episode 06 !!!๐๐ป
๐ง๐ฅ"๐๐ข๐ญ๐๐ฎ๐ ๐๐๐๐ฎ๐ซ๐ข๐ญ๐ฒ ๐ก๐จ๐ซ๐ซ๐จ๐ซ ๐ฌ๐ญ๐จ๐ซ๐ข๐๐ฌ with
#SteveGiguere "โข๏ธ...tons of ๐๐ญ๐ญ๐๐๐ค ๐ฏ๐๐๐ญ๐จ๐ซ๐ฌ, best practices, and a lot of laughs๐ . You don't wanna miss this !
Thank you Steve๐๐ป
๐๐ป spoti.fi/4dYicES ๐๐ป
      
          ๐ง๐ฅ"๐๐ข๐ญ๐๐ฎ๐ ๐๐๐๐ฎ๐ซ๐ข๐ญ๐ฒ ๐ก๐จ๐ซ๐ซ๐จ๐ซ ๐ฌ๐ญ๐จ๐ซ๐ข๐๐ฌ with
#SteveGiguere "โข๏ธ...tons of ๐๐ญ๐ญ๐๐๐ค ๐ฏ๐๐๐ญ๐จ๐ซ๐ฌ, best practices, and a lot of laughs๐ . You don't wanna miss this !
Thank you Steve๐๐ป
๐๐ป spoti.fi/4dYicES ๐๐ป
Ep06: "GitHub Security horror stories " (withย Steveย Giguere)
          Tech Beats Unplugged ยท Episode
        
          
          spoti.fi
        
      
  
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท May 20
        
        
          
      ๐ #NewBlogAlert ๐ก๏ธ #HashiCorpVault
I'm kicking off a ๐๐๐ฎ๐ฅ๐ญ ๐๐จ๐ซ ๐๐ฎ๐ฆ๐ฆ๐ข๐๐ฌ ๐ฌ๐๐ซ๐ข๐๐ฌ with
๐๐๐ซ๐ญ ๐:๐ ๐๐จ๐ฐ ๐ญ๐จ ๐๐๐ญ ๐๐ฉ ๐๐๐ฌ๐ก๐ข๐๐จ๐ซ๐ฉ ๐๐๐ฎ๐ฅ๐ญ with ๐๐๐๐ญ & ๐๐๐
๐check it out: tinyurl.com/HashiVault-f...
@cloudthrill.bsky.social
      
          I'm kicking off a ๐๐๐ฎ๐ฅ๐ญ ๐๐จ๐ซ ๐๐ฎ๐ฆ๐ฆ๐ข๐๐ฌ ๐ฌ๐๐ซ๐ข๐๐ฌ with
๐๐๐ซ๐ญ ๐:๐ ๐๐จ๐ฐ ๐ญ๐จ ๐๐๐ญ ๐๐ฉ ๐๐๐ฌ๐ก๐ข๐๐จ๐ซ๐ฉ ๐๐๐ฎ๐ฅ๐ญ with ๐๐๐๐ญ & ๐๐๐
๐check it out: tinyurl.com/HashiVault-f...
@cloudthrill.bsky.social
HashiCorp Vault for Dummies: Setup your 1st Vault with TLS (WSL) - Cloudthrill
          n this guide, you'll learn how to set up a local Vault server using Raft storage and TLS in a WSL (Windows Subsystem for Linux) environment. Whether you're just starting with secrets management, prepp...
        
          
          tinyurl.com
        
      
  
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท Apr 28
        
        
          
      #NewBlog ๐๐จ๐ฐ ๐ญ๐จ ๐๐๐ฌ๐ฌ ๐ญ๐ก๐ ๐๐๐ ๐๐๐ซ๐ญ๐ข๐๐ข๐๐๐ญ๐ข๐จ๐ง โ ๐๐จ ๐๐๐ญ๐๐ค๐๐ฌ!๐
Time to refocus on your goalsโlike finally crushing that elusive ๐๐๐ ๐๐ฑ๐๐ฆ with my curated guide on:
โ Best resources, hands-on labs, time investment tips
โ D-day strategies, CLI tricks that save you time
๐ฅJust Do it๐ช
๐๐ป buff.ly/S60cXwN #CNCF
      
          Time to refocus on your goalsโlike finally crushing that elusive ๐๐๐ ๐๐ฑ๐๐ฆ with my curated guide on:
โ Best resources, hands-on labs, time investment tips
โ D-day strategies, CLI tricks that save you time
๐ฅJust Do it๐ช
๐๐ป buff.ly/S60cXwN #CNCF
How to pass the CKA certification - Cloudthrill
          CKA is 100% hands-onโno multiple-choice, just real-world challenges. In this post, Iโll break down:โ
 Exam structure & key domainsโ
 How I prepared (resources, labs, and time investment)โ
 Tips to ace it...
        
          
          cloudthrill.ca
        
      
  
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท Apr 15
        
        
          
      ๐#NewBlogpost ๐๐จ ๐๐ฎ๐๐ฅ๐ข๐ ๐๐? ๐๐จ ๐๐ซ๐จ๐๐ฅ๐๐ฆ!
Turn Your ๐๐จ๐๐๐ฅ๐ก๐จ๐ฌ๐ญt into a FREE public URL
with ๐๐ซ๐จ๐ค from @openziti!โ This ๐๐๐ซ๐จ๐๐ซ๐ฎ๐ฌ๐ญ tool allows you to securely expose your local apps to the internet for FREE! ๐ ๐ cloudthrill.ca/ngrok-vs-zrok-part1
      
          Turn Your ๐๐จ๐๐๐ฅ๐ก๐จ๐ฌ๐ญt into a FREE public URL
with ๐๐ซ๐จ๐ค from @openziti!โ This ๐๐๐ซ๐จ๐๐ซ๐ฎ๐ฌ๐ญ tool allows you to securely expose your local apps to the internet for FREE! ๐ ๐ cloudthrill.ca/ngrok-vs-zrok-part1
Turn Your Localhost into a FREE Public URL with Ngrok & Zrok -part 1 - Cloudthrill
          Ngrok VS Zrok allow you to securely expose your local services to the internet. Plus, they provide free static domainsโno extra configuration needed. Letโs dive in!
        
          
          cloudthrill.ca
        
      
  
          
              CloudThrill
              @cloudthrill.bsky.social
          
              ยท Jan 31
        
        
      
     
        