🌐 thedevopsguy.biz
✨ An engineer exploring the world of DevOps and data. Sharing insights on homelabs, automation, and the intersection of DevOps, data, and security. ✨ 👨💻
#Homelab #DevOps #Security #Data #Writing
blog.devgenius.io/docker-done-...
#Docker #Homelab #MediaApps #Ansible #CICD #DevOps #Containers #Traefik #Proxmox
blog.devgenius.io/docker-done-...
#Docker #Homelab #MediaApps #Ansible #CICD #DevOps #Containers #Traefik #Proxmox
akashrajvanshi.medium.com/flipping-the...
akashrajvanshi.medium.com/flipping-the...
Integrated pre-commit checks for:
✅ Linting
✅ Actions-check
✅ Secret scanning
✅ YAML linting
✅ SOPS encryption
Tested both Doppler and SOPS + age encryption, working well on the current build.
Integrated pre-commit checks for:
✅ Linting
✅ Actions-check
✅ Secret scanning
✅ YAML linting
✅ SOPS encryption
Tested both Doppler and SOPS + age encryption, working well on the current build.
Completed Python Flask Zero-Code Instrumentation with label fixes!
Now integrating Otel config with Beanstalk AMI, exploring custom AMI vs .ebextensions.
Also kicked off GitOps for Docker in Homelab using Selfhosted GitHub Actions, Doppler & Komodo.
Completed Python Flask Zero-Code Instrumentation with label fixes!
Now integrating Otel config with Beanstalk AMI, exploring custom AMI vs .ebextensions.
Also kicked off GitOps for Docker in Homelab using Selfhosted GitHub Actions, Doppler & Komodo.
Since Zookeeper is deprecated in the new Kafka release, we're not jumping straight to KRaft. Instead, we're first migrating to Kafka (N-1) + Zookeeper with MirrorMaker. This gives us time to evaluate KRaft migration for prod.
Since Zookeeper is deprecated in the new Kafka release, we're not jumping straight to KRaft. Instead, we're first migrating to Kafka (N-1) + Zookeeper with MirrorMaker. This gives us time to evaluate KRaft migration for prod.
Zookeeper’s deprecated in the new Kafka release, so I’m working on a plan to migrate to Kraft storage wish me luck, it’s a wild ride! 💪
#Kafka
Zookeeper’s deprecated in the new Kafka release, so I’m working on a plan to migrate to Kraft storage wish me luck, it’s a wild ride! 💪
#Kafka
Got AWS & Azure S2S VPN working using Terraform! Super helpful for migration scenarios. Also tested both TCP & HTTPS traffic over Tailscale tunnel in K8s. Next up: exposing Traefik services via Tailscale with labels.
Got AWS & Azure S2S VPN working using Terraform! Super helpful for migration scenarios. Also tested both TCP & HTTPS traffic over Tailscale tunnel in K8s. Next up: exposing Traefik services via Tailscale with labels.
Took a weekend break but still got a few things done:
• Read up on Azure RBAC in detail
• Found some great engineering newsletters & blogs helped clarify concepts in distributed systems
Took a weekend break but still got a few things done:
• Read up on Azure RBAC in detail
• Found some great engineering newsletters & blogs helped clarify concepts in distributed systems
Finished optimizing and tuning my helmUtils shared library, added param prechecks, kubeconfig validation, and support for helm dependency build. Also worked on TF code for Azure↔️AWS S2S VPN.
Hoping to wrap it up tonight!
Finished optimizing and tuning my helmUtils shared library, added param prechecks, kubeconfig validation, and support for helm dependency build. Also worked on TF code for Azure↔️AWS S2S VPN.
Hoping to wrap it up tonight!
Spent the day improving the helmUtils Jenkins shared library and brushing up on Azure concepts.
✅ Set up a self-hosted Atuin server to store shell history
🧭 Discovered a cool tool for customized roadmaps & resources: roadmap.sh/ai
Spent the day improving the helmUtils Jenkins shared library and brushing up on Azure concepts.
✅ Set up a self-hosted Atuin server to store shell history
🧭 Discovered a cool tool for customized roadmaps & resources: roadmap.sh/ai
Set up an S2S tunnel between Azure VNet and AWS VPC to migrate a Postgres prod DB by creating a replica over the tunnel. Exploring Azure Migrate, AWS MGN & DMS for this use case. Also working on Terraform code for the S2S setup.
Set up an S2S tunnel between Azure VNet and AWS VPC to migrate a Postgres prod DB by creating a replica over the tunnel. Exploring Azure Migrate, AWS MGN & DMS for this use case. Also working on Terraform code for the S2S setup.
Set up Pangolin & Netbird on the same VPS, super helpful OSS tools! Easy to bootstrap & use, making HmLab access seamless from anywhre.
Using Traefik as a prxy for Pangolin, Netbird still on Caddy as Traefik integration had relay issues. Will debug mor soon!
Set up Pangolin & Netbird on the same VPS, super helpful OSS tools! Easy to bootstrap & use, making HmLab access seamless from anywhre.
Using Traefik as a prxy for Pangolin, Netbird still on Caddy as Traefik integration had relay issues. Will debug mor soon!
Weekend well spent! Took some time to chill and dive into Azure explored Administrative Units, Dynamic Groups, and built a Helm-based deployment pipeline in Jenkins using shared libraries.
Weekend well spent! Took some time to chill and dive into Azure explored Administrative Units, Dynamic Groups, and built a Helm-based deployment pipeline in Jenkins using shared libraries.
Tested PocketID and TinyAuth in my homelab with Traefik Proxy, super cool projects!
Both spun up in minutes and worked right away.
Tested PocketID with 1Password passkey on Proxmox, and TinyAuth with GitHub OIDC on Dozzle.
📸 Attached screencap!
Tested PocketID and TinyAuth in my homelab with Traefik Proxy, super cool projects!
Both spun up in minutes and worked right away.
Tested PocketID with 1Password passkey on Proxmox, and TinyAuth with GitHub OIDC on Dozzle.
📸 Attached screencap!
If you're seeing fingerprint change errors after every PBS update and your backup storage is unreachable until you manually update the fingerprint, skip adding fingerprints if you're using Let's Encrypt certs on Proxmox nodes. No more frustrating errors!
If you're seeing fingerprint change errors after every PBS update and your backup storage is unreachable until you manually update the fingerprint, skip adding fingerprints if you're using Let's Encrypt certs on Proxmox nodes. No more frustrating errors!
Busy couple of days! Built a Python script using the proxmoxer library to manage inventory for both nodes and VMs in Proxmox. I’ll share the code + results soon.
Also found an awesome tool: TSDProxy, automatic OIDC login when connected to @tailscale.com
Busy couple of days! Built a Python script using the proxmoxer library to manage inventory for both nodes and VMs in Proxmox. I’ll share the code + results soon.
Also found an awesome tool: TSDProxy, automatic OIDC login when connected to @tailscale.com
- Shared output of the Proxmoxer script.
- Worked on an Azure project: converted Azure Event Hub input into Azure SQL Database output using a Stream Analytics job for real-time data ingestion and window-based aggregations.
- Shared output of the Proxmoxer script.
- Worked on an Azure project: converted Azure Event Hub input into Azure SQL Database output using a Stream Analytics job for real-time data ingestion and window-based aggregations.
OTEL metrics, traces, and logs are now working for the Flask app, tracking total requests, 4xx/5xx errors, latencies, and host metrics. Jenkins integration with Beanstalk is also complete!
OTEL metrics, traces, and logs are now working for the Flask app, tracking total requests, 4xx/5xx errors, latencies, and host metrics. Jenkins integration with Beanstalk is also complete!
Tested an OTEL Collector on a Flask app with libraries embedded to ship host & app metrics, logs, and traces using a single exporter. Also baked an AMI with the OTEL Collector pre-installed for a Beanstalk app.
Tested an OTEL Collector on a Flask app with libraries embedded to ship host & app metrics, logs, and traces using a single exporter. Also baked an AMI with the OTEL Collector pre-installed for a Beanstalk app.
Sorry for the silence the past few days , I lost my grandma, the biggest support of life. 💔
Back to building:
Testing the OTEL Collector to send metrics, logs & traces directly to Grafana and its ecosystem.
Sorry for the silence the past few days , I lost my grandma, the biggest support of life. 💔
Back to building:
Testing the OTEL Collector to send metrics, logs & traces directly to Grafana and its ecosystem.
Exploring ways to directly export a Beanstalk Python app to a Prometheus instance without involving CloudWatch. Found some options, still investigating.
Also diving into managing Docker secrets without Swarm checked out Doppler today.
Exploring ways to directly export a Beanstalk Python app to a Prometheus instance without involving CloudWatch. Found some options, still investigating.
Also diving into managing Docker secrets without Swarm checked out Doppler today.
Spent the last 2 days diving into Jenkins shared libraries and DSL jobs, first time working with these! After numerous trial runs, I finally got the pipeline up and running to build and deploy on Beanstalk.
Spent the last 2 days diving into Jenkins shared libraries and DSL jobs, first time working with these! After numerous trial runs, I finally got the pipeline up and running to build and deploy on Beanstalk.