How to dockerize and deploy a node application with database to cloud ?
Hello ,
I have cloned and run medusa backend , used docker based postgres and redis and it was running locally and write a Dockerfile and tried to run it and I am unable to run it no matter what and these is some error any way what, I have built the docker image and tried to run it but it fails ever I tried i thought it was the error in my env files then I came to know that for an application with database we need to use docker compose file so then it's for local development if I want to deploy it to some cloud like AWS ecs with fargate what should I do like what is the process and how things work like I don't understand how these kinds of projects are deployed and whatvcan I do to learn these.
Please help me to understand things better
And I don't understand this diff between local deployment with compose and how to deploy it using the cloud ecs with fargate.
Please mension any resources or blogs to understand things better.
https://redd.it/1lyqvk6
@r_devops
Hello ,
I have cloned and run medusa backend , used docker based postgres and redis and it was running locally and write a Dockerfile and tried to run it and I am unable to run it no matter what and these is some error any way what, I have built the docker image and tried to run it but it fails ever I tried i thought it was the error in my env files then I came to know that for an application with database we need to use docker compose file so then it's for local development if I want to deploy it to some cloud like AWS ecs with fargate what should I do like what is the process and how things work like I don't understand how these kinds of projects are deployed and whatvcan I do to learn these.
Please help me to understand things better
And I don't understand this diff between local deployment with compose and how to deploy it using the cloud ecs with fargate.
Please mension any resources or blogs to understand things better.
https://redd.it/1lyqvk6
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Securely Expose Local Docker Services Using Cloudflare Tunnel
If you’ve ever needed to share your locally running Docker apps, whether it’s a dev backend, internal dashboard, or homelab monitoring stack, without exposing ports or using a VPN, Cloudflare Tunnel is a game-changer.
I just published a detailed guide on using Cloudflare Tunnel as a reverse proxy with Docker Compose. The setup includes:
A working sample project (Node.js services + `cloudflared`)
DNS routing with your domain or subdomain
Zero Trust-friendly structure
Security best practices
Read it here: https://blog.prateekjain.dev/expose-docker-services-securely-using-cloudflare-tunnel-9b89fe1ed2b7?sk=ca040c0d0965958aab074ff90fba437c
https://redd.it/1lywapt
@r_devops
If you’ve ever needed to share your locally running Docker apps, whether it’s a dev backend, internal dashboard, or homelab monitoring stack, without exposing ports or using a VPN, Cloudflare Tunnel is a game-changer.
I just published a detailed guide on using Cloudflare Tunnel as a reverse proxy with Docker Compose. The setup includes:
A working sample project (Node.js services + `cloudflared`)
DNS routing with your domain or subdomain
Zero Trust-friendly structure
Security best practices
Read it here: https://blog.prateekjain.dev/expose-docker-services-securely-using-cloudflare-tunnel-9b89fe1ed2b7?sk=ca040c0d0965958aab074ff90fba437c
https://redd.it/1lywapt
@r_devops
Medium
Expose Docker Services Securely Using Cloudflare Tunnel
Use Cloudflare Tunnel as a reverse proxy to expose your local Docker services securely to the internet
Datalog remove ip, useragent_details from logs
Any idea on how to remove fields from context before passing logs to datadog.i have tried something like this using beforesend but its not working
import { datadogLogs } from '@datadog/browser-logs'
datadogLogs.init({
...,
beforeSend: (log) => {
if (log.message.config)
delete log.message.config // or whatever property you want to remove
},
...
});
https://redd.it/1lyy6yb
@r_devops
Any idea on how to remove fields from context before passing logs to datadog.i have tried something like this using beforesend but its not working
import { datadogLogs } from '@datadog/browser-logs'
datadogLogs.init({
...,
beforeSend: (log) => {
if (log.message.config)
delete log.message.config // or whatever property you want to remove
},
...
});
https://redd.it/1lyy6yb
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
ASP .NET Website Project CI/CD deployment
Has anyone worked on .NET Framework 4.7 website projects specifically those without a .csproj or similar project file?
Kindly note I’m referring to website projects, not web applications or class libraries.
When attempting to publish using commands like:
msbuild ./<website-folder-name> /t:Publish /p:PublishDir=publish ,it doesn’t seem to work.
Has anyone faced this scenario? Any suggestions would be appreciated.
Thanks in advance!
https://redd.it/1lyz0sg
@r_devops
Has anyone worked on .NET Framework 4.7 website projects specifically those without a .csproj or similar project file?
Kindly note I’m referring to website projects, not web applications or class libraries.
When attempting to publish using commands like:
msbuild ./<website-folder-name> /t:Publish /p:PublishDir=publish ,it doesn’t seem to work.
Has anyone faced this scenario? Any suggestions would be appreciated.
Thanks in advance!
https://redd.it/1lyz0sg
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Podcast: Reliability Rebels, Ep 6
(x-posted from r/SRE)
I chat with Chris Evans (founder & CPO at incident.io) about the promises and pitfalls of AI in incident response, based on his recent article Avoiding the Ironies of Automation.
We also dig into his time at Monzo, including a major incident in 2019 involving a centralized Cassandra cluster that sat squarely in their critical path!
Links:
[YouTube](https://youtu.be/sysa6ubTv2s?si=P17QBZJ-7r_OPy1z)
Spotify
https://redd.it/1lz0xez
@r_devops
(x-posted from r/SRE)
I chat with Chris Evans (founder & CPO at incident.io) about the promises and pitfalls of AI in incident response, based on his recent article Avoiding the Ironies of Automation.
We also dig into his time at Monzo, including a major incident in 2019 involving a centralized Cassandra cluster that sat squarely in their critical path!
Links:
[YouTube](https://youtu.be/sysa6ubTv2s?si=P17QBZJ-7r_OPy1z)
Spotify
https://redd.it/1lz0xez
@r_devops
incident.io
All-in-one incident management platform | incident.io
incident.io is an all-in-one incident management platform unifying on-call scheduling, real-time incident response, and integrated status pages – helping teams resolve issues faster and reduce downtime.
What is the most accurate open source OCR tool for scanned PDFs?
Running tests on a few OCR tools to help streamline a document digitization project, specifically for large batches of scanned PDFs (mix of books, reports, and forms). While speed matters, I’m primarily interested in accuracy and layout preservation, especially for multi-column or table-heavy documents.
So far, I’ve looked into:
1. Nanonets OCR: It’s not fully open source, but they have a public GitHub for their basic OCR toolkit. It’s fast and easy to set up, but I’ve noticed occasional issues with reading order and formatting when documents have non-standard layouts.
2. olmOCR: Lightweight and surprisingly decent for basic text extraction. Works best on clean scans and single-column layouts. It tends to miss structure (headers, footnotes, columns) in complex PDFs.
3. OCRFlux: This one is relatively new and still evolving. It claims to be layout-aware, and in practice, it’s handled multi-column and table-heavy PDFs better than expected. It can merge paragraphs and tables that span across pages, while the other 2 tend to treat each page in isolation, which makes multi-page tables especially difficult to reconstruct. The way OCRFlux maintains visual structure and continuity reminds me of layout-aware transformers, though it's still early and I’m currently stress-testing it with edge cases and bulk runs.
None of these tools is perfect, and they each come with trade-offs between speed, format fidelity, and language support. I'm curious what OCR tool(s) you have found most accurate for scanned PDFs? Do you run post-processing to fix formatting issues, or do you rely on tools that try to preserve structure natively? And - how do you balance processing speed vs output quality when dealing with large volumes?
Appreciate hearing what workflows, combinations, or tools have worked for you in production or research settings.
https://redd.it/1lyz6qv
@r_devops
Running tests on a few OCR tools to help streamline a document digitization project, specifically for large batches of scanned PDFs (mix of books, reports, and forms). While speed matters, I’m primarily interested in accuracy and layout preservation, especially for multi-column or table-heavy documents.
So far, I’ve looked into:
1. Nanonets OCR: It’s not fully open source, but they have a public GitHub for their basic OCR toolkit. It’s fast and easy to set up, but I’ve noticed occasional issues with reading order and formatting when documents have non-standard layouts.
2. olmOCR: Lightweight and surprisingly decent for basic text extraction. Works best on clean scans and single-column layouts. It tends to miss structure (headers, footnotes, columns) in complex PDFs.
3. OCRFlux: This one is relatively new and still evolving. It claims to be layout-aware, and in practice, it’s handled multi-column and table-heavy PDFs better than expected. It can merge paragraphs and tables that span across pages, while the other 2 tend to treat each page in isolation, which makes multi-page tables especially difficult to reconstruct. The way OCRFlux maintains visual structure and continuity reminds me of layout-aware transformers, though it's still early and I’m currently stress-testing it with edge cases and bulk runs.
None of these tools is perfect, and they each come with trade-offs between speed, format fidelity, and language support. I'm curious what OCR tool(s) you have found most accurate for scanned PDFs? Do you run post-processing to fix formatting issues, or do you rely on tools that try to preserve structure natively? And - how do you balance processing speed vs output quality when dealing with large volumes?
Appreciate hearing what workflows, combinations, or tools have worked for you in production or research settings.
https://redd.it/1lyz6qv
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Is this imposter syndrome?
Hi, wanted a bit of insights please.
I've posted before about how to navigate DevOps space as a junior and have already started working on it such as automating a pipeline, being a bit better at understanding errors, using AWS and bash etc.
However, I'm not seen as a reliable/go-to person in my team as yet and I completely understand it's because they still see me as a learner/junior (2nd year in this role, last year was a grad).
I'm just worried about that being associated with me in the wider team - the one that doesn't know anything - and I've asked my manager for feedback and colleagues, as well as seeing what I can do to help myself, but everything was returned with positivity so far.
These thoughts came up when I noticed more than 10 blockers while automating a pipeline and asked for guidance as some of it was not in my control (such as bamboo skipping code on its own). It's delayed and the seniors understand but I just feel out of place and obviously don't want to lose my job.
https://redd.it/1lz4v9w
@r_devops
Hi, wanted a bit of insights please.
I've posted before about how to navigate DevOps space as a junior and have already started working on it such as automating a pipeline, being a bit better at understanding errors, using AWS and bash etc.
However, I'm not seen as a reliable/go-to person in my team as yet and I completely understand it's because they still see me as a learner/junior (2nd year in this role, last year was a grad).
I'm just worried about that being associated with me in the wider team - the one that doesn't know anything - and I've asked my manager for feedback and colleagues, as well as seeing what I can do to help myself, but everything was returned with positivity so far.
These thoughts came up when I noticed more than 10 blockers while automating a pipeline and asked for guidance as some of it was not in my control (such as bamboo skipping code on its own). It's delayed and the seniors understand but I just feel out of place and obviously don't want to lose my job.
https://redd.it/1lz4v9w
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Added PagerDuty/Slack/Discord to our free distributed monitoring based on your feedback!
Posted here last week about Synthmon.io and got amazing feedback. You asked, we delivered!
What you requested (now live):
✅ PagerDuty integration
✅ Slack notifications
✅ Discord alerts
✅ Webhook support
Still the same core features:
Truly distributed: 3 agents verify each check from different locations
Community-powered: Anyone can run monitoring agents and help scale the network
100% free: No hidden tiers, no credit cards
Thanks to everyone who gave feedback - this community is awesome. Your suggestions literally shaped these features.
https://synthmon.io
https://redd.it/1lz6lox
@r_devops
Posted here last week about Synthmon.io and got amazing feedback. You asked, we delivered!
What you requested (now live):
✅ PagerDuty integration
✅ Slack notifications
✅ Discord alerts
✅ Webhook support
Still the same core features:
Truly distributed: 3 agents verify each check from different locations
Community-powered: Anyone can run monitoring agents and help scale the network
100% free: No hidden tiers, no credit cards
Thanks to everyone who gave feedback - this community is awesome. Your suggestions literally shaped these features.
https://synthmon.io
https://redd.it/1lz6lox
@r_devops
EKS Pod Identities: Implementing the Principle of Least Privilege
Eks Pod Identities offer a robust mechanism to bolster security by implementing the principle of least privilege within Kubernetes environments. This principle ensures that each component, whether a user or a pod, has only the permissions necessary to perform its tasks, minimizing potential security risks.
EKS Pod Identities integrate with AWS IAM (Identity and Access Management) to assign unique, fine-grained permissions to individual pods. This granular access control is crucial in reducing the attack surface, as it limits the scope of actions that can be performed by compromised pods. By leveraging IAM roles, each pod can securely access AWS resources without sharing credentials, enhancing overall security posture.
https://youtu.be/Be85Xo15czk
https://redd.it/1lz7ufj
@r_devops
Eks Pod Identities offer a robust mechanism to bolster security by implementing the principle of least privilege within Kubernetes environments. This principle ensures that each component, whether a user or a pod, has only the permissions necessary to perform its tasks, minimizing potential security risks.
EKS Pod Identities integrate with AWS IAM (Identity and Access Management) to assign unique, fine-grained permissions to individual pods. This granular access control is crucial in reducing the attack surface, as it limits the scope of actions that can be performed by compromised pods. By leveraging IAM roles, each pod can securely access AWS resources without sharing credentials, enhancing overall security posture.
https://youtu.be/Be85Xo15czk
https://redd.it/1lz7ufj
@r_devops
YouTube
Enhancing Security with EKS Pod Identities: Implementing the Principle of Least Privilege
Amazon EKS (Elastic Kubernetes Service) Pod Identities offer a robust mechanism to bolster security by implementing the principle of least privilege within Kubernetes environments. This principle ensures that each component, whether a user or a pod, has only…
I built a tool that lets you spin up full-stack dev environments in 1 click (Kubernetes, Redis, Kafka, Spark, Keycloak, etc.)
Hey folks,
I’ve been working on a tool that lets you spin up **fully isolated dev/test environments** using real production tools — things like:
* Redis, PostgreSQL, MongoDB
* Kafka, Spark, Airflow
* Keycloak, MinIO, Elastic
* Kubernetes, Docker, Jenkins
* And more..
It runs everything in **ephemeral vclusters**, so you can test full stacks *without polluting your local setup*. it is 1 click deployment.. environment ready usually in 30-90 seconds.
You can:
* Mix and match services (e.g., Kafka + Redis + Spark)
* Share setups with teammates/students
* Use it for dev, testing, workshops, or even CI previews
I’m still early-stage — not open source yet but I'm considering it and would love feedback on:
* What stacks you’d want?
* Would you use this over setting it up manually?
* Would this help with learning, teaching, demos, or onboarding?
Here's a quick demo: [**prepare.sh/environments**](https://prepare.sh/environments)
Happy to answer questions.
https://redd.it/1lzawui
@r_devops
Hey folks,
I’ve been working on a tool that lets you spin up **fully isolated dev/test environments** using real production tools — things like:
* Redis, PostgreSQL, MongoDB
* Kafka, Spark, Airflow
* Keycloak, MinIO, Elastic
* Kubernetes, Docker, Jenkins
* And more..
It runs everything in **ephemeral vclusters**, so you can test full stacks *without polluting your local setup*. it is 1 click deployment.. environment ready usually in 30-90 seconds.
You can:
* Mix and match services (e.g., Kafka + Redis + Spark)
* Share setups with teammates/students
* Use it for dev, testing, workshops, or even CI previews
I’m still early-stage — not open source yet but I'm considering it and would love feedback on:
* What stacks you’d want?
* Would you use this over setting it up manually?
* Would this help with learning, teaching, demos, or onboarding?
Here's a quick demo: [**prepare.sh/environments**](https://prepare.sh/environments)
Happy to answer questions.
https://redd.it/1lzawui
@r_devops
Software Deployment
Hello,
Here’s the situation:
I have an executable file (compiled C++ source) that I need to set up and run on Debian. I also need to ensure that future updates to this software can be deployed easily.
My question is: How should I deploy the application?
I can handle installing Debian on the machine. After that, I need to deploy the application in a way that allows for straightforward future updates.
My initial idea: install the OS, create a systemd service for the software, and hand it over to the customer. For future updates, I could simply copy a new zip file and replace the old binary.
However, I know there are other options, such as using
Any tips or recommendations? Are there important details I should consider?
Thanks.
https://redd.it/1lzhrla
@r_devops
Hello,
Here’s the situation:
I have an executable file (compiled C++ source) that I need to set up and run on Debian. I also need to ensure that future updates to this software can be deployed easily.
My question is: How should I deploy the application?
I can handle installing Debian on the machine. After that, I need to deploy the application in a way that allows for straightforward future updates.
My initial idea: install the OS, create a systemd service for the software, and hand it over to the customer. For future updates, I could simply copy a new zip file and replace the old binary.
However, I know there are other options, such as using
.deb packages, Ansible, and similar tools.Any tips or recommendations? Are there important details I should consider?
Thanks.
https://redd.it/1lzhrla
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Stuck in my career. Need advice
Hi all ,
I’m seeking some guidance as I’m currently feeling a bit stuck and confused about my career direction. I have a total of 3 years of experience. As a fresher, I was initially trained in Data Engineering. For the past 2 years, I’ve been working as a Platform Engineer, where I’ve gained hands-on experience with AWS, Docker, Kubernetes, Flask, and FastAPI. In this role, we develop and maintain platform that support Data Engineering and Data Science teams.
Earlier in the same organization, I also worked briefly with Snowflake, primarily writing SQL queries.
Lately, I’ve noticed that DE roles have more openings and appear to be more future-proof compared to DevOps/Platform Engineering. I’m considering transitioning back to DE, but I’m unsure if that’s the right move.
Additionally, one of my long-term career goals is to work with automotive product companies like Mercedes-Benz, Volvo or similar.
Given my background and aspirations, I would really appreciate your advice on which path you’d recommend ??
should I continue in Platform Engineering or shift towards DE?
If i stick to devops. I can move into MLops in future but I am not sure if that becomes the reality I don't see much MLops transitioning going on..
#TIA
https://redd.it/1lzhjin
@r_devops
Hi all ,
I’m seeking some guidance as I’m currently feeling a bit stuck and confused about my career direction. I have a total of 3 years of experience. As a fresher, I was initially trained in Data Engineering. For the past 2 years, I’ve been working as a Platform Engineer, where I’ve gained hands-on experience with AWS, Docker, Kubernetes, Flask, and FastAPI. In this role, we develop and maintain platform that support Data Engineering and Data Science teams.
Earlier in the same organization, I also worked briefly with Snowflake, primarily writing SQL queries.
Lately, I’ve noticed that DE roles have more openings and appear to be more future-proof compared to DevOps/Platform Engineering. I’m considering transitioning back to DE, but I’m unsure if that’s the right move.
Additionally, one of my long-term career goals is to work with automotive product companies like Mercedes-Benz, Volvo or similar.
Given my background and aspirations, I would really appreciate your advice on which path you’d recommend ??
should I continue in Platform Engineering or shift towards DE?
If i stick to devops. I can move into MLops in future but I am not sure if that becomes the reality I don't see much MLops transitioning going on..
#TIA
https://redd.it/1lzhjin
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Using a "heartbeat" pattern for cron jobs bad practice?
I've built an app that currently uses cron jobs managed through the built-in cron manager in my Cloudways hosting panel. It's functional but hard to read, and making changes requires logging into the host panel and editing the jobs manually.
I'm considering switching to a "heartbeat" cron approach: setting up a single cron job that runs every minute and calls a script. That script would then check a database or config for scheduled tasks, log activity, and run any jobs that are due. This would also let me build a GUI in my app to manage the job schedule more easily.
Is this heartbeat-style cron setup considered bad practice? Or is there a better alternative for managing scheduled jobs in a more flexible, programmatic way?
https://redd.it/1lzjix3
@r_devops
I've built an app that currently uses cron jobs managed through the built-in cron manager in my Cloudways hosting panel. It's functional but hard to read, and making changes requires logging into the host panel and editing the jobs manually.
I'm considering switching to a "heartbeat" cron approach: setting up a single cron job that runs every minute and calls a script. That script would then check a database or config for scheduled tasks, log activity, and run any jobs that are due. This would also let me build a GUI in my app to manage the job schedule more easily.
Is this heartbeat-style cron setup considered bad practice? Or is there a better alternative for managing scheduled jobs in a more flexible, programmatic way?
https://redd.it/1lzjix3
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Any recommendations for JIT permissions elevation in AWS?
Hey folks!
Do you know/use any good OSS solutions, other than AWS TEAM, for elevating user/role permissions on request?
I wish it to work with users provisioned from Google Workspace / Okta to IAM Identity Center (SSO).
It might have some UI or be chat bot, where developer can request elevated permissions and responsible person can approve it (or it can be auto approved)
Thank you for your recommendations in advance!
https://redd.it/1lziy3d
@r_devops
Hey folks!
Do you know/use any good OSS solutions, other than AWS TEAM, for elevating user/role permissions on request?
I wish it to work with users provisioned from Google Workspace / Okta to IAM Identity Center (SSO).
It might have some UI or be chat bot, where developer can request elevated permissions and responsible person can approve it (or it can be auto approved)
Thank you for your recommendations in advance!
https://redd.it/1lziy3d
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Need your inputs herw
I'm currently working as a QA intern from last 8 months. I want quit this and start learning devops. I want to take 6-8 months of gap to learn Devops. After that can I able to get a job as a DevOps engineer?
My education details
Bachelors in CSE and 2024 passed out with 8 months of QA internship experience.
Please let me know whether I'm able to get a job after taking 8 months of gap to prepare devops. I'm really interested in DevOps.
Edit : Need Your inputs here. Typo*
https://redd.it/1lzmbg3
@r_devops
I'm currently working as a QA intern from last 8 months. I want quit this and start learning devops. I want to take 6-8 months of gap to learn Devops. After that can I able to get a job as a DevOps engineer?
My education details
Bachelors in CSE and 2024 passed out with 8 months of QA internship experience.
Please let me know whether I'm able to get a job after taking 8 months of gap to prepare devops. I'm really interested in DevOps.
Edit : Need Your inputs here. Typo*
https://redd.it/1lzmbg3
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Introducing kat: A TUI and rule-based rendering engine for Kubernetes manifests
I don't know about you, but one of my favorite tools in the Kubernetes ecosystem is [`k9s`](https://k9scli.io/). At work I have it open pretty much all of the time. After I started using it, I felt like my productivity skyrocketed, since anything you could want is just a few keystrokes away.
However, when it comes to rendering and validating manifests locally, I found myself frustrated with the existing tools (or lack thereof). For me, I found that working with manifest generators like `helm` or `kustomize` often involved a repetitive cycle: run a command, try to parse a huge amount of output to find some issue, make a change to the source, run the command again, and so on, losing context with each iteration.
So, I set out to build something that would make this process easier and more efficient. After a few months of work, I'm excited to introduce you to `kat`!
**Introducing** [`kat`](https://github.com/macropower/kat):
`kat` automatically invokes manifest generators like `helm` or `kustomize`, and provides a persistent, navigable view of rendered resources, with support for live reloading, integrated validation, and more. It is completely free and open-source, licensed under Apache 2.0.
It is made of two main components, which can be used together or independently:
1. A **rule-based engine** for automatically rendering and validating manifests
2. A **terminal UI** for browsing and debugging rendered Kubernetes manifests
Together, these deliver a seamless development experience that maintains context and focus while iterating on Helm charts, Kustomize overlays, and other manifest generators.
Notable features include:
* **Manifest Browsing**: Rather than outputting a single long stream of YAML, `kat` organizes the output into a browsable list structure. Navigate through any number of rendered resources using their group/kind/ns/name metadata.
* **Live Reload**: Just use the `-w` flag to automatically re-render when you modify source files, without losing your current position or context when the output changes. Any diffs are highlighted as well, so you can easily see what changed between renders.
* **Integrated Validation**: Run tools like `kubeconform`, `kyverno`, or custom validators automatically on rendered output through configurable hooks. Additionally, you can define custom "plugins", which function the same way as k9s plugins (i.e. commands invoked with a keybind).
* **Flexible Configuration**: `kat` allows you to define profiles for different manifest generators (like Helm, Kustomize, etc.). Profiles can be automatically selected based on output of CEL expressions, allowing `kat` to adapt to your project structure.
* **And Customization**: `kat` can be configured with your own keybindings, as well as [custom themes](https://github.com/MacroPower/kat/raw/v0.20.0/docs/assets/themes.gif)!
And more, but this post is already too long. :)
To conclude, `kat` solved my specific workflow problems when working with Kubernetes manifests locally. And while it may not be a perfect fit for everyone, I hope it can help others who find themselves in a similar situation.
If you're interested in giving `kat` a try, check out the repo here:
[https://github.com/macropower/kat](https://github.com/macropower/kat)
>I'd also love to hear your feedback! If you have any suggestions or issues, feel free to open an issue on GitHub, leave a comment, or send me a DM.
https://redd.it/1lzketl
@r_devops
I don't know about you, but one of my favorite tools in the Kubernetes ecosystem is [`k9s`](https://k9scli.io/). At work I have it open pretty much all of the time. After I started using it, I felt like my productivity skyrocketed, since anything you could want is just a few keystrokes away.
However, when it comes to rendering and validating manifests locally, I found myself frustrated with the existing tools (or lack thereof). For me, I found that working with manifest generators like `helm` or `kustomize` often involved a repetitive cycle: run a command, try to parse a huge amount of output to find some issue, make a change to the source, run the command again, and so on, losing context with each iteration.
So, I set out to build something that would make this process easier and more efficient. After a few months of work, I'm excited to introduce you to `kat`!
**Introducing** [`kat`](https://github.com/macropower/kat):
`kat` automatically invokes manifest generators like `helm` or `kustomize`, and provides a persistent, navigable view of rendered resources, with support for live reloading, integrated validation, and more. It is completely free and open-source, licensed under Apache 2.0.
It is made of two main components, which can be used together or independently:
1. A **rule-based engine** for automatically rendering and validating manifests
2. A **terminal UI** for browsing and debugging rendered Kubernetes manifests
Together, these deliver a seamless development experience that maintains context and focus while iterating on Helm charts, Kustomize overlays, and other manifest generators.
Notable features include:
* **Manifest Browsing**: Rather than outputting a single long stream of YAML, `kat` organizes the output into a browsable list structure. Navigate through any number of rendered resources using their group/kind/ns/name metadata.
* **Live Reload**: Just use the `-w` flag to automatically re-render when you modify source files, without losing your current position or context when the output changes. Any diffs are highlighted as well, so you can easily see what changed between renders.
* **Integrated Validation**: Run tools like `kubeconform`, `kyverno`, or custom validators automatically on rendered output through configurable hooks. Additionally, you can define custom "plugins", which function the same way as k9s plugins (i.e. commands invoked with a keybind).
* **Flexible Configuration**: `kat` allows you to define profiles for different manifest generators (like Helm, Kustomize, etc.). Profiles can be automatically selected based on output of CEL expressions, allowing `kat` to adapt to your project structure.
* **And Customization**: `kat` can be configured with your own keybindings, as well as [custom themes](https://github.com/MacroPower/kat/raw/v0.20.0/docs/assets/themes.gif)!
And more, but this post is already too long. :)
To conclude, `kat` solved my specific workflow problems when working with Kubernetes manifests locally. And while it may not be a perfect fit for everyone, I hope it can help others who find themselves in a similar situation.
If you're interested in giving `kat` a try, check out the repo here:
[https://github.com/macropower/kat](https://github.com/macropower/kat)
>I'd also love to hear your feedback! If you have any suggestions or issues, feel free to open an issue on GitHub, leave a comment, or send me a DM.
https://redd.it/1lzketl
@r_devops
k9scli.io
K9s - Manage Your Kubernetes Clusters In Style
K9s provides a terminal UI to interact with your Kubernetes clusters. The aim of this project is to make it easier to navigate, observe and manage your Kuber...
Final Year btech CS trying to do something with life.
I am a final year CS student with very basic knowledge of programming languages and no proper skills , everything i tried failed , now cloud devops caught my eye and i want to do this with my full dedication so that i can get atleast internship in upcomming 3 months and placement after that.
RN i am very confused with my life and i want to secure a placement and i dont want to let down my parents as they already spent lots of money in my studies.
please guide me to build my future, your guidance and tips be very much helpful:}
https://redd.it/1lzono4
@r_devops
I am a final year CS student with very basic knowledge of programming languages and no proper skills , everything i tried failed , now cloud devops caught my eye and i want to do this with my full dedication so that i can get atleast internship in upcomming 3 months and placement after that.
RN i am very confused with my life and i want to secure a placement and i dont want to let down my parents as they already spent lots of money in my studies.
please guide me to build my future, your guidance and tips be very much helpful:}
https://redd.it/1lzono4
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Are notifications a solved problem for DevOps?
I am a programmer who also does DevOps. Like many, I use GitHub, Datadog, Sentry, and other tools to keep development and deployment running smoothly. I've spent the last few years working on a notifications API (multi-channel, preference management, etc.), and I seek feedback on a product that re-imagines notifications from these products.
I've had a realization—most first-party notifications suck. GitHub is probably a prime example, but it's far from easy to configure SNS or Datadog notifications or to refine your resulting notifications. My ideal notification system would:
1. Accept web-hooks from services like GitHub, Datadog, and others, and provide a way to subscribe to notifications at different levels of granularities, with a way to opt out or tweak the frequency of notifications.
2. Use the git commit sha to tie notifications across services, thread them in topics, and notify the person responsible for the commit or deployment.
3. Update or archive any notifications that are no longer relevant - resolved incidents, error rates that have returned to normal, etc.
4. Offer a VSCode extension to show the most pressing notifications and send them to other channels (like Slack only if necessary). The extension also enables the user to switch to code or a terminal with the context needed to solve any issues.
I've always built tools based on my needs, but I'd sincerely appreciate any feedback, insights, or criticism of my ideas. One blind spot I have is my internal view of large engineering organizations. Are there any other pressing notification problems that current notification tools don't serve at larger organizations?
Thank you so much for your time!
https://redd.it/1lzmmgz
@r_devops
I am a programmer who also does DevOps. Like many, I use GitHub, Datadog, Sentry, and other tools to keep development and deployment running smoothly. I've spent the last few years working on a notifications API (multi-channel, preference management, etc.), and I seek feedback on a product that re-imagines notifications from these products.
I've had a realization—most first-party notifications suck. GitHub is probably a prime example, but it's far from easy to configure SNS or Datadog notifications or to refine your resulting notifications. My ideal notification system would:
1. Accept web-hooks from services like GitHub, Datadog, and others, and provide a way to subscribe to notifications at different levels of granularities, with a way to opt out or tweak the frequency of notifications.
2. Use the git commit sha to tie notifications across services, thread them in topics, and notify the person responsible for the commit or deployment.
3. Update or archive any notifications that are no longer relevant - resolved incidents, error rates that have returned to normal, etc.
4. Offer a VSCode extension to show the most pressing notifications and send them to other channels (like Slack only if necessary). The extension also enables the user to switch to code or a terminal with the context needed to solve any issues.
I've always built tools based on my needs, but I'd sincerely appreciate any feedback, insights, or criticism of my ideas. One blind spot I have is my internal view of large engineering organizations. Are there any other pressing notification problems that current notification tools don't serve at larger organizations?
Thank you so much for your time!
https://redd.it/1lzmmgz
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Image Migration
Hey So I am in bit of a situation were I am tasked to Replicate a build scale set on Azure.
So I have 2 Subscriptions. Subscription A has the Image I want.
Subscription B needs the build scale set.
I am not allowed to create a shared image gallery on azure but I want to Migrate that image from subscription A to Subscription B.
I tried GPT, It kept recommending the shared image gallery for this But I don't have the permissions to do that.
Only method it showed was converting to vhd and then uploading to storage account then on subscription B fetch it and create a VM etc.
Is there a way to safely create a VM atleast on subscriptions B using the image on subscriptions A. My account has contributor on the image.
https://redd.it/1lzs92w
@r_devops
Hey So I am in bit of a situation were I am tasked to Replicate a build scale set on Azure.
So I have 2 Subscriptions. Subscription A has the Image I want.
Subscription B needs the build scale set.
I am not allowed to create a shared image gallery on azure but I want to Migrate that image from subscription A to Subscription B.
I tried GPT, It kept recommending the shared image gallery for this But I don't have the permissions to do that.
Only method it showed was converting to vhd and then uploading to storage account then on subscription B fetch it and create a VM etc.
Is there a way to safely create a VM atleast on subscriptions B using the image on subscriptions A. My account has contributor on the image.
https://redd.it/1lzs92w
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Article on Quick ELK setup
Hi, I just published an article on medium. Lately I have been working on ELK at my firm and thought that I should explore it's setup on kubernetes.
Here's my article. Let me know your thoughts
https://medium.com/@joeldsouza28/one-minute-elk-stack-on-kubernetes-full-logging-setup-with-a-single-script-ba92aecb4379
https://redd.it/1lzu6pb
@r_devops
Hi, I just published an article on medium. Lately I have been working on ELK at my firm and thought that I should explore it's setup on kubernetes.
Here's my article. Let me know your thoughts
https://medium.com/@joeldsouza28/one-minute-elk-stack-on-kubernetes-full-logging-setup-with-a-single-script-ba92aecb4379
https://redd.it/1lzu6pb
@r_devops
Medium
One-Minute ELK Stack on Kubernetes — Full Logging Setup with a Single Script
🧠 Why ELK + Kubernetes?