Jobnik: Open Source K8S jobs managing tool

Hello good folks! So happy to share with you a tool I developed working at Wix that will allow you an easy, Rest API based interface to trigger and monitor your Kubernetes Jobs.

The tool was designed for offloading long lasting processes from our microservices and allowed a cleaner and more focused business logic.

Suggestions, bugs and contributions are more than welcome!

https://github.com/wix-incubator/jobnik

https://redd.it/1jafzf8
@r_devops

CI/CD with TypeScript Instead of YAML (Open-source)

I've always struggled with the various declarative syntaxes other CI/CD platforms use, especially when I just want to focus on shipping my projects.

The goal of PandaCI is enable you to code advanced workflows with little more than a quick example. I've found that by just having a few functions (job, exec, etc), everything else can be done natively in the language. A few such examples are:

* Conditional jobs — Use standard if statements
* Matrix jobs — Just write a for loop
* Code reuse — Create functions or import shared code
* Parallel steps — Use Promise.all
* API integrations — Native fetch or import npm packages

I'd love to hear any feedback (harsh or otherwise)! Personally, It's been a big upgrade for my projects and I'm excited to see what the community makes of it.

🔗 Repo: [https://github.com/pandaci-com/pandaci](https://github.com/pandaci-com/pandaci)

🔗 Site: [https://pandaci.com](https://pandaci.com)

P.S. The core is language agnostic so let me know if there are any other languages you'd like to see

https://redd.it/1jagd5v
@r_devops

AWS Certificate Free Vouchers valid until August 2025


AWS is offering 100% free certification vouchers for select exams, valid until August 2025!

This is a great opportunity to expand your cloud expertise and earn industry-recognized certifications—at zero cost.

Eligible Certifications:

✅ Foundational: Cloud Practitioner, AI Practitioner

✅ Associate: Solutions Architect, SysOps Administrator, Developer, Data Engineer, Machine Learning Engineer

https://community.aws/content/2tm12rQPFomu2bKOP1rIWWtsAAx/opportunity-to-earn-free-aws-certification-vouchers

https://redd.it/1jadmd2
@r_devops

spot-optimizer

🚀 Just released: spot-optimizer - Fast AWS spot instance selection made easy!

No more guesswork—spot-optimizer makes data-driven spot instance selection super quick and efficient.

* ⚡ Blazing fast: 2.9ms average query time
* ✅ Reliable: 89% success rate
* 🌍 All regions supported with multiple optimization modes

Give it a spin:

* PyPI: [https://pypi.org/project/spot-optimizer/](https://pypi.org/project/spot-optimizer/)
* GitHub: [https://github.com/amarlearning/spot-optimizer](https://github.com/amarlearning/spot-optimizer)

Feedback welcome! 😎

https://redd.it/1jai3c3
@r_devops

Question about DB Seeding for local SAAS development and troubleshooting

Our production database is very large and it's untenable to periodically pull down and expect developers to import into their personal containerized databases. We have a slimmed down version that can be imported very quickly for setup/teardown but it exists as a single .sql file and is rarely updated. Our SAAS app is multi-tenant meaning all customer records are stored in the same tables segmented by a field called customer_id.

I have questions regarding maintaining that minimally viable data-set and also when troubleshooting specific situations (I'm not asking about structural changes or migrations):

1. Does your team employ a tool or automation to pull down a copy of production and trim it down for developers?
2. Is there a tool/automation for anonymizing PII and other sensitive data during this process?
3. For some tasks it would be helpful to cherry-pick records from production and pull down into development for troubleshooting, optimizations, etc - is there a tool that can assist with this?


For #3 it's often the case where developers will be working a problem that's difficult to recreate in dev because they're not working with the same data that's in production. In some cases this can mean pulling down 10k+ db rows from multiple tables. Doing this manually is time-consuming and often-times takes longer than the fix itself.

https://redd.it/1jam5qv
@r_devops

What are the basic tasks for a devops intern?

Got an internship through my university at a small company as a devops. I want to prepare for my work next week and wanted to know what basic tasks Im probably goin to do? What tasks should solve an unexperienced devops as an intern? What problems usually are given to someone who is starting his career as a devops-engineer?

Prerequisites for a job were:
- Basic exp with Linux + Docker
- Basic exp with relational db
- Some scripting knowledge (go / python / bash / c#)

I have an exp as a full-stack web-developer (js, node.js + MySQL) so I know concepts of creating web-applications and also have worked with docker.

At university we were studying devops and so far I have worked with:
- VMs, lots of labs I have done with Ubuntu
- Basic clusterization
- Basic ELK setup
- Basic Ansible setup
- Some labs with Nginx
- Some basic labs with troubleshooting

Overall I know concepts on which devops culture is based and after all this amount (not large) of experience I still think that maybe Im not ready so I want to be prepared. Can anyone give me some tips and tell me what Im going to face with? Thanks a lot in advance!





https://redd.it/1jao8j5
@r_devops

Did datadog disable logging for free accounts?

I have been using datadog for free for years for a small open source project, it was working yesterday. Today I was presented with a paywall saying:

The free plan currently doesn't provide in-app access to Log Management. Please contact [email protected].

I cant find any announcements, information or notifications on why this would happen. My APM, RUM and other services still work fine. What happened?

https://redd.it/1jao1hp
@r_devops

Entry level cloud project ideas?

Hello everyone, I just got my AWS solutions architect certification I am trying to create at least 3 cloud projects for me to put on my portfolio. Preferably a project that will make me grasp multiple services. I plan to create them on both AWS and azure since I also have the AZ-104. I would appreciate ideas especially from anyone who is experienced and/or probably a hiring manager because I want to start job hunting as soon as possible. I know this is more of a devops sub but I decided to post here cos there’s going to be an overlap in terms of the learning curve anyways.

Thank you for your assistance.

https://redd.it/1jaqi0c
@r_devops

Need some advice on what cert to get..

Ar a bit of a cross road...

I''m a seasoned backend developer (Java/C++/Python) and architect/devops currently serving as a tech lead. My organization has recently adopted AWS.

Throughout my career, I've prioritized building solutions that avoid locking clients into a single vendor. I've developed expertise in using cloud-agnostic approaches to address problems. For example, I rely on tools like K3s, Rancher, and Docker for implementations and deployment solutions.

However, my organization is now encouraging all of us to become AWS certified. I'm debating whether to focus on cloud-native certifications, such as the Kubernetes Application Developer certification, or to fully commit to AWS by pursuing certifications like AWS Developer or Solutions Architect.

So, my question is: What would you do—pursue cloud-native certifications or embrace AWS certifications?

https://redd.it/1javo72
@r_devops

🚀 Step-by-Step Guide: Install Apache Airflow on Kubernetes with Helm

Hey,

I just put together a comprehensive guide on installing Apache Airflow on Kubernetes using the Official Helm Chart. If you’ve been struggling with setting up Airflow or deciding between the Official vs. Community Helm Chart, this guide breaks it all down!

🔹 What’s Inside?
✅ Official vs. Community Airflow Helm Chart – Which one to choose?
✅ Step-by-step Airflow installation on Kubernetes
✅ Helm chart configuration & best practices
✅ Post-installation checks & troubleshooting

If you're deploying Airflow on K8s, this guide will help you get started quickly. Check it out and let me know if you have any questions! 👇

📖 Read here: https://bootvar.com/airflow-on-kubernetes/

Would love to hear your thoughts or any challenges you’ve faced with Airflow on Kubernetes! 🚀

https://redd.it/1jawekj
@r_devops

Run pipelines in the terminal.

#Pipelight is a cli/engine that runs pipelines inside the terminal.

pssst: it's foss 😏 and rust 😏

It has json AND pretty tree outputs so you can inspect every process outputs fairly quickly.🕵

Supports yaml, toml, hcl, javascript and some other languages.

Give it a shot, thk me later 😜

https://github.com/pipelight/pipelight

https://redd.it/1jaxeli
@r_devops

Favorite GitHub Actions

Hey, as the title suggests: what are you favorite GitHub Actions that you’re using a lot in your projects? Is there any that you think you’re using in a unique way?

For example, I like https://github.com/salsify/action-detect-and-tag-new-version. Base use case is to check whether new version of the application has been merged and if so, tag the repository accordingly. I’m using it, however, also to verify that the version was bumped by developers when in should be (source files of the related app modified in the PR). I’d say it’s a non-obvious use case I mentioned above.

Please share yours!

p.s. just in case: I’m not a creator of this GitHub Action, just enjoying using it 😅

https://redd.it/1jayyg0
@r_devops

How do you guys avoid getting stuck doing side quests?

I had to migrate some data the other day.

When I tried to access the db, my connection bounced even though I was connected to the VPN. While trying to fix it, I discovered that the AD server in charge of verifying user trying to authenticate the VPN was not configured correctly and had not been used in several years. So I had to spend half a day trying to get it working when I realised everyone else had basically been passing around the same certificate to login without bothering to use the AD server.

Ok no worries, I'll add it to the backlog. Except as I'm logging into the db, I notice that the security group for the VPN network has whitelisted every port meaning I'm able to touch any server in staging even if I'm on a public network. This is bad, so I burn the other half of the day chasing with people to see if we can start to close ports. I don't succeed but that's another ticket into the backlog. Ok logging into the db, nope the connection is going through but is immediately bouncing. This can't be because of the security group because that is the equivalent of a security guard that fell asleep in front of a door left wide open, can't be a firewall because RDS shouldn't have any firewalls.. or does it? Nope it doesn't.. do some more investigation and realise there are over 100 connections probing this stupid thing. I do some digging... Turns out there is a lambda that opens a connection and never bothers to close it once it's done meaning we have to wait for the connection to time out. Cool, let's close that connection at the end of the lambda execution except..? What if we have a db connection pool worker? Ok not a problem, another ticket into the backlog it goes.

Now it's been 1 week, my boss has no idea why this data migration is taking so long. When I try to explain to him what I'm doing, he stares at me like I'm speaking Chinese. I feel like am extremely busy and extremely unproductive at the same time. How do you guys deal with all these side quests?

https://redd.it/1jazxeo
@r_devops

How to Prepare for Apple DevOps Technical Interview i have 2 days left

Hello, I recently got invited for technical assessment for DevOps Engineer, i have 4 YOE working mostly with AWS,K8s, Prometheus, Grafana, GitOps, ArgoCD, Istio and i can also do scripting not good at DSA honestly.

Any help will be beneficial. Thanks

https://redd.it/1jb0c3e
@r_devops

Teaching DevOps? I’ve Got 5 Hours a Day to Help! :)

Since I'm a certified GCP Professional Cloud DevOps Engineer with solid experience in Cloud and DevOps,
and I just really enjoy teaching.

I’ve got 5 free hours every day, so instead of overengineering my dotfiles, I’d rather help people learn DevOps.

If you ever feel lost in the cloud, stuck in YAML hell, or just don’t know where to start, I can be your mentor. I’ll teach you everything from CI/CD, Docker, Kubernetes, and Terraform to scaling complex cloud projects.

I’d love to do it for free, but hey, even DevOps can’t automate rent payments.
So instead, let’s keep it affordable—just $6/week (which is probably less than the cost of fixing a failed deployment… and yeah, we’ve all been there!).
If you're interested :)





https://redd.it/1jb2nub
@r_devops

Does devops count as software engineering?

Hello, i am just curious. I entered college as a CS major but the program was canned at the beginning of covid, & i lost all my internships.

Now, i’m a CyberSecurity engineer & have been in IT for the last 2.5yrs.

Part of me wants to go back to my original passion of software development, but IT is what im good at and what ive been doing.

Is this a real path for me? Im thinking about getting back into coding and maybe applying for an internal opening at my current job.

https://redd.it/1jb6iwp
@r_devops

Need to learn advanced terraform

Hi all, i was given 3 months to sharpen my terraforn skills if i want to remain in the team, looking for advanced terraform resources, not the basic lessons for the certification path, but more real production schenarios, i would be thankfull if someone can propose me with some some mentorship or platform with online labs, thanks!

https://redd.it/1jb7iqt
@r_devops

What are you using for secrets management?

With IBM acquiring hashi, are you exploring alternatives? I’ve heard it’s hard to scale for enterprise and involves high cost. True?

Looking to explore options.

https://redd.it/1jb700s
@r_devops

Advice Needed: Internal Terraform Module Versioning

Hey everyone,

I’m working on setting up a versioning strategy for internal Terraform modules at my company. The goal is to use official AWS Terraform modules but wrap them in our own internal versions to enforce company policies—like making sure S3 buckets always have public access blocked. Lets say we want to use official s3 module , we create a new module in our org which still references the official module(not a fork), turn off few features (ex: disable public access) and provide filtered features for the application teams.

Right now, we’re thinking of using a four-part versioning system like this:

X.Y.Z-org.N

Where:

X.Y.Z matches the official AWS module version.
org.N tracks internal updates (like adding security features or disabling certain options).

For example:

If AWS releases `4.2.1` of the S3 module, we start with `4.2.1-org.1`.
If we later enforce encryption as default, we’d update to 4.2.1-org.2.
When AWS releases `4.3.0`, we sync with that and release `4.3.0-org.1`.

# How we’re implementing this:

Our internal module still references the official AWS module, so we’re not rewriting resources from scratch.
We track internal changes in a changelog (`CHANGELOG.md`) to document what’s different.
Teams using the module can pin versions like this:module "s3" { source = "git::https://our-repo.git//modules/s3" version = "\~> 4.2.1-org.0" }
Planning to use CI/CD pipelines to detect upstream module updates and automate version bumps.
Before releasing an update, we validate it using terraform validate, security scans (tfsec), and test deployments.

# Looking for advice on:

1. Does this versioning approach make sense? Or is there a better way to track internal changes while keeping in sync with AWS updates?
2. For those managing internal Terraform modules, what challenges have you faced?
3. How do you make sure teams upgrade safely without breaking their deployments?
4. Any tools or workflows that help track and sync upstream module updates?

https://redd.it/1jb9pvq
@r_devops

github actions for bumpversion and release automatic?

Hi, more often then not I want to:

- take last git tag matching v[0-9].[0-9].[0-9]
- bump major, minor or patch version
- sed "s/VERSION=.*/VERSION=$NEW_VERSION/" somefile.yml
- git add -A && git commit -m "bump version" && git push
- git tag "$NEW_VERSION" && git push --tags

And then from tag github actions pipeline I would want to:
- and this and that to artifacts
- make a github actions release from all the commits from the last release
- and add an artifact to that github actions

I would want the "bump" to be a manual github action, such incrementing version in a file, pushing new tag, creating new release is automated.

There are many small pieces in different places, many small actions that solve parts of the above problems, that I can pick up and stick together and write my own.

I wonder, maybe someone has ready-to-use showcase for me to see or recommendations how it's solved and how it's done with github-actions and what is the workflow here. Thank you.

https://redd.it/1jbbsrw
@r_devops

I saved 10+ of repetitive manual steps using just 4 GitHub Actions workflows

Hey, I wanted to share a small project I’ve been working on recently with you. It’s called „one branch to rule them all”. What I think will be the most interesting part for this community is the last part: https://www.toolongautomated.com/posts/2025/one-branch-to-rule-them-all-4.html

As part of this project, I’ve managed to automate multiple steps that previously had to be done manually over and over, every time the PR gets merged to trunk (or even on every commit in the PR when running unit tests).

It’s part of a larger design that lets users deploy a containerized application to multiple environments like staging or production conveniently.

I’ve made everything open source on GitHub, here’s the GitHub Actions workflow piece: https://github.com/toolongautomated/tutorial-1/tree/main/.github/workflows

What do you think about it from the automation/design perspective? What would you do differently or what do you think should be added?

https://redd.it/1jbajbr
@r_devops