Log quota and rate limiting

Hey folks, want to see how others have tackled this problem.

Right now we use EKS and Datadog is our observability provider. Logs are collected by vector acting as logging agent, they send data to Datadog via some vpc peering connection.

The problem we have is Datadog is ungodly expensive, and log costs are out of control. What I would like to be able to do is set log quotas per service before they reach Datadog, since filtering them there imputes the ingestion cost.

I have thought about deploying vector as an aggregator to take advantage of it's throttling capability, but with multiple replicas and multiple clusters, it is hard to actually apply a global quota to a service (IIUC this throttling would only be per vector pod)

At a past job we built a custom rate limit service but afaik vector doesn't have an easy to use mechanism that would support calling a service like that even if we did build one.

Curious how others have tackled this problem with similar infra, because our logging costs need to be reined in but we want to do so with an easy lever for teams to increase when they have a good reason or organic growth.

https://redd.it/1ijbthg
@r_devops

Is there a tool to manage multiple contexts for credentials?

I have multiple customers who has multiple environments - aws, azure, various k8s clusters. Is there a convenient tool to switch context all at once like kubectx but to switch with aws/azure/ssh crends and multiple ENV variables? Currently I am just using custom bash scripts + mac os terminal profiles to reset it, it feels kinda hacky and a hassle.

What are you using for it? Vagrant?

https://redd.it/1ijh4hw
@r_devops

About IT intership

Hello, in just over a month I have an entrance exam to an IT company for student internships, where if I am accepted and I do well, I may receive a job offer as a junior administrator. I found out that the entrance exam will be on Linux + cloud basics (I think something was said about AWS, because at the end it is possible to take a certificate). My question is, what should I do to actually pass this exam well? In college, I had some basics of Linux and configuration, etc., but my knowledge is very unorganized. Hence the question, what exactly to do? Should I start taking courses or maybe some VM projects? where and how to best use this month to learn as much as possible about Linux and the basics of the cloud to make it happen? I will be grateful for any help.

https://redd.it/1ijhwsl
@r_devops

My journey to gradual automation for DevOps workflows

Hi everyone!

I’ve been exploring an idea around gradual automation for DevOps workflows and wanted to share a small open-source tool I’ve been working on.

The concept is inspired by Do-Nothing Scripting - where instead of going straight to full automation, you start with a structured manual workflow and automate steps gradually over time. The goal is to bridge the gap between fully manual and fully automated processes while keeping things flexible and easy to modify.

This is still super early POC, and I’d love to get feedback from others who deal with ops workflows daily:

* Do you think gradual automation is useful in your work?
* What tools do you currently use for something like this? (e.g., Bash, Ansible, Rundeck, internal scripts, other?)
* What would make this more valuable for you?

I don’t want to reinvent the wheel- I just think there’s a gap in how we transition from manual steps to automation, and I’d love to hear if this resonates with anyone else.

Check out the idea and let me know your thoughts: [https://github.com/StencilFrame/autopilot/blob/main/docs/IDEA.md](https://github.com/StencilFrame/autopilot/blob/main/docs/IDEA.md)

Would love to hear your feedback!

https://redd.it/1ijmfn0
@r_devops

How does your company track & manage software spending(Cloud & Beyond)? Looking for insights to build something better!

Hey everyone!


My company currently uses Google Sheets to track all our tool/software spending across teams, but I'm thinking of building a dedicated solution for this. Before I dive in, I'd love to learn from your experiences:


* What tools are you using to track and budget software spending? (SaaS or open source)
* What features do you find essential in managing tool expenses?
* What are your biggest pain points with your current system?

Would really appreciate insights from companies of any size - whether you're using spreadsheets, dedicated software, or custom solutions. Your experience could help shape a better tool for everyone!
Looking forward to your suggestions and experiences!

https://redd.it/1ijmv5a
@r_devops

Why so hard to geht a DevOps Job

Hello, I have been working in Germany as a system administrator for 5 years.
I taught myself the following technologies:
Kubernetes (CKA) Certified
Linux Certified
Azure AZ-104 Certified
Terraform
Ansible
Gitlab/Jenkins
CI/CD pipelines


I know all of these technologies and can't get a job in Germany in DevOps.
I'm desperate.
Does anyone have a tip for me?

https://redd.it/1ijphnn
@r_devops

Devops dream scenario

I am starting a new job soon - a job where I might have to start looking at some devops.

We have always used Jenkins the places I have worked, but I saw some people in here mention that they wouldn't use Jenkins if they could pick whatever.

So in order to gain some inspiration and start reading about things. If you were to setup the best CI/CD pipeline, what tools would you use? It has to be git and it has to be Openshift. But what would you have in between?

We used Octopus the place I worked. That seemed pretty great.

https://redd.it/1ijqckn
@r_devops

Did I get bait-and-switched? Stuck in a role I didn't sign up for—should I stick it out or move on?

About 6 months ago, I applied for a role at a Fortune 500 company. The job description was basically a software engineer with DevOps tools—think AWS, Terraform, Docker, and scripting. The interview process felt standard for tech roles, similar to what I went through with companies like Amazon. One odd thing, though, was that each interview round involved the same 2–3 hiring managers in the call.

I got the job, and it checked a lot of my boxes: solid salary, good benefits, and a chance to get real-world experience. It’s my first full-time corporate job, and since I already had a 1-year gap after graduating, I thought I lucked out.

2 weeks into the job, where I didn’t do anything and didn’t even have access to my laptop yet, things got weird. My original manager told me I’d be working under a the other hiring manager for the first 6 months. To me this seemed fine—I just needed experience. But when I transitioned, the new manager told me something different. Apparently, the job was posted under the original manager’s name because he had the resources to open a vacancy, but he didn’t actually need anyone. My current manager needed someone, so he pulled some strings with the help of the original manager to get me on his team instead.

The original manager said it would just be for 6 months, but my current manager told me when I initially transferred to to him that I would working with him moving forward.

At the time, I shrugged it off, thinking, “Experience is experience, right?” But fast forward 6 months, and I’ve realized that what I’m doing is far from what was in the job description. It’s about 70% Power Automate, SharePoint, and Power Apps, and only 30% Cloud work with Azure Functions and scripting, let alone DevOps.

Here’s the real problem: I have zero interest in these Microsoft tools, and they were never part of my skills, experience or career goals before applying. My background is in Linux, AWS, Terraform, and Docker—none of which I’m using now. Since I haven’t bothered to learn Power Automate or SharePoint, every task assigned to me takes longer than usual, and it’s honestly burning me out.

I want to sharpen my cloud and coding skills, but with how long these tasks take me, I’m barely finding time. At most, I think I can get 2 hours a day before bed to work on the skills I actually care about. And that’s on a good day where I don’t have much work to do.

So, here’s my dilemma. Do I…:

1. Stick it out for another 6 months to hit that 1-year mark on my resume and then start looking for a new role, either within the company or outside.

2. Contact the original manager (haven’t talked to him in months) and ask if the plan is still for me to move back to his team now that 6 months have gone by—or if I’ve been abandoned here for good. This would entail going behind my current manager’s back though.

3. Quit with 6 months experience only and focus on full-time study to rebuild and sharpen my cloud/DevOps skills and then search for a new job.

I’m torn because I don’t want to burn bridges or waste time, but I also don’t want to lose the skills I’ve worked so hard to build. What would you do in my situation?

TL;DR: Hired for a DevOps role, but after 2 weeks, was moved to another team doing mostly Power Automate and SharePoint. Not what I signed up for, and now I’m stuck deciding whether to stick it out for 1 year's experience or quit and refocus on my cloud/DevOps career. What would you do?

https://redd.it/1ijqhzt
@r_devops

What actually cuts costs in the cloud: Challenging team dynamics and driving cultural shift

Hey r/devops (and anyone drowning in cloud bills!)

Long-time lurker here, I've seen a lot of startups struggle with cloud costs.

The usual advice is "rightsize your instances," "optimize your storage," which is all valid.
But I've found the biggest savings often come from addressing something less tangible: team dynamics.

"Ok what is he talking about?"

A while back, I worked with a SaaS startup growing fast. They were bleeding cash on AWS(surprise eh) and everyone assumed it was just inefficient coding or poorly configured databases.

Turns out, the real issue was this:

* Engineers were afraid to delete unused resources because they weren't sure who owned them or if they'd break something.
* Deployments were so slow (25 minutes!) that nobody wanted to make small, incremental changes. They'd batch up huge releases, which made debugging a nightmare and discouraged experimentation.
* No one felt truly responsible for cost optimization, so it fell through the cracks.

So, what did we do? Yes, we optimized instances and storage. But more importantly, we:

1. Implemented clear ownership: Every resource had a designated owner and a documented lifecycle. No more orphaned EC2 instances.
2. Automated the shit out of deployments: Cut deployment times to under 10 minutes. Smaller, more frequent deployments meant less risk and faster feedback loops.
3. Fostered a “cost-conscious" culture: We started tracking cloud costs as a team, celebrating cost-saving initiatives in slack, and encouraging everyone to think about efficiency.

The result?

They slashed their cloud bill by 40% in a matter of weeks. The technical optimizations were important, but the cultural shift was what really moved the needle.

Food for thought: Are your cloud costs primarily a technical problem or a team/process problem? I'm curious to hear your experiences!

https://redd.it/1ijrmmv
@r_devops

Switch job for more salary but boring techstack?

Hey guys

I am currently working as a DevOps engineer with a somewhat modern techstack  (Kubernetes, Git, Gitlab, Ansible, AWS, Python, RHEL, Podman etc.) We are responsible for a specific product (which is pretty boring TBH) and I’m there to automate the software development processes.

Now I had the chance to interview for a new position which would bump me up to senior level and would come with a salary increase.

At first I was pretty convinced of the position but then I started to have doubts. Mainly because the Techstack does not include Kubernetes which I’m pretty bummed about. I would also have to get familiar with specific Microsoft products mainly in the Endpoint Security space.

What do you guys think? Is it worth switching for a higher salary and to get a more senior role (where I would also have to mentor some of the junior guys and “market” our team to the business to get more visibility etc.) but would have to deal with the fact that they don’t use Kubernetes and would have to dive deeper into more proprietary tools/software?

https://redd.it/1ijuqc0
@r_devops

Identity and Access Management (IAM): A Deep Dive in AWS Resources & Best Practices to Adopt

an article on AWS IAM best practices (concepts like least privilege, avoiding long-lived access keys, and keeping policies clean)

https://www.anyshift.io/blog/a-deep-dive-in-aws-resources-best-practices-to-adopt-identity-and-access-management-(iam))

https://redd.it/1ijxw76
@r_devops

Need advice/help

Can anyone explain me what devops is and what exactly devops engineer do?? And what advice as an engineer you’d give to a newbie or anyone who want to start devops!!

https://redd.it/1ijy16x
@r_devops

what are the better alternatives to sonarqube that you use currently?

Hey r/DevOps,

Most of our codebase is in JavaScript, TypeScript, and React, and we're currently looking for alternatives to SonarQube.

Does anyone have experience with AI tools that can help with static code analysis, code quality checks, and security vulnerability scanning for these languages?

Would love to hear what’s worked for you and if any new + reliable AI tools can take up the task!

https://redd.it/1ik11bs
@r_devops

Getting Nothing But Automated Rejection Emails. Roast My Resume!

I got my current role as a contractor on a state project shortly after a reduction in workforce at my last startup as a Site Reliability Engineer, and was looking to stay afloat rather than looking for the perfect place. I'm happy with the mission in my role, but very unhappy with the fact that I get no PTO, no holidays, and health insurance that's more expensive than what I can get through the state insurance portal, all that in addition to the organization going through a bunch of half-baked structural changes wherein we've been given a technical demotion. We were all hired as senior devops engineers, now we're all "platform engineers", so they essentially stripped us all of our senior titles, introduced new "senior" roles that don't have job descriptions and told us all to talk to our managers if we want those roles. That was months ago and no one as of yet has gotten a promotion.

Another small note, I have experience from 2014-2017 as customer facing desktop support for a large consumer technology retailer. Is that experience worth putting on my resume?

That being said, I'm starting to look elsewhere, but have not gotten any traction getting interviews, leading me to think of three possibilities:
1. My resume sucks
2. I don't have enough coding experience?
3. Everyone else in the market has longer tenure in their roles, leading to me being seen as a "job hopper"

\#3 seems possible but seeing as the only way around that is to stick it out in this tough spot for another few years, I'm hopeful that I'm somehow missing something in my resume, or something I can focus on learning to improve my odds.

For reference, the jobs I'm applying for are all Senior, Team Lead, Manager, or Staff level software engineering roles with "infrastructure" "platform" "devops" "kubernetes" in the title.

This is my sanitized resume: https://imgur.com/a/xut1KEB

I'm very grateful in advance for any feedback!

https://redd.it/1ik36u7
@r_devops

Built an open-source tool to find orphaned Kubernetes resources – would love feedback!

Hey folks,

I’ve been working on **Orphan Resource Collector (ORC)**—an **open-source** tool that helps detect orphaned resources in Kubernetes clusters. Things like unused PVs, orphaned Services, Ingresses and etc.

It’s super simple to use:

* Install a **lightweight agent** in your cluster (Helm chart available).
* It scans for orphaned resources and **sends findings to a dashboard**.
* You get a clear view of **what’s lingering in your cluster**—no API access needed.

Right now, ORC **only detects** orphaned resources (deletion is coming soon). You can **self-host it** or use the **SaaS version** to connect your cluster in less than a minute.

Would love any feedback - does this sound useful? Anything you’d want it to do differently?

Repo: [**https://github.com/origranot/orc**](https://github.com/origranot/orc)
SaaS: [**https://getorc.com**](https://getorc.com/)

Appreciate any thoughts! 😊



https://redd.it/1ik6geo
@r_devops

History lane Operations in 2000s: Opsware and Loudcloud

Does anyone remember how these two companies worked in the early 2000s? From what I understand Opsware was basically our Ansible, and Loudcloud our current AWS/GCP/Azure.

But how did Opsware work, does anyone know? Was it scripts in C, was it YAML? How were the 2000s?


https://redd.it/1ik8vbu
@r_devops

Why Golang?

Hey people! I am new to the DevOps space and cloud in general and I am from world of Javascript. I have seen multiple posts on reddit, linkedin, x, etc. Why do people start there journey with Golang as scripting language ? Even KodeKloud's DevOps path recommends learning Golang, for me as a final year student and not a job in hand should I give time learning Golang? And if so how can I do it? Thankyou all!

https://redd.it/1ikecbd
@r_devops

Homelab Ideas for Learning DevOps

So im currently going through KodeKlouds devops path, but I feel like it would be useful to do some sort of "homelab" type things to learn just general DevOps/SysAdmin.

However I am not sure where to start, I have decent just computer knowledge (I work as an SDET/Automation Architect) and i've been re-brushing up on my Linux fundamentals. I've been focusing on Docker/Kubernetes mainly right now.

One thing I am going to do is develop a very simple app to work on and attempt to take it through the docker-->kubernetes--->Helm/deployment just to get used to all that.

But as far as useful homelab idea's im honestly just not super knowledge on that. My networking knowledge is probably my weakest area (Am going to go for Network+ at some point but im focusing on Docker right now)

Really just kind of looking for ideas. Thanks! Some ideas I have I've posted below:

Self Hosted Gitlab Instance (To practice with deployment of the above webapp)
Plex Server/NAS (Not sure if on same Unit, maybe a Synology or R-pi
Home Assistant (Currently running on a raspberry pi 5
Other stuff (pfsense? some sort of firewalls?) I've thought about getting some Ubiquiti stuff since im wanting to get some of their cameras anyways

https://redd.it/1ikh4kv
@r_devops

Advice and Resume Roast

Hello all, i would appreciate if you can all give me some advice. I am trying to break into Devops, Sysadmin or similar roles.

I have years of experience as a web developer (PHP, MEAN Stack) and managing Ubuntu web servers on platforms including AWS, but no formal DevOps experience.

To break into Devops, i acquired Comptia A+, AWS CCP and Sysops certifications recently. I have also made demos to show possible employers. Demos are mainly of Terraform and Ansible.

Resume (one page for ATS): https://drive.google.com/file/d/1eFTnJmbau

Demos: https://github.com/umarbkh/AWSdemos

I am not sure what else i can do other than certifications and demos, every job post requiring a senior experienced professional is very discouraging and i feel like i wasted my time and effort. I have applied to hundreds of postings on Linkedin and directly, not a single interview.

https://redd.it/1ikikc4
@r_devops

Is the CKA Certification Worth It?

I am a student pursuing engineering in AI and currently in my final year. I love working with servers, exploring different distributions, Linux, and IT-related technologies. I have been preparing for a DevOps role, and now I have secured an internship as a DevOps Engineer at a very small startup.

However, my boss suggested that I go for the CKA (Certified Kubernetes Administrator) certification. I realized that preparing for this certification will take almost six months, and it is quite expensive.

So, my question is: If I focus on the CKA certification instead of grinding DSA coding questions for a decent job, will it be worth it?

https://redd.it/1ikjk2c
@r_devops

Wanting to switch to Devops

Hello,

I’m 28 and currently working remotely as a Cloud Engineer. While the job pays decently, it doesn’t match the income I was accustomed to from contracting overseas, though I understand those numbers are harder to achieve in the U.S.

In my free time, I day trade, which brings in a solid side income. However, I feel like I’m not progressing in my career and want to transition into DevOps. I started self-studying Docker last week and have a beginner-level understanding of it so far.

I’d appreciate any insight and guidance on how to break into a DevOps role and what skills I should focus on learning.


https://redd.it/1ikjto8
@r_devops