How are you handling failed CI triage these days?

Half my week can disappear into failed CI runs.

Usually the painful part is not the fix. It is finding the real error inside thousands of log lines and giving someone enough context to act on it.

I ended up making a small pipeline check for this.

It runs at the end of CI and outputs:

\- likely cause
\- evidence
\- suggested fix
\- confidence level
\- health/security/audit checks

It does not change code, rerun builds, or auto-fix anything.

Example GitHub Actions step if anyone wants context:

- name: Badgr Pipeline Check
uses: michaelmanly/badgr-ci@v1
if: always()


Curious how other teams handle failed CI triage. Still manual log digging, or have you automated any of it?

https://redd.it/1um4z35
@r_devops

TikTok Business Messaging API access for Spain / EU: is it currently available?

Hi everyone,

I’m trying to clarify whether TikTok’s Business Messaging API is currently available for businesses registered in Spain / the European Union.

My goal is to automate replies to TikTok DMs and integrate the messaging flow directly with our own internal system. We already have a verified TikTok Business Center, but I’m not looking to use a third-party inbox or chatbot provider if it can be avoided. Ideally, I’d like to request access to the API and build the implementation myself.

From what I’ve found, TikTok does have a Business Messaging API, but I’ve also seen some mentions that it may not be available for EEA / EU accounts. Does anyone know if this is currently possible for a Spanish business account?

Also, just in case: has anyone found a third-party provider that can legally and reliably offer TikTok DM automation in Spain / the EU? I assume access is restricted, but I’d like to confirm.

Thanks in advance.

https://redd.it/1umbjgf
@r_devops

Help needed just migrated the environment

I have recently migrated the production environment on the new cluster version 1.36. And i want to install the cluster autoscaler in it. But the cluster autoscaler has latest version of 1.35. what should i do now ?

Should i install the cluster autoscaler with version 1.35 inside the eks 1.36 ??

https://redd.it/1umcww0
@r_devops

Learning budget

I'm a full-stack web dev with 3 YOE trying to migrate into devops.

So, I'm collaborating with a friend who is building a mobile app with node server, SQL db and I'm responsible for the infrastructure.

I'd like to try stuff like github actions, docker, managed db service, storage, load balancer, testing environment and so on.

My first instinct was to pick AWS as our cloud service because it's the most popular and probably looks best on resume, I guess?

But in reality, this app probably won't be profitable and mostly be used by us, and I imagine AWS popularity comes with a price.

Should I stick with AWS and make the app less complicated? maybe less known cloud service which won't cost us much as long as traffic is low?

Would love to hear some opinions, thanks!

https://redd.it/1uminm5
@r_devops

Be careful where you paste JWTs during debugging

Something came up in a code review this week that made me realize how easy this mistake is to make.

A teammate was investigating an auth issue and pasted a **production** access token into the first JWT decoder that showed up in Google. The token still had about 50 minutes before it expired.

>It reminded me of something that's easy to overlook:

A JWT payload is just Base64URL-encoded JSON, but the **entire token is still a bearer credential**. Anyone with a valid token can generally use it until it expires (or it's revoked).


Some online JWT tools work entirely in your browser, while others provide features like signature verification or key management that may involve sending data to a backend. From the UI alone, it's often hard to tell exactly what happens with your token.



Our team's rule now is pretty simple:

* Decode locally whenever possible (jq + a shell one-liner is usually enough).
* If using a web UI, open DevTools → Network first and verify that nothing is sent when you paste a token.
* If a production token was pasted into a service you don't fully trust, rotate it rather than assuming it's fine.

Personally I usually use the CLI, but I also built a browser-only decoder because I wanted something visual without sending tokens anywhere


I'm curious what everyone else uses. Pure CLI? Browser tools? IDE extensions? Any workflows you've found that keep production credentials off third-party services?



https://redd.it/1umr6d4
@r_devops

Lyzr Ai and Accenture bring Agentic Ai in Insurance and banking
https://redd.it/1umygbe
@r_devops

Whats the market value now? How much you are making now?

I have 6 + years of devops experience. 3 years in monitoring and 3+ in devops domain. Preset CTC is 13LPA. I'm planning to switch now, just curious what could be the package I might get or ask?

https://redd.it/1un32nl
@r_devops

How To practice DevOps

Hi, so I'm in my last year of university.I started my journey as a backend engineer, back in when I was in college.I always wanted to move to DevOps but didn't move because I thought I should have knowledge about the architecture and different concepts related to it like databases, networking,System design etc.After learning and practicing these concepts, I move towards learning famously used tools like docker, kubernetes,aws,terraform.

Now I want to do projects, not the ones where i build architecture on aws and post on LinkedIn.I want to do projects which teaches me real life job problems like how to handle deployments, where to look when things goes wrong,cost optimization etc.I believe that, these skills will make me standout as a DevOps engineer.

So I want to ask everyone how did you practice this DevOps stuff ??

https://redd.it/1unbsci
@r_devops

Which countries pay DevOps Engineers, SREs, and Forward Deployed Engineers the best?

I'm curious about where these roles are most popular and well compensated.

Which countries offer the highest salaries for DevOps, SRE, and Forward Deployed Engineers?
Where is the demand strongest?
Are Forward Deployed Engineer roles mostly concentrated in the US, or are they common elsewhere as well?
How do compensation and work-life balance compare across regions?

Would love to hear from people working in different countries and companies.

I often see many SRE and DevOps roles globally, but Forward Deployed Engineer positions seem much rarer. I'm wondering whether that's because they're concentrated in specific countries or mostly found in certain types of companies.

If possible, please mention:

Country/region
Role (DevOps, SRE, FDE, etc.)
Years of experience
Company type (startup, product company, consulting, FAANG, enterprise)
Approximate salary range (if comfortable sharing)
Work-life balance and on-call expectations

More details would help everyone understand the differences better. Thanks!

https://redd.it/1unfk0l
@r_devops

DevOps engineers who freelance: How did you get your first client?

I'm curious how experienced DevOps engineers got started with freelancing or part-time consulting.

I currently work full-time as a DevOps engineer and have experience with AWS, Kubernetes, Terraform, Docker, Linux, CI/CD, monitoring, and cloud infrastructure. I'm not looking for job offers here—I want to understand how people successfully transitioned into freelance work.

Some questions I have:

How did you land your first client?
Did you use Upwork, Toptal, LinkedIn, personal networking, or something else?
What services were easiest to sell when starting out?
Did you build a portfolio, blog, GitHub projects, or open-source contributions first?
How did you decide your hourly rate?
What mistakes should someone avoid when starting?

I'd really appreciate hearing about your experiences and what worked for you. Thanks!

https://redd.it/1unru10
@r_devops

How much coding is needed for devops?

Python / Bash scripting is enough right?

No need to focus on objected oriented code like a software dev.

https://redd.it/1untbc8
@r_devops

Built a multi-agent Sast Scanner
https://redd.it/1unweqe
@r_devops

Best way to restrict AWS/Cloudflare app to specific desktops?

Best way to restrict AWS/Cloudflare app to specific desktops?

We are building a fee payment application for a school organization.

**Stack:** DB/Backend on AWS and frontend on Cloudflare.

**The challenge:** We need to restrict payment work flow used by cashiers to specific systems, while the read fees access should be able to be accessed from anywhere.

The desktops are unmanaged, regular PCs, residing in different branches in different cities. They are all connected via standard consumer ISPs (no static IPs, no company intranet).

As we are already using Cloudflare, is this something that can be achieved with Cloudflare Zero Trust free tier?

I have never worked with this restriction before, SO I am open to any suggestions. And as this is a very low budget project, I'm looking for something that costs as less as possible (Preferably free).

https://redd.it/1unyxz6
@r_devops

Engineering managers: how do you prevent valuable Slack discussions from disappearing

In my team I notice senior engineers write detailed explanations in Slack, but months later nobody can find them. Curious how others solve this.

https://redd.it/1unvlkj
@r_devops

Has anyone successfully made the jump from SDET to platform engineer from a Tier 1 company?

Hi everyone,

I’m currently an SDET (exp 1 year, total exp 2 years) at a Tier 1 tech company and I’m planning my move into a platform engineer role. I love building tools and want to be closer to product development and feature ownership.

For those who have successfully made this pivot:

Did you find it easier to transfer internally or interview elsewhere?

How did you bridge the gap in System Design if your daily work was focused on automation frameworks?

What was the single most helpful thing you did to prove you were ready?

Appreciate any insights or "traps" to avoid!

https://redd.it/1uo12qx
@r_devops

Reticle - The infrastructure diagram you can operate.

Hi all. I made a (OSS+MIT) tool called Reticle which is an infrastructure diagramming tool, but it uses your host ssh/kconf credentials to access the real running state of your actual system.

It has configurable cron health probes to determine whether your resources are green in realtime, and even gives you access to a terminal on a box for quick fixes without switching to another app.

It feels like a fresh way to get a health overview, and if something is broken, the context/dependencies is immediately obvious.

There's more features like team collaboration and professional PDF export, but I'm really curious whether r/devops (the experts in this space), find it interesting or useful.

So if there's any feedback I'd be incredibly grateful. Thank you.


reticle.live

https://redd.it/1uo6bkc
@r_devops

Leaving K8s platform engineering for an internal dev-tooling/CI-CD role

I am currently building a central "Cluster-as-a-Service" platform nd deal with automated cluster provisioning, multi-tenant setup, observability work, kubernetes security etc. I also contribute upstream to K8s-sigs. The company I work for is rather unknown and I would love to be at a bigger brand with a real engineering culture. (I have gotten a few faang interviews in the last month, but declined one myself and did not get more offers).

I now have an offer at a well-known fintech where I would work on owning CI/CD pipeline templates (GitHub Actions/Jenkins), and some more terraform templates plus policy work. Dev teams manage their own infra/CI-CD day-to-day, the team has no direct Kubernetes/Linux/scaling ownership and everything's serverless. However it is a well-known tech brand and I would get 35% more salary (which bumps my salary to slightly above market, not much tho).


My worry: My long-term goal is deep infra/platform roles (K8s internals, distributed systems, SRE-adjacent work). I'm concerned 1-2 years here erodes my skills in that area and I navigate myself into a build tooling and devex niche? What is your take on that move? Would I limit myself too much or can I easily move back to infra platform work later, i.e., would owning CI/CD/tooling be seen as equivalent experience to K8s internals, distributed systems, and observability work when I try to move back later?

https://redd.it/1uoatjd
@r_devops

When does an on-premises server become cheaper than AWS, Azure, or a VPS?

Everyone talks about moving to the cloud, but is it always the right choice?

For a small business with stable workloads (website, email, file storage, backups, internal apps), does buying a server once and running it for 5–7 years make more financial sense than paying cloud bills every month?

I'm also thinking from a business perspective. If you were starting a business today with a small budget, what service would you offer that brings recurring monthly income?

I'd love to hear real experiences from people who run infrastructure or do businesses from home network not just theory or marketing.

https://redd.it/1uobn4g
@r_devops

GitLab CI skill for ai agents based on official docs

I use ai agents as helper I talk to, not for blind vibecoding. One thing I kept noticing is asking agent to write or refactor gitlab ci pipeline, and results are often questionable. It creates a god yaml, outdated keywords, no thought about debugging or developer experience.

I looked for existing skills but did not find anything I would actually trust, most looked generated in one shot. So I spent some time and made my own. Used agent help of course, but went through everything myself and checked it against official docs for GitLab 18+

It covers pipeline structure and refactoring, bash in ci jobs, pipelines and other common patterns, debugging failed pipelines, readable logs and naming and many other cases

https://github.com/beeyev/skills/

Works with claude code and anything supporting skills format
I have been using it privately for couple of month and improving constantly, maybe it will useful for someone else too

https://redd.it/1uoab35
@r_devops

How are you handling query rewrites and schema changes in production databases?

I'm curious how teams are dealing with query performance over time as applications evolve.

A few questions I'd love to hear your experience on:

\\- How do you identify queries that need to be rewritten?

\\- How do you ensure schema changes (indexes, partitions, column changes, etc.) don't negatively impact production?

\\- Is this mostly a manual process, or do you use any tools to analyze query patterns and recommend improvements?

\\- Have you ever had an outage or major performance issue because a query or schema change wasn't optimized?

I'm exploring this space and trying to understand whether this is a pain point worth solving. I'd really appreciate hearing about your workflows, the tools you use, and what's still frustrating today.

https://redd.it/1uoewbr
@r_devops