Reddit DevOps
274 subscribers
66 photos
32.1K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
Need help with ansible and drone ci pipeline

This is probably a low level issue for a lot of you but im kinda stuck on this.

Im using Drone as my CI/CD to deploy a binary to a server, I have a ansible repo for deployment. The process is as follows for now (this is just temporary since im building a deployment and goes only to staging):

push to development > builds binary > names it binary_git_short_sha > deploy it to server with command

ansible-playbook -i .ansible/inventory -e "binary_name=${BINARY} " --limit staging .ansible/playbook.yml

BINARY variable has the value of the binary name, but when i call it in drone pipeline in a step i get binary_name= in the -e variables. If i replaced the ${BINARY} with lets say ${DRONE_BRANCH} that is an environment variable set by drone at the start of the pipeline the value is there it would be binary_name=development but any time i define a variable by hand it does not work. Ive tried even running a bash script that would define the variables and pass them to the ansible command and run it all inside the script but the source would be the same and the result would be the same as well.

I tested it in the docker container itself on my machine, the entire process and it does work but in drone ci it does not. Feel like im losing my mind a bit.

edit: edited formatting a bit

https://redd.it/1gfzdi2
@r_devops
How to write a production ready code in Python " Clean Architecture focuses"

How to write a production ready code in Python

Clean Architecture focuses on separating the software system into layers with strict boundaries, enhancing maintainability and testability. The core idea is to keep the business logic (or domain logic) independent from the external factors like databases, UI, and frameworks.

I just published Clean Architecture exaplme python and PostgreSQL 
https://medium.com/@rasvihostings/clean-architecture-exaplme-python-and-postgresql-59a95bcf8d56
This example illustrates how to implement Clean Architecture in a Python
\#Python \#fastapi \#cleancode \#CleanArchitecture

https://redd.it/1gg5ri3
@r_devops
Data Platform Strategy

So as part of our DevOps culture we moved to "Platform Engineering" we started to deploy tools for dev Teams and find ways for devs to easily deploy "directly" related infrastructure for their apps, etc.

However we are kinda struggling with the data scientists (and science people since we have a reseach branch in the company) They need tools such as juperhub, Argo Workflows, mlflow, etc

I understand this to be part of the company platform, however I wonder if there are other strategies with separate teams specifically for data engineering.

Until now we have considered data engineering as a separate responsibility, however there is no real ownership because of lack of resources, and even if it's not our strength I'm starting to think the only way is to integrate it with the Platform Team.

What do you think?

Which strategies you use in your companies?

Thanks

https://redd.it/1gg8pe5
@r_devops
Is development important for a Mid-Senior DevOps Job position?

I am currently working as an Azure Cloud Engineer with one year of experience, and prior to that, I worked as a Network Engineer for two years. I would like to know if development knowledge is essential for landing a Senior DevOps role, and whether I should consider learning web development for this purpose. I am already familiar with common DevOps tools such as Docker, Kubernetes, Terraform, Git, basic CI/CD, Python scripting, and I have cloud experience.

I'm unsure if I should further strengthen my skills with these tools or focus on learning web development to enhance my chances for a DevOps position. Since I am already working as a Cloud Engineer, I am aiming for mid-to-senior DevOps roles rather than junior positions. Could someone advise accordingly?

https://redd.it/1gfo328
@r_devops
Best static code analyzer for my android app's CI/CD pipeline?

Currently I'm using github actions ci/cd platform for: lint, ui/unit tests and packaging. I want to add static code analysis - SonarQube wa my first go-to but it turns out they are free only for public repositories. Looking for a good alternative

https://redd.it/1ggd9ck
@r_devops
Which books ?

I'm a senior devOps eng and wondering how I could improve my skill set.
I know how to learn technical stuff when it needs, but as I'm over 45 now, I think about "manage" a team. Maybe just a tech lead role would be great.
In that purpose, do you know books that could help me ?
Thx 🙏

https://redd.it/1gge1fa
@r_devops
Are there any free GitHub Actions for security scanning in private repos?

We currently have Checkmarx integrated with Actions with SAST and SCA scanning, but I was looking for some other tools like OSSF Scorecard and harden-runner and both are requires licensing for private repos. Do you guys have any other recommendations?

https://redd.it/1ggehw8
@r_devops
Organizing IaC by resource type

Does anyone else hate this and think it's an anti-pattern? For instance (assuming AWS Terraform):

- iam_roles.tf
- iam_policies.tf
- kms_keys.tf
- rds.tf


To me, this pattern isn't helpful since I'm almost always more interested in the "whole thing" and don't want to go through a bunch of individual files to figure out how the database is configured. I usually set things up like

- database.tf


then stick all the related resources like roles/policies/keys in the same file.

However, it seems like "organize by resource type" is a pretty pervasive pattern.

https://redd.it/1ggftwk
@r_devops
KEDA: Using metrics from OTEL collector for scaling

Any fellow KEDA users here? 🙋 Jirka just dropped a blog on a new OTEL Scaler for KEDA, which lets you go straight to OTEL for scaling metrics—no Prometheus server required. Setup’s pretty easy, and it’s perfect for those of us dealing with workloads that need instant scaling (AI/ML, web traffic spikes, etc.).

Worth a read if you’re looking to optimize your setup: https://kedify.io/resources/blog/using-otel-collector-with-keda?utm\_source=reddit&utm\_medium=social&utm\_campaign=blog\_post

https://redd.it/1gggvnn
@r_devops
Using Postman without sharing any data?

Hi everyone,

Firstly, I come up to this thread in the forum if you wanna check: Does Postman collect and store sensitive data such as API keys?

In our company, they decided to not use the Postman (and insomnia) but the problem is I absolutely love Postman and all it's features for simple testing. Right now we are allowed to use Bruno but to be honest i come up to several bugs that effected my performance. I personally opened many issues in their github page after my problems and I definitely support them.

What I'm wondering, is it possible to use the Postman with no data share whatsoever?

https://redd.it/1ggicrp
@r_devops
Senior Devops salaries UK

Senior Devops Engineer on 65k London. Fully remote, however I go in maybe 4 times a year for certain events.
Maybe the markets getting better recently but it seems that Seniors around 70k+

https://redd.it/1ggkzlu
@r_devops
cfgmgmtcamp talks are closing in just a couple hours!

it's coming down to the wire! Only a couple hours left. If you haven't got your #cfgmgmtcamp talks submitted, go do it NOW! https://cfp.cfgmgmtcamp.org/ghent2025/cfp

https://redd.it/1ggpeon
@r_devops
cheaper New Relic and datadog alternatives for Tracing/apm/profiling

Our datadog bill is starting to get a little long in the tooth for web APM purposes. We use datadog for web APM because we need insight into site code for PHP, asp.dotnet, node, and python. Specifically when the code is having issues to be able to trace the calls to figure out where the issue is.

For logging we use elastic and we're happy with that. Metrics are nice but that's not what we use DD for. So if it can't do traces it's automatically a non-starter.

We also use the database APM feature as well which has been super helpful across mysql, postgres, and mssql work loads and tying web apm traces to db traces.

What else is out there?

https://redd.it/1ggjc61
@r_devops
Tuning a CICD pipeline to less than 60 seconds

I got a bit pissed that my CICD pipeline was taking so long so I tuned it down to about 60 seconds.

Once I got it working on my side project on GitHub I did similar for my day job on GitLab.

Here’s a writeup of the general techniques I used. I’m mildly convinced this can work for most app builds and deploys that don’t involve running a bunch of terraform that has to wait on infrastructure.

Linting, security scanning, and building all in about a minute, in case anyone is interested:

https://mzfit.app/blog/the_one_where_i_tune_my_cdcd_pipeline/

https://redd.it/1ggst63
@r_devops
Another FREE Workshop? Oh yeah! Building Dev-Friendly IaC with OpenTofu

A couple of months back, we launched a 10-week OpenTofu workshop that saw over 320 signups, and I’m grateful for everyone who’s been sticking with us each week. Seeing the feedback and demand, we’re excited to roll out a new workshop.

This time, it’s about creating IaC that actually supports developers without forcing them to wade through endless configs and ops-land details.

In this 4-hour hands-on session, we’ll cover principles like convention over configuration and explore practical ways to cut the config chaos, so devs can stay focused on their core work, while ops keeps infrastructure sane.

Expect practical patterns for building IaC with defaults, preset scenarios, and abstractions that align with how developers actually need to work - not tools that pile more work on them.

Same as before: Slack cohort, Q&A, hands-on lab.

Register here. Limited spots, and I mean it this time! LOL last time I didn't put a cap on it and we got way to many people. Keeping it to 100 seats for my hairline's sake!

https://redd.it/1ggrcrc
@r_devops
Interview preparations tips

I will schedule an interview for a staff SRE role at GMC. I don’t know what are the things that I have to prepare for the interview. I have searched, and it seems like they don’t have a standard interview process that varies according to location and roles. 

Anybody faced GMC staff-level roles Site reliability engineer?

https://redd.it/1ggtz60
@r_devops
Deployments still suck, but maybe they don’t have to

Found this interesting blog post about why deployments are still painful in 2024. The author breaks down how deploying even a basic Rails app to AWS requires wrestling with Docker, ECR, ECS, load balancers, security groups, and more DevOps complexity. They contrast this with Heroku's revolutionary "git push" simplicity from 2007, and discuss newer PaaS alternatives like Fly.io and Railway.app. While these platforms work well for standard apps, they can become limiting for specialized needs. The post highlights some promising developments, like Cased's branch deployment system, and suggests that Vercel's success in frontend deployments points to a future where we might have more integrated, opinionated platforms that handle everything from CI/CD to monitoring without requiring developers to piece together multiple tools.

https://www.blacksmith.sh/blog/deployments-still-suck-but-maybe-they-dont-have-to

https://redd.it/1gh11ue
@r_devops
How important is peer review?

I'm currently working in an environment that I'm not really used to. Peer review has always just been a normal part of the way I've worked in all my previous teams. Often it's in the form of PRs, but it can just be general feedback on something you've designed or built.

In this team I'm working in though, it's just not a thing they seem to do. From their perspective, they've just got a task to do and they just do it. As long as it works, that's all that really matters. In a recent meeting, a colleague of mine said flatly that he doesn't want to review other people's work. He says he's got other things he'd rather be doing and that he trusts our ability.

I don't agree with his point at all. The point isn't about trust, it's about encouraging each other to think critically about implementation, to knowledge share and to prevent siloing. But curious to hear what the rest of you think.

https://redd.it/1gh30un
@r_devops
I built a tool to track GitHub Actions costs - looking for early users & feedback

Hey folks! Over the past few months, I've been building BuildBudget - a tool to help teams understand and optimize their GitHub Actions spending. The problem hit close to home when our team's CI/CD costs started climbing and we couldn't easily figure out which workflows were the main contributors.

What it does right now:

* Shows your top 100 most time-consuming workflows and jobs
* Breaks down usage by repo, org, workflow, or job
* Calculates costs for GitHub-hosted runners
* Compares what you'd pay using AWS CodeBuild instead

It's pretty bare bones at the moment, but it works. I'm sharing it early because I want to shape its development based on real feedback from other engineers dealing with CI/CD costs. Check it out at [buildbudget.dev](https://buildbudget.dev) \- it's free during beta, and setup takes less than a minute if you're using GitHub.com. It's also available for teams using GitHub Enterprise Server, via webhook.

I'd really appreciate your thoughts on:

* What other cost insights would be useful?
* Which CI/CD cost problems are you struggling with?
* What would make this actually valuable for your team?

Happy to answer any questions!

https://redd.it/1gh434z
@r_devops