Reddit DevOps
268 subscribers
1 photo
31K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
Docker course recommendation- 2024

Hi

I'm a python developer with aws cloud knowledge.

I got an opportunity to work as cloud engineer with more devops and less development.

This is an internal switch and my lead asked to get a grip on docker first and gradually move to k8s ( aws eks ) and others

Need your help in suggesting a udemy course for docker in 2024.

I have kodekloud subscription also. Kindly share a course link that covers everything related to docker.

TIA

https://redd.it/1dufdpq
@r_devops
Looking for advice of coaching staff

I’m a team leader of small group containing no more than 10 people. We had a new member joining team 3 months ago , who was just graduated.

I assigned multiple tasks for him, and none of them worked very well, he worked pretty slowly and seems to be very hard to understand my intention. I’m kind of frustrated coaching him, so I want you guys suggestion. I’ll introduce the tasks I assigned and what I saw.

Task 1: Upgrade grafana from 9.3 to 11.0

So I was imagining just backup data, edit image tag and done.

But actually he went to looking at the database difference between the two versions, trying to upgrade grafana and import the old database, hoping this would work.

Task 2: develop cloud controller manager, sync k8s tag to cloud provider

Cloud controller is an event handler for k8s resources, it listens changes of k8s manifest and do some change on cloud provider, so the simplest solution is on every change, sync the tags.

The problem is that the code he gives has no code reuse, say the resource would be created or updated, both would trigger a tag sync, the basic logic is identical but he did not reuse. He claims that the error handling is different so cannot be reused, but it’s written in Go and certainly we can create a function named sync_tag and return error if anything goes wrong wrong, call it in handlers , check the error and then handle the error gracefully.

Even after I told him the way to do that, it still took him half a day to implement it.


Task 3: replace ntp server and client from ntpd to chronyd

This task is quite straightforward, and he did it ok, writing puppet module, test.

But he cannot troubleshoot network issue, we had a few vm that has limited network access, on those machine time sync would fail, he did not find any way to troubleshoot network issue, at last I told him it might be iptables issue and finally he found it and fixed the issue.

So this is the experience of me coaching other staff, do you think there’s anything I can do to be a better coach?

https://redd.it/1duhlmb
@r_devops
Kubernetes cronjob for periodical Cloudflare backups

I've organized a Kubernetes cronjob to make periodical Cloudflare backups in Terraform format and saving them into your repo for easy and fast business continuity plan.

https://github.com/nullniverse/cloudcron

https://redd.it/1dugi7k
@r_devops
How do you manage Datadog integrations at scale?

We are rolling out Datadog but creating an ansible task to roll out each integration seems like a lot of toil. does anyone have any suggestions on how to manage this?

https://redd.it/1dulacy
@r_devops
Github Actions fails to find UnitTest.csproj

I'm currently trying to set up a GitHub actions such that when a PR is made to the developing branch, a series unit test runs on the PR. This is a dotnet application, and here is the dot.yml:

name: .NET


on:
push:
branches: [ "developing" ]
pull_request:
branches: [ "developing" ]


jobs:
build:


runs-on: windows-latest


steps:
- uses: actions/checkout@v4
- name: Setup .NET
uses: actions/setup-dotnet@v4
with:
dotnet-version: 8.0.x
- name: Restore dependencies
run: dotnet restore
- name: Build
run: dotnet build --no-restore
- name: Test
run: dotnet test --no-build --verbosity normal

Here is how the project is structured: [https://imgur.com/a/EW7YnoG](https://imgur.com/a/EW7YnoG)


When I test out the actions it fails, and I get the following message:

Run dotnet restore

C:\Program Files\dotnet\sdk\8.0.302\NuGet.targets(414,5): error MSB3202: The project file "D:\a\project\UnitTest\UnitTest.csproj" was not found. [D:\a\project\project\project.sln]

Error: Process completed with exit code 1.

I'm not sure how to resolve this, the UnitTest folder is in the project, and it is only in the developing branch, it is not in the Main branch. I have tried adding `run: dotnet restore CBAS/` but that didn't help. Searching online for solution told me that the file name could be too long, but I don't think that's the case with my project. When I run `dotnet restore` locally everything works. Any idea what I should do?

https://redd.it/1duie79
@r_devops
What can you do as a devops to help implement SOC2?

Have you ever been asked to make all the changes necessary to implement SOC2? I read about it and it doesn't seem like something developers or devops can do much about. The only thing I can think of is detecting vulnerabilities, creating unit and integration tests and that's it.

https://redd.it/1duovo9
@r_devops
How to store the value of a secret?

How are one off secrets actual values securely stored in IaC or how is everyone handling secrets and their values?

Normally for generated secrets you can use this example

resource "randompassword" "dbpassword" {
length = 16
special = true
}

resource "vaultgenericsecret" "dbpassword" {
path = "secret/db
password"

data = {
password = randompassword.dbpassword.result
}
}


But lets say there is a backup admin password that isn't automatically generated via IaC, maybe for a local app the team created.

Tried searching for this answer, no luck

https://redd.it/1duq1un
@r_devops
Does devops do front end and backend codes?

3 months into this job. Realize I'm being push to do code debug with the same pay scale.

We are talking about ui with react, nodejs with backend. I was doing infra setup


https://redd.it/1dush44
@r_devops
Q about TTS application

Hi everyone I'm curious how easy it is to make an tts app for mobile's with new voices models that can read articles from the web and epubs_pdf files? And how can i find a developer to work with on this project
i know nothing about this field and I'm not even a developer
Thanks

https://redd.it/1duvyoe
@r_devops
Just surpassed 1,000 applications. Results: 2 interviews, 0 follow-ups. Where do I go from here?

I've been applying to relevant jobs in my country (non-US) and to any possible remote jobs abroad. And by relevant jobs, I mean I filter LinkedIn using keywords and boolean expressions so the jobs are catered to my skillset. Here are my results.

I really don't know what to do anymore. Am I lacking something as an entry-level applicant in this job market? Is there a particular set of skills that may boost my profile? I'm currently learning Kubernetes, but I don't know if that will change anything job-wise. I don't want to list it on my resume yet until I feel I could pass the CKA exam, so that may take a while. Is there something else worth learning that is easy to pick up on and may help garner the interest of a recruiter or get past the ATS system? (and speaking of ATS, in case you're wondering, I made sure my resume is parseable)

I would have done a master's abroad by now just to get access to another country's job market, but because of inflation, my local currency savings basically cut in half in the last year or so, meaning I only have $5k to my name, just about enough to feed myself and get by for the time being.

https://redd.it/1dv242i
@r_devops
Career progression

I've been stumped on what my career progression should look like to eventually reach a position in DevSecOps.

3yrs Help Desk
~6 yrs (Networking) (Army)
CompTIA Security+
AAS in Network Administration
BSc in Cyber Security (graduating early 2025)

I am currently in the military as a 25H (Network systems specialist) and I have one year left on my contract. I've been self-learning Python in my free time and will start my journey getting AWS certs. (Cloud pract. > Cloud Dev > DevOps Eng > Sec spec.)

I also thought about picking up the LPIC 1&2 certs (later on LPIC 3 Security). I do have a decent amount of experience in Linux.

My main question is what do I do for experience, work-wise? Should I start with a Linux Administrator or Cloud Engineer position then pivot into DevOps then to DevSecOps? Or should I start on the Cyber Security side first? ie, SOC Analyst into Cloud Security Engineer then DevSecOps.

If anyone in the field can provide some insight to help me align my path, that would be great. I'm sure there isn't only one way to make it in, but given my starting point how would you continue.


I can apply for training at Microsoft before I get out. The MSSA program is for veterans. They have 3 options and I was going to choose the CAD option. Cloud Application Development

Concepts include application programming using C#, data structures and algorithms, developing client applications with .NET MAUI as well as cloud development using Azure.

Or should I choose the CSO option?
Cyber Security Operations.

Topics include Windows core server and security infrastructure, Microsoft Azure administration and Endpoint management, and security technologies and operations.

https://redd.it/1dv382f
@r_devops
Small change delivery

I am researching options to deploy boto3 scripts in AWS and scripts in azure to make minor ec2/vm changes. Our customer environments are developed in TF. Unfortunately another team handles the template creation. We should be using TF to make these changes, but it's not an option. We use keycloak to authenticate and yubikey code to authenticate again.

One option is to create a gitlab pipeline to deploy all changes. I am trying to help improve the culture from "just getting into the console and make the change fast thinking."

What does everyone recommend to deploy scripts considering the authentication requirements?

https://redd.it/1dvcj3y
@r_devops
How are you currently understanding your engineering output?

Hey Devs!

I am an engineering manager at a big tech company and am currently running a 30 person team. The problem here is that I often find it difficult to understand the engineering estimates and hence, actual output of my engineers. Daily stand-ups do not work as these are still estimates and I feel I have a bad control over my resources.

To all CTOs, Engineering Managers/leads, do you feel the same? How are you controlling and managing your teams and how effective has it been? Love to discuss!

https://redd.it/1dvih78
@r_devops
How do you guys handle database migrations and devops stuff?

What approaches do you use to manage database schema changes? How is your DevOps pipeline structured to guarantee comprehensive code testing and automated deployments? What are the strategies you adopt to ensure minimal deployment failures and high-quality code reaching production?

https://redd.it/1dvnwew
@r_devops
Rant: I regret every single moment being in DevOps

Working as a DevOps Architect, started my career a decade back. But every single day I regret if I could go and change anything is to work as a Dev than be in Ops. Worked in several companies as Sysops, PlatOps, SRE. At the end of the day it boils down to the same shit. I can go and write code all day ling than working on shitty YAMLs or some random scripts for automation. The irony is I’m very successful in my current job but deep inside I always hared it. Everyday I need to push myself hard to console myself that u need to do it to get the fat pay cheque at the month end. So anyone who is truly passionate about building stuffs focus on being a dev than a DevOps engineer. Don’t pay the heed to those random advices there is plenty of provisions of automations where u can leverage your coding skills. Trust except few really big orgs there is hardly any. Btw writing those stupid YAML is not coding. It’s always better to start as a Dev and then later move to Cloud Architect or similar roles than do otherwise. In most cases DevOps team budget come from Dev so u are always at their mercy. On top of that On-calls, releases will make your like miserable as crap.

https://redd.it/1dvqvtt
@r_devops
I'm genuinely interested what is the architecture behind managed DBs

Hey guys,


So the title says it all, I am just genuinely interested how server giants do the architecture behind managed DBs(SQL, PgSQL, Redis, etc...)

The reason I am asking is because I am curios to know how do they do it? I assume it is a server that has several virtual machines inside it connected on a public ip for each VM, and each VM is an isolated database, in other words, you cannot SSH into it but each VM contains a DB.

Now some of the providers provide the DB engine and then they provide storage, I also assume that they connect the volume to the engine and from there we proceed to start connecting and working on the DB.

As for failovers, I assume the replicate the DB on a second-by-second basis, or even on every transaction that happens to the DB, but with now the storage being isolated, I guess the DB engine just writes on several disks for replication.

And all that, with a 1GB RAM DB and some 25 SSD storage for 17$/month, so I guess the profit from these technologies is not 100%, it is at least at least 1000%.


Thank you so much for reading my post.

https://redd.it/1dvu0cu
@r_devops
Automating Cloud Infrastructure Incident Response with Runbooks | Open-Source Tools

I've been working with cloud infrastructure for the past 15 years and as new trends come and go, DNS and certificates rotation still remains nr 1 source of middle-of-the-night PagerDuty calls.

There are of course other issues and automating the incident response and resolution steps in runbooks is a no-brainer. However doing so in an automated way without using a proprietary 3rd party system is not as intuitive.

In a recent video I'm showing one possible way of automating runbooks execution with just open source tools.

https://youtu.be/iJS5cFOXcos

How are you automating your incident response process?

https://redd.it/1dvv7uk
@r_devops
Securely Accessing AWS Services from Anywhere with IAM Roles Anywhere

Accessing AWS services securely from anywhere can be a challenge, but a new AWS feature called IAM Roles Anywhere makes it much easier. In my latest blog post, I dive into how IAM Roles Anywhere works and how you can use it to:

• Securely connect to AWS services from any device or location
• Eliminate the need for long-term AWS credentials
• Simplify authentication and authorization for remote access

Check out the full post to learn more about this powerful new AWS capability and how it can benefit your organization:

https://dcgmechanics.medium.com/securely-accessing-aws-services-from-anywhere-with-iam-roles-anywhere-2d61d37eee1f

Any kind of feedback is appreciated!

https://redd.it/1dvwftm
@r_devops