What is a good way to manage 100-300+ microservices on multiple environments?

I am trying to find a good way to manage 100+ or even 300+ microservices on-prem k8s clusters that consist of deployments, services, configmaps, secrets, databases, load balancers and other configs and for now some of the good options that I can find are to:

\- Create a Helm Charts and combine multiple chars under one big Umbrella Chart - searching for good articles or experience with this

\- Manage different environments with Kustomize

\- Use Terraform for the deployments - but for some reason this seems to be very complex for management

Any advice, articles, guides or shared knowledge in managing a lot of services would be very appreciated.

Thanks!

https://redd.it/tnkwtd
@r_devops

Podman 4 still unusable on macOS

I'm macOS user which means I'm forced to use docker (we can argue but there's nothing better than docker for running multiple apps locally). I was really excited when podman 3 got released but excitement passed once I tried it. Long story short volumes were less than usable. With the release of podman 4 I got excited again. And again I hit the volumes wall. Is it me doing something wrong or is podman still not usable on macOS?

https://redd.it/tnncir
@r_devops

I got tired with AWS status pages. So I built my own

Here's the link.

It's open source if you want to make any suggestions

https://redd.it/tnoln3
@r_devops

Discussion: Who Should write the ci/cd pipEline (e.g. jenkinsfile)

I had a debate with a development team at my organization recently. It was regarding who should be responsible for writing and maintaining the Jenkinsfile that handled testing and deployment of the application they develop to test and prod environments.

Their stance was, "Ops should be responsible. Deployment is an ops task, ops should be responsible for it or we should hire someone external to our team who would be completely responsible for it."

My stance "The Dev team should be responsible. Most of the complexity in this pipeline is in the portions for deploying to dev environments and automated testing. Your team is and will continue to be the experts in that so moving the responsibility for defining those processes to an external position or team will only cause frustration and delay to your team."

I lost, and I realize I'm biased because I've always worked at smaller orgs where their wasn't a "DevOps" team and everyone wanted as much access to do as many things as we could so we would never have to wait on someone or give up control.

Given the different structures, sizes, processes and backgrounds we all have here I'd love to posit this to the group:

Who do you think should be responsible for defining and maintaining the CI/CD Pipeline? In general what factors do you think are the most important in driving that decision?

https://redd.it/tnwh2k
@r_devops

How to pivot into DevOps?

Hello,

I've been thinking a lot lately about my career, and I think I would like to move into software engineering; I have non-professional experience in the past on low-level video game development, and I have lots of professional experience with PowerShell/automating things.

I feel like it might be easier for me to make this transition by first pivoting into a DevOps role, as I would have more relevant experience to transition with. But I think most DevOps positions are focused on infrastructure

My work experience is isolated to Windows environments, and while I have several years experience of managing desktops (mostly) and servers, the last few years has been focused around Azure AD & Identity Management.

I'm currently spending some time working on some personal projects to build a portfolio and learn things on the coding side, but I'm wondering how much I'll need to spend learning infrastructure operations? Are there DevOps positions around Azure AD/IAM security?

https://redd.it/tnzhey
@r_devops

How do you test your Terraform+Python Code?

Hi y’all i’m trying to learn about devops and was curious how do you go about testing your terraform/python code before actually putting it up in production? Is it by unit testing or deploying the infrastructure locally?

https://redd.it/toe5i5
@r_devops

How do you send secrets to other people

As a devops engineer we also are in charge of creating various user accounts for people in the org. What is the best and most secure method to to send the passwords and other secrets to people? We have tried slacking them the username and email the password with encryption but that seems kind a hack and not sure how secure that is.

https://redd.it/tofkfs
@r_devops

How do you send secrets to other people

As a devops engineer we also are in charge of creating various user accounts for people in the org. What is the best and most secure method to to send the passwords and other secrets to people? We have tried slacking them the username and email the password with encryption but that seems kind a hack and not sure how secure that is.

https://redd.it/tofkfs
@r_devops

AWS SES is not sending emails to one particular domain, what might be the issue and how to solve it?

AWS SES sending mails to all domains except one which has an - (hyphen) in the domain name.

experiencing a strange error.

[UPDATE\]: the mail is going to only one email ID ([email protected]) other then that id its not going to any other email id on that domain.

https://redd.it/toh2ma
@r_devops

Creating a Grafana dashboard for a PoC

Hi, I'm not sure how easy or hard this topic. I recently moved from Monitoring dashboards and analysing kibana logs for day to day tockets, to a DevOps postion and altough I'm very eager to learn, I'm very much lost at the very first task at the work and feel ashamed to ask them very basic stuff and I don't know where to start.
The first task I've been given is to monitor the avalibilty of the poc, I'm suppose to create sample grafana dashboard for a white lable proof of concept that I cloned company's repo.

In the readme file on the cloned repository it's mentioned to create .env file on a desired package to run it but I don't understand how that works since it's my first time doing such a task.

Please advise me how to run the project and where to get data source so I can create sample dashboard for it.

https://redd.it/tot028
@r_devops

Typical tasks you do at your job?

I’m looking to move into devops in the future. I’m curious what are some typical tasks you do during the week that are related to more of the development side of devops?


I’m assuming it’s mostly scripting of some sort, but what types of scripts do y’all write?

https://redd.it/tp2da1
@r_devops

How much does a recruiter or their company get to place an FTE SWE, SRE etc?

​

Say a recruiter helps someone land a 200k DevOps job. What do they get on average?

I've used recruiters a few times and I honestly have no clue.

https://redd.it/tp6cp8
@r_devops

Questions about getting into DevOps.

I currently work as a SEO consultant and do a little react/js development more as a hobby.

But Recently I’ve been considering transitioning to something like DevOps since it seems to be very in demand and pay extremely well compared to my current career.

My questions are:

Is this a field worth getting into?
How difficult is it to get into this field?

Can you do it without a degree? In the case of SEO and even development, my experience has been that places will hire you without any degree as long as you can show you know what you’re doing.

Does anyone have any advice?

https://redd.it/tp8p2d
@r_devops

Expectations for a terraform interview test

I have an interview next week, part of it is a Terraform / Kube / Helm test. I'm ok with the Kube and Helm stuff, but I'm a bit rusty on my terraform (and I've not used native terraform for a while, its always been with terragrunt and scripts to improve DRY)

Any thoughts on things I should be revising? What sort of questions would you ask on a test? ( believe the test is going to be 'here's a terminal, do stuff' rather than a QA)

https://redd.it/tphaeq
@r_devops

How to find out a company is working in real devops culture

More than half of the job offers called "devops engineer" turn out to be an ops/monitoring engineer job or consultant where you are stuck on calls whole day. Most of the recrutiers or "architects" have no clue how company/project in devops culture works. How do you make sure, during an interview, that the job is really devops stuff and not something else. Do u ask interviewers any specific questions?

https://redd.it/tpmhtg
@r_devops

Static Code Analysis of a large code base in a Gitlab CI/CD pipeline

Hello, I am currently working on adding static code analysis (SCA) to a large code base of .c, .cpp, .h, and .hpp files. These files are placed in multiple subdirectories with their own CMakeLists.txt, where the files from the various subdirectories are connected and linked when building with CMAKE. How am I supposed to properly test all these files using SCA? As of now, I am using a python script to locate all files with the .c, .cpp, .h, and .hpp extensions, and then running cppcheck and flawfinder on each of the files separately. How can I just run these SCA tools once and all the files will be run instead of using a python script?

https://redd.it/tpoi49
@r_devops

I created a guide on how to build custom Windows 11 "golden" images for Azure Virtual Desktop using Packer. The build is automated by using a scheduled GitHub Actions workflow to check daily for new Windows releases and create a new image as soon as it's published

Hey /r/devops,

Over the past month I created a guide on how to build custom Windows 11 "golden" images for [Azure Virtual Desktop (AVD)](https://azure.microsoft.com/en-us/services/virtual-desktop/) using [Packer](https://www.packer.io/) and automate everything using [GitHub Actions (GHA)](https://github.com/features/actions).

[https://schnerring.net/blog/automate-building-custom-windows-images-for-azure-virtual-desktop-with-packer-and-github-actions/](https://schnerring.net/blog/automate-building-custom-windows-images-for-azure-virtual-desktop-with-packer-and-github-actions/)

Here's a quick overview:

* Resources required by Packer are pre-provisioned using [Terraform](https://www.terraform.io/)
* The Packer build uses [Chocolatey](https://chocolatey.org/) and a custom PowerShell script to provision software.
* The GHA workflow queries Azure daily for the latest Windows available Windows version and creates an image in case a new version was released by Microsoft (usually Patch Tuesday)

I'm happy how it turned out, especially the GHA part. For production use cases you probably want to flesh it out, but it's good enough to build upon.

The code is available on my GitHub: [https://github.com/schnerring/packer-windows-avd](https://github.com/schnerring/packer-windows-avd)

https://redd.it/tpscvi
@r_devops

Where do you all look to find remote jobs worth applying for

What is the best place to look for dev ops jobs. I am looking for 100% remote. And ideally it would be like a west coast hours company. I want to be choosy, and would prefer to do as much of that before wasting time talking to them. Thanks

https://redd.it/tpsve4
@r_devops

Job has 0 Infrastructure and I don't know where to start

So I'm a software developer, fairly little experience with DevOps. I've worked with Jenkins in a previous job and played with Docker with some home projects.

​

I just started a new job because the pay was a massive jump from what I was making. Then I started noticing some verbiage used by team members that raised some red flags.

​

"Let me grab the source code from x directory to somewhere where you can access it"

​

"I found some code for x app but the classes in the jars don't match. I thought this code was the most recent but I guess not"

​

"Sally can you build y environment for us to do some testing? Bob can you copy x database to y environment?"

​

2 weeks in and I realized just how bad it is. There is no infrastructure at all. There's like 10 different people to manually do so many different parts of tasks. To point 1, THEY AREN'T EVEN USING VERSION CONTROL. My first task has been "mitigate log4j and move projects into gitlab." For me to build, test, and deploy an app, I have to walk over to at least 5 people around the office to accomplish different parts.

​

So I have two choices here IMO. Bail after a month, or use this as an opportunity to really learn devops and build out this infrastructure from scratch. Is this place too far gone? Is building multiple pipelines for apps too big a task for a junior dev with little DevOps experience? We do have gitlab licensed (for years now, just nobody's done anything with it) so I could definitely use that for help, but I've never worked with it.

https://redd.it/tq9qjz
@r_devops

Canary Release on Kubernetes with Knative and Tekton

Learn how to prepare CI/CD pipelines for Spring Boot native compilation and perform canary release with Knative on Kubernetes:

https://piotrminkowski.com/2022/03/29/canary-release-on-kubernetes-with-knative-and-tekton/

https://redd.it/tqulza
@r_devops

Does Azure DevOps feels overwhelming compared to GitHub or GitLab?

Is it just me, or does Azure DevOps feels like a giant maze with thousands of options? Using GitHub or GitLab is a breeze compared to that, and they achieve the same thing.

Typical Microsoft bloat?

https://redd.it/tqvmsf
@r_devops