GitOps Repos Structure

Hi,
I have question regarding the best structure for the GitOps architecture.

1. We want to manage K8s configuration with GitOps
2. We want to deploy all of our 70 small applications via GitOps to single GKE cluster
3. We do not use Kustomization, only simple manifest since our Apps out quite simple.
4. Each app has its own separate Git Repo for source code.
5. We have two environments (dev/prod)

Guys, what is the best approach for setting up GitOps for it?

1. Monorepo for all GitOps?
- two folders for env (dev/prod)
- each separate folder for specific app
- root folder for common k8s configuration (like, quotas, rbac, etc)

Thanks to that I can only setup one GitSource for the whole cluster on /dev env. But I will have around 120 folders in the GitOps monorepo.


2. Place folder for GitOps in the App GitOps Source Code where people will publish theirs Manifests?

.. what else can be done?

Thanks :)




https://redd.it/1caium0
@r_devops

The Journey of Code to Production

Wrote a blog post that should be interesting for junior developers curious about Ops side of things. I reflect on my journey developing Java code and learning to deploy it through Containers, Kubernetes and ArgoCD. The aim is to gain high level understanding of why these tools exist and why you should know them without going into details. Hope you find this encouraging! Feedback welcome.

https://itnext.io/the-journey-of-code-to-production-588990234b78?sk=c72c63f2a53c9c27c10f875c7330cdc2 (friend link)

https://redd.it/1camkgk
@r_devops

this CV right here didn't get ANY responses

Hi,

Long time lurker here. Was wondering why this CV:

https://imgur.com/a/KAvNdpN

was not getting any responses (phone interviews or normal interviews) for these positions being applied for:

Junior Devops Engineer

Junior AWS Engineer

Junior Cloud Engineer

AWS Cloud Engineer

Cloud Engineer

Cloud Support Engineer

Background is in IT Support and recently in AWS. Am I being pigeonholed into Windows Support roles since that is my background? Or do I just lack an official cloud role on my CV? My actual interest is in AWS/Linux roles that involve automation and Terraform. I wanted to know what your thoughts are if you have experienced something like this in the past.

If you see any mistakes on this resume, please can you advise and I am getting tired of looking at it and have become blind to any glaring mistakes it may have.

Thanks

https://redd.it/1caly4y
@r_devops

Infra or code issue ?

How do you guys debug network issues ? Lost packets, cdn issues, dns caches on various levels, not closing connections properly etc.

You have devs coming with „Its infra issue my app cant even handle a retry”, how do you cope with it and not start throwing slurs?

https://redd.it/1cal2ec
@r_devops

Port Forward Transition from SPDY to WebSockets in Kubernetes 1.30

https://kftray.app/blog/posts/4-kubernetes-spdy-to-websockets-kep

https://redd.it/1caqen7
@r_devops

Devops role moving to software engineering

So I’m in the job market for a new devops position. While looking I noticed that there’s not as much devops role. It seems to be mostly software engineering role with the expectation of doing devops work as well. As someone that is coming from an infrastructure background I’m a little worried that I might not be able to transition to a software engineering role if it comes down to it.

Is anyone else seeing this trend and if so what are your thoughts on it?

https://redd.it/1caqedn
@r_devops

How much programming do you have to know as a devops or site rliability engineer? Do you have to read documentation of APIs as much as a software engineer or not at all?

Do you have to know different frameworks with different programming languages?

Is it mostly scripting as far as programming goes? Is it more of like a system administrator role than software engineer? Thanks.

https://redd.it/1cavsln
@r_devops

Recomendations for a backend deployment

Hi.

im developing a backend with python and Django, the reason for choose this options, well simple i just have more expereince using Django and DRF(Django REST Framework). Im not a seasoned developer by any means, my only experiences deploying a backedn is in the free tier that Render . com offers.

so here is a little context about the project.

I need to call an external API to get some data, but i need do it using a long polling aproach,so i'll need to set up a task that will repeat around maybe every 5 seconds that makes a request to the API, then i will filter some stuff form the body of the response and store this data(probably in a cache, because of the fast access) so that way when the client makes a resuqest to my DRF endpoint i will return this data(the one in the cache) that i have saved from the previus request made to the external API. As right now i only need one task for a single espesific endpoint of the external API, but this could increase to around 4 or 5 task that will do something similar but for diferent enpoints of the same external API.

so the solution that i have come to for this is the following one:

the retpeted task that i mentioned before will be execute using celery and celery beat.

I will have 3 machines: one for the Django server, one for redis and one that will run the celery workers. this because in this way the repeted tasks of making the requests to the external API wont take any CPU or memory from the server that will by runing Django. And i will also have a DB, postgres in this case.

So the thing will work like this, the celery worker will make the requests to the external API, then after filtering the response the resulting data will be store in the redis cache; Then when i client makes a request to my django server(the endpoint i mentioned before) the sever will have to validate an API key that the client has, then the django server will just look for the the value that the celery worker has previusly store in the cache and then take this value and return it to the client.

Right now im thinking about of deploying this in must of the stuff in aws, like this:

AWS ElastiCache for the redis machine
An EC2 instance for the machine that will run the celery workers
I was thinking on using AWS app runnner instead of and EC2 for the django server, this because from i have read is similar to what deploying on render . com is
for the DB i was thinking initially to use Render . com, since is a bit cheaper at the beginig and also includes the backups and then maybe if the DB grows mirgrating into AWS RDS

So what do you guys think of this, is this a good way to sstructure my backend for this problem?
shouuld i structure the cloud set up in a different way?
should i use a different cloud provider?
Any tips or tricks that you now that my be helpfull ?

thanks a lot for your help guys.

https://redd.it/1caxdku
@r_devops

Is CodiumAI or GitHub copilot worth it?

The vscode extension requires a subscription after 30 days. To those who have a subscription, does copilot worth the 10$/month subscription?

Every service needs a 10$/month subscription, and it quickly adds up.

https://redd.it/1cayerp
@r_devops

What are the biggest challenges you /team faced while adopting a CI/CD tool ?

We are in discussion of finalizing circle ci but wanted to understand how difficult it is to adopt a new platform/tool and what are the initial or late challenges ?

https://redd.it/1cb26j5
@r_devops

Suggestion for topics for tech talk session. Something fundamental but missed by most people

I was suppose to give a tech talk on some devops topic. I am looking a fundamental topic/process but somehow not being followed or missed by many people. I want it to be useful session please help

https://redd.it/1cb28y8
@r_devops

How to enable HTTPS on a python app.

Hey guys,

i have a python app running using python `app.py` in a azure VM .
the app is accessible at https://<public-ip>:3000

I want to run it on https://<public-ip>:3000 or https://<azure-dns>:3000
can someone help and suggest how can I achieve it.

https://redd.it/1cb4bp1
@r_devops

An Opinionated Guide to Managing Observability Pipelines

Observability data, when left on its own, behaves like entropy - it increases without bounds (until you run out of money). Observability pipelines help organizations take control of their data and limit volume before sending it upstream to vendors.

https://bit.kevinslin.com/p/an-opinionated-guide-to-managing

https://redd.it/1cb60ez
@r_devops

Imposter syndrome kickin my ass

I was made redundant this year and finally got an offer. Its near 2x my previous salary which is making me feel like a FRAUD. I have never used K8s before at work but part of their interview process was troubleshooting k8 clusters and fixing it. I guess they liked how I approached it considering it was the SRE team watching me do this the whole time but idk.

Its probably been asked so many times but how the hell can i get this feeling out. I genuinely don’t feel like im THAT good but how can i basically not embarrass myself. I have like 2 and 1/2 years DevOps experience so not that much


https://redd.it/1cb6aob
@r_devops

How do you handle feature flags in production ?

Feature flags are very interesting when you want to enable/disable a feature for everyone or a specific set of users in deployed applications.

How do you handle them in your applications/infra ?

* Environment variables ?
* SaaS (PostHog, Flagsmith, etc.) ?
* Self hosted open source solution (Flagsmith, etc.) ?
* Harcoded ?
* App database (Like a settings/parameters table) ?

Also, when was the last time you had to disable a feature flag in emergency because a feature deployed to production had flaws ?

https://redd.it/1cb3g46
@r_devops

Coroot 1.0 – simplified open source observability for modern environments

Exciting news – Coroot 1.0 has arrived! As DevOps practitioners, reliable monitoring tools are essential.

Coroot 1.0 offers a simple, comprehensive view of environments, supporting Kubernetes, VMs, and cloud services. It's easily deployable with technologies like eBPF and Netlink, gathering crucial information without complex setups. Additionally, it provides actionable insights without overwhelming users.

We're fostering a community and value feedback from users of all experience levels. Join us in shaping Coroot's development.


Check out our features overview and our repo on GitHub.

https://redd.it/1cbb8f7
@r_devops

What is the interesting AI GPT project for DevOps/Platform Engineering team?

Do you have any project working for AI just for internal purposes within your DevOps/Platform team? Please share with us.

https://redd.it/1cbceut
@r_devops

The more HashiCorp shares pictures in front of NASDAQ the worse their products will become

just saying.

after some posts of their CTO and their team in front of the stock exchange this only goes one way. down the shitter.


I work for a Fortune 500 corp and the law of average products ramps up really high once you go public

https://redd.it/1cbelva
@r_devops

IBM nearing deal for cloud software provider HashiCorp, source says

April 23 (Reuters) - International Business Machines (IBM.N), opens new tab is nearing a deal to buy cloud software provider HashiCorp (HCP.O), opens new tab, according to a person familiar with the matter.
Source https://www.reuters.com/markets/deals/ibm-nearing-buyout-deal-hashicorp-wsj-reports-2024-04-23/

https://redd.it/1cbebi3
@r_devops

Elastic search DR

Just trying to set up DR for elastic cluster. 300gb+ data. DR site in another continent.

Does it make sense to do uni or bi directional CCR? So we can fail back and forth easily.

Anything you guys recommend?

The site to site vpn has good bandwidth.

https://redd.it/1cbdl55
@r_devops

How is the job market these days?

Sorry if these kind of posts aren't allowed, but I am genuinely curious about the job market for devops/sre. I used to work as a front-end web developer, and that field is very saturated imo among juniors and mid-level devs. Can the same be said for devops/sre? You will commonly see 1000+ applicants for SWE roles within a few days (granted most of them are probably unqualified but still daunting).

With software developers, obviously there was a lot of over-hiring and hoarding during the pandemic which can be said the same for other fields. But I think software developers have it especially tougher because offshoring is making a resurgence and AI is at least giving managers the impression that you don't need as many developers. I don't know if devops/sre is experiencing those kind of blowbacks.

Anyways I personally did not enjoy my career as a web developer. It got very stale solving similar CRUD problems and I don't have the energy to grind out LEETCODE problems. I want to go get a CS degree and transiton to devops but if it's very difficult to get into it, then I must re-assess. I guess I am looking for advice.

https://redd.it/1cbifqz
@r_devops