Future tools for devops

What are tools should I
master for the next 5 years ?

https://redd.it/1d3e7gs
@r_devops

How to setup integration tests in the project

Hello everyone,

I'm investigating how to set up integration tests in our project, we do not have any tests in place at the moment. We are using NodeJS/NestJS on the backend side, and everything is deployed as AWS lambdas using a serverless framework. We use Postgres SQL database.

What I've discovered so far is that there are a couple of ways how can you implement integration tests but there are still some uncertainties.

First option: Running integration tests during CI/CD

- The issue here is that our build already takes \~10-15-20 minutes. So it would additionally slow it down even more. Also, we would need to spawn a new environment (not all services, part of the services that are needed for integration tests, database, etc.) before the PR gets merged (since you can not run integration tests with new code since the code is not yet deployed). The issue with spawning environments is the serverless framework which does not have an option to do it in regular way (at least I haven't found it). For these purposes, we could use Terraform or AWS SAM but it takes time to switch to these IAAC tools and we need to start using integration tests as soon as possible.



Second option: Running integration tests nightly

- This looks like a better option to me personally since we would use the existing test environment and every night with deployed code we would run integration tests and fix them tomorrow. The downside is that the code that does not work might be deployed anyway, but I don't see an issue with it since we have weekly releases and once code is deployed to a specific environment we leave it there for \~7 days.

I would appreciate your opinion or advice on which practices to implement and apply and if you think that my favorite option (second option) is not the best approach here.

Also, I assume for NodeJS/NestJS we should just Jest testing framework?

https://redd.it/1d3ee74
@r_devops

Want to get into DevOps as a career.

I have over a decade of software development experience as well as a bunch of years building, hosting, and managing deployments of projects. I also have work experience in automation (HVAC). For my most recent couple of personal projects I have set up deployment pipelines on GitHub and Azure. I fell in love. I love the automation of the process and I want to look into pursuing it as a career option.

My first big questions are:
What pitfalls should I watch out for that could sink me before I get started?
What kinds of experience will employers be looking for and how can I get them?
How "entry level" friendly is devops as far as the job market goes?
What courses would be most beneficial to starting me on the path to being an expert?

https://redd.it/1d3fu53
@r_devops

Identifying Container Image vulnerabilities with Docker Scout

We all know, that Docker technology is great and brings us many advantages, but also, unfortunately, Docker images include many attack surfaces on different layers.

Every day, there are new vulnerabilities discovered in open source projects and maintainers are tasked with patching their software. \~30k new vulnerabilities discovered in 2023 alone.

So how can we mitigate this risk? One solution is vulnerability scanning and its integration into your development lifecycle.

This video shows how to use Docker Scout to secure your Docker images

https://redd.it/1d3insy
@r_devops

Kubernetes is not DevOps.

See it time and time again here with people asking what to learn or creating roadmaps for DevOps saying you "need" Kubernetes (K8S) but that's such an incorrect statement.

Are there companies out there that use it and want you to have it? Sure. Many of those will never actually leverage it in the way it is constructed. Often times you will spend more time fixing issues with Kubernetes than you would other solutions. Kubernetes is container orchestration at scale, At Scale means "large volumes", which many companies don't have. I have worked for larger companies whose clusters almost never scaled and when they did they were minor. To the point that they spent more on K8S management, upkeep, and spending (servers on prem or cloud cost) than they made with systems on K8S.

Does this mean those companies built it incorrectly? Not all the time, no, it more often mean s that they were sold a solution for a problem they didn't have.

I want to be clear, you should ensure you learn Containerization. That is a modern framework for handling any application that's been made for or updated to handle it. Containers can be deployed on a variety of systems, both Kubernetes and not, and should be leveraged as such.

This ultimately comes down to a business case. Are you scaling, or planning to scale, at high levels? Say over 100 or 500 or greater? Yep Kubernetes is probably the solution you want at that point. Are you scaling less than 100, or 50, or 10? Other solutions are capable to assist you here for less cost and work.

From the azure end alone you have Container Instances and App Services which can host containers natively for both Windows and Linux. They have scale settings to allow up or out. They also have a much lower management overhead and cost overhead associated to them. AWS and GCP both have similar offerings that can be used instead.

Should you learn Version Control (git in most cases), a programming language (optional usually depending on the role you want), monitoring, log handling, IaC, Containerization, scripting, CI/CD? Yes to almost all. Should you learn Kubernetes? Only if the jobs you want need it.

https://redd.it/1d3kexn
@r_devops

Docker to kubernetes

Any advice here much welcome.
My company are transitioning from a monolithic architecture to breaking this up into microservices for future scaling and deployment of individual components.

We already have broken a few services out of the monolith into independant microservices, but there are now plans to do all. Docker was OK to manage 5 microservices or so but will be eventually running 20+ so moving to k8s makes sense.

I have a bit of previous k8s experience, but when it comes to moving a monolith architecture to separate services, I am wondering what the best approach is.
Is the best route to break up the monolith and after everything is running as its own docker container, port this to k8s, or is it better to transition the current microservices to k8s and the break up the monolith and add to the kubernetes cluster as I go?

I ask because both routes involve a lot of work, and anyone with a bit of experience of doing something similar in the past can share any knowledge or do's/don'ts when approaching this. Thanks

https://redd.it/1d3lrui
@r_devops

Is KodeKloud Standard sufficient enough to get you to feel confident about getting into DevOps or is KodeKloud Pro needed for that?

Nothing more than the above inquiry. Right now I’m learning on my own but could use some guidance. I was told to check out KodeKloud. I hear great things about it but noticed they have a tier subscription. 450 dollars a year for Pro is steep. I would have to cut my personal entertainment budget in half to afford that. Meanwhile, the Standard tier is cheaper but I’m not sure if it’s worth getting.

https://redd.it/1d3mfv1
@r_devops

Survey on the Best Reverse Proxy for Instant Rollback in Docker Deployments: Traefik vs. Nginx vs. OpenResty

Hello r/devops!

I am conducting a research study to determine the best reverse proxy solution for implementing an instant rollback feature in Docker deployments. If you have experience with Traefik, Nginx, or OpenResty, your insights would be incredibly valuable. The survey will take about 5-10 minutes to complete, and your responses will help identify the strengths and weaknesses of each reverse proxy in real-world scenarios.

Thank you in advance for your participation!

Link to Survey

https://redd.it/1d3jxoo
@r_devops

Test and stage environments strategy?

Good morning.

I want to share a question with you to see if you can clear up my doubts.

What do you consider the responsibilities and activities of a person who has to define and maintain the strategy of the test and stage environments? This person will work in the Test and Release Unit, which is responsible for test cases (test factory, quality, automation, execution...) and the company's software releases.

As proposed, it seems to be an ambiguous responsibility. I would like to know what you understand by this statement.

Many thanks for everything

https://redd.it/1d3jnnd
@r_devops

Moving selected files to glacier

I have a folder named "system" in which there are several files and folders I want to move all these except a folder named "second" To glacier.
How can I do this?

https://redd.it/1d3eq41
@r_devops

Can I get into devops as a network administrator?

Hi, I am 32, recently graduated with a bachelor's degree in computer science and electronics engineering.

I have some experience(school projects) with C++, Java, C#, Python (a little bit more than novice I think. Practicing leetcode atm).

I have slight experience working as a desktop support + currently working as a network administrator at a university. Do you think there is any chance to break into devOps industry?

Any thoughts or comments are appreciated! Thank you!




https://redd.it/1d3rtpa
@r_devops

Senior DevOps/Cloud Engineer/...?

What things have you done that make you think you are ready/qualified for upgrading from middle to senior level ?

https://redd.it/1d3vhvw
@r_devops

Linode LKE, anyone with experience?

i was really surprised by their cheap prices. 48 bucks for a cluster with medium power instances including network infra. or even smaller one with no cost to master nodes. can be 20$..

compared to the minimum of 130$ EKS+worker+network infra. of aws, which is the cheaper between GPC and azure. i think.


anyone have experience with linode then?

https://redd.it/1d3vqbn
@r_devops

3 Environment ( Dev, Stage, Prod) Deployment using GitHub action

Hi Folks,

I'm here to learn about the best practices. I want to create a GitHub action for CI for the above 3 environments. Should I create 3 separate yaml files for all 3 environments in workflows?

I also want to handle 3 different configuration files for example I have config.prod.yaml and I'm copying that into a docker file the same as I have for stage and dev how can I manage these files as well in GitHub action for different branches?

Right now I'm copying the config. prod.yaml into DOckerfile on build time I want to make it dynamic

i want to achieve this workflow ( feature -> PR -> Dev -> PR -> Stage -> PR -> Prod)


and then I will do the CD part with gitops using ArgoCD

​

Do you have any suggestions on how I can achieve the above scenario well or with the best practice?

https://redd.it/1d3ymjc
@r_devops

Hold up, can software actually be FRUGAL?

Ugh, phone troubles! My husband just got a new phone 8 months ago and already wants to upgrade because it's "slow." It really makes you think about how disposable tech feels these days.

Back in my day (yeah, I might be getting old!), we used things for ages and repurposed them whenever possible. Now, it's all about ditching the old for the new. But honestly, when does it stop? Every upgrade seems to slow my phone down even more!

But what if there was a better way? Imagine software that:

* Runs smoothly on even the oldest phones (those flip phones were built to last!)
* Keeps working for years, like a trusty pair of jeans (no more upgrade nightmares!)
* Saves battery like a champ (hello, longer screen time!)
* Takes up barely any storage space (storage who?)
* Helps you do more with less (because sometimes simple is just better!)

Is this just a dream, or is frugal software the future? When will we ditch this constant upgrade cycle and build software that's user-friendly, efficient, and lets EVERYONE join in, no matter what device they have!

https://redd.it/1d3zt1h
@r_devops

How can management efficiently handle 10 servers with the same stack?

I have a problem with my server structure.

I have a scraper script on more than 10 servers.
btw. This server is on a different provider, etc.

Currently, I am installing the same library on each server, setting up the repository on each instance, committing changes on one instance, and then updating all servers.

I have to log in via SSH to each server to run the same commands. My stack includes Ubuntu 22.04 and Docker Compose on each instance.

How can I automate my workflow for easy management without overengineering? I am thinking about Ansible, but maybe there is a simpler, easier solution?

https://redd.it/1d40868
@r_devops

Career change to DevOps.

Hi, I am 34. I work in IT consultancy. I have 5 years of experience as a back-end (Java) developer and another 4 years as... I don't know wtf I am. I'm in cybersecurity, but quite distant from the technical environment. I have meetings, review architectures, carry out threat models, have meetings, make Powerpoint presentations, write security policies, review DevOps practices from the security point of view, have meetings...

I want to go back to the technical aspect of my day to day, where I got to code, implement tools, maybe get to maintain pipelines...

Basically I am debating between going back to dev or trying to shift to DevOps (with almost no experience in that field).

I would like to know your opinion, or if someone found themselves in this situation.

https://redd.it/1d40v5g
@r_devops

Flutter Mobile CI/CD

I am wondering about what different stages people use in their CI Pipeline configuation. I have successfully implemented different scan stages through Sonar, also a successful Build stage. What could I implement more after that?

https://redd.it/1d41tbd
@r_devops

What do you wish Jenkins could do better ?

While still widely used where do you wish it can benefit from improvements ?

https://redd.it/1d43n2x
@r_devops

Managing Wing Libraries with AWS CodeArtifact

TL;DR

Asher Sterkin published an article that analyzes managing Wing libraries using AWS CodeArtifact.

Check out the full article here!

https://redd.it/1d4479c
@r_devops

SRE looking to transition to security

I've been working as a sysadmin -> DevOps -> SRE for over 10 years (on premisis, cloud, AWS, K8S) and looking to shake it up a bit and get onto a security operations team. That type of role doesn't exist where I'm currently working...but trying to understand what I should learn to get me in the door and build off of skills I already have.

Anyone have advice or a guide to making this career transition?

https://redd.it/1d436qn
@r_devops