What is the cheapest place to host a small (7 pods) Kubernetes deployment?

I've been searching around for the cheapest place to host an Kubernetes cluster with a cloud vendor.

Requirements:

* The vendor must have support for Terraform.
* Zero management of the control plane
* Preferably a good amount of additional services in case I'll need peripheral things.

I would really appreciate your thoughts and opinions. As it stands GCP (my preferred vendor) is costing me around £150 p/m for a 3 node cluster (without reservation).

https://redd.it/10f4zk3
@r_devops

Wrote an article about deploying a container into AWS EC2 with ECS

Hi everyone, recently I have wrote an article about explaining how to deploy a container into AWS EC2 with ECS. I'm wondering your thoughts on this piece, hopefully I'm not missing something out.

https://www.permify.co/post/how-to-deploy-your-container-into-aws-ec2-with-ecs

https://redd.it/10fb3pd
@r_devops

how many CICD pipelines per git repository

One thing that is not discussed a lot is the amount of seperate CICD pipelines for a GIT repository. In GitLab CI you are limited to 1 Pipeline but in Azure Devops and GitHub you can have multiple pipelines and or workflows per repository. How many pipelines do you have, on average, per repository in your organisation? And why?


I like to have 3 Pipelines, one "main" pipeline which compiles, tests, scans and deploys to a feature environment.
One release pipeline which changes the version of your dependency management tool, like Maven or NPM, compiles and deploys it and tags a commit. And one deploy pipeline which only deploys artifacts.


Sometimes these 3 are combined into one pipeline which does everything but if you would describe that pipeline with a function name it would be like:

compile_and_deploy_to_feature_env_or_only_make_a_release_or_only_deploy_artifact()

whereas seperated it would be

compile_and_deploy_to_feature_env()
build_release()
deploy_release()

Also with the last option you see fewer parameters in a CICD job

https://redd.it/10f70l0
@r_devops

Team is trying to build an entirely custom service to calculate DORA metrics for our company. Is this normal or are we over-stretching ourselves?

We are a team of 4 cloud engineers managing the platform of a small-mid sized company. We investigated Sleuth as a SaaS solution but it didn’t quite fit our needs. So we thought we’d have a crack at building something ourselves. I’m a little worried though that something like this goes into the realms of complex algorithm design and is beyond the skillset for a team of this size. I have no idea how it’s been done in other places though, so can anyone share their own experience with using DORA metrics and thoughts on our situation?

https://redd.it/10f93v4
@r_devops

What's the difference between GitOps and Ci/CD

It just sounds like fancy market talk.

Specifically this link here from github - https://github.com/readme/featured/defining-gitops

https://redd.it/10faw7u
@r_devops

An application agnostic remote agent

Does anyone know of a generic remote agent tool? By this I mean some kind of agent software that can be installed to a remote system (likely on a different network outside of my control) that can be instructed by a control server to execute arbitrary tasks, preferably containers. I know of several application specific task handlers like GitHub's self-hosted runners, but I can't find anything that is application or language agnostic.

If there isn't such a tool, what level of interest do you think there would be in one?

https://redd.it/10fl0up
@r_devops

What are Terratests good for?

So I'm working on a new team that has a requirement to run terratests on all terraform modules. But the way they are currently implementing them is by checking that all the resource names match the expected output and they have all the right tags.


Looking at this, it seems kinda pointless. Terraform creates what we tell it to, and I don't really feel a need to test that terraform is creating what I laid out in the module. The only real benefit I see in running the terratest is seeing that the apply finishes without an error, but after that, I don't really need to check all the resource names. We use interpolation for some of the naming conventions, but they aren't that complex and creating terratests just for that naming convention seems like overkill.


I can think of some better uses for terratest, like to test the functionality of some of the more complex conditional logic we sometimes use in modules. But I was curios if anyone here has uses terratest for something more useful or if I'm missing what the main point of testing terraform is all about.

https://redd.it/10fbrcl
@r_devops

Keda with kafka scaler won't scale from zero

We have multiple K8S clusters and in each cluster we have a kafka cluster. I want to use keda to scale up and down pods due to topics lag. The issue is when a new cluster is being created or if we recreate the topics, and the pods are on 0 replicas, the keda does not recognize that there's a new lag. It's happening because it can't identify the consumer group, since it was not created yet. Is there any solution for that? Thanks

https://redd.it/10fgtwb
@r_devops

Fighting Slow and Flaky CI/CD Pipelines Starts with Observability

Observability in production is great, but what about our own CI/CD? Here's a tutorial on how to build intelligent data collection, dashboarding and alerting over Jenkins pipelines with open source tools like Prometheus and OpenSearch.

https://redd.it/10fhejs
@r_devops

Keep working as developer or become cloud specialist?

I worked for an digital agency for 2 years, kind of a full-stack position, built a lot of websites and mobile apps. I've got a chance to setup cloud and did some DevOps works, just simple CI/CD and Docker.

Now I am getting 2 job offers, one backend developer offer from a bigger agency, and one cloud engineer offer from a large global shipping company.

I am very experienced in frontend, so I want to learn more in backend and DevOps/infrastructure. That's why I am struggling to decide which offer I should take.

While the agency offer pay a bit more and I can further my backend skills, the cloud engineer offer will expose me to K8S and I will still do some development works like internal frameworks for the company application team.

Any advice or anything I should take into consideration?

Should I work as backend developer and play with cloud in my free time? Or take the cloud engineer offer and do some side projects to keep sharpen my backend skills? Which one sounds more doable?

https://redd.it/10focyg
@r_devops

Is it hard to migrate a Mongo DB from one cloud to another?

Lets say I am on AWS and want to move my Mongo DB to Azure. How difficult is that to do? Is it simply just download all the info and reupload to the other cloud?

https://redd.it/10frkvy
@r_devops

Posting information INTO postman from outside - how is it done?

I've used a variety of other tools to examine payloads from PUT or POST requests.

Pipedream is my current favourite for this - it provides me with an API endpoint that I can POST a json payload to so I can examine the payload and test everything thoroughly before posting to the intended downstream system.

How do I do this with postman? My IT team has set up a postman account that we can all save our work into to make it easier to share but they are not sure how to do this. The only documentation I can find from postman talks about receiving responses from when you POST to another system from postman.

I feel like we are all missing the obvious here - can you do this with postman and if so where is the documentation?

https://redd.it/10fr6u5
@r_devops

Reproducible builds locally and in the pipeline using docker?

Hey everyone, so I have been working on our pipelines at work and have had some questions for the community on if a similar implementation exists.

​

Currently using dotnet as an example we have the following pipeline setup in azure pipelines

​

Build --> Unit Test / Sonar analysis -- > Docker build & publish

​

all of these stages (bar the docker build) run in an azure-pipeline container job the build stage does a dotnet publish and uploaded the produced artifact, and the Unit test stage runs the sonarqube analysis on the dotnet test build and publishes the coverage/test result file to the azure DevOps server and sonarqube and then the docker stage creates a production-ready image which copies in the artifact published in the first step and pushes it to our private docker registry.

​

all works fine but after speaking to the devs they have requested we make this process a bit more repeatable so they can be azure what they are producing locally is the same as what the pipeline produces. I think is a good idea and started to dive into ways we can achieve this we agreed that we should take advantage of docker more for reproducibility and use a multi-stage build to run the application build, unit tests and obviously the final production-ready image so then in the pipeline we can run a simple docker build and have the same result as if it was running on the dev machine.

​

my only issue with this process is the Code analysis, sonarqube hooks into MSBuild to analyze the code but this is now running inside a docker build process so do we add java and sonarqube to the first multi-stage of the docker image? do we want devs to run this step locally and have their local code analyzed? or do we have a completely separate step with another build inside the pipeline purely for this code analysis?

​

I am struggling to find an elegant solution, everything seems to be very overkill and I am wondering if anyone else has managed to achieve something similar.

please feel free to ask any question, I feel like I have not really explained the situation well but I will try to clear up where I can.

https://redd.it/10fk7mp
@r_devops

U got hired as a DevOps engineer, but you are really a glorified Sysadmin. What do you do to change this?

Curious how people would approach this if this happened at a company. First thing that comes to mind is containerizing applications?

https://redd.it/10fx26f
@r_devops

Need to learn about cert (security)

Hi guys,

I am working for a while in devops and used to be developer. Certs are always scare me away all the time, so never involved in working with them. But recently most of the issues in our env is because of cert whether it is kubernetes or openshift or kafka.

We are having different types of issues and for me its very difficult to understand when our team discuss about it in meeting.
Can you guide me where should I start learning about it and also suggest me if any certification courses will help as well. But my main target is, I should be ready to solve security problems related to certs / keys.

​

Thanks

https://redd.it/10fy6ki
@r_devops

CORS issue after attaching AWS WAF to load balancer

Guys,
I am facing "Access to fetch at ' ' has been blocked by CORS policy: No 'Access-Control-Allow-Origin' header is present on the requested resource. If an opaque response serves your needs, set the request's mode to 'no-cors' to fetch the resource with CORS disabled." after I have attached my load balancer to AWS WAF. Otherwise, it works fine, so what may trigger the issue or which rules are responsible for this scenario?

https://redd.it/10fw4wl
@r_devops

Beholder - Documentation search engine with K8S first approach

Hey everybody,

I just finalized the first version of my project: Beholder. When deployed to K8S it allows you to expose OpenAPI documentation for specifically labeled services.

It's the first version, I tested it as much as I could but there could be some lingering bugs. I would be more than grateful for the feedback.

https://github.com/gdulus/beholder

https://redd.it/10g1gxc
@r_devops

Should I continue my self-taught journey to become Remote worker?

Overthinker here...

There's a thing where it demotivate me to continue my self-taught journey to become DevOps Engineer. I'm from a third world country where there's barely any software job there, It's just web dev with pretty much bad salary..Currently learning sysadmin and "Golang" but it doesn't stop there I know there's much more for sure. I have already made my road map and path. also I'm on my third year in college "computer engineering"But the issue is I hear may people say that DevOps requires you to to work as a sysadmin or software engineer first and get hands-on experience then you move to DevOps, also it's so hard to get remote job outside US. My plan is to get as much knowledge and build up my github so i can land a "Junior remote job role" even if it pays much more below average (not necessarily a DevOps role.. sysadmin or Cloud Specialist first is fine)It's fine for me to work any of those jobs first but remotely? eh.. even for DevOpsWhat do you think guys? should I stay motivated and keep learning? I'm worried that all my studies will go to waste

I do have a carefully considered road map/path. Spent months doing researches and watching videos

Edit: I can't travel outside my country. I'm here taking care of my family alone :q

https://redd.it/10g4hmw
@r_devops

designing guide | DevOps

I have a homogeneous infrastructure on Cloud, I need to design the DevOps way of managing it.

My design should be capable of configuration management, security updates, scaling, automation and automation.

I have a very good knowledge on Linux, storage and operations, but i have no clue about DEVOPS ways of designing.

So any book, or website you could refer me? please

https://redd.it/10g4t22
@r_devops

Do you let devs deploy to production?

Just curious how other are doing. Here the devs need to open a Jira ticket requesting a specific build to be deployed to prod and then our team do the deployment with the cicd pipeline.

https://redd.it/10g3bcb
@r_devops

Azure Keyvault for multi-cloud use (AWS, Rancher onprem, and Azure)

Does anyone have experience utilizing Azure Keyvault outside of Azure? I've been tasked with identifying a multi-cloud solution for secrets management. We have an existing Hashicorp Vault setup, as well as an existing Azure Keyvault setup.

Is it possible to use Hashicorp vault as a secret store that pulls from Azure Keyvault? Alternatively, is it possible to use Azure Keyvault successfully in AWS kubernetes clusters or VMs, or Onprem kube clusters/VMs?

https://redd.it/10g9j9k
@r_devops