Expensive Metrics: Why Your Monitoring Data and Bill Get Out Of Hand

Why does our metric data volume and our bill get out of control? How is it related to cardinality? And how can DevOps and SRE proactively manage it?
listing some cost factors to consider in this blog:

https://horovits.medium.com/expensive-metrics-why-your-monitoring-data-and-bill-get-out-of-hand-e5724619e3f1

https://redd.it/109dhqb
@r_devops

Ever Reach the Point Where Despite Using Containers You Still Get “Works on my Machine”

I’m on hour 3 of debugging a CI pipeline where it runs 100% of the time when calling my Molecule test directly. If I call it through pytest which we use to parallelize those tests, fails every time. I didn’t write the pipeline so mostly just reading code and the spaghetti of how it’s all wired up.

Just thought I’d seek commiseration and funny stories of still hitting the “works on my machine” wall despite using containers.

https://redd.it/109swkt
@r_devops

How can I check if my ISP is filtering some hosts?

I seriously suspect that my ISP is limiting traffic to Reddit, I'd like to prove if this is true.
I'm a Software BE engineer and have some knowledge of networking and infrastructure and can handle a terminal. Someone could somehow guide me? I don't know how feasible could be.

Thanks!

https://redd.it/109d7g3
@r_devops

I wrote this guide on how to move from TDD to ODD

https://tracetest.io/blog/the-difference-between-tdd-and-odd

E2E testing on the back end is tricky because mocking data on the back end is tricky.

A way to avoid this is trace-based testing where you can run tests and assert against traces. You're really running tests against actual data—no more mocking data and wasting your time.

https://redd.it/108iclz
@r_devops

Network security on Azure and GCP

So, in our web app, which is hosted in multiple data centers (DCs), we can post content in a form field. When posting content like "<script>test</script>" in on-prem DCs, it works, no problem. However, in some Azure and GCP hosted DCs, the post fails with ERR CONNECTION RESET. We checked the firewalls where the post fails and no packets were dropped. Could there be another Azure or GCP network configuration that blocks content in JavaScript script tags? Where should I begin to troubleshoot this, since our web app's codebase is the same in all the DCs.

https://redd.it/109vin6
@r_devops

Free OpenTelemetry-based observability for Kubernetes - works great with Okteto (video)

https://youtu.be/XY6Z5l68ZqY

https://redd.it/109wrg5
@r_devops

DevOps for ML

MLOps, also known as DevOps for Machine Learning, is an invaluable practice for Data Science teams. This guide sheds light on the adoption and education - MLOps for data science

disclaimer: part of the team.

https://redd.it/109wcjn
@r_devops

Manage Multiple GitHub Repositories with Renovate and CircleCI

How to automatically update dependencies with PRs on GitHub after successful build and automated tests with Renovate and CircleCI: https://piotrminkowski.com/2023/01/12/manage-multiple-github-repositories-with-renovate-and-circleci/

https://redd.it/109y3n0
@r_devops

Creating a VPN to control access to a dev environment?

Currently, I have 1 server running Kubernetes (k3s) where I deployed a preview version of a website for the dev team. The site is currently exposed to the internet.

I would like to somehow create something like VPN to restrict access to the site from the public internet. The problem is I only have 1 server and that server is in a network to which I don't have direct access to. It just has 1 public IP assigned and I managed it thorough SSH.

What would be an ideal solution for this? I have only seen an environment where there is a VPN gateway and a network of multiple servers in a private network, but I have just one.

https://redd.it/108dykv
@r_devops

Lambda function and Web API

Lamda function has two arguments

def handlername(event, context)
...
return somevalue

I see function has two arguments event and context.

How to pass http parameter to lambda function and return http response ?

My objective is to create a Web API using Lambda function and publish it in API Gateway.

https://redd.it/10a27m8
@r_devops

Saving load test results for comparison

We've introduced an automated load test pipeline for regularly validating the performance of our website. It's written in .NET and uses Azure Pipeline to run. I'm now looking for a way to properly visualize the results and compare them with previous results.

Does anybody have a suggestion on how to do this properly? Or does anybody know some generic software where you can 'push' data-entries (like a JSON object with date, number of requests, average response time, etc.) and create some diagrams on those data-entries?

https://redd.it/10a4mvk
@r_devops

RedHat Certifed SysAdmin Resource

I am transitioning from backend engineering to devops. I have basic linux skills that comes across my day to day jobs. These are mostly related to text / listing / copy / move / kill processes. I can also do average or below average bash scripting while making CI / CD pipelines mostly.

Recently I have speedup my learning in devops space and want to get some certification specially for linux administration.

I am looking for recommendation for best learning material that can help me prepare for exam. I am a video lessons person hence looking for video course.

Thanks

https://redd.it/108nfkm
@r_devops

Terraform - How do you handle secrets?

Hey I am new to Terraform and I have wondered about this.
When you need to create a resource that has a sensitive secret what do you do?
For example creating a user with a password.

I would like to keep that stuff out of the terraform state file.

Thank you!

https://redd.it/10a7j78
@r_devops

Self-Hosted Secrets Management Service Recommendations?

Hi all. Our company is currently shopping around for a good service to allow for secrets management (primarily with Node apps) that can be integrated into CI/CD pipelines. We currently use Azure infrastructure, and initially were going to use Azure Key Vault, but found that the UX was less than ideal. This led to finding Doppler, and while it looks fantastic, the lack of self-hosting ability is a turnoff. This then led to finding Infisical, but does not look to be feature complete and is rather new.

What do you use for Secrets Management? What recommendations do you have? Any self-hosted options that also have Doppler's branching/schema features?

https://redd.it/10a7hmd
@r_devops

Push part of build output back into repo?

I've got a situation where our final build step produces 2 things:

- Release artifacts (zipped executables for different platforms)
- Files that need to be checked into the Git repo for future use (in the repo itself, not as a Release artifact)

The later is giving me a bit of a headache.

Is there a "best practice" for pushing parts of the build output back into the original Git repo?

Our setup is Gitea and Drone CI if that helps.

https://redd.it/10aejxv
@r_devops

Newbie Here.

I have some doubts/questions related to cloud and devops

1) I am interested linux so i decided to choose to career path, am i on right track?

2) Is there growth in devops?

3) Where should i learn hands on ?

https://redd.it/10ahms1
@r_devops

Can a newbie with no experience get into DevOps ?

Hi guys,

I'm fairly new to the I.T scene. I've been doing training on tools such as Ansible, Docker, Networking, AWS.....etc for just over a year now (I do have a full time job outside of learning and also a young family so am not as quick as others on here). I just got off the phone to a friend of a friend that hires people in I.T support and he was quite surprised that I was trying to jump straight into a junior DevOps roles without prior I.T experience. He said that as far as he is aware - in the 20 plus years experience he has, he doesn't know of anyone that has jumped straight into a specialist role such as DevOps without going through 1st and 2nd line support. He did impress that it was only in his experience - and not to say it hasn't happened somewhere else.

I'm ploughing in as much time as I can to learning basic Python and Linux (I'm now quite comfortable with navigating and using Linux as well as some shell scripting). So just wanted to ask others on their opinions and experience as I'm now having doubts about this career path.

https://redd.it/10a8hyj
@r_devops

How common is it for someone to get into DevOps engineering without having prior swe experience?

Hello all, I currently work as a SOC analyst. In my free time, I've gotten a good handle on python and I'll be sitting for my AWS SAA cert test soon. I either plan on getting more certs or devoting time to getting proficient with the Linux terminal and looking into containerization tooling after I pass that cert. I'm curious if it is worth eventually applying for junior devops positions when I'm ready or if I should try for something like a cloud engineer or some sort of swe position first. It seems a lot of job postings ask for prior swe experience(understandably) and I wanted to get some advice on what path I should take or what I should consider. thanks!

https://redd.it/108hcgs
@r_devops

Chronological list of Resources to Learn DevOps from Complete Beginner to Advanced Level

DevOps is a rapidly growing field that combines software development and operations to improve the overall efficiency and effectiveness of software delivery. It is a set of practices and tools that help organizations to automate, monitor, and optimize their software development and deployment processes.

As the field of DevOps continues to evolve, it is becoming increasingly important for professionals to have a good understanding of the concepts and practices involved. In this article, we will provide a comprehensive guide on how to learn DevOps from complete beginner to advanced level.

We will provide a chronological list of resources that will take you from a complete beginner to an advanced level in DevOps. We will also provide you with information on the beginner, intermediate, and advanced topics in DevOps, as well as useful blogs and books for staying up-to-date with the latest trends and developments in the field.

**Chronological list of Resources to Learn DevOps from Complete Beginner to Advanced Level**

https://redd.it/10akuiq
@r_devops

how do you handle ssh host keys between image creation and deployment

I am creating vsphere VM template using Packer. Towards the end I remove ssh host keys to make pristine template - the idea being that when I deploy a VM from this template, I'll create new host keys.

I am then using Terraform to clone the template but Terraform cannot connect to the deployed VM because SSH is not running (because it does not have ssh host keys).

How do you solve this? Do you just leave the host keys in the template and then rotate them after Terraform deploys the VM?

https://redd.it/10ajd3f
@r_devops

For Working peoples

What is your daily routine i mean how do you work on docker k8s?

Which commands do you use often?

Do you use putty to access docker k8s or other methods? Please specify in detail..please.

Any troubleshooting methods do you use?

Any source for mastering these two?



Guys please help me as i am stuck in support job i really want to learn docker and k8s

https://redd.it/10ajvcg
@r_devops