Reddit DevOps
266 subscribers
30.9K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
I can't change my job and it's so frustrating

I'm struggling to understand why I'm not being successful in applying for Cloud Engineer/DevOps positions. English is not my first language, and I wonder if that's part of the issue. The requirements for these positions seem to be getting more demanding, and perhaps my resume is not up to par. I live and work in South America, but I'm interested in pursuing opportunities in the US or Europe. Unfortunately, I've been rejected by every company I've applied to, and I haven't even been granted an interview. Is my resume that bad? https://imgur.com/Dn1hZDS

https://redd.it/12yqpii
@r_devops
Need Help - New to Devops. Docker or VM?

So my development team and I are working on a third party application where we can create custom scripts, plugins, workflows, etc. The plan is to use GitHub for source control and Jenkins for our pipeline to run unit and integration tests and deploy to servers. The part I am having trouble with is running the integration tests. I would like to do this in a separate container/VM so that way each time the tests are ran, it runs in a new instance so we can have the tests be repeatable. On top of this, it would be nice to create a development environment for the team to use when the application is updated.

The application is a web server with a database.

​

I am hoping someone can point me in the right direction, do I proceed to learn Docker, or should I learn how to automate creating a VM?

​

Summary:

Need to generate development environment for each developer when the application we are developing for is updated.

Need to have a contained environment to run tests in that is reset after all tests have run.

What is the best way?

https://redd.it/12ytpu5
@r_devops
Recommended devops stack 2023?

I'm a self-taught backend developer interested in learn devops tools for improve my job opportunities, (some choose to be fullstack to be more attractive, but I am interested in directing my profile more towards the world of devops).


At the moment I have knowledge of the following tech stack:

- FastAPI (python)
- Spring Boot (Java)
- postgresql
- Git and github repositories
- Docker
- Linux and bash (I use Fedora)

Learning Docker I have started to like the world of devops, but, I'm finding that there are a lot of different technologies like ansible, terraform, kubernetes, and some compete with each other, like github actions, jenkins, and gitlab.

I'm having flashbacks to when I first started learning programming and didn't know which programming language to choose. and I spent a lot of time looking at options until I decided on start with python.

So, if you can make a recommendation of the technologies that I could focus on to complement my profile, I would appreciate it. I am currently very interested in learning AWS as I am doing a course on AWS lambda functions with java. So it would be preferable if the technologies make a good match with AWS.

Thanks in advance!

https://redd.it/12x74ag
@r_devops
Is Tekton alive? Comparing Tekton Pipelines with Argo Workflows, ArgoCD and Jenkins

Is Tekton still alive? I’ve successfully used this tool in an Openshift environment, where it makes all the sense - there is a proper integration with the platform itself, and RedHat puts lots of effort into making a real CI/CD system out of it. But do Tekton Pipelines make sense today without a wrapper like Pipeline as Code and JenkinsX on top? And are there many companies actually using Tekton, compared to Argo and similar tools? I tried to answer all of these questions in this new mkdev video, plus did some experiments again with editing - hope it’s now even more fun and engaging to watch it, but feel free to roast me in the comments.

https://youtu.be/87FxZvEyRfI

https://redd.it/12x6eia
@r_devops
Monitoring and Observability - Pain Points

Last post I made here was about the usage of Datadog in an AWS environment. A lot of you made very good points on it’s use case and cost-benefit.

I also investigated a little more and found out that not only did my company went through Datadog, but also Grafana and ELK during the last year.

This intrigued me and I came to the conclusion that although Datadog seems to suit us the best, it has some common issues as the other tools also had: complexity, data overload coupled with scaling and lack of customisation.

I wonder if this relates to your experience as well.

What are the most common pain points that you find in nowadays monitoring and observability tools?

https://redd.it/12yzxlg
@r_devops
Am i really expected to make regex expressions by hand on the spot?

Had a terrible interview because the problem was essentially write a regex for this nginx log sample.

I know where the expression goes i just get headaches writing these without any kind of validator tooling.

https://redd.it/12z52m8
@r_devops
Need help organizing the flow of information, any advice is appreciated.

Howdy all, i hope I'm in the right place, i'm wondering if anyone can suggest good books, blogs or give me some advice. I work for a small automation company where we all do a variety of tasks. Recently, I've taken on the role of programming and managing our hardware and cloud infrastructure. I'm trying to find a way to organize and store all of our documents, code, and PLC programs in one central location for myself and my coworkers to access. I'm hoping to learn about more professional solutions than just using scripts and a shared drive. any advice is appreciated

https://redd.it/12z5f5i
@r_devops
Phantom folder in docker overlay2

A security scan is trowing an alert for a folder inside docker overlay2. But I'm not able to find the folder inside overlay2. There's a lot of other folders inside overlay2, but this particular one which raises the alert is missing, yet the scan detects it somehow. What should I do?

https://redd.it/12z9vbo
@r_devops
AWS privacy and security’s feedback

Hey! So, for our online event platform, we use Amazon Web Services (AWS) infrastructure. We have heard a lot about the security and privacy systems that Amazon uses to protect data, using all kinds of fancy stuff like the shared responsibility model, Advanced Encryption Standard (AES), and all these security and compliance certifications like SOC 1, SOC 2, and PCI DSS (don't even ask me about the last ones meaning).


But here's the thing, we wanna know what you think about AWS and how they handle privacy and data storage. Have any of y'all had any issues or concerns about this?

https://redd.it/12za2i4
@r_devops
Docker: Will my container contain source code?

Hi,

Getting ready for demo.

The back-end is written in Golang.

I remember that I have to make a Dockerfile, and K8S yaml.

But will my container contain my Golang source code or how can I make it not?

I just want it to execute a binary file and that’s it.

Thanks :)

https://redd.it/12zb4tp
@r_devops
Using GlusterFS as a storage for Kubernetes?

Hi all. I have a managed k8s on DigitalOcean and I want to use GlusterFS (mostly because of read-write-many one volume to be accessed by multiple pods).
The trick is to initialize glusterfs and a volume from k8s (as StatefulSet?) - all from the glusterfs to be controlled in k8s.

Does anyone of you did this? What's your experience, is it a good idea and where can I look for more implementation details (I'm new at k8s)?


Thanks!

https://redd.it/12zd9h1
@r_devops
Noone mentions Backup in devops? Is Veeam knowledge important?

IT admin trying to learn more about cloud/devops.

Is Veeam (Backup & Replication) needed for Cloud/Devops in AWS. Or is it better to just use some kind of Region or Availability Zone Duplication to carry out backup duties.
How do you backup your data in the Cloud (from instances, databases etc.)?
I normally don't hear much about this topic in devops so would be interested in hearing your thoughts on this.

https://redd.it/12zek00
@r_devops
NewRelic and CloudWatch integration

At the moment we are shipping metrics from cloudwatch to newrelic using the built-in integration option that pull metrics on 5 minute interval.

I found out that there is an option to push metrics using kinesis firehose from aws to nr. Has any of you switched approaches or have implemented the kinesis firehose metric streaming?

I wonder what are the gains besides latency reduction from 5mins to 1min. Is streaming more expensive or cheaper comapared to newrelic polling integration?How would you rate the effort required to migrate? I've noticed there are articles, ready made terraform snippets.

Thanks!

https://redd.it/12zfvdw
@r_devops
DevOps Jobs list. (EU & UK, India and USA)

We created a list of DevOps, SRE and Platform engineering roles, with a particular focus on Terraform and Infrastructure as Code (IaC) positions.

The list features various job posting from companies looking for experienced DevOps, SRE and Platform engineers. The job postings are grouped into separate tables by region (EU & UK, India and the USA). It also has a column specifying if the job is remote or not. Feel free to contribute and add more jobs & regions to this list

https://redd.it/12zjo2f
@r_devops
Front End Observability with Grafana Faro

Grafana made its Frontend Observability tooling in Grafana Cloud available as public preview 2 days ago (24th April). This effectively is their open source frontend library Grafana Faro and Grafana Agent receiving the data and passing it on to Loki and Tempo. Could be a nice addition instead of sentry or new relic if Grafana tooling is already deployed.

An introduction and examples with some screenshots:

https://blog.mayflower.de/15107-grafana-faro-frontend-observability.html

https://redd.it/12zkey6
@r_devops
Looking for a tutor to help in a project involving Docker, AWS, Kubernetes and EKS, Kafka and publish-subscribe, Circuit breaker and bulkheads

I have developed a Node.js application using MySQL database, and I need to dockerize it, and deploy it to AWS using a provided CloudFormation template. I also need to:

* Move the containers to Kubernetes (K8S) using Amazon’s Elastic Kubernetes Service (EKS).
* Use a K8S liveness probe to monitor services.
* Book service will call an external recommendation engine (external service that will be provided).
* Create a circuit breaker for the interaction with the external service.
* Define an asynchronous messaging interaction using Kafka (Kafka cluster will be provided) and create a Kafka consumer (asynchronous service) that will send an email to newly registered customers.

Can anyone help me with this? I need to get this done soon, and I'm seriously overwhelmed. Please don't tell me to spend some weeks to learn everything first, I really don't have much time that's why I need a private tutor. Willing to pay.

If there is anyone who can help me in these tasks, I would be super grateful. Also if this isn't the right place for this post, please guide me to where I can get help. Thanks in advance!

https://redd.it/12zt0o6
@r_devops
Self-Hosted, Distributed, No-code Performance Testing Platform

Hello Everyone,

Last year, we released the Ddosify Engine, a high-performance load testing tool on GitHub. With its simplicity and powerful features, it quickly gained nearly 7K stars. During this time, we actively engaged with Ddosify users to understand how we could further simplify the performance testing process. The most common feedback indicated the need for an easy-to-use with No-code UI and distributed performance testing platform.

We are thrilled to announce the release of Ddosify Self-Hosted on GitHub today. Unlike the Ddosify Engine, this version features a No-code UI and supports distributed traffic generation.

Here are some key features of Ddosify Self-Hosted:

Postman Import: Seamlessly import Postman collections and convert them into load testing scenarios.
Correlation: Extract variables from previous phases and pass them on to subsequent ones.
Assertion: Ensure response data meets your expectations.
Debugging: Examine request and response data before initiating the load test.
Environments: Save constant values as environment variables.
CSV Data Import: Import test data from CSV files and incorporate it into the scenario.

We have spent months developing this product and are eager to hear your thoughts. Thank you in advance for any feedback you can provide!

https://redd.it/12ztjvn
@r_devops