Understand AWS Public IPv4 Address Usage and Pricing

AWS charges for all public IPv4 addresses, including those associated with running instances and elastic IP addresses. learn more about AWS public IPV4 Address usage and its pricing.

https://vishalvyas.com/understand-aws-public-ipv4-address-usage-and-pricing

https://redd.it/1cnpguc
@r_devops

Ahrefs claims saving 1 billion by not going Cloud

Link: https://tech.ahrefs.com/how-ahrefs-gets-a-billion-dollar-worth-infrastructure-with-a-90-discount-5edd473b2399

HN discussion: https://news.ycombinator.com/item?id=40304549

Excerpt:

> Choosing colocation for the infrastructure was the right decision for Ahrefs. Reflecting on the past six years, the data centers with our own servers and network cost us $122 million, a figure that would have ballooned to an astronomical $1.1 billion if we had opted for the cheapest AWS cloud offering. Our powerful on-prem servers enable our developers to focus on enhancing our products for clients, rather than getting caught in a never-ending cycle of trying to optimize cloud costs with little hope of success.

https://redd.it/1cnqi0x
@r_devops

Beat Practice to in setting up Monitoring ECS tasks

Hello, Junior DevOps here. I would just like to ask what are the best possible solutions for monitoring ECS tasks where it would notify us if the containers reached maximum CPU or memory usage and if there are any failed tasks. I would want it to be cost efficient.

https://redd.it/1cns5z8
@r_devops

Salaries for Southern Europe

Fellow DevOps engineers, what are the (or your) salaries for Junior (if there can be a junior Devops engineer), Mid & Senior.
I know that there are a lot of factors to consider, such as skills, YOE, benefits , working situation (remote, office, hybrid), so let's say average.
Curious since I feel my company offers less the average market, although they claim it's normal for the Country.

https://redd.it/1cntjs1
@r_devops

Automatic Tagging in a multi-repo setup

So in this scenario , you have 2 repos A and B that have a pipeline to create an image that is uploaded and named after the specific commit on its respective main branch.We have a repo C that uses docker compose for example and utilises a repository to access the images of each repo A and B. So my question is what is the best method for updating C so it's aware of any new images from A and B and even better if it's aware of each environment that the image was designated to such as prod / dev.

https://redd.it/1cnuqdp
@r_devops

Best books/resources for understanding true scale and events

Hello I am a mid level engineer with a few years in the DevOps realm. I find myself still struggling to understand the consideration and challenges that goes into designing absolutely massive distributed system.

Any books/resources? In particular, I am interested in learning more about FinTech payment processing systems, and they deal with trillions of transactions per month.

My current understanding of scalability is simply observing and monitoring the CPU and other metrics of a server, make use of autoscaling groups and built-in features of EC2 etc...

I have an AWS solutions architect cert, and I still feel woefully unprepared to even begin to understand the problem at hand. I have been in some medium-sized companies so I have no experience with anything that comes close to the scale that I'm trying to describe here.

Questions:

What are the limitations and constraints that engineers need to know when designing solutions when the scale and events are so big?

Any books that can answer this question more comprehensively?

I know this is a broad question so ANY TIPS would be massively appreciated :)

Thank you all!

PS: Both kubernetes and AWS-native design patterns would be welcome!

https://redd.it/1cnvmu4
@r_devops

CI/CD Pipeline for Node.js Backend on Autoscaling Group

I'm currently in the process of deploying a Node.js backend application and creating a Jenkins CI/CD pipeline to streamline the process. With my existing pipeline, I can deploy to a single instance by SSHing into it via its IP.

Now, my goal is to extend this deployment to the autoscaling group. Since I can't SSH to every single instance that will be created by the autoscaling group when requests increase, how do I achieve this?

Sorry if this is a very basic/dumb question.

PS: If this isn't doable by Jenkins, please let me know if there's another way to accomplish it.

https://redd.it/1cnx5q3
@r_devops

Step Functions vs something else

I follow this guy on YT, and he showed how chosing the wrong step function type (Regular vs Express) sent his cloud way too high... I like to build using Step Functions but I'm now wondering if there's another service that does achieves similar things without the huge bill

https://redd.it/1cnxklv
@r_devops

How do you deal with the cost and maintenance of multiple different staging, dev and other environments?

I am wondering how people here manage the existence of additional environments in addition to production - staging, testing, dev environments.

In my experience these can be heavy compute cost wise and this can also add up maintenance wise. I've in the past merged a few of these environments to reduce maintenance cost.

How do you work around this?

https://redd.it/1co0hti
@r_devops

Need help for first technical test

So I am new in DevOps and this is gonna be my first job, I have technical test in few days and it is written that it will also have some ,,practical tasks with automation checks'' so probably they mean writing automation code, where can I practice it? probably it will be bash maybe python but I don't understand should I just go through some leetcode/codewars tasks or through some special tasks about automation? and if yes then where can I find them?

https://redd.it/1co1hz8
@r_devops

I want to get into DevOps after college. Is my experience enough to progress to a junior sysadmin or cloud engineering role that I can use as a pivot?

https://imgur.com/a/1B1AvLd

Graduating this upcoming Saturday and about to start applying. I've been doing helpdesk/some sysadmin tasks for my college IT department for about two years and will be finishing my last week today. I have an internship as a cloud engineer that gave me some extra hands-on experience as well as personal AWS lab projects involving popular devop tools (Kubernetes, jenkins, docker, etc). Got my SA-A and Network+ last year. Went through the DevOps roadmap and am familiar with majority of the concepts. Will all this be enough to at least be considered for the roles i'm going for? I know that Devops right out of school isn't likely, so I want to try pivoting in a few years.



https://redd.it/1co329x
@r_devops

What is a DevOps job like?

I'm a blind Ukrainian living in the UK and I'm looking for an IT profession where there won't be so much code.

Many times I was advised to consider becoming a DevOps.

I checked, and in my country (Ukraine) beginner DevOps earn $2,000!

I would like to know what their job is like? Do they spend all day fiddling with configs?

https://redd.it/1co4ocw
@r_devops

How do I decide between Gitlab CI, Bitbucket Pipelines, Jenkins, and Azure Pipelines?

Hi so I've seen a lot of posts discussing similar questions about the best CI/CD but what confuses me is that people a lot of times suggest GitLab CI and GitHub Actions, are they meaning that they should change SCM providers as well? Or are they saying they should create a copy of their repository in GitLab/GitHub and pay the costs of two providers just to use the pipeline? Currently I'm in a team using Jira and Confluence so I think it makes sense for us to go with BitBucket since code review can easily be done in a way that ties to user stories and it is discounted with our other Atlassian products. Why don't more people that use Jira use BitBucket? And what is the best option for a company using Jira? Do we copy our BitBucket repo to GitLab, do we use GitLab and use a Jira integration but still not have our code review be able to be tied to user stories, or do we use a CI/CD manager like Jenkins which most people agree is complex to manage? What are other people doing for this? Any advice would be greatly appreciated!

https://redd.it/1co3k0c
@r_devops

What YouTube channels are you watching?

Do you watch any DevOps or similar creators on YouTube? Personally I only watch DevOps Toolkit.

https://redd.it/1co4jav
@r_devops

NetEng interested in CI/CD pipeline

I got a new job (network engr) where the previous guy set up gitlab where it shows the diff between the last saved config and the current one.
Basically anytime the config is saved on any of the network devices.
I can see a diff on what was added/deleted

I know python, Ansible, jinja2 and git just enough to automate simple repetitive task.

Can anyone recommend a video course (or advise me on where or how to start) that would take me from zero to hero on deploying CI/CD pipeline specifically for network devices (or in general)... I want to be able to build a pipeline just like the one above

Thanks, really appreciate it

https://redd.it/1co9mu4
@r_devops

Entry-level DevOps or Adjacent Jobs?

Hey! I'm transitioning into DevOps after being laid off from game development and have a degree in Computer Engineering. I noticed there's a lot of overlap with DevOps and classes I took in college. Not to mention that my game dev experience has a bit of overlap too. I'm currently studying for my second AWS cert (DVA) and was wondering what are best places to find an entry-level application developer, software engineering, or DevOps roles?

I having working knowledge of Linux, VMs, C++, AWS, Python, and version control. I'm currently certified as a Cloud Practicioner because I barely knew anything about cloud computing and wanted to build my foundation first. I'm currently taking Cantrill's DVA course and doing great on the labs and retaining the info.

https://redd.it/1co9hah
@r_devops

Using clamAV to scan EFS for uploaded docs with viruses/malware. Best approach?

I am seeking to test out clamAV to scan AWS EFS for documents uploaded by inexperienced users. My question is twofold:

1. Is clamAV a fair solution? If not, what would be better (EFS is mounted on an Ubuntu instance)
2. I can verify that it detects issues with text files using an EICAR doc. But how do I verify that it detects issues with word or excel docs, which is what is primarily uploaded? I tried placing the EICAR string directly in the word doc, and it said the word doc was clean

https://redd.it/1co8t45
@r_devops

Google cloud accidentally deletes UniSuper's account

https://www.theguardian.com/australia-news/article/2024/may/09/unisuper-google-cloud-issue-account-access

GCP somehow managed to delete a customers account and all their data. Luckily UniSuper had backups on another provider which let them recover after a week of being offline. 620,000 members and $125 billion in funds so not exactly small fish either.



https://redd.it/1co8qbi
@r_devops

Is there a Leetcode for DevOps?

Looking to skill up for interviews, wondering if there is something to help me prepare.

https://redd.it/1cod0io
@r_devops

How does logstash cluster read the same queue in rabbitmq and not overlap

Today I got an interview question about Logstash helm deployment on K8S

They asked me if we were to deploy a Logstash cluster to read from a Rabbitmq queue (with not ack for performance utilization) how does Logstash not overlap and read on an already processed message.

I wasnt able to answer this question. Can anyone explain this to me.

https://redd.it/1cofnec
@r_devops

Tmux session across hosts

Our data center is set up like master node > app node > app container. So, to access the app container we SSH into master, then SSH into app node and then docker exec into the container. We're running a long script in the container, taking several hours. How can we maintain a tmux session for this? The one we setup on master node doesn't work, since the script doesn't run there. The command "tmux" isn't found on the app node or the container.

https://redd.it/1cofs1q
@r_devops