Azure and its problem with expensive bandwidth - How reduce cost?

I need to use Azure VM for scraping and downloading several sources (around 100TB). Based on Azure pricing, bandwidth is very expensive. Previously, I used OVH Cloud, which doesn't have any cost for bandwidth (it is unlimited). Is there any option/package/plan in Azure VM with unlimited bandwidth, or should I search for an alternative or go back to OVH?

https://redd.it/1bwj0eo
@r_devops

Future DevOps

Hi,

I just started a new job in one of the biggest companies in my country. I am working as 2line support specialist. I will use mostly SQL, but in the future I know that I can start using Linux, Azure, Bash, Python, Jenkins etc. I see that many colleagues became DevOps with 2-2,5 years of experience on that position. Do you think that is a good option to grow?

https://redd.it/1bwctev
@r_devops

Underpaid and stable or riskier contract-to-hire

Hi all,

I’m a recently promoted Lead DevOps Engineer with around 5 YOE. (Lead at this company basically just means I also do scrum work, project planning, communicating with stakeholders etc..)

I’ve been at this current company for 3 years and it checks most of my boxes in terms of culture, WLB, working on interesting tech, etc… however I know I am being paid under market value ($75k/yr in MCOL after promotion to Lead).

I started interviewing elsewhere and got an offer for $120k/yr for a mid-level DevSecOps role, but it’s a 6 month contract-to-hire W2 role. It does genuinely sound like they want to hire as an FTE at the end of the contract but I’m conflicted.

I seriously cannot afford to do anything other than scrape by at my current role, but the thought of potentially being out of a job in 6 months in this market just feels too risky.

I think this could be a really great opportunity to dive deeper into security and continue growing in my career. But I’ve survived two rounds of layoffs and have a great reputation at my current company, so I feel quite stable.

Any advice? I’m leaning towards taking the risk and just working my ass off in the new role to increase the odds of me converting, but in this economy you just never know when a whole department could get cut.

https://redd.it/1bwmrkp
@r_devops

How can I move to a DevOps management role at a new company if my current company isn't providing opportunities to enter leadership?

It seems like the only way to get into management is to be promoted from IC at your current employer. Everyone else wants some years of experience with people management.

I'm wondering, has anyone without prior management experience had much success just applying to DevOps leadership/management roles as a senior engineer? If so can you share your experience/tips?

https://redd.it/1bwnxdd
@r_devops

Automated Unit Testing - Benefits for DevOps

The guide explores several situations where automated testing is the better choice as compared to manual, it also explores some of the key scenarios where generative AI automated testing should be considered, as well as provides an example for Python code: The Benefits of Automated Unit Testing in DevOps

https://redd.it/1bwpsx1
@r_devops

Conda environment to Docker bets way?

Hi, I have a server that has multiple conda environments each for different projects with different dependencies. I want to stop using conda to start using docker container, one container for each of the environments. What is the best way and easiest way to create a docker environment based on a codna environment? I used the command "conda env export" to get a yaml with all the dependencies. What would be the next step?

https://redd.it/1bwrsei
@r_devops

Looking to get some different perspectives on a potential architecture design

Hello everyone, looking to see people's perspectives on this architecture problem I've been stewing on. Would appreciate any feedback or different perspectives. Also, is my assumption correct that a single domain is not possible with option B?
Unfortunately the new gateway api doesn't support multi-cluster yet or this wouldn't be an issue: https://gateway-api.sigs.k8s.io/geps/gep-1748/
Thanks everyone!


Image:

https://www.reddit.com/media?url=https%3A%2F%2Fpreview.redd.it%2Flooking-to-get-some-different-perspectives-on-a-potential-v0-iszua8m4uosc1.png%3Fwidth%3D2734%26format%3Dpng%26auto%3Dwebp%26s%3D8375e957b3889ce52286c6fb89ba3f058a2d28f5

View Poll

https://redd.it/1bwssni
@r_devops

Junior devops tech interview prep

Hello fellas

got a question :)

I might have the opportunity for a very very rare job offer as a junior devops engineer scope is cyber security. Actually its an learning on the job kinda thing (thats rare, right?). Requirement was to have an apprenticeship as a software dev and being familiar with a scripting language.

So i will have a tech interview, which i really want to finish off successfully, but i really cant think of what exactly of i get tested.

do you already made similar experience then i would like to hear some input from you or share your thoughts how to actually prepare on that? what things i should definitely look into?

i really want to play it safe so seeking for help, this would change my life/career drastically.

stay safe guys ✌🏻

https://redd.it/1bwu56c
@r_devops

Is there a way to practice deploying Kubernetes clusters to AWS without an account locally?

I would like to use code to deploy, but locally instead of opening an account. Is there a way to do this? Is there a way to validate the deployment code instead? I want to use Code as Infrastructure.

https://redd.it/1bww9qu
@r_devops

Setting up local environment on home computer

Hello everyone, I'm a junior developer working for a small sized company. My company's dev environment is not containerized and each dev has to setup their own local environment on their work computers. Due to some personal reasons, I have to work from home for a month. Now i do not have any devops experience but i was wondering if theres any way I can setup the dev server at home without installing everything on my personal computer?

Thank you.

https://redd.it/1bwwwyp
@r_devops

Is anyone going to be at Devnexus in ATL next week ?

Anyone wants to meet? Would love to meet others in devOps

https://redd.it/1bx0pcc
@r_devops

Is anyone going to be at Devnexus next week in ATL ?

?

https://redd.it/1bx0mhe
@r_devops

What secrets managers are y’all using?

Curious what the top secrets managers are for your use case! Vault? SSM? GCP Secrets Manager?

https://redd.it/1bx2vax
@r_devops

Java and DevOps

Hi everyone, I've question regarding Java learning resources in the context of Devops. I've recently joined a fintech company which uses Java stack (springboot, JSP, Maven, Apache struts, and MySQL), Android (Gradle), and IOS (Swift) extensively to manage different products.
I am interested in understanding the operations side of each of these in detail in order to deliver better CI/CD pipelines.

Can someone recommend any particular list of resources to follow? For context, I am have hybrid background in SWE and DevOps based on JS/Python/Docker/Postgres/k8s stack.

https://redd.it/1bx3wg1
@r_devops

Unicorn vs Enterprise for senior

Hey there! I'm in need for community opinions/angles on choosing the next employer. I'm a senior devops 7 years experience. i'm a freelancer sw engineer ATM finishing my contract in a month from now for the last 1/year I like it, but "man needs to provide" (family, plus kid). Need to buy an appartment and start paying a lot of money to a bank. For these reasons I want to move back to platform/devops engineering since there my expertise lies. I unfortunately don't have k8s prod high traffic experience. I can't say I'm super eager to become a people manager, but it was fun to do big projects and lead them.

I've managed to get 2 proposals from 2 very different companies and I'm curious what do you people think is a better move. Here are they:

1:
Unicorn startup with branches in a couple of countries.
not going to do exit, maybe an equal merge, not going IPO.
tech lead position with an opportunity for growth to team lead with hands on and a caviat on the next point.
current team lead is leaving in a month from now , the only person that knows everything and is a super pro monster is a VP and he is moving to US from our country in a few months. So his availability will be second half of the day.
stack: mixed cloud, k8s prod high traffic, postgres on ec2 (because they felt it better than managed), thanos and shit, some python/go automation OSSed - looks solid in terms of tech.
there are a couple of engineers that are mids
hybrid, twice a week from office. They say wlb is good but given the HR circumstances above I don't 100% take it with a grain of salt.
salary is good, some options(equities) provoded. Yearly options bonus. Plus minor perks, regular to SaaS companies.

2:
Big cyber security tech, with RSUs, they acquire a startup not so long ago and are looking for devops people for that part of the company. Not senior role - just a private.
tech stack there's some k8s but apparently where I'm going to put my effort on - I'm going to clarify that tomorrow in more detail. Lots of hashicorp stuff, iac, some automation.aws, going multicloud
there are other engineers that are missing, team lead that is hands on who should be good, on the interview it felt like he is a bit arrogant, but that's maybe because he had to tackle some stuff during the interview - shit happens.
good wlb, 3 times from the office, some programs for summer for small children, when there's no kindergarten, yearly bonus.
regular salary is a bit lower than of that in startup proposal.
since it is a big tech they have a option later to be moved horizontally or promoted.

I need to act quickly now and I want to split in two :)))

Wdyt? Thanks to those who read this to the end.


https://redd.it/1bx63k5
@r_devops

What's the current job oppurtunities in devops as a fresher from india?

hey everyone so i haven't experienced any of the tech fields except the web dev where i learned html, css, a lil bit of js but now i think this could not be the one for me so i am planing to give some time into this field but doesn't know anything about it and as a indian we don't get the environment to actually connect and learn new things on our own anyway, so anyone from india here can tell me what's the current job scenarios in devops in india or in gloabal, one think which is being the headache is "is academics play some role" like my academics score was like fairly average (i just wanna be honest here), so can anyone give me quick summary of all the things what actually happens in this field and what should i learn as a foundation to get started, are there any courses you recommend how much time does it take to generally to achieve specific skills which are required to get a job, are there job opportunities for freshers also i only got merely like 8-10 months left to complete my graduation in IT how much can i do in this duration,

and yeah which are the languages to learn

Thanks in advace who are willing to help by replying

https://redd.it/1bx6q2x
@r_devops

Greenmask release v0.1.9. Database anonymization tool

A [new release](https://github.com/GreenmaskIO/greenmask/releases/tag/v0.1.9) introduces improvements and bug fixes.

[https://github.com/GreenmaskIO/greenmask](https://github.com/GreenmaskIO/greenmask)

# Improvements

* Implemented tables scoring according to the table size and transformation costs. This correctly spreads the tables dumping between the requested worker's pool and reduces the execution time.
* Introduced `no_verify_ssl` parameter for S3 storage
* Adjusted Dockerfile
* Refactored storage config structure
* Most of the config attributes may be set with environment variables
* Parameter `--config` is not required anymore. This simplifies the greenmask utility user experience
* Fixed `S3_REGION` environment variable usage

If you are not familiar yet with Greenmask - it is a Database anonymization tool that brings wide anonymization functionalities and techniques. Check out the [Playground](https://greenmask.io/playground/) page to get started

https://redd.it/1bx8akf
@r_devops

Build SLO for a monolith

I have a monolith service and it serves many different purposes, there are many truly independent services inside, should I build multiple Independent SLO?

https://redd.it/1bx85bx
@r_devops

New YouTube video, asking for criticism again

Following up on some of the advice given https://www.reddit.com/r/devops/comments/1bo47o9/started\_making\_youtube\_videos\_on\_devops\_related/

I'd like to receive some more criticism, constructive ones would be great.

I'm trying to develop my own style by first copying fireship style. However, I realize I lack some skill on the editing department.

​

Thank you!

https://youtu.be/dnXTFudEXN4

https://redd.it/1bxe7vi
@r_devops

Cache is King: A guide for Docker layer caching in GitHub Actions

Hey all, my friend wrote this awesome post on how to properly cache docker layers for github actions and thought I'd share
https://blacksmith.sh/blog/cache-is-king-a-guide-for-docker-layer-caching-in-github-actions

https://redd.it/1bxoy0h
@r_devops

RabbitMQ Going back into Queue

Hey,

So I have the following setup:


< Flask App with Redis for idempotency check > ---- RabbitMQ pod --- < GPU worker node >

Once the GPU worker is finished, it uploads a file. The issue is, I think the processing is taking so long on the GPU that the RabbitMQ ends up moving back the request from 'Unacked' to 'Ready', and then back to 'Unacked' when it requests it again.

The solution I will probably implement when I wake up tomorrow morning will be another idempotency check on the GPU node, and if so instantly send the ACK back if already processed. However is there a setting in RabbitMQ which does not move it back to the 'Ready' after 5-6 minutes? I am not sure why this ACK is not being sent back, I am seeing the file being uploaded. [ GPU worker finished, it uploads the processed file \]. This request is jumping between 'Ready' and 'Unacked'.

Is this an issue with RabbitMQ, should I try Kafka / do you guys all implement idempotency checks with RabbitMQ?





https://redd.it/1bxrqmu
@r_devops