Benthos/Bloblang and Alternatives
I recently saw our data science team started using Benthos. I am wondering how popular is Benthos specifically its bloblang (mapping language). Also, I am wondering what are the alternatives to its bloblang.
https://redd.it/n7z6js
@r_devops
I recently saw our data science team started using Benthos. I am wondering how popular is Benthos specifically its bloblang (mapping language). Also, I am wondering what are the alternatives to its bloblang.
https://redd.it/n7z6js
@r_devops
Advice sought: I want to quit my devops job, but scared of outlook
Will be intentionally vague...
- I'm only devops person (doing security, infra, cicd, alerts, sre) in small startup.
- Equity is near zilch (nothing life-changing)... Will quit before 1 year period before it vests (been several months, no change in culture)
- I have enough saved for 6 months, financially, to quit
- Being the only has worn me out. No energy to interview either.
Question: if I quit, how much harder is it to get a similar job coming back (senior+ devops, devops manager) 4-6 months later. I need to quit to take care of myself, but afraid I'll be doing my career a disservice: I'm sure my employer will be dissatisfied (but probably expected otherwise they'd give more equity I presume before I joined if they knew what the role was)
https://redd.it/n87pt3
@r_devops
Will be intentionally vague...
- I'm only devops person (doing security, infra, cicd, alerts, sre) in small startup.
- Equity is near zilch (nothing life-changing)... Will quit before 1 year period before it vests (been several months, no change in culture)
- I have enough saved for 6 months, financially, to quit
- Being the only has worn me out. No energy to interview either.
Question: if I quit, how much harder is it to get a similar job coming back (senior+ devops, devops manager) 4-6 months later. I need to quit to take care of myself, but afraid I'll be doing my career a disservice: I'm sure my employer will be dissatisfied (but probably expected otherwise they'd give more equity I presume before I joined if they knew what the role was)
https://redd.it/n87pt3
@r_devops
reddit
Advice sought: I want to quit my devops job, but scared of outlook
Will be intentionally vague... - I'm only devops person (doing security, infra, cicd, alerts, sre) in small startup. - Equity is near zilch...
Using GitHub actions to deploy docker images
My GitHub action using docker image push workflow is successful executed.But image isn't in my docker hub . Where it could have been ? Where exactly image ran when building it ?
https://redd.it/n8i4ck
@r_devops
My GitHub action using docker image push workflow is successful executed.But image isn't in my docker hub . Where it could have been ? Where exactly image ran when building it ?
https://redd.it/n8i4ck
@r_devops
reddit
Using GitHub actions to deploy docker images
My GitHub action using docker image push workflow is successful executed.But image isn't in my docker hub . Where it could have been ? Where...
Working with kubernetes - how do you create development / debug environment?
Infra is in kubernetes and we have 4 services and 4 teams each is responsible for its service.
We have infrastructure as code.
Are there good tools / ways to allow each developer to be able spin up development environment in timely fashion, easily and without huge costs?
Requirements: ability to spin up production replica to develop / debug locally while still connected to environment that replicates one of ours (production for example).
Minikube seems to slow computers too much and somewhere someone is always having some exotic problems as we're working with linux / mac / windows.
Docker-compose requires separate maintenance as its not easy to set it up as our deployments in the cloud. Its also not that reliable and many devs had issues with it.
https://redd.it/n8n5gi
@r_devops
Infra is in kubernetes and we have 4 services and 4 teams each is responsible for its service.
We have infrastructure as code.
Are there good tools / ways to allow each developer to be able spin up development environment in timely fashion, easily and without huge costs?
Requirements: ability to spin up production replica to develop / debug locally while still connected to environment that replicates one of ours (production for example).
Minikube seems to slow computers too much and somewhere someone is always having some exotic problems as we're working with linux / mac / windows.
Docker-compose requires separate maintenance as its not easy to set it up as our deployments in the cloud. Its also not that reliable and many devs had issues with it.
https://redd.it/n8n5gi
@r_devops
reddit
Working with kubernetes - how do you create development / debug...
Infra is in kubernetes and we have 4 services and 4 teams each is responsible for its service. We have infrastructure as code. Are there good...
Diagram/document generation tool for Kubernetes cluster.
I was wondering if there was any open source tool that would generate architecture diagrams [or documents\] of a running Kubernetes cluster. I found this tool but it's not free. If you know any open source tool that would facilitate in documenting the architecture of a Kubernetes cluster, please share!
https://redd.it/n8e846
@r_devops
I was wondering if there was any open source tool that would generate architecture diagrams [or documents\] of a running Kubernetes cluster. I found this tool but it's not free. If you know any open source tool that would facilitate in documenting the architecture of a Kubernetes cluster, please share!
https://redd.it/n8e846
@r_devops
Hyperglance
Visualize & Document Kubernetes Architecture | Hyperglance
Visualize your Kubernetes architecture in minutes. Automatic & searchable diagrams & inventory. EKS, AKS & OpenShift support. Start your free trial today!
What does it take to do stress testing on a website?
I am a developer and just start to learn things in DevOps and Testing area. So this question might sound too simple, but it's really hard for me.
I am reading articles about load and stress testing to find out the upper limit of my website. I haven't done any tests so far, but I'd like to get some ideas about the following question:
If I'd like to do a stress test on a website running on a cluster with x cpu cores and y Gigabytes memory in total, how many cpu cores and memory do the test device (or test cluster ???) have to have? Please give me some real world data.
PS: I really have no experience about this, any comments are appreciated. Thank you guys!
By the way, is Jmeter the most popular tool in this area? Any other quicker and easier tools?
https://redd.it/n8e29s
@r_devops
I am a developer and just start to learn things in DevOps and Testing area. So this question might sound too simple, but it's really hard for me.
I am reading articles about load and stress testing to find out the upper limit of my website. I haven't done any tests so far, but I'd like to get some ideas about the following question:
If I'd like to do a stress test on a website running on a cluster with x cpu cores and y Gigabytes memory in total, how many cpu cores and memory do the test device (or test cluster ???) have to have? Please give me some real world data.
PS: I really have no experience about this, any comments are appreciated. Thank you guys!
By the way, is Jmeter the most popular tool in this area? Any other quicker and easier tools?
https://redd.it/n8e29s
@r_devops
reddit
What does it take to do stress testing on a website?
I am a developer and just start to learn things in DevOps and Testing area. So this question might sound too simple, but it's really hard for...
Deploy Knative functions as a developer
I’m new to DevOps and Platform Engineering. My team has tasked me with setting up a serverless solution in our k8s clusters. After looking through some options Knative came up and it works well with our existing istio setup.
I have no issue deploying simple stuff with a Knative Service resource but how would this be done by a developer? How would our client engineers deploy a serverless function without interacting with k8s?
https://redd.it/n8g440
@r_devops
I’m new to DevOps and Platform Engineering. My team has tasked me with setting up a serverless solution in our k8s clusters. After looking through some options Knative came up and it works well with our existing istio setup.
I have no issue deploying simple stuff with a Knative Service resource but how would this be done by a developer? How would our client engineers deploy a serverless function without interacting with k8s?
https://redd.it/n8g440
@r_devops
reddit
Deploy Knative functions as a developer
I’m new to DevOps and Platform Engineering. My team has tasked me with setting up a serverless solution in our k8s clusters. After looking through...
Applying library updates - how do you do that?
Hello, DevOps People!
Have a couple of newbie-ish questions regarding the libraries update.
Hope to get some help from the experienced DevOps:
1. Do you update libraries to patch security vulnerabilities, and if yes - where do you find the information about what needs to be updated?
2. When you installed the updated packages - do you reboot the whole server or restart the services?
Thank you in advance for your help to the beginner!
https://redd.it/n8fk1r
@r_devops
Hello, DevOps People!
Have a couple of newbie-ish questions regarding the libraries update.
Hope to get some help from the experienced DevOps:
1. Do you update libraries to patch security vulnerabilities, and if yes - where do you find the information about what needs to be updated?
2. When you installed the updated packages - do you reboot the whole server or restart the services?
Thank you in advance for your help to the beginner!
https://redd.it/n8fk1r
@r_devops
reddit
Applying library updates - how do you do that?
Hello, DevOps People! Have a couple of newbie-ish questions regarding the libraries update. Hope to get some help from the experienced...
Any GoCD users that want Gitea Oauth?
Hi all,
I recently was investigating how to integrate GoCD login with Gitea Oauth and came up with this package https://github.com/DPr00f/gitea-oauth-authorization-plugin
For anyone interested feel free to use and test, I've simply changed GoCD gitlab package to fit Gitea Oauth.
Posting here for visibility only but if someone wants to manage that package let me know.
https://redd.it/n8c5qm
@r_devops
Hi all,
I recently was investigating how to integrate GoCD login with Gitea Oauth and came up with this package https://github.com/DPr00f/gitea-oauth-authorization-plugin
For anyone interested feel free to use and test, I've simply changed GoCD gitlab package to fit Gitea Oauth.
Posting here for visibility only but if someone wants to manage that package let me know.
https://redd.it/n8c5qm
@r_devops
GitHub
DPr00f/gitea-oauth-authorization-plugin
The plugin allows user to login in GoCD using Gitea. - DPr00f/gitea-oauth-authorization-plugin
What country to choose for both working CDI and Freelance (taxes, salary, social life)
Hello everyone, I'm a DevOps engineer with 3 years experience. I'm from the middle east. But I'm searching a job on another country. I want to find a city where I can:
* work full time (CDI) as devops engineer and I can do freelance in the night and weekend. I mean when the law allows me to do both and without so much taxes.
* good salary comparing to life's costs. So I can save a good amount of money
* beautiful city to live in (social life, friendly people, transport...)
By the way, I speak English/French and basic German but I'm open to learn new languages too.
For now I have an offer in Paris. Some friends suggest : Zurich(Switzerland), Amesterdam, Portugal , Sweden.
Can you suggest some countries or cities please and tell me why you choose it?
Thanks
https://redd.it/n8p9p4
@r_devops
Hello everyone, I'm a DevOps engineer with 3 years experience. I'm from the middle east. But I'm searching a job on another country. I want to find a city where I can:
* work full time (CDI) as devops engineer and I can do freelance in the night and weekend. I mean when the law allows me to do both and without so much taxes.
* good salary comparing to life's costs. So I can save a good amount of money
* beautiful city to live in (social life, friendly people, transport...)
By the way, I speak English/French and basic German but I'm open to learn new languages too.
For now I have an offer in Paris. Some friends suggest : Zurich(Switzerland), Amesterdam, Portugal , Sweden.
Can you suggest some countries or cities please and tell me why you choose it?
Thanks
https://redd.it/n8p9p4
@r_devops
reddit
What country to choose for both working CDI and Freelance (taxes,...
Hello everyone, I'm a DevOps engineer with 3 years experience. I'm from the middle east. But I'm searching a job on another country. I want to...
My docker app exits abruptly when deployed on local PC but runs fine on remote VM
Howdy guys
So I'm still kinda new to docker.
So I was trying to deploy my node app inside a container with mongodb and mongo express (also inside a container) at once using a docker compose yaml file on my personal computer.
As soon as I run the docker compose, I notice that my node app close almost immediately with an exit code of 1 and sometimes 134 and 139.
So I created an azure vm on cloud with 8gb of RAM and 1TB storage and it ran fine without none of my containers exiting with any error code.
To the point. Could it be cos my laptop does not meet the hardware requirements to run multiple containers and whats the system requirements to run containerized images ?
My laptop spec: 4GB RAM, 500GB HDD corei3 CPU
https://redd.it/n8ms6b
@r_devops
Howdy guys
So I'm still kinda new to docker.
So I was trying to deploy my node app inside a container with mongodb and mongo express (also inside a container) at once using a docker compose yaml file on my personal computer.
As soon as I run the docker compose, I notice that my node app close almost immediately with an exit code of 1 and sometimes 134 and 139.
So I created an azure vm on cloud with 8gb of RAM and 1TB storage and it ran fine without none of my containers exiting with any error code.
To the point. Could it be cos my laptop does not meet the hardware requirements to run multiple containers and whats the system requirements to run containerized images ?
My laptop spec: 4GB RAM, 500GB HDD corei3 CPU
https://redd.it/n8ms6b
@r_devops
reddit
My docker app exits abruptly when deployed on local PC but runs...
Howdy guys So I'm still kinda new to docker. So I was trying to deploy my node app inside a container with mongodb and mongo express (also...
Free learning directory
Hey everyone, throw away account.
I'm starting to curate a directory of some great, free learning materials that range from covering topics like, computer science fundamentals, to devopsy stuff with Ansible etc.
I'll keep updating the repo as I go along, and of course everyone is free to provide their inputs and add materials of their own.
https://github.com/alex067/FreeResourceCenter
https://redd.it/n8w5nf
@r_devops
Hey everyone, throw away account.
I'm starting to curate a directory of some great, free learning materials that range from covering topics like, computer science fundamentals, to devopsy stuff with Ansible etc.
I'll keep updating the repo as I go along, and of course everyone is free to provide their inputs and add materials of their own.
https://github.com/alex067/FreeResourceCenter
https://redd.it/n8w5nf
@r_devops
GitHub
alex067/FreeResourceCenter
Contribute to alex067/FreeResourceCenter development by creating an account on GitHub.
What is the Devops Career ladder or life after devops?
What are some roles that are natural for a people minded DevOps Engineer to move into, what does the career ladder in this field look like for people who don’t want more of the same?
Excuse me if this turns into a rant as I am very much reaching the burnt-out stage of my career and with my current job. I see a ton of posts about getting into DevOps but I hardly ever see anything about advancing in the field or good roles to move from DevOps to. I have spent the better part of a decade as a “DevOps engineer/enabler” (I know it is not much to some people) and I am actively reaching the end of my rope. It might just be my current job, but beyond the senior title it seems like there is no real advancement to be had unless the rare manager leaves. I have seen countless mentions online about DevOps being a bit of a dead end at a certain point, and this seems to be the truth at my current job.
I have reached the point in my career where I will be happy if I never need to look at a Jenkins file, diagnose why a stack is failing, figure out why iOS builds are not working, or write a single line of code again. The parts I like about the job, bringing people together, breaking down barriers, finding better processes, facilitating and leading cultural change seem few and far between at this point. I have reached out internally and have gotten no feedback, so I am reaching out to this subreddit for advice. What are some roles that are natural for a people minded DevOps Engineer to move into, what does the career ladder in DevOps look like for people who don’t want more of the same?
https://redd.it/n8mqew
@r_devops
What are some roles that are natural for a people minded DevOps Engineer to move into, what does the career ladder in this field look like for people who don’t want more of the same?
Excuse me if this turns into a rant as I am very much reaching the burnt-out stage of my career and with my current job. I see a ton of posts about getting into DevOps but I hardly ever see anything about advancing in the field or good roles to move from DevOps to. I have spent the better part of a decade as a “DevOps engineer/enabler” (I know it is not much to some people) and I am actively reaching the end of my rope. It might just be my current job, but beyond the senior title it seems like there is no real advancement to be had unless the rare manager leaves. I have seen countless mentions online about DevOps being a bit of a dead end at a certain point, and this seems to be the truth at my current job.
I have reached the point in my career where I will be happy if I never need to look at a Jenkins file, diagnose why a stack is failing, figure out why iOS builds are not working, or write a single line of code again. The parts I like about the job, bringing people together, breaking down barriers, finding better processes, facilitating and leading cultural change seem few and far between at this point. I have reached out internally and have gotten no feedback, so I am reaching out to this subreddit for advice. What are some roles that are natural for a people minded DevOps Engineer to move into, what does the career ladder in DevOps look like for people who don’t want more of the same?
https://redd.it/n8mqew
@r_devops
reddit
What is the Devops Career ladder or life after devops?
What are some roles that are natural for a people minded DevOps Engineer to move into, what does the career ladder in this field look like for...
Demand for EKS in industry, compared to ECS
DevOps engineer at my work said EKS is a fair learning curve. Not so for ECS. I have a whole suite of AWS services and DevOps practices to learn so I wanted to ask if ECS is quite marketable on its own. Or are most of the industry use cases pushing towards EKS nowadays and it should be prioritized?
https://redd.it/n8bhbm
@r_devops
DevOps engineer at my work said EKS is a fair learning curve. Not so for ECS. I have a whole suite of AWS services and DevOps practices to learn so I wanted to ask if ECS is quite marketable on its own. Or are most of the industry use cases pushing towards EKS nowadays and it should be prioritized?
https://redd.it/n8bhbm
@r_devops
reddit
Demand for EKS in industry, compared to ECS
DevOps engineer at my work said EKS is a fair learning curve. Not so for ECS. I have a whole suite of AWS services and DevOps practices to learn...
Can some explain me difference between DevOps and CICD?. I am confused here !
I am hearing DevOps at one side and CICD on the other side, Delivery or deployment. Confused by these terms.
https://redd.it/n8aeix
@r_devops
I am hearing DevOps at one side and CICD on the other side, Delivery or deployment. Confused by these terms.
https://redd.it/n8aeix
@r_devops
reddit
Can some explain me difference between DevOps and CICD?. I am...
I am hearing DevOps at one side and CICD on the other side, Delivery or deployment. Confused by these terms.
12-factor app and once-off scripts?
According to 12-factor app, once off scripts should be run in an environment identical to production.
So if you have a script like
But this is pretty hard to do?
Our production system is docker containers running on ECS fargate. We can have jenkins issue a task that pulls the latest docker container, runs the desired script and then exits, however --
1 - this is slow
2 - feedback cycles are slow (you don't find out if the script had a problem for several minutes)
3 - compared to SSHing into a production machine to run the script, you can't immediately take corrective action if something does go wrong
Up till now we've been maintaining machines in production environments that expose a SSH port and we've been manually going into those machines and running once of scripts as needed. However, these machines aren't guaranteed to stay in parity with production and generally just have a copy of the repository and some of the correct environment variables.
These machines are different from prod (EC2 vs ECS, no docker image, parameter drift, etc). But on the other hand, running these kinds of scripts in a prod-like environment seems pretty inconvenient as well.
How do other teams resolve this?
https://redd.it/n7z34n
@r_devops
According to 12-factor app, once off scripts should be run in an environment identical to production.
So if you have a script like
python backfill_missing_records.py then you should run it in an environment that matches production, i.e., same docker image, same environment variables, etc.But this is pretty hard to do?
Our production system is docker containers running on ECS fargate. We can have jenkins issue a task that pulls the latest docker container, runs the desired script and then exits, however --
1 - this is slow
2 - feedback cycles are slow (you don't find out if the script had a problem for several minutes)
3 - compared to SSHing into a production machine to run the script, you can't immediately take corrective action if something does go wrong
Up till now we've been maintaining machines in production environments that expose a SSH port and we've been manually going into those machines and running once of scripts as needed. However, these machines aren't guaranteed to stay in parity with production and generally just have a copy of the repository and some of the correct environment variables.
These machines are different from prod (EC2 vs ECS, no docker image, parameter drift, etc). But on the other hand, running these kinds of scripts in a prod-like environment seems pretty inconvenient as well.
How do other teams resolve this?
https://redd.it/n7z34n
@r_devops
reddit
12-factor app and once-off scripts?
According to 12-factor app, once off scripts should be run in an environment identical to production. So if you have a script like `python...
To be a devops, do we need to be a peogrammer?
Do I need to know program in order to be a devops?
https://redd.it/n817i9
@r_devops
Do I need to know program in order to be a devops?
https://redd.it/n817i9
@r_devops
reddit
To be a devops, do we need to be a peogrammer?
Do I need to know program in order to be a devops?
Failed dream job interview due to 2 questions, would appreciate any answers about these
Hey guys, coming down from a big failure today. So I got into selected for interview in a dream job, not big name but in terms of $$$, worklife balance, culture, etc. So I clear first round it was standard, complete some assignment, all good. Had talk with Devops lead. He asked me 2 questions that I had no answers for and that was it. I mean 2 questions.
So here is how it went,
He: So we want continuous deployment very frequently what is the best way to achieve this?
Me: CICD pipeline using tools like Jenkins, Gitlab, etc.
He: Okay, great. Now say for some reason there is a faulty release, how will you delete and roll it back automatically?
Me: Not sure maybe we can have Prometheus send alert which would trigger a python k8s script for rollback?
He: Not the best way
​
Next one, he asked me something related to helm before
He: So, let me give you a scenario. Our users are growing and we are making application ever better by introducing new tools and more applications, like Redis, python app , etc. What would you do in devops perspective so that adding and maintaining those new applications is as easy as possible?
Me: Create docker image for new component, manifest and helm and then Maybe we can have git repository to store all helm chart ?
He: Are you sure?
Me: Not really
​
We that's it to be honest some questions here and there, I guess either I am kinda dumb, maybe these were easy questions. Anyway I'd appreciate the answers guys. Thank you
https://redd.it/n7qiwt
@r_devops
Hey guys, coming down from a big failure today. So I got into selected for interview in a dream job, not big name but in terms of $$$, worklife balance, culture, etc. So I clear first round it was standard, complete some assignment, all good. Had talk with Devops lead. He asked me 2 questions that I had no answers for and that was it. I mean 2 questions.
So here is how it went,
He: So we want continuous deployment very frequently what is the best way to achieve this?
Me: CICD pipeline using tools like Jenkins, Gitlab, etc.
He: Okay, great. Now say for some reason there is a faulty release, how will you delete and roll it back automatically?
Me: Not sure maybe we can have Prometheus send alert which would trigger a python k8s script for rollback?
He: Not the best way
​
Next one, he asked me something related to helm before
He: So, let me give you a scenario. Our users are growing and we are making application ever better by introducing new tools and more applications, like Redis, python app , etc. What would you do in devops perspective so that adding and maintaining those new applications is as easy as possible?
Me: Create docker image for new component, manifest and helm and then Maybe we can have git repository to store all helm chart ?
He: Are you sure?
Me: Not really
​
We that's it to be honest some questions here and there, I guess either I am kinda dumb, maybe these were easy questions. Anyway I'd appreciate the answers guys. Thank you
https://redd.it/n7qiwt
@r_devops
reddit
Failed dream job interview due to 2 questions, would appreciate...
Hey guys, coming down from a big failure today. So I got into selected for interview in a dream job, not big name but in terms of $$$, worklife...
Podman vs Docker
How many of you are using podman at work in place of Docker? How good it is?
https://redd.it/n7tidm
@r_devops
How many of you are using podman at work in place of Docker? How good it is?
https://redd.it/n7tidm
@r_devops
reddit
Podman vs Docker
How many of you are using podman at work in place of Docker? How good it is?
Host apps on different subdomains on the same ec2 server
Hello everyone,
Let me start by saying, I'm a noob in DevOps. Recently I encountered a situation where I have to host 2 flask apps on two different subdomains, for example, I've to host flask_app_1 on sub1.example.com and flask_app_2 on sub2.example.com. I have an ec2 instance and I own the example.com domain and I'm using Nginx as well. I did some trying before. I tried making a .conf file in the sites-available folder for both of them and linking them, but that didn't work. I'm not sure if I'm doing something wrong in this method or whether I should be doing something else other than this.
I'm pretty sure this is a famous thing that many websites do, but I just can't get it. Can somebody help me to get this problem fixed?
Thank you!
https://redd.it/n90ewe
@r_devops
Hello everyone,
Let me start by saying, I'm a noob in DevOps. Recently I encountered a situation where I have to host 2 flask apps on two different subdomains, for example, I've to host flask_app_1 on sub1.example.com and flask_app_2 on sub2.example.com. I have an ec2 instance and I own the example.com domain and I'm using Nginx as well. I did some trying before. I tried making a .conf file in the sites-available folder for both of them and linking them, but that didn't work. I'm not sure if I'm doing something wrong in this method or whether I should be doing something else other than this.
I'm pretty sure this is a famous thing that many websites do, but I just can't get it. Can somebody help me to get this problem fixed?
Thank you!
https://redd.it/n90ewe
@r_devops