Linux Skills
Hi. Can someone suggest some good resources to learn Linux for DevOps Engineers?
https://redd.it/110yeb6
@r_devops
Hi. Can someone suggest some good resources to learn Linux for DevOps Engineers?
https://redd.it/110yeb6
@r_devops
Reddit
r/devops on Reddit
Linux Skills - No votes and 2 comments
Start a bat file remotely which never returns anything (jmeter-server.bat)
So we are doing distributed testing of our web-app using JMeter. For that you need to have the jmeter-server.bat file running in background as it acts as sort of a listener. The problem arises when one of the slave machine out of 4 restarts due to the load and the test is effectively stuck right there as the master machine expects some output from the 4th machine. Currently the automation is done via ansible-playbooks which are called in Jenkins. There are more or less 15 tests that are downstream to one another. So even if one test is stuck, the time is wasted until someone check on the machines.
Things I've tried so far:
1. I've tried using the Windows Task Scheduler and kept the jmeter-server.bat to run without any user loggin in, but it starts the bat file in background which in-turn spawns all the child processes in the background as well i.e. starts Selenium Chrome in headless mode.
2. I've tried adding the jmeter-server.bat in startup and configuring the system to AutoLogon without any password to trigger a session which will call the startup file. But unfortunately the idea was scrapped by IT for being insecure.
3. Tried using the ansible playbook by using the win_command but it again gets stuck as the batch file never returns anything.
4. Created a service as well for the bat file, but again the child processes started in background.
https://redd.it/110xtz8
@r_devops
So we are doing distributed testing of our web-app using JMeter. For that you need to have the jmeter-server.bat file running in background as it acts as sort of a listener. The problem arises when one of the slave machine out of 4 restarts due to the load and the test is effectively stuck right there as the master machine expects some output from the 4th machine. Currently the automation is done via ansible-playbooks which are called in Jenkins. There are more or less 15 tests that are downstream to one another. So even if one test is stuck, the time is wasted until someone check on the machines.
Things I've tried so far:
1. I've tried using the Windows Task Scheduler and kept the jmeter-server.bat to run without any user loggin in, but it starts the bat file in background which in-turn spawns all the child processes in the background as well i.e. starts Selenium Chrome in headless mode.
2. I've tried adding the jmeter-server.bat in startup and configuring the system to AutoLogon without any password to trigger a session which will call the startup file. But unfortunately the idea was scrapped by IT for being insecure.
3. Tried using the ansible playbook by using the win_command but it again gets stuck as the batch file never returns anything.
4. Created a service as well for the bat file, but again the child processes started in background.
https://redd.it/110xtz8
@r_devops
Reddit
r/devops - Start a bat file remotely which never returns anything (jmeter-server.bat)
Posted in the devops community.
Moving on from Opensearch. What do I do with the historical logs/data?
Started using a lot of ELK, AWS, Opensearch for my personal project. With the scale I have (not a lot), I have migrated my present sys to GCP.
I have a years worth of system log data in Opensearch. I would ideally love to keep the data but can’t figure out the best way.
I can S3 cold store it but I wanted to see if I can store that on some tools I already use - Loki or Google cloud tools?
What would the pros and cons be here?
https://redd.it/11122t8
@r_devops
Started using a lot of ELK, AWS, Opensearch for my personal project. With the scale I have (not a lot), I have migrated my present sys to GCP.
I have a years worth of system log data in Opensearch. I would ideally love to keep the data but can’t figure out the best way.
I can S3 cold store it but I wanted to see if I can store that on some tools I already use - Loki or Google cloud tools?
What would the pros and cons be here?
https://redd.it/11122t8
@r_devops
Reddit
r/devops - Moving on from Opensearch. What do I do with the historical logs/data?
Posted in the devops community.
Alternate solution for splunk
We are dropping splunk and now we are looking for some alternatives for log monitoring and alerting. Should not be too costly like splunk. We just want log monitoring and alerting with calling webhooks in case some event happens
https://redd.it/1111vap
@r_devops
We are dropping splunk and now we are looking for some alternatives for log monitoring and alerting. Should not be too costly like splunk. We just want log monitoring and alerting with calling webhooks in case some event happens
https://redd.it/1111vap
@r_devops
Reddit
r/devops - Alternate solution for splunk
Posted in the devops community.
100 GB Docker Container
We use a specific software in our build process that is quite large (95 GB). It feels like a really bad practice to build such large docker containers.
But mounting the software into the container on specific nodes doesn’t feel „cloud native“ either.
What would be the right approach for this?
The software is mainly used to build components, not to run on a Webserver. The CICD Pipeline runs on Kubernetes.
https://redd.it/1113dwo
@r_devops
We use a specific software in our build process that is quite large (95 GB). It feels like a really bad practice to build such large docker containers.
But mounting the software into the container on specific nodes doesn’t feel „cloud native“ either.
What would be the right approach for this?
The software is mainly used to build components, not to run on a Webserver. The CICD Pipeline runs on Kubernetes.
https://redd.it/1113dwo
@r_devops
Reddit
r/devops - 100 GB Docker Container
Posted in the devops community.
Technically a "new grad." I had to do mandatory military service which wasted a year of my life (had no access to a smartphone or internet). Parents are pressuring me to find a job. I don't know whether to start applying or continue learning?
When I graduated from uni I had to do 13 months of military service. I got "drafted" to use my IT skills to train police officials. They draft people based on their degrees in my country. I was working in a classified area hence I was prohibited from having any smartphone or internet access. I also had only a week of vacation every month where I could return back home.
For a while, I tried to study while off-duty. But I soon realized that it was practically unfeasible for me to remember and practice the things I was teaching myself because I was stuck with limited computer access the other 3 weeks of the month. So I decided to postpone the learning till after I was done with my service.
My plan going forward was to follow the "devops roadmap" often shared on IT subs. It involves getting foundational knowledge in Python, Linux, Networking, AWS, and IaaC. Currently I'm done with the python/programming bit. I want to go down the devops route as I find app configuration, deployment, and server administration interesting from the very little i've dabbled with it. Plus these seem to be very employable skills.
I live with my parents, who keep pressuring me to go look for jobs. I tried telling them it's not easy to find a job these days with my very limited skillset as everyone and their mom has programming listed on their resume. Here's my resume btw. Any feedback would be appreciated.
My question is where do I go from here?
1. Do I continue learning the rest of the stuff in the roadmap? (I estimate it'll take around 4 more months.)
2. Or do I just start applying to any job that takes me? What kind of jobs would I even apply for? I don't think I'm ready for a developer position. And yet, I don't have the necessary skills for a system administration one either.
I'm studying 6-7 hours a day, even going over leetcode problems in case they pop up in interviews. I'm grinding but I just need some clarification if it's the right thing to do in my situation. I think the most optimal time to study and learn these skills would be now, when I have no financial or family obligations. The big cost of this free time to study is that I'd have an "employment gap" on my resume.
https://redd.it/1114c0m
@r_devops
When I graduated from uni I had to do 13 months of military service. I got "drafted" to use my IT skills to train police officials. They draft people based on their degrees in my country. I was working in a classified area hence I was prohibited from having any smartphone or internet access. I also had only a week of vacation every month where I could return back home.
For a while, I tried to study while off-duty. But I soon realized that it was practically unfeasible for me to remember and practice the things I was teaching myself because I was stuck with limited computer access the other 3 weeks of the month. So I decided to postpone the learning till after I was done with my service.
My plan going forward was to follow the "devops roadmap" often shared on IT subs. It involves getting foundational knowledge in Python, Linux, Networking, AWS, and IaaC. Currently I'm done with the python/programming bit. I want to go down the devops route as I find app configuration, deployment, and server administration interesting from the very little i've dabbled with it. Plus these seem to be very employable skills.
I live with my parents, who keep pressuring me to go look for jobs. I tried telling them it's not easy to find a job these days with my very limited skillset as everyone and their mom has programming listed on their resume. Here's my resume btw. Any feedback would be appreciated.
My question is where do I go from here?
1. Do I continue learning the rest of the stuff in the roadmap? (I estimate it'll take around 4 more months.)
2. Or do I just start applying to any job that takes me? What kind of jobs would I even apply for? I don't think I'm ready for a developer position. And yet, I don't have the necessary skills for a system administration one either.
I'm studying 6-7 hours a day, even going over leetcode problems in case they pop up in interviews. I'm grinding but I just need some clarification if it's the right thing to do in my situation. I think the most optimal time to study and learn these skills would be now, when I have no financial or family obligations. The big cost of this free time to study is that I'd have an "employment gap" on my resume.
https://redd.it/1114c0m
@r_devops
What you guys use to test lambda functions
Is there vm dockert that let me test my lambda fucntions on prem?
https://redd.it/110xrnc
@r_devops
Is there vm dockert that let me test my lambda fucntions on prem?
https://redd.it/110xrnc
@r_devops
Reddit
r/devops - What you guys use to test lambda functions
1 vote and 3 comments so far on Reddit
How Much Coding in the Life of a DevOps?
I love hardware and spent my first few years in the industry in server admin (Linux/BSD) and networking (IOS certified). I like coding and have been in development ~8 yrs. My career goal now is to move to devops and also to work only remote + freelance. I just finished The Phoenix Project and The Unicorn Project and it was like a light bulb for me in terms of understanding what the discipline is about (and understanding better what people are talking about in this subreddit).
I like and fairly well understand the tech used in a modern devops stack (K8S, cloud platforms). But I would absolutely hate moving back to editing config files for a living. I want to code! I'm handy in a lot of languages, including Go.
Right now my experience is way too unfocused and all over the place to think I know what I'm doing in terms of applying for a devops job. I have another year or two in development to get some goals I had finished.
Are there spots for people in devops focused on development of tooling using Go (which seems like the dominant language in that realm), plus remote plus freelance? Any advice or other roles I should think about and consider working towards? TIA.
https://redd.it/1117xqw
@r_devops
I love hardware and spent my first few years in the industry in server admin (Linux/BSD) and networking (IOS certified). I like coding and have been in development ~8 yrs. My career goal now is to move to devops and also to work only remote + freelance. I just finished The Phoenix Project and The Unicorn Project and it was like a light bulb for me in terms of understanding what the discipline is about (and understanding better what people are talking about in this subreddit).
I like and fairly well understand the tech used in a modern devops stack (K8S, cloud platforms). But I would absolutely hate moving back to editing config files for a living. I want to code! I'm handy in a lot of languages, including Go.
Right now my experience is way too unfocused and all over the place to think I know what I'm doing in terms of applying for a devops job. I have another year or two in development to get some goals I had finished.
Are there spots for people in devops focused on development of tooling using Go (which seems like the dominant language in that realm), plus remote plus freelance? Any advice or other roles I should think about and consider working towards? TIA.
https://redd.it/1117xqw
@r_devops
Reddit
r/devops - How Much Coding in the Life of a DevOps?
Posted in the devops community.
Help with the architecture of ECS Clusters with Fargate in two availability zones (with AWS)
I'm always having trouble with creating the architecture for my projects. In the following I have listed what I need for my project, but I don't know how to make the architecture, so can anyone show me how it is done? I need a VPC with 2 Subnets and each Subnet is in another Availability Zone. It needs to have an Application Load Balancer. In each Subnet is an ECS Cluster and all that with using Fargate. I also need something to deploy 2 CI/ CD Pipelines in each Subnet which are connected to the ECS Cluster. Can I just use an EC2 instance, or is there something better? If it is possible, can you show me a diagram as an example?
https://redd.it/1119phc
@r_devops
I'm always having trouble with creating the architecture for my projects. In the following I have listed what I need for my project, but I don't know how to make the architecture, so can anyone show me how it is done? I need a VPC with 2 Subnets and each Subnet is in another Availability Zone. It needs to have an Application Load Balancer. In each Subnet is an ECS Cluster and all that with using Fargate. I also need something to deploy 2 CI/ CD Pipelines in each Subnet which are connected to the ECS Cluster. Can I just use an EC2 instance, or is there something better? If it is possible, can you show me a diagram as an example?
https://redd.it/1119phc
@r_devops
Reddit
Help with the architecture of ECS Clusters with Fargate in two availability zones (with AWS)
Posted in the devops community.
Job description help - SQL developer, architect, engineer?
I need some help. I’ve been asked to design and develop a fairly important transactional database for my company, and I don’t have the requisite experience to do it. What are people who design and code SQL databases called? SQL developers? And if you personally were going to hire someone to develop a database that is subject to audit by federal agencies, what is the minimum amount of experience you would accept? I’m trying to advocate for getting qualified people to do this build rather than me as I have no formal training in database development and have only used SQL for reporting purposes (I.e. creating tables, views, and procedures for reports and not to track the official status and activities on an item).
https://redd.it/111acxt
@r_devops
I need some help. I’ve been asked to design and develop a fairly important transactional database for my company, and I don’t have the requisite experience to do it. What are people who design and code SQL databases called? SQL developers? And if you personally were going to hire someone to develop a database that is subject to audit by federal agencies, what is the minimum amount of experience you would accept? I’m trying to advocate for getting qualified people to do this build rather than me as I have no formal training in database development and have only used SQL for reporting purposes (I.e. creating tables, views, and procedures for reports and not to track the official status and activities on an item).
https://redd.it/111acxt
@r_devops
Reddit
r/devops - Job description help - SQL developer, architect, engineer?
Posted in the devops community.
Which offer to Pick?
My opinion.. both of them sucks but salaries are low in EU compared to US.
1. 90k EUR (\~96k USD)
4.050 EUR net
City: Berlin (or remote from Germany)
Role: Senior Cloud Architect
AWS 80% and Azure 20%
My expertise is in AWS and Azure (SA Pro in AWS, SA Expert in Azure) so I will not be learning much
2. 80k (\~84k USD)
3.600 EUR net
City: Munich (or remote from Germany)
Role: Senior DevOps Engineer
GCP 100%
I will be learning GCP here since I have no experience in it.
I pay 46% taxes in Germany so basically I'm getting F###ed regardless where I go.
Don't suggest OE r/overemployed as Germany monitors you via government social security and we can't do OE here. After paying rent, car, food, tv/cellphone, some clothes, and going out 1 week with my family I will barely afford much else..
https://redd.it/111cf1o
@r_devops
My opinion.. both of them sucks but salaries are low in EU compared to US.
1. 90k EUR (\~96k USD)
4.050 EUR net
City: Berlin (or remote from Germany)
Role: Senior Cloud Architect
AWS 80% and Azure 20%
My expertise is in AWS and Azure (SA Pro in AWS, SA Expert in Azure) so I will not be learning much
2. 80k (\~84k USD)
3.600 EUR net
City: Munich (or remote from Germany)
Role: Senior DevOps Engineer
GCP 100%
I will be learning GCP here since I have no experience in it.
I pay 46% taxes in Germany so basically I'm getting F###ed regardless where I go.
Don't suggest OE r/overemployed as Germany monitors you via government social security and we can't do OE here. After paying rent, car, food, tv/cellphone, some clothes, and going out 1 week with my family I will barely afford much else..
https://redd.it/111cf1o
@r_devops
Reddit
r/overemployed
Work multiple jobs during the same 40 hours, reach financial freedom.
Anyone ever go through git history to answer the question "Who is the idiot that wrote this?"
Only to find out its you...
I swear this happens to me daily.
https://redd.it/111elxi
@r_devops
Only to find out its you...
I swear this happens to me daily.
https://redd.it/111elxi
@r_devops
Reddit
r/devops on Reddit
Anyone ever go through git history to answer the question "Who is the idiot that wrote this?"
Large bin storage in a container registry?
Inspired by
this [post\](https://www.reddit.com/r/devops/comments/1113dwo/100\_gb\_docker\_container/)
I was actually curious if anyone has ever tried to use a container registry to store large binary assets as an alternative to something like Artifactory or a home grown artifact management systems? In this case it would just be snapshots of build outputs that are rather large themselves but won't be used externally much if at all.
Seems like it might actually work pretty well in theory, but curious if anyone has ever tried something like this?
https://redd.it/111fw79
@r_devops
Inspired by
this [post\](https://www.reddit.com/r/devops/comments/1113dwo/100\_gb\_docker\_container/)
I was actually curious if anyone has ever tried to use a container registry to store large binary assets as an alternative to something like Artifactory or a home grown artifact management systems? In this case it would just be snapshots of build outputs that are rather large themselves but won't be used externally much if at all.
Seems like it might actually work pretty well in theory, but curious if anyone has ever tried something like this?
https://redd.it/111fw79
@r_devops
Reddit
r/devops - 100 GB Docker Container
Posted in the devops community.
Thoughts on Self Hosting Artifactory vs. SaaS solution? How complicated is it to self host it?
We're currently in the early process of the buy vs. build decision for Artifactoty, and I'm curious about people's experiences with it?
https://redd.it/111gjfp
@r_devops
We're currently in the early process of the buy vs. build decision for Artifactoty, and I'm curious about people's experiences with it?
https://redd.it/111gjfp
@r_devops
Reddit
Thoughts on Self Hosting Artifactory vs. SaaS solution? How complicated is it to self host it?
Posted in the devops community.
Blog - Architecture Decision Records
Recently, I’ve been examining some of the roadblocks when it comes to enabling the right level of speed, control, and, empowerment of engineers in fast-paced environments. One of the most common issues is the speed of architecture processes staying on pace.
https://lachlanwhite.com/posts/architecture/architecture-decision-records/
https://redd.it/111i2yh
@r_devops
Recently, I’ve been examining some of the roadblocks when it comes to enabling the right level of speed, control, and, empowerment of engineers in fast-paced environments. One of the most common issues is the speed of architecture processes staying on pace.
https://lachlanwhite.com/posts/architecture/architecture-decision-records/
https://redd.it/111i2yh
@r_devops
Lachlanwhite
Architecture Decision Records
Technologist, Terraformer & Continuous Learner
1-on-1 meeting with manager
I have a weekly 1-on-1 meeting with my manager to pretty much talk about anything (career progression, professional development, etc).
I’m lost to what to discuss. Any recommendations? I’m an associate DevOps engineer for a small startup. We’ve discussed growth, learning paths, etc.
Just looking for anything that would be a good idea to bring up to ask or discuss.
Thanks!
https://redd.it/111dikn
@r_devops
I have a weekly 1-on-1 meeting with my manager to pretty much talk about anything (career progression, professional development, etc).
I’m lost to what to discuss. Any recommendations? I’m an associate DevOps engineer for a small startup. We’ve discussed growth, learning paths, etc.
Just looking for anything that would be a good idea to bring up to ask or discuss.
Thanks!
https://redd.it/111dikn
@r_devops
Reddit
r/devops - 1-on-1 meeting with manager
4 votes and 10 comments so far on Reddit
Job option, doubts
Hi, to sum up, I am a Dev (with bare minimum Ops), meaning, that I use jenkins and code pipelines in it using groovy. Also, I manage other projects coding in python and java, but I am not involved in the infrastructure side of devOps, so nothing to say about AWS/Azure and ansible/terraform. Right now I have a job offer which seems like IAC (aws, terraform, ansible, logging through ELK, and good linux background) but no coding/scripting. So my question is, do you think this new opportunity could "stale" me in the devops path? Of course just want to know opinions, not decisions.
https://redd.it/111gfdz
@r_devops
Hi, to sum up, I am a Dev (with bare minimum Ops), meaning, that I use jenkins and code pipelines in it using groovy. Also, I manage other projects coding in python and java, but I am not involved in the infrastructure side of devOps, so nothing to say about AWS/Azure and ansible/terraform. Right now I have a job offer which seems like IAC (aws, terraform, ansible, logging through ELK, and good linux background) but no coding/scripting. So my question is, do you think this new opportunity could "stale" me in the devops path? Of course just want to know opinions, not decisions.
https://redd.it/111gfdz
@r_devops
Reddit
Job option, doubts
1 vote and 1 comment so far on Reddit
Chef Nodes Question
Is there anyway to get any info on what nodes are using a certain cookbook? I am having difficulty locating which server is using one of my cookbooks.
https://redd.it/111fqac
@r_devops
Is there anyway to get any info on what nodes are using a certain cookbook? I am having difficulty locating which server is using one of my cookbooks.
https://redd.it/111fqac
@r_devops
Reddit
Chef Nodes Question
Posted in the devops community.
redhat Openshift internship
hello guys , im having a 4 months internship as a devops trainee , i have no background of devops , im specialized in mobile developement , and this is my 1st devops internship , the project is to containerize a jre application and make a ci/cd pipeline for it and deploy it on openshift , so i started learning the basics , linux , docker , jenkins , deployement to aws , digitalocean .. so far so good , so my question is do i need to learn how openshift works and throw all the stuff im learning right now ? or will i need them in openshift , or does openshift does all the work without the need of all those tools that i learned , and 1 more question am i on the right path ? my only resource is a course called devops bootcamp with nana that's my only resource i feel im a bit lost especially when she started talking about nexus , because i have no background with devops whatsoever , thank you guys .
https://redd.it/111o0mc
@r_devops
hello guys , im having a 4 months internship as a devops trainee , i have no background of devops , im specialized in mobile developement , and this is my 1st devops internship , the project is to containerize a jre application and make a ci/cd pipeline for it and deploy it on openshift , so i started learning the basics , linux , docker , jenkins , deployement to aws , digitalocean .. so far so good , so my question is do i need to learn how openshift works and throw all the stuff im learning right now ? or will i need them in openshift , or does openshift does all the work without the need of all those tools that i learned , and 1 more question am i on the right path ? my only resource is a course called devops bootcamp with nana that's my only resource i feel im a bit lost especially when she started talking about nexus , because i have no background with devops whatsoever , thank you guys .
https://redd.it/111o0mc
@r_devops
Reddit
r/devops on Reddit
redhat Openshift internship
What's the better solution for Prometheus?
Hi, I have an eks cluster and all nodes are fully private. Currently, I installed Kube-Prometheus-Stack on it. But I need a centralized solution. If the whole cluster is down or something then I need to find why easily with my centralized data. Also in the future, I will have more than one cluster. So I need to view all metrics and data in one place.
What's the best way I can archive that? Any suggestions?
https://redd.it/111pjc7
@r_devops
Hi, I have an eks cluster and all nodes are fully private. Currently, I installed Kube-Prometheus-Stack on it. But I need a centralized solution. If the whole cluster is down or something then I need to find why easily with my centralized data. Also in the future, I will have more than one cluster. So I need to view all metrics and data in one place.
What's the best way I can archive that? Any suggestions?
https://redd.it/111pjc7
@r_devops
Reddit
r/devops - What's the better solution for Prometheus?
Posted in the devops community.
One vs multiple CABs?
Does your company have separate CABs for infrastructure vs app dev changes? I’m interested in the pros and cons of each scenario.
View Poll
https://redd.it/111nuqz
@r_devops
Does your company have separate CABs for infrastructure vs app dev changes? I’m interested in the pros and cons of each scenario.
View Poll
https://redd.it/111nuqz
@r_devops