Reddit DevOps
267 subscribers
1 photo
31K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
Linux+ or RHCSA

Hello! I'm new to the devops community and devops in general.


I just got my CCNA and I want to begin the devops track. I've been using Linux and the command line for about 16 years but not really in depth.

I bough a RHCSA course on Udemy a while ago but I'm having trouble deciding which certification to pursue.
Which one could serve me most in a devops career? Any tips or recommendations?


I appreciate it.

https://redd.it/f8swcl
@r_devops
The Current State of IT.

Hey everyone. I’ve had a lot of questions bugging me lately that I wish some of you could provide the answers to. As someone with barely any IT experience trying to get an entry level help-desk job to build experience, and trying to set myself up for the next shift in IT (cloud), it seems like there’s a not a set path anymore.

Let me explain, and please correct me if I’m wrong. Right now, from what I’ve researched, the next lucrative thing in IT is the “cloud”. AWS, Azure, GCP is the name of the game. There have been posts I’ve seen on here every now and then, where someone manages to get a “DevOps” or “Cloud Engineering” job skipping help-desk (with no experience).

Q1) How does one get a cloud job, by skipping help-desk, if cloud jobs require a few YOE?

Another thing I want to comment on is why I think it’s kind of confusing for beginners in IT, who want to set themselves up properly for the foreseeable future (cloud). You see all these posts with beginners saying things like: “Is My RoadMap correct?”.

Usually these posts contain getting certs in order like: Security+ → Network+ → CCNA → RHCSA......

They also contain learning the proper skills: learn Python...... learn Docker...... learn A - Z...... you get the gist.

I think where the disconnect comes in, is that a lot of people with experience in this sub, have [The Curse of Knowledge](https://en.m.wikipedia.org/wiki/Curse_of_knowledge), and forget what it’s like to be a beginner, starting out in IT.

Usually the more experienced people will comment like: “yeah, sounds good, make sure to also learn: Python, Go, Linux, Windows, Azure, master Git!!!!!!, oh don’t forget to learn some networking, might want to learn how to create your own protocol as well”.

I wonder, do the people in this sub know everything they tell others to learn, or is it an unconscious form of gatekeeping?

Q2) Having to learn these skills, are entry level positions disappearing (besides help-desk)?

It seems like nowadays companies want employees who are entire IT departments, instead of engineers.

Q3) Is SWE a subset of Cloud Engineering, vice versa, or is Cloud Engineering it’s own entity?

Q4) There are two ways to become a Cloud Engineer / “DevOps” (I understand this is a methodology, but at this point I’m pretty sure you can consider it a job title), either starting off as a SysAdmin or a Developer. Is this correct?

Appreciate everyone taking the time to read this, let me know your insights.

https://redd.it/f8w48p
@r_devops
Unable to use AWS api keys with mfa enabled

We have an IAM policy setup that prevents you from doing anything on AWS except setting up MFA if you are not logged in using MFA. This works great for the console but causes an issue when it comes to using the command line or in particular deploying thru visual studio.

Below is what users are allowed to do without MFA in use, everything is blocked.

[
"iam:CreateVirtualMFADevice",
"iam:EnableMFADevice",
"iam:GetUser",
"iam:ListMFADevices",
"iam:ListVirtualMFADevices",
"iam:ResyncMFADevice",
"sts:GetSessionToken",
"iam:ListUsers"
]

How can I have it so that developers can use the command line or VS to interact and deploy things while the account has MFA setup ?

https://redd.it/f8sj4i
@r_devops
BayLISA meetup presentation on the technology behind using machine learning for autonomous incident detection and root cause indication

This is a recording of the Feb 20 BayLISA meetup. It goes into technical detail on how machine learning can be used for autonomous incident and root cause detection. [https://youtu.be/gNiWtoxJ9iM](https://youtu.be/gNiWtoxJ9iM)

https://redd.it/f8w3aj
@r_devops
Tracking PR-to-Jenkins-test-result cycle time

Hi all, long time lurker, always enjoying the conversation, debate and resources. Today I have a question on how to most easily extract an important metric from Jenkins and/or Bitbucket. Be gentle, I'm new.

I'm trying to track over a period of months the cycle time from a developer posting a PR to when Jenkins passes or failed the commit. This should help optimize our jenkins infrastructure in a very slow-to-react organization. Does anyone know of a Jenkins or Bitbucket plugin that would help?

Here's our cycle:
- Dev submits PR to Bitbucket or a commit to an existing PR
- Jenkins Bitbucket Pull Request Builder Plugin starts a build
- Jobs often have a 2-3 hour backlog, sometimes longer *this is a problem*
- Jenkins processes each job in ~32mins
- Jenkins pass or fail is reported back to Bitbucket via Jenkins Bitbucket Pull Request Builder Plugin

I have metrics on actual build and test time, but I need a way to better measure the infrastructure performance so I can beg and plead to update equipment and pilot cloud solutions for CI/CD. I can't be the first person to need this out of Jenkins. Has anyone crossed this bridge before?

Edit for additional information: This is a very simple on-prem setup. New tools outside of Jenkins or Bitbucket plug-ins are going to be very difficult to acquire.

https://redd.it/f8yms7
@r_devops
Datadog volume discount?

Hi,


Does anyone know how much of a volume discount you're looking to get, if you go 500+ hosts on Datadog? And would anyone be willing to share that info?


/kg

https://redd.it/f8op35
@r_devops
Local Jenkins reports to azure devops

Hey all

I have Jenkins on an internal VM which is triggering builds off an azure devops git repo. This all works great!

So now I have been requested to integrate the reporting from Jenkins out to the azure devops project. Though I can see azure has a bunch of Jenkins support, it seems to mostly expect azure to be able to reach where ever Jenkins is.

Do I have any options for getting information from Jenkins to azure regarding things like build status or xml reports from unit tests. Is there some way I can tell Jenkins to publish that information to my devops project, Jenkins being the initiator rather than azure. I can send information to azure from the VM Jenkins is on no problem but going the other way is going to be a no-go due to my orgs security.

https://redd.it/f91m1i
@r_devops
How does ArgoCD's gitOps compare to gitlab's gitOps for kubernetes?

ArgoCD seems to be a crd on your cluster, to keep everything in check at all times, but I'm not sure that's needed or a positive. What other big differences are there?

Are there any other good gitOps solutions for kubernetes out there?

https://redd.it/f91123
@r_devops
Split up DB clusters for micro services?

I am wondering what the normal method of handling the DB clusters for micro services is. I currently have different DB's in Mongo on a single cluster, that is working fine however I think it makes that single cluster a single point of failure which doesn't seem great.

I am Mongo Atlas for the DB hosting so I am not managing clusters at all.

Would it make sense to split up the different DBs into multiple clusters? Currently there are 6 different DB's for the whole application with another 4 planned in the coming months.

https://redd.it/f90t4h
@r_devops
Alternative to JFrog Artifactory SaaS?

Last year, JFrog changed their Artifactory SaaS contracts such that any money left on the contract at its end is no longer prorated back or carried over as credit to the next contract; JFrog just keeps it. The [only evidence of this](https://www.google.com/search?q=jfrog+artifactory+subscription+%22refund%22) is the removal of any terms from public landscapes. This is a shitty business practice on top of other questionable attempts to take advantage of [Sonatype acquisition](https://techcrunch.com/2019/11/18/sonatype-acquired/) while not really putting exciting features out for the service coupled with long term bugs.

Is there a better alternative out there for hosting and managing various artifacts for polyglot shops?

https://redd.it/f8wo86
@r_devops
Multiple repos with docker-compose files to one kubernetes config

At the moment I have a project that started with just one repo and it consisted of an API, db and a memcache server, and using docker-compose to run it all up. After some time I started another 'project' that will be used by project #1, and it's in a seperate repo. Now I have 3 repos that each contain a docker-compose file that has 2-4 services. This whole project (3 repos) is not done so I haven't deployed this to production. If I were to deploy it today I would need to ssh into the server, pull everything from the three repos and docker-compose up each of them. The problem here is that I want to be able to reference services in repo #2 in repo #1, and it's not straight forward when each of them live in their own docker-compose files so I cant just reference the name of the service.

​

Now what I want to look at is kubernetes. I want one .yaml deployment file that defines everything from all 3 repos. Is this a good approach and what would be the best way to do this? I haven't used kubernetes before but I want to learn and try to deploy the whole project to a cluster with one config file for easy deployments. Is it making it harder for me to have 3 repos? I would like to keep it that way if possible. If you can give me any advice or resources where this is demonstrated it would be highly appreciated. Thanks.

https://redd.it/f8zc17
@r_devops
Looking for opinions and suggestions

Okay so I have an automation task here's the requirements:

I have three sets database, lets name them DB1, DB2 and DB3 for simplicity.

All of those databases are on production, but the problem is I cant run queries on DB1 and DB2 because it will spike up our servers, thus DB3.

DB1 and DB2 is live and different on each other and synch updated daily. in order to fulfill my automation task, I need DB1 and DB2 synched up with DB3, but the problem is DB1 has tables different from DB2 but all those tables are needed in DB3.

So here's the requirements.

* What I need on DB1 is table\_id and table\_date
* What I need on DB2 is table\_users and table\_places
* I need all those tables synch up daily on DB3.
* I cant synch all DB1 and DB2 to DB3 since its table specific and also, too large.
* you cant expose credentials via CLI ex: MySQL -uuser -ppassword -hendpoint and mysqldump -uuser -ppassword -hendpoint

What I have already:

* I'm using RDS serverless MySQL databases.
* I have already made a script (made with bash) to run it by cronjob and use MySQL shell to extract tables and mysqldump (to synch the tables), problem is management is looking for alternatives and wants to use AWS services to do the synch.
* I'm looking at AWS DMS, but I think that will just synch up the whole DB1 and DB2 to DB3 (or not, correct me here)
* I've researched Stackoverflow, serverfault and AWS and ubuntu blogs to search for answers, all they suggest is make a script about it (which I did)
* I'm also looking at AWS parameter store and use AWS SSM to run the script, but not yet knowledgeable in mixing up AWS commands and bash.

all help and references are much appreciated.

https://redd.it/f8vkba
@r_devops
How do you deal with job FOMO / grass is greener mentality

So, kind of what the title says. In essence, the DevOps job market is crazy right now. I'm sure we all are used to frequent messages on LinkedIn and seeing job posts everywhere.

How do you guys deal with the constant temptation to switch jobs? I'm still relatively early in my career and am trying to climb the ladder, so seeing job posts I _know_ I'm qualified for constantly with increases in pay is driving me insane. I switched jobs a year ago and had a sizeable raise, and yet already the itch has returned.

It's wild, because I'm no where near underpaid, have amazing job satisfaction, but can never shake the feeling in the back of my mind. Is there really that much of a shortage of labour? Is this sustainable? I worry that by the time I'm ready to move, the market has calmed down.

Thoughts and comments welcome!

https://redd.it/f8u4h0
@r_devops
How do you understand the project specifications to create Dev Ops processes

I just got appointed to a team that's responsible to introducing CI/CD in development process.

However, I'm pretty new(1 month-ish) to the company. The only reason I got assigned here was coz i am a good coder but have no sysadmin experience.


For now, I stick to setting up the tools (Jenkins, ansible, git) on the servers.How can someone in my position contribute to the team?

https://redd.it/f96vnf
@r_devops
Should developers be using CI to test their changes?

I've implemented a fail gate in our CI build which dictates if unit tests fail, no other tests run as the build is considered a failure. We have a long enough build process as it is. So I wanted to hear from the community. I have a developer complaining that he uses CI to test out his changes before they may be ready. I personally don't think that's an appropriate use of spinning up a bunch of tests and agents just to see if one test is passing which he's concerned about. That's better left to running tests locally.

https://redd.it/f8thws
@r_devops
I’m looking for DevOps People in London to take part in a 45-minute market research interview and receive £100 for their time.

The research happens on Thursday evening - please fill out the form if you want to take part [https://questiontime.aidaform.com/devops-research?fbclid=IwAR2ey-0YAvVrQJW95f3oOOy90NKLsf6CAG1t4ZuFHl3Uxqkpz3R\_CVZYsIs](https://questiontime.aidaform.com/devops-research?fbclid=IwAR2ey-0YAvVrQJW95f3oOOy90NKLsf6CAG1t4ZuFHl3Uxqkpz3R_CVZYsIs)

https://redd.it/f981eo
@r_devops
Created a tool for testing CLI apps, containers and nodes

Hey /r/devops,

I created a tool which can be used for testing CLI apps, validating servers and containers in a simple YAML format.

Here is an example test suite:

nodes:
ssh-host:
type: ssh
addr: 192.168.100.12
user: root
identity-file: ~/.ssh/id_rsa
docker-host:
type: docker
image: ubuntu:18.04

tests:
# Execute "echo hello" on the ssh-host, docker-host and on your local node
echo hello:
nodes:
- ssh-host
- docker-host
- local
stdout: hello
exit-code: 0

In the future I would like to add more assertions, i.e. for open ports or running services.

What do you think? Would you have any use-cases for a tool like this?

Link: [https://github.com/SimonBaeumer/commander](https://github.com/SimonBaeumer/commander)

https://redd.it/f8plnv
@r_devops
High availability/zero down time using docker swarm on AWS

Hey guys.
If you are using swarm and configured nodes on different instances.
And say your main thing(leader) is hosted on abc.example.com.
And the instance goes down.
What should i do to bring it back up immediatly on abc.example.com (without having much downtime and without losing data)


Thank you, and sorry for this noobish question.

https://redd.it/f8pqm6
@r_devops
Where can I find a Terraform product roadmap? Need Azure Logic Apps support

Maybe I'm dumb and it's on their site, but I couldn't find it.

The team is testing out IaC tools and trying to make Terraform the standard in the organization due to our multi-cloud setup. The problem is that Terraform providers aren't always up-to-date, and it just so happens that Azure Logic Apps are hugely important for us, but Terraform can't manage Logic Apps. We're worried that we might find more of these down the road that slow us down and introduce the need to convert/wrap ARM with Terraform. As a result we might have to manage everything else with Terraform, but manage Logic Apps/Azure with ARM templates.

It would be great to have:

1. A Terraform product roadmap, if it exists, so we can know when the provider for Azure will support Logic Apps (if ever)
2. A list of current issues with the Terraform providers (not just Azure). We want to be able to foresee things we won't be able to manage with TF before we commit entirely.

​

Pls help

​

EDIT: I might have answered my own question. I dug through the GitHub issues and found these.

[https://github.com/terraform-providers/terraform-provider-azurerm/issues/1691](https://github.com/terraform-providers/terraform-provider-azurerm/issues/1691)

[https://github.com/terraform-providers/terraform-provider-azurerm/issues/2106](https://github.com/terraform-providers/terraform-provider-azurerm/issues/2106)

​

Looks like the AzureRM 2.0 upgrade guide has no mention of this change either. Sad world.

https://redd.it/f9dh6x
@r_devops
What i need to know to understand and start devops

Hello guys , i want to learn (ci/cd) using jenkins and docker and GitHub what are the precognition that i should know or what are the courses that i should take before i start , And do you recommend any newbie courses to understand the concept and what for we use devops ..
Thank you very much

https://redd.it/f9e84c
@r_devops