Reddit DevOps
267 subscribers
1 photo
31K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
Multiple repos with docker-compose files to one kubernetes config

At the moment I have a project that started with just one repo and it consisted of an API, db and a memcache server, and using docker-compose to run it all up. After some time I started another 'project' that will be used by project #1, and it's in a seperate repo. Now I have 3 repos that each contain a docker-compose file that has 2-4 services. This whole project (3 repos) is not done so I haven't deployed this to production. If I were to deploy it today I would need to ssh into the server, pull everything from the three repos and docker-compose up each of them. The problem here is that I want to be able to reference services in repo #2 in repo #1, and it's not straight forward when each of them live in their own docker-compose files so I cant just reference the name of the service.

​

Now what I want to look at is kubernetes. I want one .yaml deployment file that defines everything from all 3 repos. Is this a good approach and what would be the best way to do this? I haven't used kubernetes before but I want to learn and try to deploy the whole project to a cluster with one config file for easy deployments. Is it making it harder for me to have 3 repos? I would like to keep it that way if possible. If you can give me any advice or resources where this is demonstrated it would be highly appreciated. Thanks.

https://redd.it/f8zc17
@r_devops
Looking for opinions and suggestions

Okay so I have an automation task here's the requirements:

I have three sets database, lets name them DB1, DB2 and DB3 for simplicity.

All of those databases are on production, but the problem is I cant run queries on DB1 and DB2 because it will spike up our servers, thus DB3.

DB1 and DB2 is live and different on each other and synch updated daily. in order to fulfill my automation task, I need DB1 and DB2 synched up with DB3, but the problem is DB1 has tables different from DB2 but all those tables are needed in DB3.

So here's the requirements.

* What I need on DB1 is table\_id and table\_date
* What I need on DB2 is table\_users and table\_places
* I need all those tables synch up daily on DB3.
* I cant synch all DB1 and DB2 to DB3 since its table specific and also, too large.
* you cant expose credentials via CLI ex: MySQL -uuser -ppassword -hendpoint and mysqldump -uuser -ppassword -hendpoint

What I have already:

* I'm using RDS serverless MySQL databases.
* I have already made a script (made with bash) to run it by cronjob and use MySQL shell to extract tables and mysqldump (to synch the tables), problem is management is looking for alternatives and wants to use AWS services to do the synch.
* I'm looking at AWS DMS, but I think that will just synch up the whole DB1 and DB2 to DB3 (or not, correct me here)
* I've researched Stackoverflow, serverfault and AWS and ubuntu blogs to search for answers, all they suggest is make a script about it (which I did)
* I'm also looking at AWS parameter store and use AWS SSM to run the script, but not yet knowledgeable in mixing up AWS commands and bash.

all help and references are much appreciated.

https://redd.it/f8vkba
@r_devops
How do you deal with job FOMO / grass is greener mentality

So, kind of what the title says. In essence, the DevOps job market is crazy right now. I'm sure we all are used to frequent messages on LinkedIn and seeing job posts everywhere.

How do you guys deal with the constant temptation to switch jobs? I'm still relatively early in my career and am trying to climb the ladder, so seeing job posts I _know_ I'm qualified for constantly with increases in pay is driving me insane. I switched jobs a year ago and had a sizeable raise, and yet already the itch has returned.

It's wild, because I'm no where near underpaid, have amazing job satisfaction, but can never shake the feeling in the back of my mind. Is there really that much of a shortage of labour? Is this sustainable? I worry that by the time I'm ready to move, the market has calmed down.

Thoughts and comments welcome!

https://redd.it/f8u4h0
@r_devops
How do you understand the project specifications to create Dev Ops processes

I just got appointed to a team that's responsible to introducing CI/CD in development process.

However, I'm pretty new(1 month-ish) to the company. The only reason I got assigned here was coz i am a good coder but have no sysadmin experience.


For now, I stick to setting up the tools (Jenkins, ansible, git) on the servers.How can someone in my position contribute to the team?

https://redd.it/f96vnf
@r_devops
Should developers be using CI to test their changes?

I've implemented a fail gate in our CI build which dictates if unit tests fail, no other tests run as the build is considered a failure. We have a long enough build process as it is. So I wanted to hear from the community. I have a developer complaining that he uses CI to test out his changes before they may be ready. I personally don't think that's an appropriate use of spinning up a bunch of tests and agents just to see if one test is passing which he's concerned about. That's better left to running tests locally.

https://redd.it/f8thws
@r_devops
I’m looking for DevOps People in London to take part in a 45-minute market research interview and receive £100 for their time.

The research happens on Thursday evening - please fill out the form if you want to take part [https://questiontime.aidaform.com/devops-research?fbclid=IwAR2ey-0YAvVrQJW95f3oOOy90NKLsf6CAG1t4ZuFHl3Uxqkpz3R\_CVZYsIs](https://questiontime.aidaform.com/devops-research?fbclid=IwAR2ey-0YAvVrQJW95f3oOOy90NKLsf6CAG1t4ZuFHl3Uxqkpz3R_CVZYsIs)

https://redd.it/f981eo
@r_devops
Created a tool for testing CLI apps, containers and nodes

Hey /r/devops,

I created a tool which can be used for testing CLI apps, validating servers and containers in a simple YAML format.

Here is an example test suite:

nodes:
ssh-host:
type: ssh
addr: 192.168.100.12
user: root
identity-file: ~/.ssh/id_rsa
docker-host:
type: docker
image: ubuntu:18.04

tests:
# Execute "echo hello" on the ssh-host, docker-host and on your local node
echo hello:
nodes:
- ssh-host
- docker-host
- local
stdout: hello
exit-code: 0

In the future I would like to add more assertions, i.e. for open ports or running services.

What do you think? Would you have any use-cases for a tool like this?

Link: [https://github.com/SimonBaeumer/commander](https://github.com/SimonBaeumer/commander)

https://redd.it/f8plnv
@r_devops
High availability/zero down time using docker swarm on AWS

Hey guys.
If you are using swarm and configured nodes on different instances.
And say your main thing(leader) is hosted on abc.example.com.
And the instance goes down.
What should i do to bring it back up immediatly on abc.example.com (without having much downtime and without losing data)


Thank you, and sorry for this noobish question.

https://redd.it/f8pqm6
@r_devops
Where can I find a Terraform product roadmap? Need Azure Logic Apps support

Maybe I'm dumb and it's on their site, but I couldn't find it.

The team is testing out IaC tools and trying to make Terraform the standard in the organization due to our multi-cloud setup. The problem is that Terraform providers aren't always up-to-date, and it just so happens that Azure Logic Apps are hugely important for us, but Terraform can't manage Logic Apps. We're worried that we might find more of these down the road that slow us down and introduce the need to convert/wrap ARM with Terraform. As a result we might have to manage everything else with Terraform, but manage Logic Apps/Azure with ARM templates.

It would be great to have:

1. A Terraform product roadmap, if it exists, so we can know when the provider for Azure will support Logic Apps (if ever)
2. A list of current issues with the Terraform providers (not just Azure). We want to be able to foresee things we won't be able to manage with TF before we commit entirely.

​

Pls help

​

EDIT: I might have answered my own question. I dug through the GitHub issues and found these.

[https://github.com/terraform-providers/terraform-provider-azurerm/issues/1691](https://github.com/terraform-providers/terraform-provider-azurerm/issues/1691)

[https://github.com/terraform-providers/terraform-provider-azurerm/issues/2106](https://github.com/terraform-providers/terraform-provider-azurerm/issues/2106)

​

Looks like the AzureRM 2.0 upgrade guide has no mention of this change either. Sad world.

https://redd.it/f9dh6x
@r_devops
What i need to know to understand and start devops

Hello guys , i want to learn (ci/cd) using jenkins and docker and GitHub what are the precognition that i should know or what are the courses that i should take before i start , And do you recommend any newbie courses to understand the concept and what for we use devops ..
Thank you very much

https://redd.it/f9e84c
@r_devops
Just yeeted a server from on prem into azure. Yay?

Do we have backups or monitoring? Well no. Are we taking advantage of their super fast database rather than a local MySQL? Nope. Do we have a site to site VPN so we don't have to expose RDP? Also no. Did we just use Microsoft server when we could have moved to a one click deploy Linux? Well yeah, obviously that's the way we have always done it. Are we proving to someone that this cloud thing is real and can do whan a server you can touch can do? Ding!

I read you guys all the time and I feel like I'm working five or ten years in the past here.

Alt account, obvious reasons.

https://redd.it/f99ym6
@r_devops
DevOps SRE

I'm trying to learning and Become DevOps / Site Reliability Engineering, Now I need to learn a programming language, I'm studying in my university Java But I think it is not appropriate for this specialization that I am trying to learn. I think GO, Python, are more suitable, but I do not know what language I start to learn and I need to use it more. Can you help me

https://redd.it/f99cui
@r_devops
Using Docker with SQL Server?

I am wondering if this would be a practical use case for Docker. Our developers currently share a single VM that contains sql server. Alot of times they have to refresh the database which forces everyone to save and log out of the VM. Is docker something that could give everyone their own development environment and then they can add their code to the vm for testing once finished? I am trying to figure out ways to implement docker into our SQL stuff and am not sure if this is a practical use of it.

https://redd.it/f9gb1w
@r_devops
What is a good approach to managing changes in database structure while jumping between feature branches?

When developing over several active feature branches, some of which contain database structural changes, what is a good approach to switching between branches and the inherit databases?

We've previously developed using a single dev database, and all branches connect to it, even though new tables or columns are added in other branches without issue. However, its just a matter of time until this becomes a problem and then we end up duplicating the dev database and run the conflicting feature branch with DB changes on that.

That solution to me just seems odd, and I assume there is probably a better way or best practice I'm missing. TIA!

https://redd.it/f9fooh
@r_devops
Quay.io is experiencing an outage

[https://status.quay.io/incidents/m45m5cxvt0kn](https://status.quay.io/incidents/m45m5cxvt0kn)

We're seeing errors pulling images in our k8s cluster with things like dex, kiam and others

https://redd.it/f9kiej
@r_devops
How often do interviewers read your resume?

I have 2 quick questions if you are searching for a job and seeing this post.

1. How often do interviewers read your resume?
2. What is the best way you find to handle this?
> I know I can google this; I was more interested in responses from people in this field.


Thanks in advance

https://redd.it/f9jsyh
@r_devops
What kind of ops jobs are there that will allow me to program and have great career trajectory?

Is being a sysadmin the only “ops” job there is? For someone new to IT with zero experience, trying to figure out a path, what are some good options?

https://redd.it/f9p9ev
@r_devops
MariaDB Valera Clustering on Centos 8!

https://youtu.be/ZzC9NP9nXok

Hey guys I made a super short video just going through the installation and setup of a 2 node Valera cluster on some Centos 8 Vagrant VMs ✌️

The online documentation was a little ropey so hopefully this helps someone out there!

https://redd.it/f9pufc
@r_devops
Terraform: Understanding State

Hopefully this guide gives others a better idea of what the state is and how it can be managed.

[https://www.thecloud.coach/terraform/understanding-state/](https://www.thecloud.coach/terraform/understanding-state/)

Please let me know if there's anything you like to see my discuss with regards to Terraform.

https://redd.it/f9r175
@r_devops
Junior DevOps Engineer interview

Hello,

​

On Friday I have got my first ever DevOps interview (phone interview) and I'm absolutely frightened!

I don't know what to expect, what questions will be asked, how to prepare. I'm shaking.

​

The job description is very basic, it doesn't say what skills are required or what the DevOps engineer will do. One small slice of information is ''You will help with app deployment''.

​

Do you have any tips for first phone interview? Actually this will be my first tech interview because:

3 years ago I've started as a 1st line support guy - no tech questions.

I've been promoted to 2nd line - again no interview.

Since June 2018 my Job title is Infrastructure engineer - again no interview, internal promotion.

I try to learn as much as possible about everything IT related: storage, security, virtualization, networking, backups. Recently I've started learning Python and Linux administration.

​

What do you think, how can I prepare for this interview?

​

Thank you for help.

https://redd.it/f9s1ep
@r_devops