Datadog volume discount?

Hi,


Does anyone know how much of a volume discount you're looking to get, if you go 500+ hosts on Datadog? And would anyone be willing to share that info?


/kg

https://redd.it/f8op35
@r_devops

Local Jenkins reports to azure devops

Hey all

I have Jenkins on an internal VM which is triggering builds off an azure devops git repo. This all works great!

So now I have been requested to integrate the reporting from Jenkins out to the azure devops project. Though I can see azure has a bunch of Jenkins support, it seems to mostly expect azure to be able to reach where ever Jenkins is.

Do I have any options for getting information from Jenkins to azure regarding things like build status or xml reports from unit tests. Is there some way I can tell Jenkins to publish that information to my devops project, Jenkins being the initiator rather than azure. I can send information to azure from the VM Jenkins is on no problem but going the other way is going to be a no-go due to my orgs security.

https://redd.it/f91m1i
@r_devops

How does ArgoCD's gitOps compare to gitlab's gitOps for kubernetes?

ArgoCD seems to be a crd on your cluster, to keep everything in check at all times, but I'm not sure that's needed or a positive. What other big differences are there?

Are there any other good gitOps solutions for kubernetes out there?

https://redd.it/f91123
@r_devops

Split up DB clusters for micro services?

I am wondering what the normal method of handling the DB clusters for micro services is. I currently have different DB's in Mongo on a single cluster, that is working fine however I think it makes that single cluster a single point of failure which doesn't seem great.

I am Mongo Atlas for the DB hosting so I am not managing clusters at all.

Would it make sense to split up the different DBs into multiple clusters? Currently there are 6 different DB's for the whole application with another 4 planned in the coming months.

https://redd.it/f90t4h
@r_devops

Alternative to JFrog Artifactory SaaS?

Last year, JFrog changed their Artifactory SaaS contracts such that any money left on the contract at its end is no longer prorated back or carried over as credit to the next contract; JFrog just keeps it. The [only evidence of this](https://www.google.com/search?q=jfrog+artifactory+subscription+%22refund%22) is the removal of any terms from public landscapes. This is a shitty business practice on top of other questionable attempts to take advantage of [Sonatype acquisition](https://techcrunch.com/2019/11/18/sonatype-acquired/) while not really putting exciting features out for the service coupled with long term bugs.

Is there a better alternative out there for hosting and managing various artifacts for polyglot shops?

https://redd.it/f8wo86
@r_devops

Multiple repos with docker-compose files to one kubernetes config

At the moment I have a project that started with just one repo and it consisted of an API, db and a memcache server, and using docker-compose to run it all up. After some time I started another 'project' that will be used by project #1, and it's in a seperate repo. Now I have 3 repos that each contain a docker-compose file that has 2-4 services. This whole project (3 repos) is not done so I haven't deployed this to production. If I were to deploy it today I would need to ssh into the server, pull everything from the three repos and docker-compose up each of them. The problem here is that I want to be able to reference services in repo #2 in repo #1, and it's not straight forward when each of them live in their own docker-compose files so I cant just reference the name of the service.

​

Now what I want to look at is kubernetes. I want one .yaml deployment file that defines everything from all 3 repos. Is this a good approach and what would be the best way to do this? I haven't used kubernetes before but I want to learn and try to deploy the whole project to a cluster with one config file for easy deployments. Is it making it harder for me to have 3 repos? I would like to keep it that way if possible. If you can give me any advice or resources where this is demonstrated it would be highly appreciated. Thanks.

https://redd.it/f8zc17
@r_devops

Looking for opinions and suggestions

Okay so I have an automation task here's the requirements:

I have three sets database, lets name them DB1, DB2 and DB3 for simplicity.

All of those databases are on production, but the problem is I cant run queries on DB1 and DB2 because it will spike up our servers, thus DB3.

DB1 and DB2 is live and different on each other and synch updated daily. in order to fulfill my automation task, I need DB1 and DB2 synched up with DB3, but the problem is DB1 has tables different from DB2 but all those tables are needed in DB3.

So here's the requirements.

* What I need on DB1 is table\_id and table\_date
* What I need on DB2 is table\_users and table\_places
* I need all those tables synch up daily on DB3.
* I cant synch all DB1 and DB2 to DB3 since its table specific and also, too large.
* you cant expose credentials via CLI ex: MySQL -uuser -ppassword -hendpoint and mysqldump -uuser -ppassword -hendpoint

What I have already:

* I'm using RDS serverless MySQL databases.
* I have already made a script (made with bash) to run it by cronjob and use MySQL shell to extract tables and mysqldump (to synch the tables), problem is management is looking for alternatives and wants to use AWS services to do the synch.
* I'm looking at AWS DMS, but I think that will just synch up the whole DB1 and DB2 to DB3 (or not, correct me here)
* I've researched Stackoverflow, serverfault and AWS and ubuntu blogs to search for answers, all they suggest is make a script about it (which I did)
* I'm also looking at AWS parameter store and use AWS SSM to run the script, but not yet knowledgeable in mixing up AWS commands and bash.

all help and references are much appreciated.

https://redd.it/f8vkba
@r_devops

How do you deal with job FOMO / grass is greener mentality

So, kind of what the title says. In essence, the DevOps job market is crazy right now. I'm sure we all are used to frequent messages on LinkedIn and seeing job posts everywhere.

How do you guys deal with the constant temptation to switch jobs? I'm still relatively early in my career and am trying to climb the ladder, so seeing job posts I _know_ I'm qualified for constantly with increases in pay is driving me insane. I switched jobs a year ago and had a sizeable raise, and yet already the itch has returned.

It's wild, because I'm no where near underpaid, have amazing job satisfaction, but can never shake the feeling in the back of my mind. Is there really that much of a shortage of labour? Is this sustainable? I worry that by the time I'm ready to move, the market has calmed down.

Thoughts and comments welcome!

https://redd.it/f8u4h0
@r_devops

How do you understand the project specifications to create Dev Ops processes

I just got appointed to a team that's responsible to introducing CI/CD in development process.

However, I'm pretty new(1 month-ish) to the company. The only reason I got assigned here was coz i am a good coder but have no sysadmin experience.


For now, I stick to setting up the tools (Jenkins, ansible, git) on the servers.How can someone in my position contribute to the team?

https://redd.it/f96vnf
@r_devops

Should developers be using CI to test their changes?

I've implemented a fail gate in our CI build which dictates if unit tests fail, no other tests run as the build is considered a failure. We have a long enough build process as it is. So I wanted to hear from the community. I have a developer complaining that he uses CI to test out his changes before they may be ready. I personally don't think that's an appropriate use of spinning up a bunch of tests and agents just to see if one test is passing which he's concerned about. That's better left to running tests locally.

https://redd.it/f8thws
@r_devops

I’m looking for DevOps People in London to take part in a 45-minute market research interview and receive £100 for their time.

The research happens on Thursday evening - please fill out the form if you want to take part [https://questiontime.aidaform.com/devops-research?fbclid=IwAR2ey-0YAvVrQJW95f3oOOy90NKLsf6CAG1t4ZuFHl3Uxqkpz3R\_CVZYsIs](https://questiontime.aidaform.com/devops-research?fbclid=IwAR2ey-0YAvVrQJW95f3oOOy90NKLsf6CAG1t4ZuFHl3Uxqkpz3R_CVZYsIs)

https://redd.it/f981eo
@r_devops

Created a tool for testing CLI apps, containers and nodes

Hey /r/devops,

I created a tool which can be used for testing CLI apps, validating servers and containers in a simple YAML format.

Here is an example test suite:

nodes:
ssh-host:
type: ssh
addr: 192.168.100.12
user: root
identity-file: ~/.ssh/id_rsa
docker-host:
type: docker
image: ubuntu:18.04

tests:
# Execute "echo hello" on the ssh-host, docker-host and on your local node
echo hello:
nodes:
- ssh-host
- docker-host
- local
stdout: hello
exit-code: 0

In the future I would like to add more assertions, i.e. for open ports or running services.

What do you think? Would you have any use-cases for a tool like this?

Link: [https://github.com/SimonBaeumer/commander](https://github.com/SimonBaeumer/commander)

https://redd.it/f8plnv
@r_devops

High availability/zero down time using docker swarm on AWS

Hey guys.
If you are using swarm and configured nodes on different instances.
And say your main thing(leader) is hosted on abc.example.com.
And the instance goes down.
What should i do to bring it back up immediatly on abc.example.com (without having much downtime and without losing data)


Thank you, and sorry for this noobish question.

https://redd.it/f8pqm6
@r_devops

Where can I find a Terraform product roadmap? Need Azure Logic Apps support

Maybe I'm dumb and it's on their site, but I couldn't find it.

The team is testing out IaC tools and trying to make Terraform the standard in the organization due to our multi-cloud setup. The problem is that Terraform providers aren't always up-to-date, and it just so happens that Azure Logic Apps are hugely important for us, but Terraform can't manage Logic Apps. We're worried that we might find more of these down the road that slow us down and introduce the need to convert/wrap ARM with Terraform. As a result we might have to manage everything else with Terraform, but manage Logic Apps/Azure with ARM templates.

It would be great to have:

1. A Terraform product roadmap, if it exists, so we can know when the provider for Azure will support Logic Apps (if ever)
2. A list of current issues with the Terraform providers (not just Azure). We want to be able to foresee things we won't be able to manage with TF before we commit entirely.

​

Pls help

​

EDIT: I might have answered my own question. I dug through the GitHub issues and found these.

[https://github.com/terraform-providers/terraform-provider-azurerm/issues/1691](https://github.com/terraform-providers/terraform-provider-azurerm/issues/1691)

[https://github.com/terraform-providers/terraform-provider-azurerm/issues/2106](https://github.com/terraform-providers/terraform-provider-azurerm/issues/2106)

​

Looks like the AzureRM 2.0 upgrade guide has no mention of this change either. Sad world.

https://redd.it/f9dh6x
@r_devops

What i need to know to understand and start devops

Hello guys , i want to learn (ci/cd) using jenkins and docker and GitHub what are the precognition that i should know or what are the courses that i should take before i start , And do you recommend any newbie courses to understand the concept and what for we use devops ..
Thank you very much

https://redd.it/f9e84c
@r_devops

Just yeeted a server from on prem into azure. Yay?

Do we have backups or monitoring? Well no. Are we taking advantage of their super fast database rather than a local MySQL? Nope. Do we have a site to site VPN so we don't have to expose RDP? Also no. Did we just use Microsoft server when we could have moved to a one click deploy Linux? Well yeah, obviously that's the way we have always done it. Are we proving to someone that this cloud thing is real and can do whan a server you can touch can do? Ding!

I read you guys all the time and I feel like I'm working five or ten years in the past here.

Alt account, obvious reasons.

https://redd.it/f99ym6
@r_devops

DevOps SRE

I'm trying to learning and Become DevOps / Site Reliability Engineering, Now I need to learn a programming language, I'm studying in my university Java But I think it is not appropriate for this specialization that I am trying to learn. I think GO, Python, are more suitable, but I do not know what language I start to learn and I need to use it more. Can you help me

https://redd.it/f99cui
@r_devops

Using Docker with SQL Server?

I am wondering if this would be a practical use case for Docker. Our developers currently share a single VM that contains sql server. Alot of times they have to refresh the database which forces everyone to save and log out of the VM. Is docker something that could give everyone their own development environment and then they can add their code to the vm for testing once finished? I am trying to figure out ways to implement docker into our SQL stuff and am not sure if this is a practical use of it.

https://redd.it/f9gb1w
@r_devops

What is a good approach to managing changes in database structure while jumping between feature branches?

When developing over several active feature branches, some of which contain database structural changes, what is a good approach to switching between branches and the inherit databases?

We've previously developed using a single dev database, and all branches connect to it, even though new tables or columns are added in other branches without issue. However, its just a matter of time until this becomes a problem and then we end up duplicating the dev database and run the conflicting feature branch with DB changes on that.

That solution to me just seems odd, and I assume there is probably a better way or best practice I'm missing. TIA!

https://redd.it/f9fooh
@r_devops

Quay.io is experiencing an outage

[https://status.quay.io/incidents/m45m5cxvt0kn](https://status.quay.io/incidents/m45m5cxvt0kn)

We're seeing errors pulling images in our k8s cluster with things like dex, kiam and others

https://redd.it/f9kiej
@r_devops

How often do interviewers read your resume?

I have 2 quick questions if you are searching for a job and seeing this post.

1. How often do interviewers read your resume?
2. What is the best way you find to handle this?
> I know I can google this; I was more interested in responses from people in this field.


Thanks in advance

https://redd.it/f9jsyh
@r_devops