The #1 bug predictor is not technical, it's organizational complexity

I thought this one might be of interest here :)

TLDR: When Vista flopped after release, Microsoft Research took a deep-dive the Vista code base and tried to figure out what they could change to avoid flaky releases in the future.

What they found was that purely techical measurements like how complex the code is, the test coverage, how many bugs there were in the bug tracker, the number of dependencies, etc, is important, but the number one measure for predicting bugs according to their study was:

Organizational complexity!

https://augustl.com/blog/2019/best_bug_predictor_is_organizational_complexity/

EDIT: Direct link to the paper that this blog post describes in layperson's terms: https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/tr-2008-11.pdf

https://redd.it/ec9rpj
@r_devops

Best Resources to learn Window server

Hello,

I am about to involve in a deployment project which most components run on Window servers.I am not going to manage window servers after deployment but some knowledge of IIS, configuration, process management and networking are necessary for deployment.I know Linux a bit but no past experience in Window servers.Can you guys please recommend me some resources to learn an overview about Window servers?

https://redd.it/ec9vy4
@r_devops

Adding a unique GitHub actions build identifier

[https://medium.com/attest-engineering/adding-a-unique-github-build-identifier-7aa2e83cadca](https://medium.com/attest-engineering/adding-a-unique-github-build-identifier-7aa2e83cadca)

https://redd.it/ecetr4
@r_devops

What do you look for in a CI/CD tool?

I'm trying to figure out what I should be looking for in a CI/CD tool. There's a bunch of companies that have too many different features and whistles. What am I missing that I need in my life? Not interested in Jenkins - plugins and pipeline maintenance are annoying.

https://redd.it/ecewjm
@r_devops

VPO wants to invest a lot of money on On-prem infra, I suggested to better try go Cloud first... He doubts

**TL;DR:**
**I think that MGMT have some fear about the monthly billing of Cloud technologies instead of doing one BIG payment for On-premm infra. How can I present facts to solve this fear?**

So right now I'm the one IT guy who is trying to push everything into the Cloud/devops culture. The company is doing a great effort going agile already, Cloud and Devops are a little slow ATM.

I was requested recently to quote Windows Server licences and other stuff for out site. Let's say we need to invest 1000USD just to have the things needed and then start working on it. Told the boss to better try AWS/Azure first but he said *"well, if I'm gonna spend 10 usd this month but at the end of the year I will pay 1200 USD in total, what would be the benefit of using AWS?"*

I know he is not negligent, he have a real concern that wants to resolve. I'm trying to prepare some numbers to show them the estimated cost of using public cloud in maybe 2 or more years. Does anyone have any other advice to overcome this?

https://redd.it/ecf27w
@r_devops

Are you using SSH certificates (rather than keys)?

Github now support authentication via an OpenSSH certificate: [https://github.blog/2019-08-14-ssh-certificate-authentication-for-github-enterprise-cloud/](https://github.blog/2019-08-14-ssh-certificate-authentication-for-github-enterprise-cloud/).

However, I cannot find any recomendations for a certificate authority to manage these SSH certificates.

There seem to be numerous options surrounding certificate management for servers and productions environments, e.g. BLESS, CASSH etc.

**What would you know of / recommend for managing SSH certificates for developers to access Github?**

In an ideal world, this would allow for custom configuration by developer. It would be able to interact with an existing active directory to authenticate users attempting to create certificates and it would be a managed service.

https://redd.it/ecav32
@r_devops

Which PaaS or IaaS provider to choose (small startup)?

Hi. We're a team of 3 developers, with a very limited DevOps knowledge. I would like to find the best infrastructure provider, which will allow us to develop and deploy with ease, with a limited budget in mind.

Please consider the following setup:
\- 1 client (React.js / Preact)
\- 1 mobile app (React Native)
\- 1 Node.js app (API - GraphQL / Apollo)
\- 1 database (MongoDB)
\- storage for images
\- 2 envs (dev and prod)

With that in mind, which provider would you recommend? From what I understand, Heroku can become expensive very quickly. Is getting into PaaS a wise choice? Maybe there's an IaaS solution that's relatively easy to setup?

Any help will be appreciated.

https://redd.it/eccv2g
@r_devops

What are your best resources to learn observability?

As the title says. Also, which tools are you using to implement them?
I’d like to get the following:
- observability paradigms.
- tools to implement some paradigms.
- specific information about how to implement the paradigm in the above tools.

This usually comes as a regular question in r/devops, so it could be nice to have them aggregated.

https://redd.it/eckww2
@r_devops

Tar up working filesystem?

I want to make containers but I don’t want to have to get it working in a test environment, then do everything all over again to make a Dockerfile. And I don’t trust these scripts that auto generate a Dockerfile. I just want to tar up a working, running filesystem and use that as a container’s fs. Is this possible with existing container technologies?

https://redd.it/ecbj33
@r_devops

A cleaner multi-stage continuous deployment on Kubernetes of a Create React App with kustomize, helm and skaffold

Watch out front end developers, soon you too will be shipping web scale cloud native HTML!

Jokes aside, it's actually a pretty good overview of kustomize, skaffold, multi stage docker builds and all of the other yaml:

https://www.codepedia.org/ama/a-cleaner-multi-stage-deployment-on-kubernetes-of-a-create-react-app-with-kustomize-helm-and-skaffold

https://redd.it/ecoxzq
@r_devops

Do you really need multi-cloud strategy?

How will a multi-cloud be an option for an application where you have rich integration components such as APIs between applications. Latency is a big issue.

https://redd.it/ecpjau
@r_devops

“Ops by Code” - DevOps for Ops

Hello,

since DevOps is mostly used in the development context, I tried to write down my thoughts from the perspective of IT operations.

[https://medium.com/zoisays/ops-by-code-devops-for-ops-771d8cf6a22f?source=friends\_link&sk=6b403f9ed704bd0add9e750fe77d4de8](https://medium.com/zoisays/ops-by-code-devops-for-ops-771d8cf6a22f?source=friends_link&sk=6b403f9ed704bd0add9e750fe77d4de8)

What do you think?

https://redd.it/ecfygp
@r_devops

How to automatically build a project which is not mine?

All my services are based on docker images(*), automatically updated with Watchtower:

- the ones I get from Docker Hub
- and the ones I wrote myself, put in GitLab and have a CI/CD pipeline which is triggered when there is a new commit (and which builds an image and pushes it to a repository of mine)

There is now a project on GitHub I am interested in and would like to package in a docker image. A one-shot `docker build ...` is not difficult - the part I am not sure how to approach is the continuous updates of the image when the source (the project on GitHub above) changes.

The solution I will be using is to have nightly/hourly/... builds, which will eventually catch up with the changes and push a new image to my repository.

Are there better solutions (ones where I could have "something" trigger a build on my side)?

---
(*) while this question revolves around building docker images, it is the general approach I am really interested in (= how to "monitor for changes" a remote project)

https://redd.it/ecbgk0
@r_devops

Traefik 2 with GKE

Dear Peers,
Maybe someone can share your experience
Got following setup : GKE + Traefik as LB via Helm chart
At the moment, have to manually update the DNS A records to point to an externalIP , which gets assigned when we launch Traefik.
Looks like, it is not possible to assign static IP to Traefik to persist between restarts
I've tried following approach
1.gcloud compute addresses create gkestaticip --region

(\* tried alreadt both regional & global)
2. Setting **loadBalancerIP: 35.x.y.z**
No success, Traefik get a fresh IP from gcp the pool

Something i found on medium, though doesnt seem to work
[https://medium.com/faun/how-to-assign-external-ip-address-static-to-a-gcp-kubernetes-engine-service-c5be91cdcfd5](https://medium.com/faun/how-to-assign-external-ip-address-static-to-a-gcp-kubernetes-engine-service-c5be91cdcfd5)

https://redd.it/eca2ld
@r_devops

On-Call Nightmares Podcast - Episode 45 - Kelsey Hightower - Google

One of my favorite people in technology is hands down Kelsey, I was lucky enough to get a chance to talk to him about his career and life on-call.

[https://www.podomatic.com/podcasts/oncallnightmares/episodes/2019-12-19T08\_16\_15-08\_00](https://www.podomatic.com/podcasts/oncallnightmares/episodes/2019-12-19T08_16_15-08_00)

​

Thanks and let me know if you'd like to be on in the future. [https://twitter.com/oncallnightmare](https://twitter.com/oncallnightmare) or [[email protected]](mailto:[email protected]).

https://redd.it/ecvgxy
@r_devops

Phoenix Project - Kindle edition free today (UK)

Not sure how long it will be free, but in the UK it is currently free for kindle. Grab it while you can I guess?

[https://www.amazon.co.uk/Phoenix-Project-DevOps-Helping-Business-ebook/dp/B078Y98RG8](https://www.amazon.co.uk/Phoenix-Project-DevOps-Helping-Business-ebook/dp/B078Y98RG8)

(sorry if direct links aren't allowed)

https://redd.it/ecrjs0
@r_devops

If you could start from scratch, what would you use?

If you could go back and start your project again with the knowledge you have today, what would you use? Would you choose different tools, languages, infrastructure? Why? What did you learn that makes you think these would be better suited than what you currently are using?

https://redd.it/ecx197
@r_devops

how to pass ssh key into an instance with cloudformation

I need to clone repository which requires ssh key , and I want to pass ssh key to instance as text or as a parameter, so in cloudformation user data I can run bash script clone repo with ssh key to directory.
Is it possible?
any workaround ?

https://redd.it/ecz1xf
@r_devops

What is the best way to scale an node application?

Today I have an application that is separated in: An API, a crawler, and the processor. The crawler\`s job is to get the download URL for videos on YouTube and the processor process the video\`s information. My problem today is, the crawler is too fast for the processor and the queue gets enormous, I would like to scale my processor to match the demand (the processor is written in C and it runs on Linux). My ecosystem is currently running on GCP and I'm using rabbitMQ for the queue.

https://redd.it/ecy4a7
@r_devops

What do you guys use for centralised logging?

Just investigating which solution would be best for us at the moment. An ELK stack seems like overkill, cloudwatch -> s3 -> athena seems pretty alright. But if there's a quick and easy 3rd party tool we can just send logs to that would be preferable since we then don't have to worry about maintenance or setup of the tools.

https://redd.it/ecr8wg
@r_devops