Is Jenkins the best on prem build tool?

For a variety of reasons, we're forced to use only on prem build tools. And while there's tons of hosted options out there, there seems be very little competition otherwise.

We did look into team city, but got a bit of sticker shock. We don't mind paying for tools, but holy shit.

https://redd.it/g3gibh
@r_devops

Linux vs aws, azure

My job is kinda forcing me towards the middleware red hat amq route. I don’t know jack about it so I’m thinking of signing up to Linux academy. On there I see courses for aws, azure. I don’t get it what does Linux have to do with azure. Doesn’t Microsoft have its own os? I can understand why aws would run on Linux I suppose.

Second question are the terms middleware, devops cloud. Are middleware and devops considered cloud tech? Thanks

https://redd.it/g3f7n3
@r_devops

Has anyone setup Jaeger with AWS Elasticsearch

I'm trying to setup Jaeger with AWS ES, but I get the following error from the jaeger collector

```
"failed to create primary Elasticsearch client: health check timeout: no Elasticsearch node available"
```


```
{"level":"fatal","ts":1587117078.5171704,"caller":"command-line-arguments/main.go:70","msg":"Failed to init storage factory","error":"failed to create primary Elasticsearch client: health check timeout: no Elasticsearch node available","stacktrace":"main.main.func1\\n\\tcommand-line-arguments/main.go:70\\[ngithub.com/jaegertracing/jaeger/vendor/github.com/spf13/cobra.(\*Command](https://ngithub.com/jaegertracing/jaeger/vendor/github.com/spf13/cobra.(*Command)).execute\\n\\[tgithub.com/jaegertracing/jaeger/vendor/github.com/spf13/cobra/command.go:698\\ngithub.com/jaegertracing/jaeger/vendor/github.com/spf13/cobra.(\*Command](https://tgithub.com/jaegertracing/jaeger/vendor/github.com/spf13/cobra/command.go:698\ngithub.com/jaegertracing/jaeger/vendor/github.com/spf13/cobra.(*Command)).ExecuteC\\n\\[tgithub.com/jaegertracing/jaeger/vendor/github.com/spf13/cobra/command.go:783\\ngithub.com/jaegertracing/jaeger/vendor/github.com/spf13/cobra.(\*Command](https://tgithub.com/jaegertracing/jaeger/vendor/github.com/spf13/cobra/command.go:783\ngithub.com/jaegertracing/jaeger/vendor/github.com/spf13/cobra.(*Command)).Execute\\n\\[tgithub.com/jaegertracing/jaeger/vendor/github.com/spf13/cobra/command.go:736\\nmain.main\\n\\tcommand-line-arguments/main.go:117\\nruntime.main\\n\\truntime/proc.go:203](https://tgithub.com/jaegertracing/jaeger/vendor/github.com/spf13/cobra/command.go:736\nmain.main\n\tcommand-line-arguments/main.go:117\nruntime.main\n\truntime/proc.go:203)"}
```

I am using the official Jaeger chart.

Following is a curl response from the ES cluster,

```
root@ubuntu-84697fcc95-bvg7t:/# curl -X GET https://xxxxxxx.es.amazonaws.com:443/_nodes/http?pretty
{
"_nodes" : {
"total" : 2,
"successful" : 2,
"failed" : 0
},
"cluster_name" : "xxxxx",
"nodes" : {
"9HtXgDe-SBqYLEkFtx4vrA" : {
"name" : "9HtXgDe",
"version" : "6.2.3",
"build_hash" : "c59ff00",
"roles" : [ "master", "data", "ingest" ]
},
"u3xYMULYR0ObHsuUOKKdXQ" : {
"name" : "u3xYMUL",
"version" : "6.2.3",
"build_hash" : "c59ff00",
"roles" : [ "master", "data", "ingest" ]
}
}
}
```

https://redd.it/g2z19z
@r_devops

Docker project idea suggestions for newbie

Hey there I am new to DevOps, I am learning docker right now, I was given a task to use docker and solve any common problem that a developer or any person faces in daily life, I am out of ideas, would anyone of you suggest something😅,
Currently I have basic knowledge about docker containers, volumes, network, patting(port address translation), docker compose, and other basic stuff, I have to build something using these concepts.

https://redd.it/g2vb68
@r_devops

Does it pay off to host apaches behinx nginx proxy instead of proxying nginx behind nginx?

For me as a more dev guy its all about commonly used .htaccess by third party modules

I feel like in most cases its about the .ht files.

While I understand the idea behind nginx not having equivalent of .ht files, the usual developer in most cases wants that possibility (ie. SEO reasons) and if he hears something like "nginx-first app" then i suppose he will be like "un oh we don't do that here"

https://redd.it/g2zfl9
@r_devops

Make APIs simple again!

Hi everyone!

My name is Johnny, my team and I developed a platform to simplify all the steps for developers to deploy, scale and consume APIs.

What are the biggest challenges you guys face in this whole process? And if you want to make money with your cloud function, how you do it?

Thanks, stay safe.

https://redd.it/g2rrm7
@r_devops

Provisioning a highly available load balancer in Hetzner Cloud with Ansible, haproxy and keepalived

Hi! For anyone interested, German provider Hetzner has published an article of mine in their tutorials library on provisioning HA LBs with Ansible. Some bits are specific to Hetzner Cloud ma can be easily adapted to other providers who have APIs to manage floating IPs for the failover. Here's the link, hope it's useful.

https://community.hetzner.com/tutorials/howto-highly-available-load-balancer-hetzner-cloud-ansible

https://redd.it/g2iek3
@r_devops

Testing & validating AMIs

I'm building AMIs with Packer right now, and I'm interested in writing tests to validate my images and make assertions about their state, to basically automatically verify that all the dependencies I need are properly installed.

I could just write a shell script to do this, but I'd like to avoid reinventing the wheel if possible. Are there any tools/frameworks that can do something like this?

https://redd.it/g2mhoo
@r_devops

Where can I go constructively volunteer my free time and continue learning while unemployed?

I recently got terminated from a position and, due to the pandemic, worried it might be a little while before I can land the next position. Anyone know of good volunteer opportunities with non-profits out there where I can go volunteer my time and continue working on DevOps projects? Just want to make sure I'm not staying idle and find a way to continue contributing.

https://redd.it/g2hswf
@r_devops

Does anyone here have a side devops gig?

What sites/resources do you guys use to pick up short term contracting jobs in devops field. I live in Alaska, so most of my options are most likely remote jobs anyway.

Apologies in advance if this isn't the right sub for this.

https://redd.it/g2m2mr
@r_devops

SSD OR HDD

Hey folks, I'm trying to run a multithreaded python application on EC2 instance, which type of ebs storage should I use? The machine is basically for migration so lot of memory, network and disk resources will be utilised. The data could be anywhere around 50 TB, do you also think if amazon efs would be useful, I'm a newbie in AWS...

Thanks!!

https://redd.it/g2i0pw
@r_devops

how to land job in devops?

Good day guys, I've been a developer for quite sometime. I'm interested in the role of devops and started learning courses online. I have successfully deployed on GKE witn Ingress, Helm, Ngix, Docker.

I'd like to know where or how can I find this role. Just a bit background of myself. I've been doing freelance for the past 2 years of my dev career but I wasn't able to get into a team where this techs and methodology is used. Majority of the project I encounter were for individual web app and hybrid apps.

Thank you in advance.

https://redd.it/g3owqs
@r_devops

Update systemd controlled Docker containers

Hi folks,

I'm migrating infrastructure over to docker and I'd like to start the images with systemd as the IAAS provider we are bound to is notorious for restarting machines without warning.

For the production environment I plan to pin the deployed image tags, but for staging, I need to be able to update them automatically through a CI job.

I'm wondering how I could get the automatic updates in place without committing to the infrastructure repository (at least that would feel strange to me). My ideas vary around using sed to replace the systemd unit files and running ansible again with an overwrite-vars file, but both options seem to be cumbersome. Is there a better way I'm missing?

https://redd.it/g3nd01
@r_devops

Looking for a realtime configuration management solution

Hey,

Curious to know what is your experience with configuration management. Looking for a solution that allows for real-time configuration management and monitoring, specifically one that clearly reflects what's it the effective configuration **currently** running per each service on each node.

Also, I would love to know how well do these solutions work with a hybrid environment that runs both a K8S cluster and bare, non-orchestrated applications and services?

https://redd.it/g2hvq5
@r_devops

Did AWS just kill Docker AND Kubernetes with 1 Announcement?

What do you guys think? AWS appears to just have made K8 without the complexities of K8.
[https://medium.com/devops-dudes/did-aws-just-kill-docker-and-kubernetes-with-1-announcement-d7caf5ee4ced](https://medium.com/devops-dudes/did-aws-just-kill-docker-and-kubernetes-with-1-announcement-d7caf5ee4ced)

https://redd.it/g2odpj
@r_devops

MicroK8s?

I have a dedicated and a few VPS systems to which I'm thinking about converting over to MicroK8s. Does anyone have some experience with it? And is it worth the hassle?

https://redd.it/g3wkci
@r_devops

How can we step our game up?

Hi, we are a small dev teams into a small business but we would like to step our game up. We are using devops obviously and we would like use it the best way we can to step our game. We use branches policies that force 2 senior to do code reviews with pull requests. We have development, staging, production environments. We recently added whitesource builds that look for vulnerabilities in our projects. Is there any tools like sonarqube that we could use in a small enterprise for free? What else could we use to set more validations or just set our game up to exploit devops better?

https://redd.it/g481tt
@r_devops

Docker Images : Reducing Image Size

When getting started with containers, it’s pretty easy to be shocked by the size of the images that we build. We’re going to review a number of techniques to reduce image size, without sacrificing developers’ and ops’ convenience. In this first part, we will talk about multi-stage builds, because that’s where anyone should start if they want to reduce the size of their images. We will also explain the differences between static and dynamic linking, as well as why we should care about that. This will be the occasion to introduce Alpine.

https://www.ardanlabs.com/blog/2020/02/docker-images-part1-reducing-image-size.html

https://redd.it/g46atx
@r_devops

Best bare metal provisioning tools for Dell servers?

I am in search of a tool to do bare metal discovery. Essentially I need an image I can network boot (PXE/Bios or UEFI) which can discover all components in the server (CPU/disks/memory/NIC models/etc), firmware versions, what switch ports everything is cabled up to via LLDP, and report all that back to some sort of inventory tool which has an API. These are all Dell servers with an enterprise iDRAC license but multi vendor support is a plus. Once I have all this data I'd like to build some automation so that I can say build a server with this profile and it will query the API for a server meeting those specs and then go and setup the bios options, RAID, configure the switch ports (in a port channel), add an entry for a PXE install (we currently use cobbler, but open to alternatives), then PXE boot to install the OS/desired config. That would almost certainly be Ansible based.

There are several open source bare metal provisioning tools out there but I've not had any experience with any of them except a little Foreman which seemed to be a huge effort to integrate with our existing puppet infrastructure and other existing tools. Can any of them do what I want, or a slightly modified work flow that can achieve the same end result? LLDP info is critical because we currently rely on recording that manually in our inventory tool when we rack new equipment (before the OS install, at which point it's automatically reported if the OS install supports that) and that manual recorded data is all too often wrong/missing and we have to look for it on the switch to figure out where things are actually cabled.

I've thought about just building a live image that can do what we want, we already have an inventory tool we can use to report to, but that might just be extra work on our part that can be avoided with an existing tool.

https://redd.it/g4bnex
@r_devops

Logging additional metadata

In February, before the lockdown, I presented my **Fast logs** talk at ConFoo. At the end, I had an interesting question I had to cut short because of the timing. This blog post aims to describe the relevant points of the talk, the question, as well as some possible answer.

https://blog.frankel.ch/logging-additional-metadata/

https://redd.it/g4aii5
@r_devops