Bitbucket pull request notifications for triggering builds

For those of you who use Bitbucket, how do you handle pull request notifications?

We were using a plugin, but after a Bitbucket upgrade, it all stopped working. Looking for a more permanent solution.

The plugin offered tons of parameters such as the email of the author of the pull request and the commit hash of the branch, but Bitbucket's hooks don't include that functionality.

https://redd.it/e5qz23
@r_devops

Dev image customizations?

With dev, build, test, and prod running the same image, I was wondering how devs using those images handle customization. Like dotfiles and stuff.

What do you guys do?

https://redd.it/e5q2nn
@r_devops

Database IaC solution for private networks?

Lately I've been trying to figure out what's the best way to maintain the database IaC I've mounted for my instances. I've always pushed the 'fix it' now solution but I don't know what would be the best one, I always feel like it's not enough.

The first thing I did was using the google provider of Terraform, and yes, almost every single piece of the infrastructure is in Terraform. The thing is that I was also in charge of user and schema management and soon I realized that GCP CLI doesn't support something as essential as MySQL grants, so I migrated into the terraform MySQL provider. So, the MySQL provider works like a local MySQL client and I'm also running terraform locally so that means Terraform connects to the instance to run code and to even run a plan so I need to be whitelisted beforehand.

Right now I'm in the process of making those instances private and that would mean they would be unreachable for my MySQL provider. the next move I'm planning would be moving terraform into the vpc. That'd mean getting instances (1 for each env) do a little app with simple APIs that run every tf command, RBAC and auditing. But I don't think I like the idea of maintaining that and I don't think it's a robust solution.

So my other option would be Terraform cloud, which has all I need, but the problem is that my DBs would be unreachable, to solve that I've tried an ssh provider I found [https://github.com/stefansundin/terraform-provider-ssh](https://github.com/stefansundin/terraform-provider-ssh) so I can tunnel through the bastion because Terraform is not supporting SSH tunneling yet, but it's not working I don't know why, also that doesn't sound solid to me as well. Another solution I thought could be detaching the MySQL code and get that into a terraform module inside the VPC that runs separately.

I'm also considering Terraform enterprise which is self hosted so I can put that inside my VPC to reach the instances, I have to test it out but that sounds like a possible solution.

I'm also considering moving away from terraform for MySQL management but I don't know of another tool (I've tried Liquibase which is not meant for something like this) .

I'd really appreciate any advice!

https://redd.it/e5o3gy
@r_devops

OpenTracing vs AWS X-Ray

I'm evaluating distributed tracing solutions for my current company. Does anyone have any advice as to whether AWS X-Ray or OpenTracing (Jaeger, for instance) is a better approach?

https://redd.it/e5n3yp
@r_devops

Edge proxy for Consul Connect?

I know this one has made its round but I'm wondering if anyone has come up with anything in last month?

[It has been added to v1.7.0 milestone](https://github.com/hashicorp/consul/issues/5695#issuecomment-539540302) but who knows when will that come out, and how stable will it be on the first day.

I've also skimmed through [the forum](https://discuss.hashicorp.com/t/edge-load-balancing-for-consul-connect/2993/9) and tried a lot of things that are mentioned in the comments but can't get reliable results from anything.

Today I'm going to try the recently released support for root and leaf CA in [consul-template](https://github.com/hashicorp/consul-template#caleaf) and put together a frankenproxy with Envoy and consul-template, lets see how that goes.

https://redd.it/e5gvad
@r_devops

Grafana & InfluxDB data backed by an NFS (EFS) mount

Hey there,

I was wondering, has anyone tried to use containerized grafana & influxdb with their data mounted via an EFS AWS volume (or any other network filesystem). Any idea on a good way to benchmark such a setup? Does it even make sense to try it?

https://redd.it/e5ldyr
@r_devops

Best open source monitoring tool

I'm learning devops, and doing it by setting up a homelab. My next step is to set up a monitoring/metric/alerting solution. I was looking at Elastic stack, since it pretty much meets my demands (yes I'm learning, but I still have some specific use cases). However their business practices recently has turned me off from them quite a bit.

I've looked at promethus+grafana, but it looks like that only metric collection, and not logging?

So my question is, what should I look into using? Is there a good (free) alternative to Elastic, or should I just bite bullet?

https://redd.it/e5xx7n
@r_devops

Software Inventarisation for Containers?

Hi, i know, for CVE/Security Scanning there are tools like clair and snyk... but.. are there tools which do software-inventarisation? like list all the packages of the software? does anyone know something like that?

https://redd.it/e5yn1f
@r_devops

Updating helm charts during CI/CD

Say I have one repo that contains my application code and Helm charts. I want to be able to commit code, build a docker image, and have my helm chart reference that new image. I want the version/tag to be auto generated so I don't have to update it by hand on every merge.


Are there any good examples out there of a similar work flow?

Is there a way to do this besides having a bot commit the auto-gen'd version?

https://redd.it/e60v5j
@r_devops

How to build a resume for DevOps beginner/entry level guy? Can I have a look at one/(or a draft)?

If you do not want to publish it online to the public, its fine by me. We can have a private conversation using DMs :)

https://redd.it/e61p2c
@r_devops

Do Leetcode and DevOps have any co-relation?

New to this sub. Spent hours reading posts on r/cscareerquestions about struggles of finding a job after graduation. I am an international student in Australia trying my best to keep my grades high, learn interesting tech, meet people and build side projects. That sub is partially occupied with people claiming to 'grind leetcode.'

Don't get me wrong, I love coding but I cannot tolerate the torture of writing code that is of no real use and hence I started discovering other options like Security and Cloud computing. I am learning Cloud Computing through Linux Academy and I find it challenging and interesting. My question is that:

•Whether I should continue with leetcode or drop it and start pursuing Certifications?
•Are those worth the time money and efforts? •What else should I work on to increase my chances to land up an interview and try to crack it successfully for my first job into cloud Computing or AWS?
• Should I apply to sysadmin roles to get started?
•Any suggestions on projects I should build? A list of project ideas to work on?

Thanks all.

https://redd.it/e61nfx
@r_devops

What can a college-going student do in order to get a DevOps job?

I'm currently in 2nd year of Engineering and I'm quite passionate about this. All I see is a roadmap but I'm need some fact checking. Should I go ahead with this?

https://redd.it/e5y3dy
@r_devops

Downloader process

Hi everyone, I'm trying to implement a process to download logs from several IoT servers (assume you have multiple devices) and I'm looking into the best/fastest way to have a process running and it accumulates the data to a database or a datalake, and whether I should consider batch or streaming process, can you please share any resources for that type of architecture?

https://redd.it/e670gy
@r_devops

Out-of-State On-Site Interviews

Is it normal for company to pay for expenses to/from an on-site if it's out of state?

I've never had an out-of-state interview before. While I've worked in the industry for \~20 years, this is a first for me. Anyone else care to share their experience? I'm currently in a "can't hurt to ask" mode.

https://redd.it/e68uhr
@r_devops

What does your CI/CD pipeline look like?

Newbie here – trying to broaden his perspective! I am not looking for an universal answer :)

In what way is your CI/CD pipeline unique? What would you change if you had the time and means to?

For instance: is your infrastructure expressed as code – and what tool do you use? Do you deploy every feature branch to a standalone environment? How do you keep your codebase clean and secure? Are you running code analysis, checking your configuration for dangerous values, looking for lost credentials? Etc.

How much time does a feature take to hit production once it's finished? How much does one have to wait to know if their work is in a mergeable state? And of course: how much does all of this cost and how do you justify those costs to the management?

Thank you for your time :)

https://redd.it/e695s4
@r_devops

How hard is it for an American to get a position in Germamy

My girlfriend is interested in potentially doing a masters next year in Essen, and I'd ideally like to avoid doing the long distance thing. I speak basically zero German, but I'm a pretty solid engineer and will have about 5 years in the industry by the time the move comes. Anyone have an idea of how difficult would it be for me to get a job and worker's visa over there?

https://redd.it/e68avb
@r_devops

Using Helm with cert manager

I am working on a creating a new deployment using Helm and would like to know if I have my API GW container running on port 8080 for example how I would go about making the helm chart work with the cert manager? I don't think the port matters but was unsure what I needed to add to the helm chart to make it work with cert manager. I checked the docs and didn't see it. I am sure it's there though and I am likely looking in the wrong place, any chance someone would be able to point me to the right docs or would be able to point me to a guide/blog post about it?

https://redd.it/e6ajl3
@r_devops

In one year, can someone go from help desk to Junior Cloud Engineer?

If they were to learn the following at a fundamental level + with a fundamental understanding of Linux administration and networking:

- Ansible
- Terraform
- Docker
- Kubernetes
- Python

https://redd.it/e6e8q7
@r_devops

Kubernetes implementation for CI

Hey people, I was wondering if you could give some insights on the best/fastest K8s implementation to use that can be run during CI for E2E testing.

I'm in-between either Microk8s, K3s or Minikube.
The viable choice seems to be K3s ATM.

EDIT:
We're using CircleCI.

https://redd.it/e6edme
@r_devops

Managing build dependencies and artifacts

I work on a macOS project which is in a monolithic repo. I'd like to split it up in order to minimise what is rebuilt and to be able to avoid requiring all dependents having to use the latest changes to their dependencies.

It would be awesome but not essential if developer and CI/CD builds could make use of a shared cache of debug and release pre-built binaries, all the way from shared objects to notarised packages.

It has a diverse set of artifacts and a fairly complex build pipeline:
* Static C++ libraries, Qt/C++ daemons and a GUI bundle
* A Swift Finder Sync Extension
* Swift libraries, bundles and a binary
* An Objective C library and a plugin bundle
* An IOKit kernel extension
* Signed and unsigned packages
* Notarisation of released builds
* An installer project which brings most of these artifacts together - the daemons, GUI, kernel extension, etc.

I'm currently investigating Conan and Bazel. We've started to use Swift Package Manager for the Swift/Objective C libraries.

There are lots of ways to do this and I'm sure some will lead to more trouble than they're worth, so I'd like to see if any of you have experience or advice from similar conversions?

https://redd.it/e6f99s
@r_devops