Grafana & InfluxDB data backed by an NFS (EFS) mount

Hey there,

I was wondering, has anyone tried to use containerized grafana & influxdb with their data mounted via an EFS AWS volume (or any other network filesystem). Any idea on a good way to benchmark such a setup? Does it even make sense to try it?

https://redd.it/e5ldyr
@r_devops

Best open source monitoring tool

I'm learning devops, and doing it by setting up a homelab. My next step is to set up a monitoring/metric/alerting solution. I was looking at Elastic stack, since it pretty much meets my demands (yes I'm learning, but I still have some specific use cases). However their business practices recently has turned me off from them quite a bit.

I've looked at promethus+grafana, but it looks like that only metric collection, and not logging?

So my question is, what should I look into using? Is there a good (free) alternative to Elastic, or should I just bite bullet?

https://redd.it/e5xx7n
@r_devops

Software Inventarisation for Containers?

Hi, i know, for CVE/Security Scanning there are tools like clair and snyk... but.. are there tools which do software-inventarisation? like list all the packages of the software? does anyone know something like that?

https://redd.it/e5yn1f
@r_devops

Updating helm charts during CI/CD

Say I have one repo that contains my application code and Helm charts. I want to be able to commit code, build a docker image, and have my helm chart reference that new image. I want the version/tag to be auto generated so I don't have to update it by hand on every merge.


Are there any good examples out there of a similar work flow?

Is there a way to do this besides having a bot commit the auto-gen'd version?

https://redd.it/e60v5j
@r_devops

How to build a resume for DevOps beginner/entry level guy? Can I have a look at one/(or a draft)?

If you do not want to publish it online to the public, its fine by me. We can have a private conversation using DMs :)

https://redd.it/e61p2c
@r_devops

Do Leetcode and DevOps have any co-relation?

New to this sub. Spent hours reading posts on r/cscareerquestions about struggles of finding a job after graduation. I am an international student in Australia trying my best to keep my grades high, learn interesting tech, meet people and build side projects. That sub is partially occupied with people claiming to 'grind leetcode.'

Don't get me wrong, I love coding but I cannot tolerate the torture of writing code that is of no real use and hence I started discovering other options like Security and Cloud computing. I am learning Cloud Computing through Linux Academy and I find it challenging and interesting. My question is that:

•Whether I should continue with leetcode or drop it and start pursuing Certifications?
•Are those worth the time money and efforts? •What else should I work on to increase my chances to land up an interview and try to crack it successfully for my first job into cloud Computing or AWS?
• Should I apply to sysadmin roles to get started?
•Any suggestions on projects I should build? A list of project ideas to work on?

Thanks all.

https://redd.it/e61nfx
@r_devops

What can a college-going student do in order to get a DevOps job?

I'm currently in 2nd year of Engineering and I'm quite passionate about this. All I see is a roadmap but I'm need some fact checking. Should I go ahead with this?

https://redd.it/e5y3dy
@r_devops

Downloader process

Hi everyone, I'm trying to implement a process to download logs from several IoT servers (assume you have multiple devices) and I'm looking into the best/fastest way to have a process running and it accumulates the data to a database or a datalake, and whether I should consider batch or streaming process, can you please share any resources for that type of architecture?

https://redd.it/e670gy
@r_devops

Out-of-State On-Site Interviews

Is it normal for company to pay for expenses to/from an on-site if it's out of state?

I've never had an out-of-state interview before. While I've worked in the industry for \~20 years, this is a first for me. Anyone else care to share their experience? I'm currently in a "can't hurt to ask" mode.

https://redd.it/e68uhr
@r_devops

What does your CI/CD pipeline look like?

Newbie here – trying to broaden his perspective! I am not looking for an universal answer :)

In what way is your CI/CD pipeline unique? What would you change if you had the time and means to?

For instance: is your infrastructure expressed as code – and what tool do you use? Do you deploy every feature branch to a standalone environment? How do you keep your codebase clean and secure? Are you running code analysis, checking your configuration for dangerous values, looking for lost credentials? Etc.

How much time does a feature take to hit production once it's finished? How much does one have to wait to know if their work is in a mergeable state? And of course: how much does all of this cost and how do you justify those costs to the management?

Thank you for your time :)

https://redd.it/e695s4
@r_devops

How hard is it for an American to get a position in Germamy

My girlfriend is interested in potentially doing a masters next year in Essen, and I'd ideally like to avoid doing the long distance thing. I speak basically zero German, but I'm a pretty solid engineer and will have about 5 years in the industry by the time the move comes. Anyone have an idea of how difficult would it be for me to get a job and worker's visa over there?

https://redd.it/e68avb
@r_devops

Using Helm with cert manager

I am working on a creating a new deployment using Helm and would like to know if I have my API GW container running on port 8080 for example how I would go about making the helm chart work with the cert manager? I don't think the port matters but was unsure what I needed to add to the helm chart to make it work with cert manager. I checked the docs and didn't see it. I am sure it's there though and I am likely looking in the wrong place, any chance someone would be able to point me to the right docs or would be able to point me to a guide/blog post about it?

https://redd.it/e6ajl3
@r_devops

In one year, can someone go from help desk to Junior Cloud Engineer?

If they were to learn the following at a fundamental level + with a fundamental understanding of Linux administration and networking:

- Ansible
- Terraform
- Docker
- Kubernetes
- Python

https://redd.it/e6e8q7
@r_devops

Kubernetes implementation for CI

Hey people, I was wondering if you could give some insights on the best/fastest K8s implementation to use that can be run during CI for E2E testing.

I'm in-between either Microk8s, K3s or Minikube.
The viable choice seems to be K3s ATM.

EDIT:
We're using CircleCI.

https://redd.it/e6edme
@r_devops

Managing build dependencies and artifacts

I work on a macOS project which is in a monolithic repo. I'd like to split it up in order to minimise what is rebuilt and to be able to avoid requiring all dependents having to use the latest changes to their dependencies.

It would be awesome but not essential if developer and CI/CD builds could make use of a shared cache of debug and release pre-built binaries, all the way from shared objects to notarised packages.

It has a diverse set of artifacts and a fairly complex build pipeline:
* Static C++ libraries, Qt/C++ daemons and a GUI bundle
* A Swift Finder Sync Extension
* Swift libraries, bundles and a binary
* An Objective C library and a plugin bundle
* An IOKit kernel extension
* Signed and unsigned packages
* Notarisation of released builds
* An installer project which brings most of these artifacts together - the daemons, GUI, kernel extension, etc.

I'm currently investigating Conan and Bazel. We've started to use Swift Package Manager for the Swift/Objective C libraries.

There are lots of ways to do this and I'm sure some will lead to more trouble than they're worth, so I'd like to see if any of you have experience or advice from similar conversions?

https://redd.it/e6f99s
@r_devops

How to get better at obtaining a developer mindset?

Background: I have 10 years experience with infrastructure support/software support and strong Powershell knowledge with some understanding of Python. I’m currently in a role where I’m managing AWS infrastructure / monitoring (Datadog, Grafana, CloudTrail) as well as handling business application batch automation / system checks using an enterprise job scheduler.

My problem is that, while I’m not really considered DevOps within my company, we’ve been slowly ramping up things like source control (Bitbucket / Git for my team), release processes, proper validation testing, and my boss basically told me bluntly that it seems like any time I push something into production it doesn’t work 100% correctly. I’ve never really been in a position where I had to worry about the dev side of things; I’m a complete amateur when it comes to “best practices” of writing code since I’ve never really had my work reviewed and I was just known in my previous jobs as “the kid who could write scripts and get things done” by the older guys.

I know I have a knack for it but I just seem to have trouble hitting the mark with making sure all of my ducks are in a row with testing and releasing to production environments. Anyone have any tips or recommendations to help me improve or change my way of thinking?

https://redd.it/e6b1mn
@r_devops

Need advice on setting up cross account jenkins deployment in AWS

I want to set up a jenkins build from our “Non-Prod” (basically test environment)  AWS account to  another Account called “BI-Prod". I essentially want jenkins in Non-Prod environment to deploy data pipeline in BI-Prod. I am thinking to follow the approach where you a create role in the target account with the correct permission and create some sort of shell script in Non-Prod Jenkins master to STS assume that role in that BI account to deploy data pipeline. Is this right concept to follow ? Is there other way to implement this for best practises ?

https://redd.it/e68hkp
@r_devops

The State of Kubernetes Development Tooling

This is a 30 minute talk from GOTO Berlin 2019 by Ellen Körbes, life-long command-line dweller and developer relations at Garden. Check out a link to the talk along with full talk abstract below:

[https://youtu.be/b1RsNXGLuUk?list=PLEx5khR4g7PKMVeAqZdIHRdOwTM1yktD8](https://youtu.be/b1RsNXGLuUk?list=PLEx5khR4g7PKMVeAqZdIHRdOwTM1yktD8)

With Kubernetes emerging as the de facto standard for service orchestration, the discussion is shifting from "How does Kubernetes work?" to more specific concerns such as "How do I achieve an optimal development workflow?"

The answer lies in finding combinations of tools that work together in synergy. They should produce end-to-end workflows that perform effectively in the real world, while also covering a wide range of development stages—building, deploying, debugging, and so on.

Goal in mind, let's dive into the tooling available in the current landscape—tools such as Helm, Draft, Skaffold, Forge, Telepresence, Garden, and Tilt.

We'll map their capabilities to developer needs, then outline workflows developers can use in practice right away.

**What will the audience learn from this talk?**
Attendees will learn combinations of tools they can use to have an effective workflow for developing applications that run on Kubernetes.

https://redd.it/e6h752
@r_devops

Out-of-state On-Site Interviews

Is it customary for a hiring company to compensate a candidate for travel expenses to/from an on-site interview if its out-of-state?

I've been in the industry for nearly 20 years, but I've never interviewed out-of-state before. I'm looking to see what other people have had for experience. I'm currently operating with a "can't hurt to ask" mentality.

Thanks for any feedback.

https://redd.it/e69ebc
@r_devops

Sonatype Nexus search api does not return all the artifacts

We use sonatype nexus OSS 3.14.0-04 to store all our artifacts and we use Jenkins as our CI/CD took. I introduced snapshot support recently. From Jenkins I use the below groovy script to fetch all artifact versions and populate an Active choice drop-down:

​

`#!/usr/bin/env groovy`

`import groovy.json.JsonSlurper`

​

`#source can be "snapshot" or "release". - source is an Active choice parameter with these two options. I read from the source field.`



`def url = "https://<<<nexus-host>>>/service/rest/v1/search?repository=maven-" + source + "s&`[`maven.groupId=com.xyz`](https://maven.groupId=com.xyz)`&maven.artifactId=rader"`

`def xml = url.toURL().text`

`JsonSlurper parser = new groovy.json.JsonSlurper()`

`Map parsedJson = parser.parseText(xml)`

`def versions = parsedJson.items.version`

&#x200B;

`if (source.equalsIgnoreCase('snapshot')) {`

`Set<String> modVersion = new HashSet<>()`

`for (def item : versions) {`

`modVersion.add(item.split("-").getAt(0) + "-SNAPSHOT")`

`}`

&#x200B;

`return new ArrayList<>(modVersion).sort()`

`} else {`

`return versions.reverse()`

`}`

&#x200B;

The problem is, this does not always return all the artifacts both in snapshot and release. I have to go and delete some older artifacts to make the newer ones appear on the list.

I do not see anything suspicious in the log and not sure how to proceed to troubleshoot this. Is there a better way of achieving the same? Any pointer would be highly appreciated.

https://redd.it/e6c0tb
@r_devops

How did you start out before becoming DevOps?

Hello, I just graduated last year, and currently working as an IT support. I just realize that I have a passion for writing Python automated script to do my boring daily routine tasks. Therefore, I'm thinking of becoming a DevOps in the next year or two.

According to my research, there are not many DevOps junior positions.

* So how did you guys start out before becoming a DevOps Engineer?
* Do you like this job or not? Any hardship?
* What about job security and growth?
* Any advice on becoming a DevOps?

Thank you for reading my post. I'm looking forward to your answers soon.

https://redd.it/e68rfi
@r_devops