Helm Umbrella charts and ArgoCD/Flux

Hi everyone,

Current setup

60 microservices
Helm umbrella chart, all microservices as subcharts

​

I would like to move to the 'GitOps' model where the developer would use a PR to change the version of an image/Chart and that would be reflected in the environment.

​

1. Can I use ArgoCD/Flux v2 with my existing Helm umbrella chart (with its subcharts) or do I have to add individual helm charts in each of the 60 microservices repos?
2. Will the microservices be displayed as one app or the tools will figure out there are 60 of them?
3. Anyone have a similar case they tried out? Which one (argo/flux) worked best for this scenario

​

Thanks

https://redd.it/l2rb1y
@r_devops

React App Slow Startup Time in Docker Container on k8s

This maybe better suited for a react sub but wanted to start asking infra folks.

I'm experiencing very slow start up times for a production webapp built with react in a docker container. Base image is node:14.2.0-alpine3.10. Experiencing maybe 5 minute avg startup time in a deployed container on kubernetes. Locally around 5m as well.

Does this seem reasonable for anyone else deploying react applications in docker? Even testing locally the startup time for my react app feels atrocious. Looking for any optimization tips for the container or resources to try to improve these times.

Edit: Dockerfile & Package.json for context

https://redd.it/l2wml0
@r_devops

SigNoz - Open-source alternative to DataDog. Would love some feedback!

Hi r/devops

Wanted some feedback on our project to build an open source alternative to DataDog.

In my past roles, I spent a lot of time debugging issues in production. To solve this, we tried to build something using Prometheus & Grafana, but it didn’t give us the complete experience as an APM product like DataDog does. Hence, we thought of building an end to end open-source product with seamless integration of metrics & traces.

https://github.com/SigNoz/signoz

Would love to get any feedback from you on the project and if it is useful/not useful

https://redd.it/l2ss9o
@r_devops

Fulfilling the promise of CI/CD

https://stackoverflow.blog/2021/01/19/fulfilling-the-promise-of-ci-cd/

Does your org continuously deploy? I've been doing doing so for the past 10 years, but had to stop at my last job because a random auditor decided it was too risky. They made me install an "approval" gate, which was really just theater and caused changes to batch up.

https://redd.it/l2sl3k
@r_devops

What do you do?

As DevOps Engineers, I wonder how do you reply to this common question to people that are not familiar with the Tech industry.

I use to give them a long answer including software deployment, automation, pipelines, etc. but I noticed that it was confusing for many of them.

Nowadays I just reply that I'm a Software Engineer that works specifically on the backend side.

https://redd.it/l2rmys
@r_devops

Running docker from scripts

I'd like to set up my pipeline so that I can run most of it on my own machine. I've noticed that most of the CI systems use their own config syntax to define running containers -- I was thinking about using docker-in-docker so that my own code spins up the various dependency services.

Is this a terrible idea for any reason? I'm surprised I haven't seen more people do it that way. I don't particularly dislike the yaml config syntax, but AFAIK none of the CI platforms have local running as a first-class feature, so I always end up duplicating stuff. Take running integration tests, for instance: I need to spin up my application along with some related services. I've got a script that does this locally, for development, and then the yaml that does it in CI. They get out of sync over time, and it's kinda awkward.

https://redd.it/l323z5
@r_devops

Encrypted Registry Account Credentials with Codeship and Github Container Registry

Hi everyone,

apologies of this has been asked before.

I have been going through the documentation for codeship to see if I can pull an image for docker from a private github container registry (GHCR) when I am automating my build process.

The documentation specifies docker registries but nothing for the GHCR.

Has anyone used Codeship to pull docker images from the GHCR?

The documentation specifies that the most common way authenticate with image registries is to provide your account credentials via an encrypted dockercfg file. The example is as follows:

{

"auths": {

"`https://index.docker.io/v1/`": {

"auth": "your_auth_string",

"email": "your_email"

}

}

}

(sorry about the indentation)

This file will later be encrypted as per the instructions in the docs which can be found here

I was wondering if anyone has used this for GHCR, and if they have my question is whether one can simply replace the URL with the GHCR URL and pass it the email and personal access token used to access the packages or in this case images in the GHCR?

https://redd.it/l2pdz4
@r_devops

AWS Beanstalk environment management config support Japanese language???

Config Environment properties Japanese.

I have config title email in ENV but when i get email from it converted to "???". Any solutions?

https://redd.it/l33lf7
@r_devops

quick file sharing solution :-)

Have you ever neeeded to quickly copy a file from one computer to another, but... the boxes did not want to talk to each other? (For example one is Windows machine, and the other one is livecd-booted Linux without samba client...) Yes, me too... :-)

Have fun: https://hub.docker.com/r/michabbs/trashbox

https://redd.it/l2vxi3
@r_devops

Some career advice needed

Hi! I've been unemployed for a while now and I'm looking to get back into the working space.

I have chosen a government funded .NET coding bootcamp that I am planning on following. Now, as I might have expected the government services are not really premium quality service and it's taking forever to hear from these people. I am therefor planning on maybe pursuing a career as a devops engineer.

I have had multiple job offerings for devops engineer positions because of my Linux experience and my home python coding projects, but I am hesitant to go into devops. I am well aware that Devops people have to code as well, but I am only seeing things like ansible and terraform scripts as "coding", with some bash en python on the side. What I was looking for in coding is more like back-end coding (writing program logic, managing databases,..) and maybe some scripting as wel (terraform, ansible). I wonder if going into devops will give me a lot of opportunities to do the back-end stuff as well, instead of only scripts with IaC tools and automation.

I don't know if I'm making sense or if people will understand what I mean, English is my second language and I'm often not very good at explaining myself. XD But I thought I would give it a shot on this SR anyway. Thanks!

https://redd.it/l2n8rw
@r_devops

What would be the best way to automate android mobile device to turn on smart lights on and off?

Workflow

Pair Android device with RPI through an app (GE, Philips)

Pair smart bulb to RPI BLE using the app

Turn smart bulb on and off continuously from the app.

​

Trying to check BLE connectivity by using the app to ensure, the app is not the cause of packet delivery/scanning etc... While having multiple beacons advertising near by.

Was thinking about learning Appium but not sure if this is the most efficient way.

Thanks!

https://redd.it/l2ebkr
@r_devops

VM health status on telegram

Looking for ideas.

​

I would like to create telegram bot that sends messages to Vcenter adminsitraors when a node is having issues..

Any ideas how i can integrate that?

​

Currently testing out using Rundeck with Ansible for CD and CI. And using packer to 'pack' VMs

Works perfectly.

​

Can integreate telegram to Rundeck?

I am using the community version of Rundeck.

I willing to explore other tools as well

https://redd.it/l37ac0
@r_devops

Are build & test really parts of a DevOps engineer job?

I've red many articles about the tasks of a devops engineer and almost all of them emphasize on learning tools like maven for build and selenium for testing.
And now my questions are:

1) If i as a (future)Devops engineer have to build and test a software, then what developers and QAs are doing?!

2) If build and test are really parts of a DevOps engineer job then why i don't see them in the skill requrements of job offers?!

Thank you for clarifying me in advance. 🙏🏻

https://redd.it/l2e428
@r_devops

Job Framework recomendations?

Hi Everyone,

I am building a very data heavy application, which uses a lot of code (python scripts/executables/etc.) that periodically execute and perform tasks.

In the past I've used Jenkins for this, it was easy to schedule and monitor how the tasks do (the log print outs from builds are nice), see failures, add new tasks etc. However this dosen't seem like the right usecase for jenkins, as jenkins seems to bill itself as a CI/CD. Not sure if that should even matter to me as it seems to work fine.

Does anyone use any scheduling frameworks that they'd recommend. I really value the monitoring (which is why I don't just use cron)

Thanks!

https://redd.it/l2c6s1
@r_devops

My career is “frozen” but I am not lazy

For the past 3 years I am working as a DevOps engineer.
Technologies like Kubernetes, Docker, Jenkins, Ansible, Nexus/Artefactory are not new for me and I think I became better and better. I implement all my day to day tasks without need any help from someone in the team.

Before my DevOps position I was Java developer for 6 years.
And this position helps me a lot to write better pipelines, shell scripts, to understand needs of developers and get the right decisions when we are talking about release etc.

My main problem now is that all of my colleges in DevOps team has sys admin background. So they are far better then me in investigating problems, networking and all sys admin stuff.

I feel I need a lot of sys admin experience. That’s way I decide to make for myself a home lab. Mostly some VMs using KVM and start breaking them.
The question is how can I produce some real time scenarios instead of just reading some sys admin blogs/articles and reproduce these stuff.

https://redd.it/l270m2
@r_devops

Guide to debugging serverless applications

Our first long form post on debugging serverless applications. Do share your feedback.

https://blog.faasly.io/guide-to-debugging-serverless-applications

https://redd.it/l1ujac
@r_devops

Cockroach db in gitlab ci services

I have configured test cases in gitlab ci pipeline and it will require a database connection to run test cases. So I am trying to configure the cockroach db database in GitLab ci services. But I can't able to connect the database container from the app container service. here is my sample gitlab-ci.yml file.

​

test:
image: node
stage: test-cases
variables:
DATABASE_URL: postgresql://test_db:password@localhost:26257/test_db?sslmode=disable
services:
- name: cockroachdb/cockroach:v20.1.4
alias: localhost
entrypoint:
- "bash"
command:
- -c
- >
mkdir certs my-safe-directory
COCKROACH_DB="$(cat /etc/hosts |grep $HOSTNAME|cut -d$'\t' -f1)"
cockroach cert create-ca --certs-dir=certs --ca-key=my-safe-directory/ca.key
cockroach cert create-node localhost 127.0.0.1 cockroachdb $(hostname) --certs-dir=certs --ca-key=my-safe-directory/ca.key
cockroach cert create-client root --certs-dir=certs --ca-key=my-safe-directory/ca.key
cockroach start-single-node --certs-dir=certs --listen-addr=0.0.0.0:26257 --http-addr=0.0.0.0:8080 --background
cockroach sql --certs-dir=certs --execute="CREATE DATABASE test_db; CREATE USER test_db WITH PASSWORD 'password'; GRANT ALL ON DATABASE test_db TO test_db;"
tail -f /dev/null
cache: {}
script: |
curl -i https://localhost:8080 ##not able to connect service.
npm test
allow_failure: true
only:
- master

I also tried connecting using an alias but not worked. Help me if anyone has an idea.

https://redd.it/l1ryiy
@r_devops

Versioning images and code releases

How do you guys handle versioning of application or code releases?

I would like to use a semantic versioning structure, but it has not been easy to do this the kubernetes way, as for example most images on Dockerhub have their version numbers (and arch's) in the tagfield. This makes sorting and determining the versions before the latest version pretty difficult.

I have also tried to inspect image descriptions to trace versions, but even for this, there is no clearly defined structure (or best practice) that is mostly used.

https://redd.it/l1li9q
@r_devops

What is the simplest log aggregation tool out there?

I have some log files on a server. I want to aggregate them into a single persistent place and then do some basic searches over them, and occasionaly just watch incoming logs.

Preferably I'd want to install just a single binary for the centralized server and the log shipping agents (if required)`, simple config, low overhead. No JVM for the sweet love of God.

Best thing I've found so far is Papertrail, which has some limitations for the free version. SumoLogic is OK but kind of bloated for what I want. Simple is the key criteria. Elasticsearch for example is way too bloated.

Any ideas?

https://redd.it/l1m0x8
@r_devops

Anyone else using Universal Resource Names (URN) for Asset Tracking and Automation?

Just like AWS' "arn" some shops use this resource name to identity assets. These arn's obviously help give an asset a 'name' to serve as a unique identifier. Having that name allows you to develop a service where you can 'attach' metadata to it (e.g. datacenter, region, managed_by, is_live, etc). Now that you have that metadata you could automate many things from that (e.g. enable/disable monitoring, where to send alerts, billing, etc).

One challenging area is naming the URN. Specifically, since URNs are strings delimited by ":" what do you define each token to be? One common approach is some form of reverse DNS (e.g. com.example.devops.service1). Curious if anyone else is using URNs, how your using them, and your approach to coming up with the tokens of the URN?

https://redd.it/l3ey3g
@r_devops

Director of IT & DevOps?

I'm not in DevOps, I recruit for a software company. Our VP of Product & Engineering is splitting the team into 2 groups: Product (for our core product, dashboard, etc) and "everything else" (AWS, corporate website, marketing automation, Salesforce, database, internal IT, etc)

He's asking for help coming up with a title for the "everything else" team. Has anyone seen a Director of IT & DevOps title? Or do you have any other suggestions for a role like I'm describing?

Any insight is appreciated!

https://redd.it/l0r154
@r_devops