Any of you taking advantage of remote working and working two jobs?

I have been tempted to this since the start of the pandemic, but can't cause of childminding duties. It'd seem quite doable if you didn't have many meetings in a day

https://redd.it/p63tn0
@r_devops

Should I learn CI/CD or learn Containers?

My new job is basically AWS support and I work under Deployment. They will train me. Which domain or skill will be much more marketable now and down the line? CI/CD or Containers? What jobs are available out there that demand these skills?

https://redd.it/p6cr8a
@r_devops

Managing ENV vars and secrets

Hey everyone! Looking for some advice trying to centralise ENV vars and secrets.

Right now we have an application on k8s with way to many env vars. We need to keep a set for testing, staging, and production, a set for the CI/CD pipeline end-to-end tests, and a set for each developer.

Currently we have copies of everything at every place it's needed, which makes updating them a pain in the ass. What methods and tools are you guys using to centralise these things? Is there an API I can call to CRUD on env vars and secrets that's secure by default?

Thanks for the help!

https://redd.it/p635qu
@r_devops

Automating customer notifications?

hi, how do you automate your customer notifications for application maintenance? We're looking at Everbridge, but they're quite costly.

https://redd.it/p6276s
@r_devops

How are you protecting your staging environment(s) for your web apps?

By "staging environment" I'm referring to any non-production environment that you need to access over HTTPS, either ephemeral or long-living and potentially shared.

Are you using basic auth? If so, how are you managing usernames & passwords?

Are you using a VPN?

Are you using something else?

https://redd.it/p6fwax
@r_devops

Validating RESTful-ness of Flask API

Hi folks

My team maintains a small Flask API as part of our application, and we've run into a few scenarios where the endpoints we've written don't conform to the OpenAPI standards. Are there any tools out there that allow you to check compliance of a Flask API again the OpenAPI standard?

I did find https://github.com/p1c2u/openapi-spec-validator and https://github.com/p1c2u/openapi-schema-validator, but I'm pretty new to the devops world so I'm not sure if these are exactly what I'm looking for. Any recommendations or advice is appreciated.

https://redd.it/p6gjn2
@r_devops

Announcing SurplusCI - dedicated runners for your CI Pipelines

Hey all,

I just launched a new service called SurplusCI (https://surplusci.com), and would love if you gave it a try -- there's a demo which is only half a vCore but since it's dedicated it's not TOO terrible (I should probably raise that to 1 or 2 vCores so people get a better feel for the service).

As everyone here is ops-saavy -- it works just like you'd expect it to! I spin up VMs when you ask for more capacity and make sure the compute and storage scale as they need to. Would love to take questions on the infra if anyone is interested as well :). It runs on Kubernetes and uses some interesting addons/plugins (I actually use both KubeVirt and Kata-Containers).

r/devops members please DM me for a month free, I'll discount your subscription to zero, would love some feedback even if you end up not using it long term! I always wonder how much effort I should put into support Azure pipelines/BitBucket/Bazel and some other options. Hearing from people who are "plugged in" so to speak is valuable to me.

https://redd.it/p6gfdb
@r_devops

In Search Of: LOPSA Leadership Committee volunteers

Hi everyone, I am on the board of directors for LOPSA.org, the League of Professional System Administrators. We are a 501(c)(3) non-profit. The board is looking for volunteers for our Leadership Committee. This committee helps with our board election process including helping us find qualified candidates and running the election process. If anyone here would like to help volunteer for this committee, please reach out to me and let me know. I look forward to speaking with you and answer any questions.

https://redd.it/p6j0ui
@r_devops

How to deploy a Rails application using Chef these days?

Chef used to come with a cookbook called "application" which allowed to deploy web apps in different frameworks including Rails. That was back in Chef 11 days. Then breaking changes happened one after another, and I cannot even find the application cookbook on google. Is it replaced with another cookbook, or did Chef take a different path or what?

https://redd.it/p6ir2q
@r_devops

I want to log everything on kubernetes

Hey guys, I'm a junior DevOps and wanted to know how do you store your kubernetes logs.

I searched and investigate tools like graylog and Loki, but wanted to see if there's more.

Currently I'm using azure cloud so my clusters have azurefile as PVC and storage class.

https://redd.it/p61nld
@r_devops

terraform on mac m1 (arm64) ?

I need to install [email protected] but it looks unavailable: https://releases.hashicorp.com/terraform/0.14.10/

how can I use this version of terraform on the m1 mac? I've been trying/researching for a while.

https://redd.it/p6lm9r
@r_devops

DevOps Tools landscape chart/diagram generator

My manager asking me for some flashy diagram listings of all the devops tool chains we are using. I find it hard creating using powerpoint. Any easy online tool/generator, if anyone knows.

https://redd.it/p61e80
@r_devops

Federated prometheus and integration of kube-state-metrics

I have a number of k8s clusters which have installed a prometheus instance(using prom operator). I have a central separate prometheus which collects all metrics(cadvisor, kubelet) from all the k8s clusters using the /federated endpoint(using a load balancer service). I have recently installed kube-state-metrics on some of the clusters and i was able to expose those metrics using a separate LB service.


My end goal is to be able to have only one LB service exposed from each cluster and expose all metrics from that endpoint.


What i want is to be able to merge all metrics (cadvisor, kubelet, kube-state-metrics) into the local prometheus and expose all metrics externally using the federated endpoint of the local prometheus.


I was unable to find something similar online but i am sure other people have had experience on how to do this.

https://redd.it/p6mzv2
@r_devops

Creating a pipeline to update the AWS credentials monthly

Hi All,
Our AWS infrastructure updates the secret key and user access key id on a monthly basis. I want to create a pipeline in Jenkins which fetches the credentials from aws and updates the AWS credentials if the present ones are expired.
Can someone please help with the approach and how it can be done.
Any leads will be helpful.

https://redd.it/p5b7f6
@r_devops

Why Use Jenkins?

hey DevOps folks i'm a TFS to VSTS to Azure DevOps guy. I dabble with GitHub and Github actions but never Jenkins. So why do companies use it? is it the free factor? or is any good?

https://redd.it/p6qn7x
@r_devops

Linux Administrator to DevOps RoadMap : Programming, Administration, Containers, Infrastructure as Code, CICD, Logging, Monitoring, Cloud etc.(Useful to learn how your app is deployed using docker, kubernetes, with automation, and a CI pipeline)

Since about 2 years now I'm working on a series of short YouTube videos about basics of DevOps that helps you to move from Admin to DevOps engineer, You can find it here: https://www.youtube.com/channel/UCoOq-DtESvayx5yJE5H6-qQ/playlists?view=1&sort=lad&flow=grid

Contents:

1. Continuous integration and Continuous Deployment

2. Containers - Docker

3. Container Orchestration - Kubernetes

4. Logging & Visualization - Elk, Loki, Grafana

5. Monitoring - Prometheus, Splunk

6. Configuration Management - Ansible

These lessons that start with "Hello World," assuming one has absolutely no programming experience, and goes on to cover the basics on CICD, Containers, Kubernetes Pods, Deployments, Services, Setting up Jenkins, Docker, Podman, Minikube, Ansible, ELK, Git, most used commands, Pipeline jobs with Sonarqube quality checks, Artifactory for binary management, ansible playbooks, real use cases, deploying docker containers using ansible, how to convert your playbook in to roles, Monitoring docker containers, windows and linux servers, and more & more! . . All the lessons all hosted on YouTube and organized into a course. Hope you like it!

Refer the above link for complete tutorials.

https://redd.it/p6s0h2
@r_devops

Migrating from Node Redis to Ioredis: a slightly bumpy but faster road

Redis is a very important tool in the Ably toolbox, and since most of our backend code is written in Node.js, using the recommended Node Redis client was natural... but we started hitting some performance issues, and Ioredis came into the picture.

In this new blog post of the Ably Engineering series, we tell the story of how and why we migrated from Node Redis client library to Ioredis to suit our use case better, and a couple of bumps we faced along the way:

Migrating from Node Redis to Ioredis: a slightly bumpy but faster road

Hope you enjoy it, feedback is always welcomed 🤗

https://redd.it/p6ritj
@r_devops

meta Why do people keep posting YouTube videos instead of gitHub Repos? I want to read and replicate your infrastructure code, not watch a video.

Mini meta rant: how is it that YouTube videos keep getting posted here? Do other people really prefer YouTube content over a solid README with code examples? You know, like what you do on the actual job. Every other day it's another YouTube video and I'm getting a little tired of it. I'm not going to go through your 10 video playlist to learn concepts when there is no way to replicate it in my own homelab without manually typing in what you're saying.

https://redd.it/p6ti1u
@r_devops

AWS Cognito vs Auth0

I have an application that I've built and am in the process of rebuilding and am thinking of redoing the auth to use Auth0 instead of AWS Cognito since I have heard Auth0 is better and this seems like a good time to switch before I have to deal with migrations. I've done a bit of research on these two but am curious to see what this sub thinks of them in regards to management as well as just functionality.

https://redd.it/p6uezf
@r_devops

What are best practices integration testing as a platform grows?

When multiple changes are in flight across the various services/teams in a platform, how do you best handle this queue?

One option I've seen executed both poorly and well is to only allow one change at a time until it either hits prod or fails and is rolled back. This requires a strong automated testing suite to allow for a fast feedback loop but even then it doesn't scale well once you approach a large number services.

An alternative would be automating a full stack creation/termination for each change and test against current prod but this could create friction (sure, there's workarounds though) if co-dependent services make it to prod which haven't been tested against each other.

Anyone care to comment a workflow that's successful in their org?

https://redd.it/p6ubm1
@r_devops

Asking advise for cloud based startup

Me and a couple of my friends doing a startup from an idea we got together, I'm a .NET developer on Windows.

Our project's main logic is done inside Windows 10 Pro VM machines, so to do actual work we need Windows 10 VM machines, for that, I can get dedicated servers from a provider and run a bunch of Windows VMs to do the work, the problem is that I have no idea how to implement rest of the things, I even don't know what we need. So I'm asking you for help.

We need one more VM or database were we going to put already processed data, also we need a web page where users will request work from.

So my question is what do we need to accomplish this?

I just found out that API gateway can be used to connect services, etc.

I would appreciate some architecture guide as well, maybe someone already did similarly and shared it on Internet?

​

Imagine we doing "photo processing" and the main work is done in Windows 10 VM machines, we need users to upload photos and later get results, what do we need to set up such an environment?

All kinds of feedbacks are greatly appreciated.

https://redd.it/p6y6e4
@r_devops