Does anyone use HashiCorp Vagrant anymore?

I'm a new DevOps in an IOT shop. Ansible is being used (a good thing) and has a homegrown environment for testing changes. This is IMHO really good, many people, including myself, skip this. Here is the rub: It's based on HashiCorp Vagrant.

I've used Vagrant before, but it's been many years. I discovered that the latest "ubuntu/focal64" box and the latest VirtualBox (6.1.26, at least on a Mac) are incompatible.

So, my question is this: Are you using Vagrant? Do you like it? Do you wish you were using something else?

https://redd.it/p0icih
@r_devops

How does your team organize/manage their runbooks?

I'm a member of a 12 person team who is responsible for several production services.

We try to write runbooks for any incident that occurs and tie them to our alerts (DataDog), but I've noticed a couple of problems with how we manage them:

1. Runbooks become out of date. This may be because no one on the team feels like they 'own' our runbooks (even though I feel like they should be everyones responsibility to keep up with).

2. We keep our runbooks in a GitHub repository for our team, but they are nested under several subfolders depending on the service they reference. This makes them hard to find during an incident (especially if you are woken up at 3am). GitHub search is not the best for this usecase it seems.

I'm wondering how other teams manage their runbooks and keep them up to date and easily discoverable? I know there are tools out there like Rundeck (PagerDuty) and what was VictorOps (now Splunk Oncall), but these seem to focus on runbook automation which is not what we want.

I don't want to fully automate our runbooks, but simply make them easily discoverable when we need them and some how encourage keeping them up to date.

Any ideas/feedback would be greatly appreciated!

https://redd.it/p0ix2i
@r_devops

How to handle www vs no www

I have a VPS with an Nginx reverse proxy that accepts both www\.example.com and example.com. I've noticed some odd behaviour though caused by this.

If the url is follwed by /api/, it will be redirected (proxy_pass) to my NodeJS service running at localhost. My client is configured to call https://example\.com/api/ when making API requests. However, this causes a CORS rejection when a call is made from www\.example.com, no matter how I configure my API CORS settings. Changing the API url to https://www.example.com/api/ made the error go away and now requests can be made from both the www and non-www domain.
The login session seems to be seperated for both domains (I'm using auth0). If I log in at the www domain, I'm not logged in at the non-www domain and vice-versa. Logging out works globally though.

Sorry for the long post, but these behaviours make me wonder if I have been handling this incorrectly altogether. Should I stick with www or non-www and redirect one to the other? What is the correct configuration?

Thanks in advance

https://redd.it/p0io5y
@r_devops

Help with CI/CD Idea

Hi all,

I've been a lurker for a while now and am dipping my toes into some CI/CD tools. I come from a very ops background but I play around with Docker in my homelab quite a bit and use it to host several services.

I'm now at the point where I want to start automating some things as well as just learning DevOps tools/methods to apply to my current job (Cloud Engineer). The first thing I've identified as "low hanging fruit" is to automate my docker container deployments using docker compose files hosted in GitHub.

Currently I have various docker-compose files for different services. So essentially I would do the following when updating an image (all on the Docker host itself via CLI):

\> Delete the container

\> Grab latest docker container of the service in question

\> Run docker-compose up

\> Profit

I am now at the stage where I want to achieve something similar to the following:


\> Upload my docker-compose files to GitHub (done with some already)

\> Use a CI/CD tool to create pipelines to fetch the compose files and deploy the services and then essentially if I edit these compose files and commit for the CI/CD tool to then strip down the service an re-deploy with the new compose additions.

What I have done so far is the following:

\> installed Jenkins as a Docker Container on my Docker host

\> Connected Jenkins to my GitHub repos in that it can actually see the compose files

I am stuck now at actually getting the files deployed. Someone over at the Jenkins subreddit suggested adding my Docker host itself as an agent as opposed to trying to use Jenkins plugins to natively deploy it.

I'm very new at the CI/CD side of things so appreciate any and all guidance you can provide.

https://redd.it/p0ivd0
@r_devops

How to find companies with good devops culture?

I’m starting a job search and I’m relatively convinced that I wouldn’t like to be a “devops engineer” I want to be an engineer that does devops along with others that do the same. Is there any way of finding companies like this?

https://redd.it/p0n4p7
@r_devops

AWS S3 Pricing is expensive

As a software engineer, who has extensive knowledge on AWS, Azure and other cloud providers, I have noticed that pricing is extremely expensive especially for big projects that require alot of data. S3 charges $23 per Tb /month and other fees related to retrieval and storage of data. The pricing may not seem like alot but adds up very quickly. I have recently switched to Windrate, which is a platform that allows major vendors like AWS, Azure, and Google Cloud to bid on your software storage needs and I have gotten well below the market price listed for AWS S3 and Azure Blob storage. Very interesting website and developers who work for big companies should check it out!

https://redd.it/p0k7wv
@r_devops

Setting up a Python/Jupyter environment (Pref on Windows)

Hi all,
I am not in the DevOps space, so apologies if this doesn't make the most sense. I head up a small customer insights/marketing team that currently use SAS for many of our automation, ETL, and analysis tasks. We're hoping to move to Python due to the wide industry support, deeper extensibility, and flexibility.

Our operations team specialize in Windows as that's what our parent company uses, so they are much more comfortable setting up dev/prod environments on Windows servers. This seems like it may pose a problem for our desire to move to Python - especially if we want to use [JupyterHub](https://jupyter.org/hub).

We've been playing around with a basic Linux server that has been running [The Littlest JupyterHub](https://tljh.jupyter.org/en/latest/) for a few months, and need to work towards next steps of properly implementing a production environment. There's been a few issues that we've had with TLJH which may make it not the best choice for us. These issues have mainly surrounded difficulty administering the server/users, difficulty communicating with Windows servers (AD/SMB), and difficulties effectively automating/scheduling tasks.

Some of the requirements of a live production environment would be:

* Easy administration
* Multiple user support
* Active Directory group-level access control/security/auth
* Easy SMB mounting of a SAN using AD credentials
* Ability to run queries on a MS SQL server using AD credentials
* Way to easily automate processes once they have been created

So knowing all these requirements, what would be our best course of action?

* Is JupyterHub our best bet? Or is there another alternative which will play nicer in Windows?
* If we go with JupyterHub, would we be best suited to use the Docker method in Windows, or just go straight Linux?
* How would we best handle security/access?
* What would be the best way to handle automations? Any cron frontend recommendations if we must go with Linux?
* Should we run two servers, one for Jupyter/development, and a simple cron/scheduler server for automations/production?

TIA for any direction on this!

https://redd.it/p0qh52
@r_devops

Hello, I am about to start a new remote job. Any tips?

Im going to be working as an SRE for a company. The job is 100% remote, which would be a new experience to me. Any tips on the first day? Like how do you even meet or get to know your coworkers? I’m super nervous and just want to make a good first impression.

https://redd.it/p0s692
@r_devops

Windows server post build configuration and tooling?

I’m really curious what people use in terms of tooling for completing the configuration of a Windows machine after build. Currently we’re using a bunch of Powershell to provision VMs in vCenter via templates, which works just fine, but the one thing that’s always kind of error prone is completing some of the post build activities, especially the ones that rely on reboots happening between them. Currently we’re setting the RunOnce registry key and the following scripts either set the next activity in the RunOnce or clean it up. Is there a better or different way that people have been successful with?

https://redd.it/p0rzvh
@r_devops

Managing standards across a large set of git repos

Hi,

Looking for experiences people have managing standards (code layout, naming, but also things like aws resources always being tagged). That part is relatively easy, we use a number of linters, tfsec and a whole bunch of other tools.

However, we now would like to use the same standards across all of our repos, and keep them the same as we expect to make small updates to standards. Don't really wanna try and keep 100+ repos in sync manually :)

Thoughts welcome.

https://redd.it/p0vb34
@r_devops

What is Tekton and how it compares to Jenkins, Gitlab CI and other CI/CD systems

I think there is often a confusion about Tekton - it's not really a complete CI/CD system, but rather a Lego. I made a video explaining this point:

https://youtu.be/skcLi9-WTkA

https://redd.it/p0x96u
@r_devops

23 items production readiness checklist

Hello, I have watched a conference where they spoke about 23 production readiness checklist, compiled at a company like Spotify, or SoundCloud, but my memory is betraying me.

Does it ring a bell ?
What's your production readiness checklist ?

https://redd.it/p0ynn7
@r_devops

Basic Linux commands you should know

https://bradmccoydev.medium.com/kubernetes-journey-basic-linux-commands-you-should-know-da4f95ceca5?source=friends\_link&sk=834a31acb43ca1d4ac0321a8bb69157c

https://redd.it/p0z0mp
@r_devops

DevOps Engineer is the new SysAdmin

I teach a graduate course on DevOps and Agile Methodologies and many students think it's an operations course, when actually it's an advanced software engineering course that covers DevOps Culture, Test Driven Development, Behavior Driven Development, Cloud Native Microservice Architecture, Continuous Integration and Continuous Delivery, Docker, and deploying to the cloud and Kubernetes.

I believe the confusion comes from job postings for DevOps Engineers that they see. This, I believe, is an anti-pattern that is prevalent in the industry. Recently when I came across a Job Function dropdown while signing up for a conference that lumped DevOps with Operations, I just had to write my ideas about it down.

Here is the article that I wrote on the topic: DevOps Engineering is the new SysAdmin

I will repeat here what I said at the end of the article because it's important to understand the spirit in which I wrote the article. "I say this with all due respect to those who hold 'DevOps Engineer' job titles. The work you do is critically important, and the skills you possess are infinitely valuable and sought after, but the company you work for is not practicing DevOps if they put you on a DevOps Team. Remember, DevOps is about breaking down the silos, not creating a new one."

I'd be interested in this communities feedback and thoughts.

https://redd.it/p11l4k
@r_devops

How to onboard a new DevOps to a remote team

My company is a startup with around 70-80 and we have been working in a DevOps way more than 2 years. We are a spin-off from a big corporate german machinery builder and we are doing some cool iot tech. At the same time, we have customers that pay really well for it and we are in a hiper grow right now.

​

I have been working partially for the company (been in the mother company) for more than a year where I started like backend but I was focusing little by little to DevOps and finally I ask to the startup to jump full with full contract into the new company and be the "lead" devops. I am now on my own but on september one devops more will join the company to work under me. Could you get me some tips about how to make the onboarding a pleasant as possible? I have no experience with remote onboarding and we will be in different countries. Me in Germany and she will be working from Portugal but it is quite ok because I am spanish and the mindset is really similar.


Which are your recommendations for me onboarding the first new person in my team? I need to say that also the team of backend/Data science people I work with there are like 4 people are really strong in DevOps and they can also support me. And for making all even worst and I will probably be off her first week :(

https://redd.it/p130mg
@r_devops

Enhance your software development process with DevOps - Download WhitePaper

Get Your Free DevOps Whitepaper\- This whitepaper sheds a light on the benefits of DevOps that can help you quicken the software development process by minimizing errors and increasing visibility.

https://redd.it/p14a2p
@r_devops

Major Pagerduty downtime!

Pagerduty is experiencing yet another major downtime affecting their web dashboard and other components. All hands on deck folks!


https://status.pagerduty.com/incidents/6h3slvfz84xp

https://redd.it/p1537d
@r_devops

Rootless Docker

Hello,

I've recently installed docker in rootless mode on Debian 10 Buster with the VFS storage driver.

I've noticed that the docker takes so much storage space now and the performance dropped a bit.

Can someone please explain to me why does it take so much space ?

Is rootless docker good for production ?

Thanks.

https://redd.it/p138qk
@r_devops

How to become a DevOps engineer in 2021.

https://www.youtube.com/watch?v=9pZ2xmsSDdo&ab\_channel=TechWorldwithNana

I do not own the content, just thought I'd share as it's one of the clearest up to date videos I've seen so far. Hopefully it will help others here.

https://redd.it/p17ztx
@r_devops

State of Kubernetes Security Report

This could be of interest to this subreddit

https://red.ht/3wBy3T6

https://redd.it/p179i3
@r_devops

simple way to provision and manage docker containers?

I'm trying to setup a service where each user needs their own api server and database instance when the user account is created, and then I'll have to manage those instances. Does software exist to make this easier? I have docker images, and I'm quite comfortable setting these up individually on GCP or AWS, but have no idea how to automate/manage this. I think all I need is some kind of API to provision instances and handle updates, but am unsure what to do next. I'm wondering if there is something easier than diving deep into k8s.

https://redd.it/p1aeyg
@r_devops