Reddit DevOps
267 subscribers
30.9K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
What are the top barriers you are facing in adopting DevOps for your organization?

Adopting DevOps? How do you make your transition smooth with DevOps success? There are many reasons why DevOps uptake has been slow.

View Poll

https://redd.it/oz0lsm
@r_devops
How can I monitor nginx status?

I've been using a vm of Digital Ocean to run 3 containers (python+django / nginx / postgresql). So there is already an agent & dashboard to check RAM, CPU, storage usage, bandwidth, load.

How can I check nginx status? In particular, I would like to see requests per second. Any simple way to see this data?

I tried New Relic. But the setup & interface are complicated provided that I only check nginx. It cannot read status_url though I set the status page to localhost. I tried to curl https://127.0.0.1/nginx\_status and it's ok in ssh. But the agent cannot read the data. and I don't know why.

Next, I take a look at nginx amplify but the repo looks like it's not maintained 3 years ago

Any easy way to visualize nginx status data?

https://redd.it/oz0uks
@r_devops
evaluating dagger - programmable CI/CD tool

I recently got access to dagger (soon to be publicly open source), it's described as a programmable devops superglue. It basically aims to replace all your fancy bash scripts in your CI with a clean type-safe declarative configuration.

The language they used is called Cue, it was created by an ex-googler who created the GQL. Dagger allows to embed any script anywhere inside your cue config. The scripts are then executed transparently inside a container. Also it's being built by the former docker team.

I am evaluating it to replace all my devops scripts, especially the kube config templating and container build scripts. The tool is early but there are some supported packages already that you can re-use.

Curious to know if anyone played with it yet or if you have good alternatives.

https://redd.it/oz2tm7
@r_devops
Open source error management system

I'm trying to find something lightweight that I can push structured errors to from my application - so parameterised message text and the parameter values. I'd then be able to assign people to these errors to investigate, mark them as resolved etc.

I believe Sentry open source offers this but also comes with tracing etc. and feels way too heavyweight for what I want.

Hoping somebody can help with a recommendation as I'm unable to find anything so far!

https://redd.it/oz2pzl
@r_devops
OneDev 4.9 - open source git server with built-in CI/CD

The latest 4.9 release comes with service desk feature to create/discuss issues via email. This release also sees the ability to import repositories/issues from GitHub/GitLab/Gitea/BitBucket Cloud/JIRA Cloud/YouTrack.

For detail, please check: https://github.com/theonedev/onedev/wiki/4.9

https://redd.it/oz6lx2
@r_devops
Rundeck: Run job by schedule only?

Is there a way to remove the "Run Job Now" functionality and only be able to run jobs via schedule?

Rundeck is controlled by Puppet so changes will be made via the yaml file, not the console.

Coming up short looking for answers online.

Cheers

https://redd.it/oz6g76
@r_devops
New article about CDK (how to provision an Ubuntu-based EC2 instance)

Hello, I have been spending a bit of time lately playing with CDK and I wanted to share what I learned in a tutorial-style article.

Here it is: https://loige.co/provision-ubuntu-ec2-with-cdk

Let me know what you think! :)

https://redd.it/oz6p6n
@r_devops
I got into a fight with a DevOps Engineer....

Guys

So I posted this the other week but deleted as I was so embarrassed, but I think it's worth talking about how NOT to handle things...

Long story short, I got into an argument with a senior DevOps engineer over using YAML pipelines... Yes you read that correct. He wanted to continue using classic and I updated one to use YAML.. he wasn't happy.

What I should have done is walk away and bring it up with manager, instead a disagreement turned into a heated one, which punches were thrown. He hit the ground screaming in fright, embarrassment and rage...

The stupid thing is we had beers after it and are all good.

It was caught on security footage and I was fired. Ive been in a helpdesk job for the last week as I need the cash. No matter how much someone annoys you at work, never do stupid shit like this as I've probably ruined my career.

https://redd.it/oz8bxo
@r_devops
How to build on-demand cloud service with Hetzner Cloud?

So I want to build a cloud service where users can rent a game server for a specific time. For that, I want to use Hetzner Cloud as a cloud hosting provider. The way I've imagined it on a high level:

1. User rents a game server for N hours.
2. Backend creates a cloud server on Hetzner Cloud with their Hetzner Cloud API.
- Specify cloud-init user data in the API request payload to start the game server with parameters like random password.
- An image with the game server is used to create the cloud server.
3. User waits until the server is online.
4. Backend keeps track of the cloud server and deletes it after the time expires with the Hetzner Cloud API.

Does that approach make sense?

One thing that isn't great for the user experience is that the cloud server creation isn't instant and takes few minutes.

Another challenge is to keep the image up-to-date, not only the distro but also the game server itself.

https://redd.it/oz7r2r
@r_devops
6 Tools to Run Kubernetes Locally



All of the tools listed here more or less offer the same feature, including but not limited to:

1. Multi-Node cluster
2. Persistent volumes
3. Networking
4. Certificates
5. Bare-metal support
6. Dashboard
7. Kubernetes Versions
8. Add-ons
9. Cross-platform
10. Tracks upstream Kubernetes

https://yankee.dev/6-tools-to-run-kubernetes-locally

https://redd.it/ozch0y
@r_devops
tf-free: A project to create free resources on all cloud-providers

Hey r/DevOps,

I've created a project where you can create all the free resources available from the major cloud providers in a single command. I used it as a way to learn infrastructure as a code without relying on companies or external training, and without spending fortunes as well. Furthermore, I hope it helps you, as it did for me.

You are welcome to contribute and ask questions, it is not finished by any means, so be aware you must learn the basics before messing with its configurations.

https://redd.it/ozdlb8
@r_devops
🛠 Deployment strategies in Kubernetes

📓 Learn what are the different deployment strategies available in Kubernetes and how to use them. Read more...

https://redd.it/ozesk2
@r_devops
Looking for books and courses on the fundamentals of design, automation, testing and deployments.

Are there any good courses and books regarding the fundamentals of design, automation, testing and deployments.

What I mean by fundamentals is the core ideas no matter what field you are in be it IT, robotics, aviation etc. Basically fundamentals that can be applied to anything to improve your understanding and implementation of these fundamentals in projects / applications.

In my case it will be more in the DevOps space.

https://redd.it/ozev3p
@r_devops
Traefik + grafana help

Hi, I'm a junior MLE engineer who likes to play with containers and services quite a lot in his free time.

Anyhow, for my purposes I've built a small personal website service, and together with several others for fun, I've put Traefik reverse proxy before them.

Now, I would like to setup prometheus and grafana for some basic metrics (requests, memory, in future i'll try to play with bot detection etc).

My problem is, I've searched the Internets for some kind of a tutorial, and they all assume I am using Docker Swarm, which I don't (just a single Hetzner instance), or a k8s cluster, which I most definitely dont.

Is it really impossible to setup grafana for my simple setup?
Is there a tutorial out there I've missed? If there is, can you link it?
If there isn't, how can I modify the tutorials for my simple use case?

Thanks :D

https://redd.it/ozfolo
@r_devops
Is datadog good for the long haul? ...or nah?

My org is currently looking to consolidate logs, metrics, and traces all into one vendor. We've POC'd a few that claim to do this, like new relic, dynatrace, and datadog, but frankly sometimes it seems like the POC is not representative of reality (I've heard some horror stories about doing exactly this in one of these three companies). At the moment we're leaning toward datadog.

We try to be a forward looking org and don't want to get fuckin stuck (again lol) on a tool that will just get less relevant a few years down the road (happened to use a handful of times)

So my main question is to those that use datadog, is it going to be as relevant to your org in a few years?

View Poll

https://redd.it/ozhv2i
@r_devops
Today I blew up my self-hosted k8s cluster! Don't dist upgrade without thorough testing!!

I manage patching for large cloud environments. I should know better. Its basic operations procedure. Well, I decided to cut corners in my home lab and every k8s node (Ubuntu 2104) would boot into kernel panic) Without backups, it's impossible to tell what went wrong and where.

Lessons learned, take backups in your home labs!!

Here's another DevOps Vlog!!

https://youtu.be/oy9FtAZj4Js

https://redd.it/ozfi83
@r_devops
New FREE Series How to create Storage Account in Azure - Data Engineer Series | EP# 01

This video covers the below basic concepts for the Data Engineer in real world.

\-- https://youtu.be/TfgvqxLNp7E

1. How to create storage account in azure

2. What are the various types of Storage accounts

3. When to use What type of Storage

​

Azure Data Engineer Series - Session #1 \^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^ Please Subscribe, Like, & Share for more video and to get notified when new video comes :https://www.youtube.com/c/CloudDataSc... \^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^

https://redd.it/oze1mm
@r_devops
Advice on cloud based tools for A CICD pipeline.

Can I get some advice? I need to create a cloud-based CICD pipeline for a project. No one wants to touch it, so I'm stepping up to do it.

The task is to create a CICD pipeline in the cloud. Which cloud service is up to me, and it'll have to get approval from the team.

I am not sure what would be the best route to do so as I'm still learning Jenkins and TeamCity(on-premise), but I am not super great with them or cloud-based products. I'm having trouble with that; I'm not sure what is the best route to take.

I need to run checks on each pull request. To give context, each pull request contains an Angular app with the feature changes and a python automation suite that tests the app changes.

I need to start a local angular server, run the python tests (~3hr runs) on Windows chrome and Mac Safari, among other checks. CICD pipeline should be able to handle multiple PRs getting created at different times. Currently, we have two peak hours; for the sake of argument, they are 5 am and 5 pm.

The team would like to use Jenkins, but I'm not restricted to it. I have been looking at AWS EC2, AWS ECS, TeamCity Cloud, GitHub Actions, Azure. Anything with a Mac Agent and can parallelize builds even with Kubernetes. I am trying to account for cost as well.

What cloud-based CICD tool have you guys used and had success with? What is the best way to accomplish this?

Thanks in advance.

https://redd.it/ozk0sa
@r_devops
Automating port-forwarding for WSL2

I couldn't connect to my WSL2 local machine so I obtained the IP address inside of WSL2 by doing:

​

ip addr show eth0 | awk '$1 == "inet" {gsub(/\/.*$/, "", $2); print $2}'

​

And then followed up with:

​

netsh interface portproxy add v4tov4 listenport= listenaddress=0.0.0.0 connectport=2222 connectaddress=172.24.40.141

​

Is there a way to automate this process?

https://redd.it/oz7lpv
@r_devops
How do I implement Kubernetes in my current backend services?

Currently there's 1 database(ravendb) and 3 backend services running and 1 angular frontend app. Backend is in nodejs and I'm using pm2 to run all of them. I'm new to kube and don't know how it would benefit my currently running services. Can someone let me know how its gonna lay out the services before I learn kube? It would be very helpful

https://redd.it/ozaipz
@r_devops