Reddit DevOps
266 subscribers
30.9K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
What am I ?

Hello,
I've been working in my company for about two years. My title is backend developer, but since I've started I've been handling stuff like automating load balancing clusters management, integrating security into k8s clusters, dockerizing APIs that I write, creating CI/CD pipelines, debugging and handling application performance, automating DBs synchronization , designing applications, securing code, Docker images and basically I have the right to do any task without limiting myself to a specific field.
I just call myself a software engineer that does some DevOps sometimes, I know DevOps is a culture, but I'm talking about the mainstream definition of the word, automation + tools. But is this more than what is asked of a software engineer to do ? I can't even imagine just writing code and letting someone else handle its deployment.

https://redd.it/p5nnrr
@r_devops
I really truly don't understand environmental variables in production at all.

Like Custom Environmental Variables (Not Like Github Commit Information).

For example if I want to use automation tools like Terraform, Ansible how to I put environmental variables for Node/Flask/Django app for 0auth secrets, 0auth client, Database Passwords.

How am I supposed to get an output from Terraform (Like an ALB or some kind of Elastic IP) to a build so it knows the client app I build knows where the server is .

I'm just trying to find a do-something use case for learning Terraform/Ansible/CI/CD and the easiest thing to think of is a client-load balancer- server-database architecture and I really can't figure out how to do anything meaningful because of this reason. I'm trying to run servers on EC2 for example. Is this 100% stupid and should I be doing everything on a Managed Kubernetes Cluster where IPs are resolved by services by the cluster, alongside configMaps and Secrets that you deploy onto the cluster.

https://redd.it/p5nklz
@r_devops
Is DevOps suitable for fresh grad with no experience ?

I have the opportunity to join DevOps boot-camp

but I'm still fresh grad with no experience so my question is
is DevOps suitable for fresh grad ?


some people telling me that i have to have experience in another field then shift to DevOps

https://redd.it/p5lg2v
@r_devops
To kubernetes or not to kubernetes?

Hi guys, a little bit of background, I am a dotnet developer and I am starting my business, I have a management system that is very light weight, they get at max 20 concurrent users, I already have 20 consumers, each consumer has his own api in a docker container, I run all of their services on docker atm on my old pc, and I will upgrade the pc very soon to be a cluster of two pcs to handle the containers but I wanted to solve some problems and I don't know if kubernetes will solve them.

First, I want a zero down time update, every time I update the code all of my consumer get a downtime of around 30-60 seconds.

Second, I want a way to run maybe 100 containers and they find a server and kinda load balance the cpu between 2-3 servers

Third persistent storage, I want to save everything to a single server, for example all the data gets saved to server X and I can add or remove any other servers and the containers will move around and still have the same data.

I tried docker swarm it was almost everything I needed, besides the storage problem, but as I researched about it, everyone was saying it was dead and etc, and I want to future proof my infrastructure.

I tried Kubernetes (k3s) as well and I think it will solve my problem, but it is so complicated with so many things happening at the same time, weird errors with file permission and etc, so I am thinking it is overkill for me, maybe if there is something else that is a middle ground between the two?
But if kubernetes is the only way I will try my best to learn it.

And all the paas I tried didn't work for me, heroku, porter, digital Ocean apps, I want to use my local cluster not a managed aws ou Google one.

I would appreciate if you guys help me out.
Thanks in advance.

https://redd.it/p5ugef
@r_devops
REMOTE JOB TIP

Hello guys.
I'm from Brazil and have been thinking about working remote with employers from other countries. Have some of you done that? And can u give me any tip? How to receive the money, bureaucracy, legal problems, etc...

Thank you in advance.

https://redd.it/p5vgsc
@r_devops
Can't figure out how to migrate from FluxCD V1 to V2

I've been using Flux for a while now to update all the public images I use in my home K8s cluster. For the most part, it works great, but its coming time to migrate to V2, and I'm stuck on one thing in particular. Following the guide here: https://fluxcd.io/docs/migration/flux-v1-migration/, I'm stuck on this part:

flux create kustomization app \
--source=GitRepository/app \
--path="./deploy" \
--prune=true \
--interval=10m
✚ generating Kustomization
► applying Kustomization
Kustomization created
◎ waiting for Kustomization reconciliation
Kustomization app is ready
applied revision main/5302d04c2ab8f0579500747efa0fe7abc72c8f9b

I've literally tried everything for pth and source, and nothing works. here's my (i think) relevant info:

local on host location of git repo: /srv/homek8s/\

​

my attempts at the above:

flux create kustomization homek8s --source=gitrepository/homke8s --path="/srv/homek8s" --prune=true --interval=10m
flux create kustomization homek8s --source=<mygithubproject>/homek8s --path="./deploy" --prune=true --interval=10m
flux create kustomization homek8s --source=GitRepository/app --path="./deploy" --prune=true --interval=10m
flux create kustomization sonarr --source=GitRepository/sonarr --path="/srv/homek8s/media/sonarr" --prune=true --interval=10m

output of flux get sources all:

flux get sources all
NAME READY MESSAGE REVISION SUSPENDED
gitrepository/homke8s True Fetched revision: master/d7977c8d9b9271119e65ad3840775722e616046a master/d7977c8d9b9271119e65ad3840775722e616046a False

and none of the "flux create kustomization" things work. I'm trying to simply get V2 installed to where it will update public images, just like V1 did...but the documentation kinda sucks. Thanks in advance!

&#x200B;

all i get is the following:

flux create kustomization sonarr --source=GitRepository/media/sonarr --path="/srv/homek8s/media/sonarr" --prune=true --interval=10m
✚ generating Kustomization
► applying Kustomization
Kustomization updated
◎ waiting for Kustomization reconciliation
✗ Source 'GitRepository/GitRepository/media/sonarr' not found

&#x200B;

FYI, in my repo, i have things like this:homek8s/media/sonarr

homek8s/media/radarr

homek8s/media/tautulli....etc, if that helps

https://redd.it/p5w6uf
@r_devops
Guthub actions vs jenkins

As both are used for cicd, what would be the differences b/w both. Which one would you use n why?

Also ignoring the fact that u have to manage the Jenkins server by ur self while github does that for you, why would you prefer one over another?

Also is one faster then other?

https://redd.it/p5x7c1
@r_devops
Kubernetes 1.22 is here and it comes with an approach that says, “Less is more.” So, we can see 56 enhancements to this new release (up from 50 in Kubernetes 1.1 and 43 in 1.20). Of those 56 enhancements, we will see that there are 13 which seems to have graduated to Stable, 24 features that have

https://www.p3r.one/kubernetes-1-22-notes/

https://redd.it/p5xy6u
@r_devops
YAMLK8s: try to find a working YAML validator for k8s

Hi folks,

The title basically.

I am looking for a script OR a website OR any solutions to validate a YAML file for k8s

&#x200B;

I saw a lot of YAML file generators but I am not looking for that.

&#x200B;

Most of the time, I am losing a lot of time because I missed a space between or something.


Cheers, thanks a lot for your advice

https://redd.it/p5yrh6
@r_devops
NAT: Host a Server, Extend the Internet

Hi everyone! I am a cybersecurity vulnerability researcher and penetration tester professionally and in my personal time, I do a lot of educational outreach. Specifically with high school and middle school students.

I recently started a YouTube channel to support some of my lectures in an async manner. Figured some of this material also might be useful to share with the broader community. Please check it out and provide some feedback on the material and teaching style--I'm trying to improve these.

I checked the rules and I think this is allowed, but if not please remove and I apologize. Thanks for watching! :)

NAT: Host a Server, Extend the Internet - YouTube

https://redd.it/p5w68i
@r_devops
Cortex v1.10 is out . We will see the crucial changes along with the enhancements and fixes in this article. The release includes a lot of new features too. We will see all of that, but first, we will see what Cortex is, and it does.

https://www.p3r.one/cortex-v1-10-update/

https://redd.it/p5xy6q
@r_devops
A Gentle Guide to tmux

I always wanted to learn tmux but never took the time to do it. Last week, it was finally that time and I dived deep and got introduced to it. After that, I decided to write a blog post describing how you can start out with tmux and what to look at in the beginning.

You can check out the blog post if you're a beginner, or you are an experienced user but you want to refresh your knowledge of the basics. Here's the link https://pragmaticpineapple.com/gentle-guide-to-get-started-with-tmux/

P.S. Part two coming soon

https://redd.it/p60qyt
@r_devops
Can you migrate github issues to devops work items?

Tried a few tools/scripts, e.g.

https://github.com/marketplace/actions/github-issues-to-azure-devops

but it seems you lose images and comments.

I guess at least for comments you would need a way to map users from both platforms.

Do you know any good solution to keep images and comments?

https://redd.it/p60pht
@r_devops
Hikaru 0.7b just released with support for K8s watches. Now you can monitor Kubernetes activity with Hikaru, receiving events in the form of Hikaru objects.

Hikaru is a Python tool that provides you the ability to easily shift between YAML, Python objects/source, and JSON representations of your Kubernetes config files. It provides assistance in authoring these files in Python, opens up options in how you can assemble and customise the files, and provides some programmatic tools for inspecting large, complex files to enable automation of policy and security compliance.

https://github.com/haxsaw/hikaru

https://redd.it/p615pw
@r_devops
What would you use to get logs in a "pull way"?

Hi guys, I have been asked to set up logs collection/monitoring for +500 devices that don't support pushing logs to a log server, means I have to do an API request to get the logs for each device. I only have a small idea about the logging solutions out there and I would like to know your input.

Any suggestion is welcome, thanks in advance.

https://redd.it/p62tjy
@r_devops
DDOS protection by using secondary, smaller servers that receive traffic

A while ago I read about a method of protecting your servers from DDOS by basically having separate servers that accept connections from the outside and send the traffic to the main server. You have 2-3 of these smaller servers and in case of DDOS you switch between the smaller servers so when one fails you use another. Meanwhile, the main server is protected.

Does this ring any bells? I don't remember what it was called.

https://redd.it/p64det
@r_devops
Unpacking Observability: A Beginner's Guide

"Fundamentally, Observability is a data problem, and capturing the right data will ensure a properly observable system."


In the latest **#StoriesFromTheHerd**: Adriana Villela, Observability & Platform Solutions Manager at Tucows, shares a beginner’s guide to understanding Observability, why it matters, and how you can get started.

https://storiesfromtheherd.com/unpacking-observability-a-beginners-guide-833258a0591f

https://redd.it/p66dys
@r_devops
From Software Engineering to Platform Engineer Role

Hello everyone. Long story short I am coming from a background of software engineering for embedded systems with a masters in computer science. I was researching+planning to make a career change to DevOps and I applied for the role at a mobile network operator company. They gave me some technical skills tasks (basically an automation python script to GET information from a dummy API endpoint, populate an SQL database in a Docker container) and they told me that while I did very well, I am lacking the skillset in the QA testing and DBA areas for the DevOps role I applied for. Impressed by my submission, they offered me a role for a platform systems engineer to gain exposure to the industry for a potential shift to the DevOps department in the future.

I am trying to research and gain knowledge on the role responsibilities however I am having trouble finding information with respect to the telecom industry. Can someone explain and/or provide examples of the following with respect to the mobile network telecom industry:

1. Monitor and maintain infrastructure performance, capacity and availability, providing second and third level support for the resolution of incidents and operational issues.
2. Implement supporting database and middleware capabilities to support software module development and operations
1. What are middleware capabilities?
3. System KPI monitoring and analysis to pin point improvements
4. Working knowledge of database technologies, scripting and/or programming languages with the aim to increase system efficiency and lower human intervention time on any tasks
5. Working knowledge with Micro-Service architecture
1. They also require supporting and maintaining Java Applications so I am guessing Java Spring boot is one of the micro-services. What are other micro-services can be included in the architecture.

Apologies for the information overload. I am really excited for the career change and I want to do everything to shorten the learning curve before my official start date next September.

Thanking you guys in advance.

https://redd.it/p67n4k
@r_devops
Any useful anecdotes regarding the use of containers in vsphere

Looking at pairing down VMs with some vpshere upgrades and are weighing the pros and cons of containers in that environment.

It just seems like a weird way to go about it, but if it's less resource intense than a VM, that's likely to make my life a lot easier.

https://redd.it/p670ky
@r_devops
When varnish returns a cache, does it also return the cookie generated on the backend or only the css, images and html returned to the frontend?

When varnish returns a cache, does it also return the cookie generated on the backend or only the css, images and html returned to the frontend?

I had a problem where users would get the wrong cookie, so I am thinking it was due to the varnish caching, is that correct?

https://redd.it/p655y2
@r_devops