Sparrow plugin to run gitlab pipelines

Meet sparrow plugin gitlab-run-pipeline to run gitlab pipelines through Raku API.

https://redd.it/p5lcgj
@r_devops

What open source projects or free/freemium/low-cost hosted services do you use for personal/homelab purposes?

I have what I call a "completely unnecessary" personal and homelab setup (unnecessary because I can live without any of the things I have, but I do it for fun and I also get to experiment with things I can incorporate at work). It runs mostly on open source software or hosted services with a free tier, so the recurring costs are quite low.

I was wondering if anybody is using anything they're currently using that they would recommend.

Here are some of the things I'm currently using:

* [Kubernetes](https://kubernetes.io/) (obviously), on top of which most of these projects run on
* [Terraform](https://www.terraform.io/), with the state hosted on the free tier of [Terraform Cloud](https://www.terraform.io/cloud)
* [Prometheus](https://prometheus.io/)
* [Grafana](https://grafana.com/)
* [PagerDuty](https://www.pagerduty.com/)
* [Minio](https://min.io/)
* [Okta Developer Plan](https://developer.okta.com/)
* [Longhorn](https://longhorn.io/)
* [CloudFlare](https://www.cloudflare.com/)
* [ImprovMX](https://improvmx.com/)
* [PiHole](https://pi-hole.net/)

So, what are you using that you can recommend?

https://redd.it/p5j7w2
@r_devops

What tools to use for CICD pipeline of a Python webapp

I am going through a DevOps certification, because my organization demands it. In the tutorials they demonstrated whole CICD pipeline for a Java project. SCM - gitea; unit testing - junit; orchestration - Jenkins; artifact repo - Jfrog; code review and coverage - sonarqube; containerisation - docker; server mgmt - ansible; and deployment - Tomcat.

Now I am expected to use a similar CICD pipeline for my own project. I am not comfortable with Java. So, made a small project in Python, thinking that same tool can be used. But apparently not true. And now I am stuck and don't know what to do.

I am not in development roles (I am in quality function, and deal with mostly process related things) so, don't have any idea on the tools used.

Currently, I have gitea for SCM, pyunit for testing, docker for containerisation, ansible for server mgmt and flask deployment. Rest all I am not able to find. Please suggest what all tools can be used to complete a Python webapp CICD pipeline.

Thanks

https://redd.it/p5nzm0
@r_devops

A Devops Meme

https://youtu.be/BbyVmVBcKPY

Sorry didnt know where else to post this

https://redd.it/p5ojpu
@r_devops

On the learning Boat of DevOps, looking for more ways to learn

Hello there!
I started learning DevOps recently using online resources. Currently I have learned a bit of Jenkins and integration with Dockers. I've gone over integration of MySQL and S3 bucket for AWS. I want to learn things as quickly as possible and I'm quite adaptable and quick at learning as well.

I am looking for one of these things:
1. A small group Working on some project who won't mind getting me on board as a learner, I'll learn alongside and contribute to the project.
2. Some one who is experienced in DevOps and can help me by directing me on things like what should I look into next, what are the main components of automating etc, basically a guiding hand.
3. Mentor in his/her free time who will like to help me learn it.

I know it sounds a little bit selfish but I'm really excited to learn this and probably make a career in this, and I am also a firm believer that spreading your knowledge to others is a great ability and a kindness.

Even if our time zone won't match, I'll work to make things work and I can easily provide 3-4 hours daily and much more weekends for just this as I work on Monday to Friday.

Let me know if someone has some free time and will like to help me out a bit.

https://redd.it/p5otoj
@r_devops

What am I ?

Hello,
I've been working in my company for about two years. My title is backend developer, but since I've started I've been handling stuff like automating load balancing clusters management, integrating security into k8s clusters, dockerizing APIs that I write, creating CI/CD pipelines, debugging and handling application performance, automating DBs synchronization , designing applications, securing code, Docker images and basically I have the right to do any task without limiting myself to a specific field.
I just call myself a software engineer that does some DevOps sometimes, I know DevOps is a culture, but I'm talking about the mainstream definition of the word, automation + tools. But is this more than what is asked of a software engineer to do ? I can't even imagine just writing code and letting someone else handle its deployment.

https://redd.it/p5nnrr
@r_devops

I really truly don't understand environmental variables in production at all.

Like Custom Environmental Variables (Not Like Github Commit Information).

For example if I want to use automation tools like Terraform, Ansible how to I put environmental variables for Node/Flask/Django app for 0auth secrets, 0auth client, Database Passwords.

How am I supposed to get an output from Terraform (Like an ALB or some kind of Elastic IP) to a build so it knows the client app I build knows where the server is .

I'm just trying to find a do-something use case for learning Terraform/Ansible/CI/CD and the easiest thing to think of is a client-load balancer- server-database architecture and I really can't figure out how to do anything meaningful because of this reason. I'm trying to run servers on EC2 for example. Is this 100% stupid and should I be doing everything on a Managed Kubernetes Cluster where IPs are resolved by services by the cluster, alongside configMaps and Secrets that you deploy onto the cluster.

https://redd.it/p5nklz
@r_devops

Is DevOps suitable for fresh grad with no experience ?

I have the opportunity to join DevOps boot-camp

but I'm still fresh grad with no experience so my question is
is DevOps suitable for fresh grad ?


some people telling me that i have to have experience in another field then shift to DevOps

https://redd.it/p5lg2v
@r_devops

To kubernetes or not to kubernetes?

Hi guys, a little bit of background, I am a dotnet developer and I am starting my business, I have a management system that is very light weight, they get at max 20 concurrent users, I already have 20 consumers, each consumer has his own api in a docker container, I run all of their services on docker atm on my old pc, and I will upgrade the pc very soon to be a cluster of two pcs to handle the containers but I wanted to solve some problems and I don't know if kubernetes will solve them.

First, I want a zero down time update, every time I update the code all of my consumer get a downtime of around 30-60 seconds.

Second, I want a way to run maybe 100 containers and they find a server and kinda load balance the cpu between 2-3 servers

Third persistent storage, I want to save everything to a single server, for example all the data gets saved to server X and I can add or remove any other servers and the containers will move around and still have the same data.

I tried docker swarm it was almost everything I needed, besides the storage problem, but as I researched about it, everyone was saying it was dead and etc, and I want to future proof my infrastructure.

I tried Kubernetes (k3s) as well and I think it will solve my problem, but it is so complicated with so many things happening at the same time, weird errors with file permission and etc, so I am thinking it is overkill for me, maybe if there is something else that is a middle ground between the two?
But if kubernetes is the only way I will try my best to learn it.

And all the paas I tried didn't work for me, heroku, porter, digital Ocean apps, I want to use my local cluster not a managed aws ou Google one.

I would appreciate if you guys help me out.
Thanks in advance.

https://redd.it/p5ugef
@r_devops

REMOTE JOB TIP

Hello guys.
I'm from Brazil and have been thinking about working remote with employers from other countries. Have some of you done that? And can u give me any tip? How to receive the money, bureaucracy, legal problems, etc...

Thank you in advance.

https://redd.it/p5vgsc
@r_devops

Can't figure out how to migrate from FluxCD V1 to V2

I've been using Flux for a while now to update all the public images I use in my home K8s cluster. For the most part, it works great, but its coming time to migrate to V2, and I'm stuck on one thing in particular. Following the guide here: https://fluxcd.io/docs/migration/flux-v1-migration/, I'm stuck on this part:

flux create kustomization app \
--source=GitRepository/app \
--path="./deploy" \
--prune=true \
--interval=10m
✚ generating Kustomization
► applying Kustomization
✔ Kustomization created
◎ waiting for Kustomization reconciliation
✔ Kustomization app is ready
✔ applied revision main/5302d04c2ab8f0579500747efa0fe7abc72c8f9b

I've literally tried everything for pth and source, and nothing works. here's my (i think) relevant info:

local on host location of git repo: /srv/homek8s/\

​

my attempts at the above:

flux create kustomization homek8s --source=gitrepository/homke8s --path="/srv/homek8s" --prune=true --interval=10m
flux create kustomization homek8s --source=<mygithubproject>/homek8s --path="./deploy" --prune=true --interval=10m
flux create kustomization homek8s --source=GitRepository/app --path="./deploy" --prune=true --interval=10m
flux create kustomization sonarr --source=GitRepository/sonarr --path="/srv/homek8s/media/sonarr" --prune=true --interval=10m

output of flux get sources all:

flux get sources all
NAME READY MESSAGE REVISION SUSPENDED
gitrepository/homke8s True Fetched revision: master/d7977c8d9b9271119e65ad3840775722e616046a master/d7977c8d9b9271119e65ad3840775722e616046a False

and none of the "flux create kustomization" things work. I'm trying to simply get V2 installed to where it will update public images, just like V1 did...but the documentation kinda sucks. Thanks in advance!

&#x200B;

all i get is the following:

flux create kustomization sonarr --source=GitRepository/media/sonarr --path="/srv/homek8s/media/sonarr" --prune=true --interval=10m
✚ generating Kustomization
► applying Kustomization
✔ Kustomization updated
◎ waiting for Kustomization reconciliation
✗ Source 'GitRepository/GitRepository/media/sonarr' not found

&#x200B;

FYI, in my repo, i have things like this:homek8s/media/sonarr

homek8s/media/radarr

homek8s/media/tautulli....etc, if that helps

https://redd.it/p5w6uf
@r_devops

Guthub actions vs jenkins

As both are used for cicd, what would be the differences b/w both. Which one would you use n why?

Also ignoring the fact that u have to manage the Jenkins server by ur self while github does that for you, why would you prefer one over another?

Also is one faster then other?

https://redd.it/p5x7c1
@r_devops

Kubernetes 1.22 is here and it comes with an approach that says, “Less is more.” So, we can see 56 enhancements to this new release (up from 50 in Kubernetes 1.1 and 43 in 1.20). Of those 56 enhancements, we will see that there are 13 which seems to have graduated to Stable, 24 features that have

https://www.p3r.one/kubernetes-1-22-notes/

https://redd.it/p5xy6u
@r_devops

YAMLK8s: try to find a working YAML validator for k8s

Hi folks,

The title basically.

I am looking for a script OR a website OR any solutions to validate a YAML file for k8s

&#x200B;

I saw a lot of YAML file generators but I am not looking for that.

&#x200B;

Most of the time, I am losing a lot of time because I missed a space between or something.


Cheers, thanks a lot for your advice

https://redd.it/p5yrh6
@r_devops

NAT: Host a Server, Extend the Internet

Hi everyone! I am a cybersecurity vulnerability researcher and penetration tester professionally and in my personal time, I do a lot of educational outreach. Specifically with high school and middle school students.

I recently started a YouTube channel to support some of my lectures in an async manner. Figured some of this material also might be useful to share with the broader community. Please check it out and provide some feedback on the material and teaching style--I'm trying to improve these.

I checked the rules and I think this is allowed, but if not please remove and I apologize. Thanks for watching! :)

NAT: Host a Server, Extend the Internet - YouTube

https://redd.it/p5w68i
@r_devops

Cortex v1.10 is out . We will see the crucial changes along with the enhancements and fixes in this article. The release includes a lot of new features too. We will see all of that, but first, we will see what Cortex is, and it does.

https://www.p3r.one/cortex-v1-10-update/

https://redd.it/p5xy6q
@r_devops

A Gentle Guide to tmux

I always wanted to learn tmux but never took the time to do it. Last week, it was finally that time and I dived deep and got introduced to it. After that, I decided to write a blog post describing how you can start out with tmux and what to look at in the beginning.

You can check out the blog post if you're a beginner, or you are an experienced user but you want to refresh your knowledge of the basics. Here's the link https://pragmaticpineapple.com/gentle-guide-to-get-started-with-tmux/

P.S. Part two coming soon

https://redd.it/p60qyt
@r_devops

Can you migrate github issues to devops work items?

Tried a few tools/scripts, e.g.

https://github.com/marketplace/actions/github-issues-to-azure-devops

but it seems you lose images and comments.

I guess at least for comments you would need a way to map users from both platforms.

Do you know any good solution to keep images and comments?

https://redd.it/p60pht
@r_devops

Hikaru 0.7b just released with support for K8s watches. Now you can monitor Kubernetes activity with Hikaru, receiving events in the form of Hikaru objects.

Hikaru is a Python tool that provides you the ability to easily shift between YAML, Python objects/source, and JSON representations of your Kubernetes config files. It provides assistance in authoring these files in Python, opens up options in how you can assemble and customise the files, and provides some programmatic tools for inspecting large, complex files to enable automation of policy and security compliance.

https://github.com/haxsaw/hikaru

https://redd.it/p615pw
@r_devops

What would you use to get logs in a "pull way"?

Hi guys, I have been asked to set up logs collection/monitoring for +500 devices that don't support pushing logs to a log server, means I have to do an API request to get the logs for each device. I only have a small idea about the logging solutions out there and I would like to know your input.

Any suggestion is welcome, thanks in advance.

https://redd.it/p62tjy
@r_devops

DDOS protection by using secondary, smaller servers that receive traffic

A while ago I read about a method of protecting your servers from DDOS by basically having separate servers that accept connections from the outside and send the traffic to the main server. You have 2-3 of these smaller servers and in case of DDOS you switch between the smaller servers so when one fails you use another. Meanwhile, the main server is protected.

Does this ring any bells? I don't remember what it was called.

https://redd.it/p64det
@r_devops