Your private docker registry

Here's a little article that I've wrote docker private registry alternatives.

Hope it helps someone :)

​

[https://creekorful.me/harbor-private-docker-registry](https://creekorful.me/harbor-private-docker-registry)

https://redd.it/eqla7u
@r_devops

message queue between devices

Hy,

I would need a second opinion about my project. It's my home/pet project but I would still want to learn from it. I have 3 raspberry pi and they will be sending data to my home computer/server. There will be 3-5 messages for every senod per raspberry pi(9-16 total per second). Now, I know how to implement API, but since they're only sending data I think async communication is better choice. I'm looking at kafka, rabbitmq, zeromq etc. but they seem to have a lot of functionality I don't need and I keep wondering, is there something more simple for this use case?

https://redd.it/eqklqq
@r_devops

How do you use manual actions in your CircleCI pipeline?

Lets share some inspiration. We have manual actions on E2E tests as they take quite some time and you want to run them just when needed. And then on the master branch we have manual actions that approve the deploy to production.

https://redd.it/eqkboy
@r_devops

How do testing/development environments in the cloud work?

I am building a REST api (spring) on my machine (personal project). I want to test if it successfully makes calls to AWS resources like S3, RDS etc. But I don't know exactly how it's supposed to be done.

I watched 2 videos on accessing RDS with a library that makes API calls to secrets manager (cus I don't want to hardcode my DB credentials) but I am stuck in configuring it into Spring Boot. Then I saw there is this thing called AWS Java SDK.

But how can my local spring boot server use an IAM Role to access whatever API I want to test? And generally speaking, should I even be doing all of this from my local machine?

I know quite a few pieces already (ec2, linux, programming in Spring and Angular etc) but I find it hard to put them all together in context. I've yet to get a job in SWE so I wasn't exposed to how it's all done in the real world.

https://redd.it/eqh6el
@r_devops

Docker and AWS Certification

I just received my first web development internship offer and I like web development a lot especially back-end with Node, Express, and MongoDB. I now want to level up myself to the next level, by learning some DevOps and Automation. Which AWS certification would be great to have in my resume and can be achieved within 6-12 months (assuming I have regular classes at University and later work).? I have heard a lot about Docker lately and I want to get certified in it as well.

https://redd.it/eqfviv
@r_devops

Hello everyone

I am a waanna be devops engineer who is almost finishing uni. I woild want to ask everyone here how to get started to befome a decent devops.

https://redd.it/eqh0ub
@r_devops

Looking for SSH server practice in coding boot camp

Hello, I'm currently atending to a course on web development, and the class now its creating a server, and uploading a custom website trought ssh and Nginx, and then setting up a custom domain.I don't have credit card to pay for DigitalOcean, and its just for this single practice, are there any other way to do it?

I've tried mounting a custom server with filezilla but I cant use it because my IP isnt static, and I cant access to my router configurations, they are locked for my INSP

https://redd.it/eqn7eg
@r_devops

What are the hardest things you had to do as a devops engineer?

What are the hardest things you had to do as a devops engineer?

https://redd.it/eqmf0s
@r_devops

aws management and tagging

Hi guys, I have a big question for you. Imagine to have a very big aws infrastructure with thousands of resources but nothing is tagged. Now we want to tag everything because of IAM policies and better cost management.

How would you retroactively tag those thousands resources? No way I'm gonna manually tag every single line because it would be impossible.

I see 2 possibilities. (maybe 3)

1. tag father resources like EC2 and do a script to tag child resources (problem with shared resources).
2. activate an auto tagging system that when a resource call another resource a tag is added. No idea how to implement this
3. (tag everything in excel and import all tags. not very devops style)

Thank you for your ideas and suggestions and for sharing your tagging experiences

https://redd.it/eqdp04
@r_devops

Serverless Terraform remote backend

TL;DR:

I build a custom terraform HTTP backend. Link [https://github.com/derBroBro/TerraDepot](https://github.com/derBroBro/TerraDepot)

What do you think about this approach?

​

Long version:

For me, one of the largest problems in terraform is state handling. Especially if you have a lot of terraform projects, different accounts and team members it becomes quite messy.

Even if there are some builtin options like s3, gcp, artifactory or the offerings by hashicorp, they are altogether not what I was really looking for. Some are a mess from the permissions management (s3, gcs etc.) others (like terraform cloud) are more or less an included CI/CD System which we already have.

Therefore I spend some time on my holidays developing a backend as I would need it.

The result can be found here: [https://github.com/derBroBro/TerraDepot](https://github.com/derBroBro/TerraDepot)

What do you think? Do you have any further ideas or hints?

https://redd.it/er1v1n
@r_devops

Apprise API Docker Container - Over 50+ Supported Notifications

Hi guys,

It's taken a while, but I've managed to [build an API](https://github.com/caronc/apprise-api) around [Apprise](https://github.com/caronc/apprise) so that it can be used as a micro-service and/or [sidecar](https://docs.microsoft.com/en-us/azure/architecture/patterns/sidecar) for any project now. Apprise is basically the Swiss Army Knife of notifications; it can act as a universal relay to all of them out there (such as Telegram, Amazon SNS, Slack, etc).

The [Apprise API]((https://github.com/caronc/apprise-api)) is especially useful for system admins and devops who wish to be able to send notifications, but don't want to haul in *Python* libraries into their native *Go*application (*as an example*).

**The System**: [Apprise API](https://github.com/caronc/apprise-api)

**Docker Source**: [Here](https://hub.docker.com/r/caronc/apprise)

**Installation**:

# Retrieve container
docker pull caronc/apprise:latest

# Start it up:
# /config is used for a persistent store, you do not have to mount
# this if you don't intend to use it.
docker run --name apprise \
-p 8000:8000 \
-v /var/lib/apprise/config:/config \
-d caronc/apprise:latest

From here you can just point your browser and/or applications to `https://localhost:8000`

I'd be really curious on any feedback you have; enhancements, and or ideas you have that could make it better.

https://redd.it/er0rja
@r_devops

Azure DevOps Deployment groups

Looking for confirmation on my understanding of deployment groups:

Create a deployment group of like machines i.e. web servers

Install an agent (via the generated script or Azure add-on) on those machines and configure the appropriate demands. This will also register the machine as a target in the deployment group.

Set up a Release to these machines by configuring the deployment group in the Release.

Does that sound about right?

If so, I want to use terraform to create the machines, install the addon that registers them as targets, then automatically kick off a release once they are registered as a target. Does this sound possible?

Thank you for your time and thoughts!

https://redd.it/er1fv3
@r_devops

How do partitions of a database communicate? By microservices?

When a database is partitioned across multiple computers, how do the partitions communicate? Is it appropriate to consider each partition as a microservice? (I relate database partitions to microservices, because microservices are "partitions" of a larger program.)

https://redd.it/er4u30
@r_devops

Unothorized to create Kubernetes cluser on AWS using kops

I'm new to AWS and I'm trying to deploy Kubernetes for some tutorial purposes using kops.For that, I'm using a trial AWS account and I started following [this practical guide](https://ramhiser.com/post/2018-05-20-setting-up-a-kubernetes-cluster-on-aws-in-5-minutes/) to do it but I have an issue with this command :

kops create cluster --node-count=2 --node-size=t2.medium --zones=us-east-1a

which gives me the following error :

I0119 16:14:49.647701 13949 create_cluster.go:517] Inferred --cloud=aws from zone "eu-west-3a" error populating configuration: error querying for valid AZs in "eu-west-3" - verify your AWS credentials. Error: UnauthorizedOperation: You are not authorized to perform this operation. status code: 403, request id: a1f6e99f-76d6-4c3f-95bb-416cc2d67f2e

I wonder if it's not related to some limited access due to my trial AWS account !

https://redd.it/er1jbq
@r_devops

Build a 10 USD Raspberry Pi Tunnel Gateway

In this tutorial I'll show you how to build an Internet Gateway for your home network using a Raspberry Pi and a HTTPS tunnel for just 10 USD.

You can achieve a similar effect of an Internet gateway by enabling port-forwarding on your home router, however there are downsides to this.

An Internet gateway with the [inlets](https://inlets.dev/) OSS project will provide a persistent connection behind the trickiest of networks and let you expose your private and LAN services of choice to the Internet.

[https://blog.alexellis.io/raspberry-pi-zero-tunnel-gateway/](https://blog.alexellis.io/raspberry-pi-zero-tunnel-gateway/)

https://redd.it/equ1cs
@r_devops

Newbie : How do you document your work / knowledge?

Good morning everyone,

I recently started my account on Linux Academy, due to the good reviews and few comments on priors posts and I have to say that is gorgeous, I really like it and I thanks everyone who told me to try it.

---

As for the question, my main doubt right now is how to document and structure what I am learning from them and what I have already learned from myself. Because, if we are realistic I am not gonna retain all the information in my brain...

I would like to know which tools or methods do you use to organize your documentation when you are learning something new.

For the time being I think that what could work is to try to organize my existing repository and try to fit the valuable information from the course into it... but as said I am having a few doubts about this method.

---

As always thanks for your time, and have a great day ^^

https://redd.it/eqvbhp
@r_devops

ubuntu 18.04 auto-heal service on failure

Hey guys, I wanted to know if there's a way to auto-heal a service when he fails or a server restart on ubuntu 18.04

Thanks!

https://redd.it/eqtoi7
@r_devops

GitHub - oslabs-beta/Allok8: ⚡️A pretty swell Kubernetes visualization tool

With a group of enthusiastic engineers, they set forth on a month challenge to create an MVP for Allok8. It’s a conventional and uncomplicated web-based UI Kubernetes visualization tool. Though current tooling is readily available, their goal was to give insights down to the container level, especially when containers become interdependent on one another. They’d love the feedback and support of the open-source community as they’re always looking to grow! Tysm ~

https://github.com/oslabs-beta/Allok8

https://redd.it/er89la
@r_devops

Delayed Notifications Functionality: VictorOps vs OpsGenie

What do you guys think about the delayed notifications functionality on OpsGenie and VictorOps?

https://redd.it/erf5h7
@r_devops

"stress test" application to abuse CPU/RAM/HDD

Hi there,

I want to check and then harden my Kubernetes cluster's stress tolerance by deploying some kind of stress generating application that would:

1) Try to hog as much CPU as possible
2) Try to allocate as much memory as possible
3) Try to saturate disk IO with a lot of operations

The question:

Do you know, can you advice any application that does some harmful chaotic activities, tries to misuse resources, e.g. hogs CPU and leaks memory like there's no tomorrow? Does not need to be Kubernetes specific, just need something that works on Linux ;)

I need this to test if resource limits we apply on our Kubernetes cluster work the way we expect them to work, before deploying production applications there.

Thanks!

https://redd.it/ereddk
@r_devops

What is your code review process?

Do you have a limit for a number of code lines? Do you encourage people not to spend more than an hour on code review? Do you have any metrics that you watch (defect rate, avg time for code review,...), do you use any checklist so you don't forget on important things?

https://redd.it/erckwt
@r_devops