I've got some Kubernetes diagrams to share

Hi folks!

As a Kubernetes freshman, I've been looking into ways to customize it. And, to my surprise, I came to the conclusion that the Kubernetes API plays a very important role there. Custom resources seem to be a very good design decision because they can be manipulated in the same manner as any other built-in resources, such as Pods, Namespaces, or Services. However, the documentation is a bit bloated and the API structure is far from being trivial. So, I ended up drawing this diagram with Kubernetes API structure. Then I turned to the Operator Pattern because apparently custom resources without code actually have very little use. And found myself reading tons of vague articles full of some marketing speech. So, when I finally figured out that operators are simply Pods with custom controller logic watching and manipulating custom resources, I ended up making an animation of one of the operator's logic (or full-sized GIF, but be careful, it's 16 MB). Since operators are actually control loops, I thought that it might be easier to grasp the idea by looking at a dynamic visualization, not a static diagram. And finally, I also wrote an introductory but concrete article about the Operators Pattern with some useful (in my opinion) links in the end.

Sharing my findings because I hope it may safe time for people on a similar journey!

https://redd.it/l9gp5b
@r_devops

Getting into DevOps from full stack web - what, where and how

Hey there. While I work as full stack, I've also worked with gscripts, python, java, aws s3, and other technologies before. I was told that DevOps kind of includes different technologies and languages in order to deliver a product. To be fair, I don't know a lot. What I know is that AWS certification is very important however. So where would you recommend me to start? Some udemy course I presume? I saw plenty about AWS solutions and Kubernets, but honestly I have no idea what they mean by that, nor do I know what's Kubernets. I just want to know what the best possible road I can take to reach a satisfactory level in order to take the AWS exams, and even which one of those should I take. Thank you.

https://redd.it/l9fd0q
@r_devops

Production-grade Kubernetes (self-hosted)

Hi guys,

I have been looking for production ready kubernetes on self-hosted environment. But could not really find anything that was for my need or was a bit suspicious of the security.

So far, i have only used kubernetes on local machine using Docker Desktop, which was pretty straightforward to use.

I have onpremise server and hosted server on Hetzner. Both has ESXi running and ready to be used.

I know that 3 masters is recommended, but i have 2 for now, and that is unfortunately the budget for now.

What i am thinking is:

2 masters = 1x master on each server

2 nodes = 1x nodes on each server

How can i build such an environment?

https://redd.it/l9f3rt
@r_devops

News AWS Re:Invent Re:Cap 2020 - Summary of the Latest AWS Features

I made a summary of the latest features announced by AWS from the Re:Cap session.

You can read the summarized version below:

https://kevinvr.medium.com/aws-re-cap-2020-summary-latest-amazon-web-services-features-290a9d5de718

Which feature are you excited about? I particularly like the 1ms billing granularity for lambdas, but the mac1 instances are also quite neat (except the cost which I believe could be improved, as summarised).

https://redd.it/l9n4qg
@r_devops

AWS: How to see S3 Bucket request metrics, egress and costs

Vantage posted this blog post on how to enable S3 Bucket Request Metrics (and showing associated costs which is really nice) and thought the AWS folks here might appreciate it: https://www.vantage.sh/blog/how-to-see-s3-bucket-request-metrics-egress-and-costs

https://redd.it/l9qkcd
@r_devops

MongoDB - set replication to DocumentDB

We're setting up a local MongoDB cluster - Locally, we'll have one primary and one node, and we want to have another node in AWS. Is it possible to have that node as the DocumentDB service instead of an EC2 instace?

Also, I know I must have an odd number of total nodes, is it possible to first add one node and then add another one?
Thanks ahaed.

https://redd.it/l9a3jr
@r_devops

SSH to Dell switch without password

When I SSH to a dell switch, it asks me for a password. I'm trying to set the SSH keys so it wouldn't ask me for that but I just can't get it to work. I couldn't find anything useful online or in Dell's documentation.

How do I edit the authorized keys so that I could SSH without a password?

Also, when I log in, I have to type en to start the shell. Can I disable the need for that too?

Model is PowerConnect 6248.


Thanks ahaed.

https://redd.it/l9bsnz
@r_devops

Run Python Code in a Shell Script

I recently wrote a blog post on how to run Python directly from a shell script. As DevOps professionals, we oftentimes have to mix complexity that is best done in Python, but we don't want to manage or maintain multiple files for the script functionality.

This post shows how you can embed your Python code directly in your shell script. Also it can show some things you need to consider. And finally it explains how to debug that Python code!

https://redd.it/la4x3t
@r_devops

Monthly 'Getting into DevOps' thread - 2021/02

What is DevOps?

[AWS has a great article](https://aws.amazon.com/devops/what-is-devops/) that outlines DevOps as a work environment where development and operations teams are no longer "siloed", but instead work together across the entire application lifecycle -- from development and test to deployment to operations -- and automate processes that historically have been manual and slow.

Books to Read

The Phoenix Project - one of the original books to delve into DevOps culture, explained through the story of a fictional company on the brink of failure.
[The DevOps Handbook](https://www.amazon.com/dp/1942788002) - a practical "sequel" to The Phoenix Project.
Google's Site Reliability Engineering - Google engineers explain how they build, deploy, monitor, and maintain their systems.
[The Site Reliability Workbook](https://landing.google.com/sre/workbook/toc/) - The practical companion to the Google's Site Reliability Engineering Book
The Unicorn Project - the "sequel" to The Phoenix Project.
[DevOps for Dummies](https://www.amazon.com/DevOps-Dummies-Computer-Tech-ebook/dp/B07VXMLK3J/) - don't let the name fool you.

What Should I Learn?

Emily Wood's essay - why infrastructure as code is so important into today's world.
[2019 DevOps Roadmap](https://github.com/kamranahmedse/developer-roadmap#devops-roadmap) - one developer's ideas for which skills are needed in the DevOps world. This roadmap is controversial, as it may be too use-case specific, but serves as a good starting point for what tools are currently in use by companies.
This comment by /u/mdaffin - just remember, DevOps is a mindset to solving problems. It's less about the specific tools you know or the certificates you have, as it is the way you approach problem solving.
[This comment by /u/jpswade](https://gist.github.com/jpswade/4135841363e72ece8086146bd7bb5d91) - what is DevOps and associated terminology.
Roadmap.sh - Step by step guide for DevOps or any other Operations Role

Remember: DevOps as a term and as a practice is still in flux, and is more about culture change than it is specific tooling. As such, specific skills and tool-sets are not universal, and recommendations for them should be taken only as suggestions.

Previous Threads
https://www.reddit.com/r/devops/comments/koijyu/monthlygettingintodevopsthread202101/

https://www.reddit.com/r/devops/comments/k4v7s0/monthlygettingintodevopsthread202012/

https://www.reddit.com/r/devops/comments/jmdce9/monthlygettingintodevopsthread202011/

https://www.reddit.com/r/devops/comments/j3i2p5/monthlygettingintodevopsthread202010/

https://www.reddit.com/r/devops/comments/ikf91l/monthlygettingintodevopsthread202009/

https://www.reddit.com/r/devops/comments/i1n8rz/monthlygettingintodevopsthread202008/

https://www.reddit.com/r/devops/comments/hjehb7/monthlygettingintodevopsthread202007/

https://www.reddit.com/r/devops/comments/gulrm9/monthlygettingintodevopsthread202006/

https://www.reddit.com/r/devops/comments/gbkqz9/monthlygettingintodevopsthread202005/

https://www.reddit.com/r/devops/comments/ft2fqb/monthlygettingintodevopsthread202004/

https://www.reddit.com/r/devops/comments/fc6ezw/monthlygettingintodevopsthread202003/

https://www.reddit.com/r/devops/comments/exfyhk/monthlygettingintodevopsthread2020012/


https://www.reddit.com/r/devops/comments/axcebk/monthlygettingintodevopsthread/

Please keep this on topic (as a reference for those new to devops).

https://redd.it/la7j8w
@r_devops

Do DevOps Engineers need to know how to code?

I'm starting to work in DevOps Engineering and want to value add... I'm reading, listening and learning fast and furiously.

I see people coming from solutions architect, software engineer, sys admin... how much does a devops engineer need coding skill?

https://redd.it/laf6um
@r_devops

Automated deployment of ssh public key to 1000s Windows nodes

We use Chef for config management of 1,000s Windows 2012/2016+ servers. Have a need to deploy a public key into C:\\Users\\<user>\\.ssh\\authorized_keys.

However, while refining the requirement I recall that during a server's initial configuration a local user's profile is not created, so the C:\\users\\<user> folder doesn't exist. If I create in code it won't be associated with the user.

I am interested in how people have managed this in their environments. Perhaps I have missed a subtlety of ssh.

Servers have WinSCP and OpenSSH installed.

The Supermarket cookbook https://supermarket.chef.io/cookbooks/ssh\_authorized\_keys does not support Windows.

Regards

https://redd.it/la7n8h
@r_devops

What's cooking in your Kubernetes namespace?

As Kubernetes platform engineers, have you ever wondered what all things are running in the various namespaces that you have provisioned for your product teams?

We have developed a kubectl plugins to help answer that question. Check it out:

https://cloudark.medium.com/whats-cooking-in-your-kubernetes-namespace-9200be114f8

https://redd.it/lakvn7
@r_devops

Transitioning from current role into a DevOps role

Hello,

I want to transition from my current role as a network engineer to DevOps. I have previous experience as a sysadmin dealing with mostly a Windows environment and some Linux. I also managed the VMWare infrastructure in that previous role. From reading some of the posts with similar questions it seems the sentiment is to work on projects and not to focus too much on certifications. What projects should I work on that I could leverage when applying to DevOps roles? Any advice is appreciated.

https://redd.it/la9isc
@r_devops

Building Docker Images The Proper Way

Hi /r/devops

Today I published a new article about optimization and improvements of Docker builds, such as caching, reducing image size or making images more secure and I thought some you might be interested in this kind of an article. So, here is the link:

https://itnext.io/building-docker-images-the-proper-way-3c9807524582

https://redd.it/labibx
@r_devops

CI vendor comparisons?

I'm looking for an in-depth comparison of CI vendors. My company uses many CI providers and we're looking to consolidate. I figured there are already some good comparisons written.

Must be a recent comparison ideally written in 2020 or 2021.

Feature set, usability, reliability, and cost are the dimensions I'm most interested in.

https://redd.it/lab9v0
@r_devops

Setting up Samba on Docker?

I hope this is the appropriate place to ask this question. If not, please direct me to the appropriate subreddit. I'm just barely getting into devops. I wanted to try to set up a Docker container for an SMB server, create a share, and then access that share with smbclient. I tried downloading the dperson samba image from https://hub.docker.com/r/dperson/samba. It looks like I was able to run it correctly and, following the instructions on the page, was able to create some shares. The exact command I used was:

&#x200B;

sudo docker run -it -d dperson/samba -p \\

\-u "example1:badpass" \\

\-u "example2:badpass"

\-s "public;/share" \\

\-s "users;/srv;no;no;no;example1,example2" \\

\-s "example1 private share;/example1;no;no;no;example1"

\-s "example2 private share;/example2;no;no;no;example2"

&#x200B;

When I try to use smbclient to connect to it, I can even see the names of the shares. Trouble is, I cannot figure out how to open up the SMB terminal! Smbclient just returns me to my original terminal every time! It shows a message saying "no workgroup available". It also says "SMB1 disabled", but I think that is mitigated with the `-m SMB3` option.

&#x200B;

smbclient -I <IP address of docker container> -L <name of container> -U example1%badpass -m SMB3

&#x200B;

I'm pretty new to both Samba and smbclient so I may be making just a dumb mistake. If there is a more appropriate Docker image to use on Docker hub, let me know.

Thanks.

https://redd.it/laaw5j
@r_devops

Starting a Junior DevOps Engineer position in a week. My experience is 2 internships in full stack engineering. Will it be hard to return to the world of development after a year in DevOps? Worried I will miss coding too much.

background:
I'm compelled to take this position because income is a priority at the moment and this was the highest offer I received among all my junior dev/DevOps positions. However, the team is made up of friendly people who I get along with very well and are very interested in training me and I love the company culture and perks so its not by any means a loss. I also am genuinely interested in developing DevOps skills. I am told that there is ample opportunity to perform tasks programmatically.

my issue:
I can't help but worry I'm putting myself in a box very early on in my career. I love programming and developing features. If I wanted to return to development, would it be very hard to convince employers I have wake it takes to do development after a year in DevOps?

https://redd.it/lam85o
@r_devops

Shrinking size of EBS volume mounted as XFS

I have an EC2 instance with an EBS volume mounted as an XFS filesystem that is way too large than what we need it to be. I'd like to shrink the volume of the filesystem/volume to something much more in line with our needs, but I am having difficulty doing so. I tried doing something like this (https://cloudacademy.com/blog/amazon-ebs-shink-volume/) where I create a new smaller EBS volume, attach it to the instance, make a new filesystem and mount it to that. Then, I rsync everthing from the larger filesystem to the smaller filesystem, stop the instance, detach both volumes, and reattach the smaller volume to the block device (i.e. /dev/sdf) that the larger volume used to be attached to.

However, when I start my instance back up something goes wrong and it starts up in some sort of emergency mode based on reading the system logs. I can't even SSH into it anymore. Does anyone have any ideas on what I can do?

https://redd.it/laj3o8
@r_devops

Git hook to remove credentials

Hi
I have a file which contains some credentials. This file needs to be pushed to git. Before actually pushing or committing I'd like to remove the creds from this file.
I tried using git's pre-commit hook which replaces the creds, then does git add and commit again but this ofcourse creates an infinite loop of commits.
Any ideas or solutions to this problem?

https://redd.it/la9lqi
@r_devops

Prometheus alternative for serverless

Hey there 👋,

I'm working on a node.js app with a REST API that is deployed to AWS Lambda. Having worked a lot with Kubernetes, Prometheus, and Grafana, I'm used to instrumenting the API code and exposing white-box metrics from the app (error counts, latency histograms, request counts, and histograms for DB queries) and having those pulled by Prometheus for altering and also visualisation with Grafana.

I was curious to know if there are any tools or services that enable this level of detail in metrics for serverless?

Alternatively, if I go down the route of a long-running Node.js process using something like Google Cloud Run, are there any other tool or services that give similar functionality (short-term storage, visualisation and altering), without the operational overhead and cost of Prometheus?

https://redd.it/la391q
@r_devops

Backend developper who is tired of coding looking to move into DevOps

So, to start off with, I'd like to say that I'm relatively aware of what a DevOps specialist does as it's what my wife does. That being said, I'm sure I have some misconceptions but, either way, the profession looks quite interesting.

&#x200B;

I've read the "getting into dev ops" sticky but I had a slightly more point question: how much, if any, actual coding goes into being a DevOps engineer? I have a software engineering background but I'm super tired of the general monotony of pouring over code day in and day out like I've done for the last 7 years so I'm really looking for a tech-facing job that doesn't have me in the code.

&#x200B;

Thank you very much

https://redd.it/la32zh
@r_devops