Books to read for devops engineer

I am working as a devops engineer for last 4 years, with total 6 years of experiance in IT. At this point of my career I want to learn more about the IT. It is now manditory for a devops engineer to understand the application and help developers on designing them.
Like:
I am not faimilier with many terminologies used by the developers, QA etc..
I want to understand how a software is designed and how the testing is done etc.. entire flow till the application in production.

Any book/books that gives me more understanding on these topics.

Thanks in advance

https://redd.it/eoyqfi
@r_devops

Looking for Devops 101

My skill level is low. I am on a junior dev level.

vagrant, docker, kubernetes, CI/CD - I have read definitions, followed along the docs and ran "vagrant up" & [got docker to run](https://guide.freecodecamp.org/docker). But never did anything in a production environment and I am sure that I have not fully even understood the concepts. Basically just did "hello world".

I think the concept I have to pay attention is more about "containers". What is [kata](https://katacontainers.io/)?

So, how do I learn the basics to understand what is what and know if a devops guy is talking shit. Or if I am skilled enough, to actually get into devops. That is the aspiration.

All my skill are limited to the knowledge I manage to get from [AutomateTheBoringStuff](https://automatetheboringstuff.com/) & completed the "Responsive Web Design Certification" from [FreeCodeCamp](https://guide.freecodecamp.org/meta/free-code-camp-full-stack-development-certification/), working on completing the rest. So, something from my level.

https://redd.it/eoyp0p
@r_devops

How should I separate my Jenkins Projects(Jobs?) within a pipeline?

First I want to start off by saying I’m pretty new to Jenkins and am trying to set it up for my new team. We are just starting development so we don’t have a bunch of tests yet.

From my understanding a project, which I think is often referred to as a job, in Jenkins is used to run a specific test and compare the results to what is expected. If the test results match the expected results the project passes.

A pipeline is used to take multiple projects and run them one after another to essentially test a bunch of things without having to start each project individually.

How should I handle separating my projects within Jenkins so I don’t have to rewrite multiple lines in the test?

Currently I want to take a programming approach and think of projects kind of like C++ functions. If I’m going to be doing the same thing over and over again, like cloning the repo or building the project, it should be in its own project with the pipeline handling the variables that may be passed. Will this work?

When a new project is started within the same pipeline is the workspace the same as the project that ran before?

Here is my general idea of a pipeline and the projects within it.

Pipeline: Test Invalid User Input on Linux

Project: Clone repo from GitLab

Project: Compile source code on Linux Node

Project: Run User Input unit test script that calls all the tests specifically for user input

Does this seem like a reasonable separation of projects or is there a potential for flaws? I would have a similar pipeline for Windows.

If you have any resources I should look into for Jenkins please share them!

https://redd.it/epkjal
@r_devops

To what extent are devs responsible for security in the container build pipeline?

I am a user researcher and not a developer so please forgive me if I am using the wrong terminology but I am trying to understand how security works at the start of the container pipeline (the build pipeline). I know that developers run all kinds of tests on their container images but what sort of security tests are done at this point? Would they actually somehow test against the runtime security policy set by the security/vulnerability team at this stage (possible the Kubernetes admission controller policy?)? And how would that work actually? Do they have audit/view access to the security tool being used to create the policy? Who is actually responsible for the security at this point in the pipeline?

I know that there is a trend to shift security left and I have read a lot of articles about that but I am just trying to understand from a practical point of view how it actually happens since there are different roles and different teams at play here (and presumably politics as well).

Any insight on this would be very appreciated. Thanks! :)

https://redd.it/epqbmt
@r_devops

OneDev - An open source super-easy all-in-one DevOps platform

We are proud to release OneDev. It is an open source all-in-one DevOps platform, featuring git repository management with language aware code search, issue management with custom states and tickets, and a docker first Kubernetes native build/CI engine.

It is an alternative to GitLab, but is much easier to use and maintain, with lots of unique features. Checkout the product and documentation here:

[https://github.com/theonedev/onedev](https://github.com/theonedev/onedev)

https://redd.it/epsowh
@r_devops

when working in a new environment in DevOps, how long does it generally takes to acclimate yourself to all of its tools, processes and cultural work practices - especially when you’re new to dev ops?



https://redd.it/epsbzu
@r_devops

From Windows Admin to Devops

I've spent most of my career working and supporting Windows Servers, workstations, and infrastructure but as the years have passed the demand for this type of Admin has decreased significantly, as would be expected. I find myself much more interested in devops, particularly Linux and AWS solutions. I have a degree in computer science from the 1990s and most of a masters in Bio systems engineering, where I was focused mostly on sensors and controls and automation and did some significant coding. Unfortunately my academic experience has not translated into real world experience. My last position was a Powershell script developer in a contract position where I wrote scripts to automate security and patching processes in SCCM.

I am currently unemployed and have spent my days becoming more familiar with Linux, AWS, and bash/python scripting. I'm working on certifications but without real world experience I'm just not sure what I can do to prove to employers (and myself) that I know what I'm doing enough to be hired.


Any suggestions on what I should focus on and where to get training? I'm currently working through some courses on cloudguru and udemy but could really use some advice and direction in what is essential. The number of skills and technologies I see when looking at devops positions is a bit overwhelming.

https://redd.it/epn9m6
@r_devops

Should I move from CircleCI to GitHub Actions?

Hi DevOps community.

I was pretty hyped for the launch of GitHub Actions. I've been using CircleCI for the past 3 years, and with the recent pricing changes, I was hoping that GitHub (& Microsoft) would be my new go-to for SaaS CI/CD. I hoped they would "break the game" with an aggressive pricing and lots of features.

To be honest, I found it a bit "meh" when I tested it at first during the Beta. There was no cache between pipeline jobs, the UX wasn't good, the runners were really slow...

GitHub updated quite a lot during the Beta and since the launch (now there is caching, there are self-hosted runners...), but I don't find it mature enough for a production-ready CI/CD pipeline provider.

My colleague and I tested GitHub Actions against CircleCI and GitLab (here are our results [https://blog.theodo.com/2019/12/github-actions-on-the-test-rig/](https://blog.theodo.com/2019/12/github-actions-on-the-test-rig/) ).



Have you tried GitHub Actions, and did you choose to use it on your projects ? Have I missed something game-breaking that would change my mind ?

Thanks :)

https://redd.it/eplrcf
@r_devops

2019 My year in review: inlets & inlets-operator for Kubernetes

I started a new OSS project over the holidays last year, it was a side-project and not meant to be anything big. I wanted to create a simple solution using Golang and websockets so that we could receive webhooks through HTTP. The reason this works through private networks is that the client speaks first, and then establishes the persistent connection.

And for the well meaning, without time to browse the README:

\> Developers wishing to use inlets within a corporate network are advised to seek approval from their administrators or management before using the tool. By downloading, using, or distributing inlets, you agree to the [LICENSE](https://github.com/inlets/inlets/blob/master/LICENSE) terms & conditions. No warranty or liability is provided.

[https://blog.alexellis.io/2019-my-year-in-review-inlets/](https://blog.alexellis.io/2019-my-year-in-review-inlets/)

https://redd.it/epluhm
@r_devops

2020 Database DevOps Survey

Every year DBmaestro holds a survey among DevOps professionals and teams to try and learn about the state of DevOps as well as the state of Database DevOps. We'd appreciate it if you could take 5 minutes to help us and take the survey.

[https://www.surveymonkey.com/r/2020\_Database\_DevOps\_Survey](https://www.surveymonkey.com/r/2020_Database_DevOps_Survey)

Thanks in advance!

https://redd.it/epkmm1
@r_devops

For those getting into DevOps from OPs background, how would you rank the learning of these DevOps tools in order, with 1 being first priority, 2 being second, etc: (tools in the description, feel free to add tools I may have missed) Structure it in a way to get up-to speed the fastest.

AWS
Terraform
RabbitMQ
Apache Kafka
Python
Go
RBDMS/NoSQL
Docker
Kubernetes
Splunk
Prometheus
Jenkins
Git
Ansible
Selenium

https://redd.it/ephrgb
@r_devops

How long would it take to generate the following cloud formation template to build this infrastructure from scratch? Where to begin? cloud designer? or an easier way?

\*two vpcs, one on only private subnet, one on another

\*one vps instance in private VPC, one in public

\*the VPC with private subnet should have internet connectivity.

\*instance in public subnet must belong to securitygroup, as a webserver, including ssh ability by ip given as a parameter,

\*vpsinstance in private has securitygroup enabled for some randoom port, that the vpsinstance in public vpc can access.

https://redd.it/epvgnk
@r_devops

In general, who are more successful at DevOps, those who come from strong operational backgrounds, or those who come from strong development/software engineering backgrounds? And who has a greater learning curve when transitioning to DevOps from their respective fields?



https://redd.it/eph83l
@r_devops

How to inventory microservices and their endpoints/versions etc? Need help with ideas.

Hello everybody,

I am working as an architect and received a request from my organization to think about a solution to document microservices- & API's.

Essentially, what they want is a list that they can share with developers and also import to a ticketing tool. So people can report an incident on a microservice/API. The list should contain some basic information like:

​

* API Name
* API Location
* Endpoints (create, update, delete etc)
* Versions
* Other suggestions?

​

I am not working with DevOps normally, and I'm not very well versatile in it. So this is quite out of my comfort zone. So forgive my somewhat simplified view.. But how I see it, isn't it just a matter of exporting this information via an integration (REST) that puts it into a database?

Any tips on how to consolidate this and do it as automatic as possible? Where would the functionality of "registering" a new API in the DB actually be put? That is what I'm struggling with most to understand. Maybe a script which always run for each API (upon creation) that registers it in the database?

There are of course many more questions that needs to be solved. Such as how do you maintain it up to date when an API changes (version, endpoints etc) without too much manual intervention.. Relationships between different API's etc. But that comes later.

Any nudge in the right direction would be very much appreciated.

https://redd.it/epijt8
@r_devops

question on containers and queues

should I put the queue process manager in the same container as the main app?

for example if I have a laravel app with supervisord as the process manager, should I run supervisord in the same container with the app + nginx?

https://redd.it/ephd28
@r_devops

Looking for a system for sending out system status and planned maintenance by email

Hi,

I'm looking for a system to easily send out notifications to our customers when a service degrades/downtime on a service, and optional for planned maintenance.

We have a system where we have several middleware servers, and several customers with frontend-services on top of this middlewareservers.

I looking for a service for quickly sending out notifications to the affected customers. I.e customerA should be notified when we detect errors on customerA-frontend, and a predefined set of middleware-servers that affects customerA.

I have looked at [sorrypage.app](https://sorrypage.app) et al, and I like it's structure with components etc, but I don't want a public statuspage, but only notification by mail.

The closest I have found is using mailchimp and tags, i.e tag a customer contact info with "customerA", and for example "middlewareC" and "middlewareE" - but it really like a tools special made for this, with nice, (predefined) templates.

​

Any tips?

https://redd.it/epges2
@r_devops

ISPconfig for docker ?

I have multiple web servers running remotely, I’d like something to manage them just like ISPconfig (chroot dir, setup ftp users, manage configs) is there anything on the market for this ?

My only alternative right now is to stop using dockerized setups in favor of the old fashioned setup nginx and php-fpm on each server so I can use ISPconfig but I really like being able to tinker with upgrading my containers to the latest php etc without hassle

What are you guys doing or using to make life easier ?

https://redd.it/epg2m1
@r_devops

In looking for work, the most common and difficult interview question is how I would diagnose performance issues between multiple tiers and/or services, cloud or bare metal. What's your answer to this?

The problem is in the subject.

I have a fair understanding of this and don't wash out, but I feel like my response is sub-par and not on point.

How do I respond to this question as a generalist being interviewed?

https://redd.it/epfl2i
@r_devops

Is sentry.io only monitoring errors or can I use is as a cross-project centralized logs platform?

I know that it supports many cool frameworks which could help me a lot during development of some apps, but I am wondering whenever it can gather rather simple, not error related logs from the projects?

If there is anything else you can suggest as an alternative then please, share.

I intend to self-host a [sentry.io](https://sentry.io) since they provide clean docker-compose file

Especially I am looking into a possibility of live-tracking logs messages from frontend app and backend API (at one screen) which could possibly help me with debugging async apps.

https://redd.it/epdtxp
@r_devops

Secure Kubernetes on Hetzner Cloud with a node driver for Rancher

Hi! I wrote a post on how to deploy Kubernetes to Hetzner Cloud (a cheap and very good cloud provider from Germany) using a node driver for Rancher. The node driver is very convenient, but requires that a firewall is configured separately, which is what I show in this post. Any feedback is much appreciated!

https://vitobotta.com/2020/01/17/secure-kubernetes-hetzner-cloud-rancher-node-driver/

https://redd.it/eq1bbw
@r_devops