Confirm (health check) kubernetes deploy

Hello lads! We are using Jenkins for building images and deploing microservices to kubernetes on rancher 2 running in our own cluster not cloud.

Which is the best way to check after successfull job(deployment) that our pods and containers run in the desired state without throwing errors and without unexpected restarts right after deployment ? The reasons behind are that I have to production ready sign the docker images before pushing them to our repo.


I am thinking to write scripts and ask the k8 api. But what are the right metrics that I have to receive to test my case? What kind of logic I have to implement to achieve my desired goals ? Is there any more elegant way to achieve this ?

Thank you in advance. Whish you save environment s. 😀

https://redd.it/e2lpjc
@r_devops

As a first time Terraform user, What should my expectations be to deploy a 10 node HA cluster in AWS?

I need to deploy OpenShift and all its glory to AWS using Terraform.

How long should the lift take for a first time terraform user to deploy something like the diagram below? A week? two weeks? How can I set expectations and do you guys have any advice to how I should approach this problem? Thanks.

The architecture looks something like this.

[https://aws.amazon.com/quickstart/architecture/openshift/](https://aws.amazon.com/quickstart/architecture/openshift/)

https://redd.it/e2jesv
@r_devops

How to set up CloudWatch rule from an effective Date ?

I have a AWS CloudWatch Rule.

Its a Cron expression 30 12 * * ? *

I can set up this rule in CloudWatch > Rule...... But I want to set this from a effective day ( 30/NOV/2019).

How you do this ?

https://redd.it/e2j7m5
@r_devops

Shower Thought: You can't have high uptime without quality monitoring.



https://redd.it/e2j15u
@r_devops

Monthly 'Getting into DevOps' thread - 2019/12

**What is DevOps?**

* [AWS has a great article](https://aws.amazon.com/devops/what-is-devops/) that outlines DevOps as a work environment where development and operations teams are no longer "siloed", but instead work together across the entire application lifecycle -- from development and test to deployment to operations -- and automate processes that historically have been manual and slow.

**Books to Read**

* [The Phoenix Project](https://www.amazon.com/Phoenix-Project-DevOps-Helping-Business/dp/1942788290) - one of the original books to delve into DevOps culture, explained through the story of a fictional company on the brink of failure.
* [The DevOps Handbook](https://www.amazon.com/dp/1942788002) - a practical "sequel" to The Phoenix Project.
* [Google's Site Reliability Engineering](https://landing.google.com/sre/books/) - Google engineers explain how they build, deploy, monitor, and maintain their systems.
* [The Site Reliability Workbook](https://landing.google.com/sre/workbook/toc/) - The practical companion to the Google's Site Reliability Engineering Book
* [The Unicorn Project](https://www.amazon.com/Unicorn-Project-Developers-Disruption-Thriving-ebook/dp/B07QT9QR41) - the "sequel" to The Phoenix Project.
* [DevOps for Dummies](https://www.amazon.com/DevOps-Dummies-Computer-Tech-ebook/dp/B07VXMLK3J/) - don't let the name fool you.

**What Should I Learn?**

* [Emily Wood's essay](https://crate.io/a/infrastructure-as-code-part-one/) - why infrastructure as code is so important into today's world.
* [2019 DevOps Roadmap](https://github.com/kamranahmedse/developer-roadmap#devops-roadmap) - one developer's ideas for which skills are needed in the DevOps world. This roadmap is controversial, as it may be too use-case specific, but serves as a good starting point for what tools are currently in use by companies.
* [This comment by /u/mdaffin](https://www.reddit.com/r/devops/comments/abcyl2/sorry_having_a_midlife_tech_crisis/eczhsu1/) - just remember, DevOps is a mindset to solving problems. It's less about the specific tools you know or the certificates you have, as it is the way you approach problem solving.
* [This comment by /u/jpswade](https://gist.github.com/jpswade/4135841363e72ece8086146bd7bb5d91) - what is DevOps and associated terminology.

Remember: DevOps as a term and as a practice is still in flux, and is more about culture change than it is specific tooling. As such, specific skills and tool-sets are not universal, and recommendations for them should be taken only as suggestions.

**Previous Threads**

https://www.reddit.com/r/devops/comments/dq6nrc/monthly_getting_into_devops_thread_201911/

https://www.reddit.com/r/devops/comments/dbusbr/monthly_getting_into_devops_thread_201910/

https://www.reddit.com/r/devops/comments/cydrpv/monthly_getting_into_devops_thread_201909/

https://www.reddit.com/r/devops/comments/ckqdpv/monthly_getting_into_devops_thread_201908/

https://www.reddit.com/r/devops/comments/c7ti5p/monthly_getting_into_devops_thread_201907/

https://www.reddit.com/r/devops/comments/bvqyrw/monthly_getting_into_devops_thread_201906/

https://www.reddit.com/r/devops/comments/blu4oh/monthly_getting_into_devops_thread_201905/

https://www.reddit.com/r/devops/comments/b7yj4m/monthly_getting_into_devops_thread_201904/

https://www.reddit.com/r/devops/comments/axcebk/monthly_getting_into_devops_thread/

**Please keep this on topic (as a reference for those new to devops).**

https://redd.it/e4pt90
@r_devops

What have you automated at your home using devops philosophy?

I automated my resume creation using devops. I have setup gogs in a container. Every time I push update to my repo, an instance of drone in another docker container creates a pdf using miktex and pushes to my file server.

Whatever I learn, I try to mimic that in a smaller environment at my home. So it might look crude, but I had fun doing that Have you guys done anything like that? I am curious to get more ideas.

https://redd.it/e4q2lh
@r_devops

Where to learn the CD in CI/CD

Hello I've been working in the CS industry for just over a year now and I've been working a bit with docker and docker-compose, I'm still relatively new the technologies but I think I've got the hang of things for basic stuff.

I can create automated pipelines to schedule jobs that build / test my code, however I have zero experience in deploying these applications to our production servers.

In order to learn I'm currently I'm trying to develop a personal project which runs on my Raspberry PI on my LAN. Ideally I would like to have a fully automated CI/CD pipeline that once I merge my changes to master it will run build/test stages and finally deploy the code to my Raspberry PI.

Right now, the CI part I'm fine with, but when I read up on how to deploy my docker app I see a lot of posts about Kubernetes and Docker Swarm. I'm not familiar with either but when reading about them, these two technologies seem super overkill for what I want to achieve, I currently only have a single docker container that I want to deploy to a single server.

Is there somewhere I can read to learn about how to go about doing this?

Thanks for reading

https://redd.it/e4lnnd
@r_devops

how does testing change when moving to canary deployments

How does application testing during the deployment phase change when going to canary deployments?

​

I'm referring mostly around things like integration testing, performance testing, config testing, smoke tests etc

https://redd.it/e4peim
@r_devops

So, do you think you're ready to SRE?
https://www.reddit.com/r/sre/comments/e4jf56/so_do_you_think_youre_ready_to_sre/

https://redd.it/e4jv6n
@r_devops

SSH: RSA keys, and ssh-agent for SSH keys and their passwords management

During keyring configuration for the Nextcloud client (see the Linux: the Nextcloud client, qtkeychain and the "The name org.freedesktop.secrets was not provided by any .service files" error post) - I decided to clean up the mess in my SSH keys, as I have a lot of them and sometimes authentication became just pain.

[https://medium.com/@setevoy4/ssh-rsa-keys-and-ssh-agent-for-ssh-keys-and-their-passwords-management-61c68001f54b](https://medium.com/@setevoy4/ssh-rsa-keys-and-ssh-agent-for-ssh-keys-and-their-passwords-management-61c68001f54b)

https://redd.it/e4hzyz
@r_devops

What do you guys think about this curriculum for somebody who wants to get into cloud engineering?

Created it 100% from Linux Academy.
Disclaimer: This is combined with side projects, with the goal of landing a cloud engineering job to get professional experience.

Linux Academy Curriculum:

Junior Linux Administrator - Entry Level

Junior DevOps Engineer - Entry Level

Junior AWS Cloud Engineer - Entry Level

AWS Cloud Engineer - Mid Level

During this progression, the certifications to get are the RHCSA and CCNA for fundamental Linux operating system knowledge, and fundamental networking knowledge.

Also, programming (Python) on the side.

https://redd.it/e4u6ao
@r_devops

I was just hired as a vRealize/vOrchestrator automation engineer. How “in demand” are jobs like these?

I was laid off a month ago from a small company where I was learning automation with Ansible and semi-digging into DevOps tools while also building off of my systems engineering experience.

I scrambled to find a job and I landed this one where they are looking to have me automate their infrastructure on a private virtualized cloud built on the back of vRealize and vOrchestrator. I have only been researching these applications recently and while I am anxious to dig into something new, I am hard pressed to find any DevOps coorelation online. DevOps seems all about public cloud, AWS, Azure, etc. but I want to know if I can build and further a DevOps career with this experience or if I am going to be spinning my wheels with this particular work.

Anyone have any familiarity and can maybe help me see how this can benefit my DevOps career in the long run?

https://redd.it/e49irz
@r_devops

Poll: CI/CD tools in reality

I know that there are quite a few tools which state they are CI/CD, or at least enable you to do CI/CD with them. But I'm curious to know what the community is leveraging and what the reality of that solutions looks like (setup, maintenance, administration, scalability, etc.).

Let me know!

https://redd.it/e50vue
@r_devops

What's your favorite feature flagging tool?



https://redd.it/e50rpa
@r_devops

Cleaning up and organizing a huuuuge email inbox. Anybody done this? Success stories?

Hello,
My email inbox is out of proportions and I am looking for suggestions. One of my ideas is to export all email headers to a database to run some queries to know top X senders sorted by number of received emails and the stuff like that. After I know a big picture I believe it's possible to make automatic rules to transfer emails to a different folders based on conditions, such as sender, year and the like.


Do tools to export email headers to a database exist? Or can you suggest some desktop/self-hosted web client that stores retrieved emails in an DB with accessible format to query tables directly?


Thanks.

https://redd.it/e4z222
@r_devops

suspicious-pods: easy debugging for big k8s clusters

Hi /r/devops! I recently wrote a tool that is making my life much easier when it comes to debugging Kubernetes clusters, and I thought I'd share it here in can make someone's life easier too.

Suspicious pods is a very simple tool, which does a very simple task: print a list of pods in your Kubernetes cluster that might not be working correctly, along with a reason on why that pod is considered suspicious. I find it is useful in big clusters, where you need to hunt down problems with several iterations of \`kubectl get po\` and \`kubectl describe po\`.

This tool reduces the huntdown process to a single step. Enjoy!

[https://github.com/edrevo/suspicious-pods](https://github.com/edrevo/suspicious-pods)

https://redd.it/e4uj67
@r_devops

UPDATE: I want to teach someone DevOps principles and tools

Update to [my previous thread](https://www.reddit.com/r/devops/comments/e45hft/i_want_to_teach_someone_devops_principles_and/)

​

After the barrage of requests, I have accepted to work with 2 respondents personally. However, as many have asked, I have created a Discord server for this initiative so I can personally help as many people as possible.

Please join the server here: [https://discord.gg/A5Ts88](https://discord.gg/A5Ts88)

The link will be open for 24 hours and limited to 50 sign ups. This is because I would like to be involved with this personally and I don't think I can handle any more than 50 people (if that).

The proposed format is:

* general questions and answers will be open nearly full time
* I intend to run a small workshop every week or so (depends on availability). The topic will be elected democratically by the community. If I feel I am unable to competently speak about the topic in question, I will try to find someone who is.
* I also intend to have 2 hours of office hours every week. At this time, I will be available either via text chat or voice chat (TBD) where you can AMA.

​

To reiterate:

* This is not a training course or a bootcamp of any kind. This is just one person, me, trying to help as much a possible
* If you would like to follow a structured course on DevOps, I suggest [**u/brooksa321**](https://www.reddit.com/user/brooksa321/)'s course [here](https://www.reddit.com/r/devops/comments/e2ags6/ran_a_free_12_week_devops_bootcamp_on_twitch_here/)

​

Hope this helps!

https://redd.it/e52o7p
@r_devops

devopsdays nyc 2020 tickets are now on sale (earliest bird pricing!)

Check out our March 3-4, 2020 event in NYC!

[https://www.eventbrite.com/e/devopsdays-nyc-2020-tickets-83067223301?ref=estw](https://www.eventbrite.com/e/devopsdays-nyc-2020-tickets-83067223301?ref=estw)

We have tickets priced at our lowest, $150

https://redd.it/e57g7q
@r_devops

Unique Christmas ideas for my team?

I manage a team of DevOpsy folks who've done really well this year and would like to get them all a nice holiday gift. Thinking something personalized (perhaps laser engraved?) and tech-related. Any ideas? Looking to spend about $50-100 each.

One thought was a nice USB power pack with our team/company logo, their name, and their start date engraved on it. Maybe that's a bit cliche, but looking for other ideas that fall into that type of realm.

https://redd.it/e58ign
@r_devops

Netdata release v1.19

Hey all,

Introducing a major rewrite of our web log collector, [cmocka](https://www.facebook.com/hashtag/cmocka?source=feed_text&epa=HASHTAG&__xts__%5B0%5D=68.ARDKJpuwODv-hPc236C7fM2r9vCYx9vTJeH93a18odECvej08YhKL8yikqtkH5YC0qIPbakDgFmmf15tnogjIj3cf_Wya85PQYEzfw9Y2OUmmX9y_0GfH_ikrxDZS109LzcjMTWo8zoUXSy893FBfR0_AxyBw6IFCcIkBObQiTOtCIjrxws3vt14_Jg5s_H61VJwB_KoiG9hPRXpuA6vV5Vm9rUSZUwM0KpucD6_6XrlRI2xwd7Sz5M_3Arnkqr4DckHC5NXNGGTVMUYJgz2H3mq1KcdwguQvlsigL2Pz4k6QW1ZCCYCvG21xk1UzcDAEEr15Yqxx-AEGa1AlNoxRqzZc8MM&__tn__=%2ANK-R) unit testing, improvements on our [Unbound](https://www.facebook.com/hashtag/unbound?source=feed_text&epa=HASHTAG&__xts__%5B0%5D=68.ARDKJpuwODv-hPc236C7fM2r9vCYx9vTJeH93a18odECvej08YhKL8yikqtkH5YC0qIPbakDgFmmf15tnogjIj3cf_Wya85PQYEzfw9Y2OUmmX9y_0GfH_ikrxDZS109LzcjMTWo8zoUXSy893FBfR0_AxyBw6IFCcIkBObQiTOtCIjrxws3vt14_Jg5s_H61VJwB_KoiG9hPRXpuA6vV5Vm9rUSZUwM0KpucD6_6XrlRI2xwd7Sz5M_3Arnkqr4DckHC5NXNGGTVMUYJgz2H3mq1KcdwguQvlsigL2Pz4k6QW1ZCCYCvG21xk1UzcDAEEr15Yqxx-AEGa1AlNoxRqzZc8MM&__tn__=%2ANK-R) collector and even more! Check out our blog post for full details or read our release notes below.

Release v1.19.0 contains 2 new collectors, 19 bug fixes, 17 improvements, and 19 documentation updates. Full release notes can be found [here](https://github.com/netdata/netdata/releases/tag/v1.19.0).

**At a glance**

We completed a major rewrite of our web log collector to dramatically improve its flexibility and performance. The [new collector](https://github.com/netdata/go.d.plugin/pull/141), written entirely in Go, can parse and chart logs from Nginx and Apache servers, and combines numerous improvements. Netdata now supports the LTSV log format, creates charts for TLS and cipher usage, and is amazingly fast. In a test using SSD storage, the collector parsed the logs for 200,000 requests in about 200ms, using 30% of a single core.

This Go-based collector also has powerful custom log parsing capabilities, which means we're one step closer to a generic application log parser for Netdata. We're continuing to work on this parser to support more application log formatting in the future.

We have a new tutorial on [enabling the Go web log collector](https://docs.netdata.cloud/docs/tutorials/collect-apache-nginx-web-logs/) and using it with Nginx and/or Apache access logs with minimal configuration. Thanks to [Wing924](https://github.com/Wing924) for starting the Go rewrite!

We introduced more **cmocka unit testing** to Netdata. In this release, we're testing how Netdata's internal web server processes HTTP requests—the first step to improve the quality of code throughout, reduce bugs, and make refactoring easier. We wanted to validate the web server's behavior but needed to build a layer of parametric testing on top of the CMocka test runner. Read all about our process of testing and selecting cmocka on our blog post: [Building an agile team's 'safety harness' with cmocka and FOSS](https://blog.netdata.cloud/agile-team-cmocka-foss/).

Netdata's **Unbound collector** was also [completely rewritten in Go](https://github.com/netdata/go.d.plugin/pull/287) to improve how it collects and displays metrics. This new version can get dozens of metrics, including details on queries, cache, uptime, and even show per-thread metrics. See our [tutorial](https://docs.netdata.cloud/docs/tutorials/collect-unbound-metrics/) on enabling the new collector via Netdata's amazing auto-detection feature.

We [fixed an error](https://github.com/netdata/netdata/pull/7220) where **invalid spikes** appeared on certain charts by improving the incremental counter reset/wraparound detection algorithm.

Netdata can now send [**health alarm notifications to IRC channels**](https://docs.netdata.cloud/health/notifications/irc/) thanks to [Strykar](https://github.com/Strykar)!

And, Netdata can now monitor [**AM2320 sensors**](https://docs.netdata.cloud/collectors/python.d.plugin/am2320/), thanks to hard work from [Tom Buck](https://github.com/tommybuck).

**Improvements**

* **New Collectors**
* AM2320 sensor collector plugin