How to Develop Microservices in Kubernetes

I recently posted an article about how my company has evolved our approach to developing a growing set of interconnected microservices without crushing developer laptops. What we came up works well for us, but we were a little surprised that there wasn't a common well-established solution to this problem.

[https://www.cncf.io/blog/2020/11/30/how-to-develop-microservices-in-kubernetes/](https://www.cncf.io/blog/2020/11/30/how-to-develop-microservices-in-kubernetes/)

I would love to hear how others have tackled this issue!

https://redd.it/k4rjvs
@r_devops

Tips for more junior DevOps?

I've been in DevOps for just around a year now... and I've been out of school for 2 years so I'm pretty new to DevOps and the working field overall. I feel like I have a good grasp of CI/CD and most of the common tools for automating CI/CD... but when I get into infrastructure as a whole... going from the beginning -> end of hosting/maintaining an entire application stack with all of the different networking, setting appropriate permissions for security purposes, handling database migrations, etc I just get very overwhelmed.

​

During my first DevOps position, I was working for a bigger enterprise company with most of their automation already in place, but it was so complex it was a headache trying to learn it. Now, in my second role, I'm working for a much newer company that only began about 2 years ago. Their automation is a wreck, and my to-do list just gets larger and larger, and lots of it I have to spend weeks just learning the various tools to understand the architecture they need.

​

Every time I try to learn some foundational stuff, like basic routing/security groups/subnets/vpcs, I get hit with priority tasks that require me to learn some other tools and I just lose all motivation for trying to learn additional concepts outside of what is needed for that task. I guess I'm just wondering what the best way to manage my time is to avoid getting overwhelmed/stressed out and when I can expect things to get easier lol

https://redd.it/k4mnnl
@r_devops

Monthly 'Getting into DevOps' thread - 2020/12

**What is DevOps?**

* [AWS has a great article](https://aws.amazon.com/devops/what-is-devops/) that outlines DevOps as a work environment where development and operations teams are no longer "siloed", but instead work together across the entire application lifecycle -- from development and test to deployment to operations -- and automate processes that historically have been manual and slow.

**Books to Read**

* [The Phoenix Project](https://www.amazon.com/Phoenix-Project-DevOps-Helping-Business/dp/1942788290) - one of the original books to delve into DevOps culture, explained through the story of a fictional company on the brink of failure.
* [The DevOps Handbook](https://www.amazon.com/dp/1942788002) - a practical "sequel" to The Phoenix Project.
* [Google's Site Reliability Engineering](https://landing.google.com/sre/books/) - Google engineers explain how they build, deploy, monitor, and maintain their systems.
* [The Site Reliability Workbook](https://landing.google.com/sre/workbook/toc/) - The practical companion to the Google's Site Reliability Engineering Book
* [The Unicorn Project](https://www.amazon.com/Unicorn-Project-Developers-Disruption-Thriving-ebook/dp/B07QT9QR41) - the "sequel" to The Phoenix Project.
* [DevOps for Dummies](https://www.amazon.com/DevOps-Dummies-Computer-Tech-ebook/dp/B07VXMLK3J/) - don't let the name fool you.

**What Should I Learn?**

* [Emily Wood's essay](https://crate.io/a/infrastructure-as-code-part-one/) - why infrastructure as code is so important into today's world.
* [2019 DevOps Roadmap](https://github.com/kamranahmedse/developer-roadmap#devops-roadmap) - one developer's ideas for which skills are needed in the DevOps world. This roadmap is controversial, as it may be too use-case specific, but serves as a good starting point for what tools are currently in use by companies.
* [This comment by /u/mdaffin](https://www.reddit.com/r/devops/comments/abcyl2/sorry_having_a_midlife_tech_crisis/eczhsu1/) - just remember, DevOps is a mindset to solving problems. It's less about the specific tools you know or the certificates you have, as it is the way you approach problem solving.
* [This comment by /u/jpswade](https://gist.github.com/jpswade/4135841363e72ece8086146bd7bb5d91) - what is DevOps and associated terminology.
* [Roadmap.sh](https://roadmap.sh/devops) - Step by step guide for DevOps or any other Operations Role

Remember: DevOps as a term and as a practice is still in flux, and is more about culture change than it is specific tooling. As such, specific skills and tool-sets are not universal, and recommendations for them should be taken only as suggestions.

**Previous Threads**

https://www.reddit.com/r/devops/comments/jmdce9/monthly_getting_into_devops_thread_202011/

https://www.reddit.com/r/devops/comments/j3i2p5/monthly_getting_into_devops_thread_202010/

https://www.reddit.com/r/devops/comments/ikf91l/monthly_getting_into_devops_thread_202009/

https://www.reddit.com/r/devops/comments/i1n8rz/monthly_getting_into_devops_thread_202008/

https://www.reddit.com/r/devops/comments/hjehb7/monthly_getting_into_devops_thread_202007/

https://www.reddit.com/r/devops/comments/gulrm9/monthly_getting_into_devops_thread_202006/

https://www.reddit.com/r/devops/comments/gbkqz9/monthly_getting_into_devops_thread_202005/

https://www.reddit.com/r/devops/comments/ft2fqb/monthly_getting_into_devops_thread_202004/

https://www.reddit.com/r/devops/comments/fc6ezw/monthly_getting_into_devops_thread_202003/

https://www.reddit.com/r/devops/comments/exfyhk/monthly_getting_into_devops_thread_2020012/

https://www.reddit.com/r/devops/comments/ei8x06/monthly_getting_into_devops_thread_202001/

https://www.reddit.com/r/devops/comments/e4pt90/monthly_getting_into_devops_thread_201912/

https://www.reddit.com/r/devops/comments/axcebk/monthly_getting_into_devops_thread/

**Please keep this on topic (as a reference for those new to devops).**

https://redd.it/k4v7s0
@r_devops

Good ebook/tutorial for Terraform?

But not the ones you went through and were ok. Im looking for som real reccomendations. Something like "oh man you shuld definetly check this out, this stands out from the others"

https://redd.it/k4ukkk
@r_devops

Would Devops jobs get automated?

Do you guys think that there will come a time in the future that devops professionals would have to automate themselves out of the job?

https://redd.it/k4p3ib
@r_devops

Are there any better CI services than Jenkins for on-premises?

Hi everyone,

​

I want to migrate from Jenkins' CI pipeline to another service. I'm tired of using Jenkins for plugin dependencies, poor documentation, and deprecated plugins.

Our team of 10 people is using Github Enterprise and we want to run our CI pipeline on our machine.

​

Some requirements are as follows:

\-Commercial solutions are ok.

\-If it is open source, the quality of the document should be much better than that of Jenkins.

\- It should be able to run builds on our machine using Linux and macOS.

\- Polling (PR, Branch) must be available for the GHE Repository.

\- Pipeline as Code is required, but Configuration as Code is not strictly required.

\- Code has many dependencies (about 20GB), so local cache management should be possible.

​

Some of the candidates I've found are Github Action (not yet available on GHE), Cirrus CI, Azure Pipeline but I haven't looked into each candidate deeply. Are there any other alternatives?

https://redd.it/k4yihw
@r_devops

I'm a new employee at a new team that adds features to exisiting, changing code base, should we have build/deployment permissions?

So we're a newly hired 6 member team adding new features to a program that is also being handled by multiple teams. Problem is our team doesnt have permission to build for QA and waits for other teams to create a build so that ours changes get included. This is becoming a bottleneck since QA can't test features from our team immediately since deployment to QA is done manually. Should I talk to the higher ups to automate deployment upon PR for the teams? Will this create confusion which is the correct version for QA to test since at the end of the day it's all the same huge application? This is my first time working with a huge codebase that is being handled by multiple teams so I'm thinking of ways to make our integration faster. Will be really grateful for some advice. Thanks!

https://redd.it/k4ordu
@r_devops

What are best videos or blogs to learn GCP from scratch??

Gcp beginner, please help me

https://redd.it/k4lt7x
@r_devops

whatsupstream - a golang-based tool for oss devs/enthusiasts which runs in background and notifies you whenever an issue (with certain labels/creators of your choice) is raised in the repos you want to contribute to.

Here's the tool - [whatsupstream](https://github.com/yashvardhan-kukreja/whatsupstream)

So, say, you want to be notified whenever an issue with the label "good first issue" or/and "sig/node" is created by some user "alex" (or any other user) in the kubernetes repo, whatsupstream can notify u on ur desktop and u can pick it up before anyone does.

With it you dont have to keep on checking the repos and refreshing for the issues u wanna pick up.

---

So, I faced this problem while starting to contribute to kubernetes. I wanted to find "good first issues" but whenever I found one, someone already had picked it up and I couldn't just sit everyday clicking and refreshing the repo to find and pick up "good first issue". And I felt that this must be a pretty common issue.

So, as a tribute to the oss community, I coded this tool. [whatsupstream](https://github.com/yashvardhan-kukreja/whatsupstream). I even used it for a while and It worked like a charm and notified me whenever a good first issue came to kubernetes and I was able to pick them up and work on them.

Do check it out and give some stars too😂 if you like it. 😄😄

PS: Constructive criticism is always welcome :)

https://redd.it/k51p92
@r_devops

you may want to take some classes with Udemy Cyber week

Hey, guys, [Udemy's cyber week](https://www.tryblackfriday.com/2020/11/udemy-cyber-monday.html) is here, you may want to take some classes at lowest price of the year..

https://redd.it/k52xwy
@r_devops

I built a cron job monitoring tool after a scary incident

I hope this kind of post is allowed here.

I have a simple application which posts to social media sites like facebook on a schedule basis.

I slowly started realizing that all the posts are being posted twice. I initially blamed my code and spent hours figuring out the root cause but of no use.

After further investigation, I found out that the cron job which posts them to social media sites is running on two servers. This extra server is a dummy server which i started to migrate the application. But i left it behind in the middle to focus on it when i have more time. But i did not realize that the cron job is running on this server.

I immediately stopped the cron job from the dummy server. Then i thought,

* what if this cron job is processing payments?
* what if this cron job is generating shipment labels for e-commerce store?
* what if this cron job is doing a very critical task which should not be duplicated?

I thought others might be in the same boat and realized we should start monitoring our cron jobs.

​

So i built [CronBuzz](https://cronbuzz.com/?utm_source=reddit&utm_medium=devops&utm_campaign=post-12-01).

CronBuzz monitors your cron jobs and alert you when your cron jobs stopped running, duplicated, or running longer than they are intended.

Are you using any kind of cron job monitoring tool? Please let me know what you think of this tool.

https://redd.it/k4z1kn
@r_devops

Simplifying container management in Docker Swarm, Kubernetes, ACI and Edge environments

If you haven't yet discovered Portainer to simplify your container management, grab the free community edition (it's an open-source project) from [https://www.portainer.io/](https://www.portainer.io/) and let us know what you think.

If you're curious about container management within a business environment, catch the launch of Portainer Business on YouTube Premier. [https://www.youtube.com/watch?v=YiNyx\_qhUOQ](https://www.youtube.com/watch?v=YiNyx_qhUOQ)

https://redd.it/k52dr8
@r_devops

Dave's article: "Burn your ticketing system" - thoughts?

One of the best articles I've read in a while: "[Why you should burn your ticketing system](https://techbeacon.com/enterprise-it/why-you-should-burn-your-ticketing-system)" by Dave Mangot (not associated to him or advertising here, really just like the article), he sent it over this very morning. In the article he argues that there are three essential reasons why you should not have a ticketing system for ops (the kind where you would request another instance of a Postgres DB etc):
\- ticketing systems require waiting, waiting is waste
\- tickets in the system should be viewed as software exceptions being thrown by the value stream
\- Toil! You'll end up hiring a huge amount of frustrated, overqualified people doing boring, repetitive tasks.


Thoughts on this? I'm seeing similar situations a lot at different companies. I'm always wondering: how do you determine what the right level of automation is? From what level of repetition onwards should you spend how much time? Would love to hear your thoughts!

https://redd.it/k552mz
@r_devops

How to implement performance testing in CI pipeline? or just how to implement performance testing in general?

Hi! Lately we've seen huge downtime because of performance issues. One of the developers merged really bad code into production that took entire DB down for hours.

Today I've been wondering what if there is an actual tool that does performance testing at the CI level, that would be awesome. Like similar to how we do unit testing, there could be certain threshold that needs to be passed for that test.

Or if it's too fictional, where should I start to prevent such issues.

Thank you.

https://redd.it/k4zra1
@r_devops

NEW RELIC - HOW TO ADD AN EXISTING SYNTHETICS ping MONITOR TO A LOCAL New Relic APP?

So I'm relatively new to New Relic.

I have a synthetics monitor i created for a website, a simple ping one.

I then went to create a new relic app locally, which is new to me as well. How do I incorporate the above synthetics monitor I created successfully, into my new relic app?

I'm going through a documentation and videos and it isn't clear to me just yet.

I also want a very basic new relic app created right now, a space for an application to observe things going on with the site, so I'm trying to do the bare minimum setup for right now.

If I understand correctly, a new relic app is created locally in a local instance of new relic, and then when I publish/deploy it, New Relic will host it on our actual account so that the new relic app is no longer only local to me? This deployed app will run with the code from the New Relic infrastructure, and won't need to have it started on my machine locally (`nr1 nerdpack:serve`) in order to run and be there for others to see in the new relic account?

New relic, the new relic app and the file structure for it is all new to me, as well as the monitor.

PS: apologies, I don't know why the title of the post would only do cap locks automatically, for most things, it apperas. odd I guess

https://redd.it/k4ude6
@r_devops

How to get over the initial pain

Java and PowerShell are F'ing hard things to get started in. Im slightly discouraged and that makes me angry.

I need a pat on the back or something. Please help.

https://redd.it/k4l77b
@r_devops

I am kinda new to this. How to push 2 or more github repositories to google cloud build and run

So I have full stack nrwl application which is sperated back end , front end and one microservice. All connected docker-compose but tried it locally. I dont find a example of being run at the same time one to another. Any suggestion appricieted.

https://redd.it/k4kepy
@r_devops

Introducing Project Shipwright (Part 2) - Build Container Images on Kubernetes

About three weeks ago I wrote a [blog post](https://shipwright.io/blog/2020/10/21/introducing-shipwright-part-1/) introducing Project Shipwright, and posted the link [here](https://www.reddit.com/r/devops/comments/jrkwbs/introducing_shipwright_a_framework_for_building/). The first post set the scene, explaining why we started the project.

Yesterday I posted [Part 2](https://shipwright.io/blog/2020/11/30/introducing-shipwright-part-2/) of my series, which introduces the Build APIs and explains how they work together. Please take a look, and let me know what you think!

https://redd.it/k4kbve
@r_devops

Introducing microservices and Docker with a whiteboard and a marker pen :)

Hi team! some months ago I made a very educative and visual video explaining **microservices** and **Docker** from the perspective of being interesting, fun and useful. I just want to share the content here. I hope some of you may found it interesting and useful. Thank you and have a nice day!

[https://youtu.be/D3okLNBL1lE](https://youtu.be/D3okLNBL1lE)

https://redd.it/k4krsy
@r_devops

What is Jenkins?

Let's start with an introduction to one of the most popular [DevOps tools](https://www.janbasktraining.com/blog/devops-tools/) that are popular as Jenkins. [Jenkins wiki](https://wiki.jenkins.io/#all-updates) is an open-source tool that has many plug-ins and it is written in Java. The Jenkins wiki tool was launched to build and test software projects in an easy way.

Developers can easily integrate application changes with this tool to help the user to obtain a fresh build. The software can be tested and delivered continuously with the help of various integration and deployment technologies.

Through automation, software developers can accelerate the process of software development. Jenkins mainly integrates all the stages of the software development lifecycle that are documentation, packaging, testing, deployment, static analysis, and other ones.

[Jenkins](https://www.janbasktraining.com/blog/jenkins-interview-questions/) plugins help the developers in providing continuous integration and various stages can be integrated through Jenkins. To integrate any specific tool like Git, Amazon EC2, Manen 2 project, HTML publisher, etc. you can download the appropriate plugin and integrate the tool. It is a basically advantageous tool and the reason for the advantages of Jenkins is:

* Jenkins is an open-source tool that has wide community support
* Installation of Jenkins is quite easier
* A vast number of plugins are available; even if any plugin doesn’t exist then you can develop it and add it to the community.
* Due to Java's written code, it is portable to major platforms.

https://redd.it/k4je5c
@r_devops

Puppet CIS Benchmarks

Hi all. I'm looking to push CIS benchmarks via Puppet to our infrastructure. I did see the CIS Compliance Service. Can anyone speak on it's success? Or, have you found success through a different route? Cheers!

https://redd.it/k5fmjg
@r_devops