Can I do a research based on autoscaling

Can I do a research which is already done on autoscaling of VM but not in autoscaling a pod/container?

Will it be an issue if the concept is same but the scaling algorithm logic will be different.

https://redd.it/k40399
@r_devops

How does Hashicorp Vault's built-in default policy get attached to all tokens?

The docs say: "The default policy is a built-in Vault policy that cannot be removed. By default, it is attached to all tokens" but I don't see how it accomplishes this.

I'm asking because I've joined a company where they added some things to the default.hcl policy out of convenience that should really not be associated with every token per the principle of least privilege. I'd like to split out the path permissions to two separate files:

default.hcl --> associate to human ldap tokens

service\_default.hcl --> associate to machine service tokens

How do I make it so that service\_default.hcl gets associated to every service token but not to every ldap token? Is this currently possible? Any other suggestions on how to tackle this problem?

Thanks in advance!

https://redd.it/k4fu0h
@r_devops

Which type of monitoring do you most frequently use?

I'm assuming that most frequently used tools can also be considered the most valuable...... is that a reasonable assumption in your opinion?

I'm purposely not including infra & app monitoring or log management or API monitoring tools because I assume those are regularly used by most of us.

Please share in comments if you find some other types of monitoring tools more valuable. Thank you!

[View Poll](https://www.reddit.com/poll/k4jpsz)

https://redd.it/k4jpsz
@r_devops

Fetching state change graph dates/ history

Hello r/devops community, a newbie here.
I'm working on a project which requires the use of some of the dates of state graph in history.

I have tried prior states, history, etc and looked into multiple documents for this but couldn't find a way to get the state change date history using the API in azure databricks notebook.

I have a possible alternative, which is to get the html and parse it to get the state graph, which is quite slow.

Please help me out. Thank you

https://redd.it/k4kw3q
@r_devops

Networking Tools Every Developer Needs to Know

Hi /r/devops

Networking is often an overlooked and neglected skill by both DevOps engineers and developers, so I wrote an article which shows some of the basic commands and tools which I think every one of us should have in their troubleshooting/debugging/networking arsenal.

Here's link to the article: https://towardsdatascience.com/networking-tools-every-developer-needs-to-know-e17c9159b180

If there any other tools that I missed, then please let me know! :)

https://redd.it/k4o1ny
@r_devops

How can I set a Global Variable in Gitlab CI/CD that can be shared among 20 projects?

I know I can set global variables per project, but I want to set a variable that can be shared among 20 without setting it 20 times. Can I do it in the UI? Am i suppose to use a script? Thanks. :)

https://redd.it/k4oq8d
@r_devops

Cloudbees hybrid cloud deployment?

So, the company I'm with is currently in the process of being spun off and the plan is to use this as an opertunity to escape the pos that is Atlassian Bamboo.

One of the very desirable outcomes is too ofload as much stuff as possible from our datacentres and get stuff in the cloud (AWS). Now, realistically, we still have to do things on prem, but nothing that 2 build nodes couldn't handle.

First port of call is Cloudbees. Can it do a hybrid cloud setup where the master is in AWS, and for the most part, it uses elastic build agents, but has a few permenent build agents inside our datacenters?

I'd love to go whole hog into something like Azure DevOps but we still have a soul crushing amount of legacy to support.

https://redd.it/k4oedi
@r_devops

How to Develop Microservices in Kubernetes

I recently posted an article about how my company has evolved our approach to developing a growing set of interconnected microservices without crushing developer laptops. What we came up works well for us, but we were a little surprised that there wasn't a common well-established solution to this problem.

[https://www.cncf.io/blog/2020/11/30/how-to-develop-microservices-in-kubernetes/](https://www.cncf.io/blog/2020/11/30/how-to-develop-microservices-in-kubernetes/)

I would love to hear how others have tackled this issue!

https://redd.it/k4rjvs
@r_devops

Tips for more junior DevOps?

I've been in DevOps for just around a year now... and I've been out of school for 2 years so I'm pretty new to DevOps and the working field overall. I feel like I have a good grasp of CI/CD and most of the common tools for automating CI/CD... but when I get into infrastructure as a whole... going from the beginning -> end of hosting/maintaining an entire application stack with all of the different networking, setting appropriate permissions for security purposes, handling database migrations, etc I just get very overwhelmed.

​

During my first DevOps position, I was working for a bigger enterprise company with most of their automation already in place, but it was so complex it was a headache trying to learn it. Now, in my second role, I'm working for a much newer company that only began about 2 years ago. Their automation is a wreck, and my to-do list just gets larger and larger, and lots of it I have to spend weeks just learning the various tools to understand the architecture they need.

​

Every time I try to learn some foundational stuff, like basic routing/security groups/subnets/vpcs, I get hit with priority tasks that require me to learn some other tools and I just lose all motivation for trying to learn additional concepts outside of what is needed for that task. I guess I'm just wondering what the best way to manage my time is to avoid getting overwhelmed/stressed out and when I can expect things to get easier lol

https://redd.it/k4mnnl
@r_devops

Monthly 'Getting into DevOps' thread - 2020/12

**What is DevOps?**

* [AWS has a great article](https://aws.amazon.com/devops/what-is-devops/) that outlines DevOps as a work environment where development and operations teams are no longer "siloed", but instead work together across the entire application lifecycle -- from development and test to deployment to operations -- and automate processes that historically have been manual and slow.

**Books to Read**

* [The Phoenix Project](https://www.amazon.com/Phoenix-Project-DevOps-Helping-Business/dp/1942788290) - one of the original books to delve into DevOps culture, explained through the story of a fictional company on the brink of failure.
* [The DevOps Handbook](https://www.amazon.com/dp/1942788002) - a practical "sequel" to The Phoenix Project.
* [Google's Site Reliability Engineering](https://landing.google.com/sre/books/) - Google engineers explain how they build, deploy, monitor, and maintain their systems.
* [The Site Reliability Workbook](https://landing.google.com/sre/workbook/toc/) - The practical companion to the Google's Site Reliability Engineering Book
* [The Unicorn Project](https://www.amazon.com/Unicorn-Project-Developers-Disruption-Thriving-ebook/dp/B07QT9QR41) - the "sequel" to The Phoenix Project.
* [DevOps for Dummies](https://www.amazon.com/DevOps-Dummies-Computer-Tech-ebook/dp/B07VXMLK3J/) - don't let the name fool you.

**What Should I Learn?**

* [Emily Wood's essay](https://crate.io/a/infrastructure-as-code-part-one/) - why infrastructure as code is so important into today's world.
* [2019 DevOps Roadmap](https://github.com/kamranahmedse/developer-roadmap#devops-roadmap) - one developer's ideas for which skills are needed in the DevOps world. This roadmap is controversial, as it may be too use-case specific, but serves as a good starting point for what tools are currently in use by companies.
* [This comment by /u/mdaffin](https://www.reddit.com/r/devops/comments/abcyl2/sorry_having_a_midlife_tech_crisis/eczhsu1/) - just remember, DevOps is a mindset to solving problems. It's less about the specific tools you know or the certificates you have, as it is the way you approach problem solving.
* [This comment by /u/jpswade](https://gist.github.com/jpswade/4135841363e72ece8086146bd7bb5d91) - what is DevOps and associated terminology.
* [Roadmap.sh](https://roadmap.sh/devops) - Step by step guide for DevOps or any other Operations Role

Remember: DevOps as a term and as a practice is still in flux, and is more about culture change than it is specific tooling. As such, specific skills and tool-sets are not universal, and recommendations for them should be taken only as suggestions.

**Previous Threads**

https://www.reddit.com/r/devops/comments/jmdce9/monthly_getting_into_devops_thread_202011/

https://www.reddit.com/r/devops/comments/j3i2p5/monthly_getting_into_devops_thread_202010/

https://www.reddit.com/r/devops/comments/ikf91l/monthly_getting_into_devops_thread_202009/

https://www.reddit.com/r/devops/comments/i1n8rz/monthly_getting_into_devops_thread_202008/

https://www.reddit.com/r/devops/comments/hjehb7/monthly_getting_into_devops_thread_202007/

https://www.reddit.com/r/devops/comments/gulrm9/monthly_getting_into_devops_thread_202006/

https://www.reddit.com/r/devops/comments/gbkqz9/monthly_getting_into_devops_thread_202005/

https://www.reddit.com/r/devops/comments/ft2fqb/monthly_getting_into_devops_thread_202004/

https://www.reddit.com/r/devops/comments/fc6ezw/monthly_getting_into_devops_thread_202003/

https://www.reddit.com/r/devops/comments/exfyhk/monthly_getting_into_devops_thread_2020012/

https://www.reddit.com/r/devops/comments/ei8x06/monthly_getting_into_devops_thread_202001/

https://www.reddit.com/r/devops/comments/e4pt90/monthly_getting_into_devops_thread_201912/

https://www.reddit.com/r/devops/comments/axcebk/monthly_getting_into_devops_thread/

**Please keep this on topic (as a reference for those new to devops).**

https://redd.it/k4v7s0
@r_devops

Good ebook/tutorial for Terraform?

But not the ones you went through and were ok. Im looking for som real reccomendations. Something like "oh man you shuld definetly check this out, this stands out from the others"

https://redd.it/k4ukkk
@r_devops

Would Devops jobs get automated?

Do you guys think that there will come a time in the future that devops professionals would have to automate themselves out of the job?

https://redd.it/k4p3ib
@r_devops

Are there any better CI services than Jenkins for on-premises?

Hi everyone,

​

I want to migrate from Jenkins' CI pipeline to another service. I'm tired of using Jenkins for plugin dependencies, poor documentation, and deprecated plugins.

Our team of 10 people is using Github Enterprise and we want to run our CI pipeline on our machine.

​

Some requirements are as follows:

\-Commercial solutions are ok.

\-If it is open source, the quality of the document should be much better than that of Jenkins.

\- It should be able to run builds on our machine using Linux and macOS.

\- Polling (PR, Branch) must be available for the GHE Repository.

\- Pipeline as Code is required, but Configuration as Code is not strictly required.

\- Code has many dependencies (about 20GB), so local cache management should be possible.

​

Some of the candidates I've found are Github Action (not yet available on GHE), Cirrus CI, Azure Pipeline but I haven't looked into each candidate deeply. Are there any other alternatives?

https://redd.it/k4yihw
@r_devops

I'm a new employee at a new team that adds features to exisiting, changing code base, should we have build/deployment permissions?

So we're a newly hired 6 member team adding new features to a program that is also being handled by multiple teams. Problem is our team doesnt have permission to build for QA and waits for other teams to create a build so that ours changes get included. This is becoming a bottleneck since QA can't test features from our team immediately since deployment to QA is done manually. Should I talk to the higher ups to automate deployment upon PR for the teams? Will this create confusion which is the correct version for QA to test since at the end of the day it's all the same huge application? This is my first time working with a huge codebase that is being handled by multiple teams so I'm thinking of ways to make our integration faster. Will be really grateful for some advice. Thanks!

https://redd.it/k4ordu
@r_devops

What are best videos or blogs to learn GCP from scratch??

Gcp beginner, please help me

https://redd.it/k4lt7x
@r_devops

whatsupstream - a golang-based tool for oss devs/enthusiasts which runs in background and notifies you whenever an issue (with certain labels/creators of your choice) is raised in the repos you want to contribute to.

Here's the tool - [whatsupstream](https://github.com/yashvardhan-kukreja/whatsupstream)

So, say, you want to be notified whenever an issue with the label "good first issue" or/and "sig/node" is created by some user "alex" (or any other user) in the kubernetes repo, whatsupstream can notify u on ur desktop and u can pick it up before anyone does.

With it you dont have to keep on checking the repos and refreshing for the issues u wanna pick up.

---

So, I faced this problem while starting to contribute to kubernetes. I wanted to find "good first issues" but whenever I found one, someone already had picked it up and I couldn't just sit everyday clicking and refreshing the repo to find and pick up "good first issue". And I felt that this must be a pretty common issue.

So, as a tribute to the oss community, I coded this tool. [whatsupstream](https://github.com/yashvardhan-kukreja/whatsupstream). I even used it for a while and It worked like a charm and notified me whenever a good first issue came to kubernetes and I was able to pick them up and work on them.

Do check it out and give some stars too😂 if you like it. 😄😄

PS: Constructive criticism is always welcome :)

https://redd.it/k51p92
@r_devops

you may want to take some classes with Udemy Cyber week

Hey, guys, [Udemy's cyber week](https://www.tryblackfriday.com/2020/11/udemy-cyber-monday.html) is here, you may want to take some classes at lowest price of the year..

https://redd.it/k52xwy
@r_devops

I built a cron job monitoring tool after a scary incident

I hope this kind of post is allowed here.

I have a simple application which posts to social media sites like facebook on a schedule basis.

I slowly started realizing that all the posts are being posted twice. I initially blamed my code and spent hours figuring out the root cause but of no use.

After further investigation, I found out that the cron job which posts them to social media sites is running on two servers. This extra server is a dummy server which i started to migrate the application. But i left it behind in the middle to focus on it when i have more time. But i did not realize that the cron job is running on this server.

I immediately stopped the cron job from the dummy server. Then i thought,

* what if this cron job is processing payments?
* what if this cron job is generating shipment labels for e-commerce store?
* what if this cron job is doing a very critical task which should not be duplicated?

I thought others might be in the same boat and realized we should start monitoring our cron jobs.

​

So i built [CronBuzz](https://cronbuzz.com/?utm_source=reddit&utm_medium=devops&utm_campaign=post-12-01).

CronBuzz monitors your cron jobs and alert you when your cron jobs stopped running, duplicated, or running longer than they are intended.

Are you using any kind of cron job monitoring tool? Please let me know what you think of this tool.

https://redd.it/k4z1kn
@r_devops

Simplifying container management in Docker Swarm, Kubernetes, ACI and Edge environments

If you haven't yet discovered Portainer to simplify your container management, grab the free community edition (it's an open-source project) from [https://www.portainer.io/](https://www.portainer.io/) and let us know what you think.

If you're curious about container management within a business environment, catch the launch of Portainer Business on YouTube Premier. [https://www.youtube.com/watch?v=YiNyx\_qhUOQ](https://www.youtube.com/watch?v=YiNyx_qhUOQ)

https://redd.it/k52dr8
@r_devops

Dave's article: "Burn your ticketing system" - thoughts?

One of the best articles I've read in a while: "[Why you should burn your ticketing system](https://techbeacon.com/enterprise-it/why-you-should-burn-your-ticketing-system)" by Dave Mangot (not associated to him or advertising here, really just like the article), he sent it over this very morning. In the article he argues that there are three essential reasons why you should not have a ticketing system for ops (the kind where you would request another instance of a Postgres DB etc):
\- ticketing systems require waiting, waiting is waste
\- tickets in the system should be viewed as software exceptions being thrown by the value stream
\- Toil! You'll end up hiring a huge amount of frustrated, overqualified people doing boring, repetitive tasks.


Thoughts on this? I'm seeing similar situations a lot at different companies. I'm always wondering: how do you determine what the right level of automation is? From what level of repetition onwards should you spend how much time? Would love to hear your thoughts!

https://redd.it/k552mz
@r_devops

How to implement performance testing in CI pipeline? or just how to implement performance testing in general?

Hi! Lately we've seen huge downtime because of performance issues. One of the developers merged really bad code into production that took entire DB down for hours.

Today I've been wondering what if there is an actual tool that does performance testing at the CI level, that would be awesome. Like similar to how we do unit testing, there could be certain threshold that needs to be passed for that test.

Or if it's too fictional, where should I start to prevent such issues.

Thank you.

https://redd.it/k4zra1
@r_devops