Reddit DevOps
277 subscribers
69 photos
32.2K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
How do you handle co-authoring of code? Check-in/check-out, or Live Share, or similar?

Hey all,

​

Just wondering what you do within your team on the operations side when it comes to co-authoring scripts, modules, and settings files. I've looked into VSCode Live Share paired with Github Desktop, I think it could be powerful but so far haven't had success installing the extension. Are there other options? Do you prefer to check things in and out instead?

https://redd.it/ewsynp
@r_devops
How do you guys build AWS AMI?

We use Packer and Jenkins to bake application AMIs. For testing we use ciscat and rspec. I was wondering what other tools are used on enterprise level for building and testing AMIs?

https://redd.it/ewtlwh
@r_devops
DevOps & DevSecOps certifications

Going to first say that peoples views differ greatly on the validity and value of certification. I understand that and am looking for certification guidance. I have the opportunity to get certification that I know will give me benefits within my organization

I'm looking for DevOps and ideally DevSecOps certification. I see a number from devopsinstitute.com but don't have any opinion or information of colleagues on the organization. I also found devops-certification.org which looks like a certificate factory.

Looking for advice in this area, thanks!

Edit: additional though, perhaps a dedicated security qualification would be more specialised and better recognized, something like CISSP

https://redd.it/ewt7lm
@r_devops
Get kubectl access to your private cluster from anywhere

Get kubectl access to your private cluster from anywhere

This tutorial shows you how to punch out your private [Kubernetes API server](https://kubernetes.io/docs/concepts/overview/components/) to the Internet, so that you can manage your cluster from anywhere, just like you would with a cloud offering. You can also use it to punch out from one VPC to another, if the hosting VPC doesn't allow inbound connections. You can also use the networking tools here to punch out a Raspberry Pi and other TCP traffic to other networks.

Does this sound useful for your DevOps tool-belt?

[https://blog.alexellis.io/get-private-kubectl-access-anywhere/](https://blog.alexellis.io/get-private-kubectl-access-anywhere/)

https://redd.it/ews2c8
@r_devops
How many of us have cost saving in this year's or quarter's target?

I have been working to save costs for other companies that are using AWS and other cloud services. For the sake of simplicity, just referring to AWS for now.

Here's are the things I do and help other companies automate for cost-saving:

* Find and shutdown unused AWS resources
* Use the appropriate storage classes for different storage services
* Monitor, track, analyze, and act on services usage
* Identify previous generation resources - Upgrading to new ones helps in saving costs since they are provided at a lower cost.

What else do everyone is looking forward to doing to save cost?

I am the founder of TotalCloud. You can find us on Product Hunt if you search for TotalCloud or AWS.

https://redd.it/ewkgjs
@r_devops
Looking for Open Source Firewall

Hi, I'm in the process of setting up my "private cloud", which really is just a Dell R620 in a colo.

I run ProxMox with OpenShift on top with everything getting provisioned with ansible. My current problem is that all the the established OS firewalls (pfSense, OPNsense, etc.) have no way to automate their installation. I've found some long as fuck packer setups but they're dependant on storage speed so not ideal.

I also thought about using plain OpenBSD with pf. Anyway what are your thoughts and suggestions?

https://redd.it/ewligg
@r_devops
Secrets as a code with Mozilla SOPS and AWS KMS

[Medium post about secret as a code](https://link.medium.com/RocC5bGVI3)

In the article above I show how you can leverage Mozilla sops and aws and to keep your secrets around in a secure manner. Enjoy.

https://redd.it/ex5jmx
@r_devops
How do you set up transactional analytics in a microservices set up?

Hey there,

I am looking at setting up a customer facing analytics reporting service that would just be simple queries of stuff we have in our databases. - the issue is we use a microservices setup where each service has it's own db and no other services are allowed to access another's db.

How have folks done this in the past? I know I could invest in some etl tooling and use some common database for reporting but we want to know the lightest weight solution so we can validate this with customers.

Any thoughts?

https://redd.it/ex5jlm
@r_devops
Cloud Decision Process

As a DevOps engineer/developer/department, how have you in the past gone about choosing the cloud computing service you use? There are countless numbers of services out there, but how have you in the past chosen to use AWS/GCP/Azure... or other services such as render farms?

https://redd.it/ex881h
@r_devops
packer single builder but two images

I recently learned packer. I like it. Thanks for this forum for the advise.

I have a template file which builds a ec2 instance. At the end I use an ansible provisioner. It builds the image.

However, I need to build a similar image but with different argument for the provisioner. Do I need to create a new template or is there a way to refer to the builder and build a different image?

https://redd.it/ex62ds
@r_devops
Simplifying AWS Private API Gateway VPC Endpoint Association with Terraform

Recently, I've been contributing to AWS Terraform provider. The lack of documentation on the subject pushed me to write this piece - hopefully, it helps other devs to use Private API Gateway's more easily.

https://link.medium.com/FAydmUGlJ3

https://redd.it/exahat
@r_devops
Go pro CSA

Go pro CSA

After securing the three Associate certifications, the next logical path is to go after the two Professional certs, and the Certified Solutions Architect – Professional, in particular.

CSA – Pro is the absolute pinnace of AWS knowledge, and obtaining this certification is the AWS equivalent of defeating a video game’s final boss.

https://redd.it/ex60jc
@r_devops
Cloud Native Computing for Enterprise

Hey Reddit!
Wrote an article about some of the challenges/talking points for adopting cloud native technologies at an enterprise scale:
[https://medium.com/@lachlan\_white/visualising-a-cloud-native-operating-model-for-enterprise-adoption-b70cc5790d48](https://medium.com/@lachlan_white/visualising-a-cloud-native-operating-model-for-enterprise-adoption-b70cc5790d48)

https://redd.it/ex1907
@r_devops
Octopus variable replacements in JS file isn’t playing nice, adding spaces?

We are using octopus to replace variables in our reactjs environment files. It works awesome, swapping vars for each environment. However, today I added a new var for a true/false and it didn’t play as nice. I noticed Octopus writes it as a string, not a bool, which is fine, but something like

process.env.REACT_APP_FEATURE === ‘true’

Returns false even though I have true in the variable in octo. I finally got it to work by trimming it, adding a .trim(). But my var doesn’t have it in the text editor.

Known issue? Am I doing something weird?

https://redd.it/ewwqyr
@r_devops
Kubernetes and legacy OS components

Hi all,

So the product I work on has had shifting leadership over the years, and previous staff integrated a couple of external components that we really would rather not support anymore. We spend a lot of energy on maintenance of these legacy pieces which also require legacy environments, including operating systems (for sake of discussion, let's assume Windows 7).

Our team is small. No one has DevOps experience but we're all prepared to learn. We would like to move to Kubernetes for all the good things that it does. Based on the reading I've done, it looks like we could:

* run a linux VM to host our containers
* move all of our current components into containers

But if I'm reading correctly, we would not be able to run the legacy components in a container since it requires a legacy Windows OS. Is this accurate? Does anyone have suggestions? The goal is to isolate this component as-is but keep it running until we can eventually replace it and dump it.

https://redd.it/ewvozo
@r_devops
Monthly 'Getting into DevOps' thread - 2020/012

**What is DevOps?**

* [AWS has a great article](https://aws.amazon.com/devops/what-is-devops/) that outlines DevOps as a work environment where development and operations teams are no longer "siloed", but instead work together across the entire application lifecycle -- from development and test to deployment to operations -- and automate processes that historically have been manual and slow.

**Books to Read**

* [The Phoenix Project](https://www.amazon.com/Phoenix-Project-DevOps-Helping-Business/dp/1942788290) - one of the original books to delve into DevOps culture, explained through the story of a fictional company on the brink of failure.
* [The DevOps Handbook](https://www.amazon.com/dp/1942788002) - a practical "sequel" to The Phoenix Project.
* [Google's Site Reliability Engineering](https://landing.google.com/sre/books/) - Google engineers explain how they build, deploy, monitor, and maintain their systems.
* [The Site Reliability Workbook](https://landing.google.com/sre/workbook/toc/) - The practical companion to the Google's Site Reliability Engineering Book
* [The Unicorn Project](https://www.amazon.com/Unicorn-Project-Developers-Disruption-Thriving-ebook/dp/B07QT9QR41) - the "sequel" to The Phoenix Project.
* [DevOps for Dummies](https://www.amazon.com/DevOps-Dummies-Computer-Tech-ebook/dp/B07VXMLK3J/) - don't let the name fool you.

**What Should I Learn?**

* [Emily Wood's essay](https://crate.io/a/infrastructure-as-code-part-one/) - why infrastructure as code is so important into today's world.
* [2019 DevOps Roadmap](https://github.com/kamranahmedse/developer-roadmap#devops-roadmap) - one developer's ideas for which skills are needed in the DevOps world. This roadmap is controversial, as it may be too use-case specific, but serves as a good starting point for what tools are currently in use by companies.
* [This comment by /u/mdaffin](https://www.reddit.com/r/devops/comments/abcyl2/sorry_having_a_midlife_tech_crisis/eczhsu1/) - just remember, DevOps is a mindset to solving problems. It's less about the specific tools you know or the certificates you have, as it is the way you approach problem solving.
* [This comment by /u/jpswade](https://gist.github.com/jpswade/4135841363e72ece8086146bd7bb5d91) - what is DevOps and associated terminology.
* [Roadmap.sh](https://roadmap.sh/devops) - Step by step guide for DevOps or any other Operations Role

Remember: DevOps as a term and as a practice is still in flux, and is more about culture change than it is specific tooling. As such, specific skills and tool-sets are not universal, and recommendations for them should be taken only as suggestions.

**Previous Threads**
https://www.reddit.com/r/devops/comments/ei8x06/monthly_getting_into_devops_thread_202001/

https://www.reddit.com/r/devops/comments/e4pt90/monthly_getting_into_devops_thread_201912/

https://www.reddit.com/r/devops/comments/dq6nrc/monthly_getting_into_devops_thread_201911/

https://www.reddit.com/r/devops/comments/dbusbr/monthly_getting_into_devops_thread_201910/

https://www.reddit.com/r/devops/comments/cydrpv/monthly_getting_into_devops_thread_201909/

https://www.reddit.com/r/devops/comments/ckqdpv/monthly_getting_into_devops_thread_201908/

https://www.reddit.com/r/devops/comments/c7ti5p/monthly_getting_into_devops_thread_201907/

https://www.reddit.com/r/devops/comments/bvqyrw/monthly_getting_into_devops_thread_201906/

https://www.reddit.com/r/devops/comments/blu4oh/monthly_getting_into_devops_thread_201905/

https://www.reddit.com/r/devops/comments/b7yj4m/monthly_getting_into_devops_thread_201904/

https://www.reddit.com/r/devops/comments/axcebk/monthly_getting_into_devops_thread/

**Please keep this on topic (as a reference for those new to devops).**

https://redd.it/exfyhk
@r_devops
Consulting on cloud architecture optimization?

As a company looking to optimize our cloud computing systems (AWS services or such) how much would we expect to pay a Cloud Solutions Architects or other professionals hourly? Are there good software out there doing this?

https://redd.it/exgt0d
@r_devops
How to interpret various memory statistics? Cold, hot, rss, cache, swap, etc.

So I set some logging environment, its mostly based on Grafana with Prometheus and CAdvisor for Docker container monitoring.

While these tools are very cool and easy to setup, I am confused about memory consumption they represent.

Right now it shows that my Prometheus instance uses almost 4.39GB of ram, what the...

I made further investigations which and the 4.39GB is the result of call to a total memory usage, which **seems to** be built from something that some people calls a cold memory:

* mapped\_file (26MB)
* rss (2680MB)
* cache (1700MB)
* swap (0MB)

And the hot memory metrics:

* working set (270MB)

I don't really understand how flexible the cold memory is and how the resources taken by cold memory would be cut if any other linux process would suddenly burst in ram usage.

Let's imagine the scenario where other process starts heavy operations and takes significant amount of server's ram, what would happen with these cold / hot resources mentioned above? Some of them should be ready to release right?

https://redd.it/exasgh
@r_devops
College student looking to interview a software engineer!

Hello all,

I am currently enrolled in a software engineering program at my university and I would like to conduct a recorded audio call interview with someone in the industry as part of a school assignment. I would like to ask about three experiences of a bug escape at your workplace. For example, it could be a successful bug escape, a failed bug escape and a typical bug escape. Of course, this is not set in stone and I am open to any other extra workplace stories!

Please PM me if you are interested as your help will be extremely appreciated!

Thank you again

https://redd.it/exrft3
@r_devops
Show devops: dep-scan is a free open-source dependency audit tool built for CI

Thanks reddit for the fantastic support (and sponsorship!) you gave me when I announced my previous project - a free open-source SAST tool called [sast-scan](https://github.com/AppThreat/sast-scan)

Working on sast-scan gave me several useful insights into the world of vulnerabilities, CVE, CWE and so on. So it made natural sense to implement a new [dependency scanner](https://github.com/AppThreat/dep-scan) for modern DevOps and DevSecOps folks.

If you are used to using dependency-check and those commercial scanners you will find dep-scan to be a lot more performant. Give this project a try and let me know your thoughts.

https://redd.it/exp7n3
@r_devops