What We’ve Learned from Processing the First 150,000 Production Incidents: Alert Pressure Patterns (Part 1)

[https://blog.amixr.io/what-weve-learned-once-processed-first-150000-production-incidents/](https://blog.amixr.io/what-weve-learned-once-processed-first-150000-production-incidents/)

https://redd.it/f04dpn
@r_devops

What’s the most annoying thing you have to do every day?



https://redd.it/f0z9k5
@r_devops

What to tackle first

I know this is a pretty generic question but if you were to start in an environment with no devops practices, what would you start with? CI/CD, configuration management, etc?

https://redd.it/f0xto1
@r_devops

Validating Helm Chart Values with JSON Schemas

I found out that Helm 3 added support for validation via JSON schemas and wrote a blog post about it. I think it's useful to put this into the CI pipeline and make sure required values are set and have the right type.

https://www.arthurkoziel.com/validate-helm-chart-values-with-json-schemas/

https://redd.it/f0ocum
@r_devops

Senior DevOps salary in USA

Let's say that from rumors I know that senior Java developer receives 300K annually on average from top IT companies, like Google, Amazon, etc. What about DevOps? Glassdoor shows 150K is the highest. I don't believe it.

https://redd.it/f143rz
@r_devops

I’m terrible at Python

I’m a six year devops professional with AWS certs. I’m excellent with most popular devops tool sets and methodology. Problem is that I stink at python and programming in general. I can edit existing python scripts and have a general sense of what python is all about. However I always seem to take the long complicated route when solving problems. I work a lot in AWS and mastering boto3 is a must. Any tips advice or links to help me out? I do have a acloud guru subscription.

https://redd.it/f1c75t
@r_devops

Bosun - Kibana Automatic Index Pattern Discovery and Other Curating Tasks

I create a light tool to automatically create Index Pattern and I am planning to add more curating tasks that have to be done manually in Kibana. you should run it in a container beside Kibana and forget about it.

[https://github.com/sherifabdlnaby/bosun](https://github.com/sherifabdlnaby/bosun)

https://redd.it/f1p7e6
@r_devops

Cherre Series A Funding Round Announcement!

[https://blog.cherre.com/2020/02/06/real-estate-data-and-analytics-platform-cherre-raises-16m-for-further-expansion-in-round-led-by-intel-capital/](https://blog.cherre.com/2020/02/06/real-estate-data-and-analytics-platform-cherre-raises-16m-for-further-expansion-in-round-led-by-intel-capital/)

We are looking to put those funds towards growing our team so if you're interested joining, please reach out and apply at [**cherre.com/careers**](https://cherre.com/careers)!

https://redd.it/f1sqn7
@r_devops

Serverless Framework with Terraform: A firsthand experience

Hey all - [thought I'd share some learnings and experiences](https://medium.com/@joel.tbarna/serverless-framework-with-terraform-a-firsthand-experience-ce127db3ac5b) we've had getting the Serverless Framework and Terraform to work in sync. Was quite a journey and hope this helps anyone else trying to get started with a serverless application.

Let me know if you have any questions! Happy to help where I can.

https://redd.it/f1v3w3
@r_devops

How to find pods for which cpu and memory limits were not set

What is the best way to find all pods of Kubernetes cluster which have no cpu and memory limits?

The search should be automated. Additional functionality may be required in future (e.g. find pods and send notification email)

I'm considering writing a new Operator for this/using Prometheus metrics to get such pods/writing Client Library (https://kubernetes.io/docs/reference/using-api/client-libraries/)

Any ideas?

https://redd.it/f1rbzw
@r_devops

Detect/Alert When a Request is taking long to process in Passenger+Nginx+Rails Configuration

I have a non Enterprise Passenger with Nginx set up for Rails.

I am wondering if there is any way to detect if a request is taking xyz
seconds. The challenge here is to detect/alert while the request is being processed, i.e. before getting the response.

The reason for the above scenario is because I want to know when a specific request is exceeding the obvious/expected time in which it should have got executed. Maybe it's stuck somewhere and requires manual intervention. Maybe there is no way that I would be receiving the response and I should look into it. (I am taking the extreme case here). But the process can't be killed directly unless the other requests are processed completely. Thus, an alert would be more than enough to help me out in this scenario.

Found few references such as :

* [https://www.phusionpassenger.com/library/indepth/hooks.html#max\_request\_time\_reached](https://www.phusionpassenger.com/library/indepth/hooks.html#max_request_time_reached) but that's more like giving passenger the responsibility to kill the process. It's not feasible in my case here since there must be other requests which must be on-going.
[https://blog.appoptics.com/monitoring-rails-get-hidden-metrics-rails-app/](https://blog.appoptics.com/monitoring-rails-get-hidden-metrics-rails-app/) But this is more like relying on rails to do the job. And it's not while the request is on-going
.

Rails Version : 4.1.15

Any leads would be appreciated! TIA

https://redd.it/f1tqdj
@r_devops

where to begin to get DevOps engineer job?

i have some startup experience and experience with ccTLD DNS domain servers, some Python/bash experience..am going to jr college for Python, awk, and sed. I made a resume for this too.. Ive seen people on /r/devops claim to get in with no experience claiming their employer just said for them to get a Puppet book or "Phoenix Project". So I'm definitely a "somebody" at this and tech although when they say you need 3-5 years prior experience at a DevOps role they're not joking like literally they'll hang up on you at phone screen, despite seeing average joes make it here lol. I have CFEngine on my resume as experience and want to learn CFEngine so I can say I used it at CityDrinker as a "systems engineer" and get a job. I'm in the Bay Area. What do I do as far as labs how do I organize this? I had LinuxAcademy but it was going to waste I'd never use it nor do I use my "Python for DevOps" book simply because I don't know what to do. There's room in my head for being knowledgable ideally knowing ins and outs of CFEngine and maybe acloud.guru (prefer free though) can be a way for me to get a job? I have AWS free tier tied to my gmail.

I'll check out the docs page for CFEngine today it is hard to get me going I take a big nootropics stack and atomoxetine but it works and makes me obedient to DevOps I want the way of DevOps and only the way. I'll look into Kubernetes too.

https://redd.it/f1strw
@r_devops

Rundeck

Hello everyone !

I think i miss something to understand how global variable works. 

I try to create my job scheduler topology with rundeck. 

In some words and for keep it simple, 

I have a job1 in host A (backup DB, compress and calculate the size)

I have a job2 in host B (calculate the free size and compare with the return value of job1) 

I have a job3 in host A (export DB)

It just an exemple to try to pass return value between steps. 

I have defined 3 jobs and 1 more with the workflow. But impossible for me to retrieve the global variable that I put in first step in my workflow. (I also test to define this global variable in the first job) 

Any Ideas ? 

Thank's a lot

Regards

https://redd.it/f1shag
@r_devops

Nagios Alternative -- SELinux

Hello All,

I am a junior Linux system admin, and I work for a company with a few (non-cluster) Linux servers that are used for heavy computations. It is required that SELinux be enabled on all of our nodes, and I would like to install a monitoring service that 1) alerts me when one of the servers can't be reached, and 2) has a web interface (plugin?) showing the servers status and some stats (mostly to impress VIP visitors on a large screen). Can you recommend any open source Nagios alternatives that allow SELinux to be in enforcing mode?

https://redd.it/f1ziml
@r_devops

K8 - Baked in configuration or ConfigMaps?

We are on our container path and come to one of those principle decisions (always with exceptions in an enterprise). What are people see / doing? Have you changed from one to another and why?

Simply put are you baking in the configuration into your container image and therefore an image for each environment (dev, non-prod, prod) or are you using ConfigMaps or a shared configuration management system to manage these deployments variables.

Simplicity and the platform dictates directs the former, what dictates the latter for you?

https://redd.it/f1rpte
@r_devops

Google Cloudbuild + Env _Files_

Hi everyone. I've got a deep understanding of SWE, but still getting my feet wet with DO. I'm revamping our CD pipeline, company uses GCP.

I really like GCP and Cloud Build is enjoyable, but damn, I find it bewildering that the [build config](https://cloud.google.com/cloud-build/docs/build-config#options) doesn't support env files. Tell me if I'm crazy:


If I want to automate a build to a dev server and the build needs specific dev secrets which are stored in a file, I have to either have to create a custom entrypoint and parse the env file (which might end up exposing the vars in the image?) or I have to use the Secrets option and list the env vars one-by-one.

To make things worse, if I want to use these env vars in a Dockerfile, [I have to basically do the same thing again](https://github.com/moby/moby/issues/28617)?

​

What am I missing? Why is this not easier??

https://redd.it/f1oyxg
@r_devops

Roles and Responsibilities

I'm very early in my Devops journey and wanted to wisdom from those further down the road on the division of responsibility in the cloud environments for mid to large orgs.

1. Have you had success with development teams writing their own IaC, using company approved modules/templates, and owning the deployment via automated processes?
2. Have folks got dev's deploying to dev, but at UAT/PRD that deployment responsibility is with the devops team? Does this work?
3. Also, looking back what was your key lesson learned - be it a success or failure - which you could go back in time and pass on as advice to yourself?

Many thanks in advance!

https://redd.it/f1orzn
@r_devops

Question on certification

Hello r/devops,

I am recently looking to get certified with a public cloud provider, and I was wondering if it is a good idea focusing on going the Azure cloud architect certification path or the AWS certified solution architect path. I do have experience in AWS, and I wanted to learn something new with Azure, but I am unsure if it is a marketable certification. My current employer is planning going with Azure, but I am not planning staying for the long term.

https://redd.it/f22fex
@r_devops

Need help understanding azure concepts like service account, service principals, etc.



I am rookie at DevOps and a recent university graduate. I need help understanding concepts like service account, service principals, app registrations, roles, application objects, etc.. in simple terms. I have looked up azure documentation but I am having a hard time understanding the technical terminology.

What I need to understanding is what exactly these things are and how are they related. I ran into an error when I notice that I couldn't push code to a certain environment from Azure DevOps since it didn't have a service account configured. I don't know what these entities are and how they relate. Need to understand the concepts so that I can understand what errors mean.

Thanks

https://redd.it/f1xdnm
@r_devops

UNIX auditing

Heey folks.
I'm auditing rhel/centos systems, so I'm using auditd for logging and sending the logs to Graylog through Rsyslog. Well, the logs are send correctly until they rotate, when they rotate, my Graylog stop reciving the logs.
I set SELinux rules but it doesn't have some effect (https://www.reddit.com/r/sysadmin/comments/2fn013/forwarding_audit_logs_via_rsyslog_with_selinux/)

Any idea?

https://redd.it/f1zupi
@r_devops