How does your team manage OS dependency upgrades?



View Poll

https://redd.it/13l2q7a
@r_devops

Trigger Jenkins pipelines via Ansible

Continuing on the same topic from: https://www.reddit.com/r/devops/comments/13k9wy7/infrastructure\_as\_code\_trying\_to\_setup\_an/

​

Is there a possibility on Trigger Jenkins pipelines via Ansible for deploying ISTIO & NGINX? I know it works well on other way around where running Ansible scripts via Jenkins.

​

Let me know your thoughts people's

https://redd.it/13l0nyh
@r_devops

Best tips for reducing cloud costs?

Overtime I've learned many tricks from other engineers on where and how to reduce costs by using niche parts of cloud vendors. I'm mainly focused on AWS, but some of the tips are cloud agnostic. Some of them might be basid but are nontheless important. I'd love for you to share yours so we could all learn from each other. Here are mine:

General:
- Cache external dependencies locally to reduce network transfer costs. For example - pull-through docker image registries.
- Always prefer spot instances where stateless and possible as opposed to on-demand.
- Use automated scaling solutions to power off dev workloads during weekends if possible.
- Filter your logs, metrics and traces before they reach your monitoring solution. In almost all solutions, SaaS or not, you're being charged for their storage or ingestion.

AWS:
- Use Reserved Instances and Savings Plans. Consider using "smart" automated RI SaaS solutions which are based on your existing workloads.
- Prefer higher generation EC2 instances, they will always be cheaper. It is also true for other products such as storage solutions like gp2 as opposed to gp3.
- Use S3 object classes to majorly reduce costs on less frequently accessed buckets.
- When using multiple private subnets that access the internet, make sure they each have a NAT gateway. It will cost more to send the traffic only through one of them.
- Move away from Classic load balancers as they are deprecated and cost more, use Network or Application load balancers instead.
- Move away from VPC peering to Transit gateways (or Network Manager). Peering is costlier when there are many VPCs.

Kubernetes:
- Consolidate your pods on less nodes. Leave only as little headroom as you intend for in your nodes.
- Don't over commit resources. Pod requests must be optimized over time in order to not over provision.
- If possible, prefer using only a single region to avoid network transfer costs between nodes. Preferably when it's not production.

https://redd.it/13l6rde
@r_devops

GitHub Actions vs Cloud Build

We had to make some CI pipeline and we thought Cloud Build would be easy since we’re on GCP. However, to me it is a pain in the ass. Especially installing dependencies seems impossible. I gave GitHub Actions a try, and setting up the same pipeline there was ten times faster. Is it just me, or is Cloud Build just shitty for some use cases?

https://redd.it/13l8dr6
@r_devops

SQL or no sql for user analytics

We are going to measure user behavior in our app. Like which users view which profiles, who updates their profile most frequently etc. Should we use our existing Postgres z’n for this? Or should a no sql en be better for this? We know some actions beforehand but will add other actions and data types as necessary. So our first thought would be to use a separate mongodb instance for this.

Thanks in advance

https://redd.it/13l5gc5
@r_devops

I'm new to a DevOps role (it is also my first tech job). How do I get better at my job and set myself up for growth?

I work as an infrastructure developer which deals with a lot of CI/CD stuff and containerization. Essentially Jenkins and OpenShift have a lot to do with my position. I like the idea of cloud stuff but my company doesn't do much cloud computing at all, so I don't know if I should spend my time on learning much more of that since I love this company and would like to stay here.

I am assuming just learning the tools of my position would get me 80% of the way. What else should I be doing to learn as much as possible and to develop skills that will make my manager think I am valuable, and will set me up to move to a higher position within the next 2 years?

https://redd.it/13kz3nt
@r_devops

When did DevOps start "clicking" for you?

Was it months? Years? Was it never?

Or maybe it was 0 time...you...genius?

https://redd.it/13kzr6g
@r_devops

What kind of Monitoring or Observability questions should I be asking?

Hello,


I am looking for some guidance on a new task I was given. My task involves integrating observability into our new applications, specifically in the context of Google Kubernetes Engine (GKE) and our primary use of Google Cloud Managed Service for Prometheus. I am a bit lost on what kind of questions I should be asking, which areas should I focus on, considering our usage of GKE and Google Cloud Managed Service for Prometheus? Any best practices, lessons learned, or recommended resources you can offer would be super helpful.

https://redd.it/13lf5in
@r_devops

How I Used Terraform Effectively | Terraform

Increase Your Deployment Efficiency and Scale with Terraform’s Best Practices

https://medium.com/illumination/how-i-usedterraform-effectively-a-guide-to-best-practices-2c5aa6495214

https://redd.it/13li9rh
@r_devops

Which role to accept?

2 YOE DevOps engineer

Got offered DevOps role in swe team. Dealing with on prem self managed gitlab cicd and kubernetes.

Also offered SRE role in gaming industry dealing with cloud and terraform and pager duty. SRE role has roughly around 4k more in terms of total annual compensation.

Which offer should I take?

https://redd.it/13ll1wf
@r_devops

MKPM Makefile Package Manager

https://github.com/clayrisser/mkpm

https://redd.it/13lo5hc
@r_devops

Read the DevOps handbook and Phoenix project. But I don't have a way to change the Org practices because of low rank. What should I do?

The idea seems good but how to apply it?

https://redd.it/13lor87
@r_devops

Detailed article on increasing volume size of virtual machine.

No GUI involved!.

https://medium.com/@4yub1k/safely-extend-volume-size-of-vmware-ubuntu-server-linux-3f81a04cf3ad

https://redd.it/13lra5j
@r_devops

Awesome Cloud Cost Repository

Based on my previous post and your great tips I decided to open a repository for awesome cloud cost. It can be a place where we share the latest and most curated tips and tricks, and better ourselves as engineers and help us through our careers.

https://github.com/jatalocks/awesome-cloud-cost

https://redd.it/13lsltj
@r_devops

Branch and merge, improvements since TFS?

I didn't have a very good experience branch and merge in TFS some years ago, and since then most of my clients moved to Git and it's worked pretty well and it's what I'm used to.

I've had to use DevOps on my current project, and it's time to branch and I'm seriously worried.

Should I be?

https://redd.it/13ltsky
@r_devops

Addressing GitHub’s recent availability issues Github Blog

https://github.blog/2023-05-16-addressing-githubs-recent-availability-issues/

https://redd.it/13lvlgp
@r_devops

What are good options for observability for tiny startup?

I work for a tiny startup (<5 employees) with one SAAS webapp product. Our infra is in AWS and our monthly bill is ~$300 for a sense of scale. I need to set up a way for us to gather and analyze “telemetry”; specifically latencies and failure rates on HTTP endpoints. This is to support engineers supporting customers.

In a previous life for a bigger company I did the whole ansible, terraform, packer thing to provision grafana + prometheus and it worked well enough. I know that stack well enough that i am confident it provides the solution blocks i need. I’m worried about upfront investment, running costs and opportunity costs considerations.

I could probably replicate such infra for current employer but interested in hearing advice from professionals. (I’m more of a jack of all trades, master of none type…)

- I’ve considered using PutMetricData CloudWatch api for custom metrics. I’m not convinced it can do everything I need, but happy to hear from someone that’s instrumented an app this way. Our logs already go to CloudWatch.
- as mentioned, I can probably set up grafana + prometheus & dependencies within a few days, so I consider it a reliable fallback option.
- datadog? I’ve never used them and they’ve been in the news a lot recently and not for great reasons. Apparently expensive? Vendor lock-in concerns…
- which options am i missing?

https://redd.it/13luhnt
@r_devops

Monitor - IIS App Pool

Is there any open-source solution to monitor IIS App Pools? if not, any thoughts to approach this?

basically looking to notify on pool crash and shutdown. Restart them remotely if required.

https://redd.it/13lyq23
@r_devops

Datadog's $5M Oopsie: An Engineering Case Study in How Not to Do Observability Services

https://newsletter.pragmaticengineer.com/p/inside-the-datadog-outage

https://redd.it/13ls0cl
@r_devops

Cloudquery, Resoto, Steampipe, or Airbyte?

I have been tasked with gathering data about resources across multiple cloud providers (AWS and Azure primarily). Whatever I use must be open source or at least on-prem.

My first goal is asset management, with a possible need for compliance and generating resource graphs in the future.

I found these 4 tools:

Cloudquery: https://cloudquery.io/

Steampipe https://steampipe.io/

Airbyte: https://airbyte.com/

Resoto: https://resoto.com/

Any idea which one is best? i.e. most maintained and stable? If I were to choose one of these tools, which one is the least likely to get completely abandoned 1-2 years down the road?

https://redd.it/13m3gjv
@r_devops

What do I need to master in devops?

Okay, so I am a Software engineer with 3 years of work exp.
I have worked in full stack development with react and node at the core.

Also of k deploy the code I track with Droplets in do, opening ports, check the process I'd and automating the tasks using cronjobs in Linus and some more into the Linux and networking domain.

So, I know end to end deployment and all.

But what more exactly do I eed to learn to become devops, I have used kubernetes just for setting up and run some checks via kubectl.

I need some structured concepts to cover in devops.
So that I can write development+devops as a skill in my resume.

Your help will be much appreciated.

https://redd.it/13m4ku4
@r_devops