How to Access AWS From Azure VM Using OpenID Connect

Do you work in a multi-cloud environment?

Do you usually find yourself passing around cloud credentials? Hasn't it ever felt kinda wrong?

Did you ask yourself if there's a better way around this?

I'm here to tell you that there is. There is a much better way to handle such service-to-service communications.

This blog post elaborates on what OpenID Connect can do to help you avoid passing around long-lived credentials, relieving you from the chore of frequent secret rotation.

If you enjoy this post, please share it with your network.

#aws #azure #oidc #openidconnect

https://developer-friendly.blog/2024/05/27/how-to-access-aws-from-azure-vm-using-openid-connect/



https://redd.it/1d1mjhd
@r_devops

What to do with AWS consulting partner in devops team

Long story short, i’m about 4 to 5 FTE short in our team in order to deliver the projects the business wants.

I’m an acting lead and I’ve been asked how I might use two or three contractors from a AWS consulting agency to help us deliver on our BAU and devops uplift work.

My pain points are different levels of maturity across our cloud stack.

I have several EKS environments running just a single API application and what I feel is a very fragile terragrunt / helm stack (setup like 5-6 years ago) our api product hasn’t really evolved just waiting for onprem project to kick off next year but feel this infrastructure as code isn’t ready for it.

EKS upgrades are serious toil on my small team. By the time we get through the quarterly upgrade cycle we’re planning it again 8-12 weeks later. Unlikely to get buy in on switching to ECS due to onprem move planned next year.

I’ve got another 8 or so AWS accounts mostly serverless, ec2 pets in a mixture of cloudformation and SAM. I’d ideally like this moved to cdk to empower developer self service. Because my team need to help deploy new resources via cloudformation an a lot of clickops has snuck in.

My existing team are familiar with terraform and our terragrunt stack but would struggle with creating new modules or using a public one to implement something.

They know a bit of bash but not python or node so cdk will be a massive leaning curve imho (but I picked up enough typescript in 3 months to support cdk within my former team to support developers and using a bit of ChatGPT and cdk got some automation lambdas working!) as they more so come from onprem world and dabble on cloud/devops.

Assuming I have the opportunity to hire 2-3 devops engineers from an AWS consulting partner and they worked within my team how would I best use them?

I don’t have any infa patterns to hand over and I’m capacity constrained due to being a contributor to other projects as well as acting lead.

https://redd.it/1d1pjfe
@r_devops

It seems like I dislike every job

At the moment I have 3 years of experience in cloud and have felt always fairly motivated for my job untill my last 2 jobs.
Now I am already at my 4th company an I think I am switching jobs too often.

My current job I also get constantly annoyed by how weird organizations have decided to deploy software and infra. I have to deploy infra that makes uses of a 10k+ lines of terraform and I feel constantly lost and usually nobody awnsers any of my questions. Sometimes I think 70% of my team doesnt know what is going on in the templates.

Already I feel the urge to move to another job again, but this will look bad on my resumee. I have the feeling that it is about me, but I just really struggle usually with the way of working and feeling useless.
I am not a genius but I have the feeling I am not stupid either, I just get really frustrated really quick with dealing with other people's over engineered stuff.

Maybe I just need to be okay with not adding value yet after 1 month of working in this place. But I just have the feeling freelancing is more my thing. But for this my experience is still a bit lacking.

Now I am curious if other people also feel like they dislike all companies they have worked for. Do I just suck it up? Do people have advice of how to care less about the job?

Thanks in advance

https://redd.it/1d1qps7
@r_devops

Cut K8s costs with Karpenter

If you're like most companies running Kubernetes, you've likely seen your infrastructure costs balloon over the past year. Between supply chain disruptions, the rise in cloud prices, and increased app usage, those pesky cloud bills keep getting bigger and bigger.

It's enough to give any CTO heartburn. After all, you implemented Kubernetes and containers to increase efficiency and reduce costs! Yet somehow, it feels like you've lost control of your spend.

The problem often comes down to the limitations of your legacy cluster autoscaler. Tools like the Kubernetes cluster autoscaler were great when Kubernetes was new. But let's face it - their capabilities are limited compared to today's workloads. Relying on rigid auto-scaling groups and similarly sized nodes just doesn't cut it anymore.

The result? You end up with inefficient overprovisioning, idle capacity, and nodes that don't properly align with workload needs. And those inefficient nodes drive up your cloud spend exponentially.

Fortunately, there's a better way. Karpenter - the new open source node provisioning tool purpose built for Kubernetes.

Karpenter takes a workload-centric approach to right-sizing nodes on the fly based on actual resource requests. It also automatically consolidates workloads onto fewer nodes to minimize waste. Engineers who have made the switch cite 40% cost reductions or more!

Read how here https://www.perfectscale.io/blog/getting-the-most-out-of-karpenter-with-perfectscale

https://redd.it/1d1sc5l
@r_devops

From your source code to zero-downtime, high availability, and secure production deployment in no time (v5.0.1)

* With your project and its sole Dockerfile, Docker-Blue-Green-Runner manages the remainder of the Continuous Deployment (CD) process with [wait-for-it](https://github.com/vishnubob/wait-for-it), [consul-template](https://github.com/hashicorp/consul-template) and [Nginx](https://github.com/nginx/nginx).
* Examples in PHP, Java, and Node.js
* [https://github.com/Andrew-Kang-G/docker-blue-green-runner](https://github.com/Andrew-Kang-G/docker-blue-green-runner)

https://redd.it/1d1vbw4
@r_devops

Client wants to start storing data regionally

We have a client who sells services to other companies. We originally a NextJS application with PostgreSQL database in AWS Canada region.

They are looking to partner with a company in the US who seems to think they need user data stored in the US. But the current user data needs to also stay in Canada.

This presents many issues as the application was never designed to store multi-regional data like this.

One option is that we can deploy the tech stack in another AWS region, but then we essentially have two totally separate systems operating that don't talk to each other.

I've come across some service such as CockroachDB which has some features to store row level data in different regions but changing the database system at this point would be quite a bit of work. I'm not sure if something similar can be accomplished with RDS PostgreSQL.

I'm wondering if anyone has had to deal with a request like this before and hoping to get some ideas as to where to start.

https://redd.it/1d1xbbd
@r_devops

Are all CI/CD Tools similar?

So I started an intern position in a devops/IT role and am using Jenkins for the first time. Looking online, it looks like Jenkins gets a bad rep and it's alternatives are usually preferred.

So my question: are Jenkins and all the other tools similar in understanding concepts and usage? If I learn how to use Jenkins, would it be easy to use other tools?
I am mainly curious because I am hoping to learn as much as I can from this internship, and I hope that learning Jenkins means I understand how to use other tools to some degree.

https://redd.it/1d20ach
@r_devops

Preferred Dev/Deploy stack for basic python database app?

Retired devops guy here, almost a decade out of date. To update my skillset, I’d like to write a web/database app for a non-profit org I volunteer for.
My favored language is python. I’d like to do all-the-things as code, including provisioning, deployment, and database structure. I’d like to host it in the cloud, preferably free/cheap tier (it won’t get much traffic).
I’m starting the research phase, and thought y’all could help me focus in on what might be appropriate to look at.

https://redd.it/1d2cmj5
@r_devops

Ever Struggled with SSL/TLS Certificate Chains? Check This Out!

Hey everyone 👋,

I've just published a simple guide on SSL/TLS certificate chains on GitHub. This is my own notes I have kept in for a long time and I thought I shared to everyone and I'm curious to know what you think? I made it very simple enough to understand, breaking down what certificate chains are, how they work, and gave a real world example.

If you find it useful, please star or watch my repo. If not, any feedback to make it better and simple?

Check it out and let me know: GitHub - Understanding Certificate Chains: A Simple Guide

Thanks in advance!

https://redd.it/1d2dk01
@r_devops

Eraser AI

I found a useful tool today after I sifted through a post here from several months ago via my technical diagram query. I’ve worked in the Fortune 100 space for the last several years and diagramming tools have not been easy or fun. I don’t think the AI feature of Eraser was out several months ago when this product was discussed, but I think it deserves another discussion.

For those with other AI-powered technical visual/design tool experience, does Eraser AI detail a complex architecture better than the others, LucidCharts beta AI for example
? I tried diagramming with ChatGPT 3.5 in the beginning and wasn’t impressed. But models have clearly improved since then, and watching Eraser AI diagram my two year project in less than a minute with < 200 words was satisfying.

https://redd.it/1d2bzms
@r_devops

Begin for DevOps team

Hi all,

I'am a (m, 43y) I just finish some courses and have certificates. I'am from the Netherlands and want to start working in a DevOps team. But first i need to get alot of experience is my feeling. Could u give me some advice to start with. My experience is homecomputers and home networks, installing hardware, software and build computersystems.

Eager to start...

https://redd.it/1d2ewl1
@r_devops

I need 1000 concurrent iOS builds via Jenkins

We have a special requirement where we'll need 1000+ builds. All building concurrently.

Now, our main CI is Jenkins hosted in GCP.

What would be the best way to have this running?

1. AWS - Not very straightforward. But is it possible via ASG?

2. MacStadium - Seems the best option here since it's plugin has dynamic provisioning.

3. Anything else?


https://redd.it/1d2j9iy
@r_devops

What does everyone think of this recommended path I shared below?

https://raw.githubusercontent.com/milanm/DevOps-Roadmap/master/DevOps%20Roadmap.png

I found this roadmap today and wanted to hear some opinions about it. I have some fair knowledge about Git, JS development, Linux, and networking.

If I can dedicate at least 2 hours a day for this journey if not more, how long should I take on average to learn more about each topic? Of course there won't be an accurate figure. But from everyone's experience, on average, how long does it usually take? And how many projects should I involve myself with?

https://redd.it/1d2k6az
@r_devops

Landed first pure DevOps Engineer job

Just got the offer after 2 interview round. Super happy, can’t wait to start, been browsing this sub for a while, and now I can finally say

oneofyouoneofyouoneofyou

https://redd.it/1d2lvmh
@r_devops

Installing sentry on kubernetes

Hello, I have been struggling with installing Sentry on Kubernetes.

I am using ArgoCD, so basically, I want to pass it a helm chart.

The challenge is I have not found any good helm chart. These ones I found do not appear to install sentry, and I am not clear as to the purpose of the charts.

https://github.com/sentry-kubernetes/charts/tree/develop/sentry
https://github.com/sentry-kubernetes/charts/tree/develop/sentry-kubernetes


Can someone please help point in the right direction?

https://redd.it/1d2n471
@r_devops

Managing Ephemeral Storage in EKS with Bottlerocket Nodes

Hi everyone,

I have a question about ephemeral storage in EKS. I'm using version 1.29 and Bottlerocket images for the nodes. I deployed the cluster with Terraform. I noticed that the nodes have two volumes: a 2GB volume for the OS and a 20GB volume for data, which is the ephemeral volume.
Sometimes I encounter disk pressure issues, causing pods to be evicted. Before increasing the 20GB volume, which I understand is the default value, I want to understand how EKS manages this volume. Specifically, does EKS always maintain the volume at 80% usage? It seems to consistently hover around that capacity, leaving little room to handle these disk pressure incidents. I want to ensure that if I increase the volume to 40GB, it won't always remain at 80% usage.

Can anyone provide insights or share their experiences with managing ephemeral storage in EKS?Thanks!

https://redd.it/1d2oa31
@r_devops

Anyone has already read SonarQube code smell report to generate dashboard in Grafana OSS

I'd like to show the applications that had more issues in SonarQube. Is there a plugin for it? Or maybe a service for be used with Infinity Plugin on Grafana?

https://redd.it/1d2q1hf
@r_devops

Peer Code Review Tool

Hi,
We’re currently using GitLab with Atlassian Crucible for our peer code reviewing. GitLab doesn’t look like they’ll ever support a single code review for multiple projects.
Crucible is now in ‘basic maintenance’ mode therefore we’d ideally want to move to an alternative tool which is actively maintained.

Is there anything out there that does this as a standalone product or is the solution to find a tool like BitBucket which handles the repositories and the code reviewing?

Thanks

https://redd.it/1d2qqz7
@r_devops

What do you use at your org? Azure DevOps or GitHub Team?

I am working with a team of devs and we have been using GitHub teams for some time. In the beginning it was pretty good. But now it is not enough anymore.

The team is not happy with the project management tools provided by GitHub.
Resources for GitHub actions are not enough, we are exclusively using self-hosted runners.
We are worried about GitHub packages and the storage limit set for it.
Basically we are paying 4 USD per user just for version controlling.

To all the devs working in organizations, what has your experience been like? Would you prefer working with Azure DevOps instead?

Oh and if it helps, we use Azure for all our resource requirements.

Thanks for your time!

https://redd.it/1d2s336
@r_devops

Platform as a Product 101

So, we wrote up an intro/overview of what the platform as a product strategy looks like in practice since that concept has taken off in the past few months. But is anyone on here actually utilizing PaaP in their own organization that's not one of the big tech companies? Any examples you can share of how you're utilizing it in your own org?

Or is it all cap/irrelevant? Would love thoughts from both individual devs and those who maybe are in charge of leading full dev teams. :)

Check it out, thanks!
https://thenewstack.io/platform-as-a-product-101/



https://redd.it/1d2pr82
@r_devops

Elastic search question

Hi 👋 I am not a developer (or anything technical). I am a bootstrap founder looking for solutions for e-commerce and retail in my vertical using tech.

I discovered Elastic today. I uploaded a csv of products (skus) to test and can query the index with their example console to search for, as an example, a product with “cane sugar” in the ingredients. I’d like to know:

1) what code do I put in the php console to ask the index to show products that “do not contain cane sugar” for example (sort of an “if then” query)
2) how do I make a query that reads the ingredients or attributes in a product and then spits out (matches it to) their description (stored in the csv)? As in if a customer wanted to scan a product to read the ingredients attributes?
3) (I’m a total rookie I know) but how do I “export” what I’ve built and make it look pretty on the front end for customers to use on our website (integrate it) or app?

I know I’m totally out of my league here and feel quite dumb but this has been bothering me and I know there’s a simple solution, I just don’t have the skill yet would like to try. Also, if you don’t ask you’ll never know.

https://redd.it/1d2vhip
@r_devops