ArchGW v0.2.0 🚀. Unified access to local and API-based LLMs with added support for OTEL-based observability.

Arch Gateway is an open source, intelligent edge and LLM proxy built on Envoy. I just released v0.2.0 that offers a unified access and security to API-based and ollama-supported LLMs. This release also adds support for integrations with honeycomb.io, signoz and jaeger for LLM tracing and metrics.

Check it out: https://github.com/katanemo/archgw

https://redd.it/1idateq
@r_devops

Need Advice on KodeKloud Learning Path for DevOps. Anybody who took KodeKloud course for Devops, please shed a light on this

I’m planning to take the KodeKloud DevOps course to help me transition into a DevOps role. However, I’m a bit confused about the recommended learning path on their website. Do I need to complete all the prerequisite courses (Sys Admin, SRE, and Platform Engineer) before starting the DevOps course, or can I jump straight into the DevOps Course?

https://redd.it/1id9dj1
@r_devops

New trends stuff worth exploring in 2025 ?

Hi,

I'm looking for ideas on what to explore in 2025 beside AI (or in case of AI exact courses or trainings online worth doing).

What else is worth checking out to stay at "the edge" ?

I'm asking as a fellow devops that has to keep his skills sharp. I had a bigger break from following ppl to work on self health wise and now would like to return ;p

https://redd.it/1idj1m4
@r_devops

Automating a deepseek deployment on AWS

Someone from AWS shared a guide on deploying deepseek in aws along side Ollama to create a web based chatbot like functionality.

Thought id try and automate the process. Still testing out the user data script but wanted to share what i have so far

https://github.com/n7z2/iac-deepseek

https://redd.it/1idjgly
@r_devops

Current state of IT hiring and salaries in Europe: 18,000 Jobs, 68,000 Surveys

Over the past months, we analyzed 18,000+ IT job offers and surveyed 68,000 tech professionals across Europe.

One key finding? DevOps remains one of the highest-paying fields in Europe, ranking among the top salaries in Germany, Switzerland, and beyond.

No paywalls, no gatekeeping—just raw data. Check out the full report: https://static.devitjobs.com/market-reports/European-Transparent-IT-Job-Market-Report-2024.pdf

https://redd.it/1idkolw
@r_devops

Stateless architecture - core principles, advantages and disadvantages, and practical concerns

Hey devops people! My colleague recently wrote up this blog, where he discusses stateless architecture, and I thought it could be useful to share here.

It's based on his experience in technology (including in companies such as Scaleway, Datadog, Mozilla, and Ubisoft).

In the blog, he goes through the five core pillars of stateless design (independent requests, external state management, idempotency, decoupled components, horizontal scalability).

Then talks through advantages & disadvantages of stateless. Then moving on to practical concerns around handling user sessions, caching mechanisms, deployment and lifecycle concerns.

The point is - stateless architecture is powerful. However, there are trade-offs that need to be dealt with. The blog will be helpful if you're trying to figure out the best architectural approach for your specific use case - if you get it right from the start, it makes the rest of your job much, much easier.

So feel free to check it out if the topic is relevant for you! And if you have any questions / comments - would love to hear them and help in any way.

https://redd.it/1idlb95
@r_devops

Vendor partnerships, how to effectively collaborate

Hey all

I’m a DevOps engineer with five years of experience. Throughout my career, I have focused mainly on learning the technologies presented in my projects and exploring providers that captured my interest, often without regard for my employer's existing relationships with them. Now that I am taking a more active role in my company to help guide some of my peers, I am considering how to effectively use our partnerships to upskill our workforce. While there are various challenges to address, I would like to understand the key elements to define a partnership and establish clear expectations between both entities.

Thank you in advance.

https://redd.it/1idnyiw
@r_devops

What are some strong opinions about devops you've personally held in the past that have been changed over time?

I'll start:

\- I used to think devops was simply "being an automation developer for operations". I can see it's quite a bit more involved than that now.

\- I used to think that I would never learn to code or want to learn to code because I just wasn't interested in that, but I learned the value of IaC and being able to use Git well (especially when I'm surrounded by folks who don't code at all, don't audit changes to configurations or make changes to applications in K8s pods).

https://redd.it/1idomz0
@r_devops

Career Shift from IAM to DevOps

I tried to look for a FAQ for this subreddit but I couldn’t find it.

I am an IAM engineer and I do not like it. I wish it was more heavy on the automation / programming side. I want to pursue devsecops as a career but don’t know how to move from IAM to devops-esque roles.

How can I move from IAM to devops? What do you recommend I start learning? Are there any certs I should look into? Will being an IAM engineer help me pivot to devops? And I am sorry for asking this, but do you think AI will replace devops engineers OR will it make the jobs more competitive and have less openings?

Also, if there is a FAQ or a reddit post that answers this question let me know and I will dive deeper.

All help is appreciated, thank you :)

https://redd.it/1idoye1
@r_devops

Packer can't access AWS Shared Credentials for ami build, Error Message - Validating Regions: AuthFailure: AWS was not able to validate the provided access credentials status code: 401

Running Packer v1.11.2 on RHEL9 on an EC2. The only plugin using is Amazon (/home/ec2-user/.config/packer/plugins/plugins/github.com/hashicorp/amazon/packer-plugin-amazon_v1.3.4_x5.0_linux_amd64).

My goal is trying to build a Windows Server 2019.

All packer commands run without error (packer inti and packer validation)

When running the packer build command, getting the following error:

Build 'amazon-ebs.packer-generated-v2' errored after 94 milliseconds 487 microseconds: error validating regions: AuthFailure: AWS was not able to validate the provided access credentials status code: 401, request id < >

==> Wait completed after 94 milliseconds 590 microseconds

==>Some builds didn't complete successfully and had errors:

--> amazon.ebs.packer-generated-v2: error validating region: AuthFailure: AWS was not able to validate the provided access credentials
status code: 401, request id:


We are using shared credentials under .aws/config and can run aws configure list command and see the region, access_key and secret_key masked excepted for the 4 last characters.

I've tried adding the assume_role under the source block

source "amazon-ebs" "packer-generated-v2" {
assume {
role_arn = "arn info here/IAM Role here"
}


I've also added an entry under source, iam_instance_profile = "IAM_Role_Here"

and same error as before.



My question is, is how do I reference the AWS Shared Credentials/IAM Role correctly, from my Packer File when trying to build an AMI?



https://redd.it/1ido7kq
@r_devops

Insurance and legal firms for independent DevOps/IT Consultant: E&O, Cyber, Contracts, etc

Hello,

There are two things I need to set up for my consultancy:


\-Errors & Omissions and Cyber Insurance

\- help interpreting contracts with a company at which I subcontract, and creating a contract of my own/negotiating this contract (lawyers/legal counsel)


I'm particularly interested in retaining my ability to use the IaC code I write while working with this particular contractor (the one I subcontract for) as well as the code I write for direct clients.

Can anyone recommend any a) insurance companies b) legal firms that specialize in Ops/IT?


Any comments/experience on this would be greatly appreciated. I don't know if IaC written out of purely open source code is IP or not...that's just an example of the type of question I have.

https://redd.it/1idtx6f
@r_devops

How old are you?

Hi im new devops engineer and since i found many great engineers here i was wondering what's the average age here!

View Poll

https://redd.it/1idvztn
@r_devops

How to Debug a Java Microservice in Kubernetes

Sharing a guide on debugging a Java microservice running in a Kubernetes environment using mirrord. In a nutshell, it show how to run your service locally while still accessing live cluster resources and context, so you can test and debug without deploying.

https://metalbear.co/guides/how-to-debug-a-java-microservice/

https://redd.it/1idwwos
@r_devops

Tailpipe is a new open source SIEM that runs on your laptop

GitHub - https://github.com/turbot/tailpipe

Powered by DuckDB & Parquet, Tailpipe uses new technology from the big data space to provide a simple CLI to collect cloud logs (AWS, Azure, GCP) and query them at scale (hundreds of millions of rows) on your own laptop. It includes pre-build detection benchmarks mapped to MITRE ATT&CK - also open source.

https://redd.it/1idy6qi
@r_devops

What happened to this being a well paid job?

DevOps jobs used to pay really well, and I would see jobs that paid 150k plus all the time. Most positions pay between 90k - 120k now in the Dallas Texas metro area, which is really lousy and the same as a systems admin or other mid-tier positions in IT. What happened? My friend who is a loan officer at a bank for three years makes more than that.

https://redd.it/1ie14p8
@r_devops

Automate ssl certificate renewal

How can automate the process of renewing let’s encrypt certificate for a specific domain.

Currently what i do is generate certificate in my local machine verified by creating txt record in cloudflare and copy the fullchain.pem and privkey to the server.


https://redd.it/1ie77m7
@r_devops

How can I learn Grafana logs/metric querying fast?

Need help in learning Grafana logs/metrics querying fast...

It's for work, and the regex equations for promql are confusing to say the least. There are too many labels, filters and rate/sum etc. to sort thru, and I don't understand what I'm doing until I run the query, not to mention all the syntax mistakes. I'm literally trying to reverse engineer from the query result.

Please help.

I want to query Max CPU, minCPU, Avg Memory, etc. specs of specific pods in the trial cluster of our application. The latest release depends on NY performance at this.

https://redd.it/1ie937b
@r_devops

KodeKloud for DevOps?

Hey there!

I’m curious to know if anyone has used KodeKloud to learn DevOps or Cloud Engineering. I’m wondering what the curriculum is like. Is it just a basic introduction or does it go into more depth with real-world projects? I’d love to hear some honest reviews.

Cheers

https://redd.it/1ieb1e7
@r_devops

Seeking Open Source Tools or Golang Libraries for MQTT to Notification Integration

Hi everyone,

I have a use case where I previously had an MQTT service running in my cluster. Telegraf was connected to MQTT, Prometheus was connected to Telegraf, and Alertmanager was connected to Prometheus. Based on the rules defined in Prometheus, alerts were sent to Alertmanager, which then sent notifications based on the configured receivers.

Now, the services themselves are sending alerts to an MQTT topic. I need an open-source tool that can subscribe to MQTT alert topics and send notifications. This tool should be highly configurable.

If there is no open-source tool that listens to MQTT topics and directly sends notifications, I can run a Golang service that listens to MQTT topics and sends alerts to a notification service. Are there any Golang libraries that have the capability to listen to MQTT topics and libraries that can send notifications? If there isn't a single library, I can use two libraries: one that listens to MQTT and one that sends notifications.

Any recommendations or advice would be greatly appreciated!

https://redd.it/1iec12c
@r_devops

How do you handle applicative certificates?

In every organization I've worked at, there was a huge gap in the application certification processes. Wether it's for creating or renwing then. Even when theres a PKI with API acces, dev teams still rely on the infratstructure or devops team to just do it for them. Wether it's to generate, install and monitor their expiration date.

So, how do you handle it on your side?

https://redd.it/1iecvnw
@r_devops

DNA&OC, or: How to communicate during an incident

When you're on-call, working an incident, try the following: Do Not Assume (DNA) and Over-communicate (OC).

https://substack.com/home/post/p-156089872

https://redd.it/1iedvg0
@r_devops