What is the best way to learn how to troubleshooting issues in pods

I have some issues when trying to troubleshooting issues in networking

https://redd.it/1d5f3az
@r_devops

Trino on AWS EKS with IAM/IRSA - A Walkthough

Check out this blogpost I wrote to demonstrate setting up a Trino cluster with Hive Standalone Metastore in AWS EKS, to query data files in S3 using IAM/IRSA based authentication, from scratch using Terraform (or OpenTofu) and Helm.

https://binayakd.tech/posts/2024-05-30-trino-on-eks-with-oicd/

This is my first proper attempt at technical writing, and is mostly based on what I have learned and the problems I have solved, through the course of my work. 

Comments and criticism are welcome. If you have any follow up questions, or spot any mistakes, or any improvements, you can also reach out to me (or comment here), I would do my best to answer and address them.

https://redd.it/1d5gnnl
@r_devops

VS Code often loses docker connection

I enjoy using Docker in VS because the GUI is pretty easy for me to understand. I can see Containers listed in VS, and then open up my code files from the Container drop down. So that when I make code changes and save the code, these code changes are reflected in the Docker container. I don't have to run like a copy or build command in Terminal.

The annoying part is sometimes VS seemingly loses this Docker connection. For example today I woke up and made a code change and tried to save my file. Got an error, it can't save the file. And then when I try to open the file through the Containers dropdown, Files is just stuck on a spinning wheel and doesn't actually show the files.

When this has happened in the past I have usually just bumbled around, deleted my current connection, made a new key, connected with that key, etc, and then hoped that it would randomly work (which it sometimes did after fumbling around for 30 mins). But obviously this is a huge impediment to my software dev work so I am looking for solutions, thanks.

https://redd.it/1d5fu76
@r_devops

Need guidance to break into DevOps from swe

Not getting 2nd callback ms due to lack of proper DevOps experience.

Hi guys, I'm a software engineer with almost 3 yoe. I'm a Java dev mostly. I've recently done some Jenkins work in my team. My project doesn't have any DevOps components. No docker. No k8s. No cloud.
But in aws certified solutions architect associate. I'm interested in DevOps and Automation and want to move to such a role.

But I'm facing challenges in getting calls from recruiters. I'm not getting past screening rounds.

I got 1 interview but midway he realised I'm not a DevOps guy and haven't done k8s work so interview terminated.

Right now I'm going through my udemy course to learn more k8s and at least add 1 deployment on my cv.

What should I do in my situation? It's been more than 3 months I'm trying for switch.

Thank you

https://redd.it/1d5kp6l
@r_devops

What is a tool you would definitely buy/subscribe that doesn't exist on the market?

Basically as the title says, what is a tool you or your org would subscribe or buy that doesn't exist on the market, but would help you massively on productivity or product delivery?

​

To start it, we've been on the hunt lately for a simple Service Catalog and Portfolio with approval management software that allows our tenants Self Service on our infrastructure (which is built on top of a multi-tenant strategy). Most of our configuration management is done over Ansible/AWX, hence using a native RedHat solution would make sense.

Initially we explored Backstage and Port.io, but it meant we had to do a lot of integration to make it work, so we started investigating solutions that used Ansible as a

After initial investigation, I came across this Red Hat Ansible Automation feature, called Ansible Services Catalog:

https://www.youtube.com/watch?v=ryNEJuyvEl0

This module would pretty much fit all our needs and would justify migration to the commercial Ansible Automation Platform, but unfortunately it got moved out of the product to let ServiceNow handle the Self Service:

https://www.youtube.com/watch?v=DmPXiRHjgRY&t=866s

Some \~ good news was that an open-source upstream project was started to maintain this module, called Pinakes, but the bad news is that the last commit dates 2 years ago:

https://github.com/ansible/pinakes

We came across a new open-source project called Squest (backed by HP):

https://github.com/HewlettPackard/squest

After trying it out, the whole product looked a bit cumbersome and it does not support a multi-tenant model, so the proposal to integrate Squest got thrown out of the window.

​

So we started looking for ways to build our own service catalog. We designed how the back-end and the concept would work, what we needed was how to build the front-end. As a pure cloud/devops team with extensive system engineering and back-end expertise, front-end is the only skill we're missing.

We looked at some frameworks, Patternfly used by RedHat to name a few (https://www.patternfly.org/), but we just couldn't go down the rabbit hole to start maintaining yet another in-house project which nobody had a clue how to build.

Turns out frameworks like Streamlit or NiceGUI are too good until they are not, so this whole project to introduce the Service Catalog got paused for now.

We would definitely need a way to easily build front-ends without going the extensive *.js route, or a product that fulfills most of our requirements.

What is a similar story you've had on your shop?

https://redd.it/1d5knnk
@r_devops

Guidance needed

Hello everyone,
I am having diffulties in finding internship opportunities despite of having skills. What should I do? Or like how do you find... My skills include :


- Cloud Platforms: AWS
- CI/CD Tools: Jenkins, Azure DevOps, GitHub Actions
- Languages: Python, C++, C, Java, Bash, Yaml
- Operating Systems: Ubuntu, Arch, CentOS
- Version Control: Git
- Containerization: Docker, Kubernetes
- Infrastructure as Code (IAC): Terraform
- Configuration Management: Ansible

I think the tech stack I know is more than suffice for the going for an internship. I want to gain some enterprise level experience. Any help is appreciated.

https://redd.it/1d5male
@r_devops

should i become a software engineer or a devops engineer? which has more demand in the job market?

what the tittle says. should i become a software engineer or a devops engineer? which has more demand in the job market?

https://redd.it/1d5qx70
@r_devops

Cisco VPN/ any connect alternative for MacOS VPN self hosted in the cloud

What do you use as a self hosted VPN solution?

https://redd.it/1d5udwi
@r_devops

Which image format will give the best compression without any change in quality?

I'm working on a website that will allow photographers to share their work with each other. The goal is to convert the user-uploaded images into a format that does not alter the appearance, quality, or color of the image in any way.

In doing some testing, it seems that both the JPEG and WebP formats tend to shift colors.

If an image is uploaded in the sRGB color space, there should be a way to output a compressed image that's in sRGB, without any color shifting, since the gamut should be identical.

It may also be a matter of which library or which flags are used for the image compression.

We also want to avoid smoothing over any textures, or getting blocking or banding on gradients. I understand that these files will need to be larger than the typical social media compressed files, but that's OK.

Which format should I be looking at if the goal is first to avoid any loss in quality, and only then, to reduce the size as much as possible without affecting the output quality?


https://redd.it/1d5viw6
@r_devops

Talos Linux: You don't need an operating system, you only need Kubernetes

A recording of my speech from the TIC Conference has been published!

https://www.youtube.com/watch?v=9CIMTum9bTA

https://redd.it/1d5xv8n
@r_devops

SRE/DevOps with a focus on Big Data

For those who are a DevOps/SRE/Cloud Engineer with a focus on Big data what are some tools, technology and concepts you use and what are some things you must know?

https://redd.it/1d5zene
@r_devops

Automating and Detecting Kubernetes attacks (Kubesploit C2 and NeuVector)

I just created a video that shows how c2 agents can get into k8s and perform various attacks. I also demonstrated how runtime security tools can help detect them.

https://youtu.be/A6VBhSzOMZ8?si=9i\_OmAioLrr-sorp

https://redd.it/1d65h7u
@r_devops

Multitenant or server clone

I made food ordering app for one restaurant chain in my country.

Now more and more restaurants are contacting me that they want similar service.

Since functionality is pretty much the same, my first thought was multitenacy (same code different databases using Laravel tenancy package).

But then I started getting different feature request from all the restaurants(especially on frontend).

So then I was thinking that I could just clone the DO droplet, and made somekind of CI automation for backend and separate projects for frontend (if needed - basic changes like logo, color and font would be in settings). Not ideal, but less work I guess (at leastn in short term - might regret later :))

https://redd.it/1d67x57
@r_devops

Mail service only providers ?

Might not be the best sub to post, but also who else could know answer to this ? I'm migrating few (20 to 30) web services to own server cause these are non critical and can go off for a week no issues, so I can save on monthly hosting costs. This is not issue, web services easy... mail services on other hand...

Do you guys have experience with commercial email only hosting's (on budget) ? Where I can point MX (other DNS EMAIL related) records and have my mails hosted there ?

Don't get me wrong, I can create my own email server, but I would like to avoid the headache with management, and what I fear is to end on some spam list (my IP) despite me not sending spam (personal mails only ) ...

https://redd.it/1d69fe5
@r_devops

Burnout in DevOps.. How you deal with it? ... I dream to quit and work as a layman next to the beach.

8yr in SWE, 5yr in DevOps. Burnouts are real

Many people envy engineers and say that we have great work, we are paid well, our jobs are secure.. we are lucky ones.

First of all our jobs are far from secure, my colleagues are getting laid off on weekly basis and its not even US, its "stable and secure" EU.

We are paid well, this is common misconception, yeah people in Valley are paid well, even not everyone in US is paid well, in other places like EU or Canada engineers are slightly above average. Another thing if you are in another field "In most cases" you get your degree and then... you work.

We on another hand have to deal with never ending stack that keeps increasing, it was Servers, then virtualization, then docker swarm, then k8s, now k3s is picking up, knative is another thing, you have to know cloud, better know all 3 cuz companies might use all of them, startups on AWS want their code in CDK with Typescript, another one wants that in Python, other ones use CloudFormation, another place uses Ansible, company next door uses Terraform ... i can keep going for hours..

Sometimes I wish just to quit do some basic work.. I used to love this, but now its.. another day, another feature implemented, wow we implemented argo instead of deploying via pipeline, I mean who give a f#uck, I certainly don't. My grandfather was taking over Berlin on a fuckin Tank in '45, another one was a governor making people lives better, what I will say and remember? I once reduced cost and implemented spot instances, or I wrote really neat terraform module?..

https://redd.it/1d6hjb8
@r_devops

Final Update: Glad I didn't go pet dogs

This should be the final update. I got a lot of support and help realizing that where I worked wasn't the norm from this sub.

I was able to force through a lot of changes that, while they didn't solve the root of the issue, made things less unbearable. At least enough to keep me from rage quitting while I kept looking.

And now, after several months of looking, I found a new role. Fully remote. Working for a university. First engineer onboarded for standing up a new, really cool project. This means I get to actually build something from scratch with no technical debt from legacy systems and bureaucracies. I get more vacation/paid holidays. And I've already met some brilliant people that I would have otherwise never encountered.

I'm still serving my 2 weeks at the old job, but I've basically already handed everything off. Might just take half days until my last day. Been spending the rest of my time writing out the architecture diagrams of how I want to build my dream serverless environment. IAC, automations, and pipelines everywhere.

And now I can just get dogs for the house and pet them while getting paid. It all works out.

https://redd.it/1d6izy1
@r_devops

A junior in college, starting network engineering internship tomorrow but want to work in cloud . Asking about certifications for summer

So I start tomorrow morning as a network engineer intern for a small company,

Most of my degree has been your typical CS stuff but I took a bunch of electives and I’m hoping this internship continues to round out my knowledge base of all the fundamentals of CS .

They pay their engineers well imo (80-110k) , suburban Illinois . But I do believe I want to go into cloud in order to use the rest of my CS knowledge as well . Namely programming.

Would aws certification be wise or Cisco devnet considering I’m in a networking internship role .

The job typically wants their engineers to have CS degree plus ccna but unless things go very well I can’t see myself staying very long . I feel like networking engineering, at least the old school way, doesn’t take advantage of all my skills . I believe cloud will. So that’s where I’m coming from .

https://redd.it/1d6js0b
@r_devops

Looking for specific Udemy Courses or other good learning sources

Hello everyone,

I am leaving my current position and have the opportunity to get more into DevOps. I already have some experience with it on the Dev side of things and know how software shipment works too.

We are currently planing to migrate our TFS to Git and use GitHub Actions in the future.
Also we are using Azure as our Cloud Service and current Pipelines.

So what I need would be some good courses about Azure DevOps and Git/GitHub Actions. I am planning in the not so near future to get an Azure certificate too.

I would be the first full DevOps Engineer in the company, just for info and need all the help I can get.

Are there any recommendations that makes the switch for me easier? Any courses you would suggest?

Thanks!

https://redd.it/1d6igay
@r_devops

What must I study to work in the area of data?

So I'm 18 years old and Brazilian. I'm going to start college in a few months, that being said, what must I study? At some point, I want to work outside my country.


https://redd.it/1d6n73b
@r_devops

Encryption of terraform state using OpenTofu

OpenTofu is an opensource fork of terraform. It now from v1.7 allows client-side encryption of terraform state in remote backend.

Lets find out how we can encrypt terraform state, also how can we change and remove encryption key using OpenTofu in this article.

https://linuxshots.navratangupta.in/encryption-of-terraform-state-using-opentofu-04fd9dd2f562


https://redd.it/1d6xoo0
@r_devops

How to sell this?


I made a tech for real time design to production. Its a cool technique and scales to design a designer tool, designs a developer tool, and can design to usable softwares too.

I'm trying to do something new in my learning pattern, I have a rough thought of putting this in a demo page. The first version, with a minimal feature, will be put on sale.

The payment is to let customer's do over postal, I receive it. After confirming the payment, I'll courier instructions to build this tool, with instructions to build other tools as a written copy.

I'm not sure about where to share this product page with. could you tell me where to put and the price for it?

Link to the demo - https://www.youtube.com/watch?v=KHpf8h0JMuo

https://redd.it/1d6y562
@r_devops