Save on AWS by deleting untagged ECR images

Learn how unused/untagged ECR images can rack up your AWS bill unnecessarily and how to get rid of them

https://iasql.com/blog/ecr-save/

https://redd.it/1198ako
@r_devops

Do you have self-managed DBs (on a VM instead of a paid service) and which team does manage them?

Hey there,

in my current company I am part of the team who manages a few huger monolithic databases in addition to a few for microservices.

The bigger ones are around 3 proxies, 1 main, around 8 replicas each.

My question is:

If you do use self-hosted DBs, are you having a team of classical DBAs for this or more a team of infrastructure engineers which should also be able to code and write interfaces for teams to access for example dev DBs?

https://redd.it/119awnt
@r_devops

Noob Directories Question

So we have one resource that is formatted like this,

%w(dir1 dir2 dir3 dir4).each do |directory|
directory "#{node'foo''bar'}/#{directory}" do
owner cookbookowner
group cookbookowner
mode 0777
action :create
end
end


I know this is looping through and creating directories dir1, dir2, dir3, and dir4. However, I noticed that when I inspect these directories in the test instance, some of the directories have files in them? I can't seem to find any resources that creates the aforementioned files in certain directories so how do these files exist? Shouldn't they be all empty directories

https://redd.it/119bl5k
@r_devops

Boss left and now I need to clean up his mess. Looking for advice/venting.

Work on a 3-person DevOps team at a 100+ adtech firm.


My boss, the 4th one on the team who had hired us, abruptly left last week - circumstances still aren’t clear as to why.


Was a super cool dude who mostly kept us away from a lot of outside asks as they all ran through him.


We have \~30 developers we’re supporting over a couple of time zones so I was actually pretty happy he took so much pride in being a filter.


Over the last couple of days, it’s pretty clear that he was running the entire devops department out of his head.


There’s no SOPs, helpdocs or resources my team or devs can go to - at least without searching through mountains of emails and Slack messages.


The other two team members are going to be working on support while I build out everything thats been missing over the next month.


It’s my first time taking tribal knowledge and putting it together outside of something like Google Docs/Sheets.


Looking for any advice on the best ways to go about it. Sorry for the vent.

https://redd.it/119eubv
@r_devops

This Week's DevOps Newsletter: AWS Security, Kubernetes Dashboards, and Open-Source Projects

Hi there,

I have a lot of exciting topics to cover in this week's DevOps newsletter, including:

AWS Security: A comprehensive guide on how to secure your AWS environment using AWS security best practices and gain a comprehensive understanding of AWS security services.
Kubernetes Dashboards: The rise of Serverless monoliths and the best practices for running Java apps on Kubernetes. Additionally, I'm sharing an architecture for enforcing RBAC in a cloud storage system and an open-source utility that scans live Kubernetes clusters and reports potential issues with deployed resources and configurations.
Hashicorp Certified Terraform Associate: For those interested in Terraform, I have a preparation guide for becoming a Hashicorp Certified Terraform Associate.
Open-Source Projects of the Week: Check out a ChatGPT-powered gym workout generator and a CLI that creates screenshots based on terminal command output. I also explore why open-source is broken and uncover the truth about git metrics tools.

If any of these topics interest you, you can read the full issue here: https://www.devopsbulletin.com/issues/aws-security-pillar

Cheers

https://redd.it/119exbp
@r_devops

How to achieve synchronized deployment of Frontend and Backend applications to PRD?

Hello,I'm new to web apps and trying to deploy one to production which consists of:

1. React App on Frontend (deployed on AWS S3 + Cloudfront)
2. Python (Flask) AWS Lambda + API Gateway on the backend (deployed using AWS SAM)

Both FE and BE have separate repositories. After testing the latest versions of FE and BE on staging env, I want to deploy to production without any downtime.

When deploying FE_V0 -> FE_V1 it may happen that BE_V0 is not updated to BE_V1 and vice-versa. During this time FE_V1 will have an incompatible BE and will not function. It may also happen that FE_V1 is successfully deployed but BE_V1 deployment fails and will result in a longer downtime.

What strategy and services do you employ for the synchronized deployment of FE and BE apps? The ideal situation will be to:

1. Deploy FE_V1 and BE_V1, while FE_V0 and BE_V0 are still active.
2. Switch the customer-facing application to (FE_V1 + BE_V1) together or redirect the traffic incrementally from V0 to V1 combination.

Thanks for your input.

https://redd.it/1194gof
@r_devops

No longer using GitLab?

Looking to hear from folks who are no longer using GitLab. Trying to understand why they stopped using the product and who they’re using now instead?

https://redd.it/119jhj6
@r_devops

Aliasing kubectl with "kc"

Who else has done this and what other aliases do you use? Typing the full "kubectl" is a bit annoying.

https://redd.it/119ln0e
@r_devops

Alternative path to the Devops roadmap on roadmap. sh

I’m have been reading various articles in this subreddit and since realized that the roadmap.sh roadmap is frowned upon. To be honest I have been using it as a guide to prepare myself for a Devops/SRE role.

My question is what is a good roadmap to follow. The way my mind works is that i need to have a clear path laid out of the tools I need to learn so I don’t go off on many tangents. What I have learnt/know so far include:

Linux,
Bash,
Ansible,
Python,
A little Golang,
Networking,
Version control - Git,
Docker


I appreciate any advice in advance.

https://redd.it/119mhdt
@r_devops

How do you check what might be overriding elements in the DOM on production?

I have a bunch of favicons exporting files from the src directory, but on production the link elements points to a cdn on cloudfront, and I don't see any webpack config doing this. What might be doing this, and what should I look for in the browser, network requests or elsewhere?

https://redd.it/119njix
@r_devops

Our Enterprise DevOps Dispatch is online!

Our weekly dispatch is online. Sign up if you don't want to miss one: https://techaccelerationandresilience.com/short-notes/dispatch-0823

#devops #sre #platformengineering #dispatch #newsletter #techstrategy

https://redd.it/119amr5
@r_devops

Would you ever want web or full stack developers to partially manage their own traffic?

I’m more on the business side of tech but hear these horror stories from SRE’s and technical leaders about getting calls in the middle of the night from a foreign client about a downed service.

Would it be feasible or desirable for non-specialist developers to monitor/route their own traffic, so they can be on call sometimes, or not?

https://redd.it/119qp1q
@r_devops

FinOps Certification

Do you think it's relevant and worth it? Specifically, this one: https://learn.finops.org/finops-certified-practitioner-certification-exam

Besides cloud providers, what other certifications would you recommend? They can be worth it due to knowledge value, CV value, etc..

https://redd.it/119rl8q
@r_devops

"We're all gonna die (if not careful)": A popular ML researcher

https://www.legoscript.com/we-will-die-if-not-careful

https://redd.it/119sc0x
@r_devops

How do you maintain development environments?

Do your devs use their own docker-compose files or something else?

Maybe a cluster with separate namespaces for dev environments + resource quotas?

I'm creating Ergomake, which sets up preview environments from a docker-compose file, and I want to work on creating dev environments as well.

Many users can't run dev environments on their machines, and I'd like to fix that, but I need more input on current practices and whether this is actually a problem for you currently.

https://redd.it/119t3h1
@r_devops

Is it possible to learn devops by yourself?

hello everyone, I'm a python developer, I want to try myself as a devops. Is it possible to learn everything by yourself? For example, a developer makes his projects by the type of scripts, sites (if you are a web developer), bots, etc., can devops do the same? advise the best resources where you can learn something, where to practice for a young devops? Tell your stories on the path to becoming a devops

https://redd.it/119u16m
@r_devops

Drift management in cloud infrastructure

I've published a blog post about IaC drift detection and management

https://www.tailwarden.com/blog/infrastructure-drift-management

Looking forward for your feedback :)

https://redd.it/119ss6p
@r_devops

Why I think that most people prefer GKE to EKS and why this is important for the future of DevOps

Most people who have used GKE and EKS prefer GKE

Don’t take my word for it; take a look at the **consensus**.

GKE is not better because it has more features or spins nodes faster. It is preferable because the user experience is far superior; It is easier to use and better integrated with the rest of the platform; in other words, it’s better designed.

This has been my experience with GCP in general. It’s not that GCP is technically superior or offers more than AWS; it’s just so much easier and intuitive to use, to the point that I stopped taking AWS jobs altogether.

For infrastructure engineers with a long experience working with AWS, this may not be an issue because they can dedicate thousands of hours to familiarize themselves with it and leverage automation, but for developers who need to do infrastructure tasks, using AWS can be an extremely daunting and harrowing experience. This has the undesired effect of slowing down the pace of development and impairing innovation by overloading developers with tasks they shouldn’t be worrying about.

Platform Engineering aims to deliver self-service that hinges on Developer Experience (DX) by abstracting away infrastructure complexities with Internal Developer Platforms. I predict that the future of DevOps will have a heavier focus on DX, with tools and platforms that will enable delivering self-service and standardization by design, greatly mitigating cognitive load.

The cloud platforms underneath may not be any less complex because flexibility will always be needed, but the tools that enable platform engineers to provide self-service via a well-designed Internal Developer Platform will reign in the DevOps landscape.

What do you think?

https://redd.it/119sy27
@r_devops

Needed some ci cd advice / pipelines



Hey All,

Just had a question and needed some views on this, new devops guy and no one internally to learn from.

My question is around pipelines and tasks.

The environment i have come into has a pipeline running that builds the app and then saves it in a aws ecr.

my question is around the next steps, i want to automate the docker build on a machine, do i go to the machine and do that, or is it best practie to create another pipeline for the other tasks in your workflow.

im not actually sure how that bit works. if anyone could help i'd appreciate it.

https://redd.it/118u12b
@r_devops

What's your favorite developer community?

What's your favorite community as a developer/SRE/DevOps Engineer and what's the value you get from it?

I'm working on building a developer community and I would like to make sure that I avoid all the fluff and actually provide information/assets people care about.

https://redd.it/118xpss
@r_devops

Used to work at another company and their Confluence page was highly customizable - new Confluence seems more restrictive and way too much whitespace, making it inefficient for longer documentation. What happened?

as the title says.

The Confluence is so bad. I can't even vertical align center text in a table.

I use SphinxDocs for internal documentation but we're still looking for something a bit more accessible.

Am I missing something?

https://redd.it/11a01b0
@r_devops