Exploring GCP offer to migrate from AWS

As the title suggests, after discussions with GCP we've been offered a chunk of credits & they will also cover the bill of their consulting partner to do the migration over 4 months.. but rather than a lift and shift they will do all the platform modernisations we've had lined up in our roadmap and resolve our tech debt with infra, IaC, monitoring, CICD etc.. I did take this to AWS and they've said they can't pay someone to be hands on, we'd have to pay for advice on guidance on how to reach our cost efficiency and platform efficiency goals, we don't lack the technical knowhow it's more a lack of resource alongside our regular BAU and project work to prioritise modernising the platform


I guess my main concern is anything I might've missed when doing due diligence? I can't see anything that AWS necessarliy has that GCP doesn't ofc there is stuff like SES but we don't use that anyway & we already use BigQuery in GCP.. just hoping to hear from unbiased views hence me asking AWS vs GCP in here rather than one of the dedicated communities.. I know K8s would be a benefit of GCP but we only use ECS at the minute, K8 would be overkill, so we will be using Cloud Run in GCP

https://redd.it/1efsknb
@r_devops

Winget Validate Issue

Hi all, I'm looking out for helpful solutions I can try for fixing my problem.
Actually, I'm trying to add a CLI tool into the winget-pkg repository so that it can be used by every windows user from the terminal itself.
I already have structured my manifest the way it is supposed to be, as provided in the official Microsoft Winget Manifest Schema. (Installer.yaml + Version.yaml + defaultLocal.yaml)
However, whenever I try to run - "winget validate ." to validate all the yaml files in my manifest folder from CMD, it gives me the following error (1):

Manifest validation failed.

C:\\__w\\1\\s\\external\\pkg\\src\\AppInstallerSharedLib\\Yaml.cpp(252)\\WindowsPackageManager.dll!00007FFA9F3ED5CF: (caller: 00007FFA9F42F23B) Exception(1) tid(5900) 8A150022

And when I try to validate single files like- "winget validate Version.yaml" or "winget validate defaultLocale.yaml" it gives me the error (2):

Manifest validation failed.

Manifest Error: The multi file manifest is incomplete. A multi file manifest must contain at least version, installer and defaultLocale manifest. File: version.yaml

error(3) for defaultLocale.yaml:
Manifest validation failed.

Manifest Error: The multi file manifest is incomplete. A multi file manifest must contain at least version, installer and defaultLocale manifest. File: defaultLocale.yaml


1.

Note that when I run "winget validate installer.yaml" I get the error (1):

Manifest validation failed.

C:\\__w\\1\\s\\external\\pkg\\src\\AppInstallerSharedLib\\Yaml.cpp(252)\\WindowsPackageManager.dll!00007FFA9F3ED5CF: (caller: 00007FFA9F42F23B) Exception(1) tid(5900) 8A150022


2.

My CLI tool is a .exe file. And I have already added it to the Github Releases. Along with that, I have changed the InstallerURL to that release aswell.

Thank you for reading all that out :)

https://redd.it/1eftput
@r_devops

Should I lie about having Azure experience?

Hello, currently have about 5YOE working with AWS as a Cloud/DevOps engineer and got laid off a while back. I've taken a fair bit of time to get my head into Azure and completed AZ-104 and also AZ-305. Currently where I am based the market for AWS engineers is quite poor and there is a significant demand for Azure engineers.

I am beyond positive that I could perform well and interview well in an Azure role with the knowledge I have, but not recruiter/HR person will put me through as a candidate as I have less than a year of Azure experience.

Nobody really bothers with reference checks so I am considering just saying I worked with Azure instead of AWS at my last 2 jobs so that I can get my foot in an interview. Good idea or bad?

https://redd.it/1efw7io
@r_devops

Resume got selected twice but no interview scheduled within 2 months

I have this incident yesterday, I really wanted to join this company and my resume got selected twice but after the initial HR interview (where we exchange why you wanna join, tell me about yourself, and this is what company do....bla bla bla), but every time this HR...after taking this interview says "Unfortunately we will not be able to move with your profile".


I don't understand then why they selected me every time and...after initial call they say NO.

https://redd.it/1efs60z
@r_devops

GPU-Accelerated Containers for Deep Learning

A technical overview on how to set up GPU-accelerated Docker containers with NVIDIA GPUs. The guide covers essential requirements and explores two approaches: using pre-built CUDA wheels for Python frameworks and creating comprehensive CUDA development environments with PyTorch built from source:
https://martynassubonis.substack.com/p/gpu-accelerated-containers-for-deep

https://redd.it/1efyrza
@r_devops

Entering the Coding Industry

Hello everyone,

I'm looking for some advice on entering the coding industry. I was hoping to reach out to professionals with advice and experience, all else I've found have been ads trying to sell me bootcamps or courses. If there's anyone out there who's willing to let me pick their brain and get their perspective I would greatly appreciate it.

To put it into perspective I'm a 29 YO with no prior professional coding experience, I've dabbled with python and html but I'm really interested in seeing if I might be able to change my career path and do something with code. I've heard that front end work has the lowest wall of entry, so I've been looking there but I'm open to all disciplines. I just want to know if it's a smart move to dedicate the proper time to learn the work and the industry. The following are some questions I have if any of you fine gals or guys would grace me with your experience and advice.

(1) Is front end coding really a good niche to work toward as a beginner?

(2) Is there any validity to these coding bootcamps as it pertains to the education required to land a job?

(3) What is the consensus as far as AI, is it a realistic threat to the job market in the upcoming decade?

(4) How challenging is it to land a full time position, is it as simple as bootcamps make it sound or is it very competitive?

(5) can anyone with prior experience vouch for a career change into this industry as a realistic goal?

(6) What level of mastery or understanding does it take to do the work professionally, and how much time should be taken to skill up to that level?

Again I sincerely appreciate any feedback you guys have. I just want a realistic picture of what it takes, and what the opportunities and possibilities actually looks like.




https://redd.it/1eg2of9
@r_devops

Switching to Devops after 15 years as a Nurse

A co-worker of mine switched careers from 15 years as a nurse to being a devops engineer for a large restaurant chain. What tips would you give to someone moving into this field?

https://redd.it/1eg4uoh
@r_devops

Eyes on glass during deploys?

When you/your teams deploy, are you/they watching logs and metrics in real time, or relying on good alerting to catch issues introduced by the deploy?

https://redd.it/1eg790s
@r_devops

Any AI tools for generating AWS boto scripts?

Wondering if there are any codegen tools that can generate AWS boto scripts for your env? I've tried ChatGPT and Claude but code quality is not great, and they don't have the context of your env.

https://redd.it/1eg9eeh
@r_devops

Best way to see areas of improvements in an infrastructure?

I just run static analysis tools on my docker and other infra files. Is there anything else I can do?

https://redd.it/1ega2v2
@r_devops

Top Code Review Tools in 2024 - Comparison

The article explores the importance of code reviews in software development, outlines the advantages of conducting code reviews, such as early bug detection, compliance with coding standards, and improved team communication as well as introduces top code review tools for 2024: [Code Review Tools For 2024 - Guide](https://www.codium.ai/blog/9-best-code-review-tools-for-2024/)

* PR-Agent
* GitHub
* Bitbucket
* Collaborator
* Crucible
* JetBrains Space
* Gerrit
* GitLab
* RhodeCode

https://redd.it/1egfssl
@r_devops

Need help with datadog integration

I am pretty new to datadog and currently developing integration for my clients, I need to use persistent cache for one of the feature, but I want it so that it stays consistent even if I make some changes in to my customcheckvalue.yaml. Is there a way to do so or any alternative to save things on locally so that it stays stored even after system or data dog restarts or upgrades or rebuilds?

What is currently happening is cache value that I stored and then trying to read are changing just on basis of interval change in customcheckvalue.yaml

https://redd.it/1eggzja
@r_devops

Certified GitOps Associate (CGOA) Materials

Hi everyone,

I'm currently preparing for the Certified GitOps Associate (CGOA) certification and I'm having trouble finding study materials. I've checked platforms like Udemy, but I haven't found any relevant courses. Can anyone recommend some resources, books, or courses that would help me prepare for this certification? Any guidance on where to start would be greatly appreciated.
https://training.linuxfoundation.org/certification/certified-gitops-associate-cgoa/

Thank you!

https://redd.it/1eghn83
@r_devops

Disruption Ahead: AWS Quietly Axing Services, including Cloud9, SimpleDB, CodeCommit and more.

It started a couple of days ago with users reporting services being blocked, or warning banners.

There was no official announcement, but according to Jeff Barr's reply on X (Twitter), he listed S3 Select, CloudSearch, Cloud9, SimpleDB, Forecast, Data Pipeline, and CodeCommit.

Though it may not be the only services.

https://horovits.medium.com/disruption-ahead-aws-quietly-axing-services-033e7518eefb

https://redd.it/1egi010
@r_devops

Moving from FE to DevOps

Has anyone successfully made the switch?

Can you share what you did /studied.

I've got my azure fundamentals 900 booked.

I've worked in Microsoft dynamics 365 and powerapps for 2 years.

Obvious crossover skills from power shell, CMD and git.

How did you find the move?

https://redd.it/1egi8ni
@r_devops

Help me convince my manager to buy me a backend course

Hello everyone,

I am currently a DevOps and Cloud Engineer, primarily working with Terraform, K8s, AWS/Azure. My role also involves coding in Bash and Python to automate tasks, develop new tools and scripts, and interact with cloud providers' SDKs, among other things.

My interest in backend development is growing, although I am not looking to transition into a SWE role at the moment. My goal is to broaden my skill set to become more versatile and excel in my current position. Additionally, I am keen on learning Golang to enhance existing tools or develop new ones.

I am considering this course because it appears comprehensive, and I aim to use this opportunity to strengthen my foundational knowledge in development (DSA, OOP, FP, SQL). What are your thoughts on it? As I mentioned earlier, my primary focus is on K8s, Terraform, and cloud architecture, and while I do engage in coding, it differs from backend development. Could you suggest some arguments that might persuade my manager to sponsor this training for me?

https://redd.it/1egjdz7
@r_devops

Non-ephemeral CI runners

Wondering if anyone else has had experience with the approach of having a CI runner provide an environment that’s not pristine on every run.

I’ve seen this with Jenkins at a previous org and currently with self-host GitHub actions runners.

Usual arguments are things like:
- we run on bare metal for extra performance, spinning up a new VM/container just slows things down
- persistence between jobs is good because caches are hot and shared without needing to upload/download to an object store
- we only run trusted jobs so security issues are not so glaring

Issues frequently encountered:
- orphan processes or containers in the host eventually consuming all memory/disk after days/weeks
- tools which store their config in $HOME get configured by one job and give surprising results in another
- general shared resource collision, e.g. docker container with that name already exists because another job is currently running on the same host

Any other experiences or points you’d add? I’m trying to make a case that the cons outweigh the pros here, but the team running the CI agents don’t seem phased by the repeated incidents/outages/flakiness or have the bandwidth to change things.

https://redd.it/1egimwd
@r_devops

How do I build a useful Grafana dashboard for our devs?

I'm trying to design Grafana dashboards and I want them to be meaningful and useful to any dev who would open them.

Most of our alerts are for unusual error rates and resource consumption so I'll try to focus on those:

- If an app produces unusual amounts of errors over a certain amount of time, the link we add to our Slack messages are usually just logs for that app with a window of the last X minutes.

- For resource consumption, since we're deploying everything in K8s, we just add a link to a generic Grafana dashboard that shows resource usage/limit of said app that alerted.

The links are already filtered by the app/container name, namespace, cluster (stg/cand/prod) and a relevant time window.

At first I thought that would be enough but lately I found out that devs don't even open those links. They might only open the dashboard that shows logs, but I heard some devs get lost in the "wall of text" of those logs.

Are there good examples of what data you usually show in your Grafana dashboards? Any tips are welcome.

https://redd.it/1eglat1
@r_devops

Pipelight - Clean this git-hooks mess!!

You may do sport, eat vegetables, get a good amount of sleep time and even have a colon cleanse once in a while with your extra bucket.
But let me tell you. Hygene is not about beeing clean!
It is about having clean!
Having clean git-hook logic and manageable files!

Fortunately nowadays, you can manage your git-hooks with toml, yaml, hcl and javascript.

Add a config file to your repo.

[[pipelines]]
name = "test"

[[pipelines.steps]]
name = "build"
commands = ["pnpm install", "pnpm build"]

[[pipelines.triggers]]
branches = ["master","dev"]
actions= ["pre-push", "pre-commit"]

Enable git-hooks

pipelight init

Troubleshoot with verbose and colorful logs

pipelight logs -vvvv

Darn this feels great! I like to tinker with bash and python to set up my hooks but sometimes, having such an easy way to just get up and running really makes me... clean!

Written in Rust
13kb binary
GPLv2

https://github.com/pipelight/pipelight

https://redd.it/1eghzhi
@r_devops

AWS WAF for external domain

Has anyone used WAF for an external domain?
My current company hosts the majority of their application in Aptible.

Currently in a planning process to migrate more things to AWS down the road but not soon enough.

Looking to implement WAF/ALB but the domain is external and handled through Aptible. Would it be best to have a lambda as the TargetGroup or is there a better way to handle this?

https://redd.it/1egq0wd
@r_devops

Help with AWS

Hi everyone

I wanted to start learning more about AWS, since the only thing I've been working on has been on Route 53, a lil bit of IAM, EKS and Beanstalk

What would you say it is the most important things on AWS to learn as a DevOps?

Thank you!

https://redd.it/1egprz0
@r_devops