Manager blaming me for increased gcp costs

So just to get it straight this Ahole was handling most of the things for gcp by himself and never really handed me over the whole thing until he decided to go on a holiday. Before going didn't really communicate properly about the details, Inhad to work extra 3 hours with clients to get things up. After he came back didn't take any updates , and now when the bill is here he's blaming me . He told me to set budget capa for the staging and production environment but didn't even specify what was the dev environment as there were plenty of apps with the same name. And due to my bad luck there's a sudden increase in cost in this month itself due to some Api usage.
Am I the asshole here ??? Because if he's saying that we're taking care of DevOps , at least provide me with proper documentation about what you've already set. Or be clear with your words. To add to this my company doesn't work with GCP, and I've barely had any work to do with it.

https://redd.it/1igi74q
@r_devops

Doing my first DevOps certification

Hi everyone, just wanted to know your opinion on doing my first DevOps certification -

CKA

FYI,
I am currently working on an entry-level DevOps role, I do have significant experience in shell and currently I am working on the DevOps stack - Linux basic knowledge of commands (sufficient for DevOps purposes) , Terraform (basic resource provisioning and fundamentals), some kubectl commands ( k9s is awesome), ran some monitoring queries in Grafana, Jenkins (running some build stages in pipeline jobs)..

I do have a lot of supportive senior teammates constantly sharing their experience and letting me learn by doing.


I just wanna know like am I missing anything or should I do some other certifications first, or in general what's your experience with this certification, how you prepared etc.

https://redd.it/1igiaqp
@r_devops

Resources for deeply learning ELK stack ?


I want to setup spring boot logs centralization using ELK. This must be an easy task, but my dumb brain even after spending 20 hrs on this, can't figure out. Thus, I was wondering if anyone could provide some books to deeply learn ELK. PS: Do I need to know spring boot if I want to configure from the ground up?(I mean I will get the code from github but do I need to write spring boot myself). If so, please guide me towards resources to learn spring boot(youtube, udemy, books etc)

https://redd.it/1igjdmx
@r_devops

Upgrading Aurora serverless v1 to Aurora serverless v2

I am currently working to upgrade an Aurora serverless v1 instance to Aurora serverless v2 in aws rds. but the instructions int he documentation are so unclear. event he standard options for instances classes seems to be depricated fromt he console. can anyone helo me as to how should i go about it?



https://redd.it/1iginfy
@r_devops

How to easily manage and distribute our C/C++/Python/FPGA bricks internally without falling back to USB sticks? (Already have a local Gitlab instance on a Synology NAS)

Hello,

I work in a lab whose core business is not deployment.

I've set up a local Gitlab instancz on a Synology NAS. We deploy our code on it.

However, there are some CPP, C, Python and FPGA IPs bricks that we use a lot.

So I'm wondering how to manage them.

For example, I've developed a Python lib but deployed it on the Gitlab. I'd like to manage it as a module, so I've created a wheel of this lib and installed it with pip. But to do this I have to download and install it manually.

I'd like something simpler because I know my colleagues and if it gets too complicated they'll skip it and go back to usb sticks.

So how do I go about it? Install a local pip server? What about IPs? Ditto for cpp/c, compiled lib... They've taken over Gitlab, and I'm already super happy, but is clea good for libs and the like?

Synology is quite complicated I don't really like it I'd rather have a nuc or something like that to manage it but I need arguments to defend my project if you think it's necessary.

Thanks.

https://redd.it/1igmbbl
@r_devops

Looking for Cloud-Based GST Filing, E-Way Bill and E-Invoice Software (Source Code)

Hi all,

I'm looking for an India-based, cloud-based software (built with React preferred) that includes the following features:

* GST Filing
* E-Way Bill Generation
* E-Invoice Creation

If you have a source code like this, please DM me with a demo and your pricing.

Thanks!

https://redd.it/1igne5h
@r_devops

Run PR checks in github when PR is EDITED?

What is the best way to execute pull request checks in github for existing pull request when PR description is updated (no new commit has been made to PR)

https://redd.it/1ign3u4
@r_devops

What's your contracting rate?

I was approached to do some part-time contracting work on the side (high-level stuff like architecture) but I'm not sure what hourly rate to start the conversation at. I have about 4 years of experience in DevOps plus 3 years of software development before that. What's your rate?

https://redd.it/1igp4x8
@r_devops

Tired of boring Terraform outputs? Say “I am the danger” to dull pipelines with the Walter White Terraform provider

I was tired of my boring pipelines only telling me what resources I had deployed, so here's a way to inject some Heisenberg wisdom and keep things interesting:

Repo: https://github.com/The-Infra-Company/terraform-provider-breakingbad

https://redd.it/1igq08u
@r_devops

Funny/cute phrases I can tell the guy I’ve started dating

Hi everyone! I’ve recently started dating this guy, Devops engineer. He’s the sweetest and has a great sense of humour. He’s tried his best to explain to me what he does but I’m a bit useless with anything tech related (I work in education).

I was wondering if anyone knew of any funny/cute technical phrases I could tell him from time to time so that he would be caught off guard?

I’m looking for ways to tell him that I like him but with devops language basically :)

I know that may be a weird question but I would appreciate any help you can give me and thank you in advance!

https://redd.it/1igqnf8
@r_devops

Discussion: what are must-read books for DevOps engineer?

Hi guys,

I am looking into switching into devops field from fulltime web dev. And I m curios what are the most important and up-to-date books someone like me can read? Even if they're not directly connected to, but would be helpful in future.

Share you thoughts! Thanks!

https://redd.it/1igte2s
@r_devops

How do you handle log noise and event overload in high-volume environments?

Hey everyone, I’m curious about how you manage log overload in fast-growing infrastructures. Between low-priority warnings, duplicate events, and false positives, it can be tough to separate the noise from what actually matters.

Do you use filtering, deduplication, or automation to keep things manageable? What strategies or tools have helped you cut down log bloat while still catching critical alerts?

https://redd.it/1igt4p3
@r_devops

DevOps to Data Platforms

I'm looking for some advice on how to quickly get up to speed with a new job.

Previously I was working in a dotnet shop at a smaller company. I was managing Azure, Pipelines, WAFs, Networking, basically anything infrastructure related that wasn't inside the app itself. - typical "devs are bad at networking" kinda gig.

Now I'm at a bigger company, with a dispersed team, where our only job is to manage a data platform for data engineers. The problem is, I don't know the first thing about data. I've tried to search around but all the information I'm finding is mostly geared towards learning how to manage the data itself, not managing the platform. - I remember struggling with this at the dotnet shop but I had a LOT better support so the devs would interact with me and teach me what they were doing, so in turn I could help them bridge their gaps with infrastructure. That doesn't feel like a thing I can do at this new role, so I'm trying my best to cover my ass.


Any Advice? - I can google things as they come up, but I'd like to somewhat get ahead of the curve so I don't have to push off every question I'm asked.

https://redd.it/1igz14r
@r_devops

How to get started in dev ops? Certs?

I am going on 3 years experience in QA with both manual and mobile automation. It seems QA and front end development are very saturated. My friend/mentor says Dev ops is the next logical step from QA roles. Dev ops also seems less saturated. How do I get started? What certs should I get in automation or dev ops? Thoughts?

https://redd.it/1ih0i1c
@r_devops

How much DSA should I know for a DevOps or SRE role?

For real, I don’t know how much leetcode and DSA I need to master aside the tools of the DevOps trade to attend a technical interview for DevOps. Can someone help me?

https://redd.it/1ih2hhi
@r_devops

Devops/Infra/SRE/Platform Engineer Jobs

So I want to switch to a new job and was wondering other than LinkedIn what all have people used for looking for a job!

https://redd.it/1ih4jpa
@r_devops

Where do you get the latest devops news/updates?

Could be podcasts, blogs, etc

https://redd.it/1ih67d1
@r_devops

database consolidation

We have a lot of database servers. Generally one per app, and then the dev and stage instances have their own servers. Note, I'm talking servers, not databases.

We think this is too many but not sure what to do about it. I'm curious about people's philosophies here.

Large consolidated instances seem to be difficult to maintain and mean a lot of applications go down if one goes down. So I don't think we want to centralize to that degree.

One thing we've thought about is combining test/dev on the same servers. Not sure they really need their own.

We want to keep prod separate though.

But maybe someone smarter than me has thought about this. Curious what people are doing.

https://redd.it/1ih89ia
@r_devops

Help regarding the conversion from Aurora Serverless v1 to the provisioned instance.

I ma currently int he middle of updating my RDS serverless v1 to serverless v2, but in the official documentation there is a step which involves converting serverless v1 to a provisioned instance first, i cannot find any such option on the console directly, how do i go about?



https://redd.it/1ihasy0
@r_devops

What should I do?

Hey people i am a newbie to DevOps just starting out by looking at roadmap.sh and kodekloud courses. I have came across various posts on many different platforms that learning in public gets real attention and helps growing network, I do share my learnings on Linkedin and twitter ( for a long time now ) but can't see getting recognition. What else I should do i figure making short videos for instagram and youtube shorts might be good way to deliver content but dont know how to do all the stuff ( editing, recording, etc) can yall help me out ?

https://redd.it/1ihd1in
@r_devops

Need Help Integrating AWS ECS Cluster, Service & Task with LGTM Stack using Terraform

So I've been working on Integrating LGTM Stack into my current AWS Infrastructure Stack.

Let me first explain my current work I've done so far,

\######LGTM Infra :

\- Grafana = Using AWS Managed Grafana with Loki, Mimir and Tempo Data Source deployed using Terraform

\- Loki, Tempo and Mimir servers are hosted on EC2 using Docker Compose and using AWS S3 as Backend storage for all three.

\- To push my ECS Task Logs, Metrics and Traces, I've added Side-Cars with current Apps Task Definition which will run alongside with app container and push the data to Loki, Tempo and Mimir servers. For Logs I'm using __aws firelens__ log driver, for Metrics and Traces I'm using Grafana Alloy.

LGTM Server stack is running fine and all three data are being pushed to backend servers, now i'm facing issue with labeling like the metrics and traces are pushed to Mimir and Tempo backend servers but how will i identify from which Cluster, Service and Task i'm getting these Logs, Metrics and Traces.

For logs it was straight forward since i was using AWS Firelens log driver, the code was like this:

>log_configuration = {

>logDriver = "awsfirelens"

>options = {

>"Name" = "grafana-loki"

>"Url" = "${var.loki_endpoint}/loki/api/v1/push"

>"Labels" = "{job=\\"firelens\\"}"

>"RemoveKeys" = "ecs_task_definition,source,ecs_task_arn"

>"LabelKeys" = "container_id,container_name,ecs_cluster",

>"LineFormat" = "key_value"

>}

>}

as you can see in the below screenshots, ecs related details are getting populated on grafana,
: https://i.postimg.cc/HspwKRVW/loki.png

and for the same i was able to create dashboard as well with some basic filtering and search box,
: https://i.postimg.cc/tT36vNbV/loki-dashboard.png

Now comes the Metrics a.k.a Mimir part:

for this i used Grafana Alloy, and used below config.alloy config file:

>prometheus.exporter.unix "local_system" { }

>

>prometheus.scrape "scrape_metrics" {

>targets = prometheus.exporter.unix.local_system.targets

>forward_to = [prometheus.relabel.add_ecs_labels.receiver\]

>scrape_interval = "10s"

>}

>

>remote.http "ecs_metadata" {

>url = "ECS_METADATA_URI"

>}

>

>prometheus.relabel "add_ecs_labels" {

>rule {

>source_labels = ["__address__"\]

>target_label = "ecs_cluster_name"

>regex = "(.*)"

>replacement = "ECS_CLUSTER_NAME"

>}

>

>rule {

>source_labels = ["__address__"\]

>target_label = "ecs_service_name"

>regex = "(.*)"

>replacement = "ECS_SERVICE_NAME"

>}

>

>rule {

>source_labels = ["__address__"\]

>target_label = "ecs_container_name"

>regex = "(.*)"

>replacement = "ECS_CONTAINER_NAME"

>}

>

>forward_to = [prometheus.remote_write.metrics_service.receiver\]

>}

>

>prometheus.remote_write "metrics_service" {

>endpoint {

>url = "${local.mimir_endpoint}/api/v1/push"

>headers = {

>"X-Scope-OrgID" = "staging",

>}

>}

>}


I used AWS to create this config in Param store and added another app task side car which will load this config file, run a custom script which will fetch the ECS Cluster name from ECS_CONTAINER_METADATA_URI_V4 and passed Service Name and Container Name as ECS Task Definition Environment Variable.

so after all this, I was able to do the relabeling and populate the Cluster, Service and Task name on Mimir Data Source:

: https://i.postimg.cc/Gh8LchBX/mimir.png


Now when I was trying to use Node\_Exporter\_Full Grafana dashboard for the metrics, I was getting the metrics but for unix level filtering only,

: https://i.postimg.cc/Jn0wPPZp/mimir-dashboard-1.png

: