Is it necessary to maintain a logical layer on top of your codebase?

## Background

Although Git is a widely used platform for version control and collaboration, it does not have the capability to analyze and interpret the logic of code.

Assuming my program now wants to know what is on line 35 of the extract_test.go file. If using GitLab, it is possible to find the corresponding text information, which may look like this:

func TestExtractString(t testing.T) {
fileResult, err := ExtractFromString(javaCodeForExtract, &ExtractConfig{
LangType: core.LangJava,
ExtractType: extractor.TypeExtractFunction,
})
if err != nil {
panic(err)
}
for _, each := range fileResult.Units {
core.Log.Debugf("result: %s", each.GetDesc())
}
}

However, my program does not know what this text represents. This is even more difficult for programs written in other languages (such as Java or Python).

Becides, there are many tools require extracting information from source code for their secondary development. They have to re-implement the extractor once and once again. It's a huge cost.

## What we do

As a member of the infra team, we have decided to add an additional layer of logic to the code repository, so that all third-party tools can access the logic in the code repository using our unified API, reducing their costs in compatibility and language parsing.

​

With our API, they can easily extract metadata of different languages from code files without the need for any additional parsers to be written.

{
"repo_id": "sibyl2",
"rev_hash": "e995ef44372a93394199ea837b1e2eed375a71a0",
"path": "extract_test.go",
"signature": "sibyl2||TestExtractString|testing.T|",
"tags": ,
"func": {
"name": "TestExtractString",
"receiver": "",
"namespace": "sibyl2",
"parameters":
{
"type": "*testing.T",
"name": "t"
}
,
"returns": null,
"span": {
"start": {
"row": {
"$numberLong": "34"
},
"column": {
"$numberLong": "0"
}
},
"end": {
"row": {
"$numberLong": "45"
},
"column": {
"$numberLong": "1"
}
}
},
"extras": {},
"lang": "GOLANG"
}
}

By using MongoDB, we have opened up the data we collect to our data warehouse, which makes it possible to analyze data at the warehouse level. Users can easily analyze the repository situation of a specific version, or even between versions, based on this.

## Discussion

We have already given a speech on QCON 2023 in Beijing, China.

It is indeed able to meet the needs of some Chinese teams and has received some praise. But I'm not sure if this is a suitable and universal solution.

Feel free to leave your comments :)

## Others

This is not strictly speaking a promotion, but if you're interested, this is our GitHub link.

https://github.com/opensibyl/sibyl2

Thanks!

https://redd.it/122f8wu
@r_devops

Is there a tool tracking releases of infrastructures/cncf projects?

Recently, as the product grows, more infrastructures are being added to existed tool stacks, since we are a very small team and right now most of the infrastructures' version are not synchronized, I was quite scared of missing out big updates, then I suggested my team start having "release reviews" each quarter to see what have been updated or deprecated and discuss on whether to upgrade.
I know that to start implementing such routine, we'll need to start tracking releases of tools and compare with current version in used, luckily ArgoCD supports sourcing from different repos right now, so I put all the infrastructure together with application sets and wrote a tiny script that basically runs like this.


1. project repo, name, category, current version in used and latest stable release are manually listed inside a google sheet document
2. script pulls from sheets and getting information either from github or artifact hub
3. if versions are newer or different, it will then be updated back to the sheet and a slack notification will be sent to the channel tracking releases

​

I was wondering if there's any tool that works similarly to this, or is this even a good idea, because I cannot find tools that work like this, so I thought maybe people don't have this type of problem?


As I wish to contribute to the open source community, lots of projects that I'm familiar with are beyond my technical level since I don't have many years of experience in coding, so I guess this is a good place to start.


What do you think? How would you tackle this problem?

https://redd.it/122g5zs
@r_devops

Kubernetes Operations Survey

Hello, y'all!

I’ve started a new Kubernetes operations survey. The goal is to better understand so-called "2nd day operations" with Kubernetes clusters e.g. upgrades, maintenances, disaster recovery, etc.

I've already posted it on r/kubernetes, but I want to collect as many responses as possible.

You can check the results of the previous year’s survey here.

P.S. Last year, some folks suggested that Google forms have flaws, which is true. However, I don’t collect your email - I don’t care about that. This is purely my personal initiative. Also, it looks like Google Forms is the only free tool that is good enough for both form creation and some basic graph building, as well as it’s easy to use. Yet, if you have any suggestions on what can replace it - I would be happy to check those alternatives!

https://redd.it/122jopm
@r_devops

Redirect Ingress GKE trafic to an external domain

Hello,

We do have few endpoints that are too critical to be handled by our monolith app (even if it is replicated in k8s). we thought we could outsource them to cloud run and redirect traffic depending on the path to cloud run or the backed carried by k8s. like this

​

apiVersion: networking.k8s.io/v1
kind: Ingress
spec:
defaultBackend:
service:
name: monolith
port:
number: 80
rules:
- http:
paths:
- backend:
REDIRECTTO: "HOSTNAMECLOUDURUN.a.run.app"
path: /serverless
pathType: ImplementationSpecific

Each ingress rule is expecting a "service" backend.

The issue is a cloud run hostname is not a service, but a domain like https://serverless-xxxxx.a.run.app/

I just need to forward a certain path in my ingress to the hostname of our cloud run.

PS: I can do that via GCP console and update the load balancer, but this doesn't seem a good idea as it will be overwritten by k8s

Best regards

https://redd.it/122kfd4
@r_devops

Is it inevitable every DevOps job is high stress, over-worked?

Admittedly, my current company has a shit-ton of technical debts, no processes and crap management.

But how much better can it get? I'm wondering if a career in a company that doesn't have it's own app (cloud work, modern sysadmin if you like) might be a better bet (lower paid but less stress). I mean, there's a reason why the average tenure in a DevOps position is barely 1.5 years.

https://redd.it/122pq29
@r_devops

Learning about cloud security?

How do you learn about cloud security?

Are there some blogs or YouTube channels that are particularly helpful?

I tried searching but found that there are a lot of channels for cyber security but none for cloud security.

By cloud security, I mean Docker, k8s best practices, how to store passwords in a docker container, common pitfalls, etc.

https://redd.it/122p71b
@r_devops

Is it true that if you don't have proper grip over programming language you can't be successful in devops?

Is it a misconception or is it true that you don't need to know programming language to be successful in devops

https://redd.it/122sf0i
@r_devops

How do you get the list of successful builds in the "CD/Deploy" job from the "CI/Build" job in Jenkins Declarative Pipeline?

I am planning to keep the build multi-branch pipeline separate from the deployment pipelines (one pipeline each for pre-prod and production environments).

I wanted to list all the successful builds of the "main" branch of the build multi-branch pipeline in the deployment jobs so that the "Deployer" can select one of them (latest build during a "normal" deployment and one of the previous builds in case of a rollback).

In particular, the build pipeline pushes a docker image to JFrog artifactory. I want to list the image tags of successful builds that can be deployed. Deployment is done by using `helm upgrade --install` which accepts image tag as one of the options.

I am unable to find any resource that tells how this can be achieved in declarative pipeline.

Any suggestion would be extremely helpful!

https://redd.it/122scro
@r_devops

DevOps Junior

Hello everyone, I recently got a job as a junior devops, I had never worked in IT before and I would like to know as a senior devops what is expected of me in a period of six months.

context about me 2 aws certifications solutions architect and sysops certifications and some projects related to terraform, aws and python.

https://redd.it/122rnrf
@r_devops

My evaluation of the Scaleway Cloud provider

A couple of years ago, I developed an app that helped me manage my conference submission workflow. Since then, I have been a happy user of the free Heroku plan. Last summer, Heroku’s owner, Salesforce, announced that it would stop the free plan in November 2022. I searched for a new hosting provider and found Scaleway. In this post, I’d like to explain my requirement, why I chose them, and my experience using them.

Read more

https://redd.it/122vfb0
@r_devops

Implementing gitflow in github

Hi,

I recently learned about the Gitflow branching model. Now I'm trying to implement it in a github repo.
There seems to be two common methods of using the default branch (let's call it main) in a simplified repo with two long-lived branches.

1. Using it as the development branch from which we push to a stable/release branch.
2. Using it as the stable/release branch and having a designated development branch.

Since Github suggests PRs to the default branch on push to other other branches, each of the above methods come with their own issue:

1. Pushing to feature/bug branches makes Gihub suggest PRs to main - that's what I want in this case, since main is my development branch. However, when I merge main --> stable a commit is created. Github will then suggest this commit to be merged back into main and I have an infinite loop.
2. main is my production branch so I only want to allow merging to it from the development branch. It's annoying having to manually change the target branch for every PR from feature/bug branches.

Are these knows problems and are there some good/best practice solutions to them?

From a google search it seems like it's not an option to turn off Github's PR suggestions. Is it possible to trigger them programmatically and choose the target branch?

I don't mind having some workflows to make it work but I do prefer to keep them as simple as possible. Would it be possible to create workflow like this pseudo-code?

on: push

env:

branch-name: ${{ github.ref_name }}

if startsWith(branch-name, (feature || bug))

suggest PR targeting dev

if startsWith(branch-name, (dev || hotfix))

suggest PR targeting main

https://redd.it/122zh2c
@r_devops

Will AI Replace DevOps Engineers? Exploring the Possibility

Is it possible for AI to take over the role of a DevOps engineer in the future? If so, what would be the potential impact on the job market and how can current DevOps engineers prepare for this shift?

https://redd.it/1231h2p
@r_devops

Can someone experienced expand on some bullets from a job description.

So I have been reading a lot of job descriptions and I recently transitioned into devops. One of my weak points is networking and I am trying to gain experience and knowledge in it. I see this bullet point a lot in job descriptions that I was hoping someone could really expand upon it and how I can get that knowledge.

Knowledge of networking concepts (TCP/IP, DNS, Load Balancers)
Proficient with using and debugging: networks, DNS, HTTP, TLS, load-balancing,

I have taken some Udemy courses on networking but it seems like such a hard subject to learn if I didn't take the courses in college. I just don't know how to get good at this. My job mainly has me doing pipelines, so all I really do is Docker/Teamcity/Ansible/Artifactory/Bash. How do I get better at the above? I want to accelerate my networking knowledge fast but I am not sure how.

https://redd.it/1233bfd
@r_devops

Is a round-robin load balancer robust enough?

I was wondering what else I can do to make the load balance effective.

https://redd.it/122yow9
@r_devops

Cloud management application - open to feature requests!

Hi devops! I have just published a new version of my cloud management application.

https://github.com/ahmedyarub/cloud\_companion\_public/releases/tag/v0.0.2-beta.1

It is buggy and alpha for sure but with team I'm dedicated to making this application the best cloud management and problem solver in the world!

I'm attempting to add new features according to my experience in systems architecture and dev-ops, but I would like to hear from you guys which features did you wish to you have in your cloud management GUI application which current tools like k9s do not provide? All the requests would turn into ticket and add to the roadmap :D

https://redd.it/123889p
@r_devops

Replicaset question

Hi. I created a replicaset (2 replicas) for one of our service in production and after that an issue comeup that there is a duplicate records that is happening to our app. Not sure here if there's any changed in code because I only handle infra and devops but they are suspecting that the reason is that I created a replicaset

I've read that replicaset should do a load balancing and not process the API call twice if I'm not mistaken. Does anyone experience this kind of issue?

https://redd.it/123cd3v
@r_devops

An uptime counter for my application? (ECS, AWS managed Grafana)

So I was thinking of monitoring the uptime of my application (a container in ECS). I figure the best way to do this is to monitor its Load Balancer - if its healthy, then I'm good to go, right? The actual app could be down during release windows, which is ok, but a healthy LB is what I'm really interested in. The thing is, I know very little about Grafana. How would you make this work? Have something basically increment the time and display it as long as a specific load balancer is healthy? ChatGPT is of no use, so I'm wondering if someone can point me to the right direction. Thanks!

https://redd.it/123dmim
@r_devops

Notifications, noise, channels

Devops often makes use of many services, who generate some volume of notification, towards the owners of such services and towards their users too. There seem to be an accepted best practice, to send automatic notifications to people's IM app, such as Slack or Teams. I see a lot of respected wikis showing how to do this, as if it were a good idea.

Now, I think it's a bad idea, but I feel very isolated. No one else seems to think it's a bad idea.

Why bad? Once someone's IM becomes more of a notification silo than an IM, they will treat it as such. When I get a notification and I'm busy with something, I ignore it. Half the time, it's just some service letting me know about some triviality. If that's someone trying to get my attention because something is on fire, then someone failed at some point. And I know who: whoever decided automatic notification should go to the IM.

Yes, they could have called. But sometimes, they couldn't. Like if the thing that's on fire requires their immediate attention, and all they could do before grabbing the extinctor is shoot a message to a team.

If this indeed is a problem, I suppose we'd see "notification apps". Some sort of RSS-feed type-thing where you could subscribe to some notification silo, and keep your IM for human-generated message.

But I don't see such apps, or recommendations to use such a system, so I think this must not be a problem, and that weed just makes me look suspicious. Is everyone looking at me?

Is anyone else seeing a problem here? What's your solution?

https://redd.it/123eobl
@r_devops

I want to switch from my Tech Support job to DevOps. How?

I have 7+ years of experience in Tech support management role and have been working with Windows, Active Directory environment.

I also have 1+ years of self-learning + internship experience in frontend development, HTML, CSS, Javascript, ReactJS.

I've realized that I want to transition to full-time DevOps now and build my career around it. What would be the best path to take. I am in a 9 to 5 job and also married. Quitting my job just for training for the next 3 months or so is not an option. I can do part-time though. Is there any way I can start as a Junior DevOps, even if the salary is low compared to my current role?

I am in Pakistan so the job prospect is really low in DevOps currently. It's a growing sector but will take time. How should I start? I've seen that there are quite a few remote work opportunities as well but most of them are explicit about the countries or timezones they are interested it.

How should I proceed?

https://redd.it/123cq7l
@r_devops

Permanent thread for open-source tool recommendations

Unlike the self promotion thread, which can be commercial, this one will be people looking for a tool either to use or to collaborate on and other people will join them or tell them this tool already exists.
The reasoning behind that is that people are always seeking if solutions exist before implementing them ourselves or creating a post for them each time. If there was a long thread I could search through to find what I need it would be easier, and would help me contribute to projects I believe in or depend on, or to suggest my solution to someone looking for one.

View Poll

https://redd.it/123ic8x
@r_devops

Devs with security clearances, are you still getting spammed by recruiters?

I know the market is bad right now, but on the defense side of things, it seems as though nothing's changed. I'm still getting spammed to death on LinkedIn and Indeed from recruiters. Those of you with a clearance, Is it the same where you're at?

https://redd.it/123ltd2
@r_devops