How do you get the list of successful builds in the "CD/Deploy" job from the "CI/Build" job in Jenkins Declarative Pipeline?

I am planning to keep the build multi-branch pipeline separate from the deployment pipelines (one pipeline each for pre-prod and production environments).

I wanted to list all the successful builds of the "main" branch of the build multi-branch pipeline in the deployment jobs so that the "Deployer" can select one of them (latest build during a "normal" deployment and one of the previous builds in case of a rollback).

In particular, the build pipeline pushes a docker image to JFrog artifactory. I want to list the image tags of successful builds that can be deployed. Deployment is done by using `helm upgrade --install` which accepts image tag as one of the options.

I am unable to find any resource that tells how this can be achieved in declarative pipeline.

Any suggestion would be extremely helpful!

https://redd.it/122scro
@r_devops

DevOps Junior

Hello everyone, I recently got a job as a junior devops, I had never worked in IT before and I would like to know as a senior devops what is expected of me in a period of six months.

context about me 2 aws certifications solutions architect and sysops certifications and some projects related to terraform, aws and python.

https://redd.it/122rnrf
@r_devops

My evaluation of the Scaleway Cloud provider

A couple of years ago, I developed an app that helped me manage my conference submission workflow. Since then, I have been a happy user of the free Heroku plan. Last summer, Heroku’s owner, Salesforce, announced that it would stop the free plan in November 2022. I searched for a new hosting provider and found Scaleway. In this post, I’d like to explain my requirement, why I chose them, and my experience using them.

Read more

https://redd.it/122vfb0
@r_devops

Implementing gitflow in github

Hi,

I recently learned about the Gitflow branching model. Now I'm trying to implement it in a github repo.
There seems to be two common methods of using the default branch (let's call it main) in a simplified repo with two long-lived branches.

1. Using it as the development branch from which we push to a stable/release branch.
2. Using it as the stable/release branch and having a designated development branch.

Since Github suggests PRs to the default branch on push to other other branches, each of the above methods come with their own issue:

1. Pushing to feature/bug branches makes Gihub suggest PRs to main - that's what I want in this case, since main is my development branch. However, when I merge main --> stable a commit is created. Github will then suggest this commit to be merged back into main and I have an infinite loop.
2. main is my production branch so I only want to allow merging to it from the development branch. It's annoying having to manually change the target branch for every PR from feature/bug branches.

Are these knows problems and are there some good/best practice solutions to them?

From a google search it seems like it's not an option to turn off Github's PR suggestions. Is it possible to trigger them programmatically and choose the target branch?

I don't mind having some workflows to make it work but I do prefer to keep them as simple as possible. Would it be possible to create workflow like this pseudo-code?

on: push

env:

branch-name: ${{ github.ref_name }}

if startsWith(branch-name, (feature || bug))

suggest PR targeting dev

if startsWith(branch-name, (dev || hotfix))

suggest PR targeting main

https://redd.it/122zh2c
@r_devops

Will AI Replace DevOps Engineers? Exploring the Possibility

Is it possible for AI to take over the role of a DevOps engineer in the future? If so, what would be the potential impact on the job market and how can current DevOps engineers prepare for this shift?

https://redd.it/1231h2p
@r_devops

Can someone experienced expand on some bullets from a job description.

So I have been reading a lot of job descriptions and I recently transitioned into devops. One of my weak points is networking and I am trying to gain experience and knowledge in it. I see this bullet point a lot in job descriptions that I was hoping someone could really expand upon it and how I can get that knowledge.

Knowledge of networking concepts (TCP/IP, DNS, Load Balancers)
Proficient with using and debugging: networks, DNS, HTTP, TLS, load-balancing,

I have taken some Udemy courses on networking but it seems like such a hard subject to learn if I didn't take the courses in college. I just don't know how to get good at this. My job mainly has me doing pipelines, so all I really do is Docker/Teamcity/Ansible/Artifactory/Bash. How do I get better at the above? I want to accelerate my networking knowledge fast but I am not sure how.

https://redd.it/1233bfd
@r_devops

Is a round-robin load balancer robust enough?

I was wondering what else I can do to make the load balance effective.

https://redd.it/122yow9
@r_devops

Cloud management application - open to feature requests!

Hi devops! I have just published a new version of my cloud management application.

https://github.com/ahmedyarub/cloud\_companion\_public/releases/tag/v0.0.2-beta.1

It is buggy and alpha for sure but with team I'm dedicated to making this application the best cloud management and problem solver in the world!

I'm attempting to add new features according to my experience in systems architecture and dev-ops, but I would like to hear from you guys which features did you wish to you have in your cloud management GUI application which current tools like k9s do not provide? All the requests would turn into ticket and add to the roadmap :D

https://redd.it/123889p
@r_devops

Replicaset question

Hi. I created a replicaset (2 replicas) for one of our service in production and after that an issue comeup that there is a duplicate records that is happening to our app. Not sure here if there's any changed in code because I only handle infra and devops but they are suspecting that the reason is that I created a replicaset

I've read that replicaset should do a load balancing and not process the API call twice if I'm not mistaken. Does anyone experience this kind of issue?

https://redd.it/123cd3v
@r_devops

An uptime counter for my application? (ECS, AWS managed Grafana)

So I was thinking of monitoring the uptime of my application (a container in ECS). I figure the best way to do this is to monitor its Load Balancer - if its healthy, then I'm good to go, right? The actual app could be down during release windows, which is ok, but a healthy LB is what I'm really interested in. The thing is, I know very little about Grafana. How would you make this work? Have something basically increment the time and display it as long as a specific load balancer is healthy? ChatGPT is of no use, so I'm wondering if someone can point me to the right direction. Thanks!

https://redd.it/123dmim
@r_devops

Notifications, noise, channels

Devops often makes use of many services, who generate some volume of notification, towards the owners of such services and towards their users too. There seem to be an accepted best practice, to send automatic notifications to people's IM app, such as Slack or Teams. I see a lot of respected wikis showing how to do this, as if it were a good idea.

Now, I think it's a bad idea, but I feel very isolated. No one else seems to think it's a bad idea.

Why bad? Once someone's IM becomes more of a notification silo than an IM, they will treat it as such. When I get a notification and I'm busy with something, I ignore it. Half the time, it's just some service letting me know about some triviality. If that's someone trying to get my attention because something is on fire, then someone failed at some point. And I know who: whoever decided automatic notification should go to the IM.

Yes, they could have called. But sometimes, they couldn't. Like if the thing that's on fire requires their immediate attention, and all they could do before grabbing the extinctor is shoot a message to a team.

If this indeed is a problem, I suppose we'd see "notification apps". Some sort of RSS-feed type-thing where you could subscribe to some notification silo, and keep your IM for human-generated message.

But I don't see such apps, or recommendations to use such a system, so I think this must not be a problem, and that weed just makes me look suspicious. Is everyone looking at me?

Is anyone else seeing a problem here? What's your solution?

https://redd.it/123eobl
@r_devops

I want to switch from my Tech Support job to DevOps. How?

I have 7+ years of experience in Tech support management role and have been working with Windows, Active Directory environment.

I also have 1+ years of self-learning + internship experience in frontend development, HTML, CSS, Javascript, ReactJS.

I've realized that I want to transition to full-time DevOps now and build my career around it. What would be the best path to take. I am in a 9 to 5 job and also married. Quitting my job just for training for the next 3 months or so is not an option. I can do part-time though. Is there any way I can start as a Junior DevOps, even if the salary is low compared to my current role?

I am in Pakistan so the job prospect is really low in DevOps currently. It's a growing sector but will take time. How should I start? I've seen that there are quite a few remote work opportunities as well but most of them are explicit about the countries or timezones they are interested it.

How should I proceed?

https://redd.it/123cq7l
@r_devops

Permanent thread for open-source tool recommendations

Unlike the self promotion thread, which can be commercial, this one will be people looking for a tool either to use or to collaborate on and other people will join them or tell them this tool already exists.
The reasoning behind that is that people are always seeking if solutions exist before implementing them ourselves or creating a post for them each time. If there was a long thread I could search through to find what I need it would be easier, and would help me contribute to projects I believe in or depend on, or to suggest my solution to someone looking for one.

View Poll

https://redd.it/123ic8x
@r_devops

Devs with security clearances, are you still getting spammed by recruiters?

I know the market is bad right now, but on the defense side of things, it seems as though nothing's changed. I'm still getting spammed to death on LinkedIn and Indeed from recruiters. Those of you with a clearance, Is it the same where you're at?

https://redd.it/123ltd2
@r_devops

Automated Deployment in Heroku

Have you ever setup any pipeline that automatically promotes to production in heroku? Did you do it via the Heroku API by coding the logic?

https://redd.it/123n64v
@r_devops

How do you protect against dangerous commands you run everyday?

We run commands to install, test or run some setup a lot and most times daily.

Some of these commands have security risks (malware), or sometimes you can accidentally run a command (typo) that is a security risk. Some commands make infrastructure changes that you need to pay attention to, or else it could all go wrong.

We all try to pay attention to things and take measures, but these things still happen, and sometimes, you don't even know the issues that can happen.

What do people do? What are the best practices? How do people solve this? Am I alone?

https://redd.it/122mb6j
@r_devops

How do you do release management across repositories?

Not sure if this is the right place to ask, but hopefully the people here have some experience with these types of concerns.

Our product has a rather complex multi-repository setup with a mix of open-source and closed-source components. Most of the open-source components are crates that we publish to Crates.io, though some are released as WASM bundles which we can just push as GitHub Releases. We have an open-source CLI as well as a hosted service that depend on these open-source components, but also a closed source API and web frontend that share dependencies, but which are deployed to our own servers.

As you can imagine, there's quite some overhead in release management for versioning these components and making sure that components are properly updated when one of their dependencies is updated. So how does your company deal with such complexities? What CI solutions are you making use of (we currently use GitHub Actions, but having workflow dependencies between repos is no fun...)? What does your release process look like? Thanks!

https://redd.it/123r9ah
@r_devops

Hikaru 1.0.0 released

Hikaru provides a variety of tooling to work with Kubernetes configs in Python, YAML, or JSON, allowing you to move smoothly between each of these representations, and can also use the Python representation to directly interact with Kubernetes. Hikaru helps you migrate from YAML, easily create watches, detect changes in configuration, create CRDs and their controllers, and more. You can find out more Hikaru here at the PyPI page:

[https://pypi.org/project/hikaru/](https://pypi.org/project/hikaru/)

...at the Github repo: [https://github.com/haxsaw/hikaru](https://github.com/haxsaw/hikaru)

...or read the full doc at ReadTheDocs:

[https://hikaru.readthedocs.io/en/latest/index.html](https://hikaru.readthedocs.io/en/latest/index.html)

Hikaru 1.0.0 adds support for custom resource definitions. Hikaru now supports:

* The ability to define the structure of a CRD with Hikaru classes, either from scratch or to mimic one that is already in your environment,
* Sending the defintition into Kubernetes where it will be established as a CRD managed by K8s,
* Managing instances of the new CRD using CRUD methods,
* Establishing Watchers on the new CRD to in order to monitor activity or create controllers in Python, and
* The use of CRD classes as context managers, just like other Hikaru document classes.

This all works smoothly with the existing Hikaru features. Full documentation for these new features can be found in the "Advanced Topics" section of the Hikaru docs. This release still contains support for the same set of Kubernetes releases, 23.x through 26.x.

https://redd.it/123stdi
@r_devops

How To Foster a Self Help Eng Culture

TLDR: I guess my question is, what’s the best way to ask people how they’ve helped themselves so we can help them better without sounding like a total a-hole? Is the role of this team to be CX for eng teams? Seems like we’re overpaid for that.



I’ve been working as a “DevOps” / Cloud Infra Engineer full time for about 10 weeks, and part time (while straddling QA Management) for about a year and a half. I love this world.

That said, I’ve noticed a clear pattern of attitude and behaviors at my org since I’ve been able to focus full time on the role:

1. Engineers generally do not seem to want to take the initiative to understand how their applications work beyond the code they write.

2. As a result of number 1, they escalate every little question straight to our team as if we’re Tier 1 support. Worse, if they don’t get an immediate response, they communicate that we are “blockers” for their projects to senior management.

I imagine that I’ll get a lot of responses like, “Welcome to the world…”, but I have a hard time just accepting this is the status quo.

My team has been getting dumped on politically for being considered blockers while working hard to KLO and ensure that all the eng teams are able to maintain productivity at the sacrifice of our own roadmap, which has just led us to get dumped on more. Our intake and project boards were identical and exactly like the other eng teams and it seemed to me that the way were being measured is inadequate to show where our time and efforts are going.

I setup a Kanban board to track requests, their types (eg, support, questions, deployments, incidents, etc etc etc), and it became clear via the data that we’re being inundated by questions that could easily be answered if the devs just cared to look at the org docs or just investigate a little. In light of that, I created a process doc to encourage people to check if their questions have already been answered in the docs prior to submitting a request and / or where to look for common asks. At the end of the day, though, I don’t know much about this world - I do know a lot about defining process and process boundaries and leaning on that to make change.

https://redd.it/123rmr5
@r_devops

Best practices for database history collection

Sorry for the weird title, I can't think of a better way of phrasing it.

We have a problem that a set of rows in a table inside a mysql database went missing a couple months ago and we only have weekly backups of data past 35 days so cant really narrow down the period of time it occurred and the state just before the rows were deleted.

We have no generic log aggregation for our database, we only have error logs and slowquery logs setup.

My intended approach is to setup general logs for the database and push these to our centralised logging solution. This enables us to trace all commands that could have affected the missing rows, find the culprit, prevent future occurrances, etc.

Is this the best course of action here, or are there other things we can do to monitor and trace data in specific tables within our database(s)?

https://redd.it/123qwje
@r_devops

Looking for feedback on a faster, open-source alternative to Backstage

If you are looking to improve developer productivity and identify with any of these, I'd love to talk to you about what we're working on! Please comment on here or DM me!
\- Looking for an faster, open-source alternative to Backstage
\- Struggling with cloud sprawl and organizing resources
\- Building a custom ops console or eng dashboard
\- Looking to automate daily workflows of information retrieval and cloud operations
\- Just hate using the AWS console

https://redd.it/123x9t7
@r_devops