Any good CI:CD tools specifically for supporting Docker pipelines?

Wondering does something like this exist:

-> Self-hostable

-> Open-source

-> NOT Docker (the pipeline manager and server itself!) but:

-> Capable of deploying and managing containers running on Docker

Use-case:

Deploying Docker-based open-source software between a staging and production environments, both of which (of course) have Docker.

Things like Portainer are fantastic but ... aren't pipeline managers, of course. Looking for the extra component.

https://redd.it/1ciobx0
@r_devops

Devops skils set

I am managing a team of 4 platform engineers(devops) and we take care of CI platform for 1000 odd engineers. We use jenkins and have a custom pipeline library which generates a dynamic build pipeline based on user input. I have been working with this platform and team for 6 years now. Before that I have SDET experience with mobile SDKs. So my skill sets are python, java, (some experience building nodejs apps), jenkins, managing SAAS platform like JFrog and Github, Sonarqube, Docker, Kubernetes, Terraform, etc. What else I need to learn and prepare for job change? My job is less mainly managing CI platform and I don't have experience on CD platform or cloud administration. Nor I have any experience on logging and monitoring stack. Do I need to learn those(not just in theory)? If yes, do I learn with hands-on experience? I have also not worked on a platform at a larger scale. Would that be a problem? Please help a clueless fellow out. This is the first time I'll be looking for a job change after moving to this role and have no idea what's required for such roles in market. TIA.

https://redd.it/1cj5eql
@r_devops

Managing Terraform modules in GitHub monorepo, deployment and versioning questions

Lately I've been looking into ways to streamline my organizations various repos that contain Terraform and have a few questions:

For a bit of background we have 2 environments, 1 production AWS organization and 1 development AWS organization. All our development, sandboxes and testing happens within the dev AWS org.

My questions relate to a repo that is planned to be structured as follows, our modules are entire solutions with many resources in each rather than a module per resource type:

├── envs
│   ├── dev
│   │   ├── environment.tfvars
│   │   ├── main.tf
│   │   ├── outputs.tf
│   │   └── variables.tf
│   ├── prod
│   │   ├── environment.tfvars
│   │   ├── main.tf
│   │   ├── outputs.tf
│   │   └── variables.tf
└── modules
├── module_1
│   ├── v1.0.0
│   │ ├── main.tf
│   ├── v1.1.0
│   ├── main.tf
├── module_2
│   ├── main.tf
│   └── variables.tf
└── module_3
│   ├── main.tf
│   └── variables.tf

Onto the questions..

When using a monorepo like the above for managing Terraform modules, how do you go about best managing versioning? My current thoughts are to either have duplicated folders with the version in the name (like what is shown in the above folder structure under module\_1), or to instead use GitHub tagged releases (benefit much less code duplication).

To keep development fast, I'm thinking of allowing the dev env to be built from feature branches that don't require a pull request. With this way of working in mind, which of the following is best?:

* Merge to main at the end of each day and create a new tagged release (this could result in dozens of tags over a sprint).
* Merge to main at the end of each day and only tag a new release once development has completed.
* Develop out of the feature branch until work is complete before merging and tagging (this could mean a feature branch sticks around for a long time).


Apologies if these questions are basic, this is a very different way of working to what we typically do. We currently have seperate repos for environments (full code duplication between prod and dev) and work out of long running branches. I'm trying to move away from this to prevent our constant battle with drift between environments.

https://redd.it/1cj6t7w
@r_devops

Greenmask database anonymization tool release v0.1.12

A [new release](https://github.com/GreenmaskIO/greenmask/releases/tag/v0.1.12)

Introduces improvements and bug fixes.

[https://github.com/GreenmaskIO/greenmask](https://github.com/GreenmaskIO/greenmask)

This release introduces improvements and bug fixes

# Changes

* Fixed transformer parameters decoding/encoding issue
* Fixed TOC entries merge behavior when the data section is empty - important when you create a dump witout schema
* Fixed integration tests for S3 storage

If you are not familiar yet with Greenmask - it is a Database anonymization tool that brings wide anonymization functionalities and techniques. Check out the [Playground page](https://greenmask.io/playground/) to get started

https://redd.it/1cj6njg
@r_devops

Bitbucket Self-Hosting

Is there any chance that Bitbucket would be deprecating self-hosting in a near future?

https://redd.it/1cj9hdo
@r_devops

LFG, Llama3 cli helper

https://github.com/bjarneo/LFG

https://redd.it/1cja5hl
@r_devops

Personalised CV like website


Hello,

I've been contemplating creating a small, personalized serverless website to showcase my skills, professional experience, and interesting use cases. I'm curious if anyone has already developed something similar and would be willing to share their experience and any tips.

https://redd.it/1cj6hsq
@r_devops

What courses do you absolutely swear by?

Any really really highly recommended courses? Can be anything devops or IT

My company has used Udemy for a long time, but I've been in IT for awhile so never used it. On a curious glance, I looked at a Linux course on udemy last week, I've been using Linux for years so didn't imagine I'd learn a bunch.
It was amazing! So much interesting stuff I'd never come across before.

https://redd.it/1cjdaa9
@r_devops

Alternatives to rundeck?

As title says. What is your cron job interface? Something to allow service desk agents to run complex scripts.

https://redd.it/1cjgb72
@r_devops

Suggestions for ML model deployment

Hey folks,

Seeking urgent advice regarding my ML model deployed on Hugging Face. I'm looking to deploy it into AKS and implement CI/CD. Any suggestions on how to go about this? Open to any other approaches as well. Thanks in advance!

https://redd.it/1cji3sb
@r_devops

fed up with pagerduty ... is there a viable alternative?

My org is fed up with pagerduty. Legacy and messy UI. Price increases. Lack of innovation. The whole nine yards.

Some years ago we looked at alternatives and ... let's just say, they made pagerduty look good lol. But I've read online that more recently the competitors have caught up quite a bit.

These days, are there any alternatives that are as good or close to as good as pagerduty? Which tool in particular?

View Poll

https://redd.it/1cjhwlu
@r_devops

What will you do after you leave all of this behind?

So you got your cashout and early retirement.
DevOps is gone. Out of your sight, out of your mind. No need to work in the field anymore.

What will you do then?

I'll get into homesteading and alpaca husbandry.
Away from the city, away from the industrial chaos corrupting our minds - to a good life of harvesting mushrooms and knitting alpaca socks. Might also get into archeology like i wanted as a child.

https://redd.it/1cjl0gc
@r_devops

Google Artifact Registry pull through cache options

I'm looking for options for a pull through cache that can run in a GKE cluster that works with Google artifact registry.

Currently, the only solution I've found that advertised it works is Sonatype Nexus. Artifactory is also an option, but using it as just a pull through cache feels like using a jackhammer for a nail.

Docker registry only supports docker hub, and it looks like harbor only supports harbor and docker hub. What are some other options?

https://redd.it/1cjhofi
@r_devops

Pen_spark?

What is this and why does it paste each time I use ai and C&P?


https://redd.it/1cjmjt2
@r_devops

Is it Worth Writing DevOps Tutorials on Medium or LinkedIn?

I recently began enhancing my DevOps skills as a software engineer. While I don't aim to transition solely into a DevOps role, I recognize the trend of more companies entrusting DevOps responsibilities to software engineers. Often, there isn't a dedicated DevOps architect available to support software engineers on every project.

I have a strong aptitude for writing and have already published five books on IT. However, I'm somewhat skeptical about sharing posts on platforms like Medium or LinkedIn.

https://redd.it/1cjolmm
@r_devops

Let's invent something outrageous

It's bonkers to me that we've gone from computers to computers running in computers (virtualization) to containers which are basically computers running in computers running in computers.

How can we go deeper? Can we add one more layer of compute for a laugh?

https://redd.it/1cjohqp
@r_devops

What is a good starter project to get practical experience?

Hi everyone,

Im a experienced backend developer and im planning to switch over to DevOps. I've worked in DevOps before for some months doing IaC mostly in bash and integrating the scripts in a Jenkins pipeline but i want something more.
I feel is very hard to land the "first" pure DevOps job, and thats why i want to be really prepared to make every shot count once the interviews began.
I was planning in doing a GOOD project to get some skills and learn cool stuff in the way since i have found in setting infra my true passion.
My initial idea was to develop some small microservice and configure all the infra to deploy it online in a AWS environment, since the free tier is very generous.
I was thinking on doing all the provisioning in Terraform, perhaps some stuff with Cloudformation as well and integrate CI/CD with the repo to deploy into an EC2 in AWS, ideally in K8s. For monitoring i plan to use AWS Cloudwatch or perhaps integrate the internal logging of the app with some provider like Datadog but im not sure if they have free-tier.

Do you think is a good plan? Would you think im missing some must have tech in the plan?

Any suggestions, comments or critics are welcome, consider me really newby on this lol



https://redd.it/1cjpyr3
@r_devops

Choosing specific runner for specific user who commits

I have a few self hosted runners for Github's workflow. Is it possible that I can choose the runner depending on the GitHub user who made the commit?

  core-build-image:
    name: "[CORE] Build Docker Image"
    runs-on:
      - self-hosted-A if usernameA
      - self-hosted-B if usernameB

https://redd.it/1cjjtmp
@r_devops

Should I still learn and study Terraform?

Or go with its best rival? Which one and why?

https://redd.it/1cjsqy9
@r_devops

Confused that should i choose devops over fullstack in terms of specialisation.

Hi guys I am a student of btech cse and going in second year in a month. forms are out to choose specialisation for the same. I don't want to go for AI DS or ML. Since half of the crowd is there.

I am confused between devops and fullstack.

I am learning we devp side by side in first year. But if I can learn backend frontend externally by myself then why to put my 3years into it while taking fullstack specs. Also some of my seniors are saying the market for fullstack has been saturated.

I want to go for devops but don't have enough knowledge about it. I want to know about devops, Is it better than fullstack. the jobs the packages??

since many people confused me that devops come under support not much package take fullstack. while some say legit the opposite of it.

please guide me thank you

https://redd.it/1cjsack
@r_devops

100% SLA claim (not considering maintenance, emergencies, attacks, network, ...)

I saw this company's website, where they claim to provide "a specialized high-performance managed-cloud" with 100% SLA. They have a cloud hosting SLA page, where they state that customers are not eligible for compensation in circumstances beyond their reasonable control. Those are:

scheduled maintenance, emergency maintenance, upgrades
force majeure events, interrupts/delays in telecommunications or third party services
targeted attacks
...

I don't fully grasp the concept of SLA yet, but it feels that they just excluded all the possible conditions for downtime, to be able to claim 100% uptime. It looks even worse because they look like "resellers", in the sense that they are offering you a managed experience of somebody else's cloud (companies can do that?), and then they exclude third party interrupts/delays.

What do you think of this?

https://redd.it/1cjtvbn
@r_devops