Makefiles vs. Bash Scripts

Hey all, first time posting in this community.

When working with a compiled language and using Makfiles, how much of your local development environment do you throw in there? Like for instance, do you typically also have dedicated bash scripts to handle things like logging, or do you just write those directly into the Makefile to keep them behind a single interface? Are you calling bash scripts that call the makefile, or vise-versa, and how are you making those decisions?

I could see the Makefile getting really large and I'm curious when you decide to throw scripts in there, or any command-line interface really, versus in a bash script or another helper binary.

I've been in shops that keep all these little local utilities in a /bin folder at the root of the project; was curious what other folks are doing. Thanks!

https://redd.it/z1eegq
@r_devops

Is centos still in use?

I am doing some practices in some vm and i want to know if companies will still using centos, o are they migrating to other plataforms as Rocky Linux o ubuntu server?. in my last company we were using centos 7, but right now i have not idea if is more convenience start to using Rocky Linux instead

https://redd.it/z1brdh
@r_devops

Review->Stage->Prod deployment strategies for teams with multiple devs

This feels like such a simple thing, but I’m having a hard time finding the best practice(s) online.

I’m trying to set up my team with a Trunk-Based Dev approach. We have a main branch that automatically deploys to a staging environment , and we can also trigger manual deploys from our main branch to our prod environment.

Our team has three devs, and I’m already struggling with scaling up our workflow.

Example, let’s say devs #2 and #3 have feature branches merged into main that are ready for deploy, but my work hasn’t been QA’d yet and/or requires manual review before getting deployed. What am I supposed to be doing in order to not be holding the other devs’ work back? Merge in-progress work into a separate dev branch/server for review? Or some other workflow that I’m not thinking of?

We’re already running into scaling issues with a small team (mostly due to a lack of conceptual understanding of DevOps/CICD on my part). How do teams with hundreds/thousands of developers do what I imagine is a fairly simple workflow?

https://redd.it/z1gg45
@r_devops

Have you ever used Python in your daily tasks as DevOps? if so, how?

Is it worth learning it!? Or just Google it if necessary

https://redd.it/z1bh5r
@r_devops

open-source ML-based WAF add-on for NGINX/NGINX Ingress

https://github.com/openappsec/openappsec

https://redd.it/z1avgh
@r_devops

Brainstorm

I have this use can that I want to publish test reports from Gitlab to s3 so authorized people can get sns notification and go to s3 and see the report. This is the current flow I implemented but I feel it’s still need something maybe like cloud front distribution for these index.html to review reports in static website but not sure how the arrangement will be of the htmls .. even if I add time stamps it feels missing something

https://redd.it/z1j1af
@r_devops

Is “Platform Engineering” the new kid on the block?

Tailwinds take on platform engineering. Pls, read thro', looking forwarding hearing from you

https://www.linkedin.com/pulse/platform-engineering-new-kid-block-tailwinds-ai

https://redd.it/z1o1sl
@r_devops

Looking for an artifact store for generic assets, rather than specially-formatted packages or containers. Thinking maybe ORAS, but wondering if there are other options.

I'm looking for a way to store build artifacts that are completely arbitrary; just binaries or frontend assets that don't conform to any particular standard. I can just throw them in a bucket store, of course -- that's what I'm doing right now -- but that seems wasteful when so many of the assets don't change on most builds.

I really like how this works with container registries -- content-addressed storage organized by tags. So oras.land seems like a really appealing solution: it uses the registries we already work with and has the exact same tagging capabilities. It doesn't seem like it's used much, though, so I'm curious if there's something else most people use to solve this problem. Or maybe I'm just overthinking it and most people throw their builds in S3 and don't worry about the storage costs?

https://redd.it/z1olcx
@r_devops

Has anybody used OctAIpipe?

Hi,

​

As per the title, I am using Metaflow as a MLops/Devops tool, coupled with a Prefect scheduler and some CI/CD Gitthub actions pipelines.

​

Has anybody had any experience with OctAIpipe in this regard? Could it replace part of the MLOps + CI/CD pipeline ? A friend has recommended it to me, saying I can get rid of Actions and Metaflow in 1 go, but it comes with a pricetag.

​

Any help would be lovely.

https://redd.it/z1q384
@r_devops

Securely accessing blob storage from K8s

We are running our K8s cluster outside of Azure and want to provide a secure way of accessing the blob storage.

My understanding is the access keys for the blob storage is more less root level access to the storage where as I want a more granular access depending on the application accessing it.


What is the best way to achieve this securely?

https://redd.it/z12zx6
@r_devops

SLACK blocks and coloured border?

I'm trying to figure out how to send a Slack block which has a side bar as seen in the old attachments docs https://api.slack.com/reference/messaging/attachments#example

I've been through the migration guide https://api.slack.com/messaging/attachments-to-blocks as well as the blocks guide
https://api.slack.com/block-kit/building and expermiented in the block kit builder and I can't find a way to do it?

Has anyone migrated their attachments code to the new blocks format and retained the coloured side bar?

**SOLVED**

https://api.slack.com/messaging/attachments-to-blocks#direct_equivalents I missed this in the docs:

"There is one exception, and that's the color parameter, which currently does not have a block alternative. If you are strongly attached (🎺) to the color bar, use the blocks parameter within an attachment."

Basically there isn't an equivalent and you need to use attachments. That sucks Slack and you know it.

https://redd.it/z1sgp6
@r_devops

DevOps as scrum team member

General question from my side.

In your organisation, does DevOps person join meetings for feature teams(FE/BE/QA/ux) ?
Should DevOps join scrum ceremonies, like planning, retro, demo, review?

I'd like to know your opinion here. I personally find it hard to follow the feature team topics because they rarely have a issues related to Infra or DevOps matter.
But if they have issues related to Infra topic they straight go over slack to me first.

How you feel this topic?

https://redd.it/z1tfu5
@r_devops

How to choose the right API Gateway

Nowadays an API Gateway is an essential component in designing a distributed system’s architecture with multiple API services or microservices. This post helps you understand what’s the API Gateway, when, and why to use it, and guides you on how to choose the best API Gateway solution for your applications.


https://medium.com/apache-apisix/how-to-choose-the-right-api-gateway-ff1cc8cfadd7

https://redd.it/z1v5da
@r_devops

Rightsizing tips and recommendations for getting your cloud costs down

Rightsizing is a largely automated process, regardless of which cloud platform you’re using, but it pays to know how it works in order to better understand the recommendations and act on them appropriately. The process consists of three main steps: 

1. Analyze: Rightsizing involves continuously tracing metrics like memory, network, disk, and vCPU usage across your volumes, instances, and virtual machines. 
2. Verify: Analytics data must be verified against a predefined performance benchmark to determine whether or not resources are being underutilized.
3. Optimize: The final step is to downgrade or terminate cloud resources based on these results and your performance and cost-efficiency targets. 
more info check out here

https://redd.it/z1s9qe
@r_devops

Starting new project (ideas)

Hi I’m new here. I worked some of my life in devops space, but not necessarily enough to be more than junior. I was thinking about making open source tooling, but I don’t know how much of a problem it is. If it’s not then I will find something other to do in my free time. Can you tell me if you ever encountered similar situations and how you handled them?

1. Deploying on-demand resources like a new VM for somebody new in a team. I was thinking if there is a solution so I can quickly type Terraform code for VM, S3 bucket and configure networking and then create something like a typeform interface for other non-infra people to use my template and quickly deploy infra for quick testing/research. (I’ve spent a crazy amount of time configuring resources for ppl and I hate it)
2. Is there anything there for easy resource policies? I would like to deploy a VM from Terraform and configure automatic slack notifications. For example, if the VM runs for 8 hours a day, I want to message the developer and ask if they still need it. If not then shut it down. I know there are EC2 policies available, but I was thinking about the entire easy-to-configure workflow. (In my startup we wasted a lot of money on unneeded resources)
3. Is there a tool for terraform code management? Like, disallow modifying this particular resource and some specific field and notify me if it was modified. A lot of times somebody screwed up my setup by mistake because terraform allowed that. I know there is Spacelift that allows configuring that, but is there any alternative? (Somebody again tried to screw up the setup and I’ve to explain why)

Let me know if you experienced problems in those categories and if it’s worth creating oss project there. Maybe those problems are imaginary and I do have not enough experience to know how to solve them. Thanks a lot for your feedback!

https://redd.it/z20753
@r_devops

Observability with Spring Boot 3

The Spring Observability Team has been working on adding observability support for Spring Applications for quite some time, and we are pleased to inform you that this feature will be generally available with Spring Framework 6 and Spring Boot 3!

What is observability? In our understanding, it is "how well you can understand the internals of your system by examining its outputs". We believe that the interconnection between metrics, logging, and distributed tracing gives you the ability to reason about the state of your system in order to debug exceptions and latency in your applications. You can watch more about what we think observability is in this episode of Enlightning with Jonatan Ivanov.

The upcoming Spring Boot 3.0.0-RC1 release will contain numerous autoconfigurations for improved metrics with Micrometer and new distributed tracing support with Micrometer Tracing (formerly Spring Cloud Sleuth). The most notable changes are that it will contain built-in support for log correlation, W3C context propagation will be the default propagation type, and we will support automatic propagation of metadata to be used by the tracing infrastructure (called "remote baggage") that helps to label the observations.

We have been changing the Micrometer API a lot over the course of this year. The most important change is that we have introduced a new API: the Observation API.

>The idea of its founding was that we want the users to instrument their code once using a single API and have multiple benefits out of it (e.g. metrics, tracing, logging).

This blog post details what you need to know to about that API and how you can use it to provide more insights into your application.

Read the post

https://redd.it/z1uiq0
@r_devops

Tips on learning Ansible as a Chef user?

I've been using Chef for a long time now, across multiple jobs (and Puppet before that). However, my company got acquired last year by a much larger company. We're still going to be maintaining our current stack as-is for the moment, but my team is going to be helping out with another product team, and they use Ansible/Terraform and GitHub actions.

From the research that I've done already, it seems like Ansible approaches things in a much different manner than Chef does; like Chef provides a DSL layer on top of Ruby, and you still use Ruby syntax, Ansible playbooks seem to be based directly on YAML configurations rather than a DSL on top of Python. (I'm assuming that if you need to create a custom Ansible module, you'd need to do so in Python, but I haven't gotten that far yet.)

Anyways, I was wondering if anyone had some guides tailored to people familiar with Chef that are looking to learn Ansible. I've found some different StackOverflow/Google Groups threads, but not as much on an actual tutorial/guide basis.

TIA!

https://redd.it/z23gyh
@r_devops

Non-technical founder looking for advice on the YouTube Data API v3

Could someone advise me on the following situation:

For a new business concept we're testing, we need to continuously know when a new YouTube video has been added to a playlist on our client's YT channel, and we do that on behalf of that client via OAuth2. Now I know it's possible to make API calls continuously, but that seems so paradoxical that I had to seek help from - hopefully - one of you here.

It's not only for one client; our business model depends on this engine. We would need to be able to scale this to eventually 1,000+ channels (clients) of which we would need to be notified whenever a new video is added to a playlist on their channel.


Lastly, we would need the MP4 version downloaded of that newly added video to our environment for further modification.

Anyone that could help us out?

https://redd.it/z24tob
@r_devops

Daily DevOps Tools

Hey everyone - about a year ago I started posting an interesting DevOps tool every day on a small sub. Linking it here if folks find it interesting or helpful: https://www.reddit.com/r/devopspro/

https://redd.it/z27xy3
@r_devops

I tried to learn Python

TBH I hated every single piece of code I wrote, my background is C# and I'm currently working as DevOps with Azure as core skill. I'm wondering if I can skip Python and live with PowerShell and Bash, any opinions?

https://redd.it/z29jbx
@r_devops

ci/cd for new project infrastructure

Hi,
I'm workin a ci/cd pipeline for a new set of projects I'm workin well before I I'm looking at building a ci/cd pipeline, and I'm not totally sure where to go or what to do with this for a solution that gets me up and running quickly.

I have pretty decent docker experience. Ihave a dockerfile written for my API project, but I'll have at least a web frontend, an admin frontend and then the backend API. I've had jenkins experience, but I don't really want to run Jenkins for something that isn't super complex.

What's the best way to automate this? I'd like to push to git, and based on the branch deploy, preferably to a Linode I have.

I think that if I build the docker container through my ci/cd after unit tests and etc pass, I can then connect to ssh, jump to the proper directory and call docker-compose to restart the container. Is this viable for deployment? This would be for dev, stage and prod.

My secondary issue is being able to run tests against the container as part of my CI pipeline. These would be API tests or functional tests, or tests in selenium for the frontend and admin interface.

Any direction or ideas would be really helpful. I know that AWS has ci, but they seem to want you to integrate with their vc system. I would even be open to paying for some kind of managed Jenkins instance if that exists.
Thanks,

https://redd.it/z275sh
@r_devops