Does there exist a tool like docker compose that runs containers serially?

Looking for a platform agnostic ci tool that uses containers for each step. Similar to Argo workflows but not as complex or featured. If docker compose could run containers serially it would be perfect for what I’m looking for. Use case is the developer would be able to run the same workflows on their local machine as the pipeline regardless of which ci platform is used officially (we use multiple).

I started working on building a tool but wanted to check first in case it already exists.

https://redd.it/13n1nbd
@r_devops

How's DevOps market right now?

I see most of the companies are pulling away the consulting roles out there. How do you feel the heat right now in contracting world for DevOps out there?

https://redd.it/13n005y
@r_devops

What are some harsh truths that r/devops needs to hear?

Title.

https://redd.it/13n6pmp
@r_devops

How to encrypt traffic from NginX server to upstream servers?

Hi, I have a two EC2 instances. One is a public instance which is a NginX API gateway. Other instance is a private one which I use to run my microservices using Docker compose.

Currently I configured Let's encrypt SSL certificate in the NginX API gateway. So from end users to API gateway traffic is encrypted. But from API gateway to Private EC2 instance traffic is not encrypted. How can I encrypt that internal traffic. I couldn't able to find a proper document or tutorial on that. Can anyone help me?

https://redd.it/13n8gmm
@r_devops

I don't see any volumes when i do "sudo docker volume ls" . even tho in my docker compose file i have mention volumes and the postgres container runs perfectly and i can see data in specified path. I also have few questions if you guys can answer it. it will be of great help

Here is my docker-compose file : https://pastebin.com/wxHZD8nn
Here is my init.sql file: https://pastebin.com/PsfA9iGW
As far as i know docker volume has two types bind mount and named volumes
below are my understanding of both kindly correct me if i am wrong
1) Bind mounts are entire path ex: /home/test/data:/var/lib/postgresql/data
2) Named volumes are name of folder which is created inside /var/lib/docker/volume/{folder name}
ex: test:/var/lib/postgresql/data
A test folder will be created inside /var/lib/docker/volume
Please correct me if i am wrong
also can you guys please tell me
1) How can i write bind mounts or named volumes in docker compose file ?
2) what is the correct way ?
I would like to know how to add different types of volume in detail because i though only named volumes are written with top level volume but i also saw bind mounts too . so i am kinda confused now
Please help me clear my doubts

https://redd.it/13mzo0z
@r_devops

What's the point of defining the URL of an environment in GitHub Actions?

jobs:
myjob:
runs-on: ubuntu-latest
environment:
name: test
url: ${{ steps.test.outputs.url }}
steps:
- name: Test
id: test
run: echo "url=https://reddit.com" >> $GITHUBOUTPUT

If in order to run the Test step, the environment should have already been chosen, what's the point of setting the URL this way?

Have seen many examples doing this in one way or another. For example, https://github.com/actions/starter-workflows/blob/main/deployments/azure-webapps-python.yml.

https://redd.it/13nbdxg
@r_devops

What interview questions trip or expose most or a significant number of candidates

If you’re an employer or have been on the question asking side of interviews, what questions trip a lot of candidates or questions that you throw out there expecting a high chance of failure or the candidate to have to think a decent bit about the answer and if you’re a candidate what kind of questions like these have you seen

https://redd.it/13ncs07
@r_devops

Help, new on the area

Hello people! I want to get to know the DevOps area
What should I go FIRST to learn the best? What should I look for?
Many thanks already!

https://redd.it/13ne5vm
@r_devops

Installing stuff on ARM architectures.

Last year, while interning at a company I had to setup a Jetson computer which has a ARM architecture.
I faced a lot of issues with the libraries/packages/software, that would easily install or run on a PC which has Ubuntu. At my internship we had a DevOps Engineer who resolved the issue for me, but lately I have been getting a lot of interview questions on how can I solve that architecture problem.
How do I get stuff to work on multiple architectures?

https://redd.it/13nd6xv
@r_devops

Ubuntu cloud-config / autoinstall - Anyway of making it more modular?

Hi All

I suspect the answer to this will be "no", but is there any native way (or establish 3rd party way) of splitting the "autoinstall" into seperate files, so it can be made more modular? i.e.

* storage.yaml
* ssh.yaml
* late-commands.yaml

The alternative is, just write a bash script that pulls these together, and spits out the merged file.

Thanks

https://redd.it/13ncmrw
@r_devops

How do you rotate 3rd parties API keys?

We are using AWS secret manager to store our API keys which include some 3rd parties.
I want to rotate those automatically, how do you do that in your company?

https://redd.it/13nke0n
@r_devops

Can and should I create a reusable workflow that automatically creates the AWS role and trust policies needed to setup OpenID connect in AWS for CICD?

At work we have a DevOps team that has created a reusable workflow that automatically creates the AWS role and trust policies needed to setup OpenID connect in AWS for CICD.

I'm more fullstack than DevOps, but I'm working on a personal project, and I'm trying to replicate something similar on my own. I get the basic principle how authentication happens, and I can technically follow through this guide to set it up myself. However, I would love to automate this, so that I can easily run it once per repo in a consistent way.

How the work reusable workflow works is that you create a config file containing all permissions needed in the role to be created, and then you execute the GitHub action, A hyperlink is then displayed in the actions terminal that takes you to the the AWS identity federation page for you to sign in and authorize the action to your account (the action is then federated to your user). Then the role and trust policy is created automatically between the AWS account you authenticated to and the GitHub repo that you ran the action from.

My one thought is that I'm not actually able to create this same UX because I don't federate authentication with any external identity provider on my personal AWS account, I rely solely on IAM.

Is it better if I just manually create each role / trust policy?

https://redd.it/13nbnhf
@r_devops

Shifting from Analytics to DevOps

Hello, just wanted to get some advice from all of you. I am currently working in analytics and planning to shift to a DevOps Engineering role. I've read the "Getting into DevOps" page which provided a lot of useful info. I know that this will take a while and I'm looking forward to building the skills needed. I'm actually learning AWS now with plans on taking the AWS Cloud Practitioner certification as a start.

Since my background is in analytics, I don't have any experience in deploying any apps (I'm familiar with git usage though). Is it better if I take the software dev path before going to DevOps or can I go to a DevOps role directly? I know there are several paths that one can take but just wanted to know the most optimal way to start.

Thank you all in advance!

https://redd.it/13npcub
@r_devops

Industrial engineering and Devops

Hello!
I am an industrial engineering student and I was offered the opportuinity to attend a program focused on Devops. I noticed that some concepts of Devops are somewhat related to concepts like Lean and continuous improvement.
Do you think it would be beneficial for me to enroll if I want to pursue a career in industrial engineering?
Thanks in advance!

https://redd.it/13npvs2
@r_devops

Anyone know of an umbrella CLI for multiple cloud providers?

Does anyone know of an umbrella cli tool that allows me to manage machines at different providers? Working with various providers because of my clients. Would be nice if the basics were covered like creating machines, dns settings. Wouldn't mind if it shelled out to the underlying per provider clis when things get more complex.

https://redd.it/13nr8e1
@r_devops

How do you learn the implementation of mTLS? For example you have two flask microservices

How to implement mTLS to understand further?

https://redd.it/13nqfap
@r_devops

TeamCity Build Dependencies

Hello everyone,
I'm working on a project where I need to programmatically trigger a new build in TeamCity and use an existing, specific build as an artifact dependency. I'm currently using the REST API to interact with TeamCity.
From what I understand, TeamCity typically retrieves artifacts based on the artifact dependency settings in the build configuration (e.g., last successful build, last pinned build, build with a specific build number, etc). However, I'm looking to dynamically set a specific build as an artifact dependency when triggering a new build via the API.
Is there a way to do this directly through the REST API? Or is there another workaround to achieve this functionality?

https://redd.it/13nuypk
@r_devops

How is it possible to commit a docker container to an docker image?

I was reading this blog.

https://techtutorialsite.com/docker-commit-changes-to-containers/

Where the author commited a container into an image. I didn't understand that. Can you help me realize it? How is it possible to commit a container to an image?

I need to learn more about docker container and docker images, so if you've materials barring docs please share.

https://redd.it/13nyyfp
@r_devops

Any tool to "clean" helm chart values?

It's not that complicated, just asking if there's a tool that downloads all of a chart's dependencies and removes any key-value pairs in the parent values.yaml that already exist in the sub charts' values.yaml. I think that could save my team's repository tens of thousands of lines and headache

https://redd.it/13o0r8h
@r_devops

Why isn't azure popular?

My career so far has been spent working with Azure, however people seem to lean predominantly towards GCP and AWS. Personally I think Azure offers tons, but not in a place to actually comment about it vs it's competition

https://redd.it/13o0gz1
@r_devops

Abstraction of Cloud Providers

What do you think about the role of cloud providers - are they doing their job well?

Personally, I think that cloud providers should join forces and develop a uniform standard, which would eliminate the extreme lock-in effect of individual providers and enable easy migration to other cloud providers or diversification (the use of multiple cloud providers).

Personally, I haven't been through a migration from one provider to another, but I'm sure it's hell.

Have you guys been able to gain experience with this and perhaps develop best practices? For example, what were the biggest hurdles in migrating because you relied too much on the provider's services? Do you already know of projects that abstract cloud providers?

In a perfect world, migrating to a different cloud provider while using standard features should just be a different biller....

https://redd.it/13o1b8c
@r_devops