Reddit DevOps
268 subscribers
2 photos
31K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
How should infrastructure and CI/CD pipelines be documented?

3-4 months ago, we hired an experienced Devops lead with strong industry experience in AWS and our CI/CD techstack. While they've done a good job, one of our asks was for them to document the details on our infrastructure's setup in a clear way, and till now this isn't clear to anyone apart from this person.

So our questions here would be:

- How should things like infra/CI-CD be documented such that they could be explained to other tech staff, and stakeholders?
- What are the industry practices here for documentation apart from high level UML diagrams that show how various AWS services come together?

https://redd.it/y9k6c2
@r_devops
Traefik 1.7 - any sane way to store distributed certificates?

We are running our stack on Docker Swarm and use traefik 1.7 as a reverse proxy. We'd like to have 3 nodes running traefik and use round robin DNS to point to each of them. However, AFAIK traefik 1.x only supports Consul, etcd or Zookeeper as a distributed key value store for storing Let's Encrypt certs. Running any of these seems like an enormous overkill for such an easy task.

Is there any saner way of achieving distributed certs storage for traefik 1.x?

https://redd.it/y9n9bg
@r_devops
metalbear-co/mirrord: Connect your local process and your cloud environment, and run local code in cloud conditions.

>mirrord lets developers run local processes in the context of their cloud environment. It’s meant to provide the benefits of running your service on a cloud environment (e.g. staging) without actually going through the hassle of deploying it there, and without disrupting the environment by deploying untested code. It comes as a Visual Studio Code extension, an IntelliJ plugin and a CLI tool

mirrord on GitHub

https://redd.it/y9ufvs
@r_devops
Options for Application Configuration Management (e.g. ConfigHub)?

I'm currently investigating some tools that may help us manage our configuration for several of our applications. tl;dr: we have several applications with yaml files on top of yaml files that make it a) difficult to tell what's in production b) hard to validate configuration values and c) preclude non-developers from taking a peek at config.

ConfigHub seems to scratch the itch for us, but may fall short in our security review given its limited authentication options. I am having a hell of a time finding alternatives that offer something similar. Google searches seem to bring up everything from SolarWinds to Puppet/Chef - I don't need something that is managing IT assets or orchestrating my infrastructure, I just need something that acts as a push/pull config repo.

https://redd.it/y9vtzi
@r_devops
Starting a boot camp soon, need advice

It’s for software dev, but will involve DevOps basics as well as fundamentals in azure. Would it be overkill to then try and get AWS fundamentals alongside (in my free time)?

https://redd.it/ya0tjk
@r_devops
I have a small application on AWS. How do I put it all in one repo that could be deployed as-is, without needing to use the AWS website?

Hello, I'm new to devops and have AWS free tier right now, and decided to make a simple lambda that writes to a S3 bucket and is triggered from an API (AWS API Gateway). Right now, it's pretty inconvenient to go and change everything manually. Is there any way I could get all the required settings / code for the required services in a single repo locally, which I could then "run" and have it update the resources on AWS?

I'm aware of Terraform and Ansible but I'm not completely certain how they would be used here. And although I am on the Free Tier, I'd rather not accrue mystery charges.

I'm not new to computers / development, just new to devops.

https://redd.it/ya3isu
@r_devops
Using Brev to auto-manage AWS instances to cut usage costs

https://brev.dev/docs/optimize

This is a cool way to add autostop to your instances if you leave em on

https://redd.it/ya1olc
@r_devops
What would you expect a level 1 engineer to be doing/learning within their first year?

I made the switch from "traditional" IT sys administration about 6 months ago now. I feel like I've at this point got a grasp on how things are working enough to be of use to the team, but I'm curious what some of the more experienced folks here would suggest I be looking to learn, and what skills you'd expect me to have or be working towards.

I'm currently working in a 100% Azure DevOps & PowerShell environment, supporting 3 of the 8 products in my companies product suite. My management is suggesting in my spare time during the day I be pursuing the AZ 104 -> AZ400 learning path (not a lot of emphasis on getting certified, just as a learning structure and outline)

https://redd.it/ya2vbe
@r_devops
QUESTION(S) ON DATABASES IN DEVOPS

Hi, I am doing research into how modern applications are built specifically around how they utilize various databases. It would greatly help my academic efforts if you could help answer 6 questions for my paper here: https://www.surveymonkey.com/r/25C8ZP9. I truly appreciate any responses I can get.

https://redd.it/y9iqx6
@r_devops
Ask /devops - How often do you get pulled into ad-hoc tasks that don't fall into any clear bucket?

This is more of a startup or small company question. How often do you get pulled into time-consuming ad-hoc tasks that fall in your lap as an Ops person - but ideally should have been done by somebody else? It might come to you because of unclear processes, or maybe because you have admin access to something - whatever it is, it ends up consuming your time. It gets worse when your team's progress is tracked by looking at the Kanban board or Jira tickets - because this was never there.

Note that this is more rampant in smaller orgs - so would love to hear others' who face this, and how they deal with it.

https://redd.it/y9o81n
@r_devops
how to apply CICD in github to deploy in aws ec2 instance?

I made a flask application and want it to be deployed automatically in the ec2 instance one i push it to the repo. Can anyone help me knowing the steps to do this? I also want to know how to do this when using laravel.

https://redd.it/yajlio
@r_devops
Any learning resources on HPC architecture?

Hi I'm looking into High performance computing distributed architecture on Windows platform. Any resources would be welcome ♡.

https://redd.it/yanjh4
@r_devops
API Export/Import CI/CD pipeline

I'm specifically doing this with Informatica, however I've done the same thing in Databricks.

When I did it for Databricks, my team was much more involved with the release process. So, we would do an export from dev create a pull request and deploy that in to test/prod.

However, for this pipeline, I'm looking for a more hands off approach, and letting the team who contributes to the repository be the ones to create the pull requests. I'm thinking that they can continue to develop in Informatica, and I'll provide a script that will export out what they need and they can make a pull request with that. Obviously there's going to be more complexities than that, but has anyone else done something similar?

https://redd.it/yaffid
@r_devops
CI/CD

I live in a country where we are not allowed to pay foreign companies. I am unable to get the free tier of aws,gcp using credit card . How do you recommend me learning cloud and a make a complete CI\CD pipeline?

https://redd.it/yaf6pc
@r_devops
Minecraft server deployment to DO from Github Actions

Hi everyone,

I've got a few questions regarding deploying Minecraft server to Digital Ocean. My use case is to automatically spin up a new droplet with mc server with predefined server configuration on some action (let's say click of a button in some UI) and destroy if the server is empty for some time.

Currently, my process would look something like this:

1. Git repository contains mc server configuration files along with docker-compose with services that bootstrap Minecraft server and backup service.
2. User triggers Github Action that deploys the server to Digital Ocean using Terraform.
3. Terraform pulls Minecraft world data from data storage using rclone (is this a good use case for provisioner?) and runs docker compose up
4. After some time, the droplet should be destroyed (to reduce the cost), but a backup is triggered before that.

Questions:

1. Is it better to create a custom Dockerfile with minecraft server image along with my custom server configuration and upload it to docker hub or to copy the configuration along with other server data to terraform using provisioner or user_data?
2. Is there a problem if I don't save the tfstate files from the triggered Github Action?
3. How would you go about automatically destroying the droplet if there were no online players on the server for some time?

https://redd.it/yax9n2
@r_devops