Containerization = resurgence of principles behind JVM

Is containerization just the modern day version of the JVM? I haven't written in Java in a few years, but what is the main difference between these two technically and principally?

https://redd.it/11uahbh
@r_devops

What process or tools do you use to terminate instances in an ASG, when you need to ensure the EC2 instance gracefully completes any connections or tasks before being terminated?

In my prior role we didn't use ASG (Autoscaling Group) scale in events to terminate instances, instead I used a cronjob on the EC2 instance to check if the host had =>7 days up time, check existing jobs and API's have completed and then terminates it's self.

The CloudFormation CI/CD updates the AMI deployed by the ASG. So those instances wouldn't become available until a host gracefully shutdown or became unhealthy.

Wondering if anyone else is using Terminating:Wait and Lifecycle Hooks and what their experience with those is?

Or is there another method to achieve a graceful shutdown that you'd recommend instead?

https://redd.it/11uaavy
@r_devops

I want to get all the spaces in my kibana using python

So as the title says I'm trying to write a script which gets all the spaces in my kibana, i tried to go through the documentation but i can't find a way to do that using python, any help would be appreciated

EDIT: i tried to follow elastic search doc
https://www.elastic.co/guide/en/kibana/current/spaces-api-get-all.html#spaces-api-get-all-example-1

but it threw me this error

{'error': 'no handler found for uri [/api/spaces/space] and method [GET]'}

here's the code for the same

import requests

response = requests.get('https://correct_ELASTIC_URL/api/spaces/space', auth=HTTPBasicAuth('elastic', 'CORRECT_PASS'))
response.json()

EDIT 2: it worked as soon as i replaced the url with kibana endpoint and not elasticsearch endpoint

https://redd.it/11sv72j
@r_devops

Looking for a way to transcode and stream videos

I'm running a media site where we host videos ourselves instead of using YouTube. Right now we're using Bunny Stream, but I was wondering if there are better (less independent) ways. I don't have the most experience with DevOps, but I'm running some droplets on Digital Ocean while also using managed databases and Digital Ocean Spaces, so it would be nice if we could integrate our new solution in Digital Ocean as well. Are there any services that take care of transcoding the video while storing it on Digital Ocean Spaces or is this a bad idea altogether?

https://redd.it/11st9aw
@r_devops

Networking Book: TCP/IP Illustrated vs CompTIA Network+

Hi there.
I'm 25M with 1y of backend experience, transitioning to devops/sre. Right now I'm self-studying for 3 months and for this week the plan is to study networking fundamentals. my friend who has 1.5 years of experience in the field is mentoring me.
After I researched a bit on reddit I found that the book TCP/IP Illustrated Volume 1: Protocols is a repeated recommendation. I also found a book called CompTIA Network+ Certification N10-007 All-In-One Exam Guide. My mentor saw the outlines of both and said I should read the network+ and after that should look up things that were in the other one but not here and study them.

What do you think? Has anyone read both? Any ideas?

https://redd.it/11ufd6b
@r_devops

Overemployed DevOps - how many of you are rocking two paychecks right now?

A team member mentioned they found r/overemployed and got a second FT job shortly after. I've heard them on their other job's calls a few times in their background audio before they remembered to mute their mic. They never are on camera anymore, unmute their mic, or contribute to any conversations, and slowly get a few projects completed.

Just wondering how prevalent it is in the DevOps world and if any of you have noticed a difference, either as a team member or as the overemployed.

https://redd.it/11ui4y5
@r_devops

What does it take to start your own DevOps or Cloud Consultancy ?

As a DevOps engineer, you've spent years honing your skills and gaining experience in cloud computing, automation, and agile methodologies. Now, you're considering taking the leap and starting your own consultancy firm to help other businesses adopt these practices and technologies. But where and how do you start? Who has done it here ? What's the process

https://redd.it/11ul5po
@r_devops

where do you store your projects reports ?

I use gitea to store my git
Droneci for the cicd
Docker swarm for production
Loki for logs
Influxdb and grafana for metrics
Etc.

My cicd also runs some tools that generate reports :
- Code Coverage
- Security (trivy)
- image size
- build & deployment time
- dependencies size (package phobia)
- sonarqube

I see that every tool has a nice dashboard or sometimes nothing and I'm left with json.

A quick view of all this mess would be nice.
Should I develop mine quickly. Is there a tool for that ?
Is it what is called a "software catalog" ?

https://redd.it/11upmbo
@r_devops

How do you deploy your docker containers (without orchestrators) ?

There's constant discussion around the usage of Kubernetes, Nomad and Docker Swarm. I recently stumbled upon the MRSK.dev post and am curious to know the tools and strategies used by teams and individuals that deploy Docker on VMs without using orchestrators.

If you're not on the cloud, could you also mention what hosting you use? I'd like to know

1. How do you deploy your containers?
2. What domain is the business that you work in?
3. What does the toolset look like?
4. How many servers do you deploy to?
5. Do you run it via a CI/CD server?
6. How do you handle monitoring and alerting?

​

https://redd.it/11uqvqy
@r_devops

Where to learn more as I scale up?

I've created and deployed a Django web app and there may be opportunities for me to monetize this app next year. I want to be ready for growth if this happens. I'm currently using a single CPU VPS with Linode and have no problems with CPU or memory use. My app is deployed via a PaaS.

I'm just doing this by myself. I tested out deploying my app without the PaaS by installing nginx as a proxy server, but that was at a very basic level with minimal configuration. I know that with Linode I can increase the CPU and memory at any time and I don't think I'd need to expand past that - I don't think I'd have more than a few thousand concurrent users. So when I say growth I don't think I'm talking clusters. Maybe load balancing for redundancy?


What would be the next step in learning about scaling, balancing, etc? The PaaS I'm using has settings for "web" and "workers" (which would also show up in a Procfile) and I have a fuzzy idea on what they're talking about but clearly their docs are meant for someone that knows more about this than I do. My apologies if this isn't quite a devops topic, I'm at the stage where I don't know enough to ask a great question.

https://redd.it/11usgu0
@r_devops

What do you do in your downtime?

I've been working as a DevOps Engineer / SRE for five years and noticed that in my downtime I'm doing the same things that I usually do at work. And I like it more than at work (I don't understand why). So, are there many like me who have the same DevOps hobby?

https://redd.it/11uugx2
@r_devops

What are your thoughts on using a GitHub copilot as a helping tool during doing DevOps Engineering work?

I think it's counterproductive and futile. Instead of learning and understanding your instruments, you decided to add an intermediate tool that would suggest the “best” solution. And when it becomes unavailable you couldn't do your work, also it can't help you with the debugging and if it generates a complicated bug, but you wouldn't be able to fix it. In the long term, you become less smart than you were before and become depended on the tool that sometime could become or too expensive or unavailable.

https://redd.it/11uvb4z
@r_devops

only devops on my team, how to move to a devops team?

Been doing ci/cd for environment provisioning and test automation for a team over the last few months. The work is near complete and I'm interested in continuing devops work where this ci/cd will be migrated over to.

I'm meeting with my manager who wants me to focus on application development. How do I respectfully let them know that the work I've been doing will continue to need improvements and there isn't enough resources where the ci/cd will be moved to. Also moving teams would help me improve the reliability of the environments as I'd have more direct contact with others that understand the tasks I work on instead of people blankly staring and ignoring(closing tickets that track) the tasks I need to do to complete the ci/cd for multiple environments. (basically I want to be in a devops team doing devops, not going back to application development)

https://redd.it/11uwv14
@r_devops

Survey Relation between scrum and devops. Thesis about implementing devops in scrum company Repost with updates

Hello. I am looking for people familiar with Scrum or Devops. I'm doing my thesis and I need feedback on the challenges of implementing DevOps in organizations with scrum. It is a short survey and you will help me a lot! thank you!

Inside the survey there is a short brief about what both concepts mean inside the paper I'm doing.

English: https://forms.gle/etE3nJ2CnRL9M8gRA
Español: https://forms.gle/LMdVHEzpigpxmrBAA

https://redd.it/11uzja8
@r_devops

Duplocloud, anybody using this yet?

Just curious if anyone has any experience with duplocloud. My company wants to implement this solution and I am not convinced that the their low/no code approach to the cloud is going to be a silver bullet for our organization. Also I know that duplocloud has a reddit account and I really don't want to hear your sales pitch, I want to hear if anyone in the devops sub reddit has heard of it.

https://redd.it/11uu2xs
@r_devops

where do you store your projects reports ?

I use gitea to store my git
Droneci for the cicd
Docker swarm for production
Loki for logs
Influxdb and grafana for metrics
Etc.

My cicd also runs some tools that generate reports :
- Code Coverage
- Security (trivy)
- image size
- build & deployment time
- dependencies size (package phobia)
- sonarqube

I see that every tool has a nice dashboard or sometimes nothing and I'm left with json.

A quick view of all this mess would be nice.
Should I develop mine quickly. Is there a tool for that ?
Is it what is called a "software catalog" ?

https://redd.it/11upmbo
@r_devops

How many of us are on anxiety medication?

Are you on anxiety medication?

View Poll

https://redd.it/11v6j76
@r_devops

Automate Terraform with GitHub and GCP Workload Identity Federation

This is how I automate IaC following the least privilege principle with GitHub and Google Workload Identity Federation. Hope you find it useful...

The workflow will run terraform plan and apply base on the event triggering the workflow, and based on that will use a dedicated service account to allow us to strictly follow the least privilege principle. If the workflow is triggered by a pull_request event the workflow will execute the step terraform plan with the tf-plan service account. If instead it is triggered by a push against main it will execute the apply step using a service account authorised to manage the resources in GCP.

https://youtu.be/DMwl9WcSAL8

​

https:\/\/youtu.be\/DMwl9WcSAL8

https://redd.it/11vegic
@r_devops

Surf CLI - Multiple AWS Accounts support! (Text search DynamoDB, S3 and more)

**Overview**

SURF is built for Infrastructure Engineers as a CLI tool that enables searching any pattern across different platforms.

**What's New:**

You can now provide unlimited \`--aws-session\` flags with \`profile\` and \`region\` values to search across multiple AWS accounts at once!

usage: \`surf s3 -q "my data" --aws-session dev,us-east-1 --aws-session prod,us-west-2\`

**Supported Platforms**

* usage: \`surf <platform> -q <some text>\`
* AWS Route53, DynamoDB, ACM, S3, Opensearch
* Elasticsearch
* [Logz.io](https://logz.io/)
* Hashicorp Vault, Consul

https://redd.it/11vdnza
@r_devops

Looking for Advice on Intro into DevOps

Hello all! I am currently looking to shift careers from public education to DevOps. I have come coding experience but I believe the management style of DevOps fits my skills better. What route would you take to learn? I am currently enrolled in the IBM DevOps course on Coursera, is it a good route for learning this field? For this who have taken it, would the work done there help build a strong portfolio for what companies are looking for? Any other advice on where to learn is welcomed!

https://redd.it/11vkxcz
@r_devops

Committing a file via build pipeline?

I’ve got a pre merge pipeline that triggers on PR as a build validation.

I’ve also got a script that can be ran to generate a readme markdown file just in scripts folder. I’m currently running that manually when I’m making code changes pre PR.

Is it frowned on/bad practice to have a step in a pre merge pipeline that essentially create changes (as in adding a new md file) that were not part of the original PR?

The script would only run on files that have had changes to ensure the readme is always updated.

Basically don’t think anyone will stick to running it long term so thought I’d try and automate it as part of the validation stage.

Any insight (or suggestions on a better way?) would be helpful as I am new to my devops journey.

Thanks!

https://redd.it/11vluhg
@r_devops