Best way for OnPrem postgres

Hello,

So we are shifting to OnPrem for some reason. For this we want to deploy PostgreSQL database on premise. What should be the best way to deploy this? Should we consider deploying in Kubernetes or as docker containers or direct installation using virtualization software's which you know will be present.

I am thinking of a stack for kubernetes:

Rancher

KubeDB

Cloudflare

Prometheus

Stash

Thing is replication is also important and Cloudflare for tunneling.
Any recommendations
P.S Might migrate other postgres databases to onprem also

https://redd.it/1dl1v6y
@r_devops

Transitioning from Technical Support to DevOps

Hi everyone,

I've been working as a L1 Technical Support Engineer for the past 18 months with no growth in my role. I'm looking to switch my career into DevOps. Is it a good time to start preparing for DevOps? What is the demand in the market for this role in the present and future compared to other domains? How can I make this transition?

Thanks in advance!

https://redd.it/1dl534m
@r_devops

Looking for DevOps Study Partners - Let's Learn and Grow Together!

I’m a 4th year engineering student with a keen interest in DevOps. I have a basic understanding of DevOps concepts like Git, Linux, shell scripting, Python, Docker, and some cloud fundamentals. Currently, I'm preparing for Azure certification exams and I'm looking for study partners to join me on this journey.

If you're also studying DevOps or interested in learning more, let's connect! We can teach each other the concepts we know, study together, and support each other’s growth. We can set up regular study sessions on Discord and Telegram to follow up and keep each other motivated.

If you’re interested, drop a comment or DM me.

https://redd.it/1dl63bd
@r_devops

Favorite cross-cloud provider backup solution

I’m working for a mid-sized company of about 100 employees with an AWS spend of ~$20k/month. Most of our cost is in RDS, Redshift, ECS, EC2 and S3. We have been using AWS Backup with cross region replication. We are looking to replicate our backups to another cloud provider such as Google or Azure. If there are third party vendors with their own cloud storage, we are open to that as well. I was hoping to get feedback from the community on everyones favorite tooling to perform cross-cloud provider backups

https://redd.it/1dl5tb8
@r_devops

Using AI

I mainly use it as enhanced Google for references. I know there is a deeper level but not sure if that means ML is going to be another crucial skill to add. Curious how others use AI to workflow.

https://redd.it/1dl89vy
@r_devops

CICD tool indepent workflows?

Hello!

My management thinking about to create a company wide centralized CICD workflows (like build, deploy, testing, releases ect.). That sounds fair, and I support that, but we use different tools for some projects like most of the projects using Gitlab for everything and some of the projects uses Jenkins (and ArgoCD) and the last group is a Github Actions based only.

So we are asked to create the workflows to run every possible CICD platform.

It is possible? My first thought was that to use docker images with built-in shell scripts (maybe some environment variable checking or setup is needed but), after these everything can be used from anywhere.

Have you any other idea?

https://redd.it/1dldl4x
@r_devops

Azure devops pipelines issue

Okay somewhat of a newbie question:
I have 4 yml files for 4 pipelines (build, dev-release, stg-release, prod-release).

build.yml

trigger:
  branches:
    include:
      - development

pr: 
  branches:
    include:
      - staging
      - master

#rest omitted for brevity

dev-release.yml

trigger:
  branches:
    exclude:
      - '*'
pr: none

resources:
 pipelines:
     - pipeline: 'build'
       project: 'project'
       source: 'build'
       branch: 'development'
       trigger: true

#rest omitted for brevity

stg-release.yml

trigger:
  branches:
    exclude:
      - '*'
pr: none

resources:
 pipelines:
     - pipeline: 'build'
       project: 'project'
       source: 'build'
       branch: 'staging'
       trigger: true

#rest omitted for brevity

prod-release.yml

trigger:
  branches:
    exclude:
      - '*'
pr: none

resources:
 pipelines:
     - pipeline: 'build'
       project: 'project'
       source: 'build'
       branch: 'master'
       trigger: true

#rest omitted for brevity

so what I want is, build should trigger on commit on dev branch and on merges to stg and master.

The problem occurs while releasing. When I merge dev into staging both dev and stg release pipelines are triggered. Probably it would trigger all 3 release pipelines if I merge stg into master but haven't tested that yet.

Am I doing something wrong with the yml files or is there more configuration needed ?


https://redd.it/1dleqj1
@r_devops

What does a devops project look like?

I'm a pipeline/infrastructure engineer who has been in the VFX industry for almost 20 years. But I'm trying to transition into the devops field to expand my job opportunities. I'd like to put together a project that will allow me to learn the skills needed for devops. I was hoping for some advice on what to do for a project.

My initial thought was to create a simple weather app and distribute that onto a cloud infrastructure. Any advice would be welcome.

https://redd.it/1dld29z
@r_devops

Traefik load balancing

Hey guys,

I’m new to this so if it doesn’t make sense, sorry.

I’m running into this issue where I’ve set up traefik as part of a docker swarm. I’m running 3 nodes and have the service portainer in which the dns is configured in a round robin. My issue is a browser will pick one of the 3 ip address to connect to when trying to access portainer and if it picks the wrong one I get a gateway timeout error. The loadbalacing is configured in the compose file for portainer as a traefik label. And traefik is running on all three nodes on the same network as portainer. (From the research I’ve done it’s a common problem where docker will need to pick from two networks, but that isn’t the case for my setup).

Any ideas?

Ps: portainer needs to run only as one replica because of how it access its DB.

Thanks!

https://redd.it/1dlh16c
@r_devops

What are the first things you do when joining a startup?

TLDR; this startup I just joined asked me to step up to take lead the whole infra and techy decisions for about 20 people. How should I approach it?

Some context here, I've just joined a really competitive startup in France.
They are about 3yo, 60ppl, had a really talented DevOps for about 2y. The guy did an amazing job, the infra is super clean, reliable, secure and scalable. Honestly I couldn't have done that.

So now I've just joined the company as the new DevOps (another guy is coming in the next weeks as well), and they basically tell me they want someone who can completely own the infrastructure for all the teams (data, and 3 or 4 squads of Devs).
Upper management expect me to guide all infra and techy decisions for the company. They basically don't want to decide for those topics, and want me to completely handle the process from thought to implem. I've never done that, and not sure how to proceed.

I've started to plan a few calls with each team to understand their pain, more precisely the business, and from that draw out a direction on where to go.
But idk what I'm doing. How do you guys deal with that? How do you prioritise topics when you first feel like the infra is already in an amazing state (obviously there are always improvements but you know, no obvious stuff popping for now).

Cheers! Any feedback on your first day at a challenging startup company. I'm basically looking for some advise or just experience on what you guys did ou wish you did early on to take that kinda role

https://redd.it/1dlglz4
@r_devops

Newbie looking for guidance and mentorship

Hi good day amazing DevOps community, I'm an android developer looking to transition into the cloud and DevOps space and seeking guidance, mentorship and community. I would greatly appreciate if anyone would be willing to help mentor me, I'm willing to put in the work and also would like if I could get some links to common DevOps communities like this one.

https://redd.it/1dldf4b
@r_devops

School Project

Hello, I need ideas for a school project, I am looking for something innovative, simple but that is a challenge to program. I will compete against my peers in an expo and the project can be with Arduino or an application/program created by me, for the moment I have thought of a data encryption system or some project with STEM or Arduino education. I have knowledge in web development (html, css, js) and connections with DB, and some basic C#, C++ and Java, I am not looking to do the typical arm with Arduino, but I want to do something at the height of the previous expo, the winning projects were a social network and a student safety net. any suggestions?

https://redd.it/1dllv6t
@r_devops

Practical Tips for Fixing java.lang.OutOfMemoryError: Metaspace

https://blog.heaphero.io/fixing-java-outofmemoryerror-metaspace/

https://redd.it/1dlnfbx
@r_devops

How to Build an ECS + EC2 Auto-Scaling Infrastructure on AWS

I wrote a blog based on Infra I built at work to serve backend for a B2B usecase.

This blog has detailed description of all the components required to build ECS + EC2 Auto Scaling Infra & how to build it in AWS console.

Funny thing - because I used Rick roll container as example, it was picked up by AWS employee & he wrote a linkedin article building on top of this too.

Hope it helps, looking forward to your feedback.

https://medium.com/@ayushunleashed/how-to-build-ecs-ec2-auto-scaling-infrastructure-on-aws-ba730aa076a9

https://redd.it/1dlqwgj
@r_devops

Is Pulumi worth it?

Had someone build something big with it already? How do you compare your expirience compare to TF? Are there any showcases or public repos to look at?

https://redd.it/1dltcoy
@r_devops

How to create and update ansible inventory automatically from terraform via GitHub actions?

I run the terraform to create the AWS infra and store the tfstate in tf cloud via GitHub actions workflow.I need to list automatically all my AWS ec2 instances public IP addresses as an inventory file to run ansible.I don't sure I articulate it well,if any confusion,let me know

https://redd.it/1dlu5f3
@r_devops

Starting DevOps Career Without any Bachelor's Degree: Seeking for Advice and a Roadmap

Hello,I want to start my career in DevOps. I earned my Google cybersecurity certification last year. Due to some financial issues, I can't pursue further certifications at the moment. Additionally, I don't have a bachelor's degree. I have been working as an IT support technician but have no prior knowledge in DevOps. I need some suggestions on where to start, how to effectively learn DevOps practices, and how to land my first job. I'm currently studying DevOps practices on YouTube. I need a roadmap for my DevOps journey and a good approach for obtaining valuable certifications.Also, I would appreciate some insights on the job market, specifically in the UAE. Your suggestions are appreciated.

https://redd.it/1dlt24x
@r_devops

VSCode, Terraform not recogizing AWS CLI

I have the AWS CLI installed, terraform installed, vscode as my IDE.

However when I try and run a basic syntax "terraform aws s3 ls" I get the following error message:

Terraform has no command named "aws".


Please help, have 1 week to get terraform under my belt before an interview! Any assistance greatly appreciated.

https://redd.it/1dlwkyf
@r_devops

Integrating Synopsys Coverity in a GitLab Pipeline for Static Analysis

Anyone here implement Coverity in a GitLab pipeline? I'm trying to follow the docs, but I feel like they could be more detailed.

What has your experience been like with it?

https://redd.it/1dlyjoq
@r_devops

It's sometimes said "Life runs not on 'perfect', but 'good enough'. What's the 'good enough' of DevOps?

./pipeline.sh



#!/bin/bash

git clone github/company/company_project

cd important_folder

cp important_folder/* /filepath/some_folder/



Joke aside, what have you seen?

https://redd.it/1dm3thd
@r_devops

Advice on dealing with a non technical manager

Currently, we are a small company where the ops team consists of one manager and a few ICs (including myself). We initially hoped to expand the ops team, but due to a pivot in product direction, we had to let some members go and condense the team. Now, the team realistically won't be growing much.

From my understanding, the role of an engineering manager, especially for ops, is to set priorities, shield their team from the bureaucracy of the other C-levels, and manage reviews and career growth. However, I've encountered a few roadblocks due to our manager's lack of technical expertise:

- Communication Issues: The manager acts as a middleman, relaying requirements from other VPs to our team and then passing our feedback back. This has backfired because he doesn’t fully understand the technical asks from other teams.

- Unclear Priorities: It's unclear whether the principal engineer or the engineering manager should set technical priorities. This has led to some discord.

- Indecisiveness and Micromanagement: The manager seems indecisive, avoiding assigning tasks to avoid conflict, yet becomes micromanaging when tasks aren't completed as expected.

While he is a good people person, his lack of technical skills and decisiveness is impacting the team. My teammates feel the same way. I’m looking for advice from fellow engineers who have had similar experiences. Currently, my plan is to collate examples and discuss them with my team, then have a talk with him to provide feedback. If there’s no change, we may need to escalate the issue to his boss. However, I want to give him a chance to respond to our feedback first before taking it higher.

Anyone else have this issue? Any feedback would be appreciated

https://redd.it/1dm9mey
@r_devops