Azure devops pipelines issue

Okay somewhat of a newbie question:
I have 4 yml files for 4 pipelines (build, dev-release, stg-release, prod-release).

build.yml

trigger:
  branches:
    include:
      - development

pr: 
  branches:
    include:
      - staging
      - master

#rest omitted for brevity

dev-release.yml

trigger:
  branches:
    exclude:
      - '*'
pr: none

resources:
 pipelines:
     - pipeline: 'build'
       project: 'project'
       source: 'build'
       branch: 'development'
       trigger: true

#rest omitted for brevity

stg-release.yml

trigger:
  branches:
    exclude:
      - '*'
pr: none

resources:
 pipelines:
     - pipeline: 'build'
       project: 'project'
       source: 'build'
       branch: 'staging'
       trigger: true

#rest omitted for brevity

prod-release.yml

trigger:
  branches:
    exclude:
      - '*'
pr: none

resources:
 pipelines:
     - pipeline: 'build'
       project: 'project'
       source: 'build'
       branch: 'master'
       trigger: true

#rest omitted for brevity

so what I want is, build should trigger on commit on dev branch and on merges to stg and master.

The problem occurs while releasing. When I merge dev into staging both dev and stg release pipelines are triggered. Probably it would trigger all 3 release pipelines if I merge stg into master but haven't tested that yet.

Am I doing something wrong with the yml files or is there more configuration needed ?


https://redd.it/1dleqj1
@r_devops

What does a devops project look like?

I'm a pipeline/infrastructure engineer who has been in the VFX industry for almost 20 years. But I'm trying to transition into the devops field to expand my job opportunities. I'd like to put together a project that will allow me to learn the skills needed for devops. I was hoping for some advice on what to do for a project.

My initial thought was to create a simple weather app and distribute that onto a cloud infrastructure. Any advice would be welcome.

https://redd.it/1dld29z
@r_devops

Traefik load balancing

Hey guys,

I’m new to this so if it doesn’t make sense, sorry.

I’m running into this issue where I’ve set up traefik as part of a docker swarm. I’m running 3 nodes and have the service portainer in which the dns is configured in a round robin. My issue is a browser will pick one of the 3 ip address to connect to when trying to access portainer and if it picks the wrong one I get a gateway timeout error. The loadbalacing is configured in the compose file for portainer as a traefik label. And traefik is running on all three nodes on the same network as portainer. (From the research I’ve done it’s a common problem where docker will need to pick from two networks, but that isn’t the case for my setup).

Any ideas?

Ps: portainer needs to run only as one replica because of how it access its DB.

Thanks!

https://redd.it/1dlh16c
@r_devops

What are the first things you do when joining a startup?

TLDR; this startup I just joined asked me to step up to take lead the whole infra and techy decisions for about 20 people. How should I approach it?

Some context here, I've just joined a really competitive startup in France.
They are about 3yo, 60ppl, had a really talented DevOps for about 2y. The guy did an amazing job, the infra is super clean, reliable, secure and scalable. Honestly I couldn't have done that.

So now I've just joined the company as the new DevOps (another guy is coming in the next weeks as well), and they basically tell me they want someone who can completely own the infrastructure for all the teams (data, and 3 or 4 squads of Devs).
Upper management expect me to guide all infra and techy decisions for the company. They basically don't want to decide for those topics, and want me to completely handle the process from thought to implem. I've never done that, and not sure how to proceed.

I've started to plan a few calls with each team to understand their pain, more precisely the business, and from that draw out a direction on where to go.
But idk what I'm doing. How do you guys deal with that? How do you prioritise topics when you first feel like the infra is already in an amazing state (obviously there are always improvements but you know, no obvious stuff popping for now).

Cheers! Any feedback on your first day at a challenging startup company. I'm basically looking for some advise or just experience on what you guys did ou wish you did early on to take that kinda role

https://redd.it/1dlglz4
@r_devops

Newbie looking for guidance and mentorship

Hi good day amazing DevOps community, I'm an android developer looking to transition into the cloud and DevOps space and seeking guidance, mentorship and community. I would greatly appreciate if anyone would be willing to help mentor me, I'm willing to put in the work and also would like if I could get some links to common DevOps communities like this one.

https://redd.it/1dldf4b
@r_devops

School Project

Hello, I need ideas for a school project, I am looking for something innovative, simple but that is a challenge to program. I will compete against my peers in an expo and the project can be with Arduino or an application/program created by me, for the moment I have thought of a data encryption system or some project with STEM or Arduino education. I have knowledge in web development (html, css, js) and connections with DB, and some basic C#, C++ and Java, I am not looking to do the typical arm with Arduino, but I want to do something at the height of the previous expo, the winning projects were a social network and a student safety net. any suggestions?

https://redd.it/1dllv6t
@r_devops

Practical Tips for Fixing java.lang.OutOfMemoryError: Metaspace

https://blog.heaphero.io/fixing-java-outofmemoryerror-metaspace/

https://redd.it/1dlnfbx
@r_devops

How to Build an ECS + EC2 Auto-Scaling Infrastructure on AWS

I wrote a blog based on Infra I built at work to serve backend for a B2B usecase.

This blog has detailed description of all the components required to build ECS + EC2 Auto Scaling Infra & how to build it in AWS console.

Funny thing - because I used Rick roll container as example, it was picked up by AWS employee & he wrote a linkedin article building on top of this too.

Hope it helps, looking forward to your feedback.

https://medium.com/@ayushunleashed/how-to-build-ecs-ec2-auto-scaling-infrastructure-on-aws-ba730aa076a9

https://redd.it/1dlqwgj
@r_devops

Is Pulumi worth it?

Had someone build something big with it already? How do you compare your expirience compare to TF? Are there any showcases or public repos to look at?

https://redd.it/1dltcoy
@r_devops

How to create and update ansible inventory automatically from terraform via GitHub actions?

I run the terraform to create the AWS infra and store the tfstate in tf cloud via GitHub actions workflow.I need to list automatically all my AWS ec2 instances public IP addresses as an inventory file to run ansible.I don't sure I articulate it well,if any confusion,let me know

https://redd.it/1dlu5f3
@r_devops

Starting DevOps Career Without any Bachelor's Degree: Seeking for Advice and a Roadmap

Hello,I want to start my career in DevOps. I earned my Google cybersecurity certification last year. Due to some financial issues, I can't pursue further certifications at the moment. Additionally, I don't have a bachelor's degree. I have been working as an IT support technician but have no prior knowledge in DevOps. I need some suggestions on where to start, how to effectively learn DevOps practices, and how to land my first job. I'm currently studying DevOps practices on YouTube. I need a roadmap for my DevOps journey and a good approach for obtaining valuable certifications.Also, I would appreciate some insights on the job market, specifically in the UAE. Your suggestions are appreciated.

https://redd.it/1dlt24x
@r_devops

VSCode, Terraform not recogizing AWS CLI

I have the AWS CLI installed, terraform installed, vscode as my IDE.

However when I try and run a basic syntax "terraform aws s3 ls" I get the following error message:

Terraform has no command named "aws".


Please help, have 1 week to get terraform under my belt before an interview! Any assistance greatly appreciated.

https://redd.it/1dlwkyf
@r_devops

Integrating Synopsys Coverity in a GitLab Pipeline for Static Analysis

Anyone here implement Coverity in a GitLab pipeline? I'm trying to follow the docs, but I feel like they could be more detailed.

What has your experience been like with it?

https://redd.it/1dlyjoq
@r_devops

It's sometimes said "Life runs not on 'perfect', but 'good enough'. What's the 'good enough' of DevOps?

./pipeline.sh



#!/bin/bash

git clone github/company/company_project

cd important_folder

cp important_folder/* /filepath/some_folder/



Joke aside, what have you seen?

https://redd.it/1dm3thd
@r_devops

Advice on dealing with a non technical manager

Currently, we are a small company where the ops team consists of one manager and a few ICs (including myself). We initially hoped to expand the ops team, but due to a pivot in product direction, we had to let some members go and condense the team. Now, the team realistically won't be growing much.

From my understanding, the role of an engineering manager, especially for ops, is to set priorities, shield their team from the bureaucracy of the other C-levels, and manage reviews and career growth. However, I've encountered a few roadblocks due to our manager's lack of technical expertise:

- Communication Issues: The manager acts as a middleman, relaying requirements from other VPs to our team and then passing our feedback back. This has backfired because he doesn’t fully understand the technical asks from other teams.

- Unclear Priorities: It's unclear whether the principal engineer or the engineering manager should set technical priorities. This has led to some discord.

- Indecisiveness and Micromanagement: The manager seems indecisive, avoiding assigning tasks to avoid conflict, yet becomes micromanaging when tasks aren't completed as expected.

While he is a good people person, his lack of technical skills and decisiveness is impacting the team. My teammates feel the same way. I’m looking for advice from fellow engineers who have had similar experiences. Currently, my plan is to collate examples and discuss them with my team, then have a talk with him to provide feedback. If there’s no change, we may need to escalate the issue to his boss. However, I want to give him a chance to respond to our feedback first before taking it higher.

Anyone else have this issue? Any feedback would be appreciated

https://redd.it/1dm9mey
@r_devops

Suggest me the best git branching strategy for my use case

We're currently using Gitflow as our branching strategy with the push coming to migrate to Trunk Based Development (TBD). In theory, TBD looks like a way to go, but I just wanted to know if there are better branching strategy for our situation.


Here's our situation -

We've a bunch of repositories (\~25) and a bunch of journeys (\~12). A journey can be a combination of 1 or more repositories.
We've multiple feature teams which own 1 or more journeys, which also means if they make any change, chances are they're making changes to repositories common to all feature teams.
Any feature done by the team are not always fully independent. We can have a feature, which depends on other teams changes, or which undoes the changes if other's team changes are done temporarily. In rare case we may have two versions of same method in different branches.
Each of our feature takes at least 3 months to release, which can go up to a year in some scenarios.
We've a Jenkins pipeline which works with PR but not as CI/CD.
We do have tests and BDDs but test automation is still at around 75-80%.
Our team has varying degrees of experiences with some are fresh graduate trainees.

Our current flow -

main is our base branch where everything is merged back.
If a new feature is needed, release branch is created for it.
PR is raised in these release branches till the feature is ready.
Once feature is release, release branch is merged back in main.
If other team needs to build on top of this feature then their release branch is forked from existing release branch, otherwise from main.
Hotfixes are forked from main and merged back to main and release branches upon release.

I can understand a lot of obvious challenge can be mitigated by using TBD, but I'm worried about a few things -

Given our release cycle and interdependency, will we be overloading app with too many feature flags?
TBD is ideally suited for short feature releases cycles. Will it be scalable for releases as long as, say, once every 3 months?
Given teams' varying experiences and not full test automation, will TBD hurt us in long run?

Our current strategy is not ideal as we ran into several merge conflicts in the past so the change is necessary, but I was wondering if we should adopt TBD as is or look for some hybrid strategy, if available.

Please suggest me a way here.

https://redd.it/1dmkr8z
@r_devops

C Vs Devops Vs Backend

Hey guys!

I'm a CS student during my 2nd year.

I'm trying to find the specialization I like the most so I wanted to hear your opinion :)

I'm actually interested in infrastructure and software development. I want my job to be interesting so i can balance organization, code, and cooperating with other team members.

I was thinking about DevOps which is a blend of those stuff, currently, I'm learning AWS cloud and I already have the RHCSA that gave me a Linux background. (I'm enjoying it so far)

On the other hand, i was thinking about backend and C programming. (I'm not interested in frontend at all)

C programming (mainly about embedded?) I'm not interested in game development. What are the options for a C developer out there? I don't have any electronics background, so getting into the field will probably be tough. However, I seem to like the low-level stuff, but not the crazy math stuff.

I don't want my job to be all day code and no communication with others. I want it to be balanced between different tasks.

Are there people here who were in the same situation or worked in all of the fields and can give advice?

Salary wise DevOps seem good and fits the dynamics i think of.

https://redd.it/1dmsrt9
@r_devops

How to break into the industry?

I've been administering Linux servers for over 15 years.

Old school strategies--multiple hosts with mirrors of monolithic applications, hiding behind a load balancer.

Using suites of bespoke shell scripts to automate away toil and monitor system health.

Ancient security approaches--isolating all the things, not having any unnecessary utilities, libraries, etc. on the hosts, IP whitelists, tight MAC policies, logs galore...

I'm familiar with major cloud platforms like GCP, AWS and Azure. I've setup PIM, synced on-premise LDAP directories to the Azure AD, created Backblaze buckets to rclone encrypted backups to, deployed SIEMs like Splunk, set up log forwarding, setup firewall policies, spun up VMs, created Docker containers, managed DNS...

I've used Ansible, Puppet, stored configuration files in git repos.

I can't get an entry-level DevOps job. I'm stuck working short-term contracts for staffing companies, maintaining ancient monolithic C applications at large universities and performing user access audits for $35/hr.

https://redd.it/1dmuqz1
@r_devops

Let me introduce: ITIL-driven architecture

My company did ITIL by the book for twenty years. Company tries to shift into devops but is afraid to throw away old shitty processes and tools. I’m a devops guy so I write software and also deploy it to prod and operate it. If I want to deliver software officially then I have to click through an awful ITSM tool with ninety’s flair for more than an hour.
My solution: deliver a base image once. Mount config PVC in container under /config. Rsync new software code to /config.
If someone asks then we only do config changes. I still need create a change request for config change in the shitty tool but creating an IT change request only takes me 3 minutes. I’m the only approver of the change request.

I hope this story could make you smile.






https://redd.it/1dmvtt2
@r_devops

Average Full stack developer

Hey I'm a full stack developer and been working for past 3 years. Anyhow, i haven't got the opportunity to work on the devops side but now I'm planning to take on it. Can anyone of you recommend me the course or guidelines to start with?


https://redd.it/1dmujdx
@r_devops

Its 2050, you still see Job Posts filled with „Jenkins” as requirement

/rant on

Holy moly mother of sweet Jeruzalem

Why this crap cant die ? Its not maintained for over 10 years, most plugins are CVE10s, ppl moved on, cloud native is already 5-10 years old.

If that deprecation goes as fast as now my grandchildren will be still (dear god pls no) still required to maintain that sh*t.

What the fk fk stops you ppl from migrating off of that pile of smoking hot crap?

And who tf starts a company in 2020 using Jenkins for CICD? Havent you learnt anything in like past 20 years?

/rant off

Every time you post a job offer and list you use Jenkins a kitten dies of cancer.
I like kittens, please stop killing them.

https://redd.it/1dn06s7
@r_devops