gitlab-ci.yml pipeline merge branch

I'm not finding any documentation on how to do this? But maybe I'm not wording my question correctly for google. This is what I'm trying to do....

Repo branches

* dev
* master

When I run my pipeline on dev I would like to do this...

* validate
* This will do the needed checks on stuff
* If this passes, merge the dev branch with the master branch
* build
* Do build stuff in master branch

Is this something that is possible?? If so are there any examples someone could point me to?

https://redd.it/k670pk
@r_devops

Is there a good AWS tutorial that covers all the aspects and development and devops?

I started to look at Stephane Maarek AWS DevOps course. After I bought it, it suggested that I needed to have some AWS experience.

I could do both his courses. If I study something in the DevOps course and notice I need more exposure I can refer to Stephane's Developer course.

I was curious if there was a class/course/tutorial that covered building a product in AWS that taught a person developer & devops skills.

https://redd.it/k670i2
@r_devops

Learning contains AWS (basicly DevOps) with CloudAcademy or LinuxAcademy or aclodguru

Hi I wanted to learns DevOps skills and I wonder which subscription should I buy. I want to have courses with a lot of labs included (hands on labs- learning by doing).

Which one do you recommend and why?

Does this certificates matter in job market?

Thanks!

https://redd.it/k65rvr
@r_devops

Authenticated docker pulls with selfed hosted gitlab

I was wondering if anyone can point me in the right direction, we use self hosted GitLab CI/CD. (We manage the runners in EKS) With the recent Docker pull limits implemented we started occasionally hitting limits. We are planning to purchase a Docker team account but I am unsure how to actually make sure the runners are using the team account since they are currently pulling as anonymous.

I was looking into https://kubernetes.io/docs/tasks/configure-pod-container/pull-image-private-registry/ but not sure if this is the right direction...

FWIW We stand up our EKS cluster with terraform and deploy the Gitlab runners with a helm chart

https://redd.it/k61muy
@r_devops

CICD for WordPress to deploy custom plugin + knockout js, using GitLab

Hi,

Where can I find someone professional to help me set this up? I prefer to hand over the task, instead of hacking it together and experimenting myself.

I have a WordPress site which contain 2 custom things which is version controlled:

\- Some regular files such as a custom WordPress plugin and some other things. In total 5 folders and subfolders.

\- One of the folder contain a custom knockout script which needs to compile. Developers should have as easy workflow as possible, to save time.

We want to figure out a better workflow and automate as much as possible. Looking for suggestions who to hire and approximate number of hours needed?

​

\*\*Background:\*\*

Current setup is not optimal:

>! \- Developers develop fetch latest git version, and develop in local workstation. They upload it to a "dev-server" (different environment than live server) and inside of that server, they run a set of commands (to compile knockout etc), and then they check their work. If OK, then they commit the compiled code to staging branch, which using cicd script will rsync the select folders to staging server (same environment as live server). Check everything again, and repeat with master branch which rsync to live serer. !<

https://redd.it/k5y63v
@r_devops

Beginner Question: Deploying server application with Terraform and Packer

I've been developing most of my applications to run using Docker but want to have a better understanding on some other deployment patterns. I'm looking for a guide or some clarification on how to effectively use Terraform and Packer to deploy applications *without* relying on Docker. Is this possible? What is the pattern.

From my basic understanding (using AWS) is Terraform can help me make the virtual server instance (EC2) and can be defined using an AMI which can be used to create an image with a copied binary that has been compiled for deployment. But is that it? Will the application start on its own or do I need something else like Ansible to start the application?

https://redd.it/k5x7e8
@r_devops

Load distribution Kubernetes

Hello, we currently have the problem that one node has more load than the others. How can we distribute the load (Pods) better. Is there a trick for this?

\[Imgur\]([https://i.imgur.com/r8ABJww.png](https://i.imgur.com/r8ABJww.png))

https://redd.it/k5wyzx
@r_devops

Have anyone got tired of repetitive nature of the devops Job ?

I am working as devops engineer for past 5 years and have already with 6 different organisations . Everywhere it's the same.

Can anyone suggest me some alternate career in IT ? I am thinking about going in IT security as it's something which my past experience should work then I am also inclined towards programming as I want to work with those big organisations .

https://redd.it/k5vu1u
@r_devops

Diagramming tool for infrastructure that creates code

How would you feel about a tool that would let you diagram infrastructure and export as code?

[https://i.imgur.com/kBqlUkK.png](https://i.imgur.com/kBqlUkK.png)

Essentially you can drag and drop pieces, and then when you have it designed as you wish, export as code to a Terraform file. Similar to Cloudcraft, if you're familiar. Is this something you use? Pros and cons you see with this?

https://redd.it/k6iowx
@r_devops

External Code coverage tools for repositories hosted in Azure DevOps

Hi


We're looking at an external service for handling code coverage stuff ( prefer something that could also generate traceability matrixes etc ) for our pipelines. The one in Azure DevOps leaves a lot to be desired. We're looking for a tool like [codecov.io](https://codecov.io), however it doesnt seem to support having the repository itself in azure devops. We use git if that helps.


I was hoping the community had some suggestions for other tools we could have a look at.


Appreciate any help on this topic. Thanks!

https://redd.it/k6liuh
@r_devops

[Hiring] Devops expert with training delivery experience

Should have over 6-8 years of working experience in a large MNC. Should have delivered at least 4-6 training across all devops topics.

Reach out to me with your experience, sample video link, and profile so that we can discuss more details.

DM me with above details.

https://redd.it/k6mu5t
@r_devops

Unleash - an open source feature toggle service

/u/NeckbeardAaron [mentioned Unleash in my last post about Flagr.](https://www.reddit.com/r/devops/comments/k614vs/flagr_a_feature_flagging_ab_testing_and_dynamic/gek58gf/?utm_source=reddit&utm_medium=web2x&context=3) I figured I would re-post it here so others are aware of the project too! (I wasn't)

https://github.com/Unleash/unleash

If you like this, [I do a weekly roundup of open source projects that includes an interview with one of the devs you can subscribe to.](https://console.substack.com/)

https://redd.it/k6nw7w
@r_devops

Anyone else feeling burned out?

Man I was so excited about WFH and all those cool projects but now they feel meh. Project after project, it just feels like another thing to do.

How are you guys coping with this?

Before this situation I’d have been travelling and discovering small parts of my province. However, for humanity’s sake I’ve been stuck at home for the past 10 months (WFH started early for us).

https://redd.it/k6l1fv
@r_devops

Bringing up my weaknesses

I've been a DevOps Engineer for 2 years now, no other background. Just graduated and went straight into a Jr SWE on an Infrastructure team which quickly became a DevOps team. In this time I've gotten to build docker images, GitLab and Jenkins pipelines, write Helm manifests for kubernetes clusters, administer Rancher (K8s orchestrator), and write/build IaC with Terraform, Packer, and Ansible. But what I havent done a lot of is Linux debugging/administration. Being so new to the industry I've always had seniors who would take on the more difficult debugging, whether it be network connectivity errors with out of band servers or kernel issues, etc. So, I think this is something I should work on more. What recommendations do y'all have for this area?

https://redd.it/k6p56s
@r_devops

What's the DevOps take on "Delete Staging"?

I've been having a lot of conversations and have noticed a movement for "Delete Staging." The idea is that Feature Flags do the job just fine, just push to prod and puppeteer these features from the sideline. The thought is building and maintaining environments is frustrating, time-consuming, and takes resources away from the core product. As a startup or small company, resources are spread thin and you're just trying to keep your head above water as-is, so I get why people would try to cut this corner.

I'm curious what the viewpoint would be here from DevOps engineers on Feature Flags and Environments, what kind of success/horror stories you've run into, or just your intuition.

https://redd.it/k6ndo0
@r_devops

DevOps and Career Adivce

Hi Guys,

I need some career advice, here is some info about me

So currently I am 4x AWS Certified, having done the following in the past 5 months:

\- AWS Cloud Practitioner

\- AWS Solutions Architect - Associate

\- AWS SysOps Admin - Associate

\- AWS Developer - Associate (Perfect Score of 1,000)

I am currently studying for DevOps Pro and plan to clear it in January.

I am an accountant, switching careers and trying to make it into DevOps.

For this I have been studying for almost 2 years.

Initial Plan was to get into Full Stack (React / Node.js) Development but seeing the market saturation, I decided to get AWS certified and try DevOps.

For Front-end I know:

HTML / CSS (Grid / Flexbox) / JS (ES10), Typescript, React (Router, Styled Components, Redux, Cotext API)

Back-end I know:

Node.js (Express), Building REST API, JWT Tokens, SQL (PostgreSQL), MongoDB

(I built a small e-commerce website using this, along with Stripe API integration - adapted from a course I was following learning this. There are other small projects as well).

But seeing the poor market response, I decided to learn more about DevOps. This is when I started doing AWS and fell in love with the platform, and the power it offers.

I am focusing on AWS right now. But to be able to pass these papers quickly I built up my background knowledge. I followed COMPTIA's A+ 1&2, Network+, and LPIC 1 & 2 for some Linux knowledge, but did not appear in the cert exams for these courses.

Furthermore I plan to learn Python (I know basics already), Terraform, Kubernetes (Maybe get my CKAD) and Ansible.

I heard that AWS certifications are really valuable and some firms require people who have Professional Certs. That is why I am doing DevOps Pro.

Am I doing on the right path. Is there some career advice you guys can give on how I can get my first break? Will I be able to get a job if I have done these? I plan to finish all of this by Feb 2021 and get into full job hunt mode.

I am feeling a but lost now, any advice would be appreciated.

TLDR: Was an accountant, zero tech experience, started learning Fullstack JS, got interested in DevOps and started learning AWS, did all of the above, what do I need to do to get into DevOps?

https://redd.it/k6pc2w
@r_devops

Documentation Pipelines

We've have a documentation CI pipeline that takes Markdown and RestructuredText documentation from various repos and compiles them into HTML and PDF versions using sphinx. We've figured out how to do spell checking, but I'm curious if anyone knows of a way to do grammar checking? Could we enforce a third-person active voice throughout? I'm assuming we'd need the ability, like in spell checking, to exempt certain found complaints.


If you've done similar, I'm really interested in your entire toolset, not just your grammar checker.

https://redd.it/k6stbk
@r_devops

Online OpSec: Threat models and tools for staying safe, private and informed while Online, used by the average person

DevOps and OpSec are relevant to each other in that security is, at least in my observations, becoming more central to software development. Instead of being thought of after the fact, DevOps teams are bringing security concerns into the beginning of the whole process.

To help explore the overlaps, [this GitHub resource](https://github.com/devbret/online-opsec) has been established. It features a growing list of techniques/strategies and tools for personal Online OpSec. Which carries over from both personal and professional life, one into the other.

The goal is to create a first class resource for everyday professionals to learn how Operations Security applies to them and what can be done. Feedback is encouraged here.

https://redd.it/k6u795
@r_devops

Managing common code for Jenkins pipeline definitions

We keep our Jenkinsfiles with the application code.

The problem is there is an increasing amount of common code. Where to upload the artifact, where and how to send a slack message, etc.

Copy and pasting this much code makes me uneasy. How have you guys handled this?

https://redd.it/k6rtbs
@r_devops

GitOps'y style with many repositories and submodules is kind of annoying..

May be a little bit niche but over the last couple of years we've been building up our new Kubernetes related service configuration in a sort of (in hindsight, the actual architecute grew relatively organically) GitOps'y way.

I'll start off on our repository types:

- Application source code (Bitbucket)
- Infrastructure configuration (Gitlab)
- Cluster configuration (Gitlab)

We have 8 Kubernetes clusters, which each have a repository for themselves
and within each cluster repository we have a structure which looks a bit like:

```
cluster-01:
apps/
platform-$service/
charts/
helmfile.yaml
.gitlab-ci.yml
deployments_$project_$container.yml
workloads_$project.yml
registries.yml
```

Each of those applications are essentially a submodule, and the deployments yaml file is created dynamically from the registries yaml file (basically, for each of the registries inside the file, search for every container we need to deploy, and deploy it).

However with 8 cluster repositories, and with every application being a submodule within those cluster repositories it can become quite labourious to actually make a simple chart change, or deploying a new routing change as it involes making the change, opening a PR for that change, and then updating the submodule, opening a PR for each cluster.

I've thought about maybe we can work within a monorepo for some of these things but I'm caught in a trap between being DRY and being easy.

Have any of you ended up with a similar structure? If so what did you do make it easier to use?

Alternatively, are you trying to solve a similar problem but solved it differently, I'd love to know how.

I'm not sure if I've explained myself particularly well so feel free to ask for clarification if needed!

https://redd.it/k6i6ax
@r_devops

Too Many Job Opportunities (Rant)

I completely realize that in this time of economic hardship for so many, this post will sound a bit tone deaf. I also realize this post reeks of privilege, and for that I apologize. I don't really have anywhere else to vent.

I am currently a DevOps engineer for a relatively small analytics company. I like my job. I like the diverse work I do, I like my team, I like my schedule flexibility, I like all my benefits, and I love what my company does. The only area that leaves something to be desired is the salary (which is largely offset by the great benefits).

Since the Covid pandemic started up earlier in the year, I've had a very noticeable uptick in recruiters and HR people reaching out about opportunities. In the last week, I've had over a dozen opportunities brought to me. This isn't counting the numerous random emails about 6-month contract work in Nowhere, Texas. These are legit, high-paying, interesting roles with really impressive companies; many of them fairly local, too.

Under better economic circumstances, I'd likely just stay put in my job that I like. As I'm the only person in my household working right now, though, it feels fiscally irresponsible to not pursue opportunities that would be significantly higher-paying.

Constantly replying to LinkedIn messages and emails to coordinate calls in between the minutes that I'm working, and trying to find holes in my schedule that permit panel Zoom interviews is exhausting. Constantly being "on" for conversations with recruiters and hiring managers is exhausting. Constantly thinking about trying to improve my situation to better provide for my family is exhausting.

Sorry for this rant. I was just curious if anyone else is experiencing this type of burnout (on top of the normal work burnout). Also, I'd be interested to hear anyone's thoughts on job changes/upgrades during this pandemic. How do you balance things like salary expectations, benefits, work satisfaction, company satisfaction, etc.?

https://redd.it/k6pbtn
@r_devops