Authenticated docker pulls with selfed hosted gitlab

I was wondering if anyone can point me in the right direction, we use self hosted GitLab CI/CD. (We manage the runners in EKS) With the recent Docker pull limits implemented we started occasionally hitting limits. We are planning to purchase a Docker team account but I am unsure how to actually make sure the runners are using the team account since they are currently pulling as anonymous.

I was looking into https://kubernetes.io/docs/tasks/configure-pod-container/pull-image-private-registry/ but not sure if this is the right direction...

FWIW We stand up our EKS cluster with terraform and deploy the Gitlab runners with a helm chart

https://redd.it/k61muy
@r_devops

CICD for WordPress to deploy custom plugin + knockout js, using GitLab

Hi,

Where can I find someone professional to help me set this up? I prefer to hand over the task, instead of hacking it together and experimenting myself.

I have a WordPress site which contain 2 custom things which is version controlled:

\- Some regular files such as a custom WordPress plugin and some other things. In total 5 folders and subfolders.

\- One of the folder contain a custom knockout script which needs to compile. Developers should have as easy workflow as possible, to save time.

We want to figure out a better workflow and automate as much as possible. Looking for suggestions who to hire and approximate number of hours needed?

​

\*\*Background:\*\*

Current setup is not optimal:

>! \- Developers develop fetch latest git version, and develop in local workstation. They upload it to a "dev-server" (different environment than live server) and inside of that server, they run a set of commands (to compile knockout etc), and then they check their work. If OK, then they commit the compiled code to staging branch, which using cicd script will rsync the select folders to staging server (same environment as live server). Check everything again, and repeat with master branch which rsync to live serer. !<

https://redd.it/k5y63v
@r_devops

Beginner Question: Deploying server application with Terraform and Packer

I've been developing most of my applications to run using Docker but want to have a better understanding on some other deployment patterns. I'm looking for a guide or some clarification on how to effectively use Terraform and Packer to deploy applications *without* relying on Docker. Is this possible? What is the pattern.

From my basic understanding (using AWS) is Terraform can help me make the virtual server instance (EC2) and can be defined using an AMI which can be used to create an image with a copied binary that has been compiled for deployment. But is that it? Will the application start on its own or do I need something else like Ansible to start the application?

https://redd.it/k5x7e8
@r_devops

Load distribution Kubernetes

Hello, we currently have the problem that one node has more load than the others. How can we distribute the load (Pods) better. Is there a trick for this?

\[Imgur\]([https://i.imgur.com/r8ABJww.png](https://i.imgur.com/r8ABJww.png))

https://redd.it/k5wyzx
@r_devops

Have anyone got tired of repetitive nature of the devops Job ?

I am working as devops engineer for past 5 years and have already with 6 different organisations . Everywhere it's the same.

Can anyone suggest me some alternate career in IT ? I am thinking about going in IT security as it's something which my past experience should work then I am also inclined towards programming as I want to work with those big organisations .

https://redd.it/k5vu1u
@r_devops

Diagramming tool for infrastructure that creates code

How would you feel about a tool that would let you diagram infrastructure and export as code?

[https://i.imgur.com/kBqlUkK.png](https://i.imgur.com/kBqlUkK.png)

Essentially you can drag and drop pieces, and then when you have it designed as you wish, export as code to a Terraform file. Similar to Cloudcraft, if you're familiar. Is this something you use? Pros and cons you see with this?

https://redd.it/k6iowx
@r_devops

External Code coverage tools for repositories hosted in Azure DevOps

Hi


We're looking at an external service for handling code coverage stuff ( prefer something that could also generate traceability matrixes etc ) for our pipelines. The one in Azure DevOps leaves a lot to be desired. We're looking for a tool like [codecov.io](https://codecov.io), however it doesnt seem to support having the repository itself in azure devops. We use git if that helps.


I was hoping the community had some suggestions for other tools we could have a look at.


Appreciate any help on this topic. Thanks!

https://redd.it/k6liuh
@r_devops

[Hiring] Devops expert with training delivery experience

Should have over 6-8 years of working experience in a large MNC. Should have delivered at least 4-6 training across all devops topics.

Reach out to me with your experience, sample video link, and profile so that we can discuss more details.

DM me with above details.

https://redd.it/k6mu5t
@r_devops

Unleash - an open source feature toggle service

/u/NeckbeardAaron [mentioned Unleash in my last post about Flagr.](https://www.reddit.com/r/devops/comments/k614vs/flagr_a_feature_flagging_ab_testing_and_dynamic/gek58gf/?utm_source=reddit&utm_medium=web2x&context=3) I figured I would re-post it here so others are aware of the project too! (I wasn't)

https://github.com/Unleash/unleash

If you like this, [I do a weekly roundup of open source projects that includes an interview with one of the devs you can subscribe to.](https://console.substack.com/)

https://redd.it/k6nw7w
@r_devops

Anyone else feeling burned out?

Man I was so excited about WFH and all those cool projects but now they feel meh. Project after project, it just feels like another thing to do.

How are you guys coping with this?

Before this situation I’d have been travelling and discovering small parts of my province. However, for humanity’s sake I’ve been stuck at home for the past 10 months (WFH started early for us).

https://redd.it/k6l1fv
@r_devops

Bringing up my weaknesses

I've been a DevOps Engineer for 2 years now, no other background. Just graduated and went straight into a Jr SWE on an Infrastructure team which quickly became a DevOps team. In this time I've gotten to build docker images, GitLab and Jenkins pipelines, write Helm manifests for kubernetes clusters, administer Rancher (K8s orchestrator), and write/build IaC with Terraform, Packer, and Ansible. But what I havent done a lot of is Linux debugging/administration. Being so new to the industry I've always had seniors who would take on the more difficult debugging, whether it be network connectivity errors with out of band servers or kernel issues, etc. So, I think this is something I should work on more. What recommendations do y'all have for this area?

https://redd.it/k6p56s
@r_devops

What's the DevOps take on "Delete Staging"?

I've been having a lot of conversations and have noticed a movement for "Delete Staging." The idea is that Feature Flags do the job just fine, just push to prod and puppeteer these features from the sideline. The thought is building and maintaining environments is frustrating, time-consuming, and takes resources away from the core product. As a startup or small company, resources are spread thin and you're just trying to keep your head above water as-is, so I get why people would try to cut this corner.

I'm curious what the viewpoint would be here from DevOps engineers on Feature Flags and Environments, what kind of success/horror stories you've run into, or just your intuition.

https://redd.it/k6ndo0
@r_devops

DevOps and Career Adivce

Hi Guys,

I need some career advice, here is some info about me

So currently I am 4x AWS Certified, having done the following in the past 5 months:

\- AWS Cloud Practitioner

\- AWS Solutions Architect - Associate

\- AWS SysOps Admin - Associate

\- AWS Developer - Associate (Perfect Score of 1,000)

I am currently studying for DevOps Pro and plan to clear it in January.

I am an accountant, switching careers and trying to make it into DevOps.

For this I have been studying for almost 2 years.

Initial Plan was to get into Full Stack (React / Node.js) Development but seeing the market saturation, I decided to get AWS certified and try DevOps.

For Front-end I know:

HTML / CSS (Grid / Flexbox) / JS (ES10), Typescript, React (Router, Styled Components, Redux, Cotext API)

Back-end I know:

Node.js (Express), Building REST API, JWT Tokens, SQL (PostgreSQL), MongoDB

(I built a small e-commerce website using this, along with Stripe API integration - adapted from a course I was following learning this. There are other small projects as well).

But seeing the poor market response, I decided to learn more about DevOps. This is when I started doing AWS and fell in love with the platform, and the power it offers.

I am focusing on AWS right now. But to be able to pass these papers quickly I built up my background knowledge. I followed COMPTIA's A+ 1&2, Network+, and LPIC 1 & 2 for some Linux knowledge, but did not appear in the cert exams for these courses.

Furthermore I plan to learn Python (I know basics already), Terraform, Kubernetes (Maybe get my CKAD) and Ansible.

I heard that AWS certifications are really valuable and some firms require people who have Professional Certs. That is why I am doing DevOps Pro.

Am I doing on the right path. Is there some career advice you guys can give on how I can get my first break? Will I be able to get a job if I have done these? I plan to finish all of this by Feb 2021 and get into full job hunt mode.

I am feeling a but lost now, any advice would be appreciated.

TLDR: Was an accountant, zero tech experience, started learning Fullstack JS, got interested in DevOps and started learning AWS, did all of the above, what do I need to do to get into DevOps?

https://redd.it/k6pc2w
@r_devops

Documentation Pipelines

We've have a documentation CI pipeline that takes Markdown and RestructuredText documentation from various repos and compiles them into HTML and PDF versions using sphinx. We've figured out how to do spell checking, but I'm curious if anyone knows of a way to do grammar checking? Could we enforce a third-person active voice throughout? I'm assuming we'd need the ability, like in spell checking, to exempt certain found complaints.


If you've done similar, I'm really interested in your entire toolset, not just your grammar checker.

https://redd.it/k6stbk
@r_devops

Online OpSec: Threat models and tools for staying safe, private and informed while Online, used by the average person

DevOps and OpSec are relevant to each other in that security is, at least in my observations, becoming more central to software development. Instead of being thought of after the fact, DevOps teams are bringing security concerns into the beginning of the whole process.

To help explore the overlaps, [this GitHub resource](https://github.com/devbret/online-opsec) has been established. It features a growing list of techniques/strategies and tools for personal Online OpSec. Which carries over from both personal and professional life, one into the other.

The goal is to create a first class resource for everyday professionals to learn how Operations Security applies to them and what can be done. Feedback is encouraged here.

https://redd.it/k6u795
@r_devops

Managing common code for Jenkins pipeline definitions

We keep our Jenkinsfiles with the application code.

The problem is there is an increasing amount of common code. Where to upload the artifact, where and how to send a slack message, etc.

Copy and pasting this much code makes me uneasy. How have you guys handled this?

https://redd.it/k6rtbs
@r_devops

GitOps'y style with many repositories and submodules is kind of annoying..

May be a little bit niche but over the last couple of years we've been building up our new Kubernetes related service configuration in a sort of (in hindsight, the actual architecute grew relatively organically) GitOps'y way.

I'll start off on our repository types:

- Application source code (Bitbucket)
- Infrastructure configuration (Gitlab)
- Cluster configuration (Gitlab)

We have 8 Kubernetes clusters, which each have a repository for themselves
and within each cluster repository we have a structure which looks a bit like:

```
cluster-01:
apps/
platform-$service/
charts/
helmfile.yaml
.gitlab-ci.yml
deployments_$project_$container.yml
workloads_$project.yml
registries.yml
```

Each of those applications are essentially a submodule, and the deployments yaml file is created dynamically from the registries yaml file (basically, for each of the registries inside the file, search for every container we need to deploy, and deploy it).

However with 8 cluster repositories, and with every application being a submodule within those cluster repositories it can become quite labourious to actually make a simple chart change, or deploying a new routing change as it involes making the change, opening a PR for that change, and then updating the submodule, opening a PR for each cluster.

I've thought about maybe we can work within a monorepo for some of these things but I'm caught in a trap between being DRY and being easy.

Have any of you ended up with a similar structure? If so what did you do make it easier to use?

Alternatively, are you trying to solve a similar problem but solved it differently, I'd love to know how.

I'm not sure if I've explained myself particularly well so feel free to ask for clarification if needed!

https://redd.it/k6i6ax
@r_devops

Too Many Job Opportunities (Rant)

I completely realize that in this time of economic hardship for so many, this post will sound a bit tone deaf. I also realize this post reeks of privilege, and for that I apologize. I don't really have anywhere else to vent.

I am currently a DevOps engineer for a relatively small analytics company. I like my job. I like the diverse work I do, I like my team, I like my schedule flexibility, I like all my benefits, and I love what my company does. The only area that leaves something to be desired is the salary (which is largely offset by the great benefits).

Since the Covid pandemic started up earlier in the year, I've had a very noticeable uptick in recruiters and HR people reaching out about opportunities. In the last week, I've had over a dozen opportunities brought to me. This isn't counting the numerous random emails about 6-month contract work in Nowhere, Texas. These are legit, high-paying, interesting roles with really impressive companies; many of them fairly local, too.

Under better economic circumstances, I'd likely just stay put in my job that I like. As I'm the only person in my household working right now, though, it feels fiscally irresponsible to not pursue opportunities that would be significantly higher-paying.

Constantly replying to LinkedIn messages and emails to coordinate calls in between the minutes that I'm working, and trying to find holes in my schedule that permit panel Zoom interviews is exhausting. Constantly being "on" for conversations with recruiters and hiring managers is exhausting. Constantly thinking about trying to improve my situation to better provide for my family is exhausting.

Sorry for this rant. I was just curious if anyone else is experiencing this type of burnout (on top of the normal work burnout). Also, I'd be interested to hear anyone's thoughts on job changes/upgrades during this pandemic. How do you balance things like salary expectations, benefits, work satisfaction, company satisfaction, etc.?

https://redd.it/k6pbtn
@r_devops

Build/Deployment environment guidance

I'm looking for some guidance from the devops community here.

I recently completed the MVP design of an architecture for my organization's backend data collection, processing and persistence pipelines, only we don't have our CI/CD strategy finalized. We're currently on BitBucket/Bamboo and are likely going to be making a change and it's looking like GitLab may be what we move to.

The architecture is multi-stage (dev, test, qa, prod), multi-layered (data collection, enrichment/processing, persistence) and multi-region with some layers being in more regions than others. Aside from the complexity brought on by being multi-regional and multi-layered, it's a pretty neat, clean and simplistic architecture, that provides HA and somewhat easy regional failover, however the deployment is a bit intricate and of course because each region and layers needs to know about the others, each stack has dependencies on outputs from other stacks, in other regions.

My goal is to allow the developers to create their applications and be able to plug into the architecture. So, I'm using an EventBridge in each region/layer/stage that the developers can easily create a rule for the EventBridge to route data to their component.

Problem is, I haven't solved for the dependencies that the applications and their deployments will have on the infrastructure. I automated the infrastructure deployment using CloudFormation, and the developers typically use Serverless, so theoretically I can have all of the stacks export everything and let the developers just import those values everywhere they need them, however:

\- That creates a pretty tight coupling that I've never liked and Cloudformation is known for getting in these weird states that can be hard to get out of.

\- I can foresee developers wanting to depend on resources in other regions and Fn::ImportValue doesn't allow that.

\- Some of those values (i.e. "touch points") are needed at deployment time and others would be more valuable being obtained at runtime (Depending on them at runtime would allow human intervention in the event the whole thing goes up in flames, change the values and let all the resources "autodiscover")

I had a vision in my head that these touch-points (resource ARN's, hostnames, etc.) would reside in some key/value store that would be maintained in/by the deployment environment. When something gets deployed, its outputs would get stored in this key/value store. Even better, if the data store were backed by something like a DynamoDB global table, the values could be depended on at both runtime and/or deployment time.

Am I off base in thinking along those lines? Are there any frameworks that easily save these variable values and (ideally) persist them to AWS? I know GitLab has environment variables, but I haven't gotten a sense of whether they solve for what I'm thinking here. Should I just use Cloudformation Fn::ImportValue and cross the bridge of the above issues when I come to it?

Any guidance, pointer in the right direction, etc. would be much appreciated.

Thanks!

https://redd.it/k6lffr
@r_devops

Any resource on AWS IaC with Docker?

Hi,

I would like to explore AWS using Terraform infrastructure as code. Is there any book (not a video) that discusses this topic?

I’m using Docker with Terraform on DigitalOcean and I’ve successfully hosted multiple sites online, but AWS Docker has a different nuance in Terraform. So what I really like is a tutorial or book that explains the steps simply.

I prefer to stick with Terraform rather than AWS CLI, so that my IaC is not coupled to any provider.

Also, this can be a paid resource.

https://redd.it/k6z37d
@r_devops

Do professionals from Dev background who transition into Devops get assigned the same work as someone from Ops background who transition into Devops?

As a newcomer to this industry, It would really be helpful to get some inputs from professionals who already work in the industry.

https://redd.it/k70cs9
@r_devops