Looking for Project - GitLab, Python/Flask, Terraform, Docker, Kubernetes, Ansible, ELK stack, AWS

Can anyone point me to an example or full tutorial (paid or free) on using the following exact tech stack?

GitLab -- I know this pretty well

Python/Flask -- Don't use either in my day to day.

Terraform -- Decent experience

Docker -- Good experience

Kubernetes - Good experience

Ansible -- very little experience. Don't use in day to day.

ELK Stack -- No experience

AWS - Excellent experience

https://redd.it/zofgai
@r_devops

Unable to use cd in Jenkins

I am using an ec2 instance with Ubuntu AMI.
As the title say, whenever I try to cd to a directory I get the following msg:

Running as SYSTEM Building on the built-in node in workspace /var/lib/jenkins/workspace/todo-dev [todo-dev] $ /bin/sh -xe /tmp/jenkins6737039323529850559.sh + cd /home/ubuntu/project /tmp/jenkins6737039323529850559.sh: 2: cd: can’t cd to /home/ubuntu/project/django-todo Build step ‘Execute shell’ marked build as failure Finished: FAILURE

It's a Jenkins freestyle project, running on built-in node, with no options selected except execute shell and the shell script is:

cd ~
cd /home/ubuntu/project
pwd

I have added the below code to sudoers file but still same issue
> jenkins ALL=(ALL) NOPASSWD: ALL

I also tried this, but nothing happened

chmod 755 project (default option)
chmod 777 project (access to all)

I found almost identical problem on stackoverflow but the given solutions don't work for me.

Kindly, help me out.

https://redd.it/zmqrot
@r_devops

How to you practice Linux skills? What Linux skills are even necessary for DevOps?

Hello everyone, I am a backend dev migrating to devops. One of the skills I always see that you have to have is Linux. I've used Linux for several years and I haven't had many opportunities to really have to use it. It's been mostly treating me like a regular OS. I recently started actually deep diving into it and learning how everything works, but it's all theoretical. I would like to use my newfound knowledge in a project based way but I have no idea what even that would be. How can I actually tinker and empirically get a hang of Linux? I have on old laptop with ubuntu on it, or I could just use VMs, but what do I do with them? Make a server out of them, mount stuff? Any fun projects that I could look into, maybe something like homelab?

https://redd.it/zoskvx
@r_devops

Looking for DevOps mentor

Looking for devops mentor who can guide me as i am students and i want to be a devops. I have learnt different tools like AWS for cloud, jenkins for CI, Ansible for provisioning, docker for containarizing services and K8s for manages those containers but still need guidance as i am new to this field.

https://redd.it/zm65e3
@r_devops

Ansible playbook Devops

I am trying to run an ansible playbook with

ansible-playbook -i hosts.yml playbook.yml --ask-vault-pass

I enter the password of vault and get the following error

I use Bastion and pass the ssh args

ssh_args = -F ./config_dev_cluster_server.cfg -o ControlMaster=auto -o ControlPersist=30m


fatal: [all\]: UNREACHABLE! => {

"changed": false,

"msg": "Failed to connect to the host via ssh: kex_exchange_identification: Connection closed by remote host",

"unreachable": true

}

What could be the issue ?

https://redd.it/zlrjdt
@r_devops

Automate Deployments

Quick question what tools are you guys using to automate deployments in Kubernetes? Just curious, I haven't used any new products in a while.

https://redd.it/zlubtb
@r_devops

I have made a free tool to compare cloud compute offers. Feel free to try it :)

The cloud calculator compares more than 40 000 cloud compute offers from AWS, Azure, GCP, Linode, Scaleway, OVH and Alibaba. I am working on extending the calculator to storage and network offers so that it's possible to design a project and get an accurate cost estimation (top right of the page > project calculator) .

Link: https://app.holori.com/compare

Any feedback on bugs and missing features is welcome!

https://redd.it/zlts2l
@r_devops

Prometheus Stack deployment using private image registry

How can i deploy kube-prometheus-stack helm chart to k8s cluster with no internet access but only access to private image registry.

https://redd.it/zozac8
@r_devops

How limited are your DevOps / Cloud Engineering career options, if you refuse to do LeetCode interviews?

Title. Are LeetCode questions prevalent in this area of SWE? I know in some areas, like web development, to get into a top company it's basically a requirement if you want a high paying job. Wondering if it's the same for DevOps / Cloud / Infra

https://redd.it/zoypyf
@r_devops

Why is my release pipeline triggered on a PR to master?

### Description

I use a simple branching strategy, `master`, `feature/*` and `fix/*` branches. I have three YAML pipelines:

* `pr_pipeline` - triggered when doing a PR to `master`.
* `build_pipeline` - triggered on commit to `master`, builds my library.
* `release_pipeline` - once the `build_pipeline` is done, this pipeline deploys.

When trying stuff out I commit directly to `master`, `build_pipeline` runs and once done, `release_pipeline` gets triggered and deploys.

However, whenever I go the proper route and create a new PR (on GitHub), I get two pipelines triggered: `pr_pipeline` and `release_pipeline`, both at the same time. `release_pipeline` shouldn't get triggered, obviously.


### pr_pipeline

pr:
branches:
include:
- master
exclude:
- feature/*
- fix/*

trigger: none

### release_pipeline

trigger: none

resources:
pipelines:
- pipeline: build_pipeline
source: infra_build_pipeline
trigger:
branches:
- master

Thank you.

https://redd.it/zp3y1f
@r_devops

Extra users don't get created in bitnami/postgresql-ha k8s instance

Hi all,
Reposting my post from r/postgresql. Maybe some luck here.

Troubleshooting a weird issue. I'm trying to create some users inside my bitnami/postgres-ha instance, however, not able to get it to work.

The way I approach this - I have created k8s secret with "usernames" and "passwords" keys (as per doc) which house users and passwords separated by the semicolon.

I then reference the secret inside pgpool.customUsersSecret in the values file.

Redeployed and restarted the pgpool pod. The users along with their md5 hashed pass get added to pool_passwd file inside the pgpool pod, however, if I query the users through psql with \du - nothing exists in the db.

I tried restarting the whole instance - same issue.

Creating the user manually and assigning roles give you the usual "password not stored in pool_passwd file" or "password mismatch" error upon login attempt.

Any help would be appreciated as I'm stuck atm.

I'm running bitnami/postgresql-ha chart v 8.6.13

k8s v1.22.15-gke.100

Original post: https://www.reddit.com/r/PostgreSQL/comments/zoe66k/extra_users_dont_get_created_in/

Thanks!

https://redd.it/zp1256
@r_devops

Is Azure Cosmos DB essentially Citus?

I’m looking to create a Citus server on Azure using Terraform CDK, but it seems Citus is now just Azure Cosmos DB? Can someone clear up the difference or are they essentially the same?

https://redd.it/zp86x0
@r_devops

Automate AD users and SG creation

How do you automate AD users and SG creation? It is currently a manual process and I hate it.

https://redd.it/zpbkml
@r_devops

Turn your actual feedback into a business appropriate email with AI

I probably spend more time trying to be polite in email than doing actual work. Saw a post about this on r/webdev, and thought this community might enjoy it.

Website: https://politepost.net/
Author: u/PharaohsVizier
Creator's Post: https://reddit.com/r/webdev/comments/zodwya/showoff_saturday_made_a_web_app_that_turns_your/
Engine: OpenAI

https://redd.it/zpd3ur
@r_devops

How do you integrate e2e testing to your CI CD workflow for a React frontend project?

I was wondering how to integrate it, because you can sometimes only run your E2E testing on staging after you deploy the code, but this defeats the purpose of a E2E test, because you want to run your unit test and E2E test before deploying the code, so that you can see you need to fix something before deploying to staging or production, but if you need to deploy to production to run your E2E test, it's kinda dumb, so what are you supposed to do?

https://redd.it/zpccz2
@r_devops

New to devops and setting up haproxy load balancing need help!

I am now the devops guy at our company and have limited experience after our guy left :( I have a dockerized vue frontend and a dockerized django backend. I wanted to load balance two servers. I have a third server as the load balancer/landing point.

​

* **Does the frontend go on the load balancer? Or does it go on each server ?**

​

Any input on this?

https://redd.it/zp93d0
@r_devops

Deciding between Gitlab and GitHub

I'm trying to decide which platform to move our company to. Currently on BitBucket/Jenkins. We have around 100 developers.

I came from a huge company where Gitlab was used by thousands of developers and was very successful. I was planning going down the Gitlab route based on my experience but wanted to give GitHub a fair chance. To do that, I am doing identical POCs.

The POC has to be able to deploy a microservice to Kubernetes using our various technologies (Vault, ECR, EKS, Terraform). I have this working in Gitlab on local runners.

Below is what is necessary to put into an application repo. It's super short. It builds on push, does a terraform plan across all environments on your branch. On merge, it does a plan against dev then waits for you to run an apply before moving onto the next environment. The developers don't need to know more than that unless they really want to. We are pushing a DevOps culture and expect developers to understand this but we also want to enforce certain standards such as linting, container scanning..

variables:
ENVDEV: "true"
ENVSTAGING: "true"
ENVPROD: "true"

include:
- project: 'gitlabgroup/devops/gitlab-templates/kubernetes-application'
ref: master
file: standardtemplateoption.yml

Now comes GitHub. I have been attempting this same POC with GitHub Actions, Reusable Workflows, Composite Actions, etc, etc.

The biggest issue I am having is the event handling. It would appear that there is no way to push the event handling into the "Reusable" part of the workflow/pipeline. Meaning, each repository will have to have a series of files necessary to handle on.push, on.pull\request.closed, on.push with certain tags (to create releases) and each of those files can call a shared workflow.

Am I missing something ? Maybe it's not as bad as it sounds. We only have a few hundred repos.

​

Any other factors to consider when comparing the 2? Account management? New feature release cycles? GitHub clearly has a large user community. The pricing between the 2 is pretty similar between Gitlab Premium vs. GitHub Enterprise. I wonder if they ever sell Gitlab Ultimate as the pricing is insane.

https://redd.it/zoduoz
@r_devops

What tools or systems do you use to manage your time, improve your productivity or to make your life easier?

Just interested in what tools you use for your daily struggles.

Yesterday while searching for "time management" on here I found [this thread](https://www.reddit.com/r/devops/comments/uu415b/time_and_task_management_at_work/) and was pretty pleased by the new insights the comments offered.

​

Just to start; I only have one tool that I won't live without:

* [Obsidian](https://obsidian.md/)

It's just completely overclocked note taking software that can be expanded in any way with JS.
And you can use wikilinks to connect and later visualize any snippet of knowledge.

Sadly I have nothing on the topics of time management or productivity... have always been bad at them.

https://redd.it/zplfpz
@r_devops

API gateway deployment patterns

When it comes to the deployment of API Gateways, there are 4 well-known patterns: Centralized edge gateway, Two-tier gateway, Microgateway, and Sidecar. In this post, we will go through these patterns and give you an idea to choose the right API gateway deployment pattern for your business.


https://api7.ai/blog/api-gateway-deployment-patterns

https://redd.it/zpmm1u
@r_devops

Internal metrics / KPIs for workflow scheduler platforms like Github Actions, Gitlab Pipelines, Circle CI, etc ?

Hey, is there any public documentation about setting internal / business metrics / KPIs for workflow schedulers based on containers? Even "whitebox" metrics like pulling containers / instance allocation / run time, etc. These should be generic no matter what business logic is actually in the containers. Thanks

https://redd.it/zpo3bq
@r_devops

How do job titles influence you when job hunting?

I am currently a Senior DevOps Engineer, but looking at other jobs in the DevOps/SRE space and came across a couple of jobs with titles of "Operations Engineer" or "Infrastructure Engineer".

So, I am curious what the community's thoughts are on job titles in the ops/sre/infra space and how much influence it has on your decision to go for/reject a job opportunity.

I guess for those who are in hiring positions as well - a follow on question might be how does it impact you when sifting/interviewing for a role when they have a job title that some would consider more old-fashioned?

(Please don't bring up the DevOps is not a job title its a culture point, that's been debated to death I am more curious around the other job titles floating around - thanks :))

https://redd.it/zpp2g4
@r_devops