How to focus GitLeaks on a smaller subset

We have a few mega-repos with several if not dozens of solutions. I wanted to see if I could make a GitLeaks YAML task that would focus in on a particular path. The documentation seems to say that we could do it like
scanlocation: '$(Build.SourcesDirectory)/path/to/your/subfolder'


But in practice it doesn't seem to be finding it. Has anyone done here had some experience with this?

https://redd.it/1bua53g
@r_devops

Terraform workspace: how to do it?

Hello,

I am experimenting with workspace for handling three environments (dev/test, staging and prod)...

I got it work under the assumption that the three environments are similar in terms of type and quantities of services... but this is not the case in real life...

let me explain:

my terraform (for now/testing) is pretty simpler:

* **in dev/test**: it creates an S3 Bucket
* **in staging:** it creates one S3 Bucket + 2 VMs
* **in prod:** it creates - one S3 Bucket + 4 VMs

the idea is to have a terraform that allows to create 1 S3 + 4 VMs, but in each environment it should just create a subset...

how do I get this done? is there a way if .tfvars does not have a variable, it skip the instruction?

any suggestions?



https://redd.it/1bu9uvm
@r_devops

Dealing with Burnout

In the last year, I’ve basically burnt out. In just the last 4 months, I’ve worked almost every weekend, worked late almost every day, and there has been exactly 1 week that I’ve worked 40 hours or less.

I used to genuinely enjoy my job, liked coming to work, and liked the problems I was working on and people I work with. I wake up every day dreading going in, every single thing everybody says gets on my nerves, every task im assigned pisses me off, and every week I tell myself I’m going to protect my time and not work this weekend, just to do the same.

A couple weeks ago my manager said something along the lines of “u/marsmanify likes working weekends and nights” and when I called out that I didn’t he replied “could’ve fooled me”.

I am given tasks that HAVE to be done after hours or on weekends. Sure I could just not do it, and let the tickets roll in Monday morning, but it would be my ass on the line if I did.

I have no degree, no friends/family in the city I live in, and the job market is tough so just quitting is more or less out of the picture.

What can I do to manage burnout and not ruin my career by snapping on someone? Taking vacation isn’t an option because I had to submit my time off through June in January or February

Edit: I average 50-60 hour weeks, and I’ve worked 24-30 hours straight several times. 40 hours is what my work week should be, not what I’m currently working.

https://redd.it/1bue1k4
@r_devops

can packer be told to not create an image?

Is it possible to have `packer` not create the image? If you wanted to troubleshoot some aspects of provisioning and not wait for the image to get built to tweak code and what not. Basically just a time saver. Not sure if any of this made sense...

https://redd.it/1buf6zu
@r_devops

Design requirements of a new configuration-management system?

I am building a new [configuration management system][1]; of the old-regime ([CFEngine][2], [Puppet][3], [Chef][4], [Ansible][5]).

Here are the [proposed] constituent parts, all of which can be assumed to have CLI, GUI, REST API, RPC, web-frontend, mobile-frontend, and shared-library interfaces:

- **System and network de/provisioner**: abstracting APIs of various cloud and bare-metal environments
- **Registry**: What the above↑ populates, can be completely proxied—and just call the vendor(s) APIs—or built on a separate key/value store (possibly fancy, e.g., with DNS builtin); or some combination (with the key/value store being the cache)
- **Packager**: images; archives; OS|distro specific packages
- **Package managers *(large number of these)***: rather than 'recipes'/scripting create a different—yet composable/dependable—package-manager for each 'thing'; where 'thing' could be a specific web-server, database (incl. clustered variants), WordPress, Open edX… all versioned
- **Configuration updater**: Utility functionality to update (idempotently) configurations, e.g., add/remove a route in [nginx][6]
- **Execute on remote server(s)**: which might be as simple as a [polyshell][7] `curl`'d or `scp`'d that proceeds to run the desired package manager(s) using aforementioned *Registry* to locate & authenticate, and update what was run successfully where. This should let it be cross-platform (Windows, Linux, macOS, OpenBSD, SunOS, &etc.)

By design, it would not implement features like:

- **Load-balancing**
- **Health checking**
- **Secret handling / vault** - NOTE: will however need to implement integration between this and *Registry*
- **Web-server**
- **DNS server**
- **Other protocol specific servers** (e.g., email)
- **CI/CD**
- **Security scanning**
- **Distributed system guarantees**

(as these are the domain of system(s) deployed by aforementioned package manager(s) and/or vendor-provided services [e.g., cloud DNS])

---

What is missing from this new system design?

[1]: https://en.wikipedia.org/wiki/Software_configuration_management
[2]: https://en.wikipedia.org/wiki/CFEngine
[3]: https://en.wikipedia.org/wiki/Puppet_(software)
[4]: https://en.wikipedia.org/wiki/Progress_Chef
[5]: https://en.wikipedia.org/wiki/Ansible_(software)
[6]: https://en.wikipedia.org/wiki/Nginx
[7]: https://github.com/llamasoft/polyshell

https://redd.it/1buibmf
@r_devops

Where should I focus first in order to go from a tradicional tech stack to a devops approach?

So here is my situation, I'm a full-stack developer (Real full stack, I do from server configuration to frontend development, and even less related tasks like QA or data analysis) that in the past years have assumed a mixed DevOps engineer and development role (Have moved development environments to docker and enhanced the internal it processes overal). Lately I'm working into developing my skills and started tweaking with some tools like Jira, GitHub actions, some of the aws tools an stuff like that, but the more I go down the rabbit hole the more I need to learn (or even relean from a new perspective).
We are currently working with aws to almost everything, repos hosted on GitHub and not many automations on either. We use a custom ticket/issue system that we can't drop easily to use a more standard approach but I want to look for a two-way synchronization with something like Jira using webhooks and/or apis. Automatic testing and code style enforcement also aren't implemented yet. We have tons of independent tools in a pretty diverse environment but we lack a tool to centralize all those so we can have less tedious manual tasks.
I think the first thing is setting the correct DevOps mindset in order to start learning things, testing them on my personal projects and then take them to my job. I would like to get some good material to read/watch (I don't really mind) in order to help me getting my ideas sorted and having a global vision of the options out there to help me decide where shall I focus first given the current status of my job tech stack. I don't mind looking at paid courses as in my job we have credits to buy courses that gets lost if we don't use them.
I have read the pinned post, but most of the material I found is more oriented to learn from scratch rather than updating knowledge.
PS: Sorry, I have ended rambling instead of going to the point. I have tried to condensate the post, but I ended with my ADHD brain dumping info on a post.

https://redd.it/1buitid
@r_devops

Exciting News! Microsoft is now offering FREE certification courses.

Yes, you read that right: No Fee ✔️ No Subscription ✔️ No Registration Required ✔️ Just grab your laptop and start learning!

1. Microsoft Azure Fundamentals

\-> Course Link: https://learn.microsoft.com/en-gb/training/courses/az-900t00?wt.mc_id=studentamb_371890

2. Python for beginners

\-> Course Link: https://learn.microsoft.com/en-us/training/paths/beginner-python/?wt.mc_id=studentamb_371890

3. Introduction to GitHub

\-> Course Link: https://learn.microsoft.com/en-us/training/modules/introduction-to-github/?wt.mc_id=studentamb_371890

4. Microsoft 365 Fundamentals

\-> Course Link: https://learn.microsoft.com/en-us/training/courses/ms-900t01?wt.mc_id=studentamb_371890

5. Develop Generative AI Solutions with Azure OpenAI Service

\-> Course Link: https://learn.microsoft.com/en-gb/training/courses/ai-050t00?wt.mc_id=studentamb_371890

6. Developing Solutions for Microsoft Azure

\-> Course Link: https://learn.microsoft.com/en-gb/training/courses/az-204t00?wt.mc_id=studentamb_371890

7. Microsoft Azure Administrator

\-> Course Link: https://learn.microsoft.com/en-gb/training/courses/az-104t00?wt.mc_id=studentamb_371890

8. Configuring and Operating Microsoft Azure Virtual Desktop

\-> Course Link: https://learn.microsoft.com/en-gb/training/courses/az-140t00?wt.mc_id=studentamb_371890

9. Designing Microsoft Azure Infrastructure Solutions

\-> Course Link: https://learn.microsoft.com/en-gb/training/courses/az-305t00?wt.mc_id=studentamb_371890

10. Microsoft Azure Data Fundamentals

\-> Course Link: https://learn.microsoft.com/en-gb/training/courses/dp-900t00?wt.mc_id=studentamb_371890

11. Microsoft Azure AI Fundamentals

\-> Course Link: https://learn.microsoft.com/en-gb/training/courses/ai-900t00?wt.mc_id=studentamb_371890

12. Designing and Implementing a Microsoft Azure AI Solution

\-> Course Link: https://learn.microsoft.com/en-gb/training/courses/ai-102t00?wt.mc_id=studentamb_371890

13. Microsoft Security, Compliance, and Identity Fundamentals

\-> Course Link: https://learn.microsoft.com/en-gb/training/courses/sc-900t00?wt.mc_id=studentamb_371890

14 .Data Engineering on Microsoft Azure

\-> Course Link: https://learn.microsoft.com/en-gb/training/courses/dp-203t00?wt.mc_id=studentamb_371890

15. Microsoft Security Operations Analyst

\-> Course Link: https://learn.microsoft.com/en-gb/training/courses/sc-200t00?wt.mc_id=studentamb_371890

Some Extras!

1. Elevate coding prowess with Visual Studio Code Docs:

Link: https://code.visualstudio.com/?wt.mc_id=studentamb_371890

2. Gain insights from Microsoft's developers:

Link: https://devblogs.microsoft.com/?wt.mc_id=studentamb_371890

3. Explore Azure Cloud Services:

Link: https://azure.microsoft.com/en-in/?wt.mc_id=studentamb_371890

4. Join Microsoft Tech Community for collaboration:

Link: https://techcommunity.microsoft.com/?wt.mc_id=studentamb_371890

That's a wrap!

Hope this was helpful for you.

https://redd.it/1buk9sh
@r_devops

Any free tool to analyse tomcat access logs?

Team,

My Tomcat running on RHEL8, I want to analyse localhost access log generated by tomcat in pattern

>pattern="%h %l %u %t \"%r\" %s %b %D %F"

Tried internet, didn't find any suitable tool for this.

grep from linux and analyse is tedious task right now and also don't have access to client machine to install monitoring tool, I do copy logs to local machine and then analyse.



I don't need fancy, but atleast basic all details and STATS would help

https://redd.it/1buj4ke
@r_devops

Multi-Tenant Customer deployment on Kubernetes

Hi Folks,


My team is planning to transition of current single-tenant application to a Software-as-a-Service (SaaS) model, which will serve multiple tenants (customers) on Kubernetes.


We're currently using GitHub Actions for continuous integration (CI), GitOps for continuous deployment (CD), and Kubernetes for deployment of the multi-tenant application.


I'm wondering about the best approach to achieve this transition. I'm not very much familiar with Helm, so I'm curious if it's possible to accomplish this without Helm.
Your precious thoughts will be help full to giving me a kick-start

https://redd.it/1bumx14
@r_devops

Seniors - What is your best piece of advice to newly transitioned DevOps engineers?

I'm under a manager who has a large ego, and highly incompetent at his job. I'm new to DevOps so I would have loved a manager/senior that can offer me great advice and tips. However, this manager is always telling me things are pointless and hiding opportunities from me. I know the best advice would be to swap jobs, but I can't do that currently - life reasons.

My manager isn't a DevOps engineer but instead a Senior Developer - So it seems to me like it might be an insecurity thing about him managing someone on topics he doesn't know much about. For example, he told me that I shouldn't bother getting Azure certifications because there a waste of time (I have absolutely none) and I apprecite that experience is more value, but I think it comes more from insecurity with him not having any certs.

What advice would you give to a new DevOps engineer trying to be the best engineer they can

https://redd.it/1bunioa
@r_devops

Gitlab issue .gitlab-ci.yml does not exist in plank project

Hey on gitlab I have 2 accounts 1 mine personally and second is for an organization, so locally branch project does not show any issue, but inside organization gitlab I have issue .gitlab-ci.yml does not exist, why it tries to run a pipeline without .gitlab-ci.yml file in blank project?

The other question around .gitlab-ci.yml in different branches in my case if I have some jobs on main branch and does not have it in fechure branch the pipeline combine them and even whe I run pipeline from fechure branch it also add job from main one. (again locally everything works correectly and pipeline on different branches only run jobs which in specific branch)

If you have any Ideas why organisation Gitlab is messed would be nice, thanks.

https://redd.it/1bungv6
@r_devops

How to run lightweight and efficient WASM workloads on Kubernetes.

we built a 1.2MB WebAssembly demo app and deployed it to a Kubernetes cluster with SpinKube. It took just minutes to set up and worked like a charm.
Take a look at this hands-on walkthrough with SpinKube on a local k3d cluster:
☑️ Creating a k3d cluster with a SpinKube node
☑️ Configuring it to run Spin workloads
☑️ Building a sample Spin app
☑️ Deploying the app with spin-operator
☑️ Accessing the running WASM app
Do you think it will be a gamechange? https://www.perfectscale.io/blog/wasm-kubernetes

https://redd.it/1bupcu8
@r_devops

How to best showcase selfhosted git repo on GitHub?

I want to showcase my self hosted git repo on GitHub which has Terraform and Ansible, but I don't want to include things like transmission, etc in my Ansible roles publicly. I can exclude stuff with .gitignore, however, I want to build GitHub Actions with a self hosted runner to deploy changes to both the public and private roles (example below).

​

Since I'm not sure of this, the only think I've come up with so far is using two different repos, but I'd like to avoid maintaining reusable bits in two different repos (like my ansible roles). What's the best way to do this, if any?

​

If it would help, could I restructure how I have things now? My repo structure looks like this.

./selfhosted
ansible
inventory
playbooks
roles
compose-transmission (private)
docker-install (public)
harden-ssh (public)
terraform
linode
proxmox

https://redd.it/1bur9nh
@r_devops

Slack bot to analyse alerts

Hello community, I have built a Slack bot recently and wanted to share about it here.

**Problem it addresses:** Slack workspace with alert channels which are too noisy -- leading to fatigue.

**Solution it provides:** Insights on the alerts in the last 6 weeks in your channel.

* Which alert came, how often?
* Which tool is causing more noise?
* If there are any custom labels, use that to identify label-wise distribution patterns?

Alerts from Cloudwatch, Datadog, k8s, Sentry, New Relic, Grafana, PagerDuty, OpsGenie, Coralogix have regexes written to identify custom labels like namespace, service, etc.

**How:** Install the bot >> Add to specific channel >> Instantly see insights for that channel.

[Link to install](https://drdroid.io/doctor-droid-slack-integration) | [Docs with dashboard screenshots](https://docs.drdroid.io/docs/alerts-insights)

https://redd.it/1busbcz
@r_devops

Azure AKS with App Gateway Ingress Controller - what monitoring metrics are important to you?

Coming from an SRE point of view, what metrics matter to you for this architecture? I can already think of monitoring HTTP 5xx codes, but what else would be important to you?

https://redd.it/1butmcm
@r_devops

How are you preparing for AI?

I don't mean are you using GitHub copilot or even doing ML pipelines at work. I mean how are you preparing for AI to automate most of what you already do today?

9 months ago I would have said AI is useful but DevOps systems are so disparate that it would be a titanic task to automate what we do.

But give the massive advancements in the last year, way more capable models, I honestly don't think our job will exist in five years. AI can code, it can automate, it can improve itself.

What ship should we jump to next? I think it will be worse for developers but bad for us too.

https://redd.it/1buv8c7
@r_devops

Seeking Advice: Transitioning to DevOps - Worth the Commitment?

Hey everyone,

I've been presented with an opportunity. A scholarship where I wouldn't have to pay for anything to transition into a full-fledged DevOps role. However, it requires a commitment of two years at their workplace. I'm torn about whether it's worth pursuing. I'm essentially starting from scratch. I currently work as a full-time English teacher, but I've always had a passion for computers, gaming, and technology. Despite this, I've never pursued it professionally. Now, at the age of 32 and still single, I've decided to switch careers to either QA or DevOps.

QA seems a bit mundane, and there's the added expense of courses. On the other hand, DevOps doesn't require any upfront payment, but I'd have to commit intensely for five months straight, five days a week.

The catch is, if I take this scholarship, I'll have to quit my current job. Besides, I only have one try at the final test, otherwise, I'll have to wait for another year to apply again, which is a significant risk.

So, I'm reaching out for your input. Do you think it's worth taking the leap, or is it better to pass on this opportunity? I'd greatly appreciate your insights, especially from those who already have experience in the DevOps field. Thanks in advance for your advice!

https://redd.it/1buuu61
@r_devops

Salary Questions for someone who feels like they are drowning in responsibilities. Am I unrealistic?

Hey all,

I'm trying my hardest to make this not sound like a venting post because I really do want insight.

Switching jobs is not an option as it will impact another project I have outside of work hours. If that's the only option here, then this is all completely on me, and I understand that.

With that out of the way, I feel like at a state job in the Midwest, I am being underpaid.

$103k a year, my responsibilities that my boss says are my responsibility are:

-WebSphere/Tomcat patching

-General server patching

-WebSphere/Tomcat app deployments (no they're not automated, they expect we do them via the gui's and manually uploading jar files)

-My boss is also throwing me to take over some of the responsibilities of a worker who's leaving, and this includes MQ work


My other responsibilities that I've stood up and know I need to maintain for the health of the organization:

-docker environment that hosts Ansible/AWX containers

-documentatiom repo

-Gitlab administration (boss asked me if we really need Gitlab)

-Grafana, Prometheus deployment, configuration, and patching

-all the playbooks in git are ones I created and maintain



I think it slowly has crept up on me how much I'm holding up and I think throwing MQ in there has been what is making me want to ask others for insight on this. Is $103k too little at a state job? Am I expecting too much?


Thanks in advance all

https://redd.it/1bux1xd
@r_devops

Entering the field?

hello there!

I'm newly released from the army and as part of my release I got a DevOps course which mostly focused on Azure and Terraform.

unfortunately I am completely new to the IT field and even while in the course had difficulty understanding some stuff, especially around networking and dockers/ containers.

So assuming I jumped the gun and got skipped a few steps, what should I do? what am I missing?

also, am having trouble finding a job because of the lack of experience, any entre level jobs I should get into and work into the DevOps role from there?

​

thanks yall!
Cheers!

https://redd.it/1buxx9t
@r_devops

This hands-on project is designed for anyone who is interested in getting into DevOps.

Source code:

* [https://github.com/tntk-io/tntk-infra](https://github.com/tntk-io/tntk-infra)
* [https://github.com/tntk-io/tntk-ci](https://github.com/tntk-io/tntk-ci)
* [https://github.com/tntk-io/tntk-cd](https://github.com/tntk-io/tntk-cd)

Video instructions:

* [https://www.udemy.com/course/real-world-devops-project-gitops-methodology/](https://www.udemy.com/course/real-world-devops-project-gitops-methodology/)
* Apply "TENTEKDEVOPS2024" for discounts.

Enjoy!


PS: We've previously posted this but received requests for video instructions. Therefore, we're posting again to inform you that we've uploaded video instructions containing approximately 8 hours of material explaining the project's essentials.

https://redd.it/1bv0zdx
@r_devops

How does CI/CD or TBD handle features that take more than a couple of days?

Sometimes you can't breakdown features into smaller ones or you are assigned a feature that will need half a Sprint or even an entire Sprint. If you follow CI/CD guidelines, you should merge at least once a day.
I've read that a potential solution to this is to merge incomplete feature code that doesn't break prod or hide it behind a flag.
However, I'm reading these options as workaround, which means that CI/CD Features are usually shorter than two days.
How is this possible?

https://redd.it/1bv2ieu
@r_devops