My job title is “DevOps Engineer” but the work doesn’t line up. Help?

I 32F have been a “DevOps Engineer” for two years & made a switch from being a Big Data Engineer for three years.

I made the switch. I was headhunted, it’s a great company to have on my LinkedIn & the work that I was told we’d be doing sounded exciting but none of it has actually happened.

Since then, our team stack has changed to a point where I know that it’s not really DevOps anymore.

We do use Config Management tools being Puppet & Terraform. We no longer look after CI/CD tools being Jenkins & Spinnaker. It’s now maintained by Release Engineers in another team. We do look after Logging tools being ELK, InfluxDB & Grafana.

We were told that we would be looking at adding Docker as a containerisation tool only for that to be full-steam-ahead by Release Engineers.

I genuinely feel like a fraud. Having a job title with tasks & tools that don’t align. I’ve spent most of the year doing documentation & on-call on random things. I feel like tech support & I hate that.

I’m not growing at all. I’m incredibly bored. I’ve barely done any code all year. I’ve been doing a lot of self-learning to fill my knowledge gaps that it doesn’t look like I’ll get in this team.

I’ve been told we’re changing our names to SREs but that doesn’t make sense either.

I’m not a DevOps Engineer really, am I. Any advice?

https://redd.it/yle5jk
@r_devops

I have an Extra GCP exam voucher

I have bought two vouchers for myself to attempt PCA but fortunately pass the Exam in first attempt, so now I left with an extra voucher(You can use this voucher register for any GCP Exam or associate level exam) , If any of you are interested ping me, Price is very negotiable.

https://redd.it/ylxdui
@r_devops

Security scanning

Have you ever needed to convince your senior security engineer of static code analysis? For some reason ours does not see value in that and just says that we should focus on our biggest attack vector: social engineering and lost devices.

I think you should do it all but static code analysis is such a simple thing to catch a lot of stupid mistakes for such little effort, it is a low hanging fruit when compared to retraining the entire staffs security hygiene or hardening devices.

Thoughts?

https://redd.it/ymodt1
@r_devops

Course: Real world DevOps project from start to finish

Hello everyone,


I've made a DevOps course covering a lot of different technologies and applications,
aimed at startups, small companies and individuals.

To get this out of the way - this course doesn't cover Kubernetes or similar -
I'm of the opinion that for startups and small companies you probably don't need Kubernetes.
For small teams it usually brings more problems than benefits,
and unnecessary infrastructure bills buried a lot of startups before they got anywhere.

As for prerequisites, you can't be a complete beginner in the world of computers.
If you've never even heard of Docker, if you don't have even the slightest idea what DNS is,
or if you don't have any experience with Linux, this course is probably not for you.
That being said, I do explain the basics too, but probably not in enough detail
for a complete beginner.

The course is available at Udemy, and here's a 100% OFF coupon URL (1000 of those available):

https://www.udemy.com/course/real-world-devops-project-from-start-to-finish/?couponCode=FREEDEVOPS2211CJDUA

Be sure to BUY the course for $0, and not sign up for Udemy's subscription plan.
The Subscription plan is selected by default, but you want the BUY checkbox.
If you see a price other than $0, chances are that all coupons have been used already.

I encourage you to watch "free preview" videos, but here's the gist:

The goal of the course is to create an easily deployable and reproducible server
which will have "everything" a start up or a small company will need - VPN, mail, Git,
CI/CD, messaging, hosting websites and services, sharing files, calendar, etc.
It can also be useful to individuals who want to self-host all of those - I ditched Google 99.9%
and other than that being a good feeling, I'm not worried that some AI bug will lock my account
with no one to talk to about resolving the issue.

Considering that it covers a wide variety of topics, it doesn't go in depth in any of those.
Think of it as going down a highway towards the end destination, but on the way there I show you
all the junctions where I think it's useful to do more research on the subject.

We'll deploy services inside Docker and LXC (Linux Containers). Those will include
a mail server (iRedMail), Zulip (Slack and Microsoft Teams alternative), GitLab (with GitLab runner and CI/CD),
Nextcloud (file sharing, calendar, contacts, etc.), checkmk (monitoring solution), Pi-hole (ad blocking on DNS level),
Traefik with Docker and file providers (a single HTTP/S entry point with automatic routing and TLS certificates).

We'll set up WireGuard, a modern and fast VPN solution for secure access to VPS' internal network,
and I'll also show you how to get a wildcard TLS certificate with certbot and DNS provider.

To wrap it all up, we'll write a simple Python application that will compare a list of the desired backups
with the list of finished backups, and send a result to a Zulip stream.
We'll write the application, do a 'git push' to GitLab which will trigger a CI/CD pipeline
that will build a Docker image, push it to a private registry, and then,
with the help of the GitLab runner, run it on the VPS and post a result to a Zulip stream with a webhook.


If you apply the coupon, I'd appreciate if you leave your feedback on Udemy
after you're done and spread the word about the course. It would mean a lot.

If you'd like to support me, you can instead use this 80% OFF coupon:

https://www.udemy.com/course/real-world-devops-project-from-start-to-finish/?couponCode=80OFFDEVOPS2211FJKDA


I hope that you find it useful.


Happy learning,
Predrag

https://redd.it/yla3qp
@r_devops

Metrics, Logging and Application Tracing Solutions

Hi r/devops,

I am a K8s administrator in a relatively small cluster hosted in Digital Ocean. I was using Prometheus+Graphana for Metrics and Logging but there is a need for something more concrete and something that could be also used for Application Tracing. EFK Stack came to mind but ElasticSearch is a bit heavy and the cluster is already at its limits. While researching I found Datadog (that is a bit expensive) and New Relic.

What do you suggest? What are you using for Metrics, Logging and Application Tracing?

https://redd.it/ymsrgu
@r_devops

Getting Started, Automating WITH DOCKER

I have an idea for a project around automation and I'm not sure where to start.

I want a project/repo where when I check in code it spins up some docker containers to run tests. What terminology shoud I research, and what tools should I learn?

https://redd.it/ymrif8
@r_devops

Static Code Analysis Tools with CWE compatibility for bachelor thesis

Hello guys.

I am currently writing my bachelors thesis and I need to analyze Open Source Static Code Analysis Tools which are CWE compatible and have explicit mappings to the weaknesses defined in CWE. The focus of the tools should be on security. Do you have any recommendations for tools I should have a look at?

Thank you in advance

https://redd.it/ymxb9h
@r_devops

What is the difference between ECR and CodeArtifact?

Title.

https://redd.it/ymsug0
@r_devops

People that have started consulting, how do you get contracts?

Hello,
For those that have started or are starting their own consulting companies, where do you even find contracts? Are you cold calling companies? Are you applying to contract positions meant for individuals?

https://redd.it/ymzvrt
@r_devops

Are there any good GCP monitoring examples. General advice welcome

Hey all! I was recently given the chance to take ownership of SRE at the relatively small company that I work for. We have some long and short term goals but the immediate focus is to start better monitoring practices.

I have done lots of reading and googling and even worked on a few Google provided certs but I learn best by seeing real world examples. I’m not seeing great information about how to apply the metrics provided by google to the “golden signals”.

It’s all a bit overwhelming.

https://redd.it/yn42zi
@r_devops

What are your opinions/feelings on the DevOps mantra of "continuous improvement?" What really drives engineers and engineering leaders?

Re-reading "Accelerate" as I'm trying to dig deeper into the psyche of developers and engineering leaders.

It's clear that engineering leaders are not "built" like Sales or Marketing leaders. These types of leaders are often driven by money, "fame" (for lack of a better word) and are highly competitive.

Whilst my feeling is that eng. leaders are more concerned with the product they're building, and see this as an "art."

What are your thoughts on this? What do you think drives and motivates engineers? How do you think this affects their relationships with the other functions (i.e. Sales, Marketing, Business Dev.) in organizations? Is the mantra of "continuous improvement" a strong enough driver?

https://redd.it/yn3yz8
@r_devops

Tool for visualizing your backend, not just cloud infra

Hey there,

I was wondering if there is a tool that lets you visualize your backend at a higher-level than just cloud. Something that pulls info from my Github + AWS and shows things like:

* what API endpoints a microservice calls?
* what tables a service uses?
* what's the format of the messages passed between different services?

I could then interact with the nodes to make queries like:

* what are the last n calls made from one service to another?
* what are the current waiting messages in an async message queue?

I know there are tools like Cloudcraft, Lucidscale that automatically create diagrams of your cloud infra, but they're usually just limited to cloud-level details (e.g. what kinds of AWS instance a node is running).

Thanks!

https://redd.it/yncqhz
@r_devops

Do Platform Engineers require the same skills as DevOps Engineers? If so, then what's different about them?

DevOps and Platform Engineering all sound the same to me. It's as if DevOps grew up and just turned into a new term, Platform Engineering.

https://redd.it/yn1pqy
@r_devops

Advice on Azure DevOps

Hello everybody!

This is my first time on this subreddit, and I just recently started working as a DevOps Engineer.

I am currently trying to automatically run a pipeline on Azure DevOps, and retrieve the status of the pipeline (succeeded/failed), but I am running into a bit of trouble achieving that.

I was mainly using python to script the process, which would then be used in a lambda function in order to perform a health check on our service.

If any of you are able to suggest any paths to try out, I would be very thankful!

https://redd.it/ymymql
@r_devops

Can someone explain to me, as a total noob, is it possible to horizontally scale an RTMP server/severs with Kubernetes?

Hey guys,

I'm looking to create my first Dev ops/Full stack dev based side project. Basically I have 300 web cam streamers, each with their own "channel" (like twitch or Youtube), that I want my users to react with through a messaging system using web sockets.

I've been studying Kubernetes for a few months and know little about RTMP. I was wondering if it would be possible to horizontally scale RTMP with Kubernetes? And can someone explain to me like I'm 5 some basic things that I'd have to do?

(I'm just trying to research this project for viability)

https://redd.it/yng3x5
@r_devops

a guide for a process delivery from staging to production

Hello all,

I am searching for a guide with in depth description for all the steps for a process delivery to production, i am looking for a guide with also a description about the role of the different intervenants , for example : a prodcut owner make sure the package delivered respond well to the buisness needs, the techlead make sure it respects the technical aspect etc.

Thank you all for your help.

https://redd.it/ymrc37
@r_devops

Github As A Code

Hi,

We are startup looking at enabling Github as a code using terraform. I am trying to implement self service for github org so developers can deploy their repositories and we (devops) can manage entire org. Preferably using some user friendly yaml templates that make sense to end users, not plain HCL.

I can see that someone already did a great job doing that https://github.com/mineiros-io/terraform-github-organization

Has anyone used this product? I was looking for the alternatives but could not find anything decent in github/OSS field with terraform provider.

I could of course just spend a bit ( a lot ) of time and write a lot of resources and wrappers but if someone went through it already and made an effort to do it properly an in an elegant way, that would save me a lot of time and pain.

I would rather avoid writing solution from the scratch if there is a framework out where.

https://redd.it/ymrz92
@r_devops

advice about transitioning into DevOps

Hi!
I'm considering trying to move into DevOps but I'd like some advice from people who work or moved to DevOps themselves.

I'm 25 years old in a moment and nearing 7 years of experience in dba and db development, I have a pretty good grip on Linux (Ubuntu mostly) and I made some projects in collaboration with Jenkins and docker.

I have background as an IT expert as well, and some other programming languages and tools .

What should I learn and know before I try to get into DevOps? I work in a big company and transitioning is potentially an option if relevant.

Thanks!

https://redd.it/ynkeqf
@r_devops

Which free GCP product for Heroku worker dyno?

This might be a newbie's problem but I'm wondering if anyone can provide some direction on it:

Consider the following use case: an app is running on a worker dyno on Heroku 24/7 using their free tier. It’s not a web app that binds to a port and listens for requests sent via a particular HTTP webhook, rather it sits idle and uses persistent connections via TCP sockets to interact with an external server and the server pushes updates to it, hence why it’s run on a worker dyno like a background process and not on a web dyno.

If the user wants to move to GCP, what’s the right GCP product to go for for this use case? Something where the usage is entirely covered by the free tier for the respective product would be preferable. From what I’ve read, I’ve gotten the impression that Google Cloud Run isn't right because it’s more an equivalent for web dynos, not worker dynos.

https://redd.it/ynl9bd
@r_devops

How do you determine in a CI/CD pipeline which build is pushed to prod?

I'm fairly new to DevOps, but I'm excited about learning new stuff!

I'm curious about how to setup a CI/CD pipeline in order to push to multiple environments such as dev and prod. So far we had a single dev env. and the devs pushed their code into a feature-specific branch. After the review a merge was initialized and the CI/CD pipeline started on the main branch. We deployed the artifact into the dev env.

So far so good. Now we have multiple environments, and I would like to know how you guys handle this usually. Do you have specific branches, such as main and dev which each push into the corresponding environment? Or do you use tags?

What's the best practice?

https://redd.it/ynkqc5
@r_devops

How do I pivot more towards DevOps career-wise?

Hi experts,

I had a few years of experience as a BI developer (ETL + Dashboarding mostly) and moved into a new job 9 months ago which is sort of BI-Ops.

I dabbled into three focuses:

1. ETL: Mostly Python + Airflow + BigQuery
2. Internal Doc site: Think a static site generator running on Google Cloud Run with GitHub Action as CICD
3. BI workflow: Think a large BI team that needs a proper git workflow + a lot of GitHub Actions for linting/automatic approving/etc.

I actually led all three projects but the reason I said "dabbled" is because either the project got shelved or I only got to complete a PoC and then it was good enough so nothing complicated (read: good for resume) was needed. After all all three are internal so there is no need to "scale" for production.

From project 2 and 3 I learned a lot about Cloud click ops and CICD stuffs including Terraform, docker and GitHub Actions. However I don't know how to go further down the DevOps road. I'll establish the reasons:

1. My team actually is not supposed to do a lot of Ops, but we do it anyway because the company is ill structured
2. As mentioned all Ops are internal so there is no need to scale
3. We kind of use a lot of tools say Terraform but we never need to set them up. Someone else set it up for us (the real DevOps team I guess) and we simply plugin our code

How can I grow from here and pivot more towards DevOps? I'm missing a lot of skills, e.g. as mentioned I actually don't know how to setup things. Neither do I do any real Dev (Dev in our team simply means writing ETL code in Python and SQL, which I'm already good at). I guess I can learn some of the skills by setting up a home lab (I do have a 32GB server so surely I can learn basic K8S) but is that going to be enough for resume? TBH I don't really have need of those things for myself (at home I mostly dabble with system programming, either low level C or quick Python), so the best I can learn is going to be superficial.

Or maybe I should find a way to move to the DevOps team? It's a bit tricky because the whole team is in another time zone and the company seems to prefer to dismantle and outsource it, so I might need to actually leave and join a new company - and again here comes the uncertainty - is my resume good enough?

What do you think? Thanks in advance.

https://redd.it/yll4te
@r_devops