Devops Youtube tutorials

I started a DevOps tutorial after I got laid off two weeks ago to keep my mind busy. I've come to appreciate YouTubers who share quality content. Setting up good audio and video and editing them is not easy. Here's mine; let me know what you think about it
https://youtu.be/w0Wy-xnlWBo

https://redd.it/1cjzy87
@r_devops

Grafana Dashboard for redis , Elastic search Monitoring

Hello everyone,

Junior DevOps here

i got my prometheus and exporters setup for monitoring redis and elasticsearch in k8s

now i need to make grafana dashboard related to redis & elasticsearch

the problem im facing rn is that there is alot of dashboard available for both of them so kinda confuse how should i make my dashboard and what things should we monitor in both of them

if anyone got any idea or grafana dashboards please drop in comments !

Thanks

https://redd.it/1ck16eh
@r_devops

I am wondering if my workload is normal. Please tell me

Hello World

I am in a situation where I feel my workload is too high, but I would like to validate objectively with others. Here is the situation:

I am the team of lead of a small team of 3 people. As a team, we develop, deploy and support environments for our customers who bought our software. As part of the “ecosystem”, we have 20+ pipelines (deploy, out of service, copy data, export data, etc.) and self-service portal that integrates with our pipelines. We have about 200 customer environments.

My role in the team is Cloud Architecture (of the environments we deploy), IaC Team Lead: design new features, manage the team, support of pipelines, define DevOps strategies (repos, pipeline, policies), design new pipelines, define road map and on bigger task i also do IaC development. I am also escalation point for support.

The team was successful and upper management brags about what we did to the whole organization.

Three months ago, I was asked to join another project while keeping my existing role. Since then, i started work and realized the project is much bigger than what I was told: the business is developing a new product, which is a multi-region saas solution that is composed of multiple teams developing their own tools deployed on a shared infrastructure.

At first, i was supposed to only do Iac, but when I asked for the architecture diagram, I was given a high level diagram and found there is no Cloud Architect. Then I started to break it down in details to fully understand how each resources must be configured. Obviously I found issues in the details that require redesign, so I am leading this. After that, I was told that not only i need to design and develop pipelines to deploy the shared infrastructure, but also I need to design the pipelines for each took to deploy their workload team on the shared infrastructure.

Is this normal workload? I am considering changing job, but i dont want to find myself in the same situation if the problem is me

What do you guys think?

https://redd.it/1ck35ge
@r_devops

Container Tagging and Deployment Strategies

Anyone got any good articles or books on container image tagging and deployment strategies?

My company is currently in a halfway transition point. Our images are tagged latest and rebuilt with each deployment. Each environment has their own ECR. I want to get away from this as soon as possible and have a proper promotion strategy with single image/release candidate.

Thanks!

https://redd.it/1ck3pwa
@r_devops

Need help

My friend who's a data scientist suggested me some data courses, mysql, machine learning, BI and python, i started with sql, but after searching, watching YouTube videos and stuff, I don't really wanna become a data scientist, I've got more interested in becoming a developer, i want to program, write codes and this stuff, I'm almost finishing the python course i got on udemy, i bought like yesterday a web developer course, I'm planning on finish that python course and start web, should I do that? Should i just start other languages?
Js, css, html, java, idk any other languages, does that make sense? Or should i keep going to that data science part? TIA

https://redd.it/1ck6r0y
@r_devops

Anyway to get GCP 300$ free

I've already reached the 90 days limit in my trial period, so now I need a way to get a new one.

PS: I already used the free credits from GCP, AWS, Azure.

PS: For learning purposes.

https://redd.it/1ckb99g
@r_devops

How to become high paid

I am a software consultant (automation testing and bit of ops) with 16 lpa and 5yoe, i am transisioning into complete devops job (wip). My target is to become a high paif software engineer (may be 1cr or more ctc a year in few years) .

What my ambitions are

Want to design lead sclabale systems that will be used by millions of users like netflix hotstar, what should i learn
My current skillset is jenkins ,github pipeliens, appium, bitrise , java, terraform, docker ,k8s

To all high paid softeware engineers how did you achive it and whats your exp and yoe


I am from a tier 3 college ,so cant cant go back to iit now.


I am willing to learn any skill in IT in given reasonable timeframes to achieve that salary and eventually start my own company

https://redd.it/1ckg7me
@r_devops

How much should I know before the start of my DevOps internship?

I have an internship coming up and I'm wondering if there are any tools I should become familiar with before it starts. I have basic knowledge of using Linux commands in the terminal (grep, awk, etc.), but I don't have much experience with Docker and Kubernetes. I have experience deploying full-stack apps using an EC2 instance and using Route 53 and similar services, but I'm pretty sure I didn't do it optimally. I also have very little experience with GitHub Actions and Codecov. I'm kinda nervous and feel like I don't know enough, so I'm thinking about doing some stuff with Docker and Kubernetes. Is there anything else I should add to the list to make the internship experience smoother and more productive?

https://redd.it/1ckirfu
@r_devops

Help needed in Monorepos and variables management

Help needed in Monorepos and variables management

We are using monorepo which includes are apps and terraform infra files and also variable files are there. Our path to production goes like like. Dev cuts a feature branch..make changes..run automated tests on feature branch... Push changes to main.. integration test suite runs..snapshot gets created..take stamping of prod support and security in the snapshot..deploy changes on production.

Making a snapshot that will go to prod and deploying it to prod might take a week max (there are manual intervention involved).

If any issue occurs ( a variable commited in snapshot for prod was not correct) we then have to cut a new branch, change the variable value commit it..run tests..push to main..take stamping..

But by this time other changes would've been pushed to main which will also go to prod which we want to avoid. How to change variables on the go. What is the recommended approach here. Please help

https://redd.it/1ckj8aq
@r_devops

Please help me understand why my docker compose file is not working

This is for setting up the local development Sql Server database, I am trying to use one container for the database and another to run init scripts as a client as soon as the database container is available:

version: '3.8'
services:
databasecontainer:
image: mcr.microsoft.com/mssql/server:2022-latest
containername: MiBodaFetecCrmDatabase
environment:
- ACCEPTEULA=Y
- SAPASSWORD=SecretPassword!!!!
- MSSQLPID=Developer
ports:
- 1433:1433
volumes:
- sqlserverdata:/var/opt/mssql
restart: always
healthcheck:
test: ["CMD-SHELL", "/opt/mssql-tools/bin/sqlcmd -S localhost -U sa -P SecretPassword!!!! -Q 'SELECT 1' || exit 1"]
interval: 10s
retries: 10
startperiod: 10s
timeout: 3s

databaseconfigurator:
image: mcr.microsoft.com/mssql/server:2022-latest
volumes:
- ./DatabaseScripts:/docker-entrypoint-initdb.d
dependson:
databasecontainer:
condition: servicehealthy
command: bash -c /opt/mssql-tools/bin/sqlcmd -S databasecontainer -U sa -P SecretPassword!!!! -d master -i docker-entrypoint-initdb.d/init.sql; echo "All done!";

volumes:
sqlserverdata:


This waits until the sqlcmd is healthy and ready (at least I think it does). Then it tries to connect as a client, but it throws this error:

Sqlcmd: Error: Microsoft ODBC Driver 17 for SQL Server : A network-related or instance-
specific error has occurred while establishing a connection to SQL Server. Server is not found or not accessible. Check if instan
ce name is correct and if SQL Server is configured to allow remote connections.


I don't understand. I am using the service name as host name. It should find it easily right? But I guess not, can someone please help me?

https://redd.it/1ckkv3o
@r_devops

Dockerfile usage

If you're writing a Dockerfile to be executed within a CI/CD pipeline (Setup -> Build -> Analyze -> Build Container -> Deploy), would you prefer installing dependencies and building the application separately, or reusing the artifact from the previous build job? To me, the latter seems obvious, but I've only seen the former approach used so far.

https://redd.it/1cklmfh
@r_devops

Is Canonical Juju still relevant and used in DevOps space?

From my perspective, I think most people do not use it as it is more inclined to canonical products. And it is jsut another vendor lock in platform. I have not personally ever used this tool, so I could be wrong entirely.

I saw many demos/talks on conference videos. They look very good. Also, the project is more than 10 years old. I have not met a single person in devops space who uses it on their workplace or personally except a canonical employee. Just wondering today, is it just me or the tools are quite irrelevant.

https://redd.it/1ckks58
@r_devops

Which deployment tool would be the best?

Tldr: how to deploy a containerized app where containers should deploy and terminate on demand?

Hey everyone,

I've been working on an application that provides remote rendering, essentially allowing users to view scenes or engage in gaming without relying on their own GPUs. Initially, the application was set up to run on a virtual machine (VM), but I've recently managed to containerize it, condensing it into a single image as from resource utilization purpose it's better and it's easier to ship.

Here's the gist of how it works:

- Think of it as a single-player application, where each user requires their own container instance to interact with.
- Upon user disconnection, the container should terminate automatically. No need for logging or data retention; the container's sole purpose is to run while the user is connected.
- Every time a user joins, they're assigned a fresh container instance. Even if the same user reconnects, they'll get a brand-new container.
- The application operates on a specific port (it's essentially a WebRTC server) within each container, with users connecting through this port.

Now, I'm looking to deploy this application, preferably on AWS. Given these requirements, what would be the best deployment strategy? I've been considering options like Amazon ECS or Amazon EKS with a single pod per user scenario, but I'm open to suggestions and insights from the community.

Thanks in advance for your help!

https://redd.it/1ckmgpm
@r_devops

Free SLA uptime tool


Hi guys,



I created a free SLA uptime tool for you guys at https://devopsprojectshq.com/tools/sla-tool/



Have a nice weekend!

Tnx,

Tom

https://redd.it/1cklxnm
@r_devops

Get error log alerts in Grafana Loki? (or please recommend other software)

I have a docker container running a python flask app and I want to get alerts for error logs

Specifically, I want to be alerted by email or a phone notification when a new error comes in, not a repetitive error that keeps happening. Obviously, the novel error detection prevents spamming

And a nice UI like grafana would be really nice too, would like to see the error logs in between the charts in the dashboard.

Or is there a better solution than Loki? I don't want to use an external service, I would like to run it like Loki in docker compose, so that logs stay on my server and don't reach third party.

Thanks in advance!

https://redd.it/1ckopmy
@r_devops

Is there an open-source fork for Hashicorp Packer or in general creating VM images?

I have been using Hashicorp Packer for creating QEMU / VMware OVMF images. With all the potential rug pulling and the subsequent forks of Hashicorp products, is there actually a fork for Packer?

QEMU with command-line is quite verbose and tedious and I found the wrapper of HCL via Packer a bit more configuration friendly.

If there is no fork, what are other tools being used to create such VM images in the OSS world?

https://redd.it/1ckopgu
@r_devops

How much time do you spend on call?

Right now I'm on a team of 3, doing 2-week rotations of on call. Generally no one gets through 2 weeks without having at least one incident. Some of my friends say I've got it easy only working 4 weeks out of the quarter, others say I'm being exploited.

https://redd.it/1ckqwjk
@r_devops

Principal DevOps engineers - What’s your day to day like ?

Same as above

https://redd.it/1cktslo
@r_devops

I want to learn DevOps and the reason is...

There are lot more job posts for DevOps than web developer in my region.

I have BSc in Computer Science. I had a hard time to get programming concepts in college, I failed two years,, since I never coded before and I believe I am a slow learner.i have attention problems and I struggle with consistency.

Most advance stuff I did was one project made in MERN stack which by the way I had a huge help with. I couldn't do it alone.

For now I do low income job until I find something better but I don't want to ditch IT stuff,and honestly I really need career change. I still feel there could be room for me to improve and get in that industry.

As I am looking these IT industry jobs I realized people are looking for senior web developers(frontend, backend and full stack). There are almost not at all any internships or junior positions, but I have noticed there are a lot of DevOps positions and my general feeling is that they would rather chose some DevOps without much experience than web developer with decent experience.

In my mind I think there are too many web developers around and lot less DevOps engineers and if I would chose to pursue web developer position I would need to put a lot more work than what I could learn to start as a DevOps.

Could this be truth, could I engage myself in learning DevOps and get a job faster? I would really appreciate opinion of people who are actually doing DevOps for the living.

My plan would be to start Udemy course on DevOps, learn as much as I can and try to apply to these DevOps positions. And of course I would do practical projects and show as part of CV.





https://redd.it/1ckwb77
@r_devops

Monorepo

Guys any one worked on mono nepo deployment with docker. Isnt it complicated? Got some help from stack over flow. I am frist time and looks like there is a huge leaning curve for monorepo.

https://redd.it/1ckvs5l
@r_devops

Do you like Yaml? Why or why not?

I'm acquainted with great code bases that heavily use Yaml, so I'm not really sure why other people dislike it. Spring Boot was my introduction, so it might be because I've only ever had good documentation when working with it, but when I see it used for K8s, I have no complaints. What's the better alternative that people like using? (I'm particularly looking to hear from people who hate dealing with Yaml)

https://redd.it/1cl2ytt
@r_devops