What is Distributed Tracing?

https://deepsource.io/blog/distributed-tracing/

https://redd.it/kzxsin
@r_devops

Sysadmin looking to enter the dev side of things... where to begin?

Hey all, I've been working as sysadmin/infrastructure side of things for the last several years, ranging from Windows shops w/Powershell to AWS shops and running everything in Terraform/Bash/Ansible/etc.

The writing is on the wall with things like CDK becoming more popular in the market. A lot of local companies I'm interested in are NodeJS/React shops. At first I considered a coding bootcamp, but I'm motivated enough to self-teach for the time being.

So that said... where do I begin? There's a plethora of courses out there, but I'm looking for ones that might appeal to more recoverying sysadmins. Any suggestions?

Thanks!

https://redd.it/l07sz2
@r_devops

CICD pipeline

Hey guys, sorry for the novice questions but as I am studying CICD flows a lot of questions come to my mind and I am looking for a couple of answers:

In the scenario where I have a pipeline where I do a build (docker image) on every commit, what’s the best way to manage and handle all the docker images created? Let’s say, 10 devs commit/push the code upstream and that would build a docker image 10x, how do we control it in a docker repository? Keep the same tag or different tags so that the next phase of the pipeline can take the image/deploy to be tested?

Also, what’s the best way to create CD to deploy in a Kubernetes cluster with Jenkins? During the cicd pipeline, would my newly docker image have a release tag which then Jenkins could trigger a set image in my deployment?

Thank you in advance!

https://redd.it/l07fk8
@r_devops

Anyone available for a quick chat regarding user provisioning?

"DevOps" / Software Developer here. I've done data integrations for K-12. Integrating Active Directory, Google Workspace, and a bunch of other apps. Important question to ask you!

Today companies generally have AD, Azure AD (Microsoft 365), and/or Google Workspace. Companies generally also have some kind of HR system.

To get new employees accounts into these systems, IT gets an email from HR or a manager that someone is starting and a manual back and forth begins. There's the entire life cycle of an employee at your company that requires manual steps as well.

I think it's crazy we don't have an easy way to automate the integration between HR and IT systems. Every company generally has the same issue. How do you handle this today?

There's things like Okta, Onelogin, JumpCloud, etc. My issue with these apps (I've used Okta and Onelogin) is that as a new business today do you really want to also pay for Okta on top of Microsoft 365 / Google?

There's also Manage Engine, Tools4Ever, and a flury of other products. My issue with all of these apps is they hide the mappings (ie code) behind an App which leads to all of your standard low/no code issues.

Would anyone be willing to hop on a quick call, video call, or even just a comment below?

https://redd.it/l05iya
@r_devops

Fullstack Webdev or Devops? (3rd-world citizen here)

Hello everyone, I'm a uni student from Egypt, a country where society is toxic, backwards, and corrupt. Living conditions are terrible. My mental state has been at an all-time low ever since I returned here.

I really need a lifeline. My goal is to live in any developed country where I can get by in English.

I'm currently a senior enrolled in an IT-related uni degree (it's essentially an MIS degree). My GPA is 3.4.

I am proficient in C++, frontend webdev essentials (JS, html/css), and some python. Most of this I learnt on my own.

I'm currently at a road-block and don't know what to learn anymore.

- I'm having a hard time evaluating what career/skillset would most likely help me land a job abroad as a 3rd-world citizen.

- I keep procrastinating on whether I should focus on fullstack webdev or just devops. Heck sometimes I wonder if I should focus on business analysis/intelligence.

I've got around a year to learn something before i do my mandatory military service, so I need some direction. I'd like to know what you guys think gives me the best chance of getting out of here (i.e what career would be best to pursue given my situation)

P.S. Yes, I realize that I’ll definitely need years of experience in some sort of job. But my question is essentially which set of skills can reduce the amount of time needed for me to get the fuck out of here, or at least land a remote position for the time being.

https://redd.it/l0adst
@r_devops

Log aggregation and parsing

Hello redditors working on log aggregation and log parsing, what tools do you use for log aggregation and parsing? are you using any vendor tools or open source solutions like NiFi, Storm, etc.? and why?

I am working on a project and would like to learn from experience of someone implementing these solutions. I am trying to understand pros and cons of different solutions.

https://redd.it/l012fy
@r_devops

Best way to manage multiple game server containers?

Hi all. Long time lurker, first time poster. I am looking to create several game servers (personal servers hosted for the public) for older games such as Unreal Tournament and Call of Duty 2 and would like to remain independent of locking myself into specific services. That is, I would like to remain as vendor neutral as possible (aside from Docker, I suppose) so that, if for some reason I feel the need to change vendors, I can do so with relative ease. My thought was to build Docker containers with the base image for each game (probably on Alpine, if possible) and then modify each container as needed by attaching the necessary config file and third-party maps, etc. I will have over 10 servers, each in their own Docker container and probably each of them on their own individual instance (a t3.nano on AWS or equivalent). I realize managing all of these containers/servers this might get unruly and so I was trying to understand the best way to manage them. I have very little exposure to Kubernetes, but would this be one method of managing these or would that be a separate use case? Any thoughts much appreciated!

https://redd.it/l04xiw
@r_devops

DNS Load balancers?

Hello,

I'm currently working on a DDoS protection service for locations that other providers don't provide. The host I'm using offers cheap servers, but low bandwidth (750GB). That's plenty enough for a few customers home-hosting a SMP for their friends, but not nearly enough for a few hundred player on the network 100% of the time.

So far, I have found no TCP load balancers that can provide load balancing without proxying the connection as well. I started looking into the DNS side of things, so far what I have found that could possible work is a DNS ROUND-ROBIN solution. This would forward a player to any proxy that is listed in the list of proxies.

If anyone has a better solution to this problem, please contact me.

Mitch, AusGuard

https://redd.it/l0e50o
@r_devops

Laptop?

I’ve always used a MBP for all of my dev and admin stuff at my previous job without an issue.
But I’m now taking a new Sr Role and they asked what I wanted.

Have any MBP users had any DevOps Mac regrets?

I just need my stuff to work.

https://redd.it/l023r8
@r_devops

docker-compose failing

Hey,

I'm just a beginner in this ,

I built this docker-compose file which in the same folder I have a folder for the app and a Dockerfile file.

Why do I keep reeving this errors after running docker-compose up ?

Is there anything wrong with the .yml ?

​

version: ‘3’
services:
consul:
image: consul
restart: unless-stopped
command: agent -server -ui -node=server-1 -bootstrap-expect=1 -clinet=0.0.0.0
ports:
- 0.0.0.0:8500:8500
- 0.0.0.0:8600:8600/udp
networks:
- consul
proudctionapp:
build: .
ports:
- 0.0.0.0:8000:8000
networks:
- consul
networks:
consul:

**The errors I receive:**

Traceback (most recent call last):
File "bin/docker-compose", line 6, in <module>
File "compose/cli/main.py", line 71, in main
File "compose/cli/main.py", line 124, in performcommand
File "compose/cli/command.py", line 41, in projectfromoptions
File "compose/cli/command.py", line 113, in getproject
File "compose/config/config.py", line 385, in load
File "compose/config/config.py", line 385, in <listcomp>
File "compose/config/config.py", line 518, in processconfigfile
File "compose/config/config.py", line 226, in getservicedicts
File "distutils/version.py", line 46, in eq
File "distutils/version.py", line 337, in cmp
TypeError: '<' not supported between instances of 'str' and 'int'
3972 Failed to execute script docker-compose

Thanks...

https://redd.it/l04g76
@r_devops

Creating a SaaS App

Hello all,

I apologize for not being able to be more specific, but I'm going to do my best with what I know.

Currently, we have an application that was built in-house on .NET and is written in C#. We feel this application is a really strong tool that could be templated and resold as a SaaS application to other service companies in this industry. I have no idea where to start or what to look for in this scenario. My background is basically jack-of-all trades sysadmin. I do have a developer on staff who helped created this application.

What should I be looking for to better understand how to make this happen? Who should I be talking to about hosting? How do I create an environment where we can rebuild/develop the app from scratch? Basically looking for a getting started guide for building your own SaaS solution based on an existing application on-prem.

TIA

https://redd.it/l03162
@r_devops

Crucial differences in MLOps for deep learning in comparison to other ML approaches

I am new to the field of MLOps and about to set up a pipeline for a deep learning project based on TensorFlow.

I am looking for differences when comparing deep learning to other machine learning approaches in the context of MLOps. So far I have only found resources that introduce the general MLOps principles. Does anybody know what pipeline components may differ specifically? Which aspects may be more challenging?

What tools & resources would you suggest to start with? Any recommendations?

Thanks!

https://redd.it/l02vva
@r_devops

Samba - only allow users access their folder (and custom dirs)

Currently, users in our samba directory can access any folders, including each others so I've found that by including this line in the config file valid users = %S uncommented, users can only access their home directories.

Now the only problem is that other folders are not accessible for everyone and I can't seem to have it working.

How do I make the home/USER accessible to USER while keeping other dirs open for everyone?

Thanks ahaed.

https://redd.it/l0jlxv
@r_devops

Don't pay to learn Flask with python! Just watch this free course of Flask with python!!

https://www.youtube.com/watch?v=6ea9KxusS0M&t=36s

This is the third tutorial to my ultimate flask series :)

https://redd.it/l0k3y8
@r_devops

What does GitLab offer that GitHub doesn't?

As far as I can tell the two platforms are essentially the same. I currently use GitHub, but I've had a couple of people suggest I look into GitLab. I've done some basic research, and I can't see anything that would make me go "Huh, yeah I should switch to GitLab" or at least consider using both platforms. Does GL offer something that GH doesn't? On the personal or business level?

https://redd.it/l0nkiy
@r_devops

Has anyone moved from DevOps to backend engineering?

Has anyone done such a career change?

I know many peers that were previously backend devs and then moved to DevOps but haven't heard from anyone doing the opposite.

If you did so, what was the reason?

https://redd.it/l0xyim
@r_devops

As a beginner, how can I use a Raspberry Pi to learn?

Hi everyone--

I was gifted a Raspberry Pi 4 recently. I have been really interested in learning about DevOps and cloud computing.

Are there any projects or things you recommend to do with a Raspberry Pi (that a beginner could figure out)? I want to use the Pi as a "learn by doing" tool to get hands-on experience while I begin learning.

Has anyone used a Raspberry Pi to learn and recommend any projects?

https://redd.it/l0yw9p
@r_devops

What do you prefer for managing AWS EKS cluster? eksctl or Terraform or something else?

HashiCorp Terraform can handle (almost) any infrastructure management needs but, if all we need is AWS EKS cluster, maybe eksctl is a better choice, especially since it acts as both CLI and Infrastructure-as-code (IaC) tool. WDYT?
\>>> https://youtu.be/pNECqaxyewQ

https://redd.it/l0mvwl
@r_devops

Tool to monitor latest releases for different applications?

Hi! We're building a platform using EKS, helm, Terraform, the usual.

Since many of the tools we're using are fast evolving, we're looking for a tool that can be used to check for available updates for different technologies. Imagine a dashboard that shows you "EKS on cluster A has version v1.17, cluster B has v1.16, newest release is v1.18; helm chart foo is deployed with release 3.2.0, newest release is 3.4.0".

I can't seem to find something like that. One approach would be to create somehow create metrics to push to prometheus, then build a grafana dashboard for that.

Any recommendations? Or search terms? Thanks in advance!

https://redd.it/l14z1h
@r_devops

Plugin for Intellij IDE to manage your Gitlab CI builds

I've created a plugin to manage your Gitlab CI builds from Intellij based IDE (WebStorm, PyCharm, Android Studio,, etc). It lets you:
\- List pipelines from your projects
\- Check status
\- Trigger, abort and retry pipeline
\- Works with gitlab.com and self hosted gitlab edition

Plugin can be download from the IDE or on JetBrains: https://plugins.jetbrains.com/plugin/15457-gitlab-ci

Feedbacks appreciated

https://redd.it/l15m9w
@r_devops

What are my options for speeding up pulls of frequently-used docker images in CI?

My team's using CircleCI right now, and I'm frustrated at the number of cache misses we get for docker images -- even Circle's own standard docker images sometimes take nearly a minute to load. I have ambitions for a big rewrite of our CI pipeline, and I'd love to make a custom docker image for this purpose, but as it stands I'm worried it's going to make the startup time for each job unacceptably long.

I'm curious what the range of options is for caching images in the cloud. Specifically, if I want to:

* Cache a very small number of images
* Which change very infrequently
* With most container starts under 5s

What's the ideal approach? I know I can use a cache at the registry level, but I'm not sure why that would be more performant than the registries themselves, given that (presumably?) all this stuff is happening in the same data centers anyway. Does it really help to stand up a server just for my images, for such little traffic? Does it make more sense to have long-lived CI service instances that we host ourselves, with attached SSD storage? Are there any other clever tricks I'm not thinking of? I'm open to self-hosting something, if that gives me better options.

https://redd.it/l0zbvn
@r_devops