Which libraries are instrumented with OpenTelemetry?

Is there an overview of popular libraries and frameworks that are already instrumented with OpenTelemetry?

https://redd.it/scamcq
@r_devops

Importance of the git platform in the interview process

Hey folks, I started to set myself for a company change , but did not start the interviews process.
I have a lot a code, terraform modules, terraform wrappers, Ansible stuff, and python scripts that I keep on my gitlab account , mostly as a portfolio.
I personally love gitlab and use it a lot, but I feel like employers always asks for GitHub accounts, and I'm not sure they would even take the time to check a gitlab repo.

Those of you , who are recruiters on in the interview process, has the git platform any kind of importance ? Does it even matter ?
Any insight would be great, thanks buddies !

https://redd.it/sd0ct1
@r_devops

I'm on a team design quest.

As time move forward, mecury is in retrograde (I'm still on earth 0), the way teams or org work evolve. I'm researching evolution paths and other team experiences.

A. My current model is centralized with promoting tools and process with self service tool any developer can use tool and process to achieve a goal.

B. A model of centralized platform with individuals joining for short periods to rollout tools and process changes. (These may be evangalists, oh my!)

C. A model of adding a devops member to each team with decentralized platform at a team level. Adding a guild as a working group to improve tools and processes.

D. A model of adding a devops member to each team with decentralized platform at a product level. Adding a guild as a working group to improve tools and processes.

​

1. What's your current team structure?
2. What are the pros and cons of your structure?
3. With you being in this structure for a while, how did the idea of how the team would work vary from the actual team work?

https://redd.it/sd14jz
@r_devops

Learning devops with 'why' resources (as opposed to 'how')

It seems to me that most learning resources focus on the how of devops (here are basic docker commands, here is how you write a config file for IaC product X, here's how to add a a load balancer to a k8s cluster), but, for me, that doesn't help much to get a handle on how all these tools fit into a bigger picture, and perhaps more importantly, what necessitates them.

Hoping someone can point me towards resources that introduce one to devops technologies by first explaining the situation - in detail - that would lead to their adoption by a small to medium sized company.

I found on another post a link to some 'real world scenarios' but they all seem like they are starting in media res, and assuming the audience has a good grasp on what their architecture was before they made some big change.

My ideal would be a hands on kind of course that walks you through the major changes over a multi-year timeline of a small company that grew to a medium size company and the new technologies they adopted to make things more efficient/easier or that they were forced to adopt due to failures of their earlier architecture.

Sorry if this comes off as pointless grumbling, i know there are many resources out there.

https://redd.it/sc7n37
@r_devops

Centrally manage GitHub actions

GitHub actions are really great and powerful but I guess the main problem is to manage them centrally. We have over 1500 repos in GitHub organization (enterprise account) and we want to manage workflows effectively

Current solution -
1) Have a central repo with logic.
2) Add workflow files in each repo to checkout our central repo and execute main file with GitHub event

I was looking for some general and cleaner solutions to manage workflows centrally

I was thinking if it's possible to have .github folder as a submodule instead . That way, we can have a central repo for workflows.

Curious to know how you guys are managing this !!

https://redd.it/sd3jy0
@r_devops

Devops / VS2019 - Branch history vs sub branch

So I'm branching out from DEV to work on a complicated change. I merge down ever so often, from the main DEV branch.

Mind you Sub branch (DEV6312) is less than two weeks old!

This morning I'm ready to merge up, but I wanna merge down first, this is VS2019/Devops comparing the two branches:

https://ibb.co/W3631dR

WTH man, get your ducks in a row studio and Devops!

And; What are we doing wrong?

https://redd.it/sd33fr
@r_devops

Coupon code plugin for front/backend

Could you suggest some 3rd party plugin that helps integrate coupon codes?

​

For example, when you register on https://www.printful.com/ you get a coupon code that gives you a -30% discount. And coupon expires in 24 hours.


We want to use it on a custom-built website. We don't use WordPress or smth like that.

https://redd.it/sd5fn8
@r_devops

Running Terraform Cloud from Ansible Playbook

Hi Guys

I see a lot of information and documentation on the topic of integrating terraform and ansible and usually its always something like "run terraform (from local CLI or via Terraform Cloud) and then automatically run some ansible playbooks on the newly created machines via terraform".

As we are heading towards ansible Tower (RHAAP) it seems like it would be a lot more convenient to do this the other way around: controlling terraform cloud via ansible playbooks. Im thinking about using the URI Module to start API-Driven Runs on Terraform from ansible.

Does anybody have experience with that or knows any ressources / example solutions?

https://redd.it/sd72qc
@r_devops

API Traffic Viewer for Kubernetes



Hey all! I'm part of the team that developed Mizu, an open source on [GitHub](https://github.com/up9inc/mizu?utm_source=reddit&utm_medium=devops) \-[API Traffic Viewer for Kubernetes](https://github.com/up9inc/mizu) \-TCPDump and Wireshark re-invented for Kubernetes.

Features

* Simple and powerful CLI
* Monitoring network traffic in real-time. Supported protocols:

* HTTP/1.1 (REST, etc.)
* HTTP/2 (gRPC)
* AMQP (RabbitMQ, Apache Qpid, etc.)
* Apache Kafka
* Redis
* Works with Kubernetes APIs. No installation or code instrumentation
* Rich filtering

How to Run

1. Find pods you'd like to tap to in your Kubernetes cluster
2. Run mizu tap
or mizu tap PODNAME
3. Open browser on https://localhost:8899
**or** as instructed in the CLI
4. Watch the API traffic flowing
5. Type \^C to stop

[Download](https://github.com/up9inc/mizu#features)

[Download Mizu for your platform and operating system](https://github.com/up9inc/mizu#features)

https://redd.it/sd7czr
@r_devops

Unit-tests and production

Hey guys,
I’m really new at this and I’m still trying to learn. There’s something I don’t get about CI CD.

The way I see it unit tests are done by developers. Since they’re at micro level.

So let’s say a developer is working on a feature on a separate branch and then pushes said feature and initiates a pipeline.

Assuming all unit tests and whatnot passes, the next step would be to rebase the feature onto the master and initiate another pipeline and deploy to production, right ? I’m assuming this is also the responsibility of the developers. When doing that are they throwing the test files into gitignore/delete them ? Because they have no reason to be in production.


Also I’d like to know what’s your role in CICD? My friends who work in DevOps don’t really write tests, at all, like none. They more or less construct pipelines based on tests the developers give them and pre existing templates. Is that the common approach ?

Thanks.

https://redd.it/sd8wlg
@r_devops

PowerShell Master Class lesson one passes 300,000 views. THANK YOU!

Another nice milestone 🎉. Lesson one of the PowerShell Master Class hit 300,000 views! I keep this updated with recent new lessons around version 7, debugging, secrets and more.

https://youtube.com/playlist?list=PLlVtbbG169nFq_hR7FcMYg32xsSAObuq8

https://github.com/johnthebrit/PowerShellMC

PowerShell is cross-platform and such a useful tool to have in your belt.

#powershell #azure

https://redd.it/sd6j9r
@r_devops

Should I (we) skip "low level" server stuff and jump right into Kubernetes

Hi,

this thread is probably very opinion-heavy, therefore I think reddit is the best place to ask ;)

I work as a software engineer / devops dude in an IT startup with approx. 20 employees. We develop software that is already being hosted as a SaaS platform in "the cloud" by manually deploying it via Docker on a handful of servers. Each server contains the "full stack" of our software including infrastracture services like an S3 storage or Redis instance. There is "a bit" of tech debt that prevents us from horizontally scaling one of our compontents. But still, this approach has worked fine for now, since our software supports multi-tenancy and we "load balance" tenants across servers.

I am in the lucky position to heavily influence our tech roadmap and the way we do things moving forward. As our customer base is growing, I see limitations with our cloud deployment and want to distribute the mentioned components across several servers. I also want to be flexible with internal routing to avoid having to set up an internal DNS / service discovery system. Moving forward we will develop new applications that I want to integrate fast and often. I believe that this is the key to frequently delivering valuable increments for our customers.

At this point I am honestly struggeling to decide between two general options in regards to hosting our cloud software:

1. Set up an internal network. DHCP + DNS will be used to have application servers communicate with infrastructure services on other servers. Monitoring will be set up to monitor these servers on the same mechanisms.
2. Skip the "low level" stuff and jump right into Kubernetes.

As far as I am concerned, hosting Kubernetes itself is not a simple task. And adopting Kubernetes seems harder than adopting Docker containers (if you haven't used them before).

But still, in any case I (and collegues) will have to learn certain skills. I am unsure if long-term it would be wiser to directly drop Kubernetes if in the long run it would be the used orchestration framework anyway.

I hope I could kind of explain the struggle that I am facing, has been a long workday ;)

Looking forward to your opinions.

https://redd.it/sdcota
@r_devops

Help with ci/cd supervisord deployment

Hi everyone, i new in DevOps (i'm DevOps Jr) my first task is to automate the deployment of somewhat old applications that run through supervisord.

To perform the deployment of a new application tag I perform the following:

# clone repo dev in local machine
git clone URLGITLAB
# add prod repo
git remote add prod URLGITLAB
#
git push prod
git push prod --tags
# Into the instances
cd /opt/app
source env/bin/activate
git fetch
git fetch --tags
git reset --hard vx.x

We have two servers installed with gitlab, one for the dev environment and one for the production environment.

What do you recommend to automate this process? (Jenkins, Ansible, etc)

Regards,

https://redd.it/sde04w
@r_devops

Some ways DNS can break

>When I first learned about it, DNS didn’t seem like it should be THAT complicated. Like, there are DNS records, they’re stored on a server, what’s the big deal?
>
>But with DNS, reading about how it works in a textbook doesn’t prepare you for the sheer volume of different ways DNS can break your system in practice. It’s not just caching problems!
>
>So I asked people on Twitter for example of DNS problems they’ve run into, especially DNS problems that didn’t initially appear to be DNS problems. (the popular “it’s always DNS” meme)
>
>I’m not going to discuss how to solve or avoid any of these problems in this post, but I’ve linked to webpages discussing the problem where I could find them.

https://jvns.ca/blog/2022/01/15/some-ways-dns-can-break/

https://redd.it/sddzh1
@r_devops

Nomad Routing Question

I've been reading up on Nomad, trying to gauge how it works, and I have a question about the network.

Most documents recommend using a service mesh like Consul, but my question is: Does it route the traffic through Consul itself or is it just for service discovery?


I.e., is it: User Request -> Load Balancer -> Consul (on lb) -> Consul (on host) -> Web Service Container?


Or is it: User Request -> Load Balancer -> Web Service Container, where the Consul plugin for, say HAProxy just tells it which hosts it should route to?

https://redd.it/sdbpxk
@r_devops

Anyone experienced with squid proxy?

Have deployed 3.5 squid proxy to act as a firewall and a transparent proxy ( end user doesn’t know there’s a proxy) it works fine for the most part but some dev have complained that they get errors like server retuned error in unknown format ( they have been using salesforce bulkapi through java clients)
I check the logs and nothing is there on squid side. It happens only very rarely, same job goes through upon reruns. Scratching my head as I am not able to reproduce this problem. Does anyone have any suggestions?
Thanks

https://redd.it/sdhkxo
@r_devops

GH Actions + AWS - Is Terraform even needed?

Hey there,

So long story short, there is no DevOps guy on my team yet, so I'm helping with researching and basic setup in the meanwhile.

We are moving to a container based solution for one of our applications, and I was suggested to look into Terraform.

While I do understand what Terraform is for, describing a infrastructure on a special syntax, and let the TF do its magic to achieve that state by manipulating a remote env - in this case AWS - I'm having a bit of a trouble to understand why should I use it when there is a GH Action to deploy a container on AWS directly.

Could anybody provide a bit of insight of pros/cons of using or not using Terraform in this scenario? TIA

https://redd.it/sdi8ir
@r_devops

Kubernetes Cluster deployment using tekton

So we would like a way to be able to easily deploy new Kubernetes clusters whenever we would like all with the same configuration so we can easily deploy our apps, and are thinking of doing that in tekton. So you would run the tekton pipeline locally in minikube, and steps would be taken to install all the dependencies onto the (possibly bare metal) server, I suppose through an ssh connection.

Is this a good idea? Is there a standard way to do something like this? Thanks

BTW, I'm an inexperienced junior developer. So if this is not the right approach please let me know

https://redd.it/sdi2yx
@r_devops

Advice needed: creating CICD pipeline per code or manually

Hi guys, hope you can help me, give me an advice or have some good ideas. Currently we have lets say a pipeline generator where we can create new AWS codepipelines with just creating a small config file which includes the naming, source repo… works pretty fine, written in Typescript and uses CDK. We have 4 pipeline „types“ which differs on the stages and trigger type (s3, ecr, codecommit…). Now more and more developers ask for a custom pipeline because they want different stages, approval steps and so on instead of those pipelines we currently can create via the cicd pipeline generator.

PS: the cdk code of the generator is not written by us it was an external company.

Would you extend the generator to add more pipeline „types“ even if only one project need this custom pipeline, most of the requests are completely different use cases and so the pipelines.

Also creating a pipeline with the generator and modify the codepipeline manually to meet the requirements was a question from the manager. It would work but because the pipeline would be created with CDK so in the end Cloudformation and messing around manually is never a good idea, what you think?

Or would you manually create those custom pipelines? but than it would not be IaC :/ What management force us.

What you think?

https://redd.it/sdkzwn
@r_devops

Cheap CDN option for serving 50TB of video traffic in South America?

Hello,

I'm working on a project for a non-profit doing education via a video course online. They have a project which will require them to get a lot of people through their video course which will end up being about 50TB of video downloads when all is said and done (+/- 20%).

I've been looking at CDN options and so far the cheapest I can find is using DigitalOcean spaces (S3 clone) w/ built in CDN which will be $0.01 per GB of bandwidth transferred so about $500 for the 50TB (not bad!).

The downside with DigitalOcean is the CDN PoP locations aren't close to where the end users will be (in South America) and I worry about latency and playback start rate for the videos...

Cloudflare has closer PoP locations but their sales people are quoting me $5k/month minimum with 1 year contract which would be a starting amount of $50k and not something the non-profit can afford right now.

​

Are there any other CDN solutions for serving the 50TB of video (and in general for hosting video for fairly cheap) with good PoP locations in South America I might be overlooking?

https://redd.it/sd9idn
@r_devops

Cheap CDN option for serving 50TB of video traffic in South America?

Hello,

I'm working on a project for a non-profit doing education via a video course online. They have a project which will require them to get a lot of people through their video course which will end up being about 50TB of video downloads when all is said and done (+/- 20%).

I've been looking at CDN options and so far the cheapest I can find is using DigitalOcean spaces (S3 clone) w/ built in CDN which will be $0.01 per GB of bandwidth transferred so about $500 for the 50TB (not bad!).

The downside with DigitalOcean is the CDN PoP locations aren't close to where the end users will be (in South America) and I worry about latency and playback start rate for the videos...

Cloudflare has closer PoP locations but their sales people are quoting me $5k/month minimum with 1 year contract which would be a starting amount of $50k and not something the non-profit can afford right now.

​

Are there any other CDN solutions for serving the 50TB of video (and in general for hosting video for fairly cheap) with good PoP locations in South America I might be overlooking?

https://redd.it/sd9idn
@r_devops