How long do your pipelines take?

I feel mine are quite slow and its adding too much friction, mainly the E2E tests. But then again I am not too sure what expectations are.


1. Build PR: 8-10 minutes
1. Runs unit tests, and produces a build
2. Release to PR environment: 2 minutes
3. Run E2E tests against PR: 20 minutes

If E2E finds a bug it will take 30 minutes to re-run. If E2E test needs updating it takes 20 minutes to re-run. I run the E2E tests individually for any that I am fixing.

On the plus side the E2E tests are picking up lots of subtle changes, and finding bugs in about 1 out of every 3 PRs.

So how long do your various pipelines take?

https://redd.it/scqn87
@r_devops

NGINX 404 issue on mobile

i have an nginx web server running on a linode. it's configured to redirect requests made to a certain domain, https://example,com to a netlify app, and then a subdomain as well, https://mobile,example,com to another netlify app. it had been working fine, until today.

now, users on mobile who try to access https://mobile,example,com get a 404 error. it works fine on desktop.

furthermore, if a mobile user accesses the root domain AND THEN the mobile subdomain, it also works normally. any pointers on how to fix this?

https://redd.it/scl3a2
@r_devops

app slowness - root cause

looking for examples of general app slowness complaints that took hours/days/etc to nail down and what the root cause was?

​

how did this issue manifest itself within tools/what clues did you have that lead you to the root cause

https://redd.it/scjgdj
@r_devops

What path should i take to be able to run a web-based application and server from home?

I plan on starting a company within the next two years to piggy back on a company im invested in. Resources are minimal right now but they will scale up through the year.

This new company i want to start is going to be primarily based on a Mobile app/Web based app.
I plan to run the server from my home for the first year or so (mostly due to protecting Intelectual Property).

I am learing Linux for the security and server maintance knowledge.

Im not sure where to go after Linux. I know i will need to learn some coding languages. I figured C & C+ shluld be my next goal?

I would love your feed back. I am very new to development and coding.


Once i complete proof of concept i plan on hiring a full time DevOps team. I need to know just enough to build the app.

https://redd.it/scla2a
@r_devops

Advice for a DevOps Beginner

I'm an intern at a startup company and I am lucky enough to have a unique position of being able to work with the development operations team.

I have been with my company for a while (6 months), and I am learning new things but I'm not where I want to be. I want to have more technical knowledge of what we do rather than debugging problems as they show up.

If anyone has any advice, articles, or book recommendations for AWS, Terraform, Kubernetes, Dynatrace, Veracode, and Helm, I would really appreciate it.

https://redd.it/scyobu
@r_devops

Which libraries are instrumented with OpenTelemetry?

Is there an overview of popular libraries and frameworks that are already instrumented with OpenTelemetry?

https://redd.it/scamcq
@r_devops

Importance of the git platform in the interview process

Hey folks, I started to set myself for a company change , but did not start the interviews process.
I have a lot a code, terraform modules, terraform wrappers, Ansible stuff, and python scripts that I keep on my gitlab account , mostly as a portfolio.
I personally love gitlab and use it a lot, but I feel like employers always asks for GitHub accounts, and I'm not sure they would even take the time to check a gitlab repo.

Those of you , who are recruiters on in the interview process, has the git platform any kind of importance ? Does it even matter ?
Any insight would be great, thanks buddies !

https://redd.it/sd0ct1
@r_devops

I'm on a team design quest.

As time move forward, mecury is in retrograde (I'm still on earth 0), the way teams or org work evolve. I'm researching evolution paths and other team experiences.

A. My current model is centralized with promoting tools and process with self service tool any developer can use tool and process to achieve a goal.

B. A model of centralized platform with individuals joining for short periods to rollout tools and process changes. (These may be evangalists, oh my!)

C. A model of adding a devops member to each team with decentralized platform at a team level. Adding a guild as a working group to improve tools and processes.

D. A model of adding a devops member to each team with decentralized platform at a product level. Adding a guild as a working group to improve tools and processes.

​

1. What's your current team structure?
2. What are the pros and cons of your structure?
3. With you being in this structure for a while, how did the idea of how the team would work vary from the actual team work?

https://redd.it/sd14jz
@r_devops

Learning devops with 'why' resources (as opposed to 'how')

It seems to me that most learning resources focus on the how of devops (here are basic docker commands, here is how you write a config file for IaC product X, here's how to add a a load balancer to a k8s cluster), but, for me, that doesn't help much to get a handle on how all these tools fit into a bigger picture, and perhaps more importantly, what necessitates them.

Hoping someone can point me towards resources that introduce one to devops technologies by first explaining the situation - in detail - that would lead to their adoption by a small to medium sized company.

I found on another post a link to some 'real world scenarios' but they all seem like they are starting in media res, and assuming the audience has a good grasp on what their architecture was before they made some big change.

My ideal would be a hands on kind of course that walks you through the major changes over a multi-year timeline of a small company that grew to a medium size company and the new technologies they adopted to make things more efficient/easier or that they were forced to adopt due to failures of their earlier architecture.

Sorry if this comes off as pointless grumbling, i know there are many resources out there.

https://redd.it/sc7n37
@r_devops

Centrally manage GitHub actions

GitHub actions are really great and powerful but I guess the main problem is to manage them centrally. We have over 1500 repos in GitHub organization (enterprise account) and we want to manage workflows effectively

Current solution -
1) Have a central repo with logic.
2) Add workflow files in each repo to checkout our central repo and execute main file with GitHub event

I was looking for some general and cleaner solutions to manage workflows centrally

I was thinking if it's possible to have .github folder as a submodule instead . That way, we can have a central repo for workflows.

Curious to know how you guys are managing this !!

https://redd.it/sd3jy0
@r_devops

Devops / VS2019 - Branch history vs sub branch

So I'm branching out from DEV to work on a complicated change. I merge down ever so often, from the main DEV branch.

Mind you Sub branch (DEV6312) is less than two weeks old!

This morning I'm ready to merge up, but I wanna merge down first, this is VS2019/Devops comparing the two branches:

https://ibb.co/W3631dR

WTH man, get your ducks in a row studio and Devops!

And; What are we doing wrong?

https://redd.it/sd33fr
@r_devops

Coupon code plugin for front/backend

Could you suggest some 3rd party plugin that helps integrate coupon codes?

​

For example, when you register on https://www.printful.com/ you get a coupon code that gives you a -30% discount. And coupon expires in 24 hours.


We want to use it on a custom-built website. We don't use WordPress or smth like that.

https://redd.it/sd5fn8
@r_devops

Running Terraform Cloud from Ansible Playbook

Hi Guys

I see a lot of information and documentation on the topic of integrating terraform and ansible and usually its always something like "run terraform (from local CLI or via Terraform Cloud) and then automatically run some ansible playbooks on the newly created machines via terraform".

As we are heading towards ansible Tower (RHAAP) it seems like it would be a lot more convenient to do this the other way around: controlling terraform cloud via ansible playbooks. Im thinking about using the URI Module to start API-Driven Runs on Terraform from ansible.

Does anybody have experience with that or knows any ressources / example solutions?

https://redd.it/sd72qc
@r_devops

API Traffic Viewer for Kubernetes



Hey all! I'm part of the team that developed Mizu, an open source on [GitHub](https://github.com/up9inc/mizu?utm_source=reddit&utm_medium=devops) \-[API Traffic Viewer for Kubernetes](https://github.com/up9inc/mizu) \-TCPDump and Wireshark re-invented for Kubernetes.

Features

* Simple and powerful CLI
* Monitoring network traffic in real-time. Supported protocols:

* HTTP/1.1 (REST, etc.)
* HTTP/2 (gRPC)
* AMQP (RabbitMQ, Apache Qpid, etc.)
* Apache Kafka
* Redis
* Works with Kubernetes APIs. No installation or code instrumentation
* Rich filtering

How to Run

1. Find pods you'd like to tap to in your Kubernetes cluster
2. Run mizu tap
or mizu tap PODNAME
3. Open browser on https://localhost:8899
**or** as instructed in the CLI
4. Watch the API traffic flowing
5. Type \^C to stop

[Download](https://github.com/up9inc/mizu#features)

[Download Mizu for your platform and operating system](https://github.com/up9inc/mizu#features)

https://redd.it/sd7czr
@r_devops

Unit-tests and production

Hey guys,
I’m really new at this and I’m still trying to learn. There’s something I don’t get about CI CD.

The way I see it unit tests are done by developers. Since they’re at micro level.

So let’s say a developer is working on a feature on a separate branch and then pushes said feature and initiates a pipeline.

Assuming all unit tests and whatnot passes, the next step would be to rebase the feature onto the master and initiate another pipeline and deploy to production, right ? I’m assuming this is also the responsibility of the developers. When doing that are they throwing the test files into gitignore/delete them ? Because they have no reason to be in production.


Also I’d like to know what’s your role in CICD? My friends who work in DevOps don’t really write tests, at all, like none. They more or less construct pipelines based on tests the developers give them and pre existing templates. Is that the common approach ?

Thanks.

https://redd.it/sd8wlg
@r_devops

PowerShell Master Class lesson one passes 300,000 views. THANK YOU!

Another nice milestone 🎉. Lesson one of the PowerShell Master Class hit 300,000 views! I keep this updated with recent new lessons around version 7, debugging, secrets and more.

https://youtube.com/playlist?list=PLlVtbbG169nFq_hR7FcMYg32xsSAObuq8

https://github.com/johnthebrit/PowerShellMC

PowerShell is cross-platform and such a useful tool to have in your belt.

#powershell #azure

https://redd.it/sd6j9r
@r_devops

Should I (we) skip "low level" server stuff and jump right into Kubernetes

Hi,

this thread is probably very opinion-heavy, therefore I think reddit is the best place to ask ;)

I work as a software engineer / devops dude in an IT startup with approx. 20 employees. We develop software that is already being hosted as a SaaS platform in "the cloud" by manually deploying it via Docker on a handful of servers. Each server contains the "full stack" of our software including infrastracture services like an S3 storage or Redis instance. There is "a bit" of tech debt that prevents us from horizontally scaling one of our compontents. But still, this approach has worked fine for now, since our software supports multi-tenancy and we "load balance" tenants across servers.

I am in the lucky position to heavily influence our tech roadmap and the way we do things moving forward. As our customer base is growing, I see limitations with our cloud deployment and want to distribute the mentioned components across several servers. I also want to be flexible with internal routing to avoid having to set up an internal DNS / service discovery system. Moving forward we will develop new applications that I want to integrate fast and often. I believe that this is the key to frequently delivering valuable increments for our customers.

At this point I am honestly struggeling to decide between two general options in regards to hosting our cloud software:

1. Set up an internal network. DHCP + DNS will be used to have application servers communicate with infrastructure services on other servers. Monitoring will be set up to monitor these servers on the same mechanisms.
2. Skip the "low level" stuff and jump right into Kubernetes.

As far as I am concerned, hosting Kubernetes itself is not a simple task. And adopting Kubernetes seems harder than adopting Docker containers (if you haven't used them before).

But still, in any case I (and collegues) will have to learn certain skills. I am unsure if long-term it would be wiser to directly drop Kubernetes if in the long run it would be the used orchestration framework anyway.

I hope I could kind of explain the struggle that I am facing, has been a long workday ;)

Looking forward to your opinions.

https://redd.it/sdcota
@r_devops

Help with ci/cd supervisord deployment

Hi everyone, i new in DevOps (i'm DevOps Jr) my first task is to automate the deployment of somewhat old applications that run through supervisord.

To perform the deployment of a new application tag I perform the following:

# clone repo dev in local machine
git clone URLGITLAB
# add prod repo
git remote add prod URLGITLAB
#
git push prod
git push prod --tags
# Into the instances
cd /opt/app
source env/bin/activate
git fetch
git fetch --tags
git reset --hard vx.x

We have two servers installed with gitlab, one for the dev environment and one for the production environment.

What do you recommend to automate this process? (Jenkins, Ansible, etc)

Regards,

https://redd.it/sde04w
@r_devops

Some ways DNS can break

>When I first learned about it, DNS didn’t seem like it should be THAT complicated. Like, there are DNS records, they’re stored on a server, what’s the big deal?
>
>But with DNS, reading about how it works in a textbook doesn’t prepare you for the sheer volume of different ways DNS can break your system in practice. It’s not just caching problems!
>
>So I asked people on Twitter for example of DNS problems they’ve run into, especially DNS problems that didn’t initially appear to be DNS problems. (the popular “it’s always DNS” meme)
>
>I’m not going to discuss how to solve or avoid any of these problems in this post, but I’ve linked to webpages discussing the problem where I could find them.

https://jvns.ca/blog/2022/01/15/some-ways-dns-can-break/

https://redd.it/sddzh1
@r_devops

Nomad Routing Question

I've been reading up on Nomad, trying to gauge how it works, and I have a question about the network.

Most documents recommend using a service mesh like Consul, but my question is: Does it route the traffic through Consul itself or is it just for service discovery?


I.e., is it: User Request -> Load Balancer -> Consul (on lb) -> Consul (on host) -> Web Service Container?


Or is it: User Request -> Load Balancer -> Web Service Container, where the Consul plugin for, say HAProxy just tells it which hosts it should route to?

https://redd.it/sdbpxk
@r_devops

Anyone experienced with squid proxy?

Have deployed 3.5 squid proxy to act as a firewall and a transparent proxy ( end user doesn’t know there’s a proxy) it works fine for the most part but some dev have complained that they get errors like server retuned error in unknown format ( they have been using salesforce bulkapi through java clients)
I check the logs and nothing is there on squid side. It happens only very rarely, same job goes through upon reruns. Scratching my head as I am not able to reproduce this problem. Does anyone have any suggestions?
Thanks

https://redd.it/sdhkxo
@r_devops