Reddit DevOps
267 subscribers
30.9K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
Can some one help me to authenticate hashicorp vault with self signed ssl cert,key

I have deployed vault with slef signed certificated but I am unable to authenticate by using those through hvac.

can someone help me how we need to pass those to authenticate.

I have followed the same process like https://hvac.readthedocs.io/en/stable/overview.html

Thanks in advance.

https://redd.it/krok0u
@r_devops
“Application” Registry, not containers?

So internally we have a very important application that builds to a single exe. Presently our lead dev on that project will compile manually, and puts the file into a SharePoint page, where our deployment team can find it and apply it as needed. They keep copies of every single revision the app gets, and there can sometimes be 3-4+ updates in a single day.

So this is fairly crap, so my plan is to build a pipeline from git, using teamCity. We already use this for our web based products, and it’s working nicely.

So the build part, easy done.
I’d prefer not to back a script to push files into SharePoint if I can, so I’m looking for some kind of system (preferably self hosted) where the final output exe can be registered/stored, where previous versions would also remain available.

S3 kinda comes to mind, but I was hoping for something a bit more user-friendly and packable, so we can push things like release notes from commit notes and build logs to be available alongside the exe’s, but not “in” the file.

I love the way container registries (private ones like AWS ECR would be perfect if it did apps too), surely this must be a relatively common situation?

https://redd.it/krmvhz
@r_devops
What Is Infrastructure as Code (IaC)?

Infrastructure as Code (IaC) is a widespread terminology among DevOps professionals and a key DevOps practice in the industry. It is the process of managing and provisioning the complete IT infrastructure (comprises both physical and virtual machines) using machine-readable definition files. It helps in automating the complete data center by using programming scripts.

Popular IaC Tools:

1. Terraform An open-source declarative tool that offers pre-written modules to build and manage an infrastructure.
2. Chef: A configuration management tool that uses cookbooks and recipes to deploy the desired environment. Best used for Deploying and configuring applications using a pull-based approach.
3. Puppet: Popular tool for configuration management that follows a Client-Server Model. Puppet needs agents to be deployed on the target machines before the puppet can start managing them.
4. Ansible: Ansible is used for building infrastructure as well as deploying and configuring applications on top of them. Best used for Ad hoc analysis.
5. Packer: Unique tool that generates VM images (not running VMs) based on steps you provide. Best used for Baking compute images.
6. Vagrant: Builds VMs using a workflow. Best used for Creating pre-configured developer VMs within VirtualBox.

Continue to read further in this blog on - Terraform Beginner’s Guide: Everything You Should Know, and get an overview of Terraform, its lifecycle, and core concepts.

https://redd.it/ks7js9
@r_devops
I want to pursue DevOps in Canada. Should I get a masters first?

Hey everyone!

So I'm currently confused as to how I should approach this. I'm currently on the verge of finishing my Bachelor's in Computer Science Engineering. And I want to get a job in the field of DevOps. I have a few questions in mind in this regard:

1. Is a master's degree worth it in Canada to get a job in DevOps in Canada?
2. Should I get an MSc or MEng degree in the above mentioned masters?
3. What according to you is the preferred university in the above regard?
4. What other certifications should I get?

I hope this post is clear enough to comprehend and I thank you in advance for your answers!

P.S. If you know anyone else who faced this situation before, please DM me!

https://redd.it/ks5h8m
@r_devops
How to set up a distributed system



I have recently started learning about distributed systems, API's, load balancers, replicas of databases / replicas of application servers, how that is good for scaling, redundancy and so on.

Even though I understand the concepts, I am having a hard time figuring out how I can understand these systems by doing, meaning, what application I could try setting up, maybe on cloud, or on a virtual box, and set all the connections between components (set up load balancing - connect it to app servers - connect app servers to databases, how to scale by using replication or something like that) to finally understand how it all works together. There is a lot of information, and I feel somewhat lost.

I will try to sum up.. my goal is to understand how to set up a n-tier distributed system, how to connect all the components, and not to get overwhelmed so preferably a guide / course / tutorial where all the requirements and steps are defined.

I know it's a bit much/too broad of a guidence to ask, but I would appreciate any information. I am preparing for a enterprise sys admin / devops position, so that's why am looking into this. I don't really care what to deploy, I just want to get how it works together on this scale.

Thank you!

https://redd.it/ks3zre
@r_devops
How to Use GitOps with ArgoCD

Hi everyone, I wrote an article about how we integrated GitOps and ArgoCD into our deployment workflow. I hope you would like it. Currently, we are planning to use Argo Rollouts to benefit from Blue/Green and Canary deployment strategies. I would like to hear your opinions and feedbacks if you have a similar setup! https://medium.com/trendyol-tech/how-to-use-gitops-with-argocd-1782b8493cc3

https://redd.it/krjt9a
@r_devops
How To Integrate Jenkins With Selenium WebDriver?

Jenkins integration with Selenium is an important part of any organization’s Selenium test automation strategy. This guide will help you integrate Jenkins with Selenium and reap the benefits.

https://redd.it/kr0k57
@r_devops
Looking for some guides on using grafana with elasticsearch

I'm working on this project for school that involves performing realtime analytics on video streams, I've set up all the infrastructure required for this and am getting plenty of data related to the video stream into elasticsearch.

the thing is I'm new to both elasticsearch and grafana I'm having a hard time writing lucene queries to show visualisations, can someone please recommend a good resource to learn.

https://redd.it/kscvkb
@r_devops
How can I test with headless mode Selenium scripts when Cloudflare is enabled?

I want to use headless mode execution of selenium scripts for browser testing but Cloudflare blocks them. Is there a way to bypass this?

https://redd.it/kqvtdf
@r_devops
Finding the opportunity in uncertainty in custom software development - Am I off?

Hey all-

I've been thinking a lot about the uncertainty that creeps up in developing software at all levels and finally decided to write about it. I think it's interesting how so many people at every level of development are hit with uncertainty at some point. What's more, I think it's an opportunity to achieve something great if we learn to approach it correctly.


I've been there a bunch of times as a developer where I've stopped what I was doing and said, "Am I Doing this Right?". Usually I just do things anyway, plow ahead, and learn from my mistakes later. It's that kind of stuff that stick with me though.


I'd love some feedback on this issue and the stuff I've written -- uncertainty in custom software development.

https://redd.it/kseqiu
@r_devops
What happens when you delete a Pod in Kubernetes?

Did you know that deleting a pod in Kuberentes can drop traffic even if app is stopped gracefully? In this video you will learn:
↕️ Endpoint controller & kubelet's role in deleting a pod
🚦How to avoid traffic being dropped from application while the pod is being deleted
https://youtu.be/nBDKZanYUNM

https://redd.it/ksedps
@r_devops
Bugfixes and multiple versions

What would you recommend to someone who has a product which runs in several instances which aren't necessarily in the same version? When a bug surfaces that would mean fixing it in older versions also.

I get that the best DevOps scenario is just have latest everywhere and deploy often. But if that is not the case?

https://redd.it/kshfmi
@r_devops
Terraform examples for the major clouds

I have been encouraging my medium sized consulting company (500 consultants) to pool our Terraform recipes. So far it has had very real impact in speeding up IaaC deployments across clients. Terraform has been the first time we have managed to codify "technical knowledge exchange" across industries across geographic boundaries and we have seen a clear speedup and increase in quality as a result. Basically when you reuse a terraform recipe you save a ton of trial and error proving additional time to polish or add additional features, this compounds over time.

Anyway I hope it might be useful to you, and I encourage others to contribute. Because our company has no bias towards AWS/Google/Terraform I think its a unique repository that doesn't have any constraints on what it hosts. Obviously Hashicorp's own terraform examples (https://github.com/hashicorp/terraform-guides) are also very useful but it doesn't go into as much details as our, and they are not motivated by real customer problems or inhibited by politics so I think ours has a complementary use too.

Check it out I hope it helps: https://github.com/futurice/terraform-examples

https://redd.it/ks9upb
@r_devops
gitlab-ci does not stop when building aar failed

In my job in gitlab-ci pineline, I run "flutter build aar" and other commands next to it. When building aar fail, the console outputs are as below and its failed. The job does not stop, and the pineline succeeds in the end. How to make it stop when building aar fail?

https://redd.it/ksjyum
@r_devops
Containers in WebAssembly?

Saw this trending today on github.

Wasmer enables super lightweight containers based on WebAssembly that can run anywhere: from Desktop to the Cloud and IoT devices.

You also think that going closer to the bare metal can improve performance as compared to traditional approach?

wasmer

https://redd.it/kslw1s
@r_devops
Invalidating a web resource where cached resource's expire date isn't expired yet

Let's say the resource that was cached by a client web browser has an eTag and has an expire date of June 30, 2021. My assumption is that every time the browser visits this page again, it will grab it from its local cache or copy. How can we tell the browser that a new version of the resource has been uploaded and that his local copy isn't stale yet? We can't tell everyone that new resource has been uploaded. What is also the behavior when this resource is being served by Nginx?

For sure, we can delete our local cache but some visitors doesn't really know how to do that.

https://redd.it/ksk5lz
@r_devops
Seeking Career Advice

Hey everyone,

Hope you’ve all been in good health!

I was hoping you guys could give your opinions on my situation and I’ll try to be brief.

I’m a DevOps contractor operating in Toronto with 2 years of experience. I’m charging $40/hr +HST in my current contract, and the client expressed interest in hiring me full-time when my contract ends. There was a brief mention of compensation which was much lower than what I currently charge “because benefits”.

Now obviously I’m unhappy about that, but it’s not time to discuss compensation yet and I’m sure they’re open to listening; I like them and they like me. But I live in Canada and health care isn’t an issue so benefits is not a big deal for me.

I’m most likely going to ask to remain as a contractor and even try to bump up my rate, but I think I’ll have better luck just finding another contract tbh.

My questions are:
- Am I already charging way too little?
- How does one gauge what to charge?
- Should I choose the contracting life and keep hopping on whoever pays me more till I decide to settle?
- Are you a fulltime or contractor advocate? Why?

I don’t think I should focus on a stable long term job in one place now because I feel like I’ll be missing out on opportunities and experiences. This field is hot and we are in demand. I feel like I should leverage that.

I also have a CKA cert and working on Vault and cloud certs, if that’s relevant in any way.

I ask because I want to know what is realistic to charge as I begin searching for new contracts and negotiate.

Any personal experience stories and advice would be great too. Appreciate yall and Happy New Year!

https://redd.it/kqe6sd
@r_devops
B2B How do you charge for time spent on mailing / calling with customer?

First of all - I have no idea where could I post such a question, but I believe that in devops reddit there are both programmers and ops that work in B2B model, so they may know the pain. Also I cannot think of other place anyway...

Me as an individual who runs a company I always try to do my best when staying in touch with my customers, this mean both the good quality mail responses and extensive phone calls whenever needed. However during the whole month such things can be counted in a big amount of hours (explaining why things works the way they do in mailing, having few 30 minutes calls stacks up, once I had a 2 hour call) which ends with a follow up questions from customer that sounds like "can you check it?", or "cah you test it?". Well, yeah, if you would consider paying me for what you should already know, right?

This is an invisible pile of hours, and I am wondering how other people tells their customer "Hey, I just spend 10 hours on communication with you. Here is the bill"

https://redd.it/kq94xg
@r_devops
Need advice on scaling and containers/K8s.

Hello,I have a VPS running a node/express cluster with pm2 behind nginx serving my APIs. Recently my API has attracted a lot of users and I have many problems scaling.I also have the mongoDB instance running locally.I want to upgrade my architecture.

I have upgraded from $5 VPS to a $40VPS and it has been scaling nicely until now. I'm seeing more and more latency on my requests during peak times.

So the first step was to optimize my code. I did that. That took some time off my routes. Next I want to do these things and I need advice on each of these points:
- Keep mongoDB on a separate $5 instance and make it a private network so that two of my VPS can talk. Should I do this?- Move from express -> fastify.
- I've never used Docker/K8s. I've read about them would like to use them. I use digitalocean as my VPS provider and they offer a k8s auto scaling option. I see no users in the night so I would like the server to scale down during that time to save costs, and then to auto-scale to multiple nodes during peak hours. I've never worked on containers. My current architecture is very monolithic. What changes would I have to do to achieve this or should I do something different altogether.
- Any other advice you would like to offer based on my arch:


My complete architecture:
- Ubuntu
- Nginx
- Mongo
- DBNodejs + Express + Redis + Socket.io

Thanks in advance!

https://redd.it/kq37z0
@r_devops