How to use Helm plugins with Terraform's Helm Provider?



Hello all,

I am currently attempting to use the Helm provider to deploy a chart into AWS EKS. This chart has a couple of secrets that I have had encrypted using AWS KMS and the helm-secrets plugin found here:

https://github.com/jkroepke/helm-secret

When deploying directly through Helm, I can simply wrap the regular deployment with the helm secrets plugin like so:

helm secrets install my-chart . -f .\secrets.my-chart-secrets.yaml

and it successfully installs into my cluster no worries. I've also done a successful terraform apply using the helm provider and without encrypted secrets, but I'd like to store them in Github securely.

I am unsure on how to combined these two strategies so I can deploy using terraform and also use the helm-secrets plugin. To expand, I am unsure on how to use plugins in general with it, and I can't seem to find any examples.

In the documentation:

https://registry.terraform.io/providers/hashicorp/helm/latest/docs

there is a plugins_path argument, but I can't figure out a way to actually execute a plugin during the deployment. The helm_release resource doesn't provide many clues for this either.

Is there currently a way to use a helm plugin? If not, would my best bet then be to run a local exec to decrypt the file with the secrets plugin, pass the file in as a values parameter when doing the deployment, and then clean the workspace? This seems like a messy way of doing it when the secrets plugin has a way of handling the decryption and cleaning as a wrapper.

https://redd.it/krw2ln
@r_devops

Monitoring K8s and infrastructure using Prometheus

I have already installed and set up K8s cluster. Prometheus is installed using prometheus operator. When i open prometheus UI there are lots of metrics and i do not know most of them. I have been searching for some documentation about these metrics but nothing concrete for now.

I need in detail explanation for these metrics or at least some documentation. This will be helpful to write my queries.

https://redd.it/krvnhr
@r_devops

JUST NEED SOME ENCOURAGEMENT regarding aws/cloud skills.. ALSO I DONT KNOW WHy this is in all caps.

Hey.

33M here, in NYC. I make about 90-ish as a Sys Admin. Base is 80, 10%-ish bonus, and then free stocks per year. Anywho, I had a roadmap years ago of getting Network+ to my CCNA, to AWS Certs. I actually accomplished all of that, but my job didn't do any AWS tasks, so I actually let them expire.

This is my first decent job where I can actually be cozy and not do much and still get paid decently. Obviously, I got lazy.

I'm a sysadmin but really I don't work that hard. I'm not in charge of much. I've been at my job a couple years but there are 2 coworkers that have been there for 10+. They handle all the big stuff, I handle the day to day stuff like patching, etc.

Anyway, we're moving onto AWS so I guess now that's the kick in the pants I need to really get back onto it. And since I passed the AWS certs in the past, I'm actually in charge of the AWS stuff moving forward.

That being said, I would like to have a cloud oriented type job even if only do S3 stuff at work, and to be completely honest, I want the money that comes along with it as well.

It's just my whole life I did desktop support, or just operations. Nothing back end, no developing, no scripting, no programming, no databases... nothing that important. Unless you count batch files to reboot machines in bunches, lol.

So if I learn AWS again and get the cert again, and know how to manage AWS services... so what? I don't know anything about SQL, databases, programming, containers.. nothing.

It just seems a bit daunting to learn everything from scratch with no experience in any of the specialized stuff, but it seems you need all of that to have a decent paying job with AWS.

Anyone have any general advice to help out with? I've been in IT my whole life so it's not like I'm completely in the dark, I just never needed to learn anything else.

https://redd.it/kru1lj
@r_devops

Best metric for kubernetes sizing horizontal pod autoscaling?

Looking for the best metric to use for this, looking into trying the collective pod cpu/mem usage % but not sure if theres an easy metric to use

​

Using EKS w ALBs

https://redd.it/kroqh6
@r_devops

An opsec realization about what happened at the Capitol

One computer. One single computer is all would take. Some page or intern or secretary who fled the building and their screensaver was slow.

That's all it would take for one of the terrorists that stormed the building to get into the Capitol networks. One single thumb drive to infect the network.

Tell me that you're confident it didn't happen. Tell me that they shouldn't sanitize every single computer in the building.

https://redd.it/ks5psu
@r_devops

Can some one help me to authenticate hashicorp vault with self signed ssl cert,key

I have deployed vault with slef signed certificated but I am unable to authenticate by using those through hvac.

can someone help me how we need to pass those to authenticate.

I have followed the same process like https://hvac.readthedocs.io/en/stable/overview.html

Thanks in advance.

https://redd.it/krok0u
@r_devops

“Application” Registry, not containers?

So internally we have a very important application that builds to a single exe. Presently our lead dev on that project will compile manually, and puts the file into a SharePoint page, where our deployment team can find it and apply it as needed. They keep copies of every single revision the app gets, and there can sometimes be 3-4+ updates in a single day.

So this is fairly crap, so my plan is to build a pipeline from git, using teamCity. We already use this for our web based products, and it’s working nicely.

So the build part, easy done.
I’d prefer not to back a script to push files into SharePoint if I can, so I’m looking for some kind of system (preferably self hosted) where the final output exe can be registered/stored, where previous versions would also remain available.

S3 kinda comes to mind, but I was hoping for something a bit more user-friendly and packable, so we can push things like release notes from commit notes and build logs to be available alongside the exe’s, but not “in” the file.

I love the way container registries (private ones like AWS ECR would be perfect if it did apps too), surely this must be a relatively common situation?

https://redd.it/krmvhz
@r_devops

What Is Infrastructure as Code (IaC)?

Infrastructure as Code (IaC) is a widespread terminology among DevOps professionals and a key DevOps practice in the industry. It is the process of managing and provisioning the complete IT infrastructure (comprises both physical and virtual machines) using machine-readable definition files. It helps in automating the complete data center by using programming scripts.

Popular IaC Tools:

1. Terraform An open-source declarative tool that offers pre-written modules to build and manage an infrastructure.
2. Chef: A configuration management tool that uses cookbooks and recipes to deploy the desired environment. Best used for Deploying and configuring applications using a pull-based approach.
3. Puppet: Popular tool for configuration management that follows a Client-Server Model. Puppet needs agents to be deployed on the target machines before the puppet can start managing them.
4. Ansible: Ansible is used for building infrastructure as well as deploying and configuring applications on top of them. Best used for Ad hoc analysis.
5. Packer: Unique tool that generates VM images (not running VMs) based on steps you provide. Best used for Baking compute images.
6. Vagrant: Builds VMs using a workflow. Best used for Creating pre-configured developer VMs within VirtualBox.

Continue to read further in this blog on - Terraform Beginner’s Guide: Everything You Should Know, and get an overview of Terraform, its lifecycle, and core concepts.

https://redd.it/ks7js9
@r_devops

I want to pursue DevOps in Canada. Should I get a masters first?

Hey everyone!

So I'm currently confused as to how I should approach this. I'm currently on the verge of finishing my Bachelor's in Computer Science Engineering. And I want to get a job in the field of DevOps. I have a few questions in mind in this regard:

1. Is a master's degree worth it in Canada to get a job in DevOps in Canada?
2. Should I get an MSc or MEng degree in the above mentioned masters?
3. What according to you is the preferred university in the above regard?
4. What other certifications should I get?

I hope this post is clear enough to comprehend and I thank you in advance for your answers!

P.S. If you know anyone else who faced this situation before, please DM me!

https://redd.it/ks5h8m
@r_devops

How to set up a distributed system



I have recently started learning about distributed systems, API's, load balancers, replicas of databases / replicas of application servers, how that is good for scaling, redundancy and so on.

Even though I understand the concepts, I am having a hard time figuring out how I can understand these systems by doing, meaning, what application I could try setting up, maybe on cloud, or on a virtual box, and set all the connections between components (set up load balancing - connect it to app servers - connect app servers to databases, how to scale by using replication or something like that) to finally understand how it all works together. There is a lot of information, and I feel somewhat lost.

I will try to sum up.. my goal is to understand how to set up a n-tier distributed system, how to connect all the components, and not to get overwhelmed so preferably a guide / course / tutorial where all the requirements and steps are defined.

I know it's a bit much/too broad of a guidence to ask, but I would appreciate any information. I am preparing for a enterprise sys admin / devops position, so that's why am looking into this. I don't really care what to deploy, I just want to get how it works together on this scale.

Thank you!

https://redd.it/ks3zre
@r_devops

How to Use GitOps with ArgoCD

Hi everyone, I wrote an article about how we integrated GitOps and ArgoCD into our deployment workflow. I hope you would like it. Currently, we are planning to use Argo Rollouts to benefit from Blue/Green and Canary deployment strategies. I would like to hear your opinions and feedbacks if you have a similar setup! https://medium.com/trendyol-tech/how-to-use-gitops-with-argocd-1782b8493cc3

https://redd.it/krjt9a
@r_devops

How To Integrate Jenkins With Selenium WebDriver?

Jenkins integration with Selenium is an important part of any organization’s Selenium test automation strategy. This guide will help you integrate Jenkins with Selenium and reap the benefits.

https://redd.it/kr0k57
@r_devops

Looking for some guides on using grafana with elasticsearch

I'm working on this project for school that involves performing realtime analytics on video streams, I've set up all the infrastructure required for this and am getting plenty of data related to the video stream into elasticsearch.

the thing is I'm new to both elasticsearch and grafana I'm having a hard time writing lucene queries to show visualisations, can someone please recommend a good resource to learn.

https://redd.it/kscvkb
@r_devops

How can I test with headless mode Selenium scripts when Cloudflare is enabled?

I want to use headless mode execution of selenium scripts for browser testing but Cloudflare blocks them. Is there a way to bypass this?

https://redd.it/kqvtdf
@r_devops

Finding the opportunity in uncertainty in custom software development - Am I off?

Hey all-

I've been thinking a lot about the uncertainty that creeps up in developing software at all levels and finally decided to write about it. I think it's interesting how so many people at every level of development are hit with uncertainty at some point. What's more, I think it's an opportunity to achieve something great if we learn to approach it correctly.


I've been there a bunch of times as a developer where I've stopped what I was doing and said, "Am I Doing this Right?". Usually I just do things anyway, plow ahead, and learn from my mistakes later. It's that kind of stuff that stick with me though.


I'd love some feedback on this issue and the stuff I've written -- uncertainty in custom software development.

https://redd.it/kseqiu
@r_devops

What happens when you delete a Pod in Kubernetes?

Did you know that deleting a pod in Kuberentes can drop traffic even if app is stopped gracefully? In this video you will learn:
↕️ Endpoint controller & kubelet's role in deleting a pod
🚦How to avoid traffic being dropped from application while the pod is being deleted
https://youtu.be/nBDKZanYUNM

https://redd.it/ksedps
@r_devops

Bugfixes and multiple versions

What would you recommend to someone who has a product which runs in several instances which aren't necessarily in the same version? When a bug surfaces that would mean fixing it in older versions also.

I get that the best DevOps scenario is just have latest everywhere and deploy often. But if that is not the case?

https://redd.it/kshfmi
@r_devops

Terraform examples for the major clouds

I have been encouraging my medium sized consulting company (500 consultants) to pool our Terraform recipes. So far it has had very real impact in speeding up IaaC deployments across clients. Terraform has been the first time we have managed to codify "technical knowledge exchange" across industries across geographic boundaries and we have seen a clear speedup and increase in quality as a result. Basically when you reuse a terraform recipe you save a ton of trial and error proving additional time to polish or add additional features, this compounds over time.

Anyway I hope it might be useful to you, and I encourage others to contribute. Because our company has no bias towards AWS/Google/Terraform I think its a unique repository that doesn't have any constraints on what it hosts. Obviously Hashicorp's own terraform examples (https://github.com/hashicorp/terraform-guides) are also very useful but it doesn't go into as much details as our, and they are not motivated by real customer problems or inhibited by politics so I think ours has a complementary use too.

Check it out I hope it helps: https://github.com/futurice/terraform-examples

https://redd.it/ks9upb
@r_devops

gitlab-ci does not stop when building aar failed

In my job in gitlab-ci pineline, I run "flutter build aar" and other commands next to it. When building aar fail, the console outputs are as below and its failed. The job does not stop, and the pineline succeeds in the end. How to make it stop when building aar fail?

https://redd.it/ksjyum
@r_devops

Containers in WebAssembly?

Saw this trending today on github.

Wasmer enables super lightweight containers based on WebAssembly that can run anywhere: from Desktop to the Cloud and IoT devices.

You also think that going closer to the bare metal can improve performance as compared to traditional approach?

wasmer

https://redd.it/kslw1s
@r_devops

Anyone using LogicMonitor ?

Anyone using logicmonitor.com and willing to share thoughts (good/bad) ?

https://redd.it/kskylx
@r_devops