Actually working, resource-efficient, user-friendly local development environment for a HA multi-master Kubernetes (K3s) cluster

After long nights of troubleshooting and reading Github issues, I can finally share my work: https://github.com/medmouine/vagrant-k3s-HA-cluster


This repository contains all the configuration and scripts you need to run a Kubernetes (K3) cluster locally in a highly available, load-balanced manner.


It is the easiest, best (and probably the only) way to run an efficient (low resources, user-friendly, up-to-date) Kubernetes cluster on a local development environment with just a few CLI commands.


Hope this will be helpful for your personal or professional projects.

See README for details.

https://redd.it/n3ghq1
@r_devops

Terraform AWS FIPS provider

Hey guys, this was a royal pain in the ass to type up and I figured you guys may find it helpful. I've had some compliance requirements and FIPS 140-2 validated encryption is a requirement. I went through the AWS docs and got every AWS FIPS endpoint into the AWS provider.

You can maybe modularize something like this but I haven't ever tried setting up a provider in a module so I'm not sure if that's possible.

Here's a blog link: https://blog.kwnetapps.com/terraform-aws-fips-provider/

Here's a link to the github repo: https://github.com/Kaydub00/terraform-aws-fips

Now, there's probably more to meeting these requirements for your org, but if you need to meet these requirements and you're using TF and AWS you'll need this. Granted I've never been asked by an auditor to see this stuff, you may get an auditor who knows their stuff.

https://redd.it/n3af0g
@r_devops

Monorepo for microfrontends, how to set it up?

We have split several applications with microfrontends. Now these microfrontends can be reused across different applications. However until now each application has its own repo.

Should we swich to a single monorepo in order to make this more effective and manageable? how?

We are working on Azure Devops and frontends in Angular.

Any suggestion welcome

https://redd.it/n36euv
@r_devops

Which cloud provider to choose for an EdTech business?

Hello,

I wanted to know which cloud provider to choose for a better service and easy experience to host an EdTech business'? I am aware of 300 free credits provided by GCP for the initial signin, but AWS is one of the leading provider, hence, I'm confused.

https://redd.it/n32zn6
@r_devops

how to troubleshoot airflow csv inserts to db ?

i.e

I managed to extract info from db A and dump to csv.
Now airflow will pickup the csv ( success ) but unable to insert ( usually it's working ).

I alread created the table before the insert.

If the input csv has say 50 cols, how do we need which columns has issues? I suspect is incompatible columns. I have several timestamp and the rest are char.

Thanks.

https://redd.it/n31uql
@r_devops

Traditional on premises to Cloud

I’m a network engineer would love to more about devops. I don’t see any use to go above VM’s for small org like us. But want to learn so we may find a way thats useful for us and also reduce the cost in the long run. Where would small orgs can use devops? How containers came into play? Is there a good book that gives us the idea of moving to cloud and from on premises and from VM’s to containers? Where the regular IT is going in terms of research? If we don’t have a app on our own and uses only third party apps? Any useful going this devops route?

https://redd.it/n43nia
@r_devops

Are there any reputable degree programs out there that specifically focus on DevOps?

The main thing holding me back from getting a degree is I don't want to be learning outdated or irrelevant concepts that I'll never end up using again. I know of WGU's Cloud Computing program so if anyone has some opinions on it feel free to speak up, or if there are any good alternatives out there from other reputable colleges would be great to know.

https://redd.it/n46fmb
@r_devops

Open Source Programming Help Needed!!

Hi everyone,

We are a team of graduate students at UCSD working on a combined Open Source analysis tool that would make the process of scanning large banks of OS code for security vulnerabilities and license compliance issues.

We have a starting point, but are looking for help with our next steps. We have built a short anonymous survey of 16 questions (less than 10 minutes). Any help would be greatly appreciated. Thanks!

The link to the survey is below:

https://ucsd.co1.qualtrics.com/jfe/form/SV\_6eUZXbkJsoQ7cOO

https://redd.it/n4b9br
@r_devops

What can I do if a company warned me about copyright infringement on a dictionary?

I developed a dictionary, a simple collection of words which I scrapped from several dictionaries and removed all the visual garbage and advertisements, as a lover of linguistics I am. Now the legal department of one of those dictionaries sent me a legal warning to shutdown the site.

I am totally lost, thus I pose the following questions for which I am grateful that someone could help

Can they shutdown my website? The TLD is .pt and the server is in Germany
If I move the server to Russia, for example, with a TLD .org, will it help?

Thanks a lot

https://redd.it/n411h7
@r_devops

Thoughts on internal developer platforms?

I wanted to ask regarding thoughts about introducing internal developer platforms.

The goal of DevOps at the end of the day is to not be a bottle neck and to create pace. The way you create pace is by automating everything so that developers can move at their own pace.

Wouldn't introducing IDPs be a good way to do this?

In an ideal world, DevOps engineers can template out infrastructure modules for common use cases (think containers, static sites, etc.) Developers then can just deploy the needed infrastructure that will setup and run their applications without needing to be exposed to all the intricacies of infrastructure. If this is true, wouldn't IDPs be the best abstraction layer for developers so that they're not forced to be come infrastructure experts?

Has anyone here implemented / built out an IDP for your company? If so, how successful has it been?

https://redd.it/n3zbop
@r_devops

Can single Loki instance works with multiple projects?

I am wondering whenever I can run Loki instance for all my projects and correctly authorize them with something like access token, or I will have to create as many Loki instances as many projects I have (which does not make sense for Grafana single DataSource).

https://redd.it/n4f2i7
@r_devops

C is missing from the majority of CI/CD implementation

The vast majority of CI/CD implementations that I saw, especially among enterprise companies, are completely missing the point of merging to the mainline frequently (e.g., at least once a day). Yet, everyone claims to be doing at least CI, if not CD. Why is that?

https://youtu.be/0ivcSjpUzl4

https://redd.it/n3yg6v
@r_devops

Pay cut for better experience

Hi everyone,

This is a follow-up to a previous post I made a few months ago re: my transition to DevOps two years ago. In short, I was promoted internally to a DevOps role but haven't gained the experience I expected (https://redd.it/m0tg7y).

At the recommendation of some who were nice enough to provide feedback, I've been applying and expect to get an offer from a company to join their software engineering team as a Devops Engineer. The key differences between this new opportunity and ym current role are, I will be supporting a production software product (not internal IT), will be embedded with software engineers, and I will be focused on build/test/deploy versus simply automating cloud infrastructure.

The only drawback is there would be a significant pay decrease (~30/40%)- mostly due to accumulated RSU value over the last four years at my current company. The wage would still be very livable and comfortable.

My gut tells me to take the hit as the experience will get me closer to where I'd like to be in the long run. Is this a good idea? Tell my why/why not.

https://redd.it/n46zcn
@r_devops

HELP Octopus Deploy Users - How to Automate Custom User Roles & Teams?

For those of you using Octopus Deploy, is there a way to automate the create of custom user roles & teams (adding said role to new custom team)? I can't seem to find anything for this in their API's, etc.

If someone has figured it out or found a way, I'd LOVE to hear it!

https://redd.it/n41llg
@r_devops

Questions regarding CI/CD and Cloud provider cert

Hey guys,

So I'm studying my Devops path for about 5 month's ...

So I have three questions,

1- I know that the most popular tool right now is Jenkins, however after working with it for a few weeks this tool is a mess.. I think that Azure devops is much more useful and easier, should I make this transition or stick with the most common tool in the industry ?

2- Which certification is it recommended for me to study in order to have a high knowledge in cloud integration, AWS (for example) in regarding to the Dev-ops world? (deploying apps on the cluster, monitoring and etc...)

3- Is it a must to know a programming language? if I know Bash can it be a replacement or I need them both?

​

​

Thanks in advanced to everyone willing to assist!

https://redd.it/n40wx9
@r_devops

Data on Kubernetes Community Day Kubecon EU 2021 Co-located Event

The Data on Kubernetes Community is an open space in which users of Kubernetes for data share their experiences, compare approaches, and generally commiserate and collaborate.

Check it out.

https://youtu.be/xK7KLaBLaQQ
https://dok.community/​
https://go.dok.community/slack

https://redd.it/n3zvba
@r_devops

Which platform would you recommend to deploy a React/Node application?

Hi,

I will soon need to deploy an app with a React front-end and a node/express server connected to Mongo Atlas. I'm a complete noob with deployment (I've just deployed free static sites on Heroku, Netlify and github pages).

My expectations are:

A service simple to use, that don't require maintenance (so no AWS).
A reasonable pricing (of course\^\^). By reasonable I mean 15$/month or so, for both front and back. If the app gains traction, then I'll be happy to invest real money, but for the moment, I don't even know if i'll get 1 customer. So I gotta be careful with the cash.
Continuous deployment from git repo
Ability to connect with Mongo Atlas.
Decent performance (I've heard that Heroku dynos must restart every 24 hours and may be a bit slow to handle the first connection. Since I've got websockets running, I'm a bit afraid of that).
Optionally: ability to deploy a staging environment from a dev branch to check changes before merging into master/prod.

I'd prefer to stick with the same provider for the sake of simplicity, but I'm fine with using two different services if needed.

I've heard about Render, but it seems it doesn't support Mongo Atlas, is this true? There are many solutions out there, and quite frankly, I don't know sh*t about them, nor about deployment.

Which service would you suggest for my usecase? Also, is it compulsory to dockerize my front and back? For the moment, it's just a classic app with a dist/build folder. I need the server to run on node >14 to handle Intl api
(to translate dates). Is a { "engines" : { "node" : ">0.14" } }
in package.json
enough?

Thanks for your feedbacks!

https://redd.it/n3sqxs
@r_devops

Can c5.xlarge server handle 100k users?

We are a startup and our target uses gonna be 100k so can c5.xlarge handle it?
Our product is a news app daily 30 to 40 article of news published .Active users 50 to 60k daily. Or which is the best server (suitable for our usecase)

https://redd.it/n3zdji
@r_devops

Ruby Schedulers: Whenever vs Sidekiq Cron vs Sidekiq Scheduler

A post that I've made on Cron tool for Ruby apps: https://medium.com/serpapi/ruby-schedulers-whenever-vs-sidekiq-cron-vs-sidekiq-scheduler-b229d7ca5256

https://redd.it/n3ouzl
@r_devops

How much It costs for 100k users in Amazon web service(NEWS APP)

We have a local news app.Our target will be 100k to 150k .So our cms Is deployed in e2 currently .How much It would cost for 100k users a month.App we will be posting 20 to 30 articles daily and in app !
Can any one tell me the rough budget monthly?

https://redd.it/n3nqlp
@r_devops

Cli tool or library for obfuscating sensitive data

Hi,

Does anyone knows a library for obfuscating and masking the usernames and password inside of text file content?

Like Gitlab Ci does it, masking all sensitive content

I don’t care about the language in which it is written( hope it is not .net,lol)

Basically, want to use it as a post processing step in one of my own devops tools , which gonna save all the commands from bash history

Update:
Found new tool myself, teller. Need to try it though, they say it can remove sensitive data and manage secrets

https://redd.it/n4k3j3
@r_devops