Reddit DevOps
270 subscribers
9 photos
31.1K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
how to scale a multi tenant b2b saas

i want to make a b2b saas where i provide the business owner a website that they can use to handle their visitors

what i wonder is how to scale it so each tenant is isolated, so no noisy neighbour

i mean like if there are increasing client so they get their own resources

is load balancing do the job?
what about the database? how to scale it

https://redd.it/khbw1b
@r_devops
"Hello World" !

Hello guys, Im just joining this subreddit. I'm want to learn and to become a DevOps engineer. Mostly I self taught so I need some Advice on what to learn and how to learn it. I've known about the baisc of Linux, Networking and Virtualization.

Thank you for your time reading this !

https://redd.it/ki3hcx
@r_devops
One Sentence for Every AWS Instance Type

Every time I'm starting a new service to run internally or reviewing something we have going, I find myself struggling to find the right instance type for the needs. For instance, there are three families (r, x, z) that optimize RAM in various ways in various combinations and I always forget about the x and z variants.

So I put together this "cheat sheet" for us internally and thought I'd share it for anyone interested. Pull requests welcome for updates: https://github.com/wrble/public/blob/main/aws-instance-types.md

Did I miss anything?

https://redd.it/ki8rlp
@r_devops
Are developers going to rule the next coming years....

In the long run meaning at least like 5 years from now, do DevOps and SREs roles merge into Software Development, the reason i am asking this is, i am seeing SDE and programmers in general(SQL developers, frontend/backend devs) have already started taking on job duties of DevOps and SREs folks, devs in our org are doing CICD pipelines, IaC, developing custom pages/apps using APIs, watching APM alerts and figuring out performance issues, implementing security best practices etc. I know more than often businesses require dedicated Application and DevOps/SRE teams. But if one has to invest in learning and keeping up with advancements/changes in tech industry, would it help to start leaning towards SDE skillset, when it comes to skilling up and career path. I feel like companies have already started hiring developers with DevOps/SRE skillset (or train them if they are lacking). Just spit balling here, feel free to share your opinions...

https://redd.it/kic9mz
@r_devops
Automating the publishing of Helm charts to repo

Searching brings up a lot of pipeline for deploying the chart but what I want to learn is a workflow for publishing the charts to a repository. Let's say you have a folder Charts with many charts of your org. When that folder changes, trigger testing and push those charts to repo. I was going to script it but wondering if there's an efficient method.

https://redd.it/kikgf4
@r_devops
Broach devops technology? Whats that ? Help appreciated

Can someone help me understanding the term.

https://redd.it/kindx2
@r_devops
Is standalone VPS for running unit tests the whole day considered a ToS violation?

I can imagine that buying any decent VPS machine at any provider and putting there an online system to run in a loop of unit tests can degrade the machine hard disk hard and create constant CPU usage.

Ngl; I am lightly comparing this to crypto mining which is not really the thing cloud providers allow to my limited knowledge.

I guess throttling VPS resources have its name

https://redd.it/kirt1q
@r_devops
macOS 11.1, VMware Fusion and Vagrant Plug-in for kitchen-CI HELP

Hi all,

After Virtual Box stopped working with Big Sur our company has told us to use VMware Fusion as hypervisor choice for corporate Macs. So need to replicate Test-Kitchen setup w/VBox on VMWare/Vagrant.

System configuration:

macOS 11.1
VMWare Fusion 12.1 (Latest)
Vagrant VMWare Plug-in 1.0.17 (purchased today)
Chef Workstation 20.7.96 (Infra Client 16.2.73)

VAGRANT_DEFAULT_PROVIDER

$ echo $VAGRANTDEFAULTPROVIDER
vmwaredesktop

**kitchen.yml:**

driver:
name: vagrant
provider: vmware
fusion

network:
- "forwarded_port", {guest: 5985, host: 55985}

provisioner:
name: chefzero
log
level: warn

platforms:
- name: W2012-3.2.12-14DEC20
driver:
host: 127.0.0.1
port: 55985
guest: windows
transport:
name: winrm
elevated: true
elevatedusername: SYSTEM
elevated
password: null
driverconfig:
gui: true
guest: windows
username: Administrator
password: *********
communicator: winrm

suites:
....

When I run kitchen converge I get this:

-----> Starting Test Kitchen (v2.5.3)
-----> Creating <VM-W2012-3212-14DEC20>...
Bringing machine 'default' up with 'vmware
fusion' provider...
==> default: Box 'W2012-3.2.12-14DEC20' could not be found. Attempting to find and install...
default: Box Provider: vmwaredesktop, vmwarefusion, vmwareworkstation
default: Box Version: >= 0
==> default: Box file was not detected as metadata. Adding it directly...
==> default: Adding box 'W2012-3.2.12-14DEC20' (v0) for provider: vmware
desktop, vmwarefusion, vmwareworkstation
default: Downloading: W2012-3.2.12-14DEC20
An error occurred while downloading the remote file. The error
message, if any, is reproduced below. Please fix this error and try
again.

Couldn't open file /Users/<pathto>/.kitchen/kitchen-vagrant/VM-W2012-3212-14DEC20/W2012-3.2.12-14DEC20
>>>>>> ------Exception-------
>>>>>> Class: Kitchen::ActionFailed
>>>>>> Message: 1 actions failed.
>>>>>> Failed to complete
#create action: [Expected process to exit with [0], but received '1'
---- Begin output of vagrant up --no-provision --provider vmware
fusion ----
STDOUT: Bringing machine 'default' up with 'vmwarefusion' provider...
==> default: Box 'W2012-3.2.12-14DEC20' could not be found. Attempting to find and install...
default: Box Provider: vmware
desktop, vmwarefusion, vmwareworkstation
default: Box Version: >= 0
==> default: Box file was not detected as metadata. Adding it directly...
==> default: Adding box 'W2012-3.2.12-14DEC20' (v0) for provider: vmwaredesktop, vmwarefusion, vmwareworkstation
default: Downloading: W2012-3.2.12-14DEC20

STDERR: An error occurred while downloading the remote file. The error
message, if any, is reproduced below. Please fix this error and try
again.

Couldn't open file /Users/<path
to>.kitchen/kitchen-vagrant/VM-W2012-3212-14DEC20/W2012-3.2.12-14DEC20
---- End output of vagrant up --no-provision --provider vmwarefusion ----
Ran vagrant up --no-provision --provider vmware
fusion returned 1] on VM-W2012-3212-14DEC20

This gives me the impression the Vagrant VMWare driver is not working. I have had the setup working before but with macOS 10.15, VMWare Fusion 11 and Vagrant VMware Plug-in 1.0.7. Latter don't work with macOS 11.1.

Anyone please able to share wisdom of how to get this working.

Regards and happy holidays.

https://redd.it/kisgfu
@r_devops
Has anyone figured out a trunk based strategy using GitHub Actions?

I come from Azure DevOps where we use separate build and release pipelines that are linked and therefore implementing this is trivial, the release pipeline has access to various build pipeline variables and published artifacts.

I found this post https://www.reddit.com/r/devops/comments/gnnr5a/functionality_to_trigger_github_actions_builds_on/?utm_source=amp&utm_medium=&utm_content=comments_view_all and is not really what I’m looking for, I’m hoping there is a native solution. The comments on that thread are pretty terrible, not what I’ve come to know from this sub, but I’m a more recent subscriber.

The idea I’m shooting for, if you’re unfamiliar, is building once and promoting artifacts (or containers images) to environments either by approvals, button clicks, or other checks, as opposed to using separate branches that creat new builds for each environment (which seems to be the new norm?, but I’m not interested in doing things that way)

https://redd.it/kiidbl
@r_devops
Hi Team is there any possibility to periodically rotate the token not with manual automation for hashicorp

Looking for any Feasibility to generate dynamic tokens for kv secret engine for hashicorp vault for automation.
With the cli we can do but without human intervention is there any suggested automated way to do this.
I need to generate new token after some amount of time with hashicorp vault in automated way.
I am looking to write one custom service from outside but is there any way which hashicorp tool itself gave us.
Need some suggestions.
Thanks in advance.

https://redd.it/kiuurx
@r_devops
Exporting DynamoDB to S3 — cross-account and SSE-KMS encryption

Exporting DynamoDB to S3 — cross-account and SSE-KMS encryption

I have written a new article on exporting DynamoDB to S3 - a special case where the bucket is in another account and objects are to be encrypted using SSE-KMS

https://sunilkumarmohanty.medium.com/exporting-dynamodb-to-s3-cross-account-and-sse-kms-encryption-c74193e12438

https://redd.it/kiloc7
@r_devops
Template library to meet common OPA-with-Terraform requirements

Hey guys, we know that getting started with OPA can be hard, so we’ve built a reusable kit of templates for use with Terraform to help you get your first policies up and running (resource type whitelisting, regex matching, ...)

https://github.com/scalr-eap/policy-templates

https://redd.it/ki6nul
@r_devops
A good de/centralized credentials repository?

I am wondering whenever such thing exists, something that software like jenkins or Ansible could connect to and automate fetching some of the keys / certs.

I think Vault is the one, but I feel it is a bit complex.

Would appreciate some rotation mechanism / webhooks.

https://redd.it/ki5llh
@r_devops
Using H2 as a temp in memory DB for test purposes instead of Oracle in docker

Right now I am spinning up a whole oracle database in a pipeline (with docker) to run jobs to test SQL migration scripts. I heard that H2 is able to use Oracle syntax as well. Does anyone have experience with this?

Is an application able to make a connection to this database as well with the oracle JDBC client as well if so?

https://redd.it/kj06xy
@r_devops
Increasing Base Salary

Happy holidays!

My current title is “Senior DevOps Engineer”. I am based in Seattle area and my current base salary is 170k (total package is about 200k).

I’ve just had initial interview with HR lady in some company and she was really surprised that when I told them I was looking for base of 200k or something close to it (This company does not offer any equity).

I want to eventually go into management. Is the management position the only way to earn above 200k base?

Wanted to see if there are any other options.

Thanks.

https://redd.it/kizjve
@r_devops
Resources to start learning

Hi everyone
I am moving to devops soon. My manager recommended me to start learning powershell, Yaml and Jenkins
Do you have any resources I could look into to help me start?

https://redd.it/kj1orw
@r_devops
EC2 Public key authorisation failure issue.

Hi Everyone, I hope I’m in the right sub to post this - it’s a new area of learning for me. I recently set up an instance of Linux on EC2 - all good. I remote in via SSH from my Mac using a key pair I generated from the EC2 console (also good). Now I decided to automate the ssh login and I think I did something (like generate a key using a command line on my local machine) and now I can’t ssh in at all. The verbose output indicates it fails right at the end with the public key authorisation. I deleted the EC2 instance and made a fresh one and still the same thing happens. If I use the EC2 console via the browser and login into the instance that way, I can get to the command line but I can’t access the instance from my local machine. I have tried to make sense of the documentation (still working through it) - but it’s proving confusing. Is there another resource someone could point me to or explain where the public key is located and why it’s causing me an issue? Thanks.

https://redd.it/kiyp2q
@r_devops
Willing to pay someone to do my exam, it consists of kubernetes, ansible and gitops. DM me

Willing to pay someone to do my exam, it consists of kubernetes, ansible and gitops. DM me

https://redd.it/kj4s4a
@r_devops
Syncronize time by NTP before starting any services in Linux

Regular NTP clients change clock gradually. So if host started with big clock error(AWS instances sometimes happen to start several minutes in the past), you have timestamps and log events in the past. Not always a good idea.

Article on how to force NTP time syncronization before starting any services using chrony:

https://selivan.github.io/2020/12/23/ntp-sync-time-before-starting-any-services.html

https://redd.it/kixcry
@r_devops