Kubernetes Multi-Operator Stacks and Advanced Pod Scheduling
Here are some thoughts on how to think about Pod scheduling while developing Kubernetes Operators for multi-Operator environments.
[https://medium.com/@cloudark/kubernetes-multi-operator-stacks-and-advanced-pod-scheduling-c3131dde3755](https://medium.com/@cloudark/kubernetes-multi-operator-stacks-and-advanced-pod-scheduling-c3131dde3755)
Are you using Kubernetes Operators? Have you faced above issues? Would be curious to understand your use-cases in the comments.
https://redd.it/dt21hz
@r_devops
Here are some thoughts on how to think about Pod scheduling while developing Kubernetes Operators for multi-Operator environments.
[https://medium.com/@cloudark/kubernetes-multi-operator-stacks-and-advanced-pod-scheduling-c3131dde3755](https://medium.com/@cloudark/kubernetes-multi-operator-stacks-and-advanced-pod-scheduling-c3131dde3755)
Are you using Kubernetes Operators? Have you faced above issues? Would be curious to understand your use-cases in the comments.
https://redd.it/dt21hz
@r_devops
Medium
Kubernetes Multi-Operator Stacks and Advanced Pod Scheduling
Kubernetes Operators enable running third-party software natively on Kubernetes. Various Operators are being built today for a variety of…
Heroku CI vs GitHub Actions
https://www.reddit.com/r/github/comments/dtbh6t/heroku_ci_vs_github_actions/
https://redd.it/dtblkd
@r_devops
https://www.reddit.com/r/github/comments/dtbh6t/heroku_ci_vs_github_actions/
https://redd.it/dtblkd
@r_devops
reddit
Heroku CI vs GitHub Actions
I'm currently in the process of deploying some apps on Heroku. It's time for some CI/CD. Should I use Heroku CI or GitHub Actions?
distroless Docker Images - thoughts?
I'm talking about the [distroless](https://github.com/GoogleContainerTools/distroless) project from GoogleContainerTools.
The images are build through [bazel](https://bazel.build/),first time I heard about this build tool but I'd like to get some feedback from people that have actually tried it.
After successfully building the image, you'll end up with *your application* and its *runtime dependencies* (no shell, no package manager, nada).
They have some [examples](https://github.com/GoogleContainerTools/distroless/tree/master/examples) there for dotnet, go, java, nodejs etc.
https://redd.it/dtd2mu
@r_devops
I'm talking about the [distroless](https://github.com/GoogleContainerTools/distroless) project from GoogleContainerTools.
The images are build through [bazel](https://bazel.build/),first time I heard about this build tool but I'd like to get some feedback from people that have actually tried it.
After successfully building the image, you'll end up with *your application* and its *runtime dependencies* (no shell, no package manager, nada).
They have some [examples](https://github.com/GoogleContainerTools/distroless/tree/master/examples) there for dotnet, go, java, nodejs etc.
https://redd.it/dtd2mu
@r_devops
GitHub
GitHub - GoogleContainerTools/distroless: 🥑 Language focused docker images, minus the operating system.
🥑 Language focused docker images, minus the operating system. - GoogleContainerTools/distroless
Obfuscation of Javascript
Hi everyone, I made a script ( only for JavaScript obfuscation) which obfuscates your JavaScript code i.e removes the original code and replaces it with the obfuscated code. P.S - You need to have npm package JavaScript obfuscator installed. https://github.com/Shrinidhikulkarni7/Obfuscation
I also wrote blog on the same - “Obfuscation of the code” by Shrinidhi Kulkarni https://medium.com/@davidcesc/obfuscation-of-the-code-8086c9c8b34a
Please feel free to give feedback. I started doing devops work in January and willing to learn more and more as I love it.
Thanks to this subreddit :)
https://redd.it/dtevs8
@r_devops
Hi everyone, I made a script ( only for JavaScript obfuscation) which obfuscates your JavaScript code i.e removes the original code and replaces it with the obfuscated code. P.S - You need to have npm package JavaScript obfuscator installed. https://github.com/Shrinidhikulkarni7/Obfuscation
I also wrote blog on the same - “Obfuscation of the code” by Shrinidhi Kulkarni https://medium.com/@davidcesc/obfuscation-of-the-code-8086c9c8b34a
Please feel free to give feedback. I started doing devops work in January and willing to learn more and more as I love it.
Thanks to this subreddit :)
https://redd.it/dtevs8
@r_devops
GitHub
Shrinidhikulkarni7/Obfuscation
Obfuscating the javascript code to make it unreadable! - Shrinidhikulkarni7/Obfuscation
From Dev to DevOps what about networking ?
I started as java/jee developer two yars now i switched to DevOps,i've been handling at first jenkins pipeline git flow bitbucket jira administration and docker and too many times i've been stuck with network issues or misunderstanding of some network concepts . Now im just wondering should i go back to network courses to fully understand it or just concenrate on networking parts of DevOps tools ?
https://redd.it/dtj9ap
@r_devops
I started as java/jee developer two yars now i switched to DevOps,i've been handling at first jenkins pipeline git flow bitbucket jira administration and docker and too many times i've been stuck with network issues or misunderstanding of some network concepts . Now im just wondering should i go back to network courses to fully understand it or just concenrate on networking parts of DevOps tools ?
https://redd.it/dtj9ap
@r_devops
reddit
From Dev to DevOps what about networking ?
I started as java/jee developer two yars now i switched to DevOps,i've been handling at first jenkins pipeline git flow bitbucket jira...
Wanted: Version Control System with Encrypted Central Repository and Individual File Check-out.
The company I work for produces a large number of commercial apps available through the Apple Store, and that involves managing a large number of certificates, with fairly long lifetimes (between one month and one year) from Apple both for sales (the app must be signed to be sold, after all) and for push notifications. We'd like to further secure our build pipeline, and one of the requests is for a VCS that has an encrypted central repository and individual file check-out.
We're not sure how to achieve this. Thus far, the best we've got is to keep the certificates on an in-house resource with encrypted drives, and have one GIT repo per certificate, and to lock access on a per-repo basis only to the teams that need to build their particular app. That feels kludgey and unreliable.
How do you manage third-party app certificates in a way that's both secure and (relatively) convenient to a diverse number of development teams?
https://redd.it/dtiqsz
@r_devops
The company I work for produces a large number of commercial apps available through the Apple Store, and that involves managing a large number of certificates, with fairly long lifetimes (between one month and one year) from Apple both for sales (the app must be signed to be sold, after all) and for push notifications. We'd like to further secure our build pipeline, and one of the requests is for a VCS that has an encrypted central repository and individual file check-out.
We're not sure how to achieve this. Thus far, the best we've got is to keep the certificates on an in-house resource with encrypted drives, and have one GIT repo per certificate, and to lock access on a per-repo basis only to the teams that need to build their particular app. That feels kludgey and unreliable.
How do you manage third-party app certificates in a way that's both secure and (relatively) convenient to a diverse number of development teams?
https://redd.it/dtiqsz
@r_devops
reddit
Wanted: Version Control System with Encrypted Central Repository...
The company I work for produces a large number of commercial apps available through the Apple Store, and that involves managing a large number of...
How to sclae OsX builds?
Hi all! I'm almost 1.5yrs into my position as a DevOps engineer at a large company. I was lucky enough to get this gig straight out of college. I know I'm not anywhere near close to knowing all I need to know in this discipline but I'm learning more every day.
Currently, we have an application that we build on macOS, Windows, and Linux. For Macs, we currently have a bunch of minis sitting in a data center and our Jenkins master will target an available mini to run a build on (a very simplified explanation but that's pretty much the gist). My issue is, I don't think this method is scalable. We have more and more developers coming on every year so we have to buy more minis to keep up with the demand. We've thought about using Macstadium but from testing, we've seen our build times almost triple. I've been trying to do research into finding a scalable solution, preferbly with cloud tools, but I'm coming up empty.
Any ideas or advice would be greatly appreciated!!
https://redd.it/dtkfbp
@r_devops
Hi all! I'm almost 1.5yrs into my position as a DevOps engineer at a large company. I was lucky enough to get this gig straight out of college. I know I'm not anywhere near close to knowing all I need to know in this discipline but I'm learning more every day.
Currently, we have an application that we build on macOS, Windows, and Linux. For Macs, we currently have a bunch of minis sitting in a data center and our Jenkins master will target an available mini to run a build on (a very simplified explanation but that's pretty much the gist). My issue is, I don't think this method is scalable. We have more and more developers coming on every year so we have to buy more minis to keep up with the demand. We've thought about using Macstadium but from testing, we've seen our build times almost triple. I've been trying to do research into finding a scalable solution, preferbly with cloud tools, but I'm coming up empty.
Any ideas or advice would be greatly appreciated!!
https://redd.it/dtkfbp
@r_devops
reddit
How to sclae OsX builds?
Hi all! I'm almost 1.5yrs into my position as a DevOps engineer at a large company. I was lucky enough to get this gig straight out of college. I...
How would you bundle many applications within kubernetes. Service mesh?
I'm just wondering if it's a good idea to manage a high number of applications running on their own scaling up and down and each of them connecting to each other all on plain kubernetes. Or maybe using a service mesh would be a better fit?
https://redd.it/dtjztd
@r_devops
I'm just wondering if it's a good idea to manage a high number of applications running on their own scaling up and down and each of them connecting to each other all on plain kubernetes. Or maybe using a service mesh would be a better fit?
https://redd.it/dtjztd
@r_devops
reddit
How would you bundle many applications within kubernetes. Service...
I'm just wondering if it's a good idea to manage a high number of applications running on their own scaling up and down and each of them...
Budgeting question for devops leaders
How do you go about forecasting budget for your cloud spend and what metrics are you using to make those estimates?
Are you 100% usage driven? How to you estimate and account for new features in a coming year that aren't yet planned? Having the moment to moment flexibility is nice, but finance folks still want annual budgets and want teams to stick to those budgets. Obviously if there is a good reason (business growth) the finance teams are happy, they just want to understand the why when it comes to overages, but things get complicated when you're in the millions of dollars in spend across hundreds of deployable assets spread across dozens of teams with no concept of 'chargebacks' in place to hold any team accountable.
https://redd.it/dtm5z6
@r_devops
How do you go about forecasting budget for your cloud spend and what metrics are you using to make those estimates?
Are you 100% usage driven? How to you estimate and account for new features in a coming year that aren't yet planned? Having the moment to moment flexibility is nice, but finance folks still want annual budgets and want teams to stick to those budgets. Obviously if there is a good reason (business growth) the finance teams are happy, they just want to understand the why when it comes to overages, but things get complicated when you're in the millions of dollars in spend across hundreds of deployable assets spread across dozens of teams with no concept of 'chargebacks' in place to hold any team accountable.
https://redd.it/dtm5z6
@r_devops
reddit
Budgeting question for devops leaders
How do you go about forecasting budget for your cloud spend and what metrics are you using to make those estimates? Are you 100% usage driven? ...
Employer changed Stock options vesting policy
My offer letter said my 5k stocks would start vesting after 6 months, then every 6 months after that. I worked at the company for 10 months and didn't like it, so I started looking for another job and got one.
When I talked to the COO about it, he said they changed to policy to start vesting after one year. Then basically said there's nothing I can do about it.
So, is there something I can do about it?
https://redd.it/dtmsc9
@r_devops
My offer letter said my 5k stocks would start vesting after 6 months, then every 6 months after that. I worked at the company for 10 months and didn't like it, so I started looking for another job and got one.
When I talked to the COO about it, he said they changed to policy to start vesting after one year. Then basically said there's nothing I can do about it.
So, is there something I can do about it?
https://redd.it/dtmsc9
@r_devops
reddit
Employer changed Stock options vesting policy
My offer letter said my 5k stocks would start vesting after 6 months, then every 6 months after that. I worked at the company for 10 months and...
Sources for a really deep dive into containers?
I’m looking for some reading material that shows exactly how containers work, in depth. Not a how to, but a pretty low level explanation. Can someone recommend me something?
https://redd.it/dti2lo
@r_devops
I’m looking for some reading material that shows exactly how containers work, in depth. Not a how to, but a pretty low level explanation. Can someone recommend me something?
https://redd.it/dti2lo
@r_devops
reddit
Sources for a really deep dive into containers?
I’m looking for some reading material that shows exactly how containers work, in depth. Not a how to, but a pretty low level explanation. Can...
Ansible's log_plays callback plugin doesn't log the TASK banner, possible to get that functionality?
Ansible's log_plays callback plugin does exactly what we're looking for, logging of all the play results per hostname into its own separate file. However, the output cuts off the "TASK [Here is the name of the task]******************" portion for each task. Has anyone encountered this and changed the plugin to achieve this, or know of a plugin and/or configuration that achieves that per hostname logging but would give us the TASK banner portion?
https://redd.it/dtfz6r
@r_devops
Ansible's log_plays callback plugin does exactly what we're looking for, logging of all the play results per hostname into its own separate file. However, the output cuts off the "TASK [Here is the name of the task]******************" portion for each task. Has anyone encountered this and changed the plugin to achieve this, or know of a plugin and/or configuration that achieves that per hostname logging but would give us the TASK banner portion?
https://redd.it/dtfz6r
@r_devops
reddit
Ansible's log_plays callback plugin doesn't log the TASK banner,...
Ansible's log_plays callback plugin does exactly what we're looking for, logging of all the play results per hostname into its own separate file....
Containerization Security Challenges
what are the container security risks that is commonly faced and any recommendation for precautions?
https://redd.it/dtfc7n
@r_devops
what are the container security risks that is commonly faced and any recommendation for precautions?
https://redd.it/dtfc7n
@r_devops
reddit
Containerization Security Challenges
what are the container security risks that is commonly faced and any recommendation for precautions?
Question: Having daily issue with Kubernetes Cluster (Nodes are in not ready state)
Is it a good practice to scale down master node as well as worker node every day when not required?
Or should I only scale down the worker nodes?
Kindly explain why should or shouldn't I scale down the master node.
The issue is every morning my cluster is up but PODs are getting failed every time (I scale down master as well as worker node daily)
https://redd.it/dtbs2q
@r_devops
Is it a good practice to scale down master node as well as worker node every day when not required?
Or should I only scale down the worker nodes?
Kindly explain why should or shouldn't I scale down the master node.
The issue is every morning my cluster is up but PODs are getting failed every time (I scale down master as well as worker node daily)
https://redd.it/dtbs2q
@r_devops
reddit
Question: Having daily issue with Kubernetes Cluster (Nodes are in...
Is it a good practice to scale down master node as well as worker node every day when not required? Or should I only scale down the worker...
How to work with a turd such as Microsoft Azure?
FYI it's my rant at Azure....
I'm constantly forced to produce automation solutions for Azure and I can't comprehend why people are using it. Things are constantly broken, changes at the back-end are happening without considerations for users. i.e. sudden changes to API versions without regression.
Every Monday is a battle as something is breaking usually with random timeouts or errors , I have stopped counting how many times I had to increase retries beyond sane logic.
​
With recent Ignite the amount of breaking code which had been pushed to production is insane. I'm constantly finding new bugs for previously working feature, yet nowhere to report it. Phone support is as useless as the code changes.
I'm interested to hear if I'm the only one facing those problems and how are people mitigating incompetence of Azure engineers.
https://redd.it/dtgans
@r_devops
FYI it's my rant at Azure....
I'm constantly forced to produce automation solutions for Azure and I can't comprehend why people are using it. Things are constantly broken, changes at the back-end are happening without considerations for users. i.e. sudden changes to API versions without regression.
Every Monday is a battle as something is breaking usually with random timeouts or errors , I have stopped counting how many times I had to increase retries beyond sane logic.
​
With recent Ignite the amount of breaking code which had been pushed to production is insane. I'm constantly finding new bugs for previously working feature, yet nowhere to report it. Phone support is as useless as the code changes.
I'm interested to hear if I'm the only one facing those problems and how are people mitigating incompetence of Azure engineers.
https://redd.it/dtgans
@r_devops
reddit
How to work with a turd such as Microsoft Azure?
FYI it's my rant at Azure.... I'm constantly forced to produce automation solutions for Azure and I can't comprehend why people are using it....
Anybody in the field have tattoos?
I want to get my knuckles done and possibly my hand within 2 - 3 years. How much has it affected your hiring chances etc?
https://redd.it/dtvmnf
@r_devops
I want to get my knuckles done and possibly my hand within 2 - 3 years. How much has it affected your hiring chances etc?
https://redd.it/dtvmnf
@r_devops
reddit
Anybody in the field have tattoos?
I want to get my knuckles done and possibly my hand within 2 - 3 years. How much has it affected your hiring chances etc?
Difficulty in understanding concepts
I work with cloud technologies but I feel I don't understand the concepts or terminologies at depth. And I'd like to fill that gap so that I'm more effective at my job. Not that I don't get it but my understanding is shallow. Example would be, recently i was reading up on managed identities in cloud and service principals. I realized that at the end, although I felt I understood at least 60% of what I read but I'm far from being able to implement it. I'm a year out of university and working with cloud technologies for the first time.
Any suggestions?
Thanks in advance
https://redd.it/dtar41
@r_devops
I work with cloud technologies but I feel I don't understand the concepts or terminologies at depth. And I'd like to fill that gap so that I'm more effective at my job. Not that I don't get it but my understanding is shallow. Example would be, recently i was reading up on managed identities in cloud and service principals. I realized that at the end, although I felt I understood at least 60% of what I read but I'm far from being able to implement it. I'm a year out of university and working with cloud technologies for the first time.
Any suggestions?
Thanks in advance
https://redd.it/dtar41
@r_devops
reddit
Difficulty in understanding concepts
I work with cloud technologies but I feel I don't understand the concepts or terminologies at depth. And I'd like to fill that gap so that I'm...
Comparing two PostgreSQL databases with Python
After an infrastructure migration we had to figure out whether data was lost during that process. We wanted to ensure the new PostgreSQL database had exactly the same data as before.
Just sharing our process over here: [https://medium.com/trinity-mirror-digital/comparing-two-postgresql-databases-with-python-a98926ba9945](https://medium.com/trinity-mirror-digital/comparing-two-postgresql-databases-with-python-a98926ba9945)
https://redd.it/dt1lud
@r_devops
After an infrastructure migration we had to figure out whether data was lost during that process. We wanted to ensure the new PostgreSQL database had exactly the same data as before.
Just sharing our process over here: [https://medium.com/trinity-mirror-digital/comparing-two-postgresql-databases-with-python-a98926ba9945](https://medium.com/trinity-mirror-digital/comparing-two-postgresql-databases-with-python-a98926ba9945)
https://redd.it/dt1lud
@r_devops
Medium
Comparing two PostgreSQL databases with Python
After an infrastructure migration we had to figure out whether data was lost during that process. Here we describe our attempts doing…
Managing secrets via AWS Param Store
I've decided that I am going to use AWS Param Store to handle my secrets for my Lambda function and am looking for the best way to manage them. Like is it something I do just manually via the CLI or is there a better way of managing them?
https://redd.it/dty0yp
@r_devops
I've decided that I am going to use AWS Param Store to handle my secrets for my Lambda function and am looking for the best way to manage them. Like is it something I do just manually via the CLI or is there a better way of managing them?
https://redd.it/dty0yp
@r_devops
reddit
Managing secrets via AWS Param Store
I've decided that I am going to use AWS Param Store to handle my secrets for my Lambda function and am looking for the best way to manage them....
Cost insigt into Google BigQuery
I`m interested in approaches/tooling to see the drivers behind shared BQ database.
We have a BQ database used for insights into viewers patterns among other things. It is used for our own recommendations software project, the major driver and owner of the database. In addition to that it is used by our analytical department for ad-hoc queries. The challenge is to see what is driving the cost precisely. The software running queries is ofcourse easier to keep track of, they are encoded and you can guestimate. The analysts on the other hand run ad-hoc queries and link more tables creating heavier queries. What I`m looking for is a breakdown of each.
So far I´ve thought about using audit logs and separating by accounts of queries ran, but can´t get the straight cost out of GCP spend logs.
Any tips?
https://redd.it/du0kx5
@r_devops
I`m interested in approaches/tooling to see the drivers behind shared BQ database.
We have a BQ database used for insights into viewers patterns among other things. It is used for our own recommendations software project, the major driver and owner of the database. In addition to that it is used by our analytical department for ad-hoc queries. The challenge is to see what is driving the cost precisely. The software running queries is ofcourse easier to keep track of, they are encoded and you can guestimate. The analysts on the other hand run ad-hoc queries and link more tables creating heavier queries. What I`m looking for is a breakdown of each.
So far I´ve thought about using audit logs and separating by accounts of queries ran, but can´t get the straight cost out of GCP spend logs.
Any tips?
https://redd.it/du0kx5
@r_devops
reddit
Cost insigt into Google BigQuery
I`m interested in approaches/tooling to see the drivers behind shared BQ database. We have a BQ database used for insights into viewers patterns...