distroless Docker Images - thoughts?
I'm talking about the [distroless](https://github.com/GoogleContainerTools/distroless) project from GoogleContainerTools.
The images are build through [bazel](https://bazel.build/),first time I heard about this build tool but I'd like to get some feedback from people that have actually tried it.
After successfully building the image, you'll end up with *your application* and its *runtime dependencies* (no shell, no package manager, nada).
They have some [examples](https://github.com/GoogleContainerTools/distroless/tree/master/examples) there for dotnet, go, java, nodejs etc.
https://redd.it/dtd2mu
@r_devops
I'm talking about the [distroless](https://github.com/GoogleContainerTools/distroless) project from GoogleContainerTools.
The images are build through [bazel](https://bazel.build/),first time I heard about this build tool but I'd like to get some feedback from people that have actually tried it.
After successfully building the image, you'll end up with *your application* and its *runtime dependencies* (no shell, no package manager, nada).
They have some [examples](https://github.com/GoogleContainerTools/distroless/tree/master/examples) there for dotnet, go, java, nodejs etc.
https://redd.it/dtd2mu
@r_devops
GitHub
GitHub - GoogleContainerTools/distroless: 🥑 Language focused docker images, minus the operating system.
🥑 Language focused docker images, minus the operating system. - GoogleContainerTools/distroless
Obfuscation of Javascript
Hi everyone, I made a script ( only for JavaScript obfuscation) which obfuscates your JavaScript code i.e removes the original code and replaces it with the obfuscated code. P.S - You need to have npm package JavaScript obfuscator installed. https://github.com/Shrinidhikulkarni7/Obfuscation
I also wrote blog on the same - “Obfuscation of the code” by Shrinidhi Kulkarni https://medium.com/@davidcesc/obfuscation-of-the-code-8086c9c8b34a
Please feel free to give feedback. I started doing devops work in January and willing to learn more and more as I love it.
Thanks to this subreddit :)
https://redd.it/dtevs8
@r_devops
Hi everyone, I made a script ( only for JavaScript obfuscation) which obfuscates your JavaScript code i.e removes the original code and replaces it with the obfuscated code. P.S - You need to have npm package JavaScript obfuscator installed. https://github.com/Shrinidhikulkarni7/Obfuscation
I also wrote blog on the same - “Obfuscation of the code” by Shrinidhi Kulkarni https://medium.com/@davidcesc/obfuscation-of-the-code-8086c9c8b34a
Please feel free to give feedback. I started doing devops work in January and willing to learn more and more as I love it.
Thanks to this subreddit :)
https://redd.it/dtevs8
@r_devops
GitHub
Shrinidhikulkarni7/Obfuscation
Obfuscating the javascript code to make it unreadable! - Shrinidhikulkarni7/Obfuscation
From Dev to DevOps what about networking ?
I started as java/jee developer two yars now i switched to DevOps,i've been handling at first jenkins pipeline git flow bitbucket jira administration and docker and too many times i've been stuck with network issues or misunderstanding of some network concepts . Now im just wondering should i go back to network courses to fully understand it or just concenrate on networking parts of DevOps tools ?
https://redd.it/dtj9ap
@r_devops
I started as java/jee developer two yars now i switched to DevOps,i've been handling at first jenkins pipeline git flow bitbucket jira administration and docker and too many times i've been stuck with network issues or misunderstanding of some network concepts . Now im just wondering should i go back to network courses to fully understand it or just concenrate on networking parts of DevOps tools ?
https://redd.it/dtj9ap
@r_devops
reddit
From Dev to DevOps what about networking ?
I started as java/jee developer two yars now i switched to DevOps,i've been handling at first jenkins pipeline git flow bitbucket jira...
Wanted: Version Control System with Encrypted Central Repository and Individual File Check-out.
The company I work for produces a large number of commercial apps available through the Apple Store, and that involves managing a large number of certificates, with fairly long lifetimes (between one month and one year) from Apple both for sales (the app must be signed to be sold, after all) and for push notifications. We'd like to further secure our build pipeline, and one of the requests is for a VCS that has an encrypted central repository and individual file check-out.
We're not sure how to achieve this. Thus far, the best we've got is to keep the certificates on an in-house resource with encrypted drives, and have one GIT repo per certificate, and to lock access on a per-repo basis only to the teams that need to build their particular app. That feels kludgey and unreliable.
How do you manage third-party app certificates in a way that's both secure and (relatively) convenient to a diverse number of development teams?
https://redd.it/dtiqsz
@r_devops
The company I work for produces a large number of commercial apps available through the Apple Store, and that involves managing a large number of certificates, with fairly long lifetimes (between one month and one year) from Apple both for sales (the app must be signed to be sold, after all) and for push notifications. We'd like to further secure our build pipeline, and one of the requests is for a VCS that has an encrypted central repository and individual file check-out.
We're not sure how to achieve this. Thus far, the best we've got is to keep the certificates on an in-house resource with encrypted drives, and have one GIT repo per certificate, and to lock access on a per-repo basis only to the teams that need to build their particular app. That feels kludgey and unreliable.
How do you manage third-party app certificates in a way that's both secure and (relatively) convenient to a diverse number of development teams?
https://redd.it/dtiqsz
@r_devops
reddit
Wanted: Version Control System with Encrypted Central Repository...
The company I work for produces a large number of commercial apps available through the Apple Store, and that involves managing a large number of...
How to sclae OsX builds?
Hi all! I'm almost 1.5yrs into my position as a DevOps engineer at a large company. I was lucky enough to get this gig straight out of college. I know I'm not anywhere near close to knowing all I need to know in this discipline but I'm learning more every day.
Currently, we have an application that we build on macOS, Windows, and Linux. For Macs, we currently have a bunch of minis sitting in a data center and our Jenkins master will target an available mini to run a build on (a very simplified explanation but that's pretty much the gist). My issue is, I don't think this method is scalable. We have more and more developers coming on every year so we have to buy more minis to keep up with the demand. We've thought about using Macstadium but from testing, we've seen our build times almost triple. I've been trying to do research into finding a scalable solution, preferbly with cloud tools, but I'm coming up empty.
Any ideas or advice would be greatly appreciated!!
https://redd.it/dtkfbp
@r_devops
Hi all! I'm almost 1.5yrs into my position as a DevOps engineer at a large company. I was lucky enough to get this gig straight out of college. I know I'm not anywhere near close to knowing all I need to know in this discipline but I'm learning more every day.
Currently, we have an application that we build on macOS, Windows, and Linux. For Macs, we currently have a bunch of minis sitting in a data center and our Jenkins master will target an available mini to run a build on (a very simplified explanation but that's pretty much the gist). My issue is, I don't think this method is scalable. We have more and more developers coming on every year so we have to buy more minis to keep up with the demand. We've thought about using Macstadium but from testing, we've seen our build times almost triple. I've been trying to do research into finding a scalable solution, preferbly with cloud tools, but I'm coming up empty.
Any ideas or advice would be greatly appreciated!!
https://redd.it/dtkfbp
@r_devops
reddit
How to sclae OsX builds?
Hi all! I'm almost 1.5yrs into my position as a DevOps engineer at a large company. I was lucky enough to get this gig straight out of college. I...
How would you bundle many applications within kubernetes. Service mesh?
I'm just wondering if it's a good idea to manage a high number of applications running on their own scaling up and down and each of them connecting to each other all on plain kubernetes. Or maybe using a service mesh would be a better fit?
https://redd.it/dtjztd
@r_devops
I'm just wondering if it's a good idea to manage a high number of applications running on their own scaling up and down and each of them connecting to each other all on plain kubernetes. Or maybe using a service mesh would be a better fit?
https://redd.it/dtjztd
@r_devops
reddit
How would you bundle many applications within kubernetes. Service...
I'm just wondering if it's a good idea to manage a high number of applications running on their own scaling up and down and each of them...
Budgeting question for devops leaders
How do you go about forecasting budget for your cloud spend and what metrics are you using to make those estimates?
Are you 100% usage driven? How to you estimate and account for new features in a coming year that aren't yet planned? Having the moment to moment flexibility is nice, but finance folks still want annual budgets and want teams to stick to those budgets. Obviously if there is a good reason (business growth) the finance teams are happy, they just want to understand the why when it comes to overages, but things get complicated when you're in the millions of dollars in spend across hundreds of deployable assets spread across dozens of teams with no concept of 'chargebacks' in place to hold any team accountable.
https://redd.it/dtm5z6
@r_devops
How do you go about forecasting budget for your cloud spend and what metrics are you using to make those estimates?
Are you 100% usage driven? How to you estimate and account for new features in a coming year that aren't yet planned? Having the moment to moment flexibility is nice, but finance folks still want annual budgets and want teams to stick to those budgets. Obviously if there is a good reason (business growth) the finance teams are happy, they just want to understand the why when it comes to overages, but things get complicated when you're in the millions of dollars in spend across hundreds of deployable assets spread across dozens of teams with no concept of 'chargebacks' in place to hold any team accountable.
https://redd.it/dtm5z6
@r_devops
reddit
Budgeting question for devops leaders
How do you go about forecasting budget for your cloud spend and what metrics are you using to make those estimates? Are you 100% usage driven? ...
Employer changed Stock options vesting policy
My offer letter said my 5k stocks would start vesting after 6 months, then every 6 months after that. I worked at the company for 10 months and didn't like it, so I started looking for another job and got one.
When I talked to the COO about it, he said they changed to policy to start vesting after one year. Then basically said there's nothing I can do about it.
So, is there something I can do about it?
https://redd.it/dtmsc9
@r_devops
My offer letter said my 5k stocks would start vesting after 6 months, then every 6 months after that. I worked at the company for 10 months and didn't like it, so I started looking for another job and got one.
When I talked to the COO about it, he said they changed to policy to start vesting after one year. Then basically said there's nothing I can do about it.
So, is there something I can do about it?
https://redd.it/dtmsc9
@r_devops
reddit
Employer changed Stock options vesting policy
My offer letter said my 5k stocks would start vesting after 6 months, then every 6 months after that. I worked at the company for 10 months and...
Sources for a really deep dive into containers?
I’m looking for some reading material that shows exactly how containers work, in depth. Not a how to, but a pretty low level explanation. Can someone recommend me something?
https://redd.it/dti2lo
@r_devops
I’m looking for some reading material that shows exactly how containers work, in depth. Not a how to, but a pretty low level explanation. Can someone recommend me something?
https://redd.it/dti2lo
@r_devops
reddit
Sources for a really deep dive into containers?
I’m looking for some reading material that shows exactly how containers work, in depth. Not a how to, but a pretty low level explanation. Can...
Ansible's log_plays callback plugin doesn't log the TASK banner, possible to get that functionality?
Ansible's log_plays callback plugin does exactly what we're looking for, logging of all the play results per hostname into its own separate file. However, the output cuts off the "TASK [Here is the name of the task]******************" portion for each task. Has anyone encountered this and changed the plugin to achieve this, or know of a plugin and/or configuration that achieves that per hostname logging but would give us the TASK banner portion?
https://redd.it/dtfz6r
@r_devops
Ansible's log_plays callback plugin does exactly what we're looking for, logging of all the play results per hostname into its own separate file. However, the output cuts off the "TASK [Here is the name of the task]******************" portion for each task. Has anyone encountered this and changed the plugin to achieve this, or know of a plugin and/or configuration that achieves that per hostname logging but would give us the TASK banner portion?
https://redd.it/dtfz6r
@r_devops
reddit
Ansible's log_plays callback plugin doesn't log the TASK banner,...
Ansible's log_plays callback plugin does exactly what we're looking for, logging of all the play results per hostname into its own separate file....
Containerization Security Challenges
what are the container security risks that is commonly faced and any recommendation for precautions?
https://redd.it/dtfc7n
@r_devops
what are the container security risks that is commonly faced and any recommendation for precautions?
https://redd.it/dtfc7n
@r_devops
reddit
Containerization Security Challenges
what are the container security risks that is commonly faced and any recommendation for precautions?
Question: Having daily issue with Kubernetes Cluster (Nodes are in not ready state)
Is it a good practice to scale down master node as well as worker node every day when not required?
Or should I only scale down the worker nodes?
Kindly explain why should or shouldn't I scale down the master node.
The issue is every morning my cluster is up but PODs are getting failed every time (I scale down master as well as worker node daily)
https://redd.it/dtbs2q
@r_devops
Is it a good practice to scale down master node as well as worker node every day when not required?
Or should I only scale down the worker nodes?
Kindly explain why should or shouldn't I scale down the master node.
The issue is every morning my cluster is up but PODs are getting failed every time (I scale down master as well as worker node daily)
https://redd.it/dtbs2q
@r_devops
reddit
Question: Having daily issue with Kubernetes Cluster (Nodes are in...
Is it a good practice to scale down master node as well as worker node every day when not required? Or should I only scale down the worker...
How to work with a turd such as Microsoft Azure?
FYI it's my rant at Azure....
I'm constantly forced to produce automation solutions for Azure and I can't comprehend why people are using it. Things are constantly broken, changes at the back-end are happening without considerations for users. i.e. sudden changes to API versions without regression.
Every Monday is a battle as something is breaking usually with random timeouts or errors , I have stopped counting how many times I had to increase retries beyond sane logic.
​
With recent Ignite the amount of breaking code which had been pushed to production is insane. I'm constantly finding new bugs for previously working feature, yet nowhere to report it. Phone support is as useless as the code changes.
I'm interested to hear if I'm the only one facing those problems and how are people mitigating incompetence of Azure engineers.
https://redd.it/dtgans
@r_devops
FYI it's my rant at Azure....
I'm constantly forced to produce automation solutions for Azure and I can't comprehend why people are using it. Things are constantly broken, changes at the back-end are happening without considerations for users. i.e. sudden changes to API versions without regression.
Every Monday is a battle as something is breaking usually with random timeouts or errors , I have stopped counting how many times I had to increase retries beyond sane logic.
​
With recent Ignite the amount of breaking code which had been pushed to production is insane. I'm constantly finding new bugs for previously working feature, yet nowhere to report it. Phone support is as useless as the code changes.
I'm interested to hear if I'm the only one facing those problems and how are people mitigating incompetence of Azure engineers.
https://redd.it/dtgans
@r_devops
reddit
How to work with a turd such as Microsoft Azure?
FYI it's my rant at Azure.... I'm constantly forced to produce automation solutions for Azure and I can't comprehend why people are using it....
Anybody in the field have tattoos?
I want to get my knuckles done and possibly my hand within 2 - 3 years. How much has it affected your hiring chances etc?
https://redd.it/dtvmnf
@r_devops
I want to get my knuckles done and possibly my hand within 2 - 3 years. How much has it affected your hiring chances etc?
https://redd.it/dtvmnf
@r_devops
reddit
Anybody in the field have tattoos?
I want to get my knuckles done and possibly my hand within 2 - 3 years. How much has it affected your hiring chances etc?
Difficulty in understanding concepts
I work with cloud technologies but I feel I don't understand the concepts or terminologies at depth. And I'd like to fill that gap so that I'm more effective at my job. Not that I don't get it but my understanding is shallow. Example would be, recently i was reading up on managed identities in cloud and service principals. I realized that at the end, although I felt I understood at least 60% of what I read but I'm far from being able to implement it. I'm a year out of university and working with cloud technologies for the first time.
Any suggestions?
Thanks in advance
https://redd.it/dtar41
@r_devops
I work with cloud technologies but I feel I don't understand the concepts or terminologies at depth. And I'd like to fill that gap so that I'm more effective at my job. Not that I don't get it but my understanding is shallow. Example would be, recently i was reading up on managed identities in cloud and service principals. I realized that at the end, although I felt I understood at least 60% of what I read but I'm far from being able to implement it. I'm a year out of university and working with cloud technologies for the first time.
Any suggestions?
Thanks in advance
https://redd.it/dtar41
@r_devops
reddit
Difficulty in understanding concepts
I work with cloud technologies but I feel I don't understand the concepts or terminologies at depth. And I'd like to fill that gap so that I'm...
Comparing two PostgreSQL databases with Python
After an infrastructure migration we had to figure out whether data was lost during that process. We wanted to ensure the new PostgreSQL database had exactly the same data as before.
Just sharing our process over here: [https://medium.com/trinity-mirror-digital/comparing-two-postgresql-databases-with-python-a98926ba9945](https://medium.com/trinity-mirror-digital/comparing-two-postgresql-databases-with-python-a98926ba9945)
https://redd.it/dt1lud
@r_devops
After an infrastructure migration we had to figure out whether data was lost during that process. We wanted to ensure the new PostgreSQL database had exactly the same data as before.
Just sharing our process over here: [https://medium.com/trinity-mirror-digital/comparing-two-postgresql-databases-with-python-a98926ba9945](https://medium.com/trinity-mirror-digital/comparing-two-postgresql-databases-with-python-a98926ba9945)
https://redd.it/dt1lud
@r_devops
Medium
Comparing two PostgreSQL databases with Python
After an infrastructure migration we had to figure out whether data was lost during that process. Here we describe our attempts doing…
Managing secrets via AWS Param Store
I've decided that I am going to use AWS Param Store to handle my secrets for my Lambda function and am looking for the best way to manage them. Like is it something I do just manually via the CLI or is there a better way of managing them?
https://redd.it/dty0yp
@r_devops
I've decided that I am going to use AWS Param Store to handle my secrets for my Lambda function and am looking for the best way to manage them. Like is it something I do just manually via the CLI or is there a better way of managing them?
https://redd.it/dty0yp
@r_devops
reddit
Managing secrets via AWS Param Store
I've decided that I am going to use AWS Param Store to handle my secrets for my Lambda function and am looking for the best way to manage them....
Cost insigt into Google BigQuery
I`m interested in approaches/tooling to see the drivers behind shared BQ database.
We have a BQ database used for insights into viewers patterns among other things. It is used for our own recommendations software project, the major driver and owner of the database. In addition to that it is used by our analytical department for ad-hoc queries. The challenge is to see what is driving the cost precisely. The software running queries is ofcourse easier to keep track of, they are encoded and you can guestimate. The analysts on the other hand run ad-hoc queries and link more tables creating heavier queries. What I`m looking for is a breakdown of each.
So far I´ve thought about using audit logs and separating by accounts of queries ran, but can´t get the straight cost out of GCP spend logs.
Any tips?
https://redd.it/du0kx5
@r_devops
I`m interested in approaches/tooling to see the drivers behind shared BQ database.
We have a BQ database used for insights into viewers patterns among other things. It is used for our own recommendations software project, the major driver and owner of the database. In addition to that it is used by our analytical department for ad-hoc queries. The challenge is to see what is driving the cost precisely. The software running queries is ofcourse easier to keep track of, they are encoded and you can guestimate. The analysts on the other hand run ad-hoc queries and link more tables creating heavier queries. What I`m looking for is a breakdown of each.
So far I´ve thought about using audit logs and separating by accounts of queries ran, but can´t get the straight cost out of GCP spend logs.
Any tips?
https://redd.it/du0kx5
@r_devops
reddit
Cost insigt into Google BigQuery
I`m interested in approaches/tooling to see the drivers behind shared BQ database. We have a BQ database used for insights into viewers patterns...
I just made the first step to my goal of becoming an AWS Certified DevOps Engineer!
I passed my Cloud Practitioner exam!! I've been dabbling in AWS for years now and I love how it feels to make those big, impactful changes on a system. Right now I'm a Software Engineer and I've never gotten an official certification or a college degree, so taking this first step has made me happy beyond belief.
My next step is AWS Developer Associate, so if anyone has any words of wisdom for me, let me know.
Anyway, I just wanted to share my successes with everyone cause I couldn't hold it in any longer.
Thanks!
https://redd.it/du3tum
@r_devops
I passed my Cloud Practitioner exam!! I've been dabbling in AWS for years now and I love how it feels to make those big, impactful changes on a system. Right now I'm a Software Engineer and I've never gotten an official certification or a college degree, so taking this first step has made me happy beyond belief.
My next step is AWS Developer Associate, so if anyone has any words of wisdom for me, let me know.
Anyway, I just wanted to share my successes with everyone cause I couldn't hold it in any longer.
Thanks!
https://redd.it/du3tum
@r_devops
reddit
I just made the first step to my goal of becoming an AWS Certified...
I passed my Cloud Practitioner exam!! I've been dabbling in AWS for years now and I love how it feels to make those big, impactful changes on a...
Version control for mono-repo with microservices
Hey guys,
I have been trying to finalize the **version control theory for the new repository structure** that I am working on which has microservices(*currently 3 but can be more*). **The decision that has been taken collectively is to go ahead with MONO-repos**. We can debate about pros and cons of mono-repo vs multi-repo but clearly, the opinions are very much divided if you check the internet.
No, lets talk about how we can create versioning control for End to end product, each microservice and how to maintain the codebase so that in case point in time, we know which microservice was at which version for a global version of product. Let me put an example below:
>Suppose for product ABC, we have 3 microservices. At beginning, ABC and all 3 microservices are at 0.0.0 (as per semantic versioning scheme). Now, we can't control the order in which we update each microservice but what SHOULD be our strategy to bump up the **MAJOR.MINOR.PATCH** part of our product as a whole.
It will also be good to **tag GIT** (source repo) along the process so that we can fetch the code from GIT in case of bugs. And **what happens when we fix them**, precisely, how to update the overall version of product?
Additionally, **how do we handle inter-dependency amongst microservices**. There may not be all microservices that are dependent on each other, but surely there will be few. How do we define this dependency part in our repo. It can be defined in each parent folder of each microservice or how?
>I have researched on google and learnt about Lerna but it seems good fit for webservices based projects. Have read that google and facebook both are using monorepo so I reckon they must be using some tools to achieve this. Any clues about them?
How are you handling this kind of requirement at your workplace? I am sure everyone must be having/ or had this pain while migrating to microservices based deployment from monolithic.
https://redd.it/dtum27
@r_devops
Hey guys,
I have been trying to finalize the **version control theory for the new repository structure** that I am working on which has microservices(*currently 3 but can be more*). **The decision that has been taken collectively is to go ahead with MONO-repos**. We can debate about pros and cons of mono-repo vs multi-repo but clearly, the opinions are very much divided if you check the internet.
No, lets talk about how we can create versioning control for End to end product, each microservice and how to maintain the codebase so that in case point in time, we know which microservice was at which version for a global version of product. Let me put an example below:
>Suppose for product ABC, we have 3 microservices. At beginning, ABC and all 3 microservices are at 0.0.0 (as per semantic versioning scheme). Now, we can't control the order in which we update each microservice but what SHOULD be our strategy to bump up the **MAJOR.MINOR.PATCH** part of our product as a whole.
It will also be good to **tag GIT** (source repo) along the process so that we can fetch the code from GIT in case of bugs. And **what happens when we fix them**, precisely, how to update the overall version of product?
Additionally, **how do we handle inter-dependency amongst microservices**. There may not be all microservices that are dependent on each other, but surely there will be few. How do we define this dependency part in our repo. It can be defined in each parent folder of each microservice or how?
>I have researched on google and learnt about Lerna but it seems good fit for webservices based projects. Have read that google and facebook both are using monorepo so I reckon they must be using some tools to achieve this. Any clues about them?
How are you handling this kind of requirement at your workplace? I am sure everyone must be having/ or had this pain while migrating to microservices based deployment from monolithic.
https://redd.it/dtum27
@r_devops
reddit
Version control for mono-repo with microservices
Hey guys, I have been trying to finalize the **version control theory for the new repository structure** that I am working on which has...