Symbolic links in Virtual File System for Git
Hi!
I'm have merged 2 repos together as one monorepo. Getting files through Virtual File System for Git ( [https://vfsforgit.org/](https://vfsforgit.org/) ) works very well. It's really fast and easy to use. But when I try to get symlink from that repo it doesn't get resolved as link and just file with address to target is downloaded. When I try using plane git symlinks get downloaded as symlinks. So I guess the problem is in GVFS.
Has anyone had the same problem or could someone give hints what to research?
https://redd.it/di4j7e
@r_devops
Hi!
I'm have merged 2 repos together as one monorepo. Getting files through Virtual File System for Git ( [https://vfsforgit.org/](https://vfsforgit.org/) ) works very well. It's really fast and easy to use. But when I try to get symlink from that repo it doesn't get resolved as link and just file with address to target is downloaded. When I try using plane git symlinks get downloaded as symlinks. So I guess the problem is in GVFS.
Has anyone had the same problem or could someone give hints what to research?
https://redd.it/di4j7e
@r_devops
Building Tiny Python Docker Images
I've been building docker images and optimizing dockerfiles for a while now.
However, until just recently, I hadn't found a way to cleanly build my python dependencies in one docker stage, and install them in another.
I found myself chasing down numerous modern tools, like poetry, hatch, and pipenv.
In the end, it was the familiar setuptools and wheel that worked for me.
I'd like to share my experience optimizing a docker project using this strategy.
https://medium.com/@ethan.edwards/building-tiny-python-docker-images-b029b194171d
*Note: I am not selling anything. All views and opinions expressed in the above article are those of my own, and do not necessarily reflect those of any past or present employer or organization.*
https://redd.it/dkqlm5
@r_devops
I've been building docker images and optimizing dockerfiles for a while now.
However, until just recently, I hadn't found a way to cleanly build my python dependencies in one docker stage, and install them in another.
I found myself chasing down numerous modern tools, like poetry, hatch, and pipenv.
In the end, it was the familiar setuptools and wheel that worked for me.
I'd like to share my experience optimizing a docker project using this strategy.
https://medium.com/@ethan.edwards/building-tiny-python-docker-images-b029b194171d
*Note: I am not selling anything. All views and opinions expressed in the above article are those of my own, and do not necessarily reflect those of any past or present employer or organization.*
https://redd.it/dkqlm5
@r_devops
Medium
Building Tiny Python Docker Images
When it comes to packaging python projects for docker, there are plenty of questions I found myself asking
Help me understand DevOps and how better I can organize the complete process
So I work in a small team where we manage roll out of specific tools for different user.
We have same application being installed on multiple servers with different DB in the back end. This is mainly for multiple sub organizations we have.
I am part of a team in which one person handles 1 or more sub-orga. We roll out the new versions, handle customization etc.
Roll out:
\- This is a bit more complex process due to the fact that there needs to be many pre and post manual steps involved.
\- These are handled in "excel".
\- It only gets more complex as 1 excel is being used for all (for better overview)
​
Customizing:
\- There are whole loads of customization that can be done to the apps and each orga wants it differently.
\- Documenting them is only getting difficult.
there are whole load of manual job which I think is a waste of time. Unfortunately I don't have an idea for documentation/automation.
​
my questions:
1) How can I co-relate this to a "DevOps" job?
2) What tool sets do you guys use in terms of handling such scenarios including rollback?
3) I am trying to understand more simpler yet robust processes for such scenarios, which I couldn't find any.
https://redd.it/di2gc1
@r_devops
So I work in a small team where we manage roll out of specific tools for different user.
We have same application being installed on multiple servers with different DB in the back end. This is mainly for multiple sub organizations we have.
I am part of a team in which one person handles 1 or more sub-orga. We roll out the new versions, handle customization etc.
Roll out:
\- This is a bit more complex process due to the fact that there needs to be many pre and post manual steps involved.
\- These are handled in "excel".
\- It only gets more complex as 1 excel is being used for all (for better overview)
​
Customizing:
\- There are whole loads of customization that can be done to the apps and each orga wants it differently.
\- Documenting them is only getting difficult.
there are whole load of manual job which I think is a waste of time. Unfortunately I don't have an idea for documentation/automation.
​
my questions:
1) How can I co-relate this to a "DevOps" job?
2) What tool sets do you guys use in terms of handling such scenarios including rollback?
3) I am trying to understand more simpler yet robust processes for such scenarios, which I couldn't find any.
https://redd.it/di2gc1
@r_devops
reddit
Help me understand DevOps and how better I can organize the...
So I work in a small team where we manage roll out of specific tools for different user. We have same application being installed on multiple...
DevOps Jobs That Pay > $200k TC
What are you seeing out there? If you have one of these jobs, what do you do, where do you live, and how much do you travel?
I'm looking for a new job and I'm seeing a lot of jobs that pay $120k-130k base. They are middle of the road (aka "competitive", average). I have seen a good number that pay $160k base plus bonus. I've seen a couple that pay $180k-200k base plus bonus. They are out there but they're rare. These jobs are in cities that aren't SF, NYC, DC, or Seattle. I have seen a good number of 100% remote job that pay $150k-170k base.
For those of you who make $200k+ in DevOps / SRE / cloud what are you doing? Job seekers, what are you seeing?
EDIT: This thread is for jobs that aren't in SF NYC Seattle DC London or other super high cost of living areas.
https://redd.it/dks3ah
@r_devops
What are you seeing out there? If you have one of these jobs, what do you do, where do you live, and how much do you travel?
I'm looking for a new job and I'm seeing a lot of jobs that pay $120k-130k base. They are middle of the road (aka "competitive", average). I have seen a good number that pay $160k base plus bonus. I've seen a couple that pay $180k-200k base plus bonus. They are out there but they're rare. These jobs are in cities that aren't SF, NYC, DC, or Seattle. I have seen a good number of 100% remote job that pay $150k-170k base.
For those of you who make $200k+ in DevOps / SRE / cloud what are you doing? Job seekers, what are you seeing?
EDIT: This thread is for jobs that aren't in SF NYC Seattle DC London or other super high cost of living areas.
https://redd.it/dks3ah
@r_devops
reddit
DevOps Jobs That Pay > $200k TC
What are you seeing out there? If you have one of these jobs, what do you do, where do you live, and how much do you travel? I'm looking for a...
InSpec vs. Ansible check mode?
I've seen some people speaking highly of InSpec here lately but looking at it, I'm not sure what use it would be in my environment.
My company currently uses Ansible to do all the configuration, including security configuration, of our hosts, e.g., setting our sshd config options to comply with our security standards. The security configuration is baked into the Ansible playbooks we always run against all our hosts (and that we run when we build our OS images).
To test whether a system's configuration has deviated from the expected configuration, we can run `ansible-playbook --check` and see if it would modify any security settings.
From reading its web site, it seems like InSpec is a framework for checking that system configuration settings match some expected state, which is the same thing Ansible check mode does. What would adding InSpec to our setup buy us that we don't already get from Ansible? Is InSpec mostly of value in environments where it's not practical to fully automate host configuration?
https://redd.it/dktq8r
@r_devops
I've seen some people speaking highly of InSpec here lately but looking at it, I'm not sure what use it would be in my environment.
My company currently uses Ansible to do all the configuration, including security configuration, of our hosts, e.g., setting our sshd config options to comply with our security standards. The security configuration is baked into the Ansible playbooks we always run against all our hosts (and that we run when we build our OS images).
To test whether a system's configuration has deviated from the expected configuration, we can run `ansible-playbook --check` and see if it would modify any security settings.
From reading its web site, it seems like InSpec is a framework for checking that system configuration settings match some expected state, which is the same thing Ansible check mode does. What would adding InSpec to our setup buy us that we don't already get from Ansible? Is InSpec mostly of value in environments where it's not practical to fully automate host configuration?
https://redd.it/dktq8r
@r_devops
reddit
InSpec vs. Ansible check mode?
I've seen some people speaking highly of InSpec here lately but looking at it, I'm not sure what use it would be in my environment. My company...
CCNA before focusing on Cloud? Yay or Nay?
Want to learn networking fundamentals and still on the fence about getting the CCNA because of a few posts I’ve seen on here. Posts usually are about Cisco certs not really being optimal for the cloud because of how abstracted the networking is etc
https://redd.it/dkuk2t
@r_devops
Want to learn networking fundamentals and still on the fence about getting the CCNA because of a few posts I’ve seen on here. Posts usually are about Cisco certs not really being optimal for the cloud because of how abstracted the networking is etc
https://redd.it/dkuk2t
@r_devops
reddit
CCNA before focusing on Cloud? Yay or Nay?
Want to learn networking fundamentals and still on the fence about getting the CCNA because of a few posts I’ve seen on here. Posts usually are...
A noob sys admin here, some insight please!
Hi all,
This is the first time that I am posting in this subreddit although I constantly go through the informative threads in here.
I am in my early twenties and from Sri Lanka which is a small south asian island located near India. I just graduated with an Engineering degree and signed up as a Sys admin in a local company. I do have few questions to ask.
1. I am hoping to hop in to Devops as soon as possible. In order to do that I hope to acquire certifications on AWS, Docker, RedHat, Kubernetes and Ansible. Are these important or are there any missing important exams?
2. I am blown away by the salaries people post here who work remotely. (In our countries local pay levels are much lower as the living cost is not much high as in other countries.) What are the pros and cons of working remotely?
3. Any other advise from the experienced giants are much appreciated as I need win through my life! Any thing!! (These questions feel cheesy but that is I being honest (Early twenties, lots of hopes, lots of dreams, stupid and naive I guess))
Thank you very much for bearing through the long post and looking for valuable insights!
https://redd.it/dkur30
@r_devops
Hi all,
This is the first time that I am posting in this subreddit although I constantly go through the informative threads in here.
I am in my early twenties and from Sri Lanka which is a small south asian island located near India. I just graduated with an Engineering degree and signed up as a Sys admin in a local company. I do have few questions to ask.
1. I am hoping to hop in to Devops as soon as possible. In order to do that I hope to acquire certifications on AWS, Docker, RedHat, Kubernetes and Ansible. Are these important or are there any missing important exams?
2. I am blown away by the salaries people post here who work remotely. (In our countries local pay levels are much lower as the living cost is not much high as in other countries.) What are the pros and cons of working remotely?
3. Any other advise from the experienced giants are much appreciated as I need win through my life! Any thing!! (These questions feel cheesy but that is I being honest (Early twenties, lots of hopes, lots of dreams, stupid and naive I guess))
Thank you very much for bearing through the long post and looking for valuable insights!
https://redd.it/dkur30
@r_devops
reddit
A noob sys admin here, some insight please!
Hi all, This is the first time that I am posting in this subreddit although I constantly go through the informative threads in here. I am in my...
AWS and IAM permissions, trial and error?
I've worked with AWS for about 3 or 4 years now, and I love everything about it, but for the love of sanity I just can't get over how difficult it is to define permissions when attempting to apply least privilege approach. Am I the only one out there who just does it 100 times by trial and error in incognito window until you get the permissions just right? Is there a better way?
,
https://redd.it/dktcts
@r_devops
I've worked with AWS for about 3 or 4 years now, and I love everything about it, but for the love of sanity I just can't get over how difficult it is to define permissions when attempting to apply least privilege approach. Am I the only one out there who just does it 100 times by trial and error in incognito window until you get the permissions just right? Is there a better way?
,
https://redd.it/dktcts
@r_devops
reddit
AWS and IAM permissions, trial and error?
I've worked with AWS for about 3 or 4 years now, and I love everything about it, but for the love of sanity I just can't get over how difficult it...
Cargo culting...? [discussion]
It seems like the entire industry is following one "right" approach and whenever something shifts towards some "new" technology everyone just follows without actually thinking about it (ehem, Kubernetes). What is your opinion about cargo culting in the DevOps world and IT in general? Why does it happen - is it lack of education, time constraints... something else? Is it a cause of us reusing too much and trying not to reinvent the wheel?
https://redd.it/dktipc
@r_devops
It seems like the entire industry is following one "right" approach and whenever something shifts towards some "new" technology everyone just follows without actually thinking about it (ehem, Kubernetes). What is your opinion about cargo culting in the DevOps world and IT in general? Why does it happen - is it lack of education, time constraints... something else? Is it a cause of us reusing too much and trying not to reinvent the wheel?
https://redd.it/dktipc
@r_devops
reddit
Cargo culting...? [discussion]
It seems like the entire industry is following one "right" approach and whenever something shifts towards some "new" technology everyone just...
Kubernetes Patterns : The Service Discovery Pattern
**Folks,**
The client is responsible for determining which service instance it should connect to. A load-balancing layer exists in front of the service instances. The client connects to the well-defined URL of the load balancer and the latter determines which backend service it shall route the request too.
Here's this week article Kubernetes Patterns : The Service Discovery Pattern.
**What's inside:**
* Why do we need Service Discovery?
* inter-app communication Scenario.
* connecting to an outside resource Scenario.
* Why use a Service to connect to an external resource?
* Accepting outside connections Scenario.
[https://www.magalix.com/blog/kubernetes-patterns-the-service-discovery-pattern](https://www.magalix.com/blog/kubernetes-patterns-the-service-discovery-pattern)
https://redd.it/dl0j1j
@r_devops
**Folks,**
The client is responsible for determining which service instance it should connect to. A load-balancing layer exists in front of the service instances. The client connects to the well-defined URL of the load balancer and the latter determines which backend service it shall route the request too.
Here's this week article Kubernetes Patterns : The Service Discovery Pattern.
**What's inside:**
* Why do we need Service Discovery?
* inter-app communication Scenario.
* connecting to an outside resource Scenario.
* Why use a Service to connect to an external resource?
* Accepting outside connections Scenario.
[https://www.magalix.com/blog/kubernetes-patterns-the-service-discovery-pattern](https://www.magalix.com/blog/kubernetes-patterns-the-service-discovery-pattern)
https://redd.it/dl0j1j
@r_devops
www.weave.works
Kubernetes Patterns : The Service Discovery Pattern
Why do we need the service discovery pattern? And what are some scenarios in which service discovery would be utilized?
Policy as a code services
Hi guys,
Any recommendations/reviews on Policy/Compliance as a code services?
[Sentinal](https://www.hashicorp.com/sentinel/) by Hashicorp looks interesting.
Thanks!
https://redd.it/dl18gd
@r_devops
Hi guys,
Any recommendations/reviews on Policy/Compliance as a code services?
[Sentinal](https://www.hashicorp.com/sentinel/) by Hashicorp looks interesting.
Thanks!
https://redd.it/dl18gd
@r_devops
When can someone call him/herself a DevOps Guy?
I'm just getting into things as it's my internship going on.
Was just curious about when can someone call him/herself a devops engineer? i.e. what skills/knowledge/achievements are the ones that are very very necessary? And experiences too?
I am just a beginner so I don't know much about it.
https://redd.it/dl51v1
@r_devops
I'm just getting into things as it's my internship going on.
Was just curious about when can someone call him/herself a devops engineer? i.e. what skills/knowledge/achievements are the ones that are very very necessary? And experiences too?
I am just a beginner so I don't know much about it.
https://redd.it/dl51v1
@r_devops
reddit
When can someone call him/herself a DevOps Guy?
I'm just getting into things as it's my internship going on. Was just curious about when can someone call him/herself a devops engineer? i.e....
Ideas for maintaining SOX compliance with feature toggles and frequent deployment?
Feature toggles (or feature flags) enable me to deploy unfinished features without comprehensive manual testing of features toggled off. We can toggle the feature on for certain users, try it out, and then choose to toggle it off or on for all users. This enables more frequent integration as suggested by version control strategies such as [Trunk-Based Development](https://trunkbaseddevelopment.com/), and more frequent deployment of the trunk (master) branch into user's hands.
Sarbanes-Oxley rules require that all features that are in user's hands be fully tested.
So if I have a SOX-compliant system, how do I proceed with using feature toggles without having to do full manual testing of the feature toggled ON? It makes sense to do regression testing with the feature toggled OFF, but the most common need is to integrate and deploy good code but not incur the manual testing cost for a feature toggled off.
**So any suggestions on ways to have SOX-compliant feature toggles without comprehensive manual testing on every release?**
https://redd.it/dl60t4
@r_devops
Feature toggles (or feature flags) enable me to deploy unfinished features without comprehensive manual testing of features toggled off. We can toggle the feature on for certain users, try it out, and then choose to toggle it off or on for all users. This enables more frequent integration as suggested by version control strategies such as [Trunk-Based Development](https://trunkbaseddevelopment.com/), and more frequent deployment of the trunk (master) branch into user's hands.
Sarbanes-Oxley rules require that all features that are in user's hands be fully tested.
So if I have a SOX-compliant system, how do I proceed with using feature toggles without having to do full manual testing of the feature toggled ON? It makes sense to do regression testing with the feature toggled OFF, but the most common need is to integrate and deploy good code but not incur the manual testing cost for a feature toggled off.
**So any suggestions on ways to have SOX-compliant feature toggles without comprehensive manual testing on every release?**
https://redd.it/dl60t4
@r_devops
Trunkbaseddevelopment
Trunk Based Development
A portal on this practice
Open source tool to track software release for various products
Looking for a simple way to track software releases across various products. Ideally, I’d be able to notate what releases an organization should stay away from due to known vulnerabilities or bugs.
Any recommendations for something to use?
https://redd.it/dlaq8c
@r_devops
Looking for a simple way to track software releases across various products. Ideally, I’d be able to notate what releases an organization should stay away from due to known vulnerabilities or bugs.
Any recommendations for something to use?
https://redd.it/dlaq8c
@r_devops
reddit
Open source tool to track software release for various products
Looking for a simple way to track software releases across various products. Ideally, I’d be able to notate what releases an organization should...
How to install Traefik 2.x on a Docker Swarm
Here's a little article that I've wrote about the installation of Traefik on a Docker Swarm. This will be the first article on a series on swarm. May I have some reviews?
Hope it helps someone :)
[https://creekorful.me/how-to-install-traefik-2-docker-swarm](https://creekorful.me/how-to-install-traefik-2-docker-swarm/)
https://redd.it/dl7j28
@r_devops
Here's a little article that I've wrote about the installation of Traefik on a Docker Swarm. This will be the first article on a series on swarm. May I have some reviews?
Hope it helps someone :)
[https://creekorful.me/how-to-install-traefik-2-docker-swarm](https://creekorful.me/how-to-install-traefik-2-docker-swarm/)
https://redd.it/dl7j28
@r_devops
How to install Traefik 2.x on a Docker Swarm
How to install Traefik 2.x on a Docker Swarm :: Aloïs Micard
have recently migrated my production docker swarm from Traefik 1.7 to Traefik 2.0 and since I cannot found a good tutorial I have decided to write one. So in this tutorial you’ll learn how to deploy Traefik with HTTPS support on a docker swarm.
Please note…
Please note…
What are the best things I can do as a Linux Admin to move towards an official devops role?
Hi All, as the title mentions I am a Linux Admin at an MSP. After debate over the last few years between going the route of cyber security, devops, or developer, I've settled on Devops.
I am curious, what are the best things I can do right now to get there? For a bit of background, I have started learning puppet and python. I'm fairly decent with bash scripting, and I would like to learn Ansible. Some of it is hard, as it's all in my free time, since things it isn't directly applicable to my current work. For Linux I should hopefully have my RHCE by the end of the year. I have a homelab that I work on to try and further my own knowledge. I don't have a degree, and I'm fairly young. I like to believe, I am a fast learner.
Would working on something like the AWS Solutions Architect be the best? Are there broader concepts I should understand? Networking is a weaker area and I've been trying to improve upon that. Any guidance you have I would love to hear!
​
Edit: Forgot to add - I am aware of the the sticky on the front page, which has been a massive help! Just curious if there is any more granular feedback/insights for my case
https://redd.it/dlcevp
@r_devops
Hi All, as the title mentions I am a Linux Admin at an MSP. After debate over the last few years between going the route of cyber security, devops, or developer, I've settled on Devops.
I am curious, what are the best things I can do right now to get there? For a bit of background, I have started learning puppet and python. I'm fairly decent with bash scripting, and I would like to learn Ansible. Some of it is hard, as it's all in my free time, since things it isn't directly applicable to my current work. For Linux I should hopefully have my RHCE by the end of the year. I have a homelab that I work on to try and further my own knowledge. I don't have a degree, and I'm fairly young. I like to believe, I am a fast learner.
Would working on something like the AWS Solutions Architect be the best? Are there broader concepts I should understand? Networking is a weaker area and I've been trying to improve upon that. Any guidance you have I would love to hear!
​
Edit: Forgot to add - I am aware of the the sticky on the front page, which has been a massive help! Just curious if there is any more granular feedback/insights for my case
https://redd.it/dlcevp
@r_devops
reddit
What are the best things I can do as a Linux Admin to move towards...
Hi All, as the title mentions I am a Linux Admin at an MSP. After debate over the last few years between going the route of cyber security,...
What are the basic Kubectl commands to know?
I often get the same questions about Kubectl, so I wrote [an article about the basic Kubectl commands](https://www.padok.fr/en/blog/kubectl-cluster-kubernetes). Check it out and give me your opinion. Do you see a command I should add?
https://redd.it/dljee8
@r_devops
I often get the same questions about Kubectl, so I wrote [an article about the basic Kubectl commands](https://www.padok.fr/en/blog/kubectl-cluster-kubernetes). Check it out and give me your opinion. Do you see a command I should add?
https://redd.it/dljee8
@r_devops
www.padok.fr
Kubectl list-clusters and commands to know | Padok
To save time with Kubernetes, discover the mastering commands for cluster management (Kubectl) to create, delete & monitor resources.
Ansible vs Airflow
Hi,
I know both tools are different but when it comes to a use case where you need to execute a series of tasks (i.e move this file from a to b, edit this file, then move again) in a specific order and idempotently why to use Airflow and not stick with the good ol Ansible?
https://redd.it/dlj2v1
@r_devops
Hi,
I know both tools are different but when it comes to a use case where you need to execute a series of tasks (i.e move this file from a to b, edit this file, then move again) in a specific order and idempotently why to use Airflow and not stick with the good ol Ansible?
https://redd.it/dlj2v1
@r_devops
reddit
Ansible vs Airflow
Hi, I know both tools are different but when it comes to a use case where you need to execute a series of tasks (i.e move this file from a to b,...
Vault + Consult + EKS?
Hi everyone!
Have worked quite a bit with ECS in the past, and I'm trying to spec out a new POC for EKS + Vault. My knowledge of Vault is pretty limited so far, so I'm trying to tie everything together. Was hoping you all could help.
We're using Terraform, so it seems that creating secrets in Vault could be somewhat trivial.
The area that I'm kind of grey on is, how are other folks injecting/providing the secrets to their application deployments, without implementing Vault at the application-code level?
For example, we're using Kong and it needs certain environment variables set to connect to the DB. How would you guys go about making that happen?
Thanks in advance!
https://redd.it/dlixqh
@r_devops
Hi everyone!
Have worked quite a bit with ECS in the past, and I'm trying to spec out a new POC for EKS + Vault. My knowledge of Vault is pretty limited so far, so I'm trying to tie everything together. Was hoping you all could help.
We're using Terraform, so it seems that creating secrets in Vault could be somewhat trivial.
The area that I'm kind of grey on is, how are other folks injecting/providing the secrets to their application deployments, without implementing Vault at the application-code level?
For example, we're using Kong and it needs certain environment variables set to connect to the DB. How would you guys go about making that happen?
Thanks in advance!
https://redd.it/dlixqh
@r_devops
reddit
Vault + Consult + EKS?
Hi everyone! Have worked quite a bit with ECS in the past, and I'm trying to spec out a new POC for EKS + Vault. My knowledge of Vault is pretty...