What is Table of Content for DevOps Career??
What is the best tools that one needs to know to learn devops.
For eg:
1. Version Control: Git
2. Containerization: Docker
3. Jekins
4. Puppet
…..Etc……
https://redd.it/ri5xfs
@r_devops
What is the best tools that one needs to know to learn devops.
For eg:
1. Version Control: Git
2. Containerization: Docker
3. Jekins
4. Puppet
…..Etc……
https://redd.it/ri5xfs
@r_devops
reddit
What is Table of Content for DevOps Career??
What is the best tools that one needs to know to learn devops. For eg: 1. Version Control: Git 2. Containerization: Docker 3. Jekins 4....
Ansible troubleshooting - undefined variable How to reproduce the
https://youtu.be/-a3kucoXKAk
https://redd.it/rikxaf
@r_devops
undefined variable error in Ansible, troubleshooting, and fix to be able to successfully print the value of a variable on screen. #ansible #troubleshooting #code #playbook #variablehttps://youtu.be/-a3kucoXKAk
https://redd.it/rikxaf
@r_devops
YouTube
Ansible troubleshooting - undefined variable
How to reproduce the `undefined variable` error in Ansible, troubleshooting, and fix to be able to successfully print the value of a variable on screen.
https://www.ansiblepilot.com/articles/ansible-troubleshooting-undefined-variable/
Timestamps
00:00 Introduction…
https://www.ansiblepilot.com/articles/ansible-troubleshooting-undefined-variable/
Timestamps
00:00 Introduction…
Terraform: remote-exec error ssh failed
I have no idea why I keep getting this error, the key is obviously where it's supposed to be.
Error: remote-exec provisioner error
│
│ with aws_instance.devops,
│ on main.tf line 87, in resource "aws_instance" "devops":
│ 87: provisioner "remote-exec" {
│
│ Failed to read ssh private key: no key found
​
The key is located in the same folder from where I run terraform apply.
​
Here's a relevant part of the script (within aws_instance resource)
​
provisioner "remote-exec" {
inline = [
"echo 'SSH IS READY'"
\]
}
connection {
type = "ssh"
host = self.public_ip
user = "ubuntu"
private_key = file("devops.pem")
}
https://redd.it/riksrz
@r_devops
I have no idea why I keep getting this error, the key is obviously where it's supposed to be.
Error: remote-exec provisioner error
│
│ with aws_instance.devops,
│ on main.tf line 87, in resource "aws_instance" "devops":
│ 87: provisioner "remote-exec" {
│
│ Failed to read ssh private key: no key found
​
The key is located in the same folder from where I run terraform apply.
​
Here's a relevant part of the script (within aws_instance resource)
​
provisioner "remote-exec" {
inline = [
"echo 'SSH IS READY'"
\]
}
connection {
type = "ssh"
host = self.public_ip
user = "ubuntu"
private_key = file("devops.pem")
}
https://redd.it/riksrz
@r_devops
reddit
Terraform: remote-exec error ssh failed
I have no idea why I keep getting this error, the key is obviously where it's supposed to be. Error: remote-exec provisioner error │ │ with...
On-call by default: how we do it at incident.io
https://incident.io/blog/on-call-at-incident-io
Hey all!
My colleague Chris (https://twitter.com/evnsio) wrote a great guide to on-call that we've shared as a blog post.
It's a lot of good common sense, but explained in plain language and might be a good starting point for anyone setting up an on-call rota at their own companies.
Hope you find it useful!
https://redd.it/rin8ii
@r_devops
https://incident.io/blog/on-call-at-incident-io
Hey all!
My colleague Chris (https://twitter.com/evnsio) wrote a great guide to on-call that we've shared as a blog post.
It's a lot of good common sense, but explained in plain language and might be a good starting point for anyone setting up an on-call rota at their own companies.
Hope you find it useful!
https://redd.it/rin8ii
@r_devops
incident.io
On-call by default | incident.io
Like many SaaS businesses, we have an on-call rota to enable us to provide 24x7 cover if there are problems with incident.io. We have a 'pager' which will alert the relevant person if something unexpected happens in our app, so that they can investigate and…
What does a Cloud Security Engineer actually do?
On one hand, I hear people say Cloud Sec roles are mostly just IAM engineering and management.
While on the other hand, I hear it's a lot of automation of monitoring tools and compliance frameworks.
I'm sure it's both but what could I reasonably expect if I were to walk into a cloud sec job tomorrow?
https://redd.it/rimgfq
@r_devops
On one hand, I hear people say Cloud Sec roles are mostly just IAM engineering and management.
While on the other hand, I hear it's a lot of automation of monitoring tools and compliance frameworks.
I'm sure it's both but what could I reasonably expect if I were to walk into a cloud sec job tomorrow?
https://redd.it/rimgfq
@r_devops
reddit
What does a Cloud Security Engineer actually do?
On one hand, I hear people say Cloud Sec roles are mostly just IAM engineering and management. While on the other hand, I hear it's a lot of...
I'm new in DevOps, Question for Ansible + git + AWS
Hi everyone, I’ve started working from SysAdmin to DevOps, I have a task, use Ansible to automate the deploy from git.
Currently to perform an deploy I perform these steps:
git describe
git status
# Deploy new version
git fetch --tags
git reset --hard <target_version>
Is it possible to automate the deploy of new versions through Ansible? and in case the task fails to return to a previous version?
Regards,
https://redd.it/rimeqx
@r_devops
Hi everyone, I’ve started working from SysAdmin to DevOps, I have a task, use Ansible to automate the deploy from git.
Currently to perform an deploy I perform these steps:
git describe
git status
# Deploy new version
git fetch --tags
git reset --hard <target_version>
Is it possible to automate the deploy of new versions through Ansible? and in case the task fails to return to a previous version?
Regards,
https://redd.it/rimeqx
@r_devops
reddit
I'm new in DevOps, Question for Ansible + git + AWS
Hi everyone, I’ve started working from SysAdmin to DevOps, I have a task, use Ansible to automate the deploy from git. Currently to perform an...
Are you ready for the holidays?
We wrote about how SREs can prepare for the 2021 holiday season coming up!
https://redd.it/riq5db
@r_devops
We wrote about how SREs can prepare for the 2021 holiday season coming up!
https://redd.it/riq5db
@r_devops
Rootly
A Site Reliability Engineer’s Guide to the Holiday Season
SREs face special challenges during the holidays. Here’s how to manage them.
Upgrade Google App Engine
Hi folks
I am new to GCP
I have deployed my application of Google app engine. Now traffic load has been increased and I want to increase the compute power. Can anyone help me out how I can achieve this ?
Can you guys share a link ? And we can estimate the cost price
https://redd.it/ripv95
@r_devops
Hi folks
I am new to GCP
I have deployed my application of Google app engine. Now traffic load has been increased and I want to increase the compute power. Can anyone help me out how I can achieve this ?
Can you guys share a link ? And we can estimate the cost price
https://redd.it/ripv95
@r_devops
reddit
Upgrade Google App Engine
Hi folks I am new to GCP I have deployed my application of Google app engine. Now traffic load has been increased and I want to increase the...
Task Ask your managers or CTO, "What do they think DevOps is"? ... Post their answer.
I find most problems with DevOps is a warped idea of what DevOps is / should be. Let's see how endemic this problem is. :D
https://redd.it/rit9p4
@r_devops
I find most problems with DevOps is a warped idea of what DevOps is / should be. Let's see how endemic this problem is. :D
https://redd.it/rit9p4
@r_devops
reddit
[Task] Ask your managers or CTO, "What do they think DevOps is"?...
I find most problems with DevOps is a warped idea of what DevOps is / should be. Let's see how endemic this problem is. :D
How to use Terraform and Pulumi together to incrementally migrate infrastructure tooling
https://transcend.io/blog/use-terraform-pulumi-together-migrate-infrastructure-tooling
https://redd.it/ritrcv
@r_devops
https://transcend.io/blog/use-terraform-pulumi-together-migrate-infrastructure-tooling
https://redd.it/ritrcv
@r_devops
Transcend
How to use Terraform and Pulumi together to incrementally migrate infrastructure tooling
Migrating infrastructure as code platforms is a large undertaking. This blog shows how to start a migration incrementally using Terraform and Pulumi.
Build the deployment system around GitHub in minutes.
I thought the r/devops subreddit might be interested in this project I just found!
https://github.com/gitploy-io/gitploy
https://redd.it/ripoxr
@r_devops
I thought the r/devops subreddit might be interested in this project I just found!
https://github.com/gitploy-io/gitploy
https://redd.it/ripoxr
@r_devops
GitHub
GitHub - gitploy-io/gitploy: Build the deployment system around GitHub in minutes.
Build the deployment system around GitHub in minutes. - gitploy-io/gitploy
How to learn devops in 2022?
So a bit of a background, as of currently i have knowledge of MERN stack (python too), and for version control git. I had also checked for roadmap on (roadmap.sh) but it felt overwhelming. What should be my next steps for devops?, some suggestions for courses and books will be immensly helpful too. Thanx for giving it a read. Have a nice day
https://redd.it/riwqba
@r_devops
So a bit of a background, as of currently i have knowledge of MERN stack (python too), and for version control git. I had also checked for roadmap on (roadmap.sh) but it felt overwhelming. What should be my next steps for devops?, some suggestions for courses and books will be immensly helpful too. Thanx for giving it a read. Have a nice day
https://redd.it/riwqba
@r_devops
reddit
How to learn devops in 2022?
So a bit of a background, as of currently i have knowledge of MERN stack (python too), and for version control git. I had also checked for roadmap...
Confused about Devops transition
I have been learning devops related technologies from a while. But whenever I go through blind, most of people say SRE/Devops are not much required. They are someone who failed SWE interview. Google needed just support engineers so they names it SRE to look cool.
Especially developers saying, SWE is always a best job and they have to look after Devops related task too
Also on the other side of internet Devops people are getting paid more than SWE sometimes ( for good skills).
I don't understand why these people downgrade Devops/SRE jobs.
So according to you, what skillset a successful devops engineer must have?
https://redd.it/rizzlf
@r_devops
I have been learning devops related technologies from a while. But whenever I go through blind, most of people say SRE/Devops are not much required. They are someone who failed SWE interview. Google needed just support engineers so they names it SRE to look cool.
Especially developers saying, SWE is always a best job and they have to look after Devops related task too
Also on the other side of internet Devops people are getting paid more than SWE sometimes ( for good skills).
I don't understand why these people downgrade Devops/SRE jobs.
So according to you, what skillset a successful devops engineer must have?
https://redd.it/rizzlf
@r_devops
reddit
Confused about Devops transition
I have been learning devops related technologies from a while. But whenever I go through blind, most of people say SRE/Devops are not much...
How to become a good DevOps Engineer? Newbie here, I need advice
I need advice from experienced DevOps engineers. I am new in this field and sometimes it's hard to keep up with all the tools, I guess I am having a hard time integrating all the things I've learned so far and continuously learning more.
I have experience as a backend web developer and I transitioned into this role, I'm an intern and I need advice. I enjoy what I do but sometimes I feel a bit lost, tbh.
https://redd.it/rj16u0
@r_devops
I need advice from experienced DevOps engineers. I am new in this field and sometimes it's hard to keep up with all the tools, I guess I am having a hard time integrating all the things I've learned so far and continuously learning more.
I have experience as a backend web developer and I transitioned into this role, I'm an intern and I need advice. I enjoy what I do but sometimes I feel a bit lost, tbh.
https://redd.it/rj16u0
@r_devops
reddit
How to become a good DevOps Engineer? Newbie here, I need advice
I need advice from experienced DevOps engineers. I am new in this field and sometimes it's hard to keep up with all the tools, I guess I am having...
Is Terraform is the only choice in 2021/2?
I've been looking at Terraform and know it's very powerful and mainstream.
My only issues:
* HCL language is an interesting DSL, but would prefer just using a mainstream language, but I know CDKTF exists but this seems very young at the moment?
* Terraform state, this deeply troubles me, I think HashiCorp has made a major architecture flaw, a permanent state shouldn't be ever needed in theory at least, however having ephemeral state that can be re-generated would be a good optimisation.
What alternatives are there that is:
* Free open source
* Doesn't use state
* Uses mainstream language and no custom DSL
https://redd.it/rj498b
@r_devops
I've been looking at Terraform and know it's very powerful and mainstream.
My only issues:
* HCL language is an interesting DSL, but would prefer just using a mainstream language, but I know CDKTF exists but this seems very young at the moment?
* Terraform state, this deeply troubles me, I think HashiCorp has made a major architecture flaw, a permanent state shouldn't be ever needed in theory at least, however having ephemeral state that can be re-generated would be a good optimisation.
What alternatives are there that is:
* Free open source
* Doesn't use state
* Uses mainstream language and no custom DSL
https://redd.it/rj498b
@r_devops
reddit
Is Terraform is the only choice in 2021/2?
I've been looking at Terraform and know it's very powerful and mainstream. My only issues: * HCL language is an interesting DSL, but would...
Is Bret Fisher Docker Course the best one?
I've seen so many students enrolled in Docker Course of Bret Fisher, in Udemy. Is it worth the money to take on that course?
https://redd.it/rjbnhi
@r_devops
I've seen so many students enrolled in Docker Course of Bret Fisher, in Udemy. Is it worth the money to take on that course?
https://redd.it/rjbnhi
@r_devops
reddit
Is Bret Fisher Docker Course the best one?
I've seen so many students enrolled in Docker Course of Bret Fisher, in Udemy. Is it worth the money to take on that course?
What are your important tips when migrating on-prem to AWS?
So I'm studying aws-certified-solutions-architect in order to be able to move my company's on-prem servers to AWS.
What, out of your experience, are the key things to take in count ?
https://redd.it/rjfgbz
@r_devops
So I'm studying aws-certified-solutions-architect in order to be able to move my company's on-prem servers to AWS.
What, out of your experience, are the key things to take in count ?
https://redd.it/rjfgbz
@r_devops
reddit
What are your important tips when migrating on-prem to AWS?
So I'm studying aws-certified-solutions-architect in order to be able to move my company's on-prem servers to AWS. What, out of your experience,...
A simple open source CLI application to detect large files that are eating up your file system storage
I have developed a CLI application to detect large files of file system that are eating up the valuable storage. I hope it will help you a lot while searching through huge file systems. Please let me know your suggestions to improve this tool.
Github URL: https://github.com/rbrahul/large-file-finder
Available in PyPI repository: https://pypi.org/project/large-file-finder/
Thanks for having a look.
https://redd.it/rjl91c
@r_devops
I have developed a CLI application to detect large files of file system that are eating up the valuable storage. I hope it will help you a lot while searching through huge file systems. Please let me know your suggestions to improve this tool.
Github URL: https://github.com/rbrahul/large-file-finder
Available in PyPI repository: https://pypi.org/project/large-file-finder/
Thanks for having a look.
https://redd.it/rjl91c
@r_devops
GitHub
GitHub - rbrahul/large-file-finder: This simple CLI application helps you to find giant files that are eating up your system storage
This simple CLI application helps you to find giant files that are eating up your system storage - rbrahul/large-file-finder
I feel like my development team could benefit from some devops practices, but I don't know enough about devops to give any recommendations. Please help.
I work at a company with a small dev team (\~5 people) that primarily does data analytics for healthcare institutions. We use git for development, but basically just to have "backups" of our code. I feel like I don't know enough about devops to ask the right questions, but I think the best way to explain the problem is to explain first (1) what we do with the data on a high-level and (2) then what our development setup/workflow is for adding features/fixing issues.
1. What we do with the data:
We have many clients, each sending us data in several csv files over ftp. We load it into a database on our main server, making tables for each client's data; pretty straightforward, most clients do it the same way with little issues. We also keep the raw data around in a directory for a certain period of time for safety and other dev work.
Then comes to the data analysis part, we have a specific git repo/project for each client because they usually all want some custom analytics or their workflow for some common process might be different from another client that does. So we're looking at different strings in different columns or what have you.
2. Our dev setup/workflow:
Our setup seems strange to me, here's the gist:
all developers have to rdp into our main server which has both dev and prod code.
We have those projects in a directory on a shared drive, the projects also all have git repos and are hosted on bitbucket.
But everyone has access to those project directories to make changes, people can make changes without needing to use git, people hardly ever make commits or push them (not to mention, some non-dev focused people also have access to these directories to run a package for a client or make some small change).
And we can't really clone these projects on our local laptops and test them because all the data we'd need to use for testing is on the rdp server and we're not allowed to have copies of that data on our local laptops.
(When I asked about the reason for this, the answer I got was basically, "our contracts only allow us to have client data on this one server, so we can't clone the project repos on our individual laptops and copy client data to test locally there".)
________________________________________________________________________
It's not like my last job where each developer would clone a git repo for a project and push/pr changes to the repo which would then be built and tested, then and then automatically sent out in weekly builds.
We're planning to soon bring on more people for the dev team, and things have mostly worked out OK so far because the team is small enough that people rarely step on eachother's toes, trying to edit the same projects at once and such. But I think we need to change how we do things, but I don't really know *what* to suggest because of our setup with where our code is "deployed" which is the same server as where all the development happens.
________________________________________________________________________
My attempt at a solution is below, I think it sounds *OK*, but it's contingent on a big if: buying a new dev server.
Devs would have to RDP into the newdev server and clone a project from bitbucket. And have them copy raw data files from our main server to use for testing if they need it.
Spin up a jenkins server that will watch our bitbucket repos for pushes, and then publish the code on the main server to be used by our automated processes.
Then lock down user access to the main server's code/projects directory so that nobody can write to it without having to go through git on the dev server.
______________________________________
Everyone would still be rdp-ing into the same server for dev work, but
I work at a company with a small dev team (\~5 people) that primarily does data analytics for healthcare institutions. We use git for development, but basically just to have "backups" of our code. I feel like I don't know enough about devops to ask the right questions, but I think the best way to explain the problem is to explain first (1) what we do with the data on a high-level and (2) then what our development setup/workflow is for adding features/fixing issues.
1. What we do with the data:
We have many clients, each sending us data in several csv files over ftp. We load it into a database on our main server, making tables for each client's data; pretty straightforward, most clients do it the same way with little issues. We also keep the raw data around in a directory for a certain period of time for safety and other dev work.
Then comes to the data analysis part, we have a specific git repo/project for each client because they usually all want some custom analytics or their workflow for some common process might be different from another client that does. So we're looking at different strings in different columns or what have you.
2. Our dev setup/workflow:
Our setup seems strange to me, here's the gist:
all developers have to rdp into our main server which has both dev and prod code.
We have those projects in a directory on a shared drive, the projects also all have git repos and are hosted on bitbucket.
But everyone has access to those project directories to make changes, people can make changes without needing to use git, people hardly ever make commits or push them (not to mention, some non-dev focused people also have access to these directories to run a package for a client or make some small change).
And we can't really clone these projects on our local laptops and test them because all the data we'd need to use for testing is on the rdp server and we're not allowed to have copies of that data on our local laptops.
(When I asked about the reason for this, the answer I got was basically, "our contracts only allow us to have client data on this one server, so we can't clone the project repos on our individual laptops and copy client data to test locally there".)
________________________________________________________________________
It's not like my last job where each developer would clone a git repo for a project and push/pr changes to the repo which would then be built and tested, then and then automatically sent out in weekly builds.
We're planning to soon bring on more people for the dev team, and things have mostly worked out OK so far because the team is small enough that people rarely step on eachother's toes, trying to edit the same projects at once and such. But I think we need to change how we do things, but I don't really know *what* to suggest because of our setup with where our code is "deployed" which is the same server as where all the development happens.
________________________________________________________________________
My attempt at a solution is below, I think it sounds *OK*, but it's contingent on a big if: buying a new dev server.
Devs would have to RDP into the newdev server and clone a project from bitbucket. And have them copy raw data files from our main server to use for testing if they need it.
Spin up a jenkins server that will watch our bitbucket repos for pushes, and then publish the code on the main server to be used by our automated processes.
Then lock down user access to the main server's code/projects directory so that nobody can write to it without having to go through git on the dev server.
______________________________________
Everyone would still be rdp-ing into the same server for dev work, but
projects are pretty small usually, and devs could probably clone em their user directories as needed then push to the source hosting site. Could be an awful idea, I am not sure.
https://redd.it/rjmqn2
@r_devops
https://redd.it/rjmqn2
@r_devops
reddit
I feel like my development team could benefit from some devops...
I work at a company with a small dev team (\~5 people) that primarily does data analytics for healthcare institutions. We use git for development,...