Is Packer still the best choice for building images for multiple clouds?
We need to run custom images on a number of clouds and currently this is mostly done through bash scripts and the like. I was looking into using Packer to consolidate all this under one tool, is it a good choice? Any competing tools that show promise?
https://redd.it/f09m2o
@r_devops
We need to run custom images on a number of clouds and currently this is mostly done through bash scripts and the like. I was looking into using Packer to consolidate all this under one tool, is it a good choice? Any competing tools that show promise?
https://redd.it/f09m2o
@r_devops
reddit
Is Packer still the best choice for building images for multiple...
We need to run custom images on a number of clouds and currently this is mostly done through bash scripts and the like. I was looking into using...
Passing Bitbucket credentials and Personal Access Token via script.
Is there any way to pass a credential and personal access token for doing a git pull from BitBucket via script.
I'm not able to use an SSH key for this script because I can only connect via https, but I'm able to use a personal access token.
https://redd.it/f0bgo3
@r_devops
Is there any way to pass a credential and personal access token for doing a git pull from BitBucket via script.
I'm not able to use an SSH key for this script because I can only connect via https, but I'm able to use a personal access token.
https://redd.it/f0bgo3
@r_devops
reddit
Passing Bitbucket credentials and Personal Access Token via script.
Is there any way to pass a credential and personal access token for doing a git pull from BitBucket via script. I'm not able to use an SSH key...
Self hosted CI/CD option
I'm looking for a tool that could replace Jenkins. What are the good CI/CD that could be hosted on AWS. I'm the only devops engineer in a team and I don't have enough time for managing jenkins
https://redd.it/f0a6ko
@r_devops
I'm looking for a tool that could replace Jenkins. What are the good CI/CD that could be hosted on AWS. I'm the only devops engineer in a team and I don't have enough time for managing jenkins
https://redd.it/f0a6ko
@r_devops
reddit
Self hosted CI/CD option
I'm looking for a tool that could replace Jenkins. What are the good CI/CD that could be hosted on AWS. I'm the only devops engineer in a team and...
Deploying using a batch to multiple machines, what tools will help me?
So right now I'm working with a legacy system, I know a big surprise, and our system is distributed across multiple machines that are identical. For example we have 4 servers of type x, 4 servers of type y, and 4 servers of type z all which work to run our application, each of these servers uses a batch file that pulls down some code from a repo and builds out the repo it pulled down.
Now what I want to know is what type of tools I can use to make our deployments faster, centralized, and to avoid as much human error as possible, currently our deployment requires logging onto each machine and running the batch file which is laboring , not to mention very prone to human error. I imagine I could write some scripts to call out to each machine and have it run all my batch file as long as it is in a common path across machines but this loses me a few things and overall just really doesn't seem like a good solution I could go further into why but I think we understand. My next thought was to use something like octopus and have that installed on each machine and then using a process within Octopus to trigger the batch on each machine and in that way I could avoid human error, have a centralized tool that I have some experience with in the past.
While I believe Octopus solves the issue I'm working on I'm curious of any other ideas for how I could approach this problem. Any and all suggestions / criticism about my current solutions are appreciated.
https://redd.it/f08fre
@r_devops
So right now I'm working with a legacy system, I know a big surprise, and our system is distributed across multiple machines that are identical. For example we have 4 servers of type x, 4 servers of type y, and 4 servers of type z all which work to run our application, each of these servers uses a batch file that pulls down some code from a repo and builds out the repo it pulled down.
Now what I want to know is what type of tools I can use to make our deployments faster, centralized, and to avoid as much human error as possible, currently our deployment requires logging onto each machine and running the batch file which is laboring , not to mention very prone to human error. I imagine I could write some scripts to call out to each machine and have it run all my batch file as long as it is in a common path across machines but this loses me a few things and overall just really doesn't seem like a good solution I could go further into why but I think we understand. My next thought was to use something like octopus and have that installed on each machine and then using a process within Octopus to trigger the batch on each machine and in that way I could avoid human error, have a centralized tool that I have some experience with in the past.
While I believe Octopus solves the issue I'm working on I'm curious of any other ideas for how I could approach this problem. Any and all suggestions / criticism about my current solutions are appreciated.
https://redd.it/f08fre
@r_devops
reddit
Deploying using a batch to multiple machines, what tools will help me?
So right now I'm working with a legacy system, I know a big surprise, and our system is distributed across multiple machines that are identical....
Rundeck To jenkins migration.
Can anyone help me..,,
My all existing jobs are running on run-deck. Right now i want to run everything from Jenkins Can anyone help me how to migrate the jobs from Rundeck to Jenkins.
https://redd.it/f068i0
@r_devops
Can anyone help me..,,
My all existing jobs are running on run-deck. Right now i want to run everything from Jenkins Can anyone help me how to migrate the jobs from Rundeck to Jenkins.
https://redd.it/f068i0
@r_devops
reddit
Rundeck To jenkins migration.
Can anyone help me..,, My all existing jobs are running on run-deck. Right now i want to run everything from Jenkins Can anyone help me how to...
CI/CD configuration management
Hi,
How do you guys solving the configration release and application release issue when the application haveto be restarted multiple times but the pipeline is the same for all environment?
I mean if config changes apps restarts
If app changes a restart required aswell.
which means when you reach the point on the last deployment prod the app will restart twice...
https://redd.it/f0ic21
@r_devops
Hi,
How do you guys solving the configration release and application release issue when the application haveto be restarted multiple times but the pipeline is the same for all environment?
I mean if config changes apps restarts
If app changes a restart required aswell.
which means when you reach the point on the last deployment prod the app will restart twice...
https://redd.it/f0ic21
@r_devops
reddit
CI/CD configuration management
Hi, How do you guys solving the configration release and application release issue when the application haveto be restarted multiple times but...
Finally...
Been 5 years in a multinational in an ops capacity. Rotting, professionally and mentally. No time to change any of the legacy bullshit procedures. Spending more time in meetings with overenthusiastic PMs trying to justify their existence than doing actual work. I'm sure many of you have been there.
A semi-surprise org change just pushed me to a managed services team that wants me to get their stuff ready for CI/CD. I finally have the autonomy to flex my python and automate the fuck out of all those stupid manual tasks that have been annoying me for years. I'm excited to go to work again.
https://redd.it/f0g1tq
@r_devops
Been 5 years in a multinational in an ops capacity. Rotting, professionally and mentally. No time to change any of the legacy bullshit procedures. Spending more time in meetings with overenthusiastic PMs trying to justify their existence than doing actual work. I'm sure many of you have been there.
A semi-surprise org change just pushed me to a managed services team that wants me to get their stuff ready for CI/CD. I finally have the autonomy to flex my python and automate the fuck out of all those stupid manual tasks that have been annoying me for years. I'm excited to go to work again.
https://redd.it/f0g1tq
@r_devops
reddit
Finally...
Been 5 years in a multinational in an ops capacity. Rotting, professionally and mentally. No time to change any of the legacy bullshit procedures....
Strategies for deploying multiple application versions in a DR scenario
Hey all,
Been stumped thinking about this recently. In my situation, we have an application that needs to have multiple versions deployed side-by-side.
Via a branching strategy, we create a long-living branch off of master for each version release. Along with that is a infrastructure-as-code file to create the services needed. (In this case, it is a Azure ARM template, but you could plug anything in here).
Now where I get confused is in thinking about a Disaster Recovery scenario. There's no one branch I can depend on to deploy all my application versions again. I would have to go through each version branch to redeploy everything.
In my opinion, that seems pretty ugly. But I am not sure of any better strategies. It is almost like I want the master branch to know about all the versions, so its ARM template can deploy everything needed.
I'm really interested to hear what others have done to solve this (if it needs solving).
Thanks!
https://redd.it/f0fmq1
@r_devops
Hey all,
Been stumped thinking about this recently. In my situation, we have an application that needs to have multiple versions deployed side-by-side.
Via a branching strategy, we create a long-living branch off of master for each version release. Along with that is a infrastructure-as-code file to create the services needed. (In this case, it is a Azure ARM template, but you could plug anything in here).
Now where I get confused is in thinking about a Disaster Recovery scenario. There's no one branch I can depend on to deploy all my application versions again. I would have to go through each version branch to redeploy everything.
In my opinion, that seems pretty ugly. But I am not sure of any better strategies. It is almost like I want the master branch to know about all the versions, so its ARM template can deploy everything needed.
I'm really interested to hear what others have done to solve this (if it needs solving).
Thanks!
https://redd.it/f0fmq1
@r_devops
reddit
Strategies for deploying multiple application versions in a DR...
Hey all, Been stumped thinking about this recently. In my situation, we have an application that needs to have multiple versions deployed...
IT Help Desk -> Junior DevOps / Entry level Cloud roles?
Help Desk to Junior DevOps?
I graduated with a Bachelors Degree in Computer Information Systems and spent the past 3 years in IT Support / Help Desk roles. I gained a great bit of knowledge and experience working in those roles as an intern (at a Fortune 500, at a Wealth/Finanace Company, and at a MSP).
I was lucky enough to accept a great job out of college doing IT & Software Support. About 5 months in, I realize that my heart really isn't in doing Tier 1 type Help Desk stuff (resetting passwords, program installs, recovering emails). I am starting to work with the software support team and realize all of these guys have a lot of coding knowledge in work in DevOps type roles. I figured I worked too hard in college and spent most of that time busting my butt interning to just be complacent with a job doing low level work. I am thankful for where I ended up... but I want to continue learning and climbing the ladder rather than be complacent.
My goal was to start studying for the AWS Certified Solutions Architect - Associate certification. After that, I wanted to grab a better understanding and study up on Linux (I have minor knowledge in Linux atm). After I got those 2 down - I wanted to dedicate my time learning Python and automation.
Is this a good learning track towards a Junior role? Has anyone moved out of a Help Desk role into a Junior DevOps role?
All suggestions help!! Thanks!
Resume: https://m.imgur.com/gallery/u51h9wa
https://redd.it/f04fxj
@r_devops
Help Desk to Junior DevOps?
I graduated with a Bachelors Degree in Computer Information Systems and spent the past 3 years in IT Support / Help Desk roles. I gained a great bit of knowledge and experience working in those roles as an intern (at a Fortune 500, at a Wealth/Finanace Company, and at a MSP).
I was lucky enough to accept a great job out of college doing IT & Software Support. About 5 months in, I realize that my heart really isn't in doing Tier 1 type Help Desk stuff (resetting passwords, program installs, recovering emails). I am starting to work with the software support team and realize all of these guys have a lot of coding knowledge in work in DevOps type roles. I figured I worked too hard in college and spent most of that time busting my butt interning to just be complacent with a job doing low level work. I am thankful for where I ended up... but I want to continue learning and climbing the ladder rather than be complacent.
My goal was to start studying for the AWS Certified Solutions Architect - Associate certification. After that, I wanted to grab a better understanding and study up on Linux (I have minor knowledge in Linux atm). After I got those 2 down - I wanted to dedicate my time learning Python and automation.
Is this a good learning track towards a Junior role? Has anyone moved out of a Help Desk role into a Junior DevOps role?
All suggestions help!! Thanks!
Resume: https://m.imgur.com/gallery/u51h9wa
https://redd.it/f04fxj
@r_devops
Imgur
Resumeee
Post with 6 votes and 205 views. Shared by calchf. Resumeee
What We’ve Learned from Processing the First 150,000 Production Incidents: Alert Pressure Patterns (Part 1)
[https://blog.amixr.io/what-weve-learned-once-processed-first-150000-production-incidents/](https://blog.amixr.io/what-weve-learned-once-processed-first-150000-production-incidents/)
https://redd.it/f04dpn
@r_devops
[https://blog.amixr.io/what-weve-learned-once-processed-first-150000-production-incidents/](https://blog.amixr.io/what-weve-learned-once-processed-first-150000-production-incidents/)
https://redd.it/f04dpn
@r_devops
What to tackle first
I know this is a pretty generic question but if you were to start in an environment with no devops practices, what would you start with? CI/CD, configuration management, etc?
https://redd.it/f0xto1
@r_devops
I know this is a pretty generic question but if you were to start in an environment with no devops practices, what would you start with? CI/CD, configuration management, etc?
https://redd.it/f0xto1
@r_devops
reddit
What to tackle first
I know this is a pretty generic question but if you were to start in an environment with no devops practices, what would you start with? CI/CD,...
Validating Helm Chart Values with JSON Schemas
I found out that Helm 3 added support for validation via JSON schemas and wrote a blog post about it. I think it's useful to put this into the CI pipeline and make sure required values are set and have the right type.
https://www.arthurkoziel.com/validate-helm-chart-values-with-json-schemas/
https://redd.it/f0ocum
@r_devops
I found out that Helm 3 added support for validation via JSON schemas and wrote a blog post about it. I think it's useful to put this into the CI pipeline and make sure required values are set and have the right type.
https://www.arthurkoziel.com/validate-helm-chart-values-with-json-schemas/
https://redd.it/f0ocum
@r_devops
Arthurkoziel
Validating Helm Chart Values with JSON Schemas
Senior DevOps salary in USA
Let's say that from rumors I know that senior Java developer receives 300K annually on average from top IT companies, like Google, Amazon, etc. What about DevOps? Glassdoor shows 150K is the highest. I don't believe it.
https://redd.it/f143rz
@r_devops
Let's say that from rumors I know that senior Java developer receives 300K annually on average from top IT companies, like Google, Amazon, etc. What about DevOps? Glassdoor shows 150K is the highest. I don't believe it.
https://redd.it/f143rz
@r_devops
reddit
Senior DevOps salary in USA
Let's say that from rumors I know that senior Java developer receives 300K annually on average from top IT companies, like Google, Amazon, etc....
I’m terrible at Python
I’m a six year devops professional with AWS certs. I’m excellent with most popular devops tool sets and methodology. Problem is that I stink at python and programming in general. I can edit existing python scripts and have a general sense of what python is all about. However I always seem to take the long complicated route when solving problems. I work a lot in AWS and mastering boto3 is a must. Any tips advice or links to help me out? I do have a acloud guru subscription.
https://redd.it/f1c75t
@r_devops
I’m a six year devops professional with AWS certs. I’m excellent with most popular devops tool sets and methodology. Problem is that I stink at python and programming in general. I can edit existing python scripts and have a general sense of what python is all about. However I always seem to take the long complicated route when solving problems. I work a lot in AWS and mastering boto3 is a must. Any tips advice or links to help me out? I do have a acloud guru subscription.
https://redd.it/f1c75t
@r_devops
reddit
I’m terrible at Python
I’m a six year devops professional with AWS certs. I’m excellent with most popular devops tool sets and methodology. Problem is that I stink at...
Bosun - Kibana Automatic Index Pattern Discovery and Other Curating Tasks
I create a light tool to automatically create Index Pattern and I am planning to add more curating tasks that have to be done manually in Kibana. you should run it in a container beside Kibana and forget about it.
[https://github.com/sherifabdlnaby/bosun](https://github.com/sherifabdlnaby/bosun)
https://redd.it/f1p7e6
@r_devops
I create a light tool to automatically create Index Pattern and I am planning to add more curating tasks that have to be done manually in Kibana. you should run it in a container beside Kibana and forget about it.
[https://github.com/sherifabdlnaby/bosun](https://github.com/sherifabdlnaby/bosun)
https://redd.it/f1p7e6
@r_devops
GitHub
sherifabdlnaby/bosun
Kibana Automatic Index Pattern Discovery and Other Curating Tasks - sherifabdlnaby/bosun
Cherre Series A Funding Round Announcement!
[https://blog.cherre.com/2020/02/06/real-estate-data-and-analytics-platform-cherre-raises-16m-for-further-expansion-in-round-led-by-intel-capital/](https://blog.cherre.com/2020/02/06/real-estate-data-and-analytics-platform-cherre-raises-16m-for-further-expansion-in-round-led-by-intel-capital/)
We are looking to put those funds towards growing our team so if you're interested joining, please reach out and apply at [**cherre.com/careers**](https://cherre.com/careers)!
https://redd.it/f1sqn7
@r_devops
[https://blog.cherre.com/2020/02/06/real-estate-data-and-analytics-platform-cherre-raises-16m-for-further-expansion-in-round-led-by-intel-capital/](https://blog.cherre.com/2020/02/06/real-estate-data-and-analytics-platform-cherre-raises-16m-for-further-expansion-in-round-led-by-intel-capital/)
We are looking to put those funds towards growing our team so if you're interested joining, please reach out and apply at [**cherre.com/careers**](https://cherre.com/careers)!
https://redd.it/f1sqn7
@r_devops
Serverless Framework with Terraform: A firsthand experience
Hey all - [thought I'd share some learnings and experiences](https://medium.com/@joel.tbarna/serverless-framework-with-terraform-a-firsthand-experience-ce127db3ac5b) we've had getting the Serverless Framework and Terraform to work in sync. Was quite a journey and hope this helps anyone else trying to get started with a serverless application.
Let me know if you have any questions! Happy to help where I can.
https://redd.it/f1v3w3
@r_devops
Hey all - [thought I'd share some learnings and experiences](https://medium.com/@joel.tbarna/serverless-framework-with-terraform-a-firsthand-experience-ce127db3ac5b) we've had getting the Serverless Framework and Terraform to work in sync. Was quite a journey and hope this helps anyone else trying to get started with a serverless application.
Let me know if you have any questions! Happy to help where I can.
https://redd.it/f1v3w3
@r_devops
Medium
Serverless Framework with Terraform: a firsthand experience
Here at Stavvy, we are using a Serverless approach to building our SaaS product along with the Serverless Framework and Terraform to…
How to find pods for which cpu and memory limits were not set
What is the best way to find all pods of Kubernetes cluster which have no cpu and memory limits?
The search should be automated. Additional functionality may be required in future (e.g. find pods and send notification email)
I'm considering writing a new Operator for this/using Prometheus metrics to get such pods/writing Client Library (https://kubernetes.io/docs/reference/using-api/client-libraries/)
Any ideas?
https://redd.it/f1rbzw
@r_devops
What is the best way to find all pods of Kubernetes cluster which have no cpu and memory limits?
The search should be automated. Additional functionality may be required in future (e.g. find pods and send notification email)
I'm considering writing a new Operator for this/using Prometheus metrics to get such pods/writing Client Library (https://kubernetes.io/docs/reference/using-api/client-libraries/)
Any ideas?
https://redd.it/f1rbzw
@r_devops
Kubernetes
Client Libraries
This page contains an overview of the client libraries for using the Kubernetes API from various programming languages.
To write applications using the Kubernetes REST API, you do not need to implement the API calls and request/response types yourself. You…
To write applications using the Kubernetes REST API, you do not need to implement the API calls and request/response types yourself. You…
Detect/Alert When a Request is taking long to process in Passenger+Nginx+Rails Configuration
I have a non Enterprise Passenger with Nginx set up for Rails.
I am wondering if there is any way to detect if a request is taking xyz
seconds. The challenge here is to detect/alert while the request is being processed, i.e. before getting the response.
The reason for the above scenario is because I want to know when a specific request is exceeding the obvious/expected time in which it should have got executed. Maybe it's stuck somewhere and requires manual intervention. Maybe there is no way that I would be receiving the response and I should look into it. (I am taking the extreme case here). But the process can't be killed directly unless the other requests are processed completely. Thus, an alert would be more than enough to help me out in this scenario.
Found few references such as :
* [https://www.phusionpassenger.com/library/indepth/hooks.html#max\_request\_time\_reached](https://www.phusionpassenger.com/library/indepth/hooks.html#max_request_time_reached) but that's more like giving passenger the responsibility to kill the process. It's not feasible in my case here since there must be other requests which must be on-going.
[https://blog.appoptics.com/monitoring-rails-get-hidden-metrics-rails-app/](https://blog.appoptics.com/monitoring-rails-get-hidden-metrics-rails-app/) But this is more like relying on rails to do the job. And it's not while the request is on-going
.
Rails Version : 4.1.15
Any leads would be appreciated! TIA
https://redd.it/f1tqdj
@r_devops
I have a non Enterprise Passenger with Nginx set up for Rails.
I am wondering if there is any way to detect if a request is taking xyz
seconds. The challenge here is to detect/alert while the request is being processed, i.e. before getting the response.
The reason for the above scenario is because I want to know when a specific request is exceeding the obvious/expected time in which it should have got executed. Maybe it's stuck somewhere and requires manual intervention. Maybe there is no way that I would be receiving the response and I should look into it. (I am taking the extreme case here). But the process can't be killed directly unless the other requests are processed completely. Thus, an alert would be more than enough to help me out in this scenario.
Found few references such as :
* [https://www.phusionpassenger.com/library/indepth/hooks.html#max\_request\_time\_reached](https://www.phusionpassenger.com/library/indepth/hooks.html#max_request_time_reached) but that's more like giving passenger the responsibility to kill the process. It's not feasible in my case here since there must be other requests which must be on-going.
[https://blog.appoptics.com/monitoring-rails-get-hidden-metrics-rails-app/](https://blog.appoptics.com/monitoring-rails-get-hidden-metrics-rails-app/) But this is more like relying on rails to do the job. And it's not while the request is on-going
.
Rails Version : 4.1.15
Any leads would be appreciated! TIA
https://redd.it/f1tqdj
@r_devops
AppOptics Blog
Monitoring Rails: Get the Hidden Metrics Out of Your Rails App - AppOptics
We've put a lot of effort into instrumenting these applications so that we can keep a close watch on all aspects of their performance
where to begin to get DevOps engineer job?
i have some startup experience and experience with ccTLD DNS domain servers, some Python/bash experience..am going to jr college for Python, awk, and sed. I made a resume for this too.. Ive seen people on /r/devops claim to get in with no experience claiming their employer just said for them to get a Puppet book or "Phoenix Project". So I'm definitely a "somebody" at this and tech although when they say you need 3-5 years prior experience at a DevOps role they're not joking like literally they'll hang up on you at phone screen, despite seeing average joes make it here lol. I have CFEngine on my resume as experience and want to learn CFEngine so I can say I used it at CityDrinker as a "systems engineer" and get a job. I'm in the Bay Area. What do I do as far as labs how do I organize this? I had LinuxAcademy but it was going to waste I'd never use it nor do I use my "Python for DevOps" book simply because I don't know what to do. There's room in my head for being knowledgable ideally knowing ins and outs of CFEngine and maybe acloud.guru (prefer free though) can be a way for me to get a job? I have AWS free tier tied to my gmail.
I'll check out the docs page for CFEngine today it is hard to get me going I take a big nootropics stack and atomoxetine but it works and makes me obedient to DevOps I want the way of DevOps and only the way. I'll look into Kubernetes too.
https://redd.it/f1strw
@r_devops
i have some startup experience and experience with ccTLD DNS domain servers, some Python/bash experience..am going to jr college for Python, awk, and sed. I made a resume for this too.. Ive seen people on /r/devops claim to get in with no experience claiming their employer just said for them to get a Puppet book or "Phoenix Project". So I'm definitely a "somebody" at this and tech although when they say you need 3-5 years prior experience at a DevOps role they're not joking like literally they'll hang up on you at phone screen, despite seeing average joes make it here lol. I have CFEngine on my resume as experience and want to learn CFEngine so I can say I used it at CityDrinker as a "systems engineer" and get a job. I'm in the Bay Area. What do I do as far as labs how do I organize this? I had LinuxAcademy but it was going to waste I'd never use it nor do I use my "Python for DevOps" book simply because I don't know what to do. There's room in my head for being knowledgable ideally knowing ins and outs of CFEngine and maybe acloud.guru (prefer free though) can be a way for me to get a job? I have AWS free tier tied to my gmail.
I'll check out the docs page for CFEngine today it is hard to get me going I take a big nootropics stack and atomoxetine but it works and makes me obedient to DevOps I want the way of DevOps and only the way. I'll look into Kubernetes too.
https://redd.it/f1strw
@r_devops
reddit
where to begin to get DevOps engineer job?
i have some startup experience and experience with ccTLD DNS domain servers, some Python/bash experience..am going to jr college for Python, awk,...