Does your company use a geolocation service?
We are looking to evaluate geolocation services to replace a legacy hosted third party service and was wondering what others may have experience with.
https://redd.it/ej8jwd
@r_devops
We are looking to evaluate geolocation services to replace a legacy hosted third party service and was wondering what others may have experience with.
https://redd.it/ej8jwd
@r_devops
reddit
Does your company use a geolocation service?
We are looking to evaluate geolocation services to replace a legacy hosted third party service and was wondering what others may have experience with.
Issue with spinnaker and automated trigger
I am trying to get Spinnaker to have a pipeline use an automated trigger which is an image pushed to an ECR repo. I can add different repos fine but can't seem to see the images. I am following this guide and below is the example code I followed plus a second variation I tried.
​
ADDRESS=123456789123.dkr.ecr.us-west-2.amazonaws.com
REGION=us-west-2
hal config provider docker-registry account add my-ecr-registry \
--address $ADDRESS \
--username AWS \
--password-command "aws --region $REGION ecr get-authorization-token --output text --query 'authorizationData[].authorizationToken' | base64 -d | sed 's/^AWS://'"
hal deploy apply
Variation I tried
ADDRESS=123456789123.dkr.ecr.us-west-2.amazonaws.com/api
​
Currently I can see the repo in registry name then I load the image section and nothing shows up. I have checked many times and I do have images in the repo - I've even deployed them to my kubernetes cluster and tested they work when building my helm charts.
​
What am I missing or can I try?
https://redd.it/ej7wj1
@r_devops
I am trying to get Spinnaker to have a pipeline use an automated trigger which is an image pushed to an ECR repo. I can add different repos fine but can't seem to see the images. I am following this guide and below is the example code I followed plus a second variation I tried.
​
ADDRESS=123456789123.dkr.ecr.us-west-2.amazonaws.com
REGION=us-west-2
hal config provider docker-registry account add my-ecr-registry \
--address $ADDRESS \
--username AWS \
--password-command "aws --region $REGION ecr get-authorization-token --output text --query 'authorizationData[].authorizationToken' | base64 -d | sed 's/^AWS://'"
hal deploy apply
Variation I tried
ADDRESS=123456789123.dkr.ecr.us-west-2.amazonaws.com/api
​
Currently I can see the repo in registry name then I load the image section and nothing shows up. I have checked many times and I do have images in the repo - I've even deployed them to my kubernetes cluster and tested they work when building my helm charts.
​
What am I missing or can I try?
https://redd.it/ej7wj1
@r_devops
Tools for Server Monitoring
Any recommendations for tools for basic server monitoring, paid or free? I'm looking for something that will show me storage capacity remaining, memory utilization, CPU utilization, server up/down. Ideally I can monitor multiple servers, and have alerts for when thresholds are crossed, like storage capacity at 95%.
https://redd.it/ej7b1f
@r_devops
Any recommendations for tools for basic server monitoring, paid or free? I'm looking for something that will show me storage capacity remaining, memory utilization, CPU utilization, server up/down. Ideally I can monitor multiple servers, and have alerts for when thresholds are crossed, like storage capacity at 95%.
https://redd.it/ej7b1f
@r_devops
reddit
Tools for Server Monitoring
Any recommendations for tools for basic server monitoring, paid or free? I'm looking for something that will show me storage capacity remaining,...
A php based newsletter tool that supports template emails, dynamically inserted data, send rate limits and campaigns?
Good day everyone.
I'm looking for possible solutions / options - one time paid or free (maybe subscription based) that offers a complete tool for sending out emails with the following features:
1) Sending rate limits to accommodate for allotment quita by your SMTP server provider.
2) Creation of Email Templates
3) Creation of campaigns (Sending the same email to all your subscribers)
4) Dynamically insert content into the page like thumbnails, titles, content, links.
​
Now I don't expect all of this to be GUI based, API calls are just fine as well. I just want to see if there's something already out there before I start creating my own with PHP, Cron and mysql.
https://redd.it/ej1dfc
@r_devops
Good day everyone.
I'm looking for possible solutions / options - one time paid or free (maybe subscription based) that offers a complete tool for sending out emails with the following features:
1) Sending rate limits to accommodate for allotment quita by your SMTP server provider.
2) Creation of Email Templates
3) Creation of campaigns (Sending the same email to all your subscribers)
4) Dynamically insert content into the page like thumbnails, titles, content, links.
​
Now I don't expect all of this to be GUI based, API calls are just fine as well. I just want to see if there's something already out there before I start creating my own with PHP, Cron and mysql.
https://redd.it/ej1dfc
@r_devops
reddit
A php based newsletter tool that supports template emails,...
Good day everyone. I'm looking for possible solutions / options - one time paid or free (maybe subscription based) that offers a complete tool...
What certification looks good on a devops resume ? AWS SA professional, AWS devops or CKA
I have 2.5 years of ops experience and I'm trying to move to a devops role. I already have aws SA associate certificate and looking for the next certificate. I'm aware that certifications are only used to screen resumes by recruiters and their value is not much as it used to be. My employer is ready to pay for certification cost. Which one is worth spending the time on and which has a good value?
Thanks
https://redd.it/ej1c92
@r_devops
I have 2.5 years of ops experience and I'm trying to move to a devops role. I already have aws SA associate certificate and looking for the next certificate. I'm aware that certifications are only used to screen resumes by recruiters and their value is not much as it used to be. My employer is ready to pay for certification cost. Which one is worth spending the time on and which has a good value?
Thanks
https://redd.it/ej1c92
@r_devops
reddit
What certification looks good on a devops resume ? AWS SA...
I have 2.5 years of ops experience and I'm trying to move to a devops role. I already have aws SA associate certificate and looking for the next...
Editing Kops masters via the cli
I was wondering if it was possible to edit the number of kops masters and nodes via the cli instead of using the kops edit ig <group name> where it brings up a text editor. I'd like this so I can script scaling the cluster both for the masters and the nodes, idea is I want to cut costs on a cluster that is for dev reasons only and doesn't get used often but can't rebuild cluster because of other tooling needing to connect to the same cluster.
https://redd.it/ej010s
@r_devops
I was wondering if it was possible to edit the number of kops masters and nodes via the cli instead of using the kops edit ig <group name> where it brings up a text editor. I'd like this so I can script scaling the cluster both for the masters and the nodes, idea is I want to cut costs on a cluster that is for dev reasons only and doesn't get used often but can't rebuild cluster because of other tooling needing to connect to the same cluster.
https://redd.it/ej010s
@r_devops
reddit
Editing Kops masters via the cli
I was wondering if it was possible to edit the number of kops masters and nodes via the cli instead of using the kops edit ig <group name> where...
Best Certification Prep classes to recommend on the Company's dollar?
My company was recently acquired, and the parent company until that point had no well defined DevOps team concept. The company has since gathered the DevOps people from it's acquired companies, promoted us and solidified a Site Reliability team. Now they want to get us certifications that support our new role.
Currently, the company pays for Pluralsight, which is great for skills training, but for exam and cert prep seems very sparse.
What courses of study would you recommend for the following subjects:
* AWS Certified DevOps Engineer
* Microsoft Sysadmin
In addition to actual classes that will get us ready for certification exams, I'm interested in getting us books to do for a book club with my teammates, and adding those to the proposal. Thanks for any recommendations!
https://redd.it/eizmwt
@r_devops
My company was recently acquired, and the parent company until that point had no well defined DevOps team concept. The company has since gathered the DevOps people from it's acquired companies, promoted us and solidified a Site Reliability team. Now they want to get us certifications that support our new role.
Currently, the company pays for Pluralsight, which is great for skills training, but for exam and cert prep seems very sparse.
What courses of study would you recommend for the following subjects:
* AWS Certified DevOps Engineer
* Microsoft Sysadmin
In addition to actual classes that will get us ready for certification exams, I'm interested in getting us books to do for a book club with my teammates, and adding those to the proposal. Thanks for any recommendations!
https://redd.it/eizmwt
@r_devops
reddit
Best Certification Prep classes to recommend on the Company's dollar?
My company was recently acquired, and the parent company until that point had no well defined DevOps team concept. The company has since gathered...
Web Dashboard for Process Scheduling
Hi Everyone,
I am building a system (largely in python) that will need to start, stop, and moderate processes periodically.
​
The use case could be:
\- I have a script I want to run everyday at 12 AM
\- I have a executable I want to run constantly (so in this case should just start the executable on bootup and have the executable infinitely run)
\- I have a process I want started at 10am and terminated at 2pm.. daily
​
In the past I have used Jenkin's for task scheduling like this. I liked how you could see the progress of each build. However I've been told to not use jenkins for long running processes. I just figure there has to be something out there like this... that has Web Dashboard access.
https://redd.it/eizhkw
@r_devops
Hi Everyone,
I am building a system (largely in python) that will need to start, stop, and moderate processes periodically.
​
The use case could be:
\- I have a script I want to run everyday at 12 AM
\- I have a executable I want to run constantly (so in this case should just start the executable on bootup and have the executable infinitely run)
\- I have a process I want started at 10am and terminated at 2pm.. daily
​
In the past I have used Jenkin's for task scheduling like this. I liked how you could see the progress of each build. However I've been told to not use jenkins for long running processes. I just figure there has to be something out there like this... that has Web Dashboard access.
https://redd.it/eizhkw
@r_devops
reddit
Web Dashboard for Process Scheduling
Hi Everyone, I am building a system (largely in python) that will need to start, stop, and moderate processes periodically. The use...
DevOps Blogs + Reddit
Sadly I don't have time to read all of these. Which 3 do you recommend? Already reading AWS, CloudTech News & following most of these on Twitter.
https://redd.it/eiw9fy
@r_devops
Sadly I don't have time to read all of these. Which 3 do you recommend? Already reading AWS, CloudTech News & following most of these on Twitter.
https://redd.it/eiw9fy
@r_devops
reddit
DevOps Blogs + Reddit
Sadly I don't have time to read all of these. Which 3 do you recommend? Already reading AWS, CloudTech News & following most of these on Twitter.
Consultant and company rates difference
Hi,
I work as a devops consultant with 6 years of experience and I started thinking about the difference in my md rates vs rates of a company that does the same.
Usually the companies that have several consultants and several references charge way more than my md rate, lets say double the amount. I find it weird, as I have worked fir these companies in the past and there wasn't much of a difference in the delivered services between theirs and mine.
Still, I might be a no-name to the client even though I do have good references if my own, so I charge less.
Is there a coeficient of how much less should I as a freelancer charge in comparison to companies that do the same of the same quality and experience (basically everything the same)? Because if it is the same, why exactly should I get paid less (I don't want to sound greedy, I just don't know).
Could you please advise me?
https://redd.it/ejfi2q
@r_devops
Hi,
I work as a devops consultant with 6 years of experience and I started thinking about the difference in my md rates vs rates of a company that does the same.
Usually the companies that have several consultants and several references charge way more than my md rate, lets say double the amount. I find it weird, as I have worked fir these companies in the past and there wasn't much of a difference in the delivered services between theirs and mine.
Still, I might be a no-name to the client even though I do have good references if my own, so I charge less.
Is there a coeficient of how much less should I as a freelancer charge in comparison to companies that do the same of the same quality and experience (basically everything the same)? Because if it is the same, why exactly should I get paid less (I don't want to sound greedy, I just don't know).
Could you please advise me?
https://redd.it/ejfi2q
@r_devops
reddit
Consultant and company rates difference
Hi, I work as a devops consultant with 6 years of experience and I started thinking about the difference in my md rates vs rates of a company...
Book recommendations on Architechting for deployability
As per Nicole Forsgren and Jez Humble’s Accelerate. The biggest factor that impacts the deployability of a system (measured by how often it is deployed) Is it's architecture and I really do agree with it (reading it was line was one of those “aha!” momments as I’ve been repeating the same thing for years). Now comes the tough part, how can i learn to architect for deployability? I mean i think I know how to do it, I’ve been “doing” it, but I also feel that it may not be the best way to do it and my method is absurdly tainted by my biases. Is there any book or training or articles or case studies you would recommend to learn how to do this from other people? Like i feel Im versed on event-driven archs and kafka, but im sure there is a lot more things out there.
Thanks!
https://redd.it/ejgyqk
@r_devops
As per Nicole Forsgren and Jez Humble’s Accelerate. The biggest factor that impacts the deployability of a system (measured by how often it is deployed) Is it's architecture and I really do agree with it (reading it was line was one of those “aha!” momments as I’ve been repeating the same thing for years). Now comes the tough part, how can i learn to architect for deployability? I mean i think I know how to do it, I’ve been “doing” it, but I also feel that it may not be the best way to do it and my method is absurdly tainted by my biases. Is there any book or training or articles or case studies you would recommend to learn how to do this from other people? Like i feel Im versed on event-driven archs and kafka, but im sure there is a lot more things out there.
Thanks!
https://redd.it/ejgyqk
@r_devops
reddit
Book recommendations on Architechting for deployability
As per Nicole Forsgren and Jez Humble’s Accelerate. The biggest factor that impacts the deployability of a system (measured by how often it is...
Kubernetes Secrets vs Hashicorp Vault
I am currently working on removing secrets from code and have come across both k8s secrets and vault. Half my system is k8s. I'm having a hard time seeing what vault provides that k8s secrets cant do. Even for nodes outside of k8s could access secrets using the api and rbac right? Any insight would be helpful.
https://redd.it/ejfzhl
@r_devops
I am currently working on removing secrets from code and have come across both k8s secrets and vault. Half my system is k8s. I'm having a hard time seeing what vault provides that k8s secrets cant do. Even for nodes outside of k8s could access secrets using the api and rbac right? Any insight would be helpful.
https://redd.it/ejfzhl
@r_devops
reddit
Kubernetes Secrets vs Hashicorp Vault
I am currently working on removing secrets from code and have come across both k8s secrets and vault. Half my system is k8s. I'm having a hard...
Vault Root Account Replacement
Once I revoke the root token, I want to create a couple of accounts that have root access to all of vault.
The documentation seems to suggest creating an admin policy for this that looks like this: [https://gist.github.com/kawsark/4cdb66093d6206d9e036ecd1294e6509](https://gist.github.com/kawsark/4cdb66093d6206d9e036ecd1294e6509)
But I am wondering why not create a policy that looks like this instead?
path "*"
{
capabilities = ["create", "read", "update", "delete", "list", "sudo"]
}
This block seems to do the same (and more?) and it is less verbose than the above, also (I assume) it covers all cases. Is there any best practice against this?
https://redd.it/ejfc1w
@r_devops
Once I revoke the root token, I want to create a couple of accounts that have root access to all of vault.
The documentation seems to suggest creating an admin policy for this that looks like this: [https://gist.github.com/kawsark/4cdb66093d6206d9e036ecd1294e6509](https://gist.github.com/kawsark/4cdb66093d6206d9e036ecd1294e6509)
But I am wondering why not create a policy that looks like this instead?
path "*"
{
capabilities = ["create", "read", "update", "delete", "list", "sudo"]
}
This block seems to do the same (and more?) and it is less verbose than the above, also (I assume) it covers all cases. Is there any best practice against this?
https://redd.it/ejfc1w
@r_devops
Gist
An example Vault admin policy with capability to manage leses
An example Vault admin policy with capability to manage leses - example-vault-admin-policy.hcl
Which flow should I take during deploy of big API changes to keep the consumers in sync?
Hello
I am running a project that is in dev stage (so there are breaking changes etc.), but I met with a problem of keeping the changes in sync with UI client / consumer.
Let's say that there is 1 developer to maintain both backend API and frontend App, when this developer commits a change to develop branch then Jenkins is doing some shell magic to deploy the stuff.
So, if the developer pushes change to API, then a long process of deployments starts; Before the API deployment ends he pushes another change to UI App which deployment takes seconds and we are in a state where UI can throw random errors since the API deployment did not finish.
Even if we reverse the case, ie. the first deploy goes for UI App, the API changes are still not deployed so there still will be random errors in UI App.
While I know about things like backward compatibility and such, a big changes still may happen in the process, and this scenario is from what I can think of - the simplest. This is no rocket science microservice architecture but plain API - UI project for now.
In perfect world the API and UI deployments ends in the same time.
https://redd.it/ejds19
@r_devops
Hello
I am running a project that is in dev stage (so there are breaking changes etc.), but I met with a problem of keeping the changes in sync with UI client / consumer.
Let's say that there is 1 developer to maintain both backend API and frontend App, when this developer commits a change to develop branch then Jenkins is doing some shell magic to deploy the stuff.
So, if the developer pushes change to API, then a long process of deployments starts; Before the API deployment ends he pushes another change to UI App which deployment takes seconds and we are in a state where UI can throw random errors since the API deployment did not finish.
Even if we reverse the case, ie. the first deploy goes for UI App, the API changes are still not deployed so there still will be random errors in UI App.
While I know about things like backward compatibility and such, a big changes still may happen in the process, and this scenario is from what I can think of - the simplest. This is no rocket science microservice architecture but plain API - UI project for now.
In perfect world the API and UI deployments ends in the same time.
https://redd.it/ejds19
@r_devops
reddit
Which flow should I take during deploy of big API changes to keep...
Hello I am running a project that is in dev stage (so there are breaking changes etc.), but I met with a problem of keeping the changes in sync...
Pubsubbeat + elasticsearch creates only one index
Hi.
I've just set up pubsubbeat + elasticsearch in order to get logs from stackdriver to my private elasticsearch cluster. Everything works fine except that it's only using one index. It created an index called pubsubbeat-8.0.0-2019.12.31-000001 and it's adding all the documents inside the same index instead of creating one every day. Do you know how to force it to create an index daily? I've found the delete\_by\_time query but I would prefer to delete a whole index, looks cleaner.
Thanks
https://redd.it/ejdgfs
@r_devops
Hi.
I've just set up pubsubbeat + elasticsearch in order to get logs from stackdriver to my private elasticsearch cluster. Everything works fine except that it's only using one index. It created an index called pubsubbeat-8.0.0-2019.12.31-000001 and it's adding all the documents inside the same index instead of creating one every day. Do you know how to force it to create an index daily? I've found the delete\_by\_time query but I would prefer to delete a whole index, looks cleaner.
Thanks
https://redd.it/ejdgfs
@r_devops
reddit
Pubsubbeat + elasticsearch creates only one index
Hi. I've just set up pubsubbeat + elasticsearch in order to get logs from stackdriver to my private elasticsearch cluster. Everything works fine...
Do you use hot redeploy in production or have downtime for new release installation? Is hot redeploy actually needed for your system?
https://redd.it/ejlipp
@r_devops
https://redd.it/ejlipp
@r_devops
reddit
Do you use hot redeploy in production or have downtime for new...
Posted in r/devops by u/dmitry_murashenkov • 1 point and 0 comments
Zero to Hero guide 2020
Hi, I am a software developer with 3 years of experience and just recently had to work on a project that uses AWS.
No need to say that I was overwhelmed by all the terminologies and network configuration.
I learned about Docker and bought a very simple course on Udemy about Deploying a NodeJS application docker container to AWS EC2, but that was it... I think I need some sort of pipeline to work with that will make CD/CI easier and pain free.
What resources (books, course, YT channel) you guys recommend getting started on DevOps, especially on AWS, in 2020?
https://redd.it/ejkfm4
@r_devops
Hi, I am a software developer with 3 years of experience and just recently had to work on a project that uses AWS.
No need to say that I was overwhelmed by all the terminologies and network configuration.
I learned about Docker and bought a very simple course on Udemy about Deploying a NodeJS application docker container to AWS EC2, but that was it... I think I need some sort of pipeline to work with that will make CD/CI easier and pain free.
What resources (books, course, YT channel) you guys recommend getting started on DevOps, especially on AWS, in 2020?
https://redd.it/ejkfm4
@r_devops
reddit
Zero to Hero guide 2020
Hi, I am a software developer with 3 years of experience and just recently had to work on a project that uses AWS. No need to say that I was...
DNS SSL Apache in Docker Container
The current setup is ec2 ubuntu instance with docker container that runs my app during development and demo purposes only.
My question is how do you setup ssl cert in your server? do you set it up inside the container? or in the ec2 instance itself and you just mount it on the container?
https://redd.it/ejalr3
@r_devops
The current setup is ec2 ubuntu instance with docker container that runs my app during development and demo purposes only.
My question is how do you setup ssl cert in your server? do you set it up inside the container? or in the ec2 instance itself and you just mount it on the container?
https://redd.it/ejalr3
@r_devops
reddit
DNS SSL Apache in Docker Container
The current setup is ec2 ubuntu instance with docker container that runs my app during development and demo purposes only. My question is how do...
What do you recommend my learning path be? I’m looking to deploy Django projects in an intelligent way- currently looking at AWS EBS + Docker + git
Unfortunately I’m getting a little tired of the endless articles that don’t cover everything, and that’s nothing against them.
For someone like me, how do you recommend I proceed? “All” I want is an easy way to develop and deploy.
I’m sure that’s what everyone says though.
Whether it’s books, coursers, or whatever, I’m all ears for the practical knowledge.
I am partial to docker though, it’s been helpful for my speed in development, and it’s my understanding that it helps in deploying, right?
Thank you for your time.
https://redd.it/ejonhe
@r_devops
Unfortunately I’m getting a little tired of the endless articles that don’t cover everything, and that’s nothing against them.
For someone like me, how do you recommend I proceed? “All” I want is an easy way to develop and deploy.
I’m sure that’s what everyone says though.
Whether it’s books, coursers, or whatever, I’m all ears for the practical knowledge.
I am partial to docker though, it’s been helpful for my speed in development, and it’s my understanding that it helps in deploying, right?
Thank you for your time.
https://redd.it/ejonhe
@r_devops
reddit
What do you recommend my learning path be? I’m looking to deploy...
Unfortunately I’m getting a little tired of the endless articles that don’t cover everything, and that’s nothing against them. For someone like...
How many environments do you use per project?
At my workplace, most teams have 4+ envs (e.g. dev, qa, uat, staging, prod).
I'm curious if many other teams do it this way or if the norm is to keep things simpler with just staging and prod?
https://redd.it/ejmat1
@r_devops
At my workplace, most teams have 4+ envs (e.g. dev, qa, uat, staging, prod).
I'm curious if many other teams do it this way or if the norm is to keep things simpler with just staging and prod?
https://redd.it/ejmat1
@r_devops
reddit
How many environments do you use per project?
At my workplace, most teams have 4+ envs (e.g. dev, qa, uat, staging, prod). I'm curious if many other teams do it this way or if the norm is to...