Looking for an alternative to EC2Box (multiple SSH terminals for EC2 via web)
Basically looking for a tool I can run in a container on our dev server and access via browser to open multiple SSH terminals connected to EC2 instances. Simple, fast and modern. We've been using EC2Box for too long (and it still works I guess), and I'm sure there are better alternatives right now that are currently maintained.
I've looked at some candidates like Boundary but I'm not sure those are simple enough, maybe there are simpler tools out there?
https://redd.it/oazd1d
@r_devops
Basically looking for a tool I can run in a container on our dev server and access via browser to open multiple SSH terminals connected to EC2 instances. Simple, fast and modern. We've been using EC2Box for too long (and it still works I guess), and I'm sure there are better alternatives right now that are currently maintained.
I've looked at some candidates like Boundary but I'm not sure those are simple enough, maybe there are simpler tools out there?
https://redd.it/oazd1d
@r_devops
reddit
Looking for an alternative to EC2Box (multiple SSH terminals for...
Basically looking for a tool I can run in a container on our dev server and access via browser to open multiple SSH terminals connected to EC2...
Integrate Rundeck with Github
Is there a way to integrate Github with Rundeck where when a job runs, the 1st step, it will goto github and download the latest version of a script and run the latest version?
https://redd.it/ob06jj
@r_devops
Is there a way to integrate Github with Rundeck where when a job runs, the 1st step, it will goto github and download the latest version of a script and run the latest version?
https://redd.it/ob06jj
@r_devops
reddit
Integrate Rundeck with Github
Is there a way to integrate Github with Rundeck where when a job runs, the 1st step, it will goto github and download the latest version of a...
How to set how much time a kubernetes pod is replicated when a node goes down? Five minutes is too slow
I have a cluster and when a node goes down it require 5 minutes to replicate the pod on another node. I would like to have that this will happen in few seconds. Where can I set this? Thank you
https://redd.it/oaxykw
@r_devops
I have a cluster and when a node goes down it require 5 minutes to replicate the pod on another node. I would like to have that this will happen in few seconds. Where can I set this? Thank you
https://redd.it/oaxykw
@r_devops
reddit
How to set how much time a kubernetes pod is replicated when a...
I have a cluster and when a node goes down it require 5 minutes to replicate the pod on another node. I would like to have that this will happen...
What are your thoughts on Portainer.io
The GUI looks interesting.
Still testing some of the features though.
What do you guys think?
https://redd.it/ob0wic
@r_devops
The GUI looks interesting.
Still testing some of the features though.
What do you guys think?
https://redd.it/ob0wic
@r_devops
reddit
What are your thoughts on Portainer.io
The GUI looks interesting. Still testing some of the features though. What do you guys think?
Rest api and apigee
Hi guys my new company wants me to learn rest api and apigee
My role there is a devops engineer
The new fancy term they call for build and release engineer / ops engineer
What should I know about rest api and apigee w.r.t to devops
I already know what is that just want to know where it will be used in our role
https://redd.it/ob4565
@r_devops
Hi guys my new company wants me to learn rest api and apigee
My role there is a devops engineer
The new fancy term they call for build and release engineer / ops engineer
What should I know about rest api and apigee w.r.t to devops
I already know what is that just want to know where it will be used in our role
https://redd.it/ob4565
@r_devops
reddit
Rest api and apigee
Hi guys my new company wants me to learn rest api and apigee My role there is a devops engineer The new fancy term they call for build and...
List AD users as a drop down menu option in Rundeck
Is there a way in a Rundeck job to list a dynamic and updated list of all Active Directory users (in a specific OU) so the user can select a valid user?
https://redd.it/ob40ns
@r_devops
Is there a way in a Rundeck job to list a dynamic and updated list of all Active Directory users (in a specific OU) so the user can select a valid user?
https://redd.it/ob40ns
@r_devops
reddit
r/devops - List AD users as a drop down menu option in Rundeck
0 votes and 0 comments so far on Reddit
Can someone pls explain like i'm 5 what the fuck hashicorp terraform is?
I'm about to graduate with a degree in information systems and feel fucking clueless.
Why is hashicorp so hot? I'm talking about terraform mostly. Like ... why don't the public cloud vendors have software to provision themselves? Why do you need something like this? And what the fuck actually IS terraform provisioning?
And I've seen this a number of times but still don't totally get it ... why do you need terraform and ansible?
Is terraform the reason that everyone is always raving about hashicorp, or is there some other thing? I understand vault is big and that makes sense to me from a tech perspective. So maybe it's just those two.
I don't want to derail this subreddit into idiocy for too long, but I have a hunch that a TON of people that are either newcomers or only dabble in DevOps will benefit from having this explained in 5yo terms.
Thanks so much!
https://redd.it/ob47kx
@r_devops
I'm about to graduate with a degree in information systems and feel fucking clueless.
Why is hashicorp so hot? I'm talking about terraform mostly. Like ... why don't the public cloud vendors have software to provision themselves? Why do you need something like this? And what the fuck actually IS terraform provisioning?
And I've seen this a number of times but still don't totally get it ... why do you need terraform and ansible?
Is terraform the reason that everyone is always raving about hashicorp, or is there some other thing? I understand vault is big and that makes sense to me from a tech perspective. So maybe it's just those two.
I don't want to derail this subreddit into idiocy for too long, but I have a hunch that a TON of people that are either newcomers or only dabble in DevOps will benefit from having this explained in 5yo terms.
Thanks so much!
https://redd.it/ob47kx
@r_devops
reddit
r/devops - Can someone pls explain like i'm 5 what the fuck hashicorp terraform is?
0 votes and 8 comments so far on Reddit
What is the best way to become an “expert” in systemd?
I’m sorry if this question is a bit sparse on details, but I started a new devops job recently and was told that it would be great if I could master systemd, as we only have one person who has expertise in it.
I’m currently going through the systemd docs right now but am a bit vexed on how to gauge grasp / mastery of systemd.
Thanks for your thoughts and comments!
https://redd.it/ob869j
@r_devops
I’m sorry if this question is a bit sparse on details, but I started a new devops job recently and was told that it would be great if I could master systemd, as we only have one person who has expertise in it.
I’m currently going through the systemd docs right now but am a bit vexed on how to gauge grasp / mastery of systemd.
Thanks for your thoughts and comments!
https://redd.it/ob869j
@r_devops
reddit
r/devops - What is the best way to become an “expert” in systemd?
0 votes and 0 comments so far on Reddit
Devops vs DevOpsSecs
What does DevOpsSecs discipline have over traditional(loosely termed) DevOps? Is it knowledge of DevOps culture + tools with a focus on security? I'm curious to know what the professionals in either organization have to say. Thank you all in advance
https://redd.it/ob7p01
@r_devops
What does DevOpsSecs discipline have over traditional(loosely termed) DevOps? Is it knowledge of DevOps culture + tools with a focus on security? I'm curious to know what the professionals in either organization have to say. Thank you all in advance
https://redd.it/ob7p01
@r_devops
reddit
Devops vs DevOpsSecs
What does DevOpsSecs discipline have over traditional(loosely termed) DevOps? Is it knowledge of DevOps culture + tools with a focus on security?...
Closing CFP DataOps Summit 2021 closing today (6/30)
If you are interested in showcasing your leadership in the DataOps space. See more info here. https://www.dataopssummit-sf.com/about
https://redd.it/ob7iid
@r_devops
If you are interested in showcasing your leadership in the DataOps space. See more info here. https://www.dataopssummit-sf.com/about
https://redd.it/ob7iid
@r_devops
DataOps Summit
About - DataOps Summit
DataOps Summit 2021 | September 28 – 30 | Virtual Please join us, Data Rock Star! Data: a concise word for a tremendous amount of information. Once, it was manageable. […]
Looking for API feedback on a TypeScript DSL for dynamic CI config
As I've spent more time on my team's CI pipeline and investigating various CI providers (we've had a lot of trouble with Circle and I'd like to get away from them if possible), I've noticed that most providers/platforms now support dynamically generating the CI pipeline config at the start of the job. It's a [recent addition to Circle](https://circleci.com/blog/introducing-dynamic-config-via-setup-workflows/), but others, like GitLab, have supported it for longer. In Buildkite, it's almost mandatory, since your initial CI config has to be set in the UI -- if you want a pipeline, even a static one, checked into your repo, you have to create a minimal bootstrap config in the UI that clones your repo and manually selects the pipeline file to run.
I see good reasons for this -- YAML + bash isn't the most elegant or expressive combo for big, complex pipelines. I've thought about writing some tooling before, but I didn't like the idea of having to install my preferred scripting language onto every CI node to run scripts. The dynamic config feature has given me a new idea, though: a TypeScript DSL for **generating** pipeline configurations.
The idea is that you'd run a TS script as your CI-generation job, the output of which would be a pipeline config for your platform of choice. Because there's a lot of overlap in the functionality of different CI systems, I think it should be possible to define jobs and steps in a mostly-platform-independent way, then "compile" them to the platform representation. I don't expect to be able to migrate CI providers just by swapping output targets -- I'm sure every project has platform-specific details to work out -- but I do think it could make migration *easier* and reduce lock-in.
[This is an example](https://gist.github.com/davidwallacejackson/a5e4f02115b23d06c7588e9d5ed7535a) of what pipeline definitions look like in the API as I've implemented it so far -- the working library name is `build-gen`. I'm not married to any of the design decisions, of course, or even to actually using this thing. It feels like a good direction to me, but this is why I'm looking for feedback -- I'm wondering if there are good reasons people haven't done things like this before -- or, maybe they have and I haven't found them, or maybe there are just better tools to solve these problems.
And a few stray thoughts on my reasoning:
* Most CI platforms have some abstractions built in for conditional execution, "defined steps" and matrix running -- to me, this seems like a signal that most people will eventually want traditional programming constructs like \`if\`, functions, and loops in their CI pipeline, as it grows.
* I chose TypeScript because it's my favorite language to write in, but this tool or one like it could of course be written in any language. I was actually working on this before the Circle blog post I linked above was released, but I note that they express interest in a TypeScript-based config tool as a possible future development, which feels encouraging.
* Type-checking and documentation comments (in TS or any other "full" programming language) offer some nice ergonomic benefits that apply just as well to CI as they do to anything else.
Anyway! Thank you for reading all of that. Would you use this thing? Does it look interesting to you? How are you handling templating and dynamic configuration in your CI systems right now? Any insight would be very welcome.
https://redd.it/oaqs9r
@r_devops
As I've spent more time on my team's CI pipeline and investigating various CI providers (we've had a lot of trouble with Circle and I'd like to get away from them if possible), I've noticed that most providers/platforms now support dynamically generating the CI pipeline config at the start of the job. It's a [recent addition to Circle](https://circleci.com/blog/introducing-dynamic-config-via-setup-workflows/), but others, like GitLab, have supported it for longer. In Buildkite, it's almost mandatory, since your initial CI config has to be set in the UI -- if you want a pipeline, even a static one, checked into your repo, you have to create a minimal bootstrap config in the UI that clones your repo and manually selects the pipeline file to run.
I see good reasons for this -- YAML + bash isn't the most elegant or expressive combo for big, complex pipelines. I've thought about writing some tooling before, but I didn't like the idea of having to install my preferred scripting language onto every CI node to run scripts. The dynamic config feature has given me a new idea, though: a TypeScript DSL for **generating** pipeline configurations.
The idea is that you'd run a TS script as your CI-generation job, the output of which would be a pipeline config for your platform of choice. Because there's a lot of overlap in the functionality of different CI systems, I think it should be possible to define jobs and steps in a mostly-platform-independent way, then "compile" them to the platform representation. I don't expect to be able to migrate CI providers just by swapping output targets -- I'm sure every project has platform-specific details to work out -- but I do think it could make migration *easier* and reduce lock-in.
[This is an example](https://gist.github.com/davidwallacejackson/a5e4f02115b23d06c7588e9d5ed7535a) of what pipeline definitions look like in the API as I've implemented it so far -- the working library name is `build-gen`. I'm not married to any of the design decisions, of course, or even to actually using this thing. It feels like a good direction to me, but this is why I'm looking for feedback -- I'm wondering if there are good reasons people haven't done things like this before -- or, maybe they have and I haven't found them, or maybe there are just better tools to solve these problems.
And a few stray thoughts on my reasoning:
* Most CI platforms have some abstractions built in for conditional execution, "defined steps" and matrix running -- to me, this seems like a signal that most people will eventually want traditional programming constructs like \`if\`, functions, and loops in their CI pipeline, as it grows.
* I chose TypeScript because it's my favorite language to write in, but this tool or one like it could of course be written in any language. I was actually working on this before the Circle blog post I linked above was released, but I note that they express interest in a TypeScript-based config tool as a possible future development, which feels encouraging.
* Type-checking and documentation comments (in TS or any other "full" programming language) offer some nice ergonomic benefits that apply just as well to CI as they do to anything else.
Anyway! Thank you for reading all of that. Would you use this thing? Does it look interesting to you? How are you handling templating and dynamic configuration in your CI systems right now? Any insight would be very welcome.
https://redd.it/oaqs9r
@r_devops
CircleCI
Introducing dynamic config via setup workflows
With the new release of dynamic config via setup workflows, CircleCI customers can now duse jobs and workflows, not only to execute work but to determine the work they want to run.
Did you take do250 course? Do you advise it?
Hi
Do you advise this course?
redhat course "practices your DevOps journey do250"
https://redd.it/oarlia
@r_devops
Hi
Do you advise this course?
redhat course "practices your DevOps journey do250"
https://redd.it/oarlia
@r_devops
reddit
Did you take do250 course? Do you advise it?
Hi Do you advise this course? redhat course "practices your DevOps journey do250"
Moving files
What is the best automated approach of moving repo files from gitlab to a onedrive that is connected via a private network?....And being able to push and pull the changes .
https://redd.it/oagtif
@r_devops
What is the best automated approach of moving repo files from gitlab to a onedrive that is connected via a private network?....And being able to push and pull the changes .
https://redd.it/oagtif
@r_devops
reddit
Moving files
What is the best automated approach of moving repo files from gitlab to a onedrive that is connected via a private network?....And being able to...
Conduct vulnerability management for your Kubernetes applications
Just wrote an article on improving security for the applications on Kubernetes. Please check the link below
https://renjithvr11.medium.com/conduct-vulnerability-management-for-your-kubernetes-applications-64eef0ea2e0d
https://redd.it/obe836
@r_devops
Just wrote an article on improving security for the applications on Kubernetes. Please check the link below
https://renjithvr11.medium.com/conduct-vulnerability-management-for-your-kubernetes-applications-64eef0ea2e0d
https://redd.it/obe836
@r_devops
Medium
Conduct Vulnerability Management for Your Kubernetes Applications
Kubernetes is an open source container orchestration tool initially developed by Google and subsequently handed over to the Cloud Native…
How long until you used a new programming language idiomatically?
I started programming and C was the first language I used a lot, so I do a lot of things like I'd do in C. My first NodeJS programs looked this like C programs.
After years of using NodeJS (in small doses as it's not my main job) I used JavaScript'isms with easy and naturally: I became fluent in idiomatic JavaScript: Callbacks, promises, prototypes, anonymous functions...can't scare me now. Took about 3 years, mainly because I didn't program that much.
Learning Dart was a please: It's a lot of JavaScript minus the stupid parts. And static types. It's so similar to JavaScript, that learning the few Dart'isms was quick and simple and natural. Maybe 3 months that took me.
At work I use Python: very different and even after years my programs don't do Python'isms. 3 years and counting...
This makes me wonder: How long did it take you to be fluent and idiomatic in a new programming lanaguage?
Focus is on new. If you start programming with Python, I'd assume everything it does feels "natural" and thus easy to adopt.
Update: Fix grammar.
https://redd.it/obf30b
@r_devops
I started programming and C was the first language I used a lot, so I do a lot of things like I'd do in C. My first NodeJS programs looked this like C programs.
After years of using NodeJS (in small doses as it's not my main job) I used JavaScript'isms with easy and naturally: I became fluent in idiomatic JavaScript: Callbacks, promises, prototypes, anonymous functions...can't scare me now. Took about 3 years, mainly because I didn't program that much.
Learning Dart was a please: It's a lot of JavaScript minus the stupid parts. And static types. It's so similar to JavaScript, that learning the few Dart'isms was quick and simple and natural. Maybe 3 months that took me.
At work I use Python: very different and even after years my programs don't do Python'isms. 3 years and counting...
This makes me wonder: How long did it take you to be fluent and idiomatic in a new programming lanaguage?
Focus is on new. If you start programming with Python, I'd assume everything it does feels "natural" and thus easy to adopt.
Update: Fix grammar.
https://redd.it/obf30b
@r_devops
reddit
How long until you used a new programming language idiomatically?
I started programming and C was the first language I used a lot, so I do a lot of things like I'd do in C. My first NodeJS programs looked this...
Moving developers files
What is the best automated approach of moving developers files from gitlab to a onedrive that is connected to a private network? And be able to push and pull changes to both environments
https://redd.it/oagjld
@r_devops
What is the best automated approach of moving developers files from gitlab to a onedrive that is connected to a private network? And be able to push and pull changes to both environments
https://redd.it/oagjld
@r_devops
reddit
Moving developers files
What is the best automated approach of moving developers files from gitlab to a onedrive that is connected to a private network? And be able to...
What is the best alternative to ElasticSearch for a logging stack?
We are using EFK (Elasticsearch, Fluenbit and Kibana) as our logging stack and things are working fine when the load is low or medium but when the load is high Elasticsearch cannot coupe with the high load and it returns 429 error (sometimes other errors).
After some search, I found that the suggested solution is giving Elasticsearch much more resources than we do. We can do this on our development cluster (we run EFK on Kubernetes clusters) but we need to run our product on very small clusters (sometimes even on Microk8s) and giving Elasticsearch more resources cannot work for us everywhere. What is the best alternative to Elasticsearch that is not as resource hungry as Elasticsearch?
https://redd.it/obh870
@r_devops
We are using EFK (Elasticsearch, Fluenbit and Kibana) as our logging stack and things are working fine when the load is low or medium but when the load is high Elasticsearch cannot coupe with the high load and it returns 429 error (sometimes other errors).
After some search, I found that the suggested solution is giving Elasticsearch much more resources than we do. We can do this on our development cluster (we run EFK on Kubernetes clusters) but we need to run our product on very small clusters (sometimes even on Microk8s) and giving Elasticsearch more resources cannot work for us everywhere. What is the best alternative to Elasticsearch that is not as resource hungry as Elasticsearch?
https://redd.it/obh870
@r_devops
reddit
What is the best alternative to ElasticSearch for a logging stack?
We are using EFK (Elasticsearch, Fluenbit and Kibana) as our logging stack and things are working fine when the load is low or medium but when the...
One YAML CI/CD pipeline to rule them all?
Does anyone have an example of a tidy and cleanly written YAML CI/CD pipeline that covers deploying from dev, release, hotfix, main branches to dev, staging, prod env? With different stages, different env variables, versioning, approving, using a deployment pattern like blue-green deployment, and all the best practices. Or is this not a good practice to begin with (cramming it all in a single YAML )?
Use case for a simple web app deploy lets say.
https://redd.it/obijy7
@r_devops
Does anyone have an example of a tidy and cleanly written YAML CI/CD pipeline that covers deploying from dev, release, hotfix, main branches to dev, staging, prod env? With different stages, different env variables, versioning, approving, using a deployment pattern like blue-green deployment, and all the best practices. Or is this not a good practice to begin with (cramming it all in a single YAML )?
Use case for a simple web app deploy lets say.
https://redd.it/obijy7
@r_devops
reddit
One YAML CI/CD pipeline to rule them all?
Does anyone have an example of a tidy and cleanly written YAML CI/CD pipeline that covers deploying from dev, release, hotfix, main branches to...
Here is something worth reading on Software Testing Anti-patterns
https://blog.codepipes.com/testing/software-testing-antipatterns.html
https://redd.it/objicc
@r_devops
https://blog.codepipes.com/testing/software-testing-antipatterns.html
https://redd.it/objicc
@r_devops
Terraform Environments Questions
Hello!
I am a more traditional IT Infrastructure person adopting IaC practices (pretty much just using ansible for lots of stuff including provisioning). I say traditional because we don't have a dev team or deal with code in any way. We're just managing vmware for stuff like AD or VMs for HVAC systems to run, or Oracle EBS to run.
Anyway, I'm looking at Terraform for provisioning. Everything that I learn in tutorials or their documentation has references to multiple environments like dev, stage, and prod. We don't really have those types of environments, though. The closest we have is our Microsoft SQL Servers where we have Dev and Prod, but they aren't really related to each other and we also have a lot different production ones (both stand alone and clusters). Probably 30 in total.
So I'm wondering, do I treat each SQL server/SQL Cluster as an environment? instead of calling it dev and prod, do I call the environments prod-sql-1 and prod-sql-2 and dev-sql-1 and prod-sql-cluster1 using prod-sql-1.tfvars and prod-sql-2.tfvars and prod-sql-cluster1.tfvars to specify their differences? And would I put these all in the same pipeline or would I make a different repo for each and each have their own pipeline (So I'd have 20 pipelines just for Microsoft SQL alone and then probably 50 pipelines for all the random one-off servers). Or is this something for workspaces (something I haven't wrapped my head around that yet). Or is there some other way I should be going about this I'm missing?
​
Thanks in advance for any help/tips!
https://redd.it/obl4rl
@r_devops
Hello!
I am a more traditional IT Infrastructure person adopting IaC practices (pretty much just using ansible for lots of stuff including provisioning). I say traditional because we don't have a dev team or deal with code in any way. We're just managing vmware for stuff like AD or VMs for HVAC systems to run, or Oracle EBS to run.
Anyway, I'm looking at Terraform for provisioning. Everything that I learn in tutorials or their documentation has references to multiple environments like dev, stage, and prod. We don't really have those types of environments, though. The closest we have is our Microsoft SQL Servers where we have Dev and Prod, but they aren't really related to each other and we also have a lot different production ones (both stand alone and clusters). Probably 30 in total.
So I'm wondering, do I treat each SQL server/SQL Cluster as an environment? instead of calling it dev and prod, do I call the environments prod-sql-1 and prod-sql-2 and dev-sql-1 and prod-sql-cluster1 using prod-sql-1.tfvars and prod-sql-2.tfvars and prod-sql-cluster1.tfvars to specify their differences? And would I put these all in the same pipeline or would I make a different repo for each and each have their own pipeline (So I'd have 20 pipelines just for Microsoft SQL alone and then probably 50 pipelines for all the random one-off servers). Or is this something for workspaces (something I haven't wrapped my head around that yet). Or is there some other way I should be going about this I'm missing?
​
Thanks in advance for any help/tips!
https://redd.it/obl4rl
@r_devops
reddit
Terraform Environments Questions
Hello! I am a more traditional IT Infrastructure person adopting IaC practices (pretty much just using ansible for lots of stuff including...