Preview environments per Pull Request using AWS CDK and Github Actions
Hello all, I published my first tech article explaining the steps to create your own isolated environments in your Github Pull Request using the awesome AWS CDK.
Here is the link : https://dev.to/jgoux/preview-environments-per-pull-request-using-aws-cdk-and-github-actions-bfi
​
It was a great experience writing it. :)
https://redd.it/m4zyji
@r_devops
Hello all, I published my first tech article explaining the steps to create your own isolated environments in your Github Pull Request using the awesome AWS CDK.
Here is the link : https://dev.to/jgoux/preview-environments-per-pull-request-using-aws-cdk-and-github-actions-bfi
​
It was a great experience writing it. :)
https://redd.it/m4zyji
@r_devops
DEV Community
Preview environments per Pull Request using AWS CDK and Github Actions
TL;DR The code is 👉 here 👈. The rest of this post gives information and context about it. 📖...
Question regarding some books on humble bundle
Hello guys. I'm studying to get on to devops and there are some books on humble bundle, particularly on git, bash, linux and python, that caught my attention. Are these any good? Are they outdated?
https://www.humblebundle.com/books/pocket-reference-guides-oreilly-books?hmb_source=humble_home&hmb_medium=product_tile&hmb_campaign=mosaic_section_2_layout_index_2_layout_type_twos_tile_index_2_c_pocketreferenceguidesoreilly_bookbundle
Thanks for the help.
https://redd.it/m4wryq
@r_devops
Hello guys. I'm studying to get on to devops and there are some books on humble bundle, particularly on git, bash, linux and python, that caught my attention. Are these any good? Are they outdated?
https://www.humblebundle.com/books/pocket-reference-guides-oreilly-books?hmb_source=humble_home&hmb_medium=product_tile&hmb_campaign=mosaic_section_2_layout_index_2_layout_type_twos_tile_index_2_c_pocketreferenceguidesoreilly_bookbundle
Thanks for the help.
https://redd.it/m4wryq
@r_devops
Humble Bundle
Humble Book Bundle: Pocket Reference Guides by O'Reilly
We’ve teamed up with O’Reilly for our newest bundle. Get books like Linux Pocket Guide & Python Pocket Reference . Plus, pay what you want & support charity!
Software download portal
A little gig on the side resulted in me writing some software for a few companies. This has now turned into something that is more seriously used and downloaded within a few companies and I find myself needing some sort of download portal where logged in users can come to download whichever version they want.
I've looked at offerings from JFrog, Gitlab, Github, and even some WordPress plug-ins but I have no idea which to use. Github/lab both seem to be focused on being source code repositories that I could force to act like a download portal. JFrog has support for managing distributions, although it seems to be tied to some CI/CD, which is more than I want.
I know this isn't exactly DevOps but this was the best sub I could think to post this to.
https://redd.it/m4r33j
@r_devops
A little gig on the side resulted in me writing some software for a few companies. This has now turned into something that is more seriously used and downloaded within a few companies and I find myself needing some sort of download portal where logged in users can come to download whichever version they want.
I've looked at offerings from JFrog, Gitlab, Github, and even some WordPress plug-ins but I have no idea which to use. Github/lab both seem to be focused on being source code repositories that I could force to act like a download portal. JFrog has support for managing distributions, although it seems to be tied to some CI/CD, which is more than I want.
I know this isn't exactly DevOps but this was the best sub I could think to post this to.
https://redd.it/m4r33j
@r_devops
reddit
Software download portal
A little gig on the side resulted in me writing some software for a few companies. This has now turned into something that is more seriously used...
Monitor hardware usage from your mobile phone
We have developed an open-source tool to monitor hardware usage from your mobile phone.
The app shows two views for each metric, summary and detail views. Summary views would help you to quickly scan and understand your hardware usages. You can use detail views for more in-depth analysis.
For example, our CPU summary view shows the mean utilization of all cores and the detail view shows the utilization of each core.
Github : **https://github.com/lab-ml/labml**
Writeup: **https://github.com/lab-ml/labml/blob/master/guides/hardware\_monitoring.md**
Samples:
Live Session: **https://app.labml.ai/session/dc3645d86d0111ebae8706496fd25a7e**
Stopped Session: **https://app.labml.ai/session/41b0f9427cc711ebb12e0242ac1c0002**
Supports the following,
1. CPU Utilization
2. Memory
3. Hard Disk
4. GPU Utilization
5. GPU Temperature
6. GPU Power
7. GPU Memory
8. Network
We love to hear your feedback and suggestions. Thank you all and I appreciate the support.
https://redd.it/m4ojkz
@r_devops
We have developed an open-source tool to monitor hardware usage from your mobile phone.
The app shows two views for each metric, summary and detail views. Summary views would help you to quickly scan and understand your hardware usages. You can use detail views for more in-depth analysis.
For example, our CPU summary view shows the mean utilization of all cores and the detail view shows the utilization of each core.
Github : **https://github.com/lab-ml/labml**
Writeup: **https://github.com/lab-ml/labml/blob/master/guides/hardware\_monitoring.md**
Samples:
Live Session: **https://app.labml.ai/session/dc3645d86d0111ebae8706496fd25a7e**
Stopped Session: **https://app.labml.ai/session/41b0f9427cc711ebb12e0242ac1c0002**
Supports the following,
1. CPU Utilization
2. Memory
3. Hard Disk
4. GPU Utilization
5. GPU Temperature
6. GPU Power
7. GPU Memory
8. Network
We love to hear your feedback and suggestions. Thank you all and I appreciate the support.
https://redd.it/m4ojkz
@r_devops
GitHub
lab-ml/labml
🔎 Monitor deep learning model training and hardware usage from your mobile phone 📱 - lab-ml/labml
How to automate/synchronize large data in two servers?
I need to keep changes to a ecommerce goods up to date between two environment called Production and Development. The ecommerce goods list on Production is huge and does not change frequently, but those changes take up a lot of time for someone to add,update or remove from the Development Admin panel.
Can somebody describe me a way so that changes made on production is also reflected on development server? We can assume that there is a unique product_id for each product matching in both server.
Thank you!
https://redd.it/m4ni7q
@r_devops
I need to keep changes to a ecommerce goods up to date between two environment called Production and Development. The ecommerce goods list on Production is huge and does not change frequently, but those changes take up a lot of time for someone to add,update or remove from the Development Admin panel.
Can somebody describe me a way so that changes made on production is also reflected on development server? We can assume that there is a unique product_id for each product matching in both server.
Thank you!
https://redd.it/m4ni7q
@r_devops
reddit
How to automate/synchronize large data in two servers?
I need to keep changes to a ecommerce goods up to date between two environment called Production and Development. The ecommerce goods list on...
An outage is a lot like children; you don’t really get it until you create one.
It’s why sometimes the 3am rule comes into play. Where the decision goes to the person who would get the 3am call.
https://redd.it/m4gzq5
@r_devops
It’s why sometimes the 3am rule comes into play. Where the decision goes to the person who would get the 3am call.
https://redd.it/m4gzq5
@r_devops
reddit
An outage is a lot like children; you don’t really get it until...
It’s why sometimes the 3am rule comes into play. Where the decision goes to the person who would get the 3am call.
Passing json objects as parameter but how do I ssh into a device to reboot?
Currently have something like this on Jenkins testing my RPI but need to ssh into the RPI to use curl command reboot with update. How can I write this? Any idea? Couldn't find anything online.....
​
JSON object file as parameter
{
"device": {
"Google Home": "Jarvis",
"Apple Home Kit": "siri"
}
"reboot": {
"reboot": "curl -I 'https://localhost:2004/etc/etc/etc \-X POST -H etc'
*This does not work since I'm not ssh into the device and using IP instead of localhost will not be allowed*.
}
}
https://redd.it/m5c96q
@r_devops
Currently have something like this on Jenkins testing my RPI but need to ssh into the RPI to use curl command reboot with update. How can I write this? Any idea? Couldn't find anything online.....
​
JSON object file as parameter
{
"device": {
"Google Home": "Jarvis",
"Apple Home Kit": "siri"
}
"reboot": {
"reboot": "curl -I 'https://localhost:2004/etc/etc/etc \-X POST -H etc'
*This does not work since I'm not ssh into the device and using IP instead of localhost will not be allowed*.
}
}
https://redd.it/m5c96q
@r_devops
reddit
Passing json objects as parameter but how do I ssh into a device...
Currently have something like this on Jenkins testing my RPI but need to ssh into the RPI to use curl command reboot with update. How can I write...
Kubernetes Customer Usage Billing
Hello DevOps,
I have three clients that need a kubernetes cluster.
I can create three different clusters for each one of them and bill them monthly but I don't really like this idea.
I've been reading about multi tenants and projects like Kiosk, Kubecost, Promitheus and Grafana monitoring.
I want to achieve is automated billing for my customers. I don't know if separate clusters or multi tenant is better. Definitely the multi tenant is cost effective.
Another question is, how providers like linode create new deployments via their customer portal? I want to create something similar like that. I've seen Jalastic but I don't know if there are any alternatives.
https://redd.it/m57ypk
@r_devops
Hello DevOps,
I have three clients that need a kubernetes cluster.
I can create three different clusters for each one of them and bill them monthly but I don't really like this idea.
I've been reading about multi tenants and projects like Kiosk, Kubecost, Promitheus and Grafana monitoring.
I want to achieve is automated billing for my customers. I don't know if separate clusters or multi tenant is better. Definitely the multi tenant is cost effective.
Another question is, how providers like linode create new deployments via their customer portal? I want to create something similar like that. I've seen Jalastic but I don't know if there are any alternatives.
https://redd.it/m57ypk
@r_devops
reddit
Kubernetes Customer Usage Billing
Hello DevOps, I have three clients that need a kubernetes cluster. I can create three different clusters for each one of them and bill them...
Devops Tools
Do we need to learn all Devops tools?
* If i chose github from github and bitbucket
* Then maven from building tools.
* Jenkins for Continous Integration
* Ansible & CHef for Configuration management
* Docker from Conainerization
* Nagios for Monitoring Tools
* At last AWS for Cloud.
If i learn all these tools and ignore other tools will I be a DevOPs or do i need to lean all the tools.
https://redd.it/m5b4wt
@r_devops
Do we need to learn all Devops tools?
* If i chose github from github and bitbucket
* Then maven from building tools.
* Jenkins for Continous Integration
* Ansible & CHef for Configuration management
* Docker from Conainerization
* Nagios for Monitoring Tools
* At last AWS for Cloud.
If i learn all these tools and ignore other tools will I be a DevOPs or do i need to lean all the tools.
https://redd.it/m5b4wt
@r_devops
reddit
Devops Tools
Do we need to learn all Devops tools? * If i chose github from github and bitbucket * Then maven from building tools. * Jenkins for Continous...
Database restore verification
Hey all,
We are looking at putting more automation around doing test restores and verifying we have the data we want.
Obviously we minimised this by ensuring we use IAC and not storing anything locally on an instance so as long as we have a backup of the source code and build machine we are good for all the apps.
But what I am kinda stuck on is verification of a test restored database. I was wondering if anyone has done something similar and could point me to some tooling or something.
Our current ideas are a script to compare prod and restored data at a high level and randomly select some apps to do a deeper verification on.
Having the Dev teams write some tests so they can control what gets verified and highlight what's more critical in their database.
But that will all be in-house scripts/tests and before we go down that path I would love to see if there is a tool that can speed up this task or help with keep best practice in mind.
https://redd.it/m5arxw
@r_devops
Hey all,
We are looking at putting more automation around doing test restores and verifying we have the data we want.
Obviously we minimised this by ensuring we use IAC and not storing anything locally on an instance so as long as we have a backup of the source code and build machine we are good for all the apps.
But what I am kinda stuck on is verification of a test restored database. I was wondering if anyone has done something similar and could point me to some tooling or something.
Our current ideas are a script to compare prod and restored data at a high level and randomly select some apps to do a deeper verification on.
Having the Dev teams write some tests so they can control what gets verified and highlight what's more critical in their database.
But that will all be in-house scripts/tests and before we go down that path I would love to see if there is a tool that can speed up this task or help with keep best practice in mind.
https://redd.it/m5arxw
@r_devops
reddit
Database restore verification
Hey all, We are looking at putting more automation around doing test restores and verifying we have the data we want. Obviously we minimised...
Cloud Native CI/CD with Tekton — Laying The Foundation
Hi /r/DevOps,
Today I published article with intro to Tekton Pipelines including repository with scripts and customized setup to get up and running quickly with Tekton (Pipelines, Triggers, Dashboard and KinD cluster). The repository also includes sample Tasks, Pipelines, etc.
So, if you want to check it out, then here's:
Article: https://itnext.io/cloud-native-ci-cd-with-tekton-laying-the-foundation-a377a1b59ac0
Repository: https://github.com/MartinHeinz/tekton-kickstarter
Feedback is very much appreciated!
https://redd.it/m5fu7i
@r_devops
Hi /r/DevOps,
Today I published article with intro to Tekton Pipelines including repository with scripts and customized setup to get up and running quickly with Tekton (Pipelines, Triggers, Dashboard and KinD cluster). The repository also includes sample Tasks, Pipelines, etc.
So, if you want to check it out, then here's:
Article: https://itnext.io/cloud-native-ci-cd-with-tekton-laying-the-foundation-a377a1b59ac0
Repository: https://github.com/MartinHeinz/tekton-kickstarter
Feedback is very much appreciated!
https://redd.it/m5fu7i
@r_devops
Medium
Cloud Native CI/CD with Tekton — Laying The Foundation
It’s time to kick-start your journey to cloud-native CI/CD on Kubernetes with Tekton Pipelines…
What are some pre-made projects that I could use to practice on?
Hi /r/devops, I want to practice troubleshooting, ci/cd, monitoring, etc especially on aws (eks). I got the idea of how to set up the cluster and everything but I was wondering if there are any practice applications out that has the functionalities in place already? Maybe application that uses some sort of database etc.
https://redd.it/m597cp
@r_devops
Hi /r/devops, I want to practice troubleshooting, ci/cd, monitoring, etc especially on aws (eks). I got the idea of how to set up the cluster and everything but I was wondering if there are any practice applications out that has the functionalities in place already? Maybe application that uses some sort of database etc.
https://redd.it/m597cp
@r_devops
reddit
What are some pre-made projects that I could use to practice on?
Hi /r/devops, I want to practice troubleshooting, ci/cd, monitoring, etc especially on aws (eks). I got the idea of how to set up the cluster and...
Docker image for infrastructure developer
I created a simple docker image with basic tool set for infrastructure developer
GitHub
DockerHub
Welcome feedback and support if you like it!
https://redd.it/m4jinj
@r_devops
I created a simple docker image with basic tool set for infrastructure developer
GitHub
DockerHub
Welcome feedback and support if you like it!
https://redd.it/m4jinj
@r_devops
GitHub
kumarkeviv/infrastructure-developer-tools
Infrastructure developer tools includes set of plugins and services that make it easier than ever to build, test and deploy infrastructure. - kumarkeviv/infrastructure-developer-tools
How much does it cost to run the web application called Omegle?
I believe it shouldn't cost much because everything is P2P?
https://redd.it/m4ed9h
@r_devops
I believe it shouldn't cost much because everything is P2P?
https://redd.it/m4ed9h
@r_devops
reddit
How much does it cost to run the web application called Omegle?
I believe it shouldn't cost much because everything is P2P?
Can't run my Django app on port 80 on GCE
Hello guys,
I'm far from being a DevOps but having issues running my Django on Google Compute Engine
I have created both http-server and https-server firewall rules.
The app is deployed on Google's Artifact Registry
I can SSH into it but cannot view it in the browser.
I learned VM-level firewall could be intervening but have no idea how to by-pass it even after running the commands from this guide: https://cloud.google.com/container-optimized-os/docs/how-to/firewall
Here's my response from
I'd appreciate your help
https://redd.it/m5llxa
@r_devops
Hello guys,
I'm far from being a DevOps but having issues running my Django on Google Compute Engine
I have created both http-server and https-server firewall rules.
The app is deployed on Google's Artifact Registry
I can SSH into it but cannot view it in the browser.
I learned VM-level firewall could be intervening but have no idea how to by-pass it even after running the commands from this guide: https://cloud.google.com/container-optimized-os/docs/how-to/firewall
Here's my response from
docker ps: https://ibb.co/DGrXBPDI'd appreciate your help
https://redd.it/m5llxa
@r_devops
Google Cloud
Configuring the host firewall | Container-Optimized OS | Google Cloud
What is remote working like in your field? Is it possible to be a "tech nomad" of sorts?
Is the nomad life impossible for you guys since you might be needed more urgently than say a software dev? And therefore have to be in the same timezone as your employer?
https://redd.it/m5m6yr
@r_devops
Is the nomad life impossible for you guys since you might be needed more urgently than say a software dev? And therefore have to be in the same timezone as your employer?
https://redd.it/m5m6yr
@r_devops
reddit
What is remote working like in your field? Is it possible to be a...
Is the nomad life impossible for you guys since you might be needed more urgently than say a software dev? And therefore have to be in the same...
For those using distributed tracing in production, I want to hear from you
I'm a maintainer in an open-source project in the distributed tracing area (Jaeger) and would like to hear from actual users of tracing tools:
\- Why are you using distributed tracing in the first place? I know quite a few reasons to use it, but I wonder what makes YOU use it. I know I'll learn a new and surprising use case after this experiment :-)
\- How does your solution look like? Which libraries are you using for instrumentation? Which components are in your backend? How are you using the tracing data?
\- Which benefits were you able to obtain so far?
\- What are you currently missing? Knowledge? Internal buy-in? Tooling?
https://redd.it/m5giof
@r_devops
I'm a maintainer in an open-source project in the distributed tracing area (Jaeger) and would like to hear from actual users of tracing tools:
\- Why are you using distributed tracing in the first place? I know quite a few reasons to use it, but I wonder what makes YOU use it. I know I'll learn a new and surprising use case after this experiment :-)
\- How does your solution look like? Which libraries are you using for instrumentation? Which components are in your backend? How are you using the tracing data?
\- Which benefits were you able to obtain so far?
\- What are you currently missing? Knowledge? Internal buy-in? Tooling?
https://redd.it/m5giof
@r_devops
reddit
For those using distributed tracing in production, I want to hear...
I'm a maintainer in an open-source project in the distributed tracing area (Jaeger) and would like to hear from actual users of tracing tools: \-...
DevOps and NoCode/LowCode
I've seen over the last year a lot of hype building up on no-code and low-code (mostly on things not related to DevOps).
I was curious about the community's take on this topic so... do you think no-code solutions can be applied to DevOps? What do you think would benefit from no-code?
https://redd.it/m5nbcs
@r_devops
I've seen over the last year a lot of hype building up on no-code and low-code (mostly on things not related to DevOps).
I was curious about the community's take on this topic so... do you think no-code solutions can be applied to DevOps? What do you think would benefit from no-code?
https://redd.it/m5nbcs
@r_devops
reddit
DevOps and NoCode/LowCode
I've seen over the last year a lot of hype building up on no-code and low-code (mostly on things not related to DevOps). I was curious about the...
Could AWS EC2 instances ping Client VPN on the same VPC?
I have a scenario where I have multiple Raspberry Pis connected to the Client VPN Endpoint and an EC2 instance on the same VPC. I want to SSH into those Raspberry Pis by using the IP addresses that the VPN provided.
I have a VPC with one subnet where I have one EC2 instance and a Client VPN endpoint on the same VPC. The Client VPN could ping the EC2 instance but the EC2 instance could not ping the Client VPN? Could AWS EC2 instances ping Client VPN on the same VPC? If so, how could I achieve this?
https://redd.it/m5jsju
@r_devops
I have a scenario where I have multiple Raspberry Pis connected to the Client VPN Endpoint and an EC2 instance on the same VPC. I want to SSH into those Raspberry Pis by using the IP addresses that the VPN provided.
I have a VPC with one subnet where I have one EC2 instance and a Client VPN endpoint on the same VPC. The Client VPN could ping the EC2 instance but the EC2 instance could not ping the Client VPN? Could AWS EC2 instances ping Client VPN on the same VPC? If so, how could I achieve this?
https://redd.it/m5jsju
@r_devops
reddit
Could AWS EC2 instances ping Client VPN on the same VPC?
I have a scenario where I have multiple Raspberry Pis connected to the Client VPN Endpoint and an EC2 instance on the same VPC. I want to SSH into...
How long does it take to set up docker containers usually? (ballpark figure/approximate range)
We're working on an app that allows to set up dev environments within docker containers in less than 10 minutes and we'd like to compare with the manual setup process/alternative solutions.
How long does it usually take you to setup a project before you get started on a project if you're starting from scratch?
https://redd.it/m5qcj4
@r_devops
We're working on an app that allows to set up dev environments within docker containers in less than 10 minutes and we'd like to compare with the manual setup process/alternative solutions.
How long does it usually take you to setup a project before you get started on a project if you're starting from scratch?
https://redd.it/m5qcj4
@r_devops
reddit
How long does it take to set up docker containers usually?...
We're working on an app that allows to set up dev environments within docker containers in less than 10 minutes and we'd like to compare with the...
Good tools/examples for creating runbooks?
I have a need for maintaining Ops documentation in project repositories along with diagrams and stuff.
I'm thinking about using diagrams for diagramming over visio/lucid and looking for any tools out there. I want to avoid putting the documentation into a wiki as it stagnates.
Anyone seen any good tools for this?
https://redd.it/m5tqye
@r_devops
I have a need for maintaining Ops documentation in project repositories along with diagrams and stuff.
I'm thinking about using diagrams for diagramming over visio/lucid and looking for any tools out there. I want to avoid putting the documentation into a wiki as it stagnates.
Anyone seen any good tools for this?
https://redd.it/m5tqye
@r_devops
GitHub
GitHub - mingrammer/diagrams: :art: Diagram as Code for prototyping cloud system architectures
:art: Diagram as Code for prototyping cloud system architectures - mingrammer/diagrams