Why You Can’t Find Anything in Your Monitoring Dashboards
Too often we run into an incident, jump to the dashboard, just to find ourselves drowning in endless data and unable to find what we need. This could be caused not just by the data overload, but also due to seeing too many or too few colors, inconsistent conventions or the lack of visual cues.
The dashboard needs to be designed in a way that allows users easily access and interpret the data. It requires more than the engineer mindset to do it right. Take these two guiding principles:
*When designing a dashboard,* ***think like a UX designer****, and* ***keep it simple****.*
Here are some guidelines for effective dashboard design:
* Understand your dashboard’s user persona and use case
* Utilize the right data visualizations
* Create clean layout with an intuitive flow
* Keep Consistency of the layout
* Correlate between different dashboards and views
* Annotate thresholds, alerts and events on the graph
* Overlay values on the same graph only when makes sense
See dashboard examples and more details on this guide: [https://medium.com/p/12fcc23d34c8](https://medium.com/p/12fcc23d34c8)
https://redd.it/11t3i0i
@r_devops
Too often we run into an incident, jump to the dashboard, just to find ourselves drowning in endless data and unable to find what we need. This could be caused not just by the data overload, but also due to seeing too many or too few colors, inconsistent conventions or the lack of visual cues.
The dashboard needs to be designed in a way that allows users easily access and interpret the data. It requires more than the engineer mindset to do it right. Take these two guiding principles:
*When designing a dashboard,* ***think like a UX designer****, and* ***keep it simple****.*
Here are some guidelines for effective dashboard design:
* Understand your dashboard’s user persona and use case
* Utilize the right data visualizations
* Create clean layout with an intuitive flow
* Keep Consistency of the layout
* Correlate between different dashboards and views
* Annotate thresholds, alerts and events on the graph
* Overlay values on the same graph only when makes sense
See dashboard examples and more details on this guide: [https://medium.com/p/12fcc23d34c8](https://medium.com/p/12fcc23d34c8)
https://redd.it/11t3i0i
@r_devops
Medium
Unreadable Metrics: Why You Can’t Find Anything in Your Monitoring Dashboards
A Guide to Effective Dashboard Design
Feedback needed: Will this help you?
Hi alL! I'm the growth PM at ngrok, and I've been working hard to make our product easier to use and understand for people testing and debugging web apps. As part of this, I'm working to expand our free tier, and have included webhook verification and OAuth.
​
My question for this group is, does webhook verification matter? We don't see a ton of usage but part of that was because it was in the paid plan. Is this something you care about? If not, why?
https://redd.it/11su2gg
@r_devops
Hi alL! I'm the growth PM at ngrok, and I've been working hard to make our product easier to use and understand for people testing and debugging web apps. As part of this, I'm working to expand our free tier, and have included webhook verification and OAuth.
​
My question for this group is, does webhook verification matter? We don't see a ton of usage but part of that was because it was in the paid plan. Is this something you care about? If not, why?
https://redd.it/11su2gg
@r_devops
Ngrok
Expanding ngrok's free plan with security in one line
We strive to take ingress off developers’ plates with our platform, and that requires making security-focused features accessible and easy to use. Today, I'm proud to announce an important step in that direction: we're adding our security features — OAuth…
is anyone using garden.io for Kubernetes development?
Hi, just wanted to ask if anyone of you has experience with introducing Garden.io at your company for Kubernetes development? Did it help with providing a better developer experience or speeding things up or improving overall developer satisfaction? Or why did you even introduced in first place?
Would appreciate any insights on garden.io. Thanks.
https://redd.it/11sydxp
@r_devops
Hi, just wanted to ask if anyone of you has experience with introducing Garden.io at your company for Kubernetes development? Did it help with providing a better developer experience or speeding things up or improving overall developer satisfaction? Or why did you even introduced in first place?
Would appreciate any insights on garden.io. Thanks.
https://redd.it/11sydxp
@r_devops
docs.garden.io
Welcome to Garden! | Garden Docs
Garden is a DevOps automation tool for developing and testing Kubernetes apps faster
Elasticsearch upgrade delimma
I am performing a rolling upgrade on our elastic search cluster from 7.6.2 to 7.16.2, there are total 3 nodes. Cordinator node is already updated. Should I keep the value of cluster.initialmasternodes as empty in elasticsearch.yml while upgrading or keep the values.
https://redd.it/11tqyk9
@r_devops
I am performing a rolling upgrade on our elastic search cluster from 7.6.2 to 7.16.2, there are total 3 nodes. Cordinator node is already updated. Should I keep the value of cluster.initialmasternodes as empty in elasticsearch.yml while upgrading or keep the values.
https://redd.it/11tqyk9
@r_devops
Reddit
r/devops on Reddit: Elasticsearch upgrade delimma
Posted by u/vishnujp12 - No votes and 1 comment
Folks on my team never want to have a "white boarding" session to review stories that I pick up...?
Some stories I pickup I'd like to dive a bit deeper with my colleagues before I start development. In the past folks would always be willing to jump on a call or meet in a room and start mocking out a potential architecture for automation / CICD... normal *right*?
Every person on this new team I'm on requires a PR before they'll review/consult against the work increment. This seems counterintuitive as the development has already been through multiple phases.
Yea, we can do this in grooming, but that's typically for 10-15mins on a story, and you're not positive if that particular story will even be assigned to you.
Is this normal practice?
https://redd.it/11ts7mo
@r_devops
Some stories I pickup I'd like to dive a bit deeper with my colleagues before I start development. In the past folks would always be willing to jump on a call or meet in a room and start mocking out a potential architecture for automation / CICD... normal *right*?
Every person on this new team I'm on requires a PR before they'll review/consult against the work increment. This seems counterintuitive as the development has already been through multiple phases.
Yea, we can do this in grooming, but that's typically for 10-15mins on a story, and you're not positive if that particular story will even be assigned to you.
Is this normal practice?
https://redd.it/11ts7mo
@r_devops
Reddit
r/devops on Reddit: Folks on my team never want to have a "white boarding" session to review stories that I pick up...?
Posted by u/swiftsparky - No votes and 1 comment
How do you handle subnet reservation ?
looking for a better way to handle subnet allocation rather than rely on a spreadsheet. would like it to auto update if possible .
​
at the moment we have subnets reserverd for failovers , but there is no record of them in the azure portal , as they dont exist until the point of deployment , ant the moment this is handles through the traditional spreadsheet , which sucks
​
so who has a better way?
https://redd.it/11tqrv1
@r_devops
looking for a better way to handle subnet allocation rather than rely on a spreadsheet. would like it to auto update if possible .
​
at the moment we have subnets reserverd for failovers , but there is no record of them in the azure portal , as they dont exist until the point of deployment , ant the moment this is handles through the traditional spreadsheet , which sucks
​
so who has a better way?
https://redd.it/11tqrv1
@r_devops
Reddit
r/devops on Reddit: How do you handle subnet reservation ?
Posted by u/titch124 - 3 votes and 5 comments
Guys/girls, I need your help!
So, i am doing an internship in this company after graduating. I applied for a mobile development position.I had really good mentors and everything was going according to plan. Long story short: there have been some fuckups in the company and now i have to decide between DevOps and data science.
So I need advice from you guys about what can I expect. What is it like working as a DevOps/data scientist. What do you like/dislike? How stressful/hard/fun it is etc.
Excuse my broken english as it is my second language.
I'm posting this question in both communities (feel free to redirect me somewhere else if you think it would suit my question better) .
Thanks everyone in advance!
https://redd.it/11tvz5o
@r_devops
So, i am doing an internship in this company after graduating. I applied for a mobile development position.I had really good mentors and everything was going according to plan. Long story short: there have been some fuckups in the company and now i have to decide between DevOps and data science.
So I need advice from you guys about what can I expect. What is it like working as a DevOps/data scientist. What do you like/dislike? How stressful/hard/fun it is etc.
Excuse my broken english as it is my second language.
I'm posting this question in both communities (feel free to redirect me somewhere else if you think it would suit my question better) .
Thanks everyone in advance!
https://redd.it/11tvz5o
@r_devops
Reddit
r/devops on Reddit: Guys/girls, I need your help!
Posted by u/crnigorac - No votes and no comments
Master EKS Clusters, Terraform & ArgoCD with this Comprehensive DevOps Tutorial!
Hey, DevOps enthusiasts! 👋
I recently created an in-depth tutorial covering the entire process of creating and managing an EKS cluster using Terraform modules and installing ArgoCD on it. I wanted to share it with you all, as I believe it can be a valuable resource for those looking to enhance their DevOps skills.
In this tutorial, you'll learn:
How to set up an EKS cluster with Terraform modules
Best practices for managing your infrastructure
Installing and configuring ArgoCD for seamless deployment
And finally, how to properly destroy the cluster once you're done
Whether you're new to DevOps or an experienced pro, I'm confident that you'll find this tutorial useful and informative!
🎥 Check out the video here: https://youtu.be/zgNs2xz1eLk
I'd love to hear your thoughts, feedback, or any questions you might have. Let's discuss and learn from each other!
Happy learning! 🚀
https://redd.it/11tx9gs
@r_devops
Hey, DevOps enthusiasts! 👋
I recently created an in-depth tutorial covering the entire process of creating and managing an EKS cluster using Terraform modules and installing ArgoCD on it. I wanted to share it with you all, as I believe it can be a valuable resource for those looking to enhance their DevOps skills.
In this tutorial, you'll learn:
How to set up an EKS cluster with Terraform modules
Best practices for managing your infrastructure
Installing and configuring ArgoCD for seamless deployment
And finally, how to properly destroy the cluster once you're done
Whether you're new to DevOps or an experienced pro, I'm confident that you'll find this tutorial useful and informative!
🎥 Check out the video here: https://youtu.be/zgNs2xz1eLk
I'd love to hear your thoughts, feedback, or any questions you might have. Let's discuss and learn from each other!
Happy learning! 🚀
https://redd.it/11tx9gs
@r_devops
YouTube
DevOps Tutorial: EKS Cluster, Terraform & ArgoCD Best Practices Unleashed!
Unlock the power of DevOps in this comprehensive tutorial as we explore the ins and outs of creating an EKS cluster using Terraform modules and seamlessly installing ArgoCD on it. Learn best practices for efficient and secure infrastructure management, and…
SonarCloud and golang code in Azure
Hi, i'm new in devops, and Azure. I'm trying to use SonarCloud in my project with Golang in Azure. I already install the extension, the prepare analysis configuration, run code analysis and publish code gate quality in the CI pipeline. When i run my code CI everything do fine but when i go see the results in SonarCloud, apparently just the golang code its not analyzed. i can see in Sumarry 0 Bugs, Code Smells, Vulnerabilities and Security Hotspots, and in Code i can see just the Dockerfile, the pipeline yml and manifests folder.
I tried to install the golang during CI pipeline but not work.
https://redd.it/11twr6w
@r_devops
Hi, i'm new in devops, and Azure. I'm trying to use SonarCloud in my project with Golang in Azure. I already install the extension, the prepare analysis configuration, run code analysis and publish code gate quality in the CI pipeline. When i run my code CI everything do fine but when i go see the results in SonarCloud, apparently just the golang code its not analyzed. i can see in Sumarry 0 Bugs, Code Smells, Vulnerabilities and Security Hotspots, and in Code i can see just the Dockerfile, the pipeline yml and manifests folder.
I tried to install the golang during CI pipeline but not work.
https://redd.it/11twr6w
@r_devops
Reddit
r/devops on Reddit: SonarCloud and golang code in Azure
Posted by u/CaioTaavares - No votes and no comments
March 29, Free Talk on the Future of DevOps with Sasha Rosenbaum, Principal at Ergonautic
March 29 at 12 pm ET (17:00 UTC), join Sasha Rosenbaum, principal at Ergonautic, for the ACM TechTalk " Future of DevOps." Andrew Clay Shafer of Ergonautic will moderate.
The term DevOps first appeared in 2009, and since then has been used to describe a cultural shift, an engineering job title, and many products in the Continuous Integration and Continuous Delivery space. In this session, Sasha will talk through the brief history of DevOps as a methodology, a set of technical skills, and an umbrella of technologies, and then dive into what the next 5 to 10 years are likely to look like in the DevOps space.
Register to attend this talk live or on demand.
https://redd.it/11tzpfj
@r_devops
March 29 at 12 pm ET (17:00 UTC), join Sasha Rosenbaum, principal at Ergonautic, for the ACM TechTalk " Future of DevOps." Andrew Clay Shafer of Ergonautic will moderate.
The term DevOps first appeared in 2009, and since then has been used to describe a cultural shift, an engineering job title, and many products in the Continuous Integration and Continuous Delivery space. In this session, Sasha will talk through the brief history of DevOps as a methodology, a set of technical skills, and an umbrella of technologies, and then dive into what the next 5 to 10 years are likely to look like in the DevOps space.
Register to attend this talk live or on demand.
https://redd.it/11tzpfj
@r_devops
Zoom
Welcome! You are invited to join a webinar: Future of DevOps. After registering, you will receive a confirmation email about joining…
The term DevOps first appeared in 2009, and since then has been used to describe a cultural shift, an engineering job title, and many products in the Continuous Integration and Continuous Delivery space. In this session, we will talk through the brief history…
What are some of your favorite projects to support on GitHub?
Hey y'all, happy Friday. I'm interested in discovering what kinds of projects devops professionals like to support. Maybe it's an open-source project led by a global team, or maybe it's one person's passion project to improve accessibility to K8s. Are there any you support on a regular basis, either through contributing or through sponsorships? Thanks for entertaining my curiosity!
https://redd.it/11u1jlf
@r_devops
Hey y'all, happy Friday. I'm interested in discovering what kinds of projects devops professionals like to support. Maybe it's an open-source project led by a global team, or maybe it's one person's passion project to improve accessibility to K8s. Are there any you support on a regular basis, either through contributing or through sponsorships? Thanks for entertaining my curiosity!
https://redd.it/11u1jlf
@r_devops
Reddit
r/devops on Reddit: What are some of your favorite projects to support on GitHub?
Posted by u/NewRelicChris - No votes and 1 comment
Any tips on how to run auto scaling self-hosted GitLab runners well?
If you are using AWS and EKS? Or other CSP is fine
https://redd.it/11tstqc
@r_devops
If you are using AWS and EKS? Or other CSP is fine
https://redd.it/11tstqc
@r_devops
Reddit
r/devops on Reddit: Any tips on how to run auto scaling self-hosted GitLab runners well?
Posted by u/IamOkei - 1 vote and 6 comments
Is chatgpt replacing or will eventually replace devops jobs?
Is chatgpt replacing or will eventually replace devops jobs? What are your views ?
https://redd.it/11u2pf9
@r_devops
Is chatgpt replacing or will eventually replace devops jobs? What are your views ?
https://redd.it/11u2pf9
@r_devops
Reddit
r/devops on Reddit: Is chatgpt replacing or will eventually replace devops jobs?
Posted by u/Foolca - No votes and 25 comments
Platform Engineering Won’t Kill the DevOps Star
Will platform engineering eclipse DevOps in 2023? Will platform teams better internally advocate their services?
This article answers these questions and includes other platform engineering predictions. Check it out 👇
https://thenewstack.io/platform-engineering-wont-kill-the-devops-star/?utm_source=Social-Media&utm_medium=Reddit&utm_campaign=SM
https://redd.it/11u7rjj
@r_devops
Will platform engineering eclipse DevOps in 2023? Will platform teams better internally advocate their services?
This article answers these questions and includes other platform engineering predictions. Check it out 👇
https://thenewstack.io/platform-engineering-wont-kill-the-devops-star/?utm_source=Social-Media&utm_medium=Reddit&utm_campaign=SM
https://redd.it/11u7rjj
@r_devops
The New Stack
Platform Engineering Won’t Kill the DevOps Star
Will platform engineering eclipse DevOps in 2023? How will platform teams better internally advocate their services? Read platform predictions.
Does anyone of you think about the retirement?
I feel like Im getting old and I definitely feel the agism in our industry.
With AI soon to simplify many things, it will be even harder to find a job and tbh how long can you keep on learning ?
What is your backup plan ? Learning a second thing to keep earning in 50s60s?
Ps. Yes I know some ppl in their 60s are still in workforce in IT, but for us in 30s40s the future will look completely different :(
I feel like all the knowledge I have will be sooner or later obsolete and I wont be able to keep up :/
https://redd.it/11u7n72
@r_devops
I feel like Im getting old and I definitely feel the agism in our industry.
With AI soon to simplify many things, it will be even harder to find a job and tbh how long can you keep on learning ?
What is your backup plan ? Learning a second thing to keep earning in 50s60s?
Ps. Yes I know some ppl in their 60s are still in workforce in IT, but for us in 30s40s the future will look completely different :(
I feel like all the knowledge I have will be sooner or later obsolete and I wont be able to keep up :/
https://redd.it/11u7n72
@r_devops
Reddit
r/devops on Reddit: Does anyone of you think about the retirement?
Posted by u/pojzon_poe - No votes and 5 comments
Containerization = resurgence of principles behind JVM
Is containerization just the modern day version of the JVM? I haven't written in Java in a few years, but what is the main difference between these two technically and principally?
https://redd.it/11uahbh
@r_devops
Is containerization just the modern day version of the JVM? I haven't written in Java in a few years, but what is the main difference between these two technically and principally?
https://redd.it/11uahbh
@r_devops
Reddit
r/devops on Reddit: Containerization = resurgence of principles behind JVM
Posted by u/theRealJuicyJay - No votes and no comments
What process or tools do you use to terminate instances in an ASG, when you need to ensure the EC2 instance gracefully completes any connections or tasks before being terminated?
In my prior role we didn't use ASG (Autoscaling Group) scale in events to terminate instances, instead I used a cronjob on the EC2 instance to check if the host had =>7 days up time, check existing jobs and API's have completed and then terminates it's self.
The CloudFormation CI/CD updates the AMI deployed by the ASG. So those instances wouldn't become available until a host gracefully shutdown or became unhealthy.
Wondering if anyone else is using
Or is there another method to achieve a graceful shutdown that you'd recommend instead?
https://redd.it/11uaavy
@r_devops
In my prior role we didn't use ASG (Autoscaling Group) scale in events to terminate instances, instead I used a cronjob on the EC2 instance to check if the host had =>7 days up time, check existing jobs and API's have completed and then terminates it's self.
The CloudFormation CI/CD updates the AMI deployed by the ASG. So those instances wouldn't become available until a host gracefully shutdown or became unhealthy.
Wondering if anyone else is using
Terminating:Wait and Lifecycle Hooks and what their experience with those is?Or is there another method to achieve a graceful shutdown that you'd recommend instead?
https://redd.it/11uaavy
@r_devops
Reddit
r/devops on Reddit: What process or tools do you use to terminate instances in an ASG, when you need to ensure the EC2 instance…
Posted by u/hangerofmonkeys - No votes and 1 comment
I want to get all the spaces in my kibana using python
So as the title says I'm trying to write a script which gets all the spaces in my kibana, i tried to go through the documentation but i can't find a way to do that using python, any help would be appreciated
EDIT: i tried to follow elastic search doc
https://www.elastic.co/guide/en/kibana/current/spaces-api-get-all.html#spaces-api-get-all-example-1
but it threw me this error
here's the code for the same
EDIT 2: it worked as soon as i replaced the url with kibana endpoint and not elasticsearch endpoint
https://redd.it/11sv72j
@r_devops
So as the title says I'm trying to write a script which gets all the spaces in my kibana, i tried to go through the documentation but i can't find a way to do that using python, any help would be appreciated
EDIT: i tried to follow elastic search doc
https://www.elastic.co/guide/en/kibana/current/spaces-api-get-all.html#spaces-api-get-all-example-1
but it threw me this error
{'error': 'no handler found for uri [/api/spaces/space] and method [GET]'}
here's the code for the same
import requests
response = requests.get('https://correct_ELASTIC_URL/api/spaces/space', auth=HTTPBasicAuth('elastic', 'CORRECT_PASS'))
response.json()
EDIT 2: it worked as soon as i replaced the url with kibana endpoint and not elasticsearch endpoint
https://redd.it/11sv72j
@r_devops
www.elastic.co
Get all Kibana spaces API | Kibana Guide [8.6] | Elastic
Conceptual and step-by-step procedures for using runtime fields, scripted fields, and field formatters.
Looking for a way to transcode and stream videos
I'm running a media site where we host videos ourselves instead of using YouTube. Right now we're using Bunny Stream, but I was wondering if there are better (less independent) ways. I don't have the most experience with DevOps, but I'm running some droplets on Digital Ocean while also using managed databases and Digital Ocean Spaces, so it would be nice if we could integrate our new solution in Digital Ocean as well. Are there any services that take care of transcoding the video while storing it on Digital Ocean Spaces or is this a bad idea altogether?
https://redd.it/11st9aw
@r_devops
I'm running a media site where we host videos ourselves instead of using YouTube. Right now we're using Bunny Stream, but I was wondering if there are better (less independent) ways. I don't have the most experience with DevOps, but I'm running some droplets on Digital Ocean while also using managed databases and Digital Ocean Spaces, so it would be nice if we could integrate our new solution in Digital Ocean as well. Are there any services that take care of transcoding the video while storing it on Digital Ocean Spaces or is this a bad idea altogether?
https://redd.it/11st9aw
@r_devops
Networking Book: TCP/IP Illustrated vs CompTIA Network+
Hi there.
I'm 25M with 1y of backend experience, transitioning to devops/sre. Right now I'm self-studying for 3 months and for this week the plan is to study networking fundamentals. my friend who has 1.5 years of experience in the field is mentoring me.
After I researched a bit on reddit I found that the book
What do you think? Has anyone read both? Any ideas?
https://redd.it/11ufd6b
@r_devops
Hi there.
I'm 25M with 1y of backend experience, transitioning to devops/sre. Right now I'm self-studying for 3 months and for this week the plan is to study networking fundamentals. my friend who has 1.5 years of experience in the field is mentoring me.
After I researched a bit on reddit I found that the book
TCP/IP Illustrated Volume 1: Protocols is a repeated recommendation. I also found a book called CompTIA Network+ Certification N10-007 All-In-One Exam Guide. My mentor saw the outlines of both and said I should read the network+ and after that should look up things that were in the other one but not here and study them. What do you think? Has anyone read both? Any ideas?
https://redd.it/11ufd6b
@r_devops
Reddit
r/devops on Reddit: Networking Book: TCP/IP Illustrated vs CompTIA Network+
Posted by u/mrafee113 - No votes and no comments
Overemployed DevOps - how many of you are rocking two paychecks right now?
A team member mentioned they found r/overemployed and got a second FT job shortly after. I've heard them on their other job's calls a few times in their background audio before they remembered to mute their mic. They never are on camera anymore, unmute their mic, or contribute to any conversations, and slowly get a few projects completed.
Just wondering how prevalent it is in the DevOps world and if any of you have noticed a difference, either as a team member or as the overemployed.
https://redd.it/11ui4y5
@r_devops
A team member mentioned they found r/overemployed and got a second FT job shortly after. I've heard them on their other job's calls a few times in their background audio before they remembered to mute their mic. They never are on camera anymore, unmute their mic, or contribute to any conversations, and slowly get a few projects completed.
Just wondering how prevalent it is in the DevOps world and if any of you have noticed a difference, either as a team member or as the overemployed.
https://redd.it/11ui4y5
@r_devops
Reddit
r/devops on Reddit: Overemployed DevOps - how many of you are rocking two paychecks right now?
Posted by u/Paramourn2 - No votes and 6 comments