Long term Prometheus metric storage
Curious what everyone is using for long term storage of their prometheus metrics. We currently store metrics on disk locally and have also tried Longhorn which has proven to be more trouble that its worth.
Looking to store 30-90 days of metrics and curious what people have worked with in the past for long term metric storage
https://redd.it/11xrcj0
@r_devops
Curious what everyone is using for long term storage of their prometheus metrics. We currently store metrics on disk locally and have also tried Longhorn which has proven to be more trouble that its worth.
Looking to store 30-90 days of metrics and curious what people have worked with in the past for long term metric storage
https://redd.it/11xrcj0
@r_devops
Reddit
r/devops on Reddit: Long term Prometheus metric storage
Posted by u/big-tuna28 - 1 vote and 8 comments
Tips needed: Adopting DevOps for a support team
Hello. We are in the midst of a transformation in our organization, and we are considering the adoption of Agile and DevOps. In line with this, for our team, I've been considering training our group wither via EXIN's DevOps Fundamentals or Devops Institute's DevOps Foundations. Which is better for a team to get acquainted to DevOps? Your advice is going to be very helpful. Thanks!
https://redd.it/11xn0hh
@r_devops
Hello. We are in the midst of a transformation in our organization, and we are considering the adoption of Agile and DevOps. In line with this, for our team, I've been considering training our group wither via EXIN's DevOps Fundamentals or Devops Institute's DevOps Foundations. Which is better for a team to get acquainted to DevOps? Your advice is going to be very helpful. Thanks!
https://redd.it/11xn0hh
@r_devops
Reddit
r/devops on Reddit: Tips needed: Adopting DevOps for a support team
Posted by u/arsenenox - No votes and 1 comment
Salary accurate?
I have been working in devops for about 1.5 years now since I graduated from school. I graduated with a bs in cs and landed this job through connectionsi am currently making between $60k and $70k.
Is this reasonable for someone who had no internship experience? Or am I being low balled?
https://redd.it/11y3ctr
@r_devops
I have been working in devops for about 1.5 years now since I graduated from school. I graduated with a bs in cs and landed this job through connectionsi am currently making between $60k and $70k.
Is this reasonable for someone who had no internship experience? Or am I being low balled?
https://redd.it/11y3ctr
@r_devops
Reddit
r/devops on Reddit: Salary accurate?
Posted by u/Bladedge11 - No votes and 1 comment
How to enable sonarqube code coverage checking using .net framework
Hello Team,
Anyone here have tried to add code coverage checking on their sonar scan for .net? Could you please give me an example on how to do it and what are the requirements for us to do that?
​
Note: I'm using .net framework as a build tool
Thank you team! Have a good day!
https://redd.it/11y46ri
@r_devops
Hello Team,
Anyone here have tried to add code coverage checking on their sonar scan for .net? Could you please give me an example on how to do it and what are the requirements for us to do that?
​
Note: I'm using .net framework as a build tool
Thank you team! Have a good day!
https://redd.it/11y46ri
@r_devops
Reddit
r/devops on Reddit: How to enable sonarqube code coverage checking using .net framework
Posted by u/Logical-Raccoon-7301 - No votes and 1 comment
📣 Understand Probes In Kubernetes - Liveness Probe, Readiness Probe, Startup Probe 📣
This is my 4th video on the Kubernetes series. In today’s video, I will share how to use different probes to check the container health and take actions accordingly.
I will be talking about three probes - Liveness Probe, Readiness Probe and Startup Probe. Finally I will provide one example where I will combine these probes to get most benefit out of these.
📌 Video: https://youtu.be/gahdtHYHbjI
https://redd.it/11xityb
@r_devops
This is my 4th video on the Kubernetes series. In today’s video, I will share how to use different probes to check the container health and take actions accordingly.
I will be talking about three probes - Liveness Probe, Readiness Probe and Startup Probe. Finally I will provide one example where I will combine these probes to get most benefit out of these.
📌 Video: https://youtu.be/gahdtHYHbjI
https://redd.it/11xityb
@r_devops
YouTube
Probes In Kubernetes Liveness Probe, Readiness Probe, Startup Probe
Hello Everyone, welcome to another video on the Kubernetes series. In today’s video, I will share how to use different probes to check the container health and take actions accordingly.
I will be talking about three probes - Liveness Probe, Readiness Probe…
I will be talking about three probes - Liveness Probe, Readiness Probe…
EC2 Instance families interview question
I was asked about the difference between all the EC2 instance families. Are we expected to memorize that? What would you have answered?
https://redd.it/11y7y5v
@r_devops
I was asked about the difference between all the EC2 instance families. Are we expected to memorize that? What would you have answered?
https://redd.it/11y7y5v
@r_devops
Reddit
r/devops on Reddit: EC2 Instance families interview question
Posted by u/HelloNewMe20 - No votes and no comments
Parseable - an open source log observability platform
Hello DevOps community, we've been working on https://github.com/parseablehq/parseable for a while now. Would love to get any feedback, questions etc.
​
Major driver for us to build Parseable, is the acute absence of a developer friendly, simple product to just ingest logs and integrate with current tools in the ecosystem. Parseable is
1. Written in Rust for memory efficiency and performance.
2. Uses Apache Arrow and Parquet for data management.
3. Based on indexing free design for fast ingestion (up to 100K events / sec / node).
4. Uses object storage (like S3) as primary storage system for cost effective storage.
​
Log dashboard in Grafana (powered by Parseable data source): https://demo.parseable.io:3000/d/ojonXSp4z/parseable-demo-data?orgId=1&refresh=1m
Get Started: https://www.parseable.io/docs/
https://redd.it/11y9hpp
@r_devops
Hello DevOps community, we've been working on https://github.com/parseablehq/parseable for a while now. Would love to get any feedback, questions etc.
​
Major driver for us to build Parseable, is the acute absence of a developer friendly, simple product to just ingest logs and integrate with current tools in the ecosystem. Parseable is
1. Written in Rust for memory efficiency and performance.
2. Uses Apache Arrow and Parquet for data management.
3. Based on indexing free design for fast ingestion (up to 100K events / sec / node).
4. Uses object storage (like S3) as primary storage system for cost effective storage.
​
Log dashboard in Grafana (powered by Parseable data source): https://demo.parseable.io:3000/d/ojonXSp4z/parseable-demo-data?orgId=1&refresh=1m
Get Started: https://www.parseable.io/docs/
https://redd.it/11y9hpp
@r_devops
GitHub
GitHub - parseablehq/parseable: Parseable is an observability datalake built from first principles.
Parseable is an observability datalake built from first principles. - parseablehq/parseable
Professional over thinker doing a job interview
Hello, so recently i applied to a DevOps engineer position as a joke with friends. I actually have a decent background on both for someone who hasn't been highered yet. I got this test, where i have to make an automated currency converter that uses an intermediary currency, so if the user selects USD to EUR, i have to do something like this USD -> MXN -> EUR. Every decimal point after the second decimal point is "mine" to keep. But i also have to find which intermediary is the best for the customer and which is the best for me.
I finished the projects in around 3 hours, with bug fixing taking about 45minutes and searching for a good API took about 30minutes. So in total i spent time codin was around 1.75h? It's around 60 lines. A friend said he wouldn't use any imports except the requests import, to show skill. Currently I'm importing math (only for trunc() function) and pandas and IPython.display to create the table and display it in the console, since for somereason pandas style function didn't work.
Is it better for me to not use imports to do it, or is it better?
To people asking why I'm doing the test, its because I'm bored at home and like a little challenge.
https://imgur.com/a/mpP367o heres a view of the code. I haven't taken the time to make it look better yet, since i decided to hit the hay once i got it working properly.
https://redd.it/11y8erp
@r_devops
Hello, so recently i applied to a DevOps engineer position as a joke with friends. I actually have a decent background on both for someone who hasn't been highered yet. I got this test, where i have to make an automated currency converter that uses an intermediary currency, so if the user selects USD to EUR, i have to do something like this USD -> MXN -> EUR. Every decimal point after the second decimal point is "mine" to keep. But i also have to find which intermediary is the best for the customer and which is the best for me.
I finished the projects in around 3 hours, with bug fixing taking about 45minutes and searching for a good API took about 30minutes. So in total i spent time codin was around 1.75h? It's around 60 lines. A friend said he wouldn't use any imports except the requests import, to show skill. Currently I'm importing math (only for trunc() function) and pandas and IPython.display to create the table and display it in the console, since for somereason pandas style function didn't work.
Is it better for me to not use imports to do it, or is it better?
To people asking why I'm doing the test, its because I'm bored at home and like a little challenge.
https://imgur.com/a/mpP367o heres a view of the code. I haven't taken the time to make it look better yet, since i decided to hit the hay once i got it working properly.
https://redd.it/11y8erp
@r_devops
Imgur
Discover the magic of the internet at Imgur, a community powered entertainment destination. Lift your spirits with funny jokes, trending memes, entertaining gifs, inspiring stories, viral videos, and so much more from users.
The DevOps Conference happening now - and it's free
People who want to listen to speeches and go to conferences, see www.thedevopsconference.com. Registration is required but it's free to join. Live program for two days.
If you think this counts as vendor spam (rule #4), please let me know and I'll remove the post.
https://redd.it/11ybf0z
@r_devops
People who want to listen to speeches and go to conferences, see www.thedevopsconference.com. Registration is required but it's free to join. Live program for two days.
If you think this counts as vendor spam (rule #4), please let me know and I'll remove the post.
https://redd.it/11ybf0z
@r_devops
Reddit
r/devops on Reddit: The DevOps Conference happening now - and it's free
Posted by u/lpalokan - No votes and no comments
Need help with career decision!
Currently I'm working as a junior cloud engineer (Azure) with 9 months of cloud experience and a overall professional working experience of 2+ years.
The reason I'm looking for a switch is, my company decided to shutdown the cloud dept as it was a startup. Currently serving my notice period.
I have worked on couple of projects and have to knowledge of Azure DevOps, ansible and gitlab.
Should I look for a switch in DevOps or look for a similar job opportunity?
Please share your view.
https://redd.it/11ycstv
@r_devops
Currently I'm working as a junior cloud engineer (Azure) with 9 months of cloud experience and a overall professional working experience of 2+ years.
The reason I'm looking for a switch is, my company decided to shutdown the cloud dept as it was a startup. Currently serving my notice period.
I have worked on couple of projects and have to knowledge of Azure DevOps, ansible and gitlab.
Should I look for a switch in DevOps or look for a similar job opportunity?
Please share your view.
https://redd.it/11ycstv
@r_devops
Reddit
r/devops on Reddit: Need help with career decision!
Posted by u/moon_knight01 - No votes and no comments
Digger - an open-source Terraform Cloud Alternative (Now in Golang)
Digger is a Github Action that runs Terraform plan and apply with PR-level locks. The idea is that terraform jobs run natively in your Github Actions - no need to share sensitive data with another CI system. There's no need to deploy and maintain a backend service either. We migrated from Python to Golang yesterday. None of the team had experience with golang, but we managed to migrate in a week. Here's why we did it:
* Faster runtimes (upto 30x faster)
* Can be compiled into single binary, advantages for Github actions is that we don’t need to wrap action into Dockerfile.
* Easy to compile binary to multiple platforms, it helps us run from same codebase.
* Interface based development , more guarantees about the code correctness by the compiler when compared to using Python.
* Golang is more popular in the DevOps and infrastructure community, we can find several libraries and reuse them in our code.
Here is the link to the repo - [https://github.com/diggerhq/digger](https://github.com/diggerhq/digger).
Seeking feedback from the community on how our code quality is. Please be as critical as possible! :)
https://redd.it/11ye153
@r_devops
Digger is a Github Action that runs Terraform plan and apply with PR-level locks. The idea is that terraform jobs run natively in your Github Actions - no need to share sensitive data with another CI system. There's no need to deploy and maintain a backend service either. We migrated from Python to Golang yesterday. None of the team had experience with golang, but we managed to migrate in a week. Here's why we did it:
* Faster runtimes (upto 30x faster)
* Can be compiled into single binary, advantages for Github actions is that we don’t need to wrap action into Dockerfile.
* Easy to compile binary to multiple platforms, it helps us run from same codebase.
* Interface based development , more guarantees about the code correctness by the compiler when compared to using Python.
* Golang is more popular in the DevOps and infrastructure community, we can find several libraries and reuse them in our code.
Here is the link to the repo - [https://github.com/diggerhq/digger](https://github.com/diggerhq/digger).
Seeking feedback from the community on how our code quality is. Please be as critical as possible! :)
https://redd.it/11ye153
@r_devops
GitHub
GitHub - diggerhq/digger: Digger is an open source IaC orchestration tool. Digger allows you to run IaC in your existing CI pipeline…
Digger is an open source IaC orchestration tool. Digger allows you to run IaC in your existing CI pipeline ⚡️ - diggerhq/digger
Any tool to automatically containerize Jenkins jobs for future use in other tools?
So, I've heard about Dagger.io, but it's not gonna work out for me. The thing is, I've got a heck load of old and established jobs on Jenkins. Now, what I'm wondering is if there's some awesome tool or trick out there that'll let me put those jobs/stages into containers, so I can run them on a different platform without any hiccups?
https://redd.it/11ye9l3
@r_devops
So, I've heard about Dagger.io, but it's not gonna work out for me. The thing is, I've got a heck load of old and established jobs on Jenkins. Now, what I'm wondering is if there's some awesome tool or trick out there that'll let me put those jobs/stages into containers, so I can run them on a different platform without any hiccups?
https://redd.it/11ye9l3
@r_devops
Reddit
r/devops on Reddit: Any tool to automatically containerize Jenkins jobs for future use in other tools?
Posted by u/MarriottsRidge - No votes and no comments
DO, tf Assign already existing firewall to a new droplets
Hi all,
I want when create a new droplet using terraform (on DigitalOcean) to assign the droplet to a firewall but struggling to understand where my issue is.
​
Thanks.
https://redd.it/11yhobg
@r_devops
Hi all,
I want when create a new droplet using terraform (on DigitalOcean) to assign the droplet to a firewall but struggling to understand where my issue is.
​
Thanks.
https://redd.it/11yhobg
@r_devops
Reddit
r/devops on Reddit: [DO, tf] Assign already existing firewall to a new droplets
Posted by u/NedkoHristov - No votes and no comments
Buy vs. build - any tips or frameworks to prepare the decision for mgmt?
There are a few concepts out there, but nothing seems widely accepted. How did you go about this? What's the most important pitfall to avoid?
https://www.talon.one/lp/build-or-buy
https://www.windwardstudios.com/white-papers/build-buy-software-development
https://www.chameleon.io/blog/build-vs-buy
https://divbyzero.com/blog/build-vs-buy/
https://redd.it/11yft6b
@r_devops
There are a few concepts out there, but nothing seems widely accepted. How did you go about this? What's the most important pitfall to avoid?
https://www.talon.one/lp/build-or-buy
https://www.windwardstudios.com/white-papers/build-buy-software-development
https://www.chameleon.io/blog/build-vs-buy
https://divbyzero.com/blog/build-vs-buy/
https://redd.it/11yft6b
@r_devops
www.talon.one
Build or buy your promotion software | Talon.One
Learn about the opportunities and threats of building your promotion software in-house. Decision-making made easy.
DevOps vs Platform Engineering
Me trying to explain the difference between DevOps and Platform Engineering in 3 Minutes.
Enjoy
https://youtu.be/JAblex0uS4k
https://redd.it/11xsbae
@r_devops
Me trying to explain the difference between DevOps and Platform Engineering in 3 Minutes.
Enjoy
https://youtu.be/JAblex0uS4k
https://redd.it/11xsbae
@r_devops
YouTube
DevOps vs Platform Engineering
Today we'll be discussing the differences between DevOps and platform engineering.
There are various definitions for DevOps and Platform Engineering. This video will be mainly based on my experiences as software engineer working in the DevOps/platform engineering…
There are various definitions for DevOps and Platform Engineering. This video will be mainly based on my experiences as software engineer working in the DevOps/platform engineering…
Any good online text editors?
I'm getting so lazy I don't even want to have to open an application for basic text editing :) Something that loads up from a link without logging in and has basic find and replace, maybe line join and even regex find and replace.
I have been using https://onlinenotepad.org/ but I wondered if there was something that offers slightly more functionality and doesn't look like it was made in 2003.
​
https://redd.it/11xoa7w
@r_devops
I'm getting so lazy I don't even want to have to open an application for basic text editing :) Something that loads up from a link without logging in and has basic find and replace, maybe line join and even regex find and replace.
I have been using https://onlinenotepad.org/ but I wondered if there was something that offers slightly more functionality and doesn't look like it was made in 2003.
​
https://redd.it/11xoa7w
@r_devops
onlinenotepad.org
Online Notepad - Write and Save Notes Quickly
Online Notepad is a browser based plain text editor with autosave functionality. It provides a more convenient way of writing down notes on the go.
Elite vs. Low Performing DevOps Teams: How good is your DevOps team?
How good is your DevOps team? You can find out where you stand on the software delivery performance scale - elite, low performing, or somewhere in between. Vote below, and let's see where we all stand. Let's together have an open discussion about the #DORA Metrics. Let's see if these metrics actually empower and enable our DevOps teams or are these metrics just BS, easily manipulatable KPI's for micromanaging teams or is this just good old marketing tricks.
Here's the \#google #DORA Report!
View Poll
https://redd.it/11xnep6
@r_devops
How good is your DevOps team? You can find out where you stand on the software delivery performance scale - elite, low performing, or somewhere in between. Vote below, and let's see where we all stand. Let's together have an open discussion about the #DORA Metrics. Let's see if these metrics actually empower and enable our DevOps teams or are these metrics just BS, easily manipulatable KPI's for micromanaging teams or is this just good old marketing tricks.
Here's the \#google #DORA Report!
View Poll
https://redd.it/11xnep6
@r_devops
Google Cloud Blog
Use Four Keys metrics like change failure rate to measure your DevOps performance | Google Cloud Blog
Learn how the Four Keys open source project lets you gauge your DevOps performance according to DORA metrics.
Multicluster Prometheus question
Hello everybody.
I'm in the process of moving our projects from VM to k8s. In our new k8s setup we want to implement multi-cluster, multi-cloud infrastructure. So far, so good. Everything seems understandable and reasonable, except monitoring.
I have never used Prometheus before. Our company used TIG stack with VMs, which we found reliable and easy to use.
So, we need to collect metrics from both clusters. As far as I understood, we need to setup some external service to collect those metrics. I found info about different agents, Telegraf Prometheus plugin, Thanos, Prometheus Federation, etc. But I don't understand, why we can't just connect Prometheus services as backends to Grafana and collect metrics without proxy services? I know that Prometheus is stateful app, so if it goes down, historical data could be lost. For us it is not a big deal, because all necessary metrics we collect and store in external ELK stack.
So what are cons of using Prometheus connected directly to Grafana?
https://redd.it/11weolz
@r_devops
Hello everybody.
I'm in the process of moving our projects from VM to k8s. In our new k8s setup we want to implement multi-cluster, multi-cloud infrastructure. So far, so good. Everything seems understandable and reasonable, except monitoring.
I have never used Prometheus before. Our company used TIG stack with VMs, which we found reliable and easy to use.
So, we need to collect metrics from both clusters. As far as I understood, we need to setup some external service to collect those metrics. I found info about different agents, Telegraf Prometheus plugin, Thanos, Prometheus Federation, etc. But I don't understand, why we can't just connect Prometheus services as backends to Grafana and collect metrics without proxy services? I know that Prometheus is stateful app, so if it goes down, historical data could be lost. For us it is not a big deal, because all necessary metrics we collect and store in external ELK stack.
So what are cons of using Prometheus connected directly to Grafana?
https://redd.it/11weolz
@r_devops
Reddit
r/devops on Reddit: Multicluster Prometheus question
Posted by u/sr_dayne - 2 votes and 2 comments
Using project management and DevOps tools for M365 migrations
I'm new to DevOps and I just want to know Is it possible to use project management and DevOps tools for M365 migrations? If so how to use them effectively?
https://redd.it/11wi792
@r_devops
I'm new to DevOps and I just want to know Is it possible to use project management and DevOps tools for M365 migrations? If so how to use them effectively?
https://redd.it/11wi792
@r_devops
Reddit
r/devops on Reddit: Using project management and DevOps tools for M365 migrations
Posted by u/sonaldag - 1 vote and 2 comments
git: 'submodule' is not a git command ONLY when running through Jenkins
I am adding a Windows worker to my Jenkins instance but hitting some issues with Git, this issue occurs when using
I can run any other git command just fine, I can run it as the fully qualified executable path or just
Running
I have no clue why or how this issue could be occuring, any insight would be appreciated.
When run via Jenkins:
When run on the host:
https://redd.it/11whhop
@r_devops
I am adding a Windows worker to my Jenkins instance but hitting some issues with Git, this issue occurs when using
checkout scm in the pipeline or putting git submodule into a bat block. I can run any other git command just fine, I can run it as the fully qualified executable path or just
git with the same results as well. Running
git --version outputs the same version number and I updated from 2.30 to 2.40 without resolving the issue, but both git --version outputs changed so I think I am 100% running the correct git binary via Jenkins.I have no clue why or how this issue could be occuring, any insight would be appreciated.
When run via Jenkins:
C:\Jenkins_Workspace\workspace>"C:\Program Files\Git\cmd\git.exe" submodule
git: 'submodule' is not a git command. See 'git --help'.
When run on the host:
C:\Jenkins_Workspace\workspace>"C:\Program Files\Git\cmd\git.exe" submodule
<listed module here>
https://redd.it/11whhop
@r_devops
Reddit
r/devops on Reddit: git: 'submodule' is not a git command ONLY when running through Jenkins
Posted by u/PipeItToDevNull - No votes and 6 comments
Become your own heru?
Hi all! So we've created a platform that enables connecting to any registry, any vm you have and easily deploy infinite Docker apps while connecting each app to a domain. Oh, and we do all the hard wiring without installing any agents! are looking for first users to help validate it.
www.paunel.com
https://redd.it/11whmsm
@r_devops
Hi all! So we've created a platform that enables connecting to any registry, any vm you have and easily deploy infinite Docker apps while connecting each app to a domain. Oh, and we do all the hard wiring without installing any agents! are looking for first users to help validate it.
www.paunel.com
https://redd.it/11whmsm
@r_devops
Reddit
r/devops on Reddit: Become your own her**u?
Posted by u/WindArtas - No votes and 9 comments