FYI to anyone running Terraform on a Mac, you may need to re-install it
https://discuss.hashicorp.com/t/hcsec-2023-01-hashicorp-response-to-circleci-security-alert/48842/4
https://redd.it/12zki4z
@r_devops
https://discuss.hashicorp.com/t/hcsec-2023-01-hashicorp-response-to-circleci-security-alert/48842/4
https://redd.it/12zki4z
@r_devops
HashiCorp Discuss
HCSEC-2023-01 - HashiCorp Response to CircleCI Security Alert
Bulletin ID: HCSEC-2023-01 Publication Date: January 11, 2023 Summary CircleCI Security Alert On January 4, 2023, CircleCI published a security alert in which they recommended that their customers immediately rotate any and all secrets stored in CircleCI.…
Front End Observability with Grafana Faro
Grafana made its Frontend Observability tooling in Grafana Cloud available as public preview 2 days ago (24th April). This effectively is their open source frontend library Grafana Faro and Grafana Agent receiving the data and passing it on to Loki and Tempo. Could be a nice addition instead of sentry or new relic if Grafana tooling is already deployed.
An introduction and examples with some screenshots:
https://blog.mayflower.de/15107-grafana-faro-frontend-observability.html
https://redd.it/12zkey6
@r_devops
Grafana made its Frontend Observability tooling in Grafana Cloud available as public preview 2 days ago (24th April). This effectively is their open source frontend library Grafana Faro and Grafana Agent receiving the data and passing it on to Loki and Tempo. Could be a nice addition instead of sentry or new relic if Grafana tooling is already deployed.
An introduction and examples with some screenshots:
https://blog.mayflower.de/15107-grafana-faro-frontend-observability.html
https://redd.it/12zkey6
@r_devops
Mayflower Blog
Frontend Observability with Grafana Faro
Grafana Faro allows to observe the frontend of a web application. For teams making use of the full Grafana stack, Faro integrates seamlessly.
Looking for a tutor to help in a project involving Docker, AWS, Kubernetes and EKS, Kafka and publish-subscribe, Circuit breaker and bulkheads
I have developed a Node.js application using MySQL database, and I need to dockerize it, and deploy it to AWS using a provided CloudFormation template. I also need to:
* Move the containers to Kubernetes (K8S) using Amazon’s Elastic Kubernetes Service (EKS).
* Use a K8S liveness probe to monitor services.
* Book service will call an external recommendation engine (external service that will be provided).
* Create a circuit breaker for the interaction with the external service.
* Define an asynchronous messaging interaction using Kafka (Kafka cluster will be provided) and create a Kafka consumer (asynchronous service) that will send an email to newly registered customers.
Can anyone help me with this? I need to get this done soon, and I'm seriously overwhelmed. Please don't tell me to spend some weeks to learn everything first, I really don't have much time that's why I need a private tutor. Willing to pay.
If there is anyone who can help me in these tasks, I would be super grateful. Also if this isn't the right place for this post, please guide me to where I can get help. Thanks in advance!
https://redd.it/12zt0o6
@r_devops
I have developed a Node.js application using MySQL database, and I need to dockerize it, and deploy it to AWS using a provided CloudFormation template. I also need to:
* Move the containers to Kubernetes (K8S) using Amazon’s Elastic Kubernetes Service (EKS).
* Use a K8S liveness probe to monitor services.
* Book service will call an external recommendation engine (external service that will be provided).
* Create a circuit breaker for the interaction with the external service.
* Define an asynchronous messaging interaction using Kafka (Kafka cluster will be provided) and create a Kafka consumer (asynchronous service) that will send an email to newly registered customers.
Can anyone help me with this? I need to get this done soon, and I'm seriously overwhelmed. Please don't tell me to spend some weeks to learn everything first, I really don't have much time that's why I need a private tutor. Willing to pay.
If there is anyone who can help me in these tasks, I would be super grateful. Also if this isn't the right place for this post, please guide me to where I can get help. Thanks in advance!
https://redd.it/12zt0o6
@r_devops
Reddit
r/devops on Reddit: Looking for a tutor to help in a project involving Docker, AWS, Kubernetes and EKS, Kafka and publish-subscribe…
Posted by u/Shiningstar999 - No votes and no comments
Self-Hosted, Distributed, No-code Performance Testing Platform
Hello Everyone,
Last year, we released the Ddosify Engine, a high-performance load testing tool on GitHub. With its simplicity and powerful features, it quickly gained nearly 7K stars. During this time, we actively engaged with Ddosify users to understand how we could further simplify the performance testing process. The most common feedback indicated the need for an easy-to-use with No-code UI and distributed performance testing platform.
We are thrilled to announce the release of Ddosify Self-Hosted on GitHub today. Unlike the Ddosify Engine, this version features a No-code UI and supports distributed traffic generation.
Here are some key features of Ddosify Self-Hosted:
Postman Import: Seamlessly import Postman collections and convert them into load testing scenarios.
Correlation: Extract variables from previous phases and pass them on to subsequent ones.
Assertion: Ensure response data meets your expectations.
Debugging: Examine request and response data before initiating the load test.
Environments: Save constant values as environment variables.
CSV Data Import: Import test data from CSV files and incorporate it into the scenario.
We have spent months developing this product and are eager to hear your thoughts. Thank you in advance for any feedback you can provide!
https://redd.it/12ztjvn
@r_devops
Hello Everyone,
Last year, we released the Ddosify Engine, a high-performance load testing tool on GitHub. With its simplicity and powerful features, it quickly gained nearly 7K stars. During this time, we actively engaged with Ddosify users to understand how we could further simplify the performance testing process. The most common feedback indicated the need for an easy-to-use with No-code UI and distributed performance testing platform.
We are thrilled to announce the release of Ddosify Self-Hosted on GitHub today. Unlike the Ddosify Engine, this version features a No-code UI and supports distributed traffic generation.
Here are some key features of Ddosify Self-Hosted:
Postman Import: Seamlessly import Postman collections and convert them into load testing scenarios.
Correlation: Extract variables from previous phases and pass them on to subsequent ones.
Assertion: Ensure response data meets your expectations.
Debugging: Examine request and response data before initiating the load test.
Environments: Save constant values as environment variables.
CSV Data Import: Import test data from CSV files and incorporate it into the scenario.
We have spent months developing this product and are eager to hear your thoughts. Thank you in advance for any feedback you can provide!
https://redd.it/12ztjvn
@r_devops
GitHub
GitHub - getanteon/anteon: Anteon (formerly Ddosify): eBPF-based Kubernetes Monitoring and Performance Testing
Anteon (formerly Ddosify): eBPF-based Kubernetes Monitoring and Performance Testing - getanteon/anteon
DevOps - Bait and Switch
Hey All,
I'm coming from a developer background and recently joined a F500 in a DevOps role. For some context, I worked as a full-stack developer for approximately 3 years in a startup with a completely cloud-native environment where I gained a lot of hands on Azure experience. While working I also obtained 2 Azure certs.
I recently went through the job hunt, and got an offer approximately 3 months ago with the for a DevOps role to work on AWS (current job). I figured it would be an interesting challenge and allow me to learn a new cloud provider while building skills in a larger organization. Unfortunately however, I feel like it was a bait and switch.
Upon joining the team and getting to know the application and systems, it turns out that the team I am working with is completely on-prem trying to migrate a legacy application to microservices for almost 2 years without any definite forecast in the short/medium term to actually deploy them to AWS. The interview and the job description mentioned most of the work will be AWS based. Right now it feels like a SysAdmin role, which isn't exactly what I was expecting.
On the positive, I am learning a ton about networking and on-prem infrastructure, but I am worried my cloud skills, and by extension dev skills (since there isn't much allowance for any programming due to the organizational structure) will start to decay. What should I do in a situation like this? Should I stick it out? I currently have another offer for a full-stack dev role, although, the pay is slightly less.
Thanks for any feedback!
https://redd.it/12zvj2a
@r_devops
Hey All,
I'm coming from a developer background and recently joined a F500 in a DevOps role. For some context, I worked as a full-stack developer for approximately 3 years in a startup with a completely cloud-native environment where I gained a lot of hands on Azure experience. While working I also obtained 2 Azure certs.
I recently went through the job hunt, and got an offer approximately 3 months ago with the for a DevOps role to work on AWS (current job). I figured it would be an interesting challenge and allow me to learn a new cloud provider while building skills in a larger organization. Unfortunately however, I feel like it was a bait and switch.
Upon joining the team and getting to know the application and systems, it turns out that the team I am working with is completely on-prem trying to migrate a legacy application to microservices for almost 2 years without any definite forecast in the short/medium term to actually deploy them to AWS. The interview and the job description mentioned most of the work will be AWS based. Right now it feels like a SysAdmin role, which isn't exactly what I was expecting.
On the positive, I am learning a ton about networking and on-prem infrastructure, but I am worried my cloud skills, and by extension dev skills (since there isn't much allowance for any programming due to the organizational structure) will start to decay. What should I do in a situation like this? Should I stick it out? I currently have another offer for a full-stack dev role, although, the pay is slightly less.
Thanks for any feedback!
https://redd.it/12zvj2a
@r_devops
Reddit
r/devops on Reddit: DevOps - Bait and Switch
Posted by u/newhere006 - No votes and 4 comments
For everyone doing their client work - what are your rates and how do you even determine what your rate is?
Hi everyone,
I’ve done work for clients through agencies before with the agency even paying me market rates. That being said, how do you figure out what rate the agency is charging the client? If you’re doing work for clients directly, what rates are you charging? I might have an opportunity coming up to do work directly for a startup so I’m trying to find resources on what to charge - I definitely don’t want to sell myself short.
https://redd.it/12zzu9c
@r_devops
Hi everyone,
I’ve done work for clients through agencies before with the agency even paying me market rates. That being said, how do you figure out what rate the agency is charging the client? If you’re doing work for clients directly, what rates are you charging? I might have an opportunity coming up to do work directly for a startup so I’m trying to find resources on what to charge - I definitely don’t want to sell myself short.
https://redd.it/12zzu9c
@r_devops
Reddit
r/devops on Reddit: For everyone doing their client work - what are your rates and how do you even determine what your rate is?
Posted by u/saalih416 - No votes and no comments
Are these good replacements ageing software?
I'm thinking of replacing a very old set of observability tools with a more modern and supportable set of tools. The original tools were hacked together 7 years ago but none of the original staff are around to update them or grow them into the new requirements we have - namely lots more data of every kind and multiple new data sources. the systems keep running out of storage or manual intervention way too much of the time We currently have a mixture of NxLog, LogStash, Metricus, Graphite, and Logic Monitor plus we have metrics feeding in from third-party systems. I'm thinking of using :
- fluentd to replace nxlog, logstash, metricus
- a Prometheus server to replace graphite storage and Riemann filters
- and then everything feeds off the central Prometheus server for alerting and shipping and reporting for instance to pager duty/splunk ops and Azure storage for long-term archive.
What do you think?
https://redd.it/1300hvw
@r_devops
I'm thinking of replacing a very old set of observability tools with a more modern and supportable set of tools. The original tools were hacked together 7 years ago but none of the original staff are around to update them or grow them into the new requirements we have - namely lots more data of every kind and multiple new data sources. the systems keep running out of storage or manual intervention way too much of the time We currently have a mixture of NxLog, LogStash, Metricus, Graphite, and Logic Monitor plus we have metrics feeding in from third-party systems. I'm thinking of using :
- fluentd to replace nxlog, logstash, metricus
- a Prometheus server to replace graphite storage and Riemann filters
- and then everything feeds off the central Prometheus server for alerting and shipping and reporting for instance to pager duty/splunk ops and Azure storage for long-term archive.
What do you think?
https://redd.it/1300hvw
@r_devops
Reddit
r/devops on Reddit: Are these good replacements ageing software?
Posted by u/throwingaway239023 - No votes and 1 comment
Varnish in front of IIS
This is a really stupid question from someone not super experienced with backend / devops but:
I think varnish is a caching reverse proxy right? So am I right in that you would need one single instance in front of each webserver instance (eg a container)?
Or is it one instance one front of ALL webserver instances? confused. Thx.
https://redd.it/1300ej0
@r_devops
This is a really stupid question from someone not super experienced with backend / devops but:
I think varnish is a caching reverse proxy right? So am I right in that you would need one single instance in front of each webserver instance (eg a container)?
Or is it one instance one front of ALL webserver instances? confused. Thx.
https://redd.it/1300ej0
@r_devops
Reddit
r/devops on Reddit: Varnish in front of IIS
Posted by u/yennedy - No votes and 3 comments
Was told "<tool> can be configured with <language> because it is written in <language>", am skeptical.
Hi all,
Unsure of where to ask about this, but since I was told the following during a DevOps bootcamp I thought I'd try my luck here.
Often, the last time being when teaching Kubernetes, a teacher told my class that "this tool is written in some programming language, which explains why it can be easily configured using the same language, or why it is more compatible with some other software which has ties to said language".
This quote is as vague as it was originally told, the teacher in question said this multiple times in various ways, and isn't the best of speakers.
I am skeptical about that statement.
Surely, once code is compiled the resulting binary becomes completely independent of the language it was originally programmed with?
What would make sense to me is "this tool includes an API which was developed to be especially easy to use with the same language it was written with".
Kubernetes is written in GO, and so is Podman. But that alone doesn't make them particularly compatible? This compatibility would come from the developers' design choice, right?
https://redd.it/1303yuf
@r_devops
Hi all,
Unsure of where to ask about this, but since I was told the following during a DevOps bootcamp I thought I'd try my luck here.
Often, the last time being when teaching Kubernetes, a teacher told my class that "this tool is written in some programming language, which explains why it can be easily configured using the same language, or why it is more compatible with some other software which has ties to said language".
This quote is as vague as it was originally told, the teacher in question said this multiple times in various ways, and isn't the best of speakers.
I am skeptical about that statement.
Surely, once code is compiled the resulting binary becomes completely independent of the language it was originally programmed with?
What would make sense to me is "this tool includes an API which was developed to be especially easy to use with the same language it was written with".
Kubernetes is written in GO, and so is Podman. But that alone doesn't make them particularly compatible? This compatibility would come from the developers' design choice, right?
https://redd.it/1303yuf
@r_devops
Reddit
r/devops on Reddit: Was told "<tool> can be configured with <language> because it is written in <language>", am skeptical.
Posted by u/Tabouret- - No votes and no comments
Writing a Kubernetes Network Plugin (CNI) in Rust
https://thetechtrailblazer.blog/2023/04/27/writing-a-kubernetes-network-plugin-cni-in-rust/
https://redd.it/1303q6q
@r_devops
https://thetechtrailblazer.blog/2023/04/27/writing-a-kubernetes-network-plugin-cni-in-rust/
https://redd.it/1303q6q
@r_devops
The Tech Trailblazer
Writing a Kubernetes Network Plugin (CNI) in Rust
You can check the plugin yourself here, or fork it and use it as a boilerplate to start your own rust CNI plugin. During writing my rust operator, I was intrigued about how the underlying networkin…
Help: Docerkize IIS app and SQL server with windows authentication
I have .net4.5 and used Docker to run asp.net on IIS app using windows server core image. But how do I containerize a SQLsever db with windows authentication?
https://redd.it/12zyo5f
@r_devops
I have .net4.5 and used Docker to run asp.net on IIS app using windows server core image. But how do I containerize a SQLsever db with windows authentication?
https://redd.it/12zyo5f
@r_devops
Reddit
r/devops on Reddit: Help: Docerkize IIS app and SQL server with windows authentication
Posted by u/v3-3y - 2 votes and 3 comments
How do you manage your container lifecycle?
I wrote some notes since it seems nontrivial to clean up old images without mutating the tag. Am I missing something please? https://dabase.com/blog/2023/container-lifecycle/
https://redd.it/1302hwu
@r_devops
I wrote some notes since it seems nontrivial to clean up old images without mutating the tag. Am I missing something please? https://dabase.com/blog/2023/container-lifecycle/
https://redd.it/1302hwu
@r_devops
Dabase
Container Lifecycle
Container repository tagging for Build Once, Deploy Anywhere
Learnings from integrating JMX based metrics from Java applications into time series databases
https://last9.io/blog/learnings-integrating-jmxtrans/
https://redd.it/1308y1v
@r_devops
https://last9.io/blog/learnings-integrating-jmxtrans/
https://redd.it/1308y1v
@r_devops
last9.io
Learnings integrating jmxtrans
JMX metrics give solid insights into the workings of your application. Integrating them with Levitate (our time series data warehosue) required us to jump some hoops with vmagent.
Is "Certified GitOps Associate" a joke or desperate attempt by CNCF?
Why does CNCF the want to sell certs so desperately?
https://redd.it/1309zrg
@r_devops
Why does CNCF the want to sell certs so desperately?
https://redd.it/1309zrg
@r_devops
Reddit
r/devops on Reddit: Is "Certified GitOps Associate" a joke or desperate attempt by CNCF?
Posted by u/IamOkei - No votes and no comments
Can Google Enteprise enforce hardware MFA?
Does anyone use google workspace enteprise know if they allow to enforce hardware MFA only?
https://redd.it/12zzmqi
@r_devops
Does anyone use google workspace enteprise know if they allow to enforce hardware MFA only?
https://redd.it/12zzmqi
@r_devops
Reddit
r/devops on Reddit: Can Google Enteprise enforce hardware MFA?
Posted by u/banhloc - No votes and 1 comment
Best courses to learn python specifically for devops
I am doing sysadmin things in my organization and I've heard everywhere that one cannot survive in devops without scripting knowledge either bash or python.
I know neither of them but want to learn one and picked python first. I don't want to learn in deep or i don't know if i should learn it deep.
I am from a non technical field just entered into the software industry so it'll be quite hard.
Is there any courses where can I learn python specifically for devops? Like for automation and scripting. I've heard that automate the boring stuff with python is good but would that be suitable for me as i am from non tech field and have low critical thinking ability? What are your recommended courses and what's your advice for me?
https://redd.it/130c6vu
@r_devops
I am doing sysadmin things in my organization and I've heard everywhere that one cannot survive in devops without scripting knowledge either bash or python.
I know neither of them but want to learn one and picked python first. I don't want to learn in deep or i don't know if i should learn it deep.
I am from a non technical field just entered into the software industry so it'll be quite hard.
Is there any courses where can I learn python specifically for devops? Like for automation and scripting. I've heard that automate the boring stuff with python is good but would that be suitable for me as i am from non tech field and have low critical thinking ability? What are your recommended courses and what's your advice for me?
https://redd.it/130c6vu
@r_devops
Reddit
r/devops on Reddit: Best courses to learn python specifically for devops
Posted by u/Neither_Wallaby_9033 - No votes and no comments
Monitor Logs From an Agent in Icinga2
I'm currently using Icinga2 for a distributed monitoring solution, in a master-agent configuration. I've looked into using the built-in logfiles plugin ([https://icinga.com/docs/icinga-2/latest/doc/10-icinga-template-library/#logfiles](https://icinga.com/docs/icinga-2/latest/doc/10-icinga-template-library/#logfiles)), but have found no success in getting it to parse through the requested logfile on the agent server.
Here's the curent configuration within \`/etc/icinga2/zones.d/master/cpanel.conf\` on the master server:
object Service "cpanel-backup" {
import "generic-service"
host_name = "cpanel29.dbl-mail.com"
check_command = "logfiles"
vars.logfiles_logfile ="/var/log/borgbackup.log"
vars.logfiles_critical_pattern = "error:"
command_endpoint = host.vars.agent_endpoint
}
Any ideas on what I'm doing wrong?
0 comments
https://redd.it/12zyusc
@r_devops
I'm currently using Icinga2 for a distributed monitoring solution, in a master-agent configuration. I've looked into using the built-in logfiles plugin ([https://icinga.com/docs/icinga-2/latest/doc/10-icinga-template-library/#logfiles](https://icinga.com/docs/icinga-2/latest/doc/10-icinga-template-library/#logfiles)), but have found no success in getting it to parse through the requested logfile on the agent server.
Here's the curent configuration within \`/etc/icinga2/zones.d/master/cpanel.conf\` on the master server:
object Service "cpanel-backup" {
import "generic-service"
host_name = "cpanel29.dbl-mail.com"
check_command = "logfiles"
vars.logfiles_logfile ="/var/log/borgbackup.log"
vars.logfiles_critical_pattern = "error:"
command_endpoint = host.vars.agent_endpoint
}
Any ideas on what I'm doing wrong?
0 comments
https://redd.it/12zyusc
@r_devops
Reddit
r/devops on Reddit: Monitor Logs From an Agent in Icinga2
Posted by u/Yibro99 - 1 vote and no comments
Using GPT to Analyze Cloud Security Issues
https://www.selefra.io/blog/using-gpt-to-analyze-cloud-security-issues-by-selefra-clgyrzjyn1132812znjv2pvoxip
https://redd.it/130esi8
@r_devops
https://www.selefra.io/blog/using-gpt-to-analyze-cloud-security-issues-by-selefra-clgyrzjyn1132812znjv2pvoxip
https://redd.it/130esi8
@r_devops
Selefra
Using GPT to Analyze Cloud Security Issues by Selefra
In today's digital age, cloud security has become an increasingly important task. Countless cloud se..
What are the most important DevOps conferences this year?
I'm curious what are the most interesting/important/influential DevOps related conferences happening this year? Job let's me pick one and pay for travel and the ticket so definitely planning to use that perk, just not sure on what.
https://redd.it/130gsk4
@r_devops
I'm curious what are the most interesting/important/influential DevOps related conferences happening this year? Job let's me pick one and pay for travel and the ticket so definitely planning to use that perk, just not sure on what.
https://redd.it/130gsk4
@r_devops
Reddit
r/devops on Reddit: What are the most important DevOps conferences this year?
Posted by u/ntech2 - No votes and no comments
Remote DevOps salaries poll
Hi, this one is for DevOps engineers who work remotely, I'm curious to see what are your salaries? Where are you from and where is your employer located? Do you work on a b2b contract basis or are you fully employed? Thanks!
I'll start:
q| a
---|---
Your location| E.Europe(Latvia)
Employer location| E.Europe(Latvia)
Contract or Full time| Full time employment
Years of relevant experience| 5
Salary(gross/net)| 50k EUR (55k USD) which is ~35k EUR after tax.
https://redd.it/130gcc4
@r_devops
Hi, this one is for DevOps engineers who work remotely, I'm curious to see what are your salaries? Where are you from and where is your employer located? Do you work on a b2b contract basis or are you fully employed? Thanks!
I'll start:
q| a
---|---
Your location| E.Europe(Latvia)
Employer location| E.Europe(Latvia)
Contract or Full time| Full time employment
Years of relevant experience| 5
Salary(gross/net)| 50k EUR (55k USD) which is ~35k EUR after tax.
https://redd.it/130gcc4
@r_devops
Reddit
r/devops on Reddit: Remote DevOps salaries poll
Posted by u/ntech2 - No votes and 1 comment
Scaling RabbitMQ
Hey guys!
Currently facing the use case where our RabbitMQ cluster (3 nodes, all quorom queues) has to handle 80k-100k events per second. We've reached situations where the latency was above what we can allow for our applications and downstream users.
The cluster is being used across the entire company and we were trying to think of ways to overcome this problem.
One of the suggestions is multicluster RabbitMQ where several clusters would be provisioned for different teams so that an outage of a cluster doesn't influence many functions. However, currently we're in a situation where certain teams are producing to queues which are consumed by other teams. Additionally, we don't want to overcomplicate the management of connections to several different teams on the application level and therefore we were debating whether federation is a good use case for this.
If anyone has experience with similar problems or how to spread the load of a RabbitMQ cluster and has any best practices/ recommendations I'd love to hear those and would be very appreciative.
Thanks!
https://redd.it/130kiu0
@r_devops
Hey guys!
Currently facing the use case where our RabbitMQ cluster (3 nodes, all quorom queues) has to handle 80k-100k events per second. We've reached situations where the latency was above what we can allow for our applications and downstream users.
The cluster is being used across the entire company and we were trying to think of ways to overcome this problem.
One of the suggestions is multicluster RabbitMQ where several clusters would be provisioned for different teams so that an outage of a cluster doesn't influence many functions. However, currently we're in a situation where certain teams are producing to queues which are consumed by other teams. Additionally, we don't want to overcomplicate the management of connections to several different teams on the application level and therefore we were debating whether federation is a good use case for this.
If anyone has experience with similar problems or how to spread the load of a RabbitMQ cluster and has any best practices/ recommendations I'd love to hear those and would be very appreciative.
Thanks!
https://redd.it/130kiu0
@r_devops
Reddit
r/devops on Reddit: Scaling RabbitMQ
Posted by u/Easy-Dragonfruit6606 - No votes and no comments