Saga Orchestration for Microservices Using the Outbox Pattern
https://www.infoq.com/articles/saga-orchestration-outbox/
#debezium #ai #ml #kafka #microservices
https://www.infoq.com/articles/saga-orchestration-outbox/
#debezium #ai #ml #kafka #microservices
InfoQ
Saga Orchestration for Microservices Using the Outbox Pattern
The outbox pattern, implemented via change data capture, is a proven approach for addressing the concern of data exchange between microservices. The saga pattern, as demonstrated in this article, is useful for data updates that span multiple microservices.
Declarative stream processing for mundane tasks and data engineering
https://github.com/Jeffail/benthos
#go #kafka #rabbitmq #amqp #logs #nats #datastreaming
https://github.com/Jeffail/benthos
#go #kafka #rabbitmq #amqp #logs #nats #datastreaming
GitHub
GitHub - benthosdev/benthos: Fancy stream processing made operationally mundane
Fancy stream processing made operationally mundane - benthosdev/benthos
Scylla University: New Spark and Kafka Lessons
https://www.scylladb.com/2021/10/21/scylla-university-new-spark-and-kafka-lessons/
#scylla #kafka #spark
https://www.scylladb.com/2021/10/21/scylla-university-new-spark-and-kafka-lessons/
#scylla #kafka #spark
ScyllaDB
ScyllaDB University: New Spark and Kafka Lessons - ScyllaDB
Two new ScyllaDB University lessons on connecting your ScyllaDB NoSQL database to Apache Spark analytics and Apache Kafka event streaming.
Scaling Kafka at Honeycomb
https://www.honeycomb.io/blog/scaling-kafka-observability-pipelines
#kafka #observability #monitoring
https://www.honeycomb.io/blog/scaling-kafka-observability-pipelines
#kafka #observability #monitoring
Mizu
is a API traffic viewer for Kubernetes enabling you to view all API communication between microservices. Think TCPDump and Wireshark re-invented for Kubernetes
#k8s #kubernetes #rest #tcpdump #wireshark #kafka #redisBuilding Self-driving Kafka clusters using open source components
https://slack.engineering/building-self-driving-kafka-clusters-using-open-source-components/
#kafka #chef #terraform
https://slack.engineering/building-self-driving-kafka-clusters-using-open-source-components/
#kafka #chef #terraform
Akvorado:
flow
https://github.com/vincentbernat/akvorado
#snmp #ipfx #network #tool #clickhouse #kafka
flow
collector, hydrater and visualizer.https://github.com/vincentbernat/akvorado
#snmp #ipfx #network #tool #clickhouse #kafka
Redpanda vs Apache Kafka: A performance comparison (2022 update)
https://redpanda.com/blog/redpanda-vs-kafka-performance-benchmark
#kafka #redpanda #mq
https://redpanda.com/blog/redpanda-vs-kafka-performance-benchmark
#kafka #redpanda #mq
Super High-performance NoSQL and MQ
https://blog.bytebytego.com/p/ep31-super-high-performance-nosql
#nosql #mq #scylladb #redpanda #kafka #cassandra
https://blog.bytebytego.com/p/ep31-super-high-performance-nosql
#nosql #mq #scylladb #redpanda #kafka #cassandra
Building a real-time search application with Redpanda and ZincSearch
https://redpanda.com/blog/real-time-data-search-redpanda-zincsearch
#redpanda #kafka #elasticsearch #zincsearch
https://redpanda.com/blog/real-time-data-search-redpanda-zincsearch
#redpanda #kafka #elasticsearch #zincsearch
Altinity Replicator for ClickHouse
https://github.com/Altinity/clickhouse-sink-connector
#clickhouse #postgresql #mongodb #mysql #kafka #redpanda
https://github.com/Altinity/clickhouse-sink-connector
#clickhouse #postgresql #mongodb #mysql #kafka #redpanda
Kafka vs Redpanda Perfomance
https://jack-vanlightly.com/blog/2023/5/15/kafka-vs-redpanda-performance-do-the-claims-add-up
#kafka #redpanda #benchmark #mq
https://jack-vanlightly.com/blog/2023/5/15/kafka-vs-redpanda-performance-do-the-claims-add-up
#kafka #redpanda #benchmark #mq
Quine • a streaming graph
https://github.com/thatdot/quine
#kafka #scylladb #cassandra
Quine is a streaming graph interpreter; a server-side program that consumes data, builds it into a stateful graph structure, and runs live computation on that graph to answer questions or compute results. Those results stream out in real-time.
https://github.com/thatdot/quine
#kafka #scylladb #cassandra
How We Scaled to 100 Million Active Users Using Kafka and Golang — Eventual Consistency
https://medium.com/@mhrlife/how-we-scaled-to-100-million-active-users-using-kafka-and-golang-eventual-consistency-6241cfeba7e8
#kafka #go #mq
https://medium.com/@mhrlife/how-we-scaled-to-100-million-active-users-using-kafka-and-golang-eventual-consistency-6241cfeba7e8
#kafka #go #mq
How to Choose a Message Queue? Kafka vs. RabbitMQ
https://blog.bytebytego.com/p/how-to-choose-a-message-queue-kafka
#kafka #rabbitmq
https://blog.bytebytego.com/p/how-to-choose-a-message-queue-kafka
#kafka #rabbitmq
Proton
https://github.com/timeplus-io/proton
#clickhouse #sql #kafka
a unified streaming and historical data processing engine in a single binary, powered by ClickHousehttps://github.com/timeplus-io/proton
#clickhouse #sql #kafka
Revolutionizing Real-Time Streaming Processing: 4 Trillion Events Daily at LinkedIn
https://engineering.linkedin.com/blog/2023/revolutionizing-real-time-streaming-processing--4-trillion-event
#kafka
https://engineering.linkedin.com/blog/2023/revolutionizing-real-time-streaming-processing--4-trillion-event
#kafka
An overview of Cloudflare's logging pipeline
https://blog.cloudflare.com/an-overview-of-cloudflares-logging-pipeline
#cloudflare #logs #elk #clickhouse #kafka
https://blog.cloudflare.com/an-overview-of-cloudflares-logging-pipeline
#cloudflare #logs #elk #clickhouse #kafka