How To Set Up a Continuous Delivery Pipeline with Flux on DigitalOcean Kubernetes

https://www.digitalocean.com/community/tutorials/how-to-set-up-a-continuous-delivery-pipeline-with-flux-on-digitalocean-kubernetes

#flux #digitalocean #kubernetes #k8s #cd #ci #pipeline

A look at the tradeoffs between testing in a pipeline and observability in production for data engineering.

https://medium.com/bigeye/testing-vs-observability-which-is-right-for-your-data-quality-needs-1ceb34a12867

#observability #testing #pipeline

Kestra is an infinitely scalable orchestration and scheduling platform, creating, running, scheduling, and monitoring millions of complex pipelines.

https://github.com/kestra-io/kestra

#orchestration #pipeline #workflow

#typescript #cd #ci #git #gitlab #gitlab_ci #local #pipeline #push #uncomitted #untracked

You can run GitLab CI pipelines locally using `gitlab-ci-local`, which saves you time and effort by not having to push changes to test your `.gitlab-ci.yml` files. This tool allows you to execute pipelines as a shell executor or docker executor, eliminating the need for development-specific scripts. It also offers convenience features like CLI options, environment files, bash aliases, and tab completion. You can list pipeline jobs before running them and customize variables and artifacts easily. This makes your development process more efficient and streamlined.

https://github.com/firecow/gitlab-ci-local