Alternatives to whisper database

I am using graphite + whisper for monitoring the system metrics but since the number of metrics are increasing , it is becoming difficult to use whisper as a storage as it is not an optimal solution because of inode table bottleneck and also it is not scalable.

Anyone has suggestions which database will be good in place of whisper which can solve inode table bottleneck problem and is also scalable and fast.

PS : i am thinking to go for M3DB which is developed by Uber.

https://redd.it/f6rzcg
@r_devops

Architecting Kubernetes clusters — how many should you have?

We just published an article discussing various Kubernetes cluster strategies from "few large" to "many small" clusters.

[https://learnk8s.io/how-many-clusters](https://learnk8s.io/how-many-clusters)

https://redd.it/f6rnab
@r_devops

Building & deploying a versioned documentation site with werf

Online documentation for our tool, werf, is updated with each release and we use a semantic versioning approach with 5 stability channels. It brings some special requirements in building a regular static site for this docs: we use a dynamic number of artifacts during the process of building Docker images (that are deployed to Kubernetes afterwards). [Here](https://medium.com/flant-com/dynamic-building-deploying-with-werf-5c65bb5c29cb?source=friends_link&sk=2cd5ec5c7ddbd3f7d4d3a5acd5cf9b58) we share how we're dogfooding with werf itself to implement the whole CI/CD process for the tool's website.

https://redd.it/f7c646
@r_devops

Solutions for hosting web app

I created a web application and hosted it in a standard way on a single VPS (2vCPU, 4GB RAM). Node.js backend and PostgreSQL are running as a process and React.js artifact is served through nginx. I am looking for a ways to make it more professional and efficient.
I started thinking about using Docker but my knowledge about it is quite poor. Could you recommend my directions/solutions which I should follow? Is using Docker can help me?

https://redd.it/f7c9sb
@r_devops

How to expand the use of Devops tools and practices in my current job?

I was hired as a Devops Engineer at my company. We are a SQL and Windows shop that doesn't actually have an application, rather we clean data that gets put onto a server that other companies then use. The most I have been able to do so far is get everyone on GIT for version control of their code and setup Jenkins to deploy a few of our file cleaner programs. My current work exists of managing and creating Jenkins deploys, managing GIT, creating PowerShell scripts to do sysAdmin and DBadmin jobs, and a few other odds and ends. This seems like a unique situation that there is not a lot of material on. I've looked into tools like Puppet, but I do not have control over deploying new servers (that comes from corporate). What more could I do for automation/ DevOps style approach?

https://redd.it/f7c7rn
@r_devops

Build and push your Docker images using Github Actions

I was working on a CI (continuous integration) portion for a project that lives in a mono-repo and hosts multiple, independently deployable services. Each service in the repository is versioned separately and there is a VERSION file with the version number inside each service folder.

```text
src
├── service1
│ ├── Dockerfile
│ └── VERSION
└── service2
├── Dockerfile
└── VERSION
```

The whole application is currently deployed as a monolith - a single, versioned Helm chart with sub-charts for each of the services. Theoretically, we are in the spot where we could be deploying all these services separately by replacing one helm install/upgrade command with a Helm command for each service.

However, the first step was to get each image built and pushed to the registry each time the version number changes and only on the master branch. I documented how I did this using Github Actions [here](https://www.learncloudnative.com/blog/2020-02-20-github-action-build-push-docker-images/) - hope it helps someone.

The whole thing wasn't too complex, however, I spent more time than I'd like to admit figuring out why I couldn't run git diff-tree. (Spoiler: it was due to the fetch-depth - by default the Github checkout action only fetches the last commit).

Is anyone else using Github Actions for their pipelines? Any interesting scenarios you ran into?

https://redd.it/f7eg85
@r_devops

Help with DevOps operations

Hello everyone. I am now entering the area of ​​infrastructure as a code, after more than five years in the area of ​​IT Infrastructure. I completed several courses in the area that instructed how to operate git, vagrant, docker, jenkins, grafana, aws and bash script. I am going to enter my first job as DevOps. I would like to know from you veterans, how it works within the work environment, since in class everything seems very simple and easy. If someone can describe to me things that happen from commit to production.

Something like a step by step of how it occurs from the beginning to the end of the life cycle of the operation. From commit to deployment in Cloud Computing.

Sorry for the long text, I would be grateful for the help.

https://redd.it/f7c3hk
@r_devops

[noob] OpenBalena with AWS vs Docker with Watchtower? For embedded linux devices

Let me start with stating I am totally new to the world of embedded electronics, and as a startup I have no choice but to learn. If this is the wrong place to ask this, please point me in the right direction :) (I'll be cross posting this to r/docker)

I am building a device that runs off of a raspberry pi compute module and the BalenaFin board (temporarily, while testing is done on our custom carrier board). the device will be used in medical offices, and will need to be able to receive program updates OTA through the customer's wifi. So far I have narrowed myself down to 2 main options:

First: I could run Balena's OpenBalena OS in combination with an AWS server (already HIPAA compliant, and the best pricing for our business model according to my current knowledge) . I see that balena has a ton of really nice features, but it really just feels like an expensive GUI/CLI suite for Docker.

Second: I could run the RPi compute module off of Raspbian, install WatchTower and Docker, and accomplish the same updating method.

As far as I can see from this point, all I need this system to do is run a few different C++ programs, control GPIO, and have the ability to be updated remotely by pushing. And of course to be scalable. I have a feeling that in the future if our device is widely adopted, Balena Cloud will be used rather than either of these methods, just because they'd most likely offer better support/bang for my buck than a small in-house team of engineers.

Am I right in my understanding of Balena OS in regards to my use case? Is there something I'm missing?

https://redd.it/f7gvz7
@r_devops

stackstorm - ability to run manual 'jobs' similar to rundeck?

We are a bit frustrated with rundeck (for a number of reasons) and I've been looking for alternatives. Stormstack docs don't give me a hint of this, and I did an install and also couldn't figure it out on my own. Does Stormstack have a way of doing manual 'self serve' job executions, in addition to its auto-remediation IFTT style tasks?

https://redd.it/f7b3eh
@r_devops

Import XML to SonarQube

Hello, does anyone know if you can import an xml file generated by a functional test of LeanFT / ALM with reports of success or failure of it to SonarQube? If so, how can I do this?

https://redd.it/f79x4z
@r_devops

Deploy to production based on git tags?

What is a good branching strategy for CI/CD? Would the master branch matching with the staging environment with promotions to production via git tags and good idea?

https://redd.it/f7j0xb
@r_devops

Am i good to go for devops

Started my career as linux admin a year back in a startup, now this is what I've learnt so fat,

Setup test servers in GCP with Oracle DB, Weblogic, Tomcat, redis, postgresql and few basic tasks on them


Deploying jar files along with UI files in Weblogic

Deploments in Solaris

Setup flexcube test environment from scratch on a Centos server.

Create fresh database and schemas. Export and import DB dmp files,

Very little mikrotik router firewall configurations

Setup mysql-innodb cluster and mysql database from scratch.

Basix linux admin chores

Logic behind yaml files and edit

Cloning from a UAT to production env, except db and weblogic configurations

Once migrated Windows server to Centos - mysql, oracle, postgresql database migration, tomcat applications,


All on CentOS, and im 0 in any programming languages.

https://redd.it/f78zq2
@r_devops

[Response Policy Zone] How to setup a DNS Bind with Docker, with 2 different zones that can be access by 3 different clients in the same server?


I need to create a DNS Bind in Docker with 2 different zones for 3 DNS clients from the same server, where:

- **1 client has access to one zone** and **the other 2 access to the other zone**

I need to use Bind9 and Docker for this.

How can i do this?

#Bind9 #DNSResponsePolicyZones #DNS #docker

https://redd.it/f78ffz
@r_devops

Confused by AWS ECR Security Vulnerability Scan

We have container images in ECR and its vulnerability scan reported there are critical issues in the images. The thing is that all the critical vulnerabilities are related to kernel. As far as I know, docker container images don't have their own kernel because containers run on its host machine's kernel. Should I ignore these vulnerability issues or am I confused about how docker containers work?

https://redd.it/f7404l
@r_devops

Conferences for Devops?

What are good conferences to go to for Devops and are any worth going?

I go to general ones like DeveloperWeek, DockerCon, KubeCon or RSA(comp security), most of the technical talks being marketing schpeels on a product from a company rep or engineer. Actually looking for something educational with hands on training rather than something like a circle-jerk without being patronizing.

https://redd.it/f7kinn
@r_devops

Building a good test db

Hello everyone,

I have learned from my last post so I am going to refine questions. I am currently working at a growing start up and the problem we have encountered is that more often than not SEs are copying the production DB, i know it’s bad hence why I am here, to test their code. I was curious on what the practice is to build a quality database that mimics your production environment in order to truly wall off your production DB but not lost out in quality testing.

https://redd.it/f7k8o6
@r_devops

What small things have you automated at work with bash/python?

I'm curious to know some examples of automation. Not full-blown IaC code in json/yaml.

I mean smaller things, maybe 10 to 50 lines of code in a script.

Just trying to get some ideas and maybe your suggestions can help others too.

thanks

https://redd.it/f7ha38
@r_devops

Best portable way to connect from within a pod in a local dev cluster to docker compose service

I'm setting up a local development project for a cloud native app where the idea is once in production up in Google Cloud, I'll be using Cloud SQL (managed cloud service) for data persistence. While I'm developing my application locally, I am using a local cluster with KinD, and would like my containers there to be able to reach a couple of external resources outside the cluster (in this case PostgreSQL) to keep dev/prod parity.

I have Postgres running locally using docker compose alongside my cluster, and while I can reach it already using the host's (my computer) IP + exposed port from within my pod containers, this is not very portable and would require every team member to configure their host IP to get their local environment working. I would like to avoid this.

Is there a better solution? Thanks.

https://redd.it/f73yqj
@r_devops

Is Raspberry Pi really needed for practicing DevOps tools?

I am new to DevOps, was a developer for a while and right now trying to get into DevOps. So I came across few blog posts about RPI where they created a cluster using 5 or more RPI's and deployed K8 on that. This was all for fun and practice. But I would like to know what difference does it make as I can spin up VM's in my local PC or get $300 free GCP credit where I can implement the same.
I know it can be used for Home Automation purpose, but I was not able to justify buying them for Docker/k8's.


So question remains, does we really need RPI if we are solely looking at it from DevOps prespective?

https://redd.it/f73grj
@r_devops

Logging infra usefulness on public cloud

Dev/Sec/Ops here. Small-sized MSP using GCP & AWS across multi-cloud regions, and using AWS CloudWatch & CloudTrail logs, Stackdriver for logging, alerting, errors, etc. We're finding limited usefulness of this logging infrastructure. Wondering if its just me!
As DevOps, I really find StackDriver logging UI not much useful to scroll through. For one thing, it is really slow. Secondly, I find service name & service acronyms very annoying. Not just StackDriver, but AWS too.

- Other than debugging, what purpose do logging serve?
- What are some tools that you use to dice & slice logging data to make any meaning?
- How do you extract actual errors while alerting?

https://redd.it/f737ge
@r_devops

Why is my Jenkins pipeline inconsistent? A command works sometimes and doesn't sometimes.

I am simply using a docker command in one of my stages.

When it works well, everything goes as intended.

However, many times, it gives me a message 'docker command is not found'.

What could be the main cause of this inconsistency?

https://redd.it/f714lo
@r_devops