Gamify Twitter with Prometheus and Grafana on Kubernetes

Hi everyone,

I personally have Gamified my Twitter banner with Prometheus, Grafana and some custom Python code on Kubernetes. I've made a write-up for inspiration: https://www.civo.com/learn/using-civo-kubernetes-to-gamify-twitter-with-prometheus-and-grafana

(And yes, It's more intended for FUN and just hacking around, rather than very serious business ;) )

https://redd.it/nvzpor
@r_devops

Reducing data transfer costs with a Docker registry cache

Reducing costs has been a focus area for us ever since the COVID pandemic started. We recently published a blog post on this topic. One of the prominent contributors to our AWS costs was the data transfer of our internal Docker registry. https://lambda.grofers.com/reducing-data-transfer-costs-with-a-docker-registry-based-cache-8f93d7e561f3

https://redd.it/nvz7pm
@r_devops

Log management solution

Hey, so I'm in a need of a log management solution.

What is the best log management solution for a small startup and why?

https://redd.it/nubl10
@r_devops

What is a cool thing I can show high schoolers who learn programming that will be interesting to them?

Hey all,

I'm a DevOps engineer and I got this feeling that I want to go and volunteer somewhere.

I came up with the idea to go to my old high school and show them something DevOps-related that they might find interesting and if any of them want to, I could teach them a thing or two.

Now I'm trying to think what in our field would be interesting but simple enough that high schoolers could enjoy.

I could always just do a docker demo or IAC type of thing but I don't know if they'll find it interesting.

What are your thoughts?

https://redd.it/nw3p8l
@r_devops

Best monitoring tools for clouds?

I would like to know if you have used some monitoring tools and what are the best for cloud like Azure, AWS, GCP, etc. I would like to implement and monitoring my resources like the VMs, the networks, the infrastructure, the security, the applications, etc. in the different clouds. I have read that some goods are datadog, appdynamics, instana.

https://redd.it/nw4ott
@r_devops

Which is better ?

Do you think it's more a enriching experience to work as a DevOps consultant and getting to work on a lot of different projects or as a DevOps engineer working on same company projects ?

https://redd.it/nw5i2q
@r_devops

How Quickly does your org react to change? How is the decision made to adopt new technology on the market?

I've been interviewing for Kubernetes focussed roles lately and I've been wondering, how companies even knew to make the switch before adoption was widespread? Who are these early adopters with 5+ years of experience and how do they know when a new technology is going to come out ahead? How do you convince your org to switch when an emerging technology is on the market? Just curious what the thought process is in general.

https://redd.it/nw6a1d
@r_devops

How do I show a devops portfolio?

I am learning devops and want to get a job in the field. It was suggested that I put together a portfolio.

I have a website I can put it on, but I don't know what it should actually be.

Other than links to the github repos where the dockerfiles, jenkinsfile, and helm charts I create are... what could I actually show? I usually fork a java or node repo and then add all of the pipeline and docker files to it. Should I have screen shots of the command line outputs showing everything is running?

https://redd.it/nw6jvd
@r_devops

Add pipeline for a new repository

I am new to CI/CD. We have an existing pipeline setup that triggers the build automatically. How do I build a pipeline for a new repository? Thanks.

https://redd.it/nwa5l9
@r_devops

HAProxy+xinetd+galera - Connection reset by peer

Hi guys!

​

I have a simple galera with 3 nodes and a haproxy lb. I use xinetd for the check and my problem is that every X check return with this error message: Socket error: Connection reset by peer

image: https://imgur.com/a/Jkf44HX

haproxy config:

# MySQL Cluster BE configuration
backend pxc-clusterbackend
mode tcp
option tcpka
balance leastconn
option httpchk
server pxc-cluster-node-1 192.168.0.130:3306 weight 1 check port 9200 inter 1s rise 2 fall 3
server pxc-cluster-node-2 192.168.0.170:3306 weight 1 check port 9200 inter 1s rise 2 fall 3
server pxc-cluster-node-3 192.168.0.182:3306 weight 1 check port 9200 inter 1s rise 2 fall 3

#####################


xinetd config:

# default: on
# description: mysqlchk
service mysqlchk
{
# this is a config for xinetd, place it in /etc/xinetd.d/
disable = no
flags = REUSE
sockettype = stream
# type = UNLISTED
port = 9200
wait = no
user = root
server = /root/mc.sh
logonfailure += USERID
onlyfrom = 192.168.0.0/24
persource = UNLIMITED
}

In the script i just make a simple select and if success return 200.

I also tried to add the haproxy address in the /etc/hosts.allow file but nothing.

Have you any suggestion?

https://redd.it/nw5fkt
@r_devops

New relic Alert for VPN

I have vpn tunnels hosted on Aws. I want to create an alert if the tunnel is not responding for more than 5 minutes. Can anybody help me with this.

https://redd.it/nw0snz
@r_devops

Tell me your opinions about full-stack monitoring solutions

For those of you who have used multiple monitoring solutions, I'd like to hear your experience and your opinions about which is best and why. To be specific, I'm talking about solutions which offer log aggregation, host metrics, application metrics, APM, outside->in monitoring (synthetic checks), and alerting.

I've looked at Elastic, DataDog and New Relic. I think New Relic doesn't hold the prestige it once did. I'm my opinion, it has fallen behind it's competitors and become more of an enterprise solution. I have used DataDog briefly, and am a long time Elastic user/admin, but have never used the paid versions so no APM or "AI" features (correlation, anomaly detection, etc).

What do you all think is the best of the three, and why?

ETA: If I'm considering Elastic this time around, the paid features are definitely on the table.

https://redd.it/nwd2hn
@r_devops

How to transition from IT Analyst to DevOps?

Looking to possibly transition into DevOps.

Past:

Help Desk
NOC tech
Point of Sale Analyst
Web App Server Implementations
IT Analyst /Incident Manager at a Fintech (current)

10 YOE

I work with DevOps on a regular basis and it feels like it would be a great next step. Both in career growth and in compensation.

Figured I’d ask Reddit, what’s the top 3 things I can focus on to land a DevOps role?

GitHub actions? Azure proficiency? Python for automation purposes? AWS?

Thanks!

https://redd.it/nwevse
@r_devops

Best paas to host a wildfly aplication?

Hello everyone, in less than a week I need to put a wildfly application on one paas. It is going to be an ear and it also uses remote jms queues. There seems to be a lot of options but most of them dont support wildfly out of the box. The service has to be free because it will be used for testing for now.

https://redd.it/nwdzy3
@r_devops

Hiring Devops Engineer - USA (NYC or Remote)

Hi all, w'ere looking for a talented DevOps engineer to join our team! NYC/Remote funded nonprofit startup doing exciting work in the criminal justice space! We're backed by Jack Dorsey & Vinod Khosla.

Compensation: $100K - $150K +

Apply Here: https://ameelio.breezy.hr/p/3cc2bd95ee38-senior-software-engineer?li\_fat\_id=65d44d51-2143-4b7e-a8fc-84f31494a3e5

https://redd.it/nvz9ff
@r_devops

How to Build SQL Database Deployment Automation Pipeline Tutorial

Hey guys,

Gijs Reijn just wrote a new blog post you may enjoy on the ATA blog.

"How to Build SQL Database Deployment Automation Pipeline Tutorial"

Summary:
Tired of manually deploying changes to your SQL databases? Learn how to to build a database deployment automation pipeline!

https://adamtheautomator.com/database-deployment-automation/

https://redd.it/nwh3yn
@r_devops

Limitation for consul-template to discover changes and invoke reloads in HAProxy.

Hello there,

I'm refactoring old consul-template (further called just consul), that generates HAProxy config and my goal is to reduce amount of reloads to minimum. Currently whenever service is being auto-discovered due to its auto-scaling, consul reloads my config. I'm also switching from static config generated by consul at every service change to so called haproxy server-template with KV for slot configs.

But I'm struggling to find any information related to how to limit consu to watch only KV changes not service changes.
- Is it like if something is used in config then consul watches for changes there?
- Or is it being invoked after every small change?

https://redd.it/nvul4b
@r_devops

Best storage solution for normalized relational data if I'm locked to GCP?

Hey /r/devops

Got a GCP question. If I have data that is relational and highly normalized, what's the best option for me on the platform?

I'm using BigQuery a fair bit in the same project, but the data I'm dealing with in there is completely denormalized, which the BigQuery docs says is the way to go.

The relational data that I'm storing isn't actually going to be queried often - instead my server running in prod will sync with it from the cloud every hour or so, and that's where the bulk of the live querying takes place.

What I'm looking for is a place to keep my data in the cloud (specifically GCP) so I can back it up often, query it offline, sync with prod/staging/dev environments. Should I still use BigQuery if I'm not querying the data from there often, but just using it for "lukewarm" storage to be pulled down elsewhere?

---

Edit: for context the relational data isn't huge. It's a bit under 30mb at most. The other stuff I'm doing with BigQuery is dealing with gigabytes of denormalized data (so I'm already using it in this project for other stuff)


---

Edit 2: Having the SQL interface on the data is still important - I'd like to query it while it's in the cloud as well (on top of the other stuff I mentioned like pulling it down into prod/staging/dev environments to be consumed by Postgres for example).

https://redd.it/nvtbhg
@r_devops

MAAS set default cloud-init script

I have a MAAS server that deploys Ubuntu workstations.

When I deploy, I paste in a bash script I made

Is there a way to set this bash script as default? So that MAAS would always use this cloud-init on machines I deploy?

Thanks ahead!

https://redd.it/nwjna3
@r_devops

Provisioning a preconfigured Nexus Repository Manager (NXRM) Docker container

Hi all, I've created a preconfigured NXRM Docker image, with an init-script - provision/entrypoint.sh,

Link to project @ GitHub - https://github.com/unfor19/nexus-ops
Link to Docker image @ DockerHub - https://hub.docker.com/r/unfor19/nexus-ops

Here's a TL;DR of what the entrypoint.sh script executes upon running NXRM:

1. Changes the initial random password that is in /nexus-data/admin.password to admin
2. Enables anonymous access - allows anonymous users to access localhost:8081 with READ permissions
3. Adds Docker Bearer Token Realm - allows anonymous pulls from local Nexus registry localhost:8081
4. Creates two Docker repository of type proxy
1. docker-hub - DockerHub
2. docker-ecrpublic - AWS ECR Public
5. Creates a Docker repository of type group
1. docker-group - The above Docker repositories are members of this Docker group

https://redd.it/nwl81k
@r_devops

Devops Tools

https://kush01.hashnode.dev/best-tools-for-devops

https://redd.it/nwlx13
@r_devops