How to create alerts in ELK

Hi there,

I am aware of x-pack edition of elastic stack comes with the alerting option ? Does the open source edition of the stack ELK provides the option for alerts ? If yes, how we configure alerts in the ELK stack ?

Thanks

https://redd.it/ld3lad
@r_devops

Alerts in ELK Stack

Hi there,

I am aware of x-pack edition of elastic stack comes with the alerting option ? Does the open source edition of the stack ELK provides the option for alerts ? If yes, how we configure alerts in the ELK stack ?

Thanks

https://redd.it/ld35gh
@r_devops

IaC Snippets - Your input would be amazing

We are beginning to provide IaC snippets for common resources like Docker Containers, S3 Buckets, and DynamoDB Tables in Commandeer.

https://docs.getcommandeer.com/blog/latest/introducing-iac-snippets-for-ansible-docker-compose-serverless-framework-and-terraform/

I'd appreciate any input you might have on any ways we can make this beneficial for your day to day work.

https://redd.it/ldydke
@r_devops

What are your indicators of a system in distress?

When looking at a system, what do you use in consideration to determine if it is in distress? Is it the heap usage? CPU usage?

https://redd.it/le41m4
@r_devops

Free alternative to Dynatrace Pure Path

Hi,

We use Dynatrace in our project for APM needs and i find the pure path feature really helpful to analyze API or service performance. I was wondering is there a free alternative to check for pure path which i can use to analyze my side projects. I can use Prometheus for basic application monitoring n alerting or micrometer.io to check for my application methods , but is there any open source product where i can view end to end flow n time taken for an api call

https://redd.it/le4xji
@r_devops

How can Stackoverflow make you a better developer

We all use SO on a daily basis. I’ve found that participating by asking and answering questions to be very effective for my own coding skills. I wrote a short article on why I think you should try it and improve your programming skills.

https://devopsian.net/posts/so-make-you-better-dev/

Would be glad to hear your opinions.

https://redd.it/le1dwz
@r_devops

How to connect front end to back end?

I want to do a project wherein I am using ML algorithm and train data and get a prediction. I want to take input from my html web page and give output on it. Possibly also a visualization. How to make this happen?

https://redd.it/le0tq3
@r_devops

Gathering interest in podcast or YT channel idea

My friend and I work on two different teams on the same software project (he's a Scrum Master, I'm a Dev Lead) and we've had some success at getting our organization to move toward adopting DevOps and Lean principles for software development.

Our organization is an enterprise IT company with a mix of projects and technologies that were acquired or developed in house. Our particular project has a spotlight on it, and we've been successful over the last year in helping our management become data aware.

We've started to work with other parts of our company to move them in that direction as well, and have learned a lot doing so.

We would like to disseminate our knowledge and thought that some kind of periodic podcast or video channel would be a great way to capture our experiences. Would anyone here find this helpful?

From lurking in this community for a while, it does seem as though the content is more focused on the technology while our idea is more about how to move the organization, so if there is a better place to ask, we'd love to know.

Anyway, looking forward to seeing your comments and ideas.

https://redd.it/ldzdxx
@r_devops

Automate Manual SQL runs

I recently started working with our DBAs to automate some of their workflows. One of the problems I've been tasked with is automating some manual SQL requests they run often. Anything outside of the normal migrations, like adding customer account data or bulk updating columns. Currently our DBAs run these manually but I would like to have a review / approval process before running along with syntax checking and output verification. Any suggestions for how to do this?

https://redd.it/ldyi02
@r_devops

Want to share Interview Preparation Courses

I have organized some of the best interview preparation courses like:

1. AlgoExpert
2. SystemsExpert
3. Epic React Pro by Kent C. Dodds
4. Grokking OOD
5. Grokking The Coding Interview
6. Coderust: Hacking The Coding Interview
7. Grokking Dynamic Programming Patterns
8. Grokking the System Design Interview
9. ZeroToMastery: Master the Coding Interview Big Tech (FAANG) Interviews
10. Gaurav Sen: System Design
11. TechSeries dev: AlgoPro, Tech Interview Pro
12. BackToBackSWE
13. CodeWithMosh
14. InterviewCake
15. InterviewCamp
16. Applied Course
17. InterviewEspresso
18. SimpleProgrammer

And some other courses. DM me if you are interested to have these courses.

https://redd.it/ldy45j
@r_devops

What DevOps KPIs do you track?

Hey folks. I am curious what are some key indicators do you track to have an understanding of how well your organization is doing with DevOps? That is if you could pick 3 metrics that would tell where you should focus and optimize your delivery pipelines, what would they be?

I would also appreciate any links to some tools that could help with such insights.

Cheers!

https://redd.it/lea2nd
@r_devops

How Can I Do Continous Deployment On My VPS With Docker?

I am trying to step up my devops chops by trying to implement a CI/CD (deployment) pipeline for my personal website.

On the CI side, I am working on implementing gitflow, automated testing, and pushing new Docker images on successful merge to master via Github Actions.

As far as the CD side, I am currently hosting my site on a Vultr VPS. I would like to set up a system that checks for a new Docker image for the site, and if one exists, it should pull it down and restart my website (probably via docker-compose) with the new Docker image. I could probably just write a cronjob that runs every few minutes and checks for a new image/redeploys but that seems inefficient and clunky.

I am aware that something like this could easily be implemented using AWS ECS/ECR but I think that would be overkill for my small site. Does there exist some tool that could do the "polling" for a new image and redeployment in a more streamlined way?

Any help/feedback would be appreciated.

https://redd.it/le9v8f
@r_devops

Building Python for multi-Linux distro deployment

We’re building some system-level applications that have to interface and configure Unix users/groups, other system tools like mail servers, nginx, etc.

The team is planning on writing the apps in Python, and distributing them via RPMs and Debs. Their reasoning for using system packages is primarily so that we can pin dependencies on the system. To me, this sounds fairly complicated, as we’d have to package the code up twice and test deployment across multiple versions of the multiple OSes.

I’ve mostly worked on ephemeral systems that were either configured with Ansible/Puppet that would configure the system + deploy applications, or baked Docker containers. Does the system package approach make more sense on non-ephemeral hosts? Is there a better alternative for Python apps? I’ve looked into something like Pyinstaller that can package the Python app into an executable, would that still be Linux OS-dependent?

Thanks!

https://redd.it/le8o13
@r_devops

Bare metal servers provisioning software

I am searching for a not very complicated system for provisioning bare metal servers (mostly Supermicro).

The steps for the new server deployment at the moment are:

1. Add server to a bootstrap network segment
2. Install base OS on the new server (Ubuntu)
3. Make some tweaks via ansible (add user/keys, some packages, iptables rules, etc)
4. Move server to the prod network segment and transfer to app admins.

Items 1,3,4 already automated with Ansible, now time to OS install process.

I'm looking to maas.io, but it looks some overkill for my purpose.

I would appreciate some advice.

Thanks!

https://redd.it/le76oz
@r_devops

Automate the initializing and unsealing of HashiCorp Vault without public cloud infrastructure

Hey everyone! Here's a small project I worked on recently that I thought people here might find interesting: https://github.com/jace-ys/vault-init.

It draws inspiration from https://github.com/kelseyhightower/vault-init, but doesn't rely on any public cloud infrastructure for the encrypting and storing of Vault's root tokens and unseal keys. You would typically use this if you do not have access to public cloud infrastructure, or if your Vault deployment must operate entirely on-prem.

Hope someone here finds it useful, and let me know if you have any issues/feedback!

https://redd.it/ldud7w
@r_devops

When using AWS route53 + Alb + EKS + ACM, is it possible to assign a different url/domain to each pod inside a cluster ? ex. foo.com = pod1, bar.com = pod2, dog.com = pod 3, cat.com = pod 4

I want to be able to access these urls using HTTPS. I want to be able to use the certs from ACM. Lets say all four as just hosting a static website.

If there is a better way of doing this, please do let me know!

ty

https://redd.it/leho36
@r_devops

SSH keeps disconnecting from my EC2

Hi, I'm new to devops and trying to figure out my way to creating docker images using ansible playbooks. I use t2-micro EC2 instances.. Everything is fine so far but the ec2 keeps disconnecting every 5 mins or so if i dont interact with the session..

Couldn't really get to the reason why this is happening..

Any suggestions in this regards are much appreciated. (Any logs that can be checked/time-out settings to be amended)

https://redd.it/lehd5t
@r_devops

How to use AWS S3 as a version control System using Terraform?

I created S3 bucket through terraform. And trying to using it as a version control system. By uploading terraform's state file into the bucket. However I am getting an error I'm posting below. I am using ubuntu 20.04 , terraform version v0.14.4. TIA

​

\# Define your AWS configuration
provider "aws" {
profile = "default"
region = "us-east-1"
}
\# Define your S3 AWS Resource
resource "aws_s3_bucket" "tf_course" {
bucket = "rahulwilliams11121985"
acl = "private"
}

\#after terraform apply
terraform remote config \\

backend=s3 \\

backend-config="bucket=(rahulwilliams11121985)" \\

backend-config="key=terraform.tfstate" \\

backend-config="region=us-east-1" \\

backend-config="encrypt=true"

After this i need to run these below commands .

remote configuration updated

Remote state configured and pulled.

But after the remote configuration updated. I am getting the below error. Could you please guide me where I am going wrong.

rahul@rahul-MacBookPro:\~/Documents/s3backend/s3back$ remote configuration updated

bash: /snap/bin/remote: No such file or directory

rahul@rahul-MacBookPro:\~/Documents/s3backend/s3back$ Remote configuration updated

Command 'Remote' not found, did you mean:

command 'remote' from snap remote (1.09)

command 'emote' from snap emote (1.4.0)

https://redd.it/lehty5
@r_devops

How can I come out of shell script execution?

I am running a shell script, using AWS Code Deploy on Linux EC2 machine. The script executes a binary which starts a web app on port 3000. Given it executes a binary which creates a process, the shell script never terminates which fails my AWS Code Deployment.

How can I come out of the shell script without terminating the binary process?

\#!/bin/bash

cd /home/ec2-user/go/bin/

./go_binary

https://redd.it/ldwgzh
@r_devops

A prototype framework for scaling cloud apps

Hi everyone! 😊

Over the last few months I've been working on a side project to automate the deployment of production cloud applications. It's really an automated way to deploy a local codebase into cloud services and automatically scaffold the pipelines and configuration.

My main driver was that configuring services and pipelines is a bit of a headache and cloud applications can be infinitely complex. So I wanted to simplify and drive design out of a scaffolding framework without losing flexibility to scale to more complex apps.

The way it works is "describe the thing you want to build" and it will be built end to end. The two use cases I have working so far are the end to end deployment of Dockerised app into Kubernetes with all routing set up. The second use case is deploying web application architecture. You can also replicate environments if you wanted to stand up dev through to prod.

There are a few guiding principles:

* Keep the language simple - I want to be able to describe the application I want to build (no complex new language to learn)
* BYOT (Bring Your Own Terraform) - flexibility in design
* Configuration / community driven - functionality scaled as modules (e.g. modules for Docker, ...)

Is anyone interested in taking a look and sharing some feedback?

https://redd.it/ldv70t
@r_devops

Need Advice for Getting Started with DevOps

I have a fun learning project in mind that I want to use to learn DevOps. Also, if it works, it may generate some side income that can fund my home lab dream.

I intend to use Python; I have spent the last few weeks learning Python and some Django.

I also want to containerize the application, with the sole purpose of having some hands-on experience in some of the DevOps concepts.

I will be building my test servers inside VMware Workstation. So far, this is what I have come up with:

(All servers are Ubuntu Linux)

1. Server A - Container 1: Nginx serving static files and JS
2. Server A - Container 2: Some business logic that is mildly CPU intensive
3. Server B - Container 1: Gunicorn
4. Server B - Container 2: Core business logic that is mostly CPU intensive

I have gained some experience in automated testing but not much in Jenkins. And I have no experience in containerization.

As I take the first steps, I need to know whether I am on the right track or not. I don't even know if I am asking the right questions.

Soliciting your valuable advice and inputs.

Thank you for reading the post.

https://redd.it/ldyave
@r_devops