unified monitoring for EKS cluster and additional envs

I'm relatively new to the DevOps world so forgive the newb question. We've got a legacy installation of zenoss which for all intents and purposes works alright, but we lack the knowledge to troubleshoot it and moving forward it seems like Prometheus or INfluxDB are more appropriate. We've got some atypical (I think) VM envs, AWS EC2, and AWS EKS environments that all need to be monitored. The EKS is what throws me for a loop, albeit, I'm very new to EKS as well, but it seems like I basically need to run another instance of my monitoring in another EKS cluster or inside of the ones I'm interested in monitoring. These seems like I'm missing something because I have a hard time understanding how other shops would have separate instances running of their monitoring software that weren't all wired in/tied together.

Can someone offer me the zoomed out view of how I need to conceive of monitoring local, VM, and cloud environments?

​

Thank you.

https://redd.it/lxn33g
@r_devops

Histograms allow users to compress and analyze massive amounts of telemetry data. Check out OpenHistogram.io, which is 100% open source and free.

Check out OpenHistogram.io, which is 100% open source, free, and vendor neutral - creating open standards for sharing telemetry data between vendor platforms.

https://redd.it/lxmqxg
@r_devops

Cloudify Community edition

Does anyone have an experience using Cloudify Community edition in production? I am evaluating it for the project we work on, would like to hear if someone has real life experience.

Also, is there a similar multi-cloud environment lifecycle orchestrator?

Thanks.

https://redd.it/lxl1tr
@r_devops

Nexus on a NAS

I got a silly question,
I have a NAS lying around collecting dust.
Can I install nexus repository on it ?

https://redd.it/lxrdr0
@r_devops

From all the "infrastructure as code" tools which DSL (code) you think is the most intuitive for big projects?

Hello all

I'm kind of new to the DevOps ecosystem, I notice there are many DSL languages for the IoC
I have high level question, what do you think is the most intuitive DSL no matter which TOOL?

https://redd.it/lxfmxw
@r_devops

Klustered #3 - Live Cluster Debugging and Special SIG Honk CTF

Hi everyone. Thank you for the kind words on the two previous episodes!

Episode 3 happened yesterday. This time, I’m joined by Kubernetes contributor, Michael Hausenblas. Unfortunately for us, we’re up against Justin Garrison & SIG Honk (Ian Coldwater, Duffie Cooley, Rory McCune, and Brad Geeseman)

This one seem some rather unique “breaks” from both teams. I won’t leave any spoilers in case you want to guess as you watch.

Again, thanks for being so supportive of this series. I hope you enjoy 😍

https://youtu.be/Ps2CQm6_aZU

https://redd.it/ly7tdd
@r_devops

Hey everyone. Wondering if anyone can help me on advice for a simple SaltStack POC - just need to find a robust Linux distribution or something but having a time with it.

If you could humor me also, eli5 why saltstack’s Googlable doco is so tailored to every environment it lives in, that would also rly help.

https://redd.it/lxf4fs
@r_devops

What it is like to be a devops engineer

I always wonder what problem do devops engineer face, I am we developer who is also a student and thinking of learning web development, Is devops that bad? How should someone get started

https://redd.it/lxap6d
@r_devops

Ask r/devops: Small Time Developer HIPAA Web App Hosting.

Good day. I'm a web developer creating a webapp and giving it to a small medical research facility. I plan on giving the platform for free and accept fees for paying cloud subscriptions. Could I get recommendations and tips in determining methods to deploy my WebApp and database? I can't use AWS or Azure since the fees are really expensive and I want to keep costs at a low so it can be sustainable. Do I keep the db and app on one VPS? or do I keep the DB separate on a managed database? I'm looking at LiquidWeb. But I'm having trouble about implementation. I would really appreciate any help. Devops has never been my forte and this will be my first stint at it. Thank you.

https://redd.it/lxdop0
@r_devops

How do you organise your study

Hi all,

I'm a 'Server and Storage Analyst' as it stands, and i'm working my way down the DevOps roadmap trying to pick up some new skills.

I've started learning Python and brushing up on Linux, but I find myself getting side-tracked, sometimes for weeks. For instance, this week I got side-tracked as I attended a Microsoft Training Day and ended up down the Azure rabbit hole. I got a certification out of it so it was worthwhile, but my Python skills, or lack there of, has definitely suffered.

To organise my study, I made a OneNote and used some folders etc but it's not working all that well. I'm planning on buying a whiteboard and a calendar to stick on my wall, so I can write down what I plan to achieve in the short and long term, but before i do, I was wondering whether anybody has some tips on how to properly manage your study.

​

What do you guys do? Trello? OneNote? Good old fashioned pen and paper?

https://redd.it/lyaupd
@r_devops

Looking for multi-cloud management console

Would like to provision and monitor AWS, Azure and GCP instances from one place. Couldn't find something good. Assistance appreciated!

https://redd.it/lycxli
@r_devops

We recently wrote about why and how you could migrate from Jenkins Freestyle to Multibranch pipeline.

This article talks about the reasons, advantages and challenges we faced while migrating from Freestyle Job to Jenkins Pipeline. It contains a reusable Jenkinsfile template.


Sharing the link in the comment section.

https://redd.it/lyd1ge
@r_devops

Can someone help me understand where Ansible fits in a CI/CD pipeline?

Hello. I'm fairly new to DevOps and I'm trying to teach myself various tools such as Terraform, Jenkins, Packer, Docker, Kubernetes, etc. However, I'm not quite sure where Ansible fits in a CI/CD pipeline on AWS. Ansible feels...redundant, almost useless. It seems like 99% of the pipeline is already being handled by Terraform, Packer, Jenkins, and Kubernetes.

Can someone please enlighten me on where Ansible comes into play? How do you use Ansible? What am I missing? Thanks.

https://redd.it/lyc8cr
@r_devops

MLOps podcast series

Hello, everyone. My co-host and I are running a multipart series about MLOps on our podcast Delivery, Interrupted. We interview several MLOps experts and discuss everything from how to get started with machine learning in your business to CD practices in a ML world. There are more episodes to come on the subject, so now’s a good time to start listening.

Delivery, Interrupted podcast

https://redd.it/lyde57
@r_devops

What is most challenging about DevOps in real life?

Part of my job is to help people with DevOps and I started making a list of questions for people to consider. Because DevOps is so application specific, there is no standard answer - although all the Hello World tutorials out there would lead us to believe otherwise.

I think the most complicated technical topic is one of deployment promotion, how to move something from dev to staging, etc. to production

I have people tell me they prefer to click a UI to deploy to a "target" environment. I ask them well, what version of your code is running on `uat` right now? Which they cannot answer…
I personally prefer having long running branches per environment, e.g. dev, staging, production…
but people new to DevOps (or git outside of a UI?) struggle with managing long-lived branches and merge conflicts.
but people get stuck on who promotes or merges changes from one branch to another.

Sometimes I feel like this is because people haven't defined these processes, which for me is akin to never planning for failure. It needs to be defined. Sometimes I feel like people just struggle with git. In a previous job where I mentored developers, people would ask for help and I tried to explain out loud to them as I debugged, but often I myself was lost in the IDE. When I switched to a terminal window, many were lost.

I think the most challenging general concept is governance, but that isn't just DevOps specific. It's hard to figure out a RBAC model and then to map that both to cloud and automation. But I think I have that one figured out in terms of how to explain it.

What do you think is most challenging? I'm asking because I like the hard problems and figuring out a way to teach people to help them understand.

In my work I encounter a very specific group of people. I was wondering what other people "in the real world" (and not my work bubble), what do you see?

https://redd.it/lyfwyu
@r_devops

Transitioning in to DevOps from being a QA Tester

I just wanted some guidance on what your doing so far in terms of Devops. What tools/tech stack you are using.

Am currently transitioning in to DevOps so your advice would be very useful.

So far i have created a road map which is the following : 

Programming Language : Python , Shell Scripting
Linuxs Administration :
Terraform , Cloudformation - Infastructure as code
AWS , GCP - Cloud Platforms
Alerting , Monitoring and Auditing - Cloudwatch Alarms , Cloudwatch Logs , Kibana , Grafana
CI/CD - AWS CodePipeline , Jenkins
Containerisation - Docker with ECS/EKS
Centralised configuration management - SSM Parameter Store
Software management/Configuration management - Ansible
Testing : Automated testing for terraform , docker


Pretty much I have covered Python , AWS and now moving on to Terraform. I guess I have python and AWS commercial experience , however I do not with terraform or ansible. Advice would be appreciated from fellow DevOps engineers.

https://redd.it/lyitqz
@r_devops

tagging strategy

When building code (Python,C++, and Java), I always compile locally and run tests locally. When I am ready I commit to Git.

In my CI (Jenkins), it automaitcally builds the software and tests.

My question is, how do you tag? Do you have your CI tag or once you merge to master you tag there? I feel when I tag with CI, I don't have much control of the tag number -- I use the build number. But when I tag it manually and push the tags, I feel it can become cumbersome and error prone (not following a standard).

How do you tag?

https://redd.it/lyd41s
@r_devops

6 Pitfalls to Avoid while Implementing Continuous Delivery

Continuous Delivery (CD) is now ubiquitous across the industrial enterprises as the key DevOps practice for delivering software speedily, safely, and sustainably to the end-users i.e. customers. Yet, as per the state of DevOps 2019 report by Puppet, CircleCI, and Splunk, a survey response by more than 1000 engineers/DevOps or SREs/ITOps Managers suggests that nearly 60% of the organizations are still medium and low performers while implementing continuous delivery.

Delving deep into the areas that affect the performance of Continuous Delivery for greater insight into the problems led us to summarize the six pitfalls that are essential to avoid by the DevOps teams while implementing Continuous Delivery. Be it managing security and audit, orchestrating with a plethora of DevOps tools for your CI/CD pipelines, or contemplating automation for automated risk analysis,

https://redd.it/ly92j3
@r_devops

Online newspaper CI/CD pipeline

Not quite sure it's 100% devops but if someone has so idea to help to understand this, it would be nice (as a Computer Science student).

What the workflow usually look like for an online newspaper like The New York Times in order to deploy / update an article?

Like once a journalist finished to write an article, what's going on after that before to be available on the platform?

https://redd.it/ly8xtt
@r_devops

Advice for introducing DevOps practices to a company

Hi all,

Apologies if this is a repeat post.

I've recently joined a company as their sole DevOps engineer and I'm after advice on how I can implement some best practices without stepping on any toes, the current processes in place are very manual and there is no consistency to any of the work carried out.

For context, I've come from a much larger software company where I was spoilt with tools and best practices, as well as other engineers to bounce ideas off of. DevOps mentality was baked into everything we did as a company.

I guess I'm just feeling quite overwhelmed with the task at hand due to the sheer scope alone, I'm expected to work across both ongoing projects and new projects therefore I never have any time to do any housekeeping of our internal infrastructure as the new projects take precedence.

Any advice on even just a starting point would be greatly appreciated.

Thanks!

https://redd.it/lylfvx
@r_devops

What is the easiest way to push docker-compose on AWS ?

I have dockerized applications using docker-compose files (not single image Dockerfile). I need to push them to AWS. Using github-actions as CI.

I used ECS in the past for Docker, but docker-compose is not available and you need to use aws specific files which is not practical.

I don’t think ElasticBeanstalk handles docker-compose.

What is your pipeline for docker-compose apps on AWS ?

https://redd.it/lyhi98
@r_devops