Technological Stack Version Control

Hello,

One of the things I am noticing would be nice to have on the infrastructure I am doing devops on, is a way to keep track of all software components and their versions. Like keeping an inventory and managing it along the way of making their updates and stuff like that.

I am unaware if there exists any software that does that already and that maybe you use it on a daily basis, but if you know anything that would do this kind of tracking and that keeps it simple, please write it on comments.

Needless to say that excel is not an option :-D

​

Thanks for sharing your info and thoughts!

https://redd.it/lxqudw
@r_devops

AWS codebuild equivalent of the jenkins build name setter plugin?

Is there a way to set change the default build IDs from the AWS randomly generated gibberish to something more descriptive?

https://redd.it/lxy1o5
@r_devops

Tekton CI



Im thinking about using Tekton for a CICD system, for a k8s based product.

I’d like to hear how many of you are familiar, and feedback and anything that can contribute to the discussion

Tekton is a Ci system that is k8s native, and defined as tasks that can be reused in multiple pipelines, pipelinesRuns, and more - so you can fine tune your needs.

Its main advantage is that its yaml based, and is very easy to understand.
It also have rather low need for maintenance as its on the cluster, so Its more easy IMO than jenkins to manage and maintain.

The main problem I see is that its rather new, 3 years old, and that it might not be battle tested enough.

Learnings curve to code is also pretty tough, as it have alot of new definitions and resources, but once things are set and written its rather easy to understand and reuse.


I think as gitlab/hub CI are yaml based, we start to understand that this is the future of CI, I also read that gitlab plan to allow Tekton syntax in the future in their own gitlab-ci,
There is also a new beta concept that they are trying out which is a hub, it holds many tasks that are prewritten and you can copy and reuse as your own, this might help too.

Im not sure about its works between clusters, but as its container based, you can code the use case and just use the container in your CI system, so I think this sentence actually cover alot, why use jenkins agent as container if you can just run the containers themselves on a shared PVC, and much more.

The project is also backed by red hat (red hat pipelines is a downstream project), and is a part of the CD foundation.

I really want to love that, and thus feel a bit biased,
Ill be glad to hear your thoughts.

Cheers.

For the unfamiliar:

https://github.com/tektoncd/pipeline

https://tekton.dev/

https://redd.it/lxw1ia
@r_devops

Backing up databases

I want to understand the best practices for backing up databases.
Can I just backup the entirety of /var/lib/postgresql/data?
On stackoverflow they have recommended the following: https://stackoverflow.com/questions/24718706/backup-restore-a-dockerized-postgresql-database.

Is there anything wrong with going with the former approach?

https://redd.it/lxt2kk
@r_devops

Test Automation for Waterfall

Developer Claim: By waiting until the product code is near or at completion to execute your primary test automation capabilities, your likely missing out on some of the benefits offered by test automation. In other words, generally speaking, there are missed opportunities when pairing test automation and waterfall-like software development, where the automation team starts once the developer has a Release Candidate. He believes that moving the automation team earlier in the process would offer more value.

My Response: That sounds reasonable, but what well respected source claims of this inherent conflict between test automation and waterfall? Sure we can argue to move the test automation team to the left, but where do we point to for an objective assessment.

Developer Response: Siiiiigggghhh

Anyone here know of any reputable sources that address this question that we can mull over?

https://redd.it/ly1qzb
@r_devops

Does anyone know when Microsoft Outlook's new macOS application will support third party IMAP accounts?

I want to shift gears and use the new stuff, but I can't leave one of my accoutns behind.

https://redd.it/lxofkp
@r_devops

unified monitoring for EKS cluster and additional envs

I'm relatively new to the DevOps world so forgive the newb question. We've got a legacy installation of zenoss which for all intents and purposes works alright, but we lack the knowledge to troubleshoot it and moving forward it seems like Prometheus or INfluxDB are more appropriate. We've got some atypical (I think) VM envs, AWS EC2, and AWS EKS environments that all need to be monitored. The EKS is what throws me for a loop, albeit, I'm very new to EKS as well, but it seems like I basically need to run another instance of my monitoring in another EKS cluster or inside of the ones I'm interested in monitoring. These seems like I'm missing something because I have a hard time understanding how other shops would have separate instances running of their monitoring software that weren't all wired in/tied together.

Can someone offer me the zoomed out view of how I need to conceive of monitoring local, VM, and cloud environments?

​

Thank you.

https://redd.it/lxn33g
@r_devops

Histograms allow users to compress and analyze massive amounts of telemetry data. Check out OpenHistogram.io, which is 100% open source and free.

Check out OpenHistogram.io, which is 100% open source, free, and vendor neutral - creating open standards for sharing telemetry data between vendor platforms.

https://redd.it/lxmqxg
@r_devops

Cloudify Community edition

Does anyone have an experience using Cloudify Community edition in production? I am evaluating it for the project we work on, would like to hear if someone has real life experience.

Also, is there a similar multi-cloud environment lifecycle orchestrator?

Thanks.

https://redd.it/lxl1tr
@r_devops

Nexus on a NAS

I got a silly question,
I have a NAS lying around collecting dust.
Can I install nexus repository on it ?

https://redd.it/lxrdr0
@r_devops

From all the "infrastructure as code" tools which DSL (code) you think is the most intuitive for big projects?

Hello all

I'm kind of new to the DevOps ecosystem, I notice there are many DSL languages for the IoC
I have high level question, what do you think is the most intuitive DSL no matter which TOOL?

https://redd.it/lxfmxw
@r_devops

Klustered #3 - Live Cluster Debugging and Special SIG Honk CTF

Hi everyone. Thank you for the kind words on the two previous episodes!

Episode 3 happened yesterday. This time, I’m joined by Kubernetes contributor, Michael Hausenblas. Unfortunately for us, we’re up against Justin Garrison & SIG Honk (Ian Coldwater, Duffie Cooley, Rory McCune, and Brad Geeseman)

This one seem some rather unique “breaks” from both teams. I won’t leave any spoilers in case you want to guess as you watch.

Again, thanks for being so supportive of this series. I hope you enjoy 😍

https://youtu.be/Ps2CQm6_aZU

https://redd.it/ly7tdd
@r_devops

Hey everyone. Wondering if anyone can help me on advice for a simple SaltStack POC - just need to find a robust Linux distribution or something but having a time with it.

If you could humor me also, eli5 why saltstack’s Googlable doco is so tailored to every environment it lives in, that would also rly help.

https://redd.it/lxf4fs
@r_devops

What it is like to be a devops engineer

I always wonder what problem do devops engineer face, I am we developer who is also a student and thinking of learning web development, Is devops that bad? How should someone get started

https://redd.it/lxap6d
@r_devops

Ask r/devops: Small Time Developer HIPAA Web App Hosting.

Good day. I'm a web developer creating a webapp and giving it to a small medical research facility. I plan on giving the platform for free and accept fees for paying cloud subscriptions. Could I get recommendations and tips in determining methods to deploy my WebApp and database? I can't use AWS or Azure since the fees are really expensive and I want to keep costs at a low so it can be sustainable. Do I keep the db and app on one VPS? or do I keep the DB separate on a managed database? I'm looking at LiquidWeb. But I'm having trouble about implementation. I would really appreciate any help. Devops has never been my forte and this will be my first stint at it. Thank you.

https://redd.it/lxdop0
@r_devops

How do you organise your study

Hi all,

I'm a 'Server and Storage Analyst' as it stands, and i'm working my way down the DevOps roadmap trying to pick up some new skills.

I've started learning Python and brushing up on Linux, but I find myself getting side-tracked, sometimes for weeks. For instance, this week I got side-tracked as I attended a Microsoft Training Day and ended up down the Azure rabbit hole. I got a certification out of it so it was worthwhile, but my Python skills, or lack there of, has definitely suffered.

To organise my study, I made a OneNote and used some folders etc but it's not working all that well. I'm planning on buying a whiteboard and a calendar to stick on my wall, so I can write down what I plan to achieve in the short and long term, but before i do, I was wondering whether anybody has some tips on how to properly manage your study.

​

What do you guys do? Trello? OneNote? Good old fashioned pen and paper?

https://redd.it/lyaupd
@r_devops

Looking for multi-cloud management console

Would like to provision and monitor AWS, Azure and GCP instances from one place. Couldn't find something good. Assistance appreciated!

https://redd.it/lycxli
@r_devops

We recently wrote about why and how you could migrate from Jenkins Freestyle to Multibranch pipeline.

This article talks about the reasons, advantages and challenges we faced while migrating from Freestyle Job to Jenkins Pipeline. It contains a reusable Jenkinsfile template.


Sharing the link in the comment section.

https://redd.it/lyd1ge
@r_devops

Can someone help me understand where Ansible fits in a CI/CD pipeline?

Hello. I'm fairly new to DevOps and I'm trying to teach myself various tools such as Terraform, Jenkins, Packer, Docker, Kubernetes, etc. However, I'm not quite sure where Ansible fits in a CI/CD pipeline on AWS. Ansible feels...redundant, almost useless. It seems like 99% of the pipeline is already being handled by Terraform, Packer, Jenkins, and Kubernetes.

Can someone please enlighten me on where Ansible comes into play? How do you use Ansible? What am I missing? Thanks.

https://redd.it/lyc8cr
@r_devops

MLOps podcast series

Hello, everyone. My co-host and I are running a multipart series about MLOps on our podcast Delivery, Interrupted. We interview several MLOps experts and discuss everything from how to get started with machine learning in your business to CD practices in a ML world. There are more episodes to come on the subject, so now’s a good time to start listening.

Delivery, Interrupted podcast

https://redd.it/lyde57
@r_devops

What is most challenging about DevOps in real life?

Part of my job is to help people with DevOps and I started making a list of questions for people to consider. Because DevOps is so application specific, there is no standard answer - although all the Hello World tutorials out there would lead us to believe otherwise.

I think the most complicated technical topic is one of deployment promotion, how to move something from dev to staging, etc. to production

I have people tell me they prefer to click a UI to deploy to a "target" environment. I ask them well, what version of your code is running on `uat` right now? Which they cannot answer…
I personally prefer having long running branches per environment, e.g. dev, staging, production…
but people new to DevOps (or git outside of a UI?) struggle with managing long-lived branches and merge conflicts.
but people get stuck on who promotes or merges changes from one branch to another.

Sometimes I feel like this is because people haven't defined these processes, which for me is akin to never planning for failure. It needs to be defined. Sometimes I feel like people just struggle with git. In a previous job where I mentored developers, people would ask for help and I tried to explain out loud to them as I debugged, but often I myself was lost in the IDE. When I switched to a terminal window, many were lost.

I think the most challenging general concept is governance, but that isn't just DevOps specific. It's hard to figure out a RBAC model and then to map that both to cloud and automation. But I think I have that one figured out in terms of how to explain it.

What do you think is most challenging? I'm asking because I like the hard problems and figuring out a way to teach people to help them understand.

In my work I encounter a very specific group of people. I was wondering what other people "in the real world" (and not my work bubble), what do you see?

https://redd.it/lyfwyu
@r_devops