Which CI/CD tools (with staging environment/sandbox for testing) which suitable for this containerized application?

Hi,
I’m a newbie in container technology and currently being in one project to improve my skill, I try to containerized application using Docker. So, I use webhook and now I have my master branch Docker image and automated development on Dockerhub. I’d like to ask for suggestion of CI/CD tools. First, I choose Jenkins but I’m not sure that Jenkins will have a staging environment/sandbox (like in Heroku CI/CD) for my “develop” branch to test before merging to “master”. Do you have any suggestion? or you think staging environment is unnecessary?

Ps. I have plan to deploy on GCP using k8s

Thank you in advance for your comments.

https://redd.it/lfdkwn
@r_devops

Good solution to avoid direct SSH with pem keys

Hey Guys!

Need your help with finding solution (AWS) how to not SSH with .pem files.

Solutions like SSO with Gsuite, or some other new way that you know.

​

Please help! :)

https://redd.it/lfcpa4
@r_devops

Octopus Deploy Alternatives?

We are looking how we can move away from Octopus Deploy and I could use some suggestions for any suitable alternatives. Seems there's a lot to chose from but many I've looked at so far don't seem to suit our current setup (e.g. DeployBot).

We are currently deploying approx. 30+ .NET applications, SQL databases, windows services etc to on-prem hosted VMs pulled from a TeamCity repo.

Management are keen to move to Azure, but right now I'm not familiar with their pricing structure, how it works deploying on-prem and how easy it is to manage all these components.

Keen to hear any thoughts.

https://redd.it/lg4wby
@r_devops

Jenkins vs Commercial Tools

Hello,

I was hoping to get some advice from experienced DevOps engineers. I am currently trying to choose a tool for implementing the CI/CD pipeline and I need some help with choosing the right tool. The DevOps practice is quite new to my organisation, so I have been reviewing Jenkins against the commercial solutions like Travic CI, Circle CI, TeamCity, Bamboo, GitLab, GitHub Actions. All tools appear to be the same for the most part, but there are two claims made against Jenkins and I would like to know if that is the case from your experience.

Claim 1: Jenkins has a higher maintenance cost than "some commercial tool". Our experience with Jenkins is that we need 1.5 to two FTEs (Full-Time-Equivalents).

In comparion, with "some commercial tool", we need 0.25 to 0.5 FTEs, and the need so far appears to be declining from month to month.

Claim 2: Plugin dependency is complex and the overall maintenability of Jenkins is also complex.

My questions:

Is the maintenance cost as high as mentioned in claim 1 for Jenkins in your experience?

Is the plugin dependency and maintenability that complex that it would be beneficial to choose a commercial tool?

https://redd.it/lg54f6
@r_devops

Jenkins Skype Notifier Plugin

I was asked to configure Jenkins to send build notifications to Skype. I read on the plugin and found out that it needed an older version of Jenkins In order to work. I need some guide on this. Is it still possible to use the plugin on a more recent version of Jenkins??

https://redd.it/lg53pm
@r_devops

Engineering Infrastructure - Looking for a Beginner's Guide

I'm an internal Tech Recruiter specialising on infrastructure roles for the past couple years, everything from large-scale on-prem distributed systems to your run of the mill AWS cloud setup. I've been recruiting and speaking with a lot of DevOps, Observability and Site Reliability Engineers recently. I understand the type of skillset I need to find, I understand when something is relevant to what I'm looking for and when it isn't, but I'd like to go a step further and understand the basics of infrastructure itself. I think it could only help when speaking to Engineers - I don't want to be "that recruiter" that's only trying to shill a job.

How does a distributed system work? What components is it made up of? How do you put all of your software onto the cloud and make it work together? What does Kubernetes actually do? I don't need in-depth explanation and courses, I'm not trying to learn how to code and don't plan on digging into the Linux command line, but some intro guides, whether they be videos, podcasts, articles etc. would be very helpful.

If anyone can recommend any "Beginner's Guide to..." type of content, ideally even targeted at people who aren't necessarily Engineers themselves, I would be highly grateful! I figured this subreddit would be a good place to ask.

Thanks in advance!

https://redd.it/lg3qwg
@r_devops

Is DevOps/DevSecOps a job or environment?

Hi there! I recently found out about DevOps and DevSecOps through my interest in cloud computing. I have found some pretty good articles and videos explaining what each is (including the pinned post for this subreddit).

But I get confused when I try to explain it to other people. I understand DevOps/DevSecOps as kind of like a pipeline, like CD/CI, or environment like Agile, but it is also a prominent job title I see. Which makes me think it is something more...then again, the job descriptions sound like the same ones for cloud engineers...?

I would love to hear anyone else's thoughts on the whole.

https://redd.it/lgekzm
@r_devops

Sharing files between virtual machines

Dears, i have created two virtual machines and i have task to share files through ssh so i need a step guide for this topic

Thanks!

https://redd.it/lg83xn
@r_devops

Suggestions for Instructor Led Course for Cloud Native Certified Kubernetes Administrator (CKA) in Australia?

Hi there,


My work has budget to send people for training. The suggestion to us was an instructor led AWS Solution Architect Associate course that come with the exam.


I want to explore a bit more with Kubernetes (already tried to do the Kubernetes The Hard way , but it was a bit dry), anyone have suggestion of training provider for CKA?


Many thanks!

https://redd.it/lggzd7
@r_devops

CI/CD pipeline from scratch



Hi guys,

I need some advice from you. I have been following an open source project called OpenEMR for quite some time now. It is a HIPPA compliant Electronic Medical Records system used in hospitals and clinics.

I would like to install and host this EMR system in an african rural hospital where i am originally from. The installation and hosting will be at my own cost as my small contribution to humanity.

I would also like to create an entire CI/CD pipeline from scratch on which i will be collaborating on with some friends of mine back in africa to continuosly develop and fix issues/bugs that will inadvertently pop up. I plan on initially hosting it on a local server and ultimately move it on to AWS.

Could you guys give me any guidlines on how i can do this? What will i need to set up this CI/CD Infrastructure? What costs can i expect to encounter being that i am based in Europe and the project will be in Africa? Do i need any other hardware other than a high end machine that i have at home?

Thanks a lot in advance for your inputs/comments/questions/advices.

https://redd.it/lfz8a1
@r_devops

Docker in Kubernetes is about to be gone. What now?

The dust created after the news about Docker Shim deprecation has settled.
Everyone had plenty of time to figure out how to deal with the disappearance of Docker from Kubernetes clusters.
Yet, Docker Shim deprecation is still a cause of confusion and, sometimes, panic.
Here's my take on the "situation" >>> https://youtu.be/xa453MkdaAk
Did you have to do anything? Was it "life as usual", or are you putting your fate in Mirantis taking over Docker Shim maintenance?

https://redd.it/lg5eiz
@r_devops

Azure DevOps Pipeline: To upload the artifacts to another repo (in same project)

Hey ADO experts,
I'm wondering how can I upload the artifact from the same pipeline to another repo in the same project. I'm looking for any task in ADO pipeline which can do it.


I've been doing it on my server using powershell to push files in Git, using git commands. I tried to do the same thing in ADO pipeline using PowerShell task but it does not work.


Your help will be deeply appreciated.

https://redd.it/lfcjx2
@r_devops

Terraform: Serverless Kubernetes Cluster with AWS EKS and Fargate

Running Pods on Fargate with EKS Cluster and exposing them for the outside world with the help of load balancer controller (elbv2) using Terraform.
Also shown how to create both Testing and Production environments with the same Terraform code. And code management with Terraform modules.

Read complete article here :-
https://link.medium.com/Dks0bmfhzdb

https://redd.it/lf8f8l
@r_devops

Hardware Virtualization within CI

Hey I’m wondering if anyone has some good reads about hardware virtualization? Basically I’d like to emulate hardware to flash firmware and run tests, ideally without needing hardware so my solution can be completely cloud based.

Anyone done anything similar before?

Thanks!

https://redd.it/lgofez
@r_devops

Kubernetes - shibboleth + ldap

Using shibboleth and ldap for auth and user management in our app running on k8s.

I'm building helm charts for these based on a legacy project. Wondering if anyone can set me on the track for using something more up to date, perhaps a helm chart combination that is widely used for this purpose.

Have looked at options like cognito but would prefer a k8s based solution.

I'm a bit nooby on this subject, any guidance will be appreciated 🙏

https://redd.it/lggdr3
@r_devops

I made an archive of default config files

Hi everyone!

​

I encountered the following problem:

When editing configuration files I sometimes reached a point where I messed up the config file pretty bad. No point in trying to fix things, when clearly a fresh start makes more sense.

Turns out finding the shipped original version of the configuration file is actually pretty hard. If you are lucky you find this original config file on some random GitHub Gist or accidentally indexed FTP server.
You probably know this situation.

My Solution:

I went ahead and built an archive of these clean, original configuration files. Now you and me got them all in one place.

They are collected from a fresh installation of the application (Apache, nginx, MariaDB, etc) on various Linux distros (Debian, CentOS, Alpine, etc). This is important because config files differ slightly between Linux distros.

​

The Tech:
Frontend: static site generated with Hugo.
Backend: applications are installed in Docker containers. The shipped configuration files are fetched and the containers are destroyed. This process is repeated for every Linux distro.

​

Let me know what you think, what I should improve and what applications/distros you are missing and so on!

TL;DR: My goal is to provide a collection of original, unaltered configuration files for multiple applications.

Link: https://exampleconfig.com

https://redd.it/lgpsbd
@r_devops

Kubernetes alternative to shibboleth

Currently try to build a helm chart around shibboleth, ldap setup.

Wondering if there are any good helm chart alternatives to manage application auth and users on our cluster.

I'm a bit nooby on this subject so doubting ambiguity of the question.

https://redd.it/lgg96u
@r_devops

On-demand self-hosted AWS EC2 runner for GitHub Actions

Hey folks!

As GitHub recently made it possible to create self-hosted runners using API, I've created a new action for creating on-demand self-hosted runners on AWS EC2. Automatically right before you need it.

Please check the repo: https://github.com/machulav/ec2-github-runner

We started using it for running jobs that need access to the private resources in the VPC like a database migration. Maybe it will be useful also for some of you.

I would really appreciate hearing your feedback and thoughts on that!

https://redd.it/lgg2ai
@r_devops

Prometheus Retention Period

Hi there,

What happens to Prometheus metrics data after the retention period ? How can we persist that data without increasing the retention period ? I understand increasing the retention period also increases the storage capacity of the TSDB ?

I'm a beginner with Prometheus, please help with recommended techniques. Thanks

https://redd.it/lgdgs1
@r_devops

Load balancing pods based on least connection on GKE

I have a kube cluster setup on GKE. I want to load balance my pods based on least connection algorithm. I saw that kube proxy has IPVS mode which supports least connection algo but thats not available on GKE.




Is there any way I can load balance pods based on connections on Google kubernetes engine.

https://redd.it/lgap13
@r_devops

Serverless Framework with Terraform: A firsthand experience

Hey all - thought I'd share some learnings and experiences we've had getting the Serverless Framework and Terraform to work in sync. Was quite a journey and hope this helps anyone else trying to get started with a serverless application.

Let me know if you have any questions! Happy to help where I can.

https://redd.it/lg9k7t
@r_devops