Harness launched source available continuous delivery

The Harness CD Community Edition is available for use free of charge.

https://redd.it/s8dzq2
@r_devops

Automate Deployments on Merge to Main Branch

Sorry for the beginner question, but I'm feeling really overwhelmed with this task and need some input from people much more experienced than myself.

I have 2YOE working as a dev. I'm now in a new role (6 months here) and it's a small company, even though my title is Software Developer, I'm doing a fair bit with servers because we need it and I think it's pretty fun.

Before I started, our deployment process was pretty basic. We needed to ssh into the server, switch user to www-data, cd into the relevant directory and run git pull, then run any relevant commands based on which files had changed. Some projects have a separate frontend and API backend so you'd repeat the process if there were changes across the full stack.

Also there are some projects that share one codebase, but have \~10 different customer-facing websites. So if you made changes to this codebase, you'd have to cd and run relevant commands in \~10 separate directories.

What I've done so far:

I've recently wrote a bash script that automates some of our deployment process. Now, we need to ssh into the server, switch user to www-data, run the deploy script, deploy script asks which project is being deployed, deploy script then cd's into relevant directories and runs any relevant commands based on which files have been changed.

I'm happy with what I've done so far, because if we need to compile frontend assets a deployment can sometimes take around an hour. But I'd like to completely automate this by having the script run (or a more automation-friendly version of the script) when code is successfully merged into the main branch. Removing the need to ssh into the server and run the script.

I've looked into Jenkins, read through the docs and watched some courses on YouTube and Udemy, but it all seems really overwhelming. They mention Docker, Ansible, AWS etc and none of this is relevant to me at this time. All I want to do is run the script when code is merged to main.

I've thought about setting up a cron job to check for changes every hour or so, but that seems inefficient to me and I'd rather do things the right way.

Some additional info:

* I only want to use free, open-source tools at this time.
* The client is in control of the server. No idea where it's hosted or even if it's on prem
* I'm using PHP, Ubuntu, Bitbucket.

https://redd.it/s8eifq
@r_devops

Who is tracking the performance of the CI pipeline and test success metrics in an organization?

I'm seeing organizations are more and more trying to optimize the CI issues.

I wonder who is accountable/responsible for the performance of the CI pipelines?

https://redd.it/s8fa5b
@r_devops

Some questions about influxdb / k8s

Hello,

Please excuse my broken English.

My company collects metrics from different cloud customers in InfluxDB, queried by Grafana. Most small customers are stored on a single, shared EC2. Some large customers have a dedicated EC2.

This model is showing its limits today:

\- no HA

\- performance problems occur and the only way to deal with them is to vertically inflate the EC2.

\- an incident on an EC2 can quickly impact x customers

A SaaS solution is not an option for my company at the moment.

From my point of view, I would tend to find a metrics storage solution that supports clustering and sharding, either licensed or open source, and to deploy all this in multi-AZ for HA. On the other hand, a new open source solution forces us to leave InfluxDB and rewrite a lot of dashboards.

Some colleagues suggested to move to containerization and to put influxDB in EKS, each client would have its own database with persistent volume, and we could separate clients by namespaces. I don't have much experience with K8S in production but this raises several alarms for me:

\-> increased complexity

\-> how will the service behave if a node change is scheduled (e.g. drain for update) or forced (node crash)

\-> if we use a cross-AZ storage like EFS, I'm afraid that the performance will not follow at all, InfluxDB is greedy in I/O. And EFS is much more expensive than EBS.

\-> I have the impression that using k8s for a stateful application, which does not scale horizontally, and which is potentially attached to an AZ does not bring much, but I do not have enough experience in orchestration to be sure

I'd like your advices ...

Thanks for reading.

https://redd.it/s8fwxm
@r_devops

Kubernetes Operations Survey

Hello everyone!

I’m doing a quick research about Kubernetes cluster operations. I would appreciate it if you can participate in this survey:
https://forms.gle/4iuyHuPX55wFVL137

Thank you!

https://redd.it/s8hub9
@r_devops

Can you refer multiple Azure cloud services as cloud infrastructure ?

I am using various cloud services on azure for a project such as VNet, Application gateway, AKS, VMs, PublicIP.

Is cloud Infrastructure a appropriate term to refer it ? I need to use it in resume.

For eg. I set up the cloud infrastructure.

I analyzed existing cloud infrastructure

https://redd.it/s8ch4j
@r_devops

How to do a complete security audit of your mongo cloud account

https://kloudle.com/academy/how-to-do-a-complete-security-audit-of-your-mongo-cloud-account

https://redd.it/s8a3j3
@r_devops

HTTP is working with custom domain, but not HTTPS.

https is working with appname.ap-south-1.elasticbeanstalk.com, but not working with custom domain. only http is working with custom domain

https://redd.it/s8ld33
@r_devops

Is there a cloud engineer here that would be down to chat?

Hey all! I might accept a cloud engineer position and I just wanted to see if there is anything in the job description or in my experience so far with them that stands out to you as red flags. I’m currently in an operations/app support role at my current company but since this job has the opportunity to involve more coding/automating, I wanted to move towards it. Any help is very much appreciated!

https://redd.it/s8mq3m
@r_devops

Is many Pipelines good or bad

In Corporate Organizations you often have thousands of unique Pipelines. I recently thought about, if this is a good thing or a bad thing.

I understand that it gives flexibility to the teams, on the other-side, it also means that there is a lower degree of standarization.

​

What are your takes?

https://redd.it/s7u0ja
@r_devops

How do you manage supply chain vulnerabilities of images and pacakges?

Should all images, packages and dependencies get updated - which will trigger a full system rebuild and requirement for full unit, integration and e2e testing or use a firewall or some other way of delivering updated images, packages and externally used libraries?

Supply chain security seems to be very expensive as you have to run daily scans for vulnerabilities due to the fact that you cannot know what vulnerabilities will be found when you even use the latest version today that can be vulnerable tomorrow.

https://redd.it/s8ovrb
@r_devops

What are your "most used" Ansible modules?

Disclaimer: I am mostly interested in VPS because I pay for my own servers, and it's way cheaper than AWS and whatnot. While I am interested in all aspects of tech, I don't have much use for AWS, Azure, or GCE specific modules at this time.



Hey everyone,

I've finally gotten around to start learning Ansible recently, have written some simple playbooks, etc.

I'm curious what you all think are the most important modules you refer to all the time, and which are the must-haves in my toolkit. Ones I have found important so far:

- package and distro-specific (apt mostly as I like Ubuntu servers on the cloud) package managers.
- user to setup non-root users for login.
- service / systemd.
- ini_file / lineinfile for configuration.

I guess I should look into ufw too.

What other modules would you say you use all the time and I need to learn ASAP?

https://redd.it/s8qd2i
@r_devops

Hosted SAAS Basic ElasticSearch or SOLR Options?

Hello, my shop is looking for something along the lines of a Hosted "Human Face" on SOLR or ES. We don't have the staff to build up our own environment, and are looking to a vendor to sell us a packaged solution. We have 20K fairly structured PDFs we need to search with mostly pre-set terms, and a wildcard. Any ideas welcomed!

https://redd.it/s7zzli
@r_devops

Am I unexperienced or are the devops interviews ridiculous?

Hi all,


I have done some interviews for devops/cloud engineer roles. I have a masters degree in CS and I have been in the field professionally for 3-4 years now. I have a high passion for this field and overall feeling comfortable within devops. But this field is very broad and have different definition depending on who you talk to, so of course I'm strong in some areas but lack expertise on some other areas.


What I experienced in the interviews is that they asked very specific questions on what feature X worked in framework Y. I answered with I have used similar framework and took and educated guess on how it could work in framework Y. Other questions would be if I had been in this specific scenario, where some service were failing due to Z and how would I solve it. I answered with what type of solution theoretically could solve it. They said later that where looking for an answer e.g. "I would solve this by using this framework XY" (which I have never worked with). Other scenarios would be asking me specific AWS questions when they know I worked with other cloud providers (Azure, GCP) while the job role is Cloud engineer in Azure.


My point with all of this, while devops is very broad and I feel it's unfair to expect from an 3-4 year old experienced dev to know everything in the field. I get that some frameworks are required to know in order to get job. And I have only applied for jobs where I know the main frameworks. But I haven't had the possibility to work with all those specific frameworks they listed, but I know the theory and methodology behind those frameworks or have experience with similar frameworks. Shouldn't that be enough to convince that I could learn those frameworks when starting?


Personally it feels ridiculous that I need experience with exactly all the specific frameworks they list in the job description . Devops is always changing where frameworks comes and goes. So what are your perspectives on this? Are they narrow-minded or just having high demands on the candidates? Are these interviews reasonable? Or just simply, am I too unexperienced?

https://redd.it/s8rvrc
@r_devops

Terraform - Count dependencies

I'm using module cloudposse/vpc-peering/aws to create a vpc-peering between two VPCs. This modules handles creating routes in-between subnets as well which is what we need. The issue is, when you are creating the VPC and VPC-PEERING in the same run, it fails on :

│ The "count" value depends on resource attributes that cannot be determined until apply, so Terraform cannot predict how many instances will be created. To work around this, use the -target argument to first apply only the resources that the count depends on.

The reason being because when planing, the route tables are not yet created. ( https://github.com/cloudposse/terraform-aws-vpc-peering/blob/master/main.tf#L53 ) . One of the solutions would be apply the VPC beforehand, which i want to avoid. The other being hardcoding the route tables in the tfvars. Any other ideas ?

https://redd.it/s8lwrh
@r_devops

Building DevOps Learning Paths

I am building out learning paths - courses, hands on labs, assessments, etc for the DevOps space.

I need to research to hone in on specific roles that require DevOps knowledge and application. For these roles, I need to pull out
1) key skills, competencies, and knowledge an individual needs
2) what are common authentic tasks that someone needs to be able to do within the DevOps space

What resources would you recommend I look at to get at these answers or share your responses! Are there competency frameworks or Industry boards I can look to?

https://redd.it/s8mu3y
@r_devops

How do you manage your Volumes on a Docker Swarm CLuster

Hello!
I'm setting up a docker swarm cluster with 3 nodes. Since the services can be deployed on one or another node, I was wondering what are the best methods out there to have a distributed storage mechanism for the different nodes.

Thanks in advances for your answers.

https://redd.it/s8xcgr
@r_devops

How Much Studying / Personal Projects Do You Do Outside Of Work?

I do a bit here and there but keep it very leisurely. I know some people who go home after work and all they do are personal projects, contribute to open source, or study / read docs.

I used to do a lot more myself when I was trying to get some experience / land a job but now that I'm in DevOps and I'm doing this all day I feel like I have enough opportunity to learn during the job and flex any coding muscles I might need to as well. Sure it's a different kind of growth where I'm trying to learn a lot as I also need to implement, but I'm ok with that.

I don't need to go home and grind out K8s theory and personal projects, I get my fill on the job and have plenty of opportunity to learn there. I'm also completely ok with the idea that I can't be a master of all this. I know what my strengths are and definitely feel like I'm still growing my skillset all the time anyway.

Some people are into it because it's their hobby outside of work as well and I totally get that. I really like working with all this stuff and learning, but more and more I'm realizing I like disconnecting a bit after work and just enjoying my time / focusing on other things and hobbies.

How do you balance it? Do you get your fill of learning on the job, or do you feel you need to also grind out personal projects / studying outside of work just to try and stay on top of things? Or is it a hobby of yours outside of work as well?

https://redd.it/s8xurf
@r_devops

Differences in AWS, Azure to look at as a recruiter

Hi all! As stated in the title, I am a recruiter working in FinTech and newer into my role. I'm looking for ways to distinguish between a truly experienced Azure DevOps engineer versus someone more green in that area with previous experience in AWS.
A few thoughts below, I'm sure there are a ton of other questions and ponders that haven't come to me quite yet! Feel free to comment as you see fit, be it on a listed question or else!
Is it an easy migration from AWS to Azure?
Huge differences in the two, ie would someone with a strong background in AWS (10yrs+) and a few years of experience in Azure be as skilled in Azure as someone with say, 5-6 years in total experience in Azure?
What are some differentiators to look out for when looking at resumes with both experience types when I'm hiring for Azure? Biggest notable things that I should see on a resume for an Azure DevOps Engineer versus that of an AWS Engineer?
Thanks in advance!

https://redd.it/s84e50
@r_devops

I got an interview call from Google and the designation for which they are hiring is Strategic Cloud Engineer.

What question should I expect in the Google interview for strategic cloud engineer ? I am first time giving interview for google. Just need an idea regarding the same.

Thanks in advance!

https://redd.it/s91zei
@r_devops

Fresh College cybersecurity grad. Opportunity in DevOPs

I recently graduated from college with a degree in cyber security. I feel quite efficient but never learned any language of coding. I would consider myself a beginner in the coding realm. Recently applied to a gaming company that took interest in me, but put me more in a Devops position. I have 1 week to complete an assignment and have 3 days left. The last two question are out of my realm. I've been searching the internet and reddit and have gotten answers but want additional clarification. As I said I have very little coding knowledge and am running iOS. For one of the task they want me to provide a powershell which I had no idea what is was prior to this assignment and have more knowledge on it now but still, scratching the surface. Below I provided some of the info. Still I am not sure what to do and if I should use what i found online regarding the code. Then should i submit it on the word sheet or on visual studio code? Still haven't been able to download powershell on VS Code and not sure how to tackle this. I've also attacked the website that I was going to base the code off of, but not sure how to submit it all.

Any insight helps. Thank you

https://adamtheautomator.com/powershell-onboarding-script/

\-Provide a PowerShell that creates new users in a Windows Active Directory and adds licenses to Ofice 365. • Automated Script to perform Daily Reboots of workstations at 3:00 AM

https://redd.it/s81yeu
@r_devops