CI/CD with Long Running Regression Tests

In CI/CD, every time a commit is pushed to the master branch, a container is spun up, the code is pulled down, and the tests are run. If the tests pass, the code is merged into master and deployed to prod.

How does this work if your tests are not fast? Let's say between 1-2 hours.

I know most of you agile people will say "then use mocks to make the tests faster", but just assume for sake of argument that you are working with legacy code and in no circumstance are willing to change the existing test suite.

Can you still do CI/CD when you have long running tests?

Is there anything to be aware of? For example let's say at t=0 minutes one person pushes to master, and at t=10 another person pushes to master. But the tests take 1 hour to run. Is this going to be a problem?

https://redd.it/zsp4ox
@r_devops

Karpenter : Difference between cluster autoscaling and Serverless ?

Hi all, I hope you and your folks are all doing fine during these festive times,

So right now on the project we are working on we are using Karpenter in order to assure cluster autoscaling from within our EKS. First time I used it, and I find it to be pretty interesting, especially since it is cloud agnostic and validated and approved by the AWS community.

On the other hand, there are solutions like K-native or Fargate which allows you to deploy Serverless apps on K8s. I never actually worked with those, but I'm familiar with the concepts of Serverless architectures, and I'm really having a hard time seeing the difference between what Karpenter offers, and what K-native offers. Maybe 0 scaling with Serverless ?

Can anyone help me grasp the difference between these two solutions, and what would be the perfect use case for each ?

Thanks.

https://redd.it/zsrjc7
@r_devops

muskjet.live grafana dashboard

I made a quick grafana dashboard to display Elon Musk's jet's current location. I understand this makes him upset, so I was inclined to contribute.

https://grafana.com/grafana/dashboards/17690-muskjet/

https://redd.it/zt4mho
@r_devops

How to Automate your WireGuard Virtual Networks with NMCTL and Netmaker

https://medium.com/netmaker/how-to-automate-your-wireguard-virtual-networks-with-nmctl-and-netmaker-d0234406e2fb


Thought this might be useful to you all! Automate WireGuard-based vitrual networks with a kubectl-like CLI, and bake management into your Automation Tools.

https://redd.it/zsuvlo
@r_devops

Proper NFS fstab mount options for web server data

Hello,

What would be sensible /etc/fstab options for automounting a web server's data (static files only) on a modern architecture (ubuntu 20.04 LTS, nginx, NFS share from Isilon infrastructure) ?

I've found some examples but with what looks like obsolete options.

I'm tempted to go with:

host_ip:/path /nfs/path nfs noatime,nolock,tcp 0 0

Should I add 'hard', 'rw' (is it not default?) ?

Thanks for your help!

EDIT: Added mention of « static files only »

https://redd.it/zsloex
@r_devops

What are some fun/useful ideas to play with Python and REST APIs?

I'm looking to get a better grasp on Python and working with APIs but I'm a hands-on learner and I was wondering if anyone has some recommendations for some fun projects that would strengthen both of these? Perhaps real-life examples some of you have done. I'm semi familiar with the requests library.

I'm also down with combining it with os and or pathlib.

Any ideas?

https://redd.it/zsw236
@r_devops

What else should I put on my CV for applying to entry level positions in DevOps? What are some technologies or projects that would make me stand out?

Hello. So I got interested into DevOps and started learning all these different tools and technologies. I have started using AWS and set up my own personal full stack project using EC2, RDS, S3, Route 53, CloudFront, etc. I have also created my own CI/CD Pipeline using GitLab for that project.

What else could I put on my CV ? Would setting infrastructure again, but this time using Terraform and creating terraform file would be good (because last time I used just AWS console) ? Would using ECS or EKS to show some Docker container knowledge would be good idea?

https://redd.it/ztk2oz
@r_devops

Is GCP's cloud sql auth proxy considered a resource in terraform?

I'm trying to have compute instances deployed with cloud sql auth proxy installed right away on it to be able to have a connection through it to the cloud sql instance I have on the same project. I'm using the proxy because I'll be connecting from an app that's not in the same project as the compute instance and the sql instance. I need it to do all of this through Terraform but I still can't figure out how's the proxy deployed as code if it's not a terraform resource. Any ideas?

https://redd.it/ztcjx0
@r_devops

Does Azure DevOps documentation teach the basic of Devops?

Is learning Azure DevOps sufficient for quickly learning basic devops for someone who has no experience or knowledge of devops?

https://redd.it/ztskq1
@r_devops

DevOps team constitution

I dont know if this is allowed in this sub, but is there some scientific paper on the constitution of a DevOps team? For masters dissertation purposes. Thank you very much

https://redd.it/ztpp1w
@r_devops

containerized java development to deployment pipeline

Anyone here work in a java shop that are building and deploying web apps on Tomcat that is willing to share the entire process, just high level, from the actual developer environment all the way to production deployment?

I'd be especially interested in anyone who is developing in, and/or deploying to, containers.

Our developers all work locally on Windows with Eclipse today, they deploy to staging/test/qa/uat themselves and then we have an ops team that manually deploys to production. You can see the problems with this already, I'm sure.

https://redd.it/ztmepl
@r_devops

how hard would it be for a data engineer to become a devops engineer?

I work as a data engineer, and do a lot of development in python, SQL, and command line scripts. I also am very familiar with AWS.



I'm pretty familiar with infrastructure as code, where I have used Terraform and Cloudformation.




How hard would it be for me to apply for devops jobs? All devops jobs in my area are pretty senior it seems, and I have been working in data engineering for 4 years.

https://redd.it/ztm601
@r_devops

Should i study for Software Engineer or AWS re/Start?

I have no idea what each of these do, but i need to change a career , and found a school with these 2 choices. My creteria for selection:

1)be able to work from home

2) have decent salary

3) not overstress from work.

​

Any advice is appreciated

https://redd.it/zu0s88
@r_devops

Beginner DevOps

I’m maths graduate student who is trying to get into learning all about DevOps. I need advice on where to start from. I want some recommendation on some online courses or books for me to start with.

https://redd.it/zu08d4
@r_devops

Am I doing it right?

I am new to DevOps (intern) and I am trying to secure/improve how we handle config files. We deploy java projects which needs a config.properties file.

This config file contains username and passwords of databases. For now, we are storing these files on our server and move them to tomcat at the time of deploying via jenkins, which is not a secure way.

I was thinking of introducing hashicorp vault and integrate it with Jenkins. So the flow would be:

​

get secret from vault at the time of build > parse config file using python (to update credentials) > deploy it to tomcat

​

Please tell me if this is the right way of doing it or if there are other better ways?

https://redd.it/zttqnj
@r_devops

Paying $7847.42/mo in unused Reserved Instances?

I'm the CTO of a web3 company (I know lol) and I recently found myself in a bit of a predicament with AWS. We were given $100,000 in AWS credits to use for building out our infrastructure, and as someone who doesn't have a lot of experience setting up AWS accounts, I turned to the AWS cost explorer for guidance. I didn’t pay enough attention to our costs (which is probably exactly what AWS wants).

The cost explorer recommended that we purchase 1-year reserved instances, so that's what we did. At the time, we were on credits and didn't really worry too much about the architecture – looking back, that was a pretty stupid move.

We ended up purchasing the following instances: r6i.xlarge, c4.large, t3a.xlarge, m5.xlarge, m5.xlarge, m5.xlarge, t3a.xlarge, m5.xlarge. At the peak, these were all being fully utilized.

However, things changed when the crypto market crashed and we saw a large dropoff in traffic (around 60%). As a result, our traffic dropped from 10,000 requests per minute to 4,000 requests per minute, and my EKS cluster also dropped in the number of instances it needed.

Here's a breakdown of the unused hours for each instance:

r6i.xlarge: 34,944 reservation hours unused
c4.large: 353 reservation hours unused
t3a.xlarge: 10,680 reservation hours unused
m5.xlarge: 9 reservation hours unused
m5.xlarge: 4 reservation hours unused
m5.xlarge: 108.55 reservation hours unused
t3a.xlarge: 19,141.32 reservation hours unused
m5.xlarge: 911.68 reservation hours unused

(see screenshot here https://i.imgur.com/2WmfP10.png)

I was left with a bunch of reserved instances that I wasn't using, and I was still paying for them even though they weren't providing any value. I tried talking to AWS support to see if they could help me solve this issue, but I didn't make any progress. I tried reaching out via email, phone, and even through the AWS console, but I didn't get any help.

I had 6 months on the reserved instances and this was our biggest expense at the company. We were able to reduce our other costs quite a lot, but this sucked bc we weren’t using any of the instances at all.

I know I'm not the only one who's experienced something like this, so I wanted to share how we fixed it.

I had already tried selling the reserved instances on the marketplace (no one bought them) so had resigned myself to paying the costs.

One of our investors recommended a SaaS company (I don’t want to name them bc promotion) that would buy and sell RIs on our behalf. Lowkey thought this was too risky and didn’t want to give them access to our AWS accounts but in the end, we decided to run a POC to give it a try. To be safe, we talked to one of their competitors as well (trying to learn from my mistakes to take better precautions lol).

In the end, we decided to go with the first tool for a few reasons: more favorable contract terms, better insights and reporting, and a product roadmap that fits what we think our needs will be in the future. Would recommend making sure that any tool you use in this space fits your needs in both the near future and the long-term time horizon - I can see this not being the case for many companies with more stable compute.

It took this company around 20 days to offload the reserved instances that we had on hand and they also were able to get us better terms with their 3-yr RIs. They charged us XX% for the savings that they created which is not ideal but still came out to more than we were getting on the one-year reserved instances. At the end of the day, I/we would be in a much better spot if we had taken more time to buy the right instances and had better prepared for the crypto crash but if you are in a similar situation then this might be helpful.

TLDR: I bought a lot of 1 yr reserved instances that went underutilized shortly after. I found a solution to offload the reserved instances, but not as soon as I would have liked.

PS: Sorry for my rant

:)

https://redd.it/ztnbxy
@r_devops

What's going to be the next big thing after DevOps?

Hey guys, a question that just sprung up in my head - today there's a lot of hype around DevOps, but what will be the next big thing?

https://redd.it/ztbpod
@r_devops

Need Help in selecting a CICD tool AWS CodePipeline Suite or Gitlab

Learner Here, Starting a small project and would like to learn and implement CICD for a project .

Need some help in deciding a CICD tool for getting things started for a web app project which relies almost AWS Infra (Server less). So would like to hear some thoughts on which tool should I be considering for a small team (3) and benefits and pitfalls of AWS toolkit over Git lab.

Would like to hear some insights from people using these tools in daily work and know more about ease of setting things up and cost wise

https://redd.it/zu7zmc
@r_devops

How to calculate hardware requirements for a hypervisor?

hello guys,

Wish everyone is doing okay.

I would like to setup a baremetal hypervisor that would virtualize \~25 vm for 25 users.

The vms mostly would be used for sending email , working with docs and will have software package like microsoft office,adobe etc and all of them running Win 10 Enterprise.

How to calculate minimal hardware requirements for hypervisor server and what should one take in consideration, are there any better ways?

https://redd.it/zu7wsu
@r_devops

Billions of unnecessary files in GitHub

It seems a lot of people who use #GitHub don't know about .gitignore or they misunderstand how to use it. This leads to billions of unnecessary files: generated files, 3rd party installations, caches etc. to be added to git and GitHub.

Not only is this a waste of space and a waste of network bandwidth when you clone a project, it also makes tracking the real changes more difficult.

https://dev.to/szabgab/billions-of-unnecessary-files-in-github-i85

https://redd.it/ztfayw
@r_devops