Reddit DevOps
266 subscribers
30.9K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
Instances)](https://github.com/omerbsezer/Fast-Terraform/blob/main/SAMPLE03-EC2-EBS-EFS.md)
* [SAMPLE-04: Provisioning ECR (Elastic Container Repository), Pushing Image to ECR, Provisioning ECS (Elastic Container Service), VPC (Virtual Private Cloud), ELB (Elastic Load Balancer), ECS Tasks and Service on Fargate Cluster](https://github.com/omerbsezer/Fast-Terraform/blob/main/SAMPLE04-ECR-ECS-ELB-VPC-ECS-Service.md)
* [SAMPLE-05: Provisioning ECR, Lambda Function and API Gateway to run Flask App Container on Lambda](https://github.com/omerbsezer/Fast-Terraform/blob/main/SAMPLE05-Lambda-Container-ApiGateway-FlaskApp.md)
* [SAMPLE-06: Provisioning EKS (Elastic Kubernetes Service) with Managed Nodes using Blueprint and Modules](https://github.com/omerbsezer/Fast-Terraform/blob/main/SAMPLE06-EKS-ManagedNodes-Blueprint.md)
* [SAMPLE-07: CI/CD on AWS => Provisioning CodeCommit and CodePipeline, Triggering CodeBuild and CodeDeploy, Running on Lambda Container](https://github.com/omerbsezer/Fast-Terraform/blob/main/SAMPLE07-CodeCommit-Pipeline-Build-Deploy-Lambda.md)
* [SAMPLE-08: Provisioning S3 and CloudFront to serve Static Web Site](https://github.com/omerbsezer/Fast-Terraform/blob/main/SAMPLE08-S3-CloudFront-Static-WebSite.md)

**Table of Contents**

* [Motivation](https://github.com/omerbsezer/Fast-Terraform#motivation)
* [What is Terraform?](https://github.com/omerbsezer/Fast-Terraform#what_is_terraform)
* [How Terraform Works?](https://github.com/omerbsezer/Fast-Terraform#how_terrafom_works)
* [Terraform File Components](https://github.com/omerbsezer/Fast-Terraform#terrafom_file_components)
* [Providers](https://github.com/omerbsezer/Fast-Terraform#providers)
* [Resources](https://github.com/omerbsezer/Fast-Terraform#resources)
* [Variables (tfvar)](https://github.com/omerbsezer/Fast-Terraform#variables)
* [Values (Locals, Outputs)](https://github.com/omerbsezer/Fast-Terraform#values)
* [Meta Arguments](https://github.com/omerbsezer/Fast-Terraform#meta_arguments)
* [Dynamic Blocks](https://github.com/omerbsezer/Fast-Terraform#dynamic_blocks)
* [Data Sources](https://github.com/omerbsezer/Fast-Terraform#datasources)
* [Provisioners (file, remote\_exec, local\_exec), Null Resource](https://github.com/omerbsezer/Fast-Terraform#provisioners)
* [Modules](https://github.com/omerbsezer/Fast-Terraform#modules)
* [Workspaces](https://github.com/omerbsezer/Fast-Terraform#workspaces)
* [Templates](https://github.com/omerbsezer/Fast-Terraform#templates)
* [Backends and Remote States](https://github.com/omerbsezer/Fast-Terraform#backends_remote_states)
* [Terraform Best Practices](https://github.com/omerbsezer/Fast-Terraform#best_practice)
* [AWS Terraform Hands-on Samples](https://github.com/omerbsezer/Fast-Terraform#samples)
* [SAMPLE-01: EC2s (Windows 2019 Server, Ubuntu 20.04), VPC, Key-Pairs for SSH, RDP connections](https://github.com/omerbsezer/Fast-Terraform#ec2_vpc_key_pair_ssh_rdp)
* [SAMPLE-02: Provisioning Lambda Function, API Gateway and Reaching HTML Page in Python Code From Browsers](https://github.com/omerbsezer/Fast-Terraform#lambda_apigateway_python)
* [SAMPLE-03: EBS (Elastic Block Storage: HDD, SDD) and EFS (Elastic File System: NFS) Configuration with EC2s (Ubuntu and Windows Instances)](https://github.com/omerbsezer/Fast-Terraform#ebs_efs_ec2)
* [SAMPLE-04: Provisioning ECR (Elastic Container Repository), Pushing Image to ECR, Provisioning ECS (Elastic Container Service), VPC (Virtual Private Cloud), ELB (Elastic Load Balancer), ECS Tasks and Service on Fargate Cluster](https://github.com/omerbsezer/Fast-Terraform#ecr_ecs_elb_vpc_ecs_service_fargate)
* [SAMPLE-05: Provisioning ECR, Lambda Function and API Gateway to run Flask App Container on Lambda](https://github.com/omerbsezer/Fast-Terraform#ecr_lambda_apigateway_container)
* [SAMPLE-06: Provisioning EKS (Elastic Kubernetes Service) with Managed Nodes using Blueprint and Modules](https://github.com/omerbsezer/Fast-Terraform#eks_managednodes_blueprint)
* [SAMPLE-07: CI/CD on AWS => Provisioning CodeCommit
Transitioning to DevOps

Hey Guys,
I am currently looking for a role as a Data Analyst, I’ve 2 years experience in the same, I’ve been applying since last 4 months, applied to at least 400 jobs. Hardly had 5 interviews, I’m doing my Master’s in Information Systems, where everyone is looking for Analytics job by faking their resumes with 3-4 years work experience, so it’s become a mess to get a Data Analyst role. Now, I have come to a point where I feel there’s no point of applying, and I’m thinking I won’t be able get into Analytics jobs anytime soon with this trend going on. With no interest in becoming a Full Stack Developer, I want to get into DevOps mostly using Azure cloud. I wanted to know how the hiring trend is for a DevOps role, and what are some skills I need to concentrate on, and will there be a saturation point like how Data jobs have become ?

https://redd.it/12xtbk8
@r_devops
Master Graceful Degradation in Microservices: Exclusive Webinar Tomorrow!

Hello everyone,

​

If anyone is interested in mastering graceful degradation in microservices then please join tomorrow’s webinar. We'll cover topics like enhancing reliability and performance through intelligent load management in cloud-native applications.

https://www.linkedin.com/events/reliabilityinmicroservicesenvir7048663975290368000/

https://redd.it/12xnw50
@r_devops
Migrating a WordPress website to a better hosting service

TLDR: Am a webdev that is asked to handle operations; Medium company wants to upgrade hosting of their wordpress (not my website) but no idea how to go about doing that (because I am a webdev, not an ops. Suggestions on how to go about picking the best suited hosting service is welcome, and also how to migrate the wordpress website and its big bag of plugins also welcome. Where to go for objective information/benchmark on hosting services that isn't all affiliated XYZ/ads (like, the MDN of hosting)?

​

Hi r/devops, I'm a bit over my head. Boss requested we move our medium size company's wordpress website from WordPress's cheapest hosting service to something more robust because many of our visitors are experiencing poor website performances on their visits:

Some async images occasionally not loading
scripts not downloading properly
deprecated code warnings
slow webpage load times
formatting html scripts not executing consistently because sometimes the js files are getting 403 errors and not loading
missing fonts warnings

Possible causes for poor website performance could be (I'm just guessing):

all assets (imgs particularly) were never compressed or properly cropped so even some little avatar are over 1MB each
perhaps because current server is located far from majority visitors (US servers, Asia visitors)
deprecated code not functioning as expected
low ram, cpu, etc hardware restrictions due to current cheap hosting plan

Initially, the website ran smoothly while it was light on assets and # of pages in the beginning, but now that the website is more than 3GB, it is not performing well at all.

I am a professional 3+ years fullstack Java/Spring/JSP/SQL/Vuejs/JS/CSS webdev asked to do heavy lifting that is mostly on the operations side, and have a million questions. I am new to this company and was not the original developer of this website. It is badly written/optimized and have copious amounts of wordpress plugins weighing it down. Could use all the help I can get.

My questions include:

Currently have 3000 visitors per month but will expect it to reach 10000 per month soon, with bigger peaks at 3000 visitors per day on busy days, all from greater Asia region and some from the US, a few from the EU. I don't think we need cache and queues like ticketing systems do for load balancing but I do think we need more of something infrastructure-wise? RAM? Bandwidth? Better server locations closer to vast majority of our visitors in Asia? What are good resources/websites to visit that 'benchmark' available hosting service options, what specs should we be focusing on maximizing?
The new hosting service has to support Wordpress ofc, but it also probably has to support current plugins too ideally. How realistic is it that we require the new hosting service to support currently used plugins?
Where can I go to find an objective list of hosting services that provide for the Asian region, perhaps ranked by value or some other metric?
I've found a handful of VPS that say they support wordpress migrations. I don't find any dedicated servers/dedicated cloud that say this. Price is not a major concern. Interested to know why the expensive options seem to have less support.
The boss is looking for top of the line hosting (in her words "looking to buy a mansion for our website") even though we currently may not have the staff to maintain 'the mansion'. I suspect we can adequately be served just going up a tier to VPS or shared hosting by some company that has servers in China and Taiwan specifically as well, that also supports WordPress. Anyone know if such a service exists? How to go about searching for one like that without being buried under ads? Do you agree we can get by without going straight to something like AWS? Or is that still a good option for us?
What other sub reddits should this be posted, if this isn't the best place to ask these questions?

EDIT: Formatting

Thank you for your
I can't change my job and it's so frustrating

I'm struggling to understand why I'm not being successful in applying for Cloud Engineer/DevOps positions. English is not my first language, and I wonder if that's part of the issue. The requirements for these positions seem to be getting more demanding, and perhaps my resume is not up to par. I live and work in South America, but I'm interested in pursuing opportunities in the US or Europe. Unfortunately, I've been rejected by every company I've applied to, and I haven't even been granted an interview. Is my resume that bad? https://imgur.com/Dn1hZDS

https://redd.it/12yqpii
@r_devops
Need Help - New to Devops. Docker or VM?

So my development team and I are working on a third party application where we can create custom scripts, plugins, workflows, etc. The plan is to use GitHub for source control and Jenkins for our pipeline to run unit and integration tests and deploy to servers. The part I am having trouble with is running the integration tests. I would like to do this in a separate container/VM so that way each time the tests are ran, it runs in a new instance so we can have the tests be repeatable. On top of this, it would be nice to create a development environment for the team to use when the application is updated.

The application is a web server with a database.

​

I am hoping someone can point me in the right direction, do I proceed to learn Docker, or should I learn how to automate creating a VM?

​

Summary:

Need to generate development environment for each developer when the application we are developing for is updated.

Need to have a contained environment to run tests in that is reset after all tests have run.

What is the best way?

https://redd.it/12ytpu5
@r_devops
Recommended devops stack 2023?

I'm a self-taught backend developer interested in learn devops tools for improve my job opportunities, (some choose to be fullstack to be more attractive, but I am interested in directing my profile more towards the world of devops).


At the moment I have knowledge of the following tech stack:

- FastAPI (python)
- Spring Boot (Java)
- postgresql
- Git and github repositories
- Docker
- Linux and bash (I use Fedora)

Learning Docker I have started to like the world of devops, but, I'm finding that there are a lot of different technologies like ansible, terraform, kubernetes, and some compete with each other, like github actions, jenkins, and gitlab.

I'm having flashbacks to when I first started learning programming and didn't know which programming language to choose. and I spent a lot of time looking at options until I decided on start with python.

So, if you can make a recommendation of the technologies that I could focus on to complement my profile, I would appreciate it. I am currently very interested in learning AWS as I am doing a course on AWS lambda functions with java. So it would be preferable if the technologies make a good match with AWS.

Thanks in advance!

https://redd.it/12x74ag
@r_devops
Is Tekton alive? Comparing Tekton Pipelines with Argo Workflows, ArgoCD and Jenkins

Is Tekton still alive? I’ve successfully used this tool in an Openshift environment, where it makes all the sense - there is a proper integration with the platform itself, and RedHat puts lots of effort into making a real CI/CD system out of it. But do Tekton Pipelines make sense today without a wrapper like Pipeline as Code and JenkinsX on top? And are there many companies actually using Tekton, compared to Argo and similar tools? I tried to answer all of these questions in this new mkdev video, plus did some experiments again with editing - hope it’s now even more fun and engaging to watch it, but feel free to roast me in the comments.

https://youtu.be/87FxZvEyRfI

https://redd.it/12x6eia
@r_devops
Monitoring and Observability - Pain Points

Last post I made here was about the usage of Datadog in an AWS environment. A lot of you made very good points on it’s use case and cost-benefit.

I also investigated a little more and found out that not only did my company went through Datadog, but also Grafana and ELK during the last year.

This intrigued me and I came to the conclusion that although Datadog seems to suit us the best, it has some common issues as the other tools also had: complexity, data overload coupled with scaling and lack of customisation.

I wonder if this relates to your experience as well.

What are the most common pain points that you find in nowadays monitoring and observability tools?

https://redd.it/12yzxlg
@r_devops
Am i really expected to make regex expressions by hand on the spot?

Had a terrible interview because the problem was essentially write a regex for this nginx log sample.

I know where the expression goes i just get headaches writing these without any kind of validator tooling.

https://redd.it/12z52m8
@r_devops
Need help organizing the flow of information, any advice is appreciated.

Howdy all, i hope I'm in the right place, i'm wondering if anyone can suggest good books, blogs or give me some advice. I work for a small automation company where we all do a variety of tasks. Recently, I've taken on the role of programming and managing our hardware and cloud infrastructure. I'm trying to find a way to organize and store all of our documents, code, and PLC programs in one central location for myself and my coworkers to access. I'm hoping to learn about more professional solutions than just using scripts and a shared drive. any advice is appreciated

https://redd.it/12z5f5i
@r_devops
Phantom folder in docker overlay2

A security scan is trowing an alert for a folder inside docker overlay2. But I'm not able to find the folder inside overlay2. There's a lot of other folders inside overlay2, but this particular one which raises the alert is missing, yet the scan detects it somehow. What should I do?

https://redd.it/12z9vbo
@r_devops
AWS privacy and security’s feedback

Hey! So, for our online event platform, we use Amazon Web Services (AWS) infrastructure. We have heard a lot about the security and privacy systems that Amazon uses to protect data, using all kinds of fancy stuff like the shared responsibility model, Advanced Encryption Standard (AES), and all these security and compliance certifications like SOC 1, SOC 2, and PCI DSS (don't even ask me about the last ones meaning).


But here's the thing, we wanna know what you think about AWS and how they handle privacy and data storage. Have any of y'all had any issues or concerns about this?

https://redd.it/12za2i4
@r_devops
Docker: Will my container contain source code?

Hi,

Getting ready for demo.

The back-end is written in Golang.

I remember that I have to make a Dockerfile, and K8S yaml.

But will my container contain my Golang source code or how can I make it not?

I just want it to execute a binary file and that’s it.

Thanks :)

https://redd.it/12zb4tp
@r_devops
Using GlusterFS as a storage for Kubernetes?

Hi all. I have a managed k8s on DigitalOcean and I want to use GlusterFS (mostly because of read-write-many one volume to be accessed by multiple pods).
The trick is to initialize glusterfs and a volume from k8s (as StatefulSet?) - all from the glusterfs to be controlled in k8s.

Does anyone of you did this? What's your experience, is it a good idea and where can I look for more implementation details (I'm new at k8s)?


Thanks!

https://redd.it/12zd9h1
@r_devops
Noone mentions Backup in devops? Is Veeam knowledge important?

IT admin trying to learn more about cloud/devops.

Is Veeam (Backup & Replication) needed for Cloud/Devops in AWS. Or is it better to just use some kind of Region or Availability Zone Duplication to carry out backup duties.
How do you backup your data in the Cloud (from instances, databases etc.)?
I normally don't hear much about this topic in devops so would be interested in hearing your thoughts on this.

https://redd.it/12zek00
@r_devops