Reddit DevOps
268 subscribers
1 photo
31K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
USA Visa Applications for tech jobs

Anyone have experience applying for USA working VISA from Europe? I’m a DevOps Engineer and always wanted to work in the US tech community, I know getting a visa is difficult without a job offer and most companies hiring within the US.

Any tips, knowledge share and feedback would be greatly appreciated.

https://redd.it/p7co80
@r_devops
Setting up SES with Pulumi - A guide

I wrote a small guide to setting up SES with Pulumi that r/devops might be into, you can find it here:

https://vadosware.io/post/setting-up-ses-with-pulumi/ (You could also go straight to the code at the bottom)

In a sea of great options, Pulumi is my choice of infrastructure-as-code library because it actually is code and as a result very flexible.

I've got a huge bent for running my own infrastructure, so I'm always interested in how I can make cloud stuff divert/key off of my own external infrastructure/resources. To that extent, Maddy is mentioned in this post and I encourage everyone to look into it for running a mail server, it's pretty sweet. It's relevant because I set up the DKIM, SPF, etc to support maddy as well as SES -- I could send all my email through maddy but I choose to use SES and keep the second option (receive/send through maddy, send from applications through SES).

Hope you enjoy the post and learn something!

https://redd.it/p7xz6v
@r_devops
Which one should i pick Github Action vs Gitlab?

Hi, i recently joined an internship as DevOps Eng and i was asked to figure out best CI/CD tool and i went through this post https://www.reddit.com/r/devops/comments/ls7lzk/cicd\_if\_you\_were\_to\_start\_over\_what\_tools\_would/ where i noticed whether Github Action or Gitlab would be good choice to start, since our company using Github for repo so which one would be best CI/CD according to your opinion?

THANK YOU so much for your time.

https://redd.it/p81iny
@r_devops
What are the things we as engineers don't spend enough time on?

We often have to balance many tasks and often conflicting priorities, so I was wondering what are the 10 things hard but rewarding activities we don't spend enough time on but would be beneficial to do more of...

So in my opinion, what I'd definitely like to dedicate more of my focus on:

​

1. Backups & Preventing Accidental Deletion

2. Naming Things

3. Code Reviews

4. Problem Definition

5. Architecture and Design Decisions

6. Alignment with Other Teams

7. Giving Praise Where It Is Deserved

8. Hiring

9. Reading Logs

10. Communication

​

I actually put them in an article where I elaborate a bit more on why I think so. But intrigued to know what would you add to the list?

https://redd.it/p8366l
@r_devops
CNCE #2

Hello everyone!

The ChaosNative community is glad to invite you to the Cloud-Native Chaos Engineering Workshop #2 where you can network with tech geeks around the world. Get yourself exposed to the world of resiliency and reliability. We will be having interactive talks and discussions with our experts about:

1. Hands-on experience with a workshop on Cloud Native Chaos Engineering which introduces you to the basics & fundamentals of Chaos Engineering. 

2. A sneak-peek at the latest evolution in the Cloud Native Chaos Engineering world with LitmusChaos 2.0. 

3. A demonstration of running Chaos experiments in just a few steps!

Mark your calendars for 9th September 2021, 9 PM IST

Register here: https://www.chaosnative.com/cnce-workshop

https://redd.it/p85e7m
@r_devops
How to send all traffic to a certain path with a application gateway (azure)

Hi Devops!

I'm struggling to find a way of sending all traffic into a app gw to a certain website path.

Say my website is, stackoverflow.devops.com.

I have a App Service backend with the custom domain stackoverflow.devops.com.

The idea going forwards is to send all traffic to that website to a traffic manager, doing geolocation routing. Currently, if you're in Europe, it routes to an application gateway where the path is fine and will remain as stackoverflow.devops.com, and this works.

If you're in the states, it routes to a different application gateway (with the same backend pool) and I want to change the url to stackoverflow.devops.com/us for any traffic going through this app gw.

I've tried URL rewrites but getting a 'too many redirects' error.

Any ideas?

Thanks!

https://redd.it/p87vaq
@r_devops
Developer productivity tools recommendations please

So my question about what do we as engineers don't spend enough time on, got me interested, what kind of productivity/time-saving tools is everyone using? Would be good to have a nice concentrated list of everyone's favorites ones here.

https://redd.it/p89ng0
@r_devops
How to manage passwords in Helm

My goal is to deploy Helm Charts through Jenkins to Rancher.
I’ve a bunch of passwords stored in HashiCorp Vault.

Right now, I deploy the Helm chart from my local. I run a dockcmd command to pull my values from Vault, store them in a Yaml on my local, and deploy with that values file

It’s not secure, and I was wondering what would be the best way to deploy these passwords along with our charts

https://redd.it/p8devw
@r_devops
Any good tools to deploy self-hosted opensource libs into my AWS account?

Managed services like RDS, ElastiCache (Redis), ElasticSearch cost a premium compared to self-hosting them on an equivalent VM. I get this for production, backups and all. But for dev, staging and test environments I'd much rather pay less, or get more power for the same money.

The problem is, it takes effort to set it all up compared to click-and-run for managed services. Are there any good tools that make it easy to run self-hosted OSS?

https://redd.it/p8guu1
@r_devops
Go into industry or remain a devops consultant?

I'm at a crossroads between 2 opportunities. Currently I work as a DevOps consultant for a mid-tier firm, great WLB, good comp, interesting problems. A lot of my role revolves around your typical terraform, containerization, docker, k8s, python microservices, aws etc. Engagement are 6 months - 1 year in length and I enjoy seeing infra problems at multiple companies. The flip side is we've been acquired by a large tech company (blue machines), so I don't know how my engagements will look in the coming months.

I have an opportunity to move from devops into a hybrid infra engineering role that would focus on AI/Data science, ML infra based workloads. Effectively, MLops or similar where I'd be a first engineer to support and ensure stability of the ML platforms. I have done this at my client before and have previous experience. I'm concerned if I take the role, it might pigeon-hole me too much into AI space. I should not, I am currently in the role prior and for a year and understand the WLB and expectations of the role.

Respective of the above, let's say for arguments sake, comp is the same for both roles. I was curious what some might think of either remaining a generalist engineer going from project to project or honing my skills into infra engineering on the AI platforms (model tuning, airflow, containerized workloads, k8s etc.)

https://redd.it/p8sw02
@r_devops
Repo Structures

Hello colleagues, I was curious to hear how you are organizing your repositories and their deployment files. This comes in the context of multiple convos I had with other engineers on how to structure this, how this affects the deployment pipelines and other processes.

For example, I really like having all the code for the service in the same repo, and while it's great for many things, it also has its downsides and complications like config change commits triggering an artifact build unless your pipeline is smart enough or harder to deploy an older version depending on how your pipeline is setup.

On the other side, if you have one or more repos just with config you might have to make 2 PRs to do a deployment.

Also, do you have a monorepo with all service configs, or a per service repo?

So I'm curious to read what we are all doing and how/why or pro/cons for us.

Eg.

- Do you store your Terraform (or similar) code along side your app? (The code relevant for that service or microservice not your VPC)
- Do you store the monitoring/alerting/dashborading there?
- Do you have a central repo with all your Kube (raw, helm and/or Kustomize) with something like gitops?

Looking forward to your replies!

https://redd.it/p8twaa
@r_devops
Looking for recommendations: Deploying a docker container with a mounted volume

I'm a total devops noob and I'm quite uncomfortable with the topic. Anyhow, for a small project, I need to deploy an app that uses a single large file (language model, GPT-2).

I previously used Google Cloud Run (GCR) to do so, since the app is stateless and I just threw everything into the container. Now, since I'm working with several language models, I've changed my dev environment to mount the large language models as a docker volume when the docker container runs. I find this very convenient, but now I'm baffled if it is still possible/sensible to deploy the app with GCR?

The app just serves as a demonstration for a research paper I'm writing, so I'd like to keep costs as low as possible and am willing to compromise on reliability and scalability. I don't expect the app to be used a lot.

Could someone kindly provide some recommendations on where to deploy a container with a mounted docker volume cheaply? I'm also facing time pressure so I would be happy to find a quick and dirty solution. Thanks 🙏🏼

https://redd.it/p8v61j
@r_devops
Any coupons for ACloudGuru or LinuxAcademy?

Hi All,


Is anyone aware of any coupons for ACloudGuru or LinuxAcademy?


Thanks in advance!

https://redd.it/p8w2p7
@r_devops
C++ builds best practices

Hey gurus,

Just wanted to know the best practices for building c++ applications on windows. I know cmake , visual studio can do that.

But i am looking for something CICD prospective.
Please share the best tools and practices.

https://redd.it/p8qbs1
@r_devops
How to automate browser to stop asking to store passwords?

Hi community,

I am tired of browsers asking to store my password and I switch between computers a lot ( I have 7 for work purposes)

I also use multiple browsers: Edge, Chrome, Brave, Firefox and Safari.

Is there any way to run a script or playbook that configures my machine in "Secure mode" so these browser dont offer the option to store passwords?

Thanks

https://redd.it/p8nmsf
@r_devops
Switch to a better hosting platform for security and operational benefits.

We recently helped one of our US-based clients to recover from a huge malware injection into their data. They are an established firm in the branding & marketing world for more than 3 decades. With a good number of customers who trust them, they are supporting several businesses through their digital services.

Here is the link for the complete article if you wish to go through it.

https://redd.it/p8nizb
@r_devops
Anyone have experience with pv-migrate for Kubernetes?

I've been looking at https://github.com/utkuozdemir/pv-migrate and am curious if anyone has used it in production? Been thinking about what options I have available if I need to migrate storage and resize is not available. Seems like the above would do the trick but want to see if anyone here has experience with it in a prod environment.

https://redd.it/p90hkr
@r_devops
In a real world scenario, do testers still wait for fixed code to be manually deployed before manually performing tests even though there is a CD pipeline in place? Or are all tests automatically performed?

Sorry for noob question

https://redd.it/p8jj87
@r_devops
PM here. Is there a technical reason that a release cant/shouldn't go forward just because two tickets aren't completed?

Ive got minimal technical knowledge on this and cant just google it. Talking with the Sr. Architect on Wednesday. In my last job we wouldn't extend a Sprint two weeks when we had doned multiple other pieces of functionality.

Let's assume the two tickets aren't codependent on others.

https://redd.it/p92i9z
@r_devops
Need suggestions for Terraform Deployment strategy with multiple environments

We have 4 different environments, dev, qa, stage, prod. Our repo structure includes a module per folder and we're using terragrunt. Our gitlab ci pipeline currently only runs a terraform validate on every module and creates an artifact that contains the repo to be deployed via Jenkins later on within each of the environments. Due to compliance reasons, we have no choice but to use Jenkins in production, but I would like to deploy directly to dev/qa/stage from gitlab. I'm having a hard time setting up the pipeline to match our current work flow.

Today, we push to a feature branch, the artifact is created and synced to an s3 bucket. Then we run a Jenkins job within the environment we want to run it in, manually.

I would like to deploy to dev, run tests, etc.. then deploy to our QA environment. Then our QA team validates and "approves". Hopefully this could all be tracked within the gitlab merge request right up until the stage environment has been deployed to.

I can't decide if the branch per environment method is the way to go, where we would have different stages in the pipeline run based on which branch was being merged OR deploy to our DEV environment on every commit and use the manual pipeline trigger for the other environments. Could anyone else provide some insight into how they are solving this?

https://redd.it/p94hg3
@r_devops