GitLab or GitHub/Azure DevOps

What should I make sure we ask about and look into? I have GitLab experience, I was surprised that the GitHub/Azure DevOps sales pitch actually sounded so good. Enterprise Architects are now doing a test run of each before making a decision. What would I regret not having brought up?

Context: large traditional enterprise that struggles a lot. I’m the new DevOps lead on a struggling/failing project looking to turn stuff around. It appears both would work for what I need, IoC (including pipelines!), GitOps, and automatic (not auto-manual!) deploys and rollbacks. If there’s anything I should look into now is the time to raise objections and point stuff out.

I know the “traditional” adjective sounds bad, and it is tbh. If I succeed in this role I’ll have to excel as a diplomat in addition to technical skill.

https://redd.it/p7e99u
@r_devops

Harbormaster: The anti-Kubernetes for your personal server

I thought the /r/devops subreddit might be interested in this project I just found!

https://gitlab.com/stavros/harbormaster

https://redd.it/p7frxs
@r_devops

Downloading from Artifactory

Hello, I am trying to download a package from our artifactory deployment using powershell.

Using Invoke-WebRequest I authenticate correctly however it doesn't download the file, only the loading page. Not sure if I'm missing a setting somewhere or not.

Invoke-WebRequest -Uri "https://artifactory:8082/artifactory/test/testfile.exe" -Headers $header -Method "Get" -ContentType "application/executable" -UseBasicParsing -OutFile "C:\\temp\\testfile.exe"

Any help or pointers in the right would be greatly appreciated.

https://redd.it/p7eyip
@r_devops

Devops Engineer interviewing process

Just got off a call with a company that said their final interview section is a 4 hour technical and personal interview. Is that common? Took my by surprise. I'll also add this isn't for a junior position.

https://redd.it/p7hs7p
@r_devops

Hey , I’m new to helm and all , is there a way to pull image from ECR to the pods created with helm value file?

I’m trying to make a git action to install helm via GitHub but my helm chart is in ECR

https://redd.it/p7ispa
@r_devops

nginx and trailing slashes

I have following config

server {
listen 443;
listen [::]:443;

location / {
proxy_pass https://svc1:3200/;
proxy_set_header Host $host;
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
proxy_set_header X-Forwarded-Host $server_name;
proxy_set_header X-Forwarded-Proto $scheme;
proxy_set_header X-Forwarded-Ssl on;
proxy_set_header X-Forwarded-Port 443;
proxy_set_header X-Forwarded-Host $host;
proxy_set_header X-NginX-Proxy true;
proxy_read_timeout 3600;
}

location /backend-api/ {
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
proxy_set_header X-Forwarded-Proto $scheme;
proxy_set_header X-NginX-Proxy true;
proxy_pass_header Content-Type;
proxy_pass https://backend-api:3000/;
proxy_ssl_session_reuse off;
proxy_set_header Host $http_host;
proxy_cache_bypass $http_upgrade;
proxy_redirect off;
proxy_read_timeout 3600;
}

location /backend-api {
proxy_set_header X-Real-IP $remote_addr;
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
proxy_set_header X-Forwarded-Proto $scheme;
proxy_set_header X-NginX-Proxy true;
proxy_pass_header Content-Type;
proxy_pass https://backend-api:3000/;
proxy_ssl_session_reuse off;
proxy_set_header Host $http_host;
proxy_cache_bypass $http_upgrade;
proxy_redirect off;
proxy_read_timeout 3600;
}

When I navigate to [https://example.com/backend-api/api/](https://example.com/backend-api/api/) I get API response

but when I navigate to

[https://example.com/backend-api/api](https://example.com/backend-api/api)

it redirects me to [https://example.com/api/](https://example.com/api/)

why is this happening? Why do I get this redirect without /backend-api/ part?

https://redd.it/p7d2cu
@r_devops

Starting a new consulting role. Any advice?

I've got two years of experience as a Devops engineer. My current company is super chilled out but I wanted more money and exposure to new technologies. I'm going to be starting my new job in just over a month. It's a consulting role and I'm a little nervous as I don't know exactly what to expect. What's some advice/tips you guys would give?

https://redd.it/p7nm36
@r_devops

History of PaaS: How Canon almost became a major cloud provider

Hey r/devops!

Here's an article about Zimki, the world's very first PaaS that belonged to Canon (the camera company). It also touches on the origin of AWS and the discusses the relationship between IaaS and PaaS. Thought it could be an interesting read!

https://blog.porter.run/history-of-paas-how-canon-almost-became-a-major-cloud-provider/

https://redd.it/p7n94h
@r_devops

AWS PrivateLink | MASTER the AWS PrivateLink | Demo, EC2 to SSM, and Troubleshooting

Hey everyone,

I'm sharing this video to show how to secure the traffic between your EC2 instances and SSM, by using a PrivateLink. With a PrivateLink, traffic remains within the AWS ecosystem so this is an ideal solution for compliance and regulations such as HIPAA, and PCI. Also, I cover a few troubleshooting scenarios and go into detail.

https://www.youtube.com/watch?v=pUDrVImuPpA

Shoutout to /u/tdk2fe for the suggestion and for giving me the idea. This video was fun to edit.

I try to make these videos digestible and easy to follow regardless of your AWS experience.

Let me know what you think, and thanks again!

https://redd.it/p7tx48
@r_devops

Need suggestions on Backend setup & Frameworks

Please suggest some backend setup &/or frameworks for the following task

- Fetch data from API-1

- Use API-2 to do some data manipulation

- then store the data on MySQL database

This needs to happen automaticilay once ever 24h

- Finally create my own API-3 which will serve data from my database. (No frontend required)

Ps. I want to run in it on a basic Apache hosting server. So, needs to be lightweight

https://redd.it/p7h7xb
@r_devops

USA Visa Applications for tech jobs

Anyone have experience applying for USA working VISA from Europe? I’m a DevOps Engineer and always wanted to work in the US tech community, I know getting a visa is difficult without a job offer and most companies hiring within the US.

Any tips, knowledge share and feedback would be greatly appreciated.

https://redd.it/p7co80
@r_devops

Setting up SES with Pulumi - A guide

I wrote a small guide to setting up SES with Pulumi that r/devops might be into, you can find it here:

https://vadosware.io/post/setting-up-ses-with-pulumi/ (You could also go straight to the code at the bottom)

In a sea of great options, Pulumi is my choice of infrastructure-as-code library because it actually is code and as a result very flexible.

I've got a huge bent for running my own infrastructure, so I'm always interested in how I can make cloud stuff divert/key off of my own external infrastructure/resources. To that extent, Maddy is mentioned in this post and I encourage everyone to look into it for running a mail server, it's pretty sweet. It's relevant because I set up the DKIM, SPF, etc to support maddy as well as SES -- I could send all my email through maddy but I choose to use SES and keep the second option (receive/send through maddy, send from applications through SES).

Hope you enjoy the post and learn something!

https://redd.it/p7xz6v
@r_devops

Which one should i pick Github Action vs Gitlab?

Hi, i recently joined an internship as DevOps Eng and i was asked to figure out best CI/CD tool and i went through this post https://www.reddit.com/r/devops/comments/ls7lzk/cicd\_if\_you\_were\_to\_start\_over\_what\_tools\_would/ where i noticed whether Github Action or Gitlab would be good choice to start, since our company using Github for repo so which one would be best CI/CD according to your opinion?

THANK YOU so much for your time.

https://redd.it/p81iny
@r_devops

What are the things we as engineers don't spend enough time on?

We often have to balance many tasks and often conflicting priorities, so I was wondering what are the 10 things hard but rewarding activities we don't spend enough time on but would be beneficial to do more of...

So in my opinion, what I'd definitely like to dedicate more of my focus on:

​

1. Backups & Preventing Accidental Deletion

2. Naming Things

3. Code Reviews

4. Problem Definition

5. Architecture and Design Decisions

6. Alignment with Other Teams

7. Giving Praise Where It Is Deserved

8. Hiring

9. Reading Logs

10. Communication

​

I actually put them in an article where I elaborate a bit more on why I think so. But intrigued to know what would you add to the list?

https://redd.it/p8366l
@r_devops

AWS SSO and the Lost IAM Keys

Wrote a new blog about AWS SSO and IAM Keys challenges and best-practices :

https://www.cloudquery.io/blog/aws-sso-and-the-lost-iam-keys

https://redd.it/p85w2g
@r_devops

CNCE #2

Hello everyone!

The ChaosNative community is glad to invite you to the Cloud-Native Chaos Engineering Workshop #2 where you can network with tech geeks around the world. Get yourself exposed to the world of resiliency and reliability. We will be having interactive talks and discussions with our experts about:

1. Hands-on experience with a workshop on Cloud Native Chaos Engineering which introduces you to the basics & fundamentals of Chaos Engineering. 

2. A sneak-peek at the latest evolution in the Cloud Native Chaos Engineering world with LitmusChaos 2.0. 

3. A demonstration of running Chaos experiments in just a few steps!

Mark your calendars for 9th September 2021, 9 PM IST

Register here: https://www.chaosnative.com/cnce-workshop

https://redd.it/p85e7m
@r_devops

How to send all traffic to a certain path with a application gateway (azure)

Hi Devops!

I'm struggling to find a way of sending all traffic into a app gw to a certain website path.

Say my website is, stackoverflow.devops.com.

I have a App Service backend with the custom domain stackoverflow.devops.com.

The idea going forwards is to send all traffic to that website to a traffic manager, doing geolocation routing. Currently, if you're in Europe, it routes to an application gateway where the path is fine and will remain as stackoverflow.devops.com, and this works.

If you're in the states, it routes to a different application gateway (with the same backend pool) and I want to change the url to stackoverflow.devops.com/us for any traffic going through this app gw.

I've tried URL rewrites but getting a 'too many redirects' error.

Any ideas?

Thanks!

https://redd.it/p87vaq
@r_devops

Developer productivity tools recommendations please

So my question about what do we as engineers don't spend enough time on, got me interested, what kind of productivity/time-saving tools is everyone using? Would be good to have a nice concentrated list of everyone's favorites ones here.

https://redd.it/p89ng0
@r_devops

How to manage passwords in Helm

My goal is to deploy Helm Charts through Jenkins to Rancher.
I’ve a bunch of passwords stored in HashiCorp Vault.

Right now, I deploy the Helm chart from my local. I run a dockcmd command to pull my values from Vault, store them in a Yaml on my local, and deploy with that values file

It’s not secure, and I was wondering what would be the best way to deploy these passwords along with our charts

https://redd.it/p8devw
@r_devops

Any good tools to deploy self-hosted opensource libs into my AWS account?

Managed services like RDS, ElastiCache (Redis), ElasticSearch cost a premium compared to self-hosting them on an equivalent VM. I get this for production, backups and all. But for dev, staging and test environments I'd much rather pay less, or get more power for the same money.

The problem is, it takes effort to set it all up compared to click-and-run for managed services. Are there any good tools that make it easy to run self-hosted OSS?

https://redd.it/p8guu1
@r_devops

Go into industry or remain a devops consultant?

I'm at a crossroads between 2 opportunities. Currently I work as a DevOps consultant for a mid-tier firm, great WLB, good comp, interesting problems. A lot of my role revolves around your typical terraform, containerization, docker, k8s, python microservices, aws etc. Engagement are 6 months - 1 year in length and I enjoy seeing infra problems at multiple companies. The flip side is we've been acquired by a large tech company (blue machines), so I don't know how my engagements will look in the coming months.

I have an opportunity to move from devops into a hybrid infra engineering role that would focus on AI/Data science, ML infra based workloads. Effectively, MLops or similar where I'd be a first engineer to support and ensure stability of the ML platforms. I have done this at my client before and have previous experience. I'm concerned if I take the role, it might pigeon-hole me too much into AI space. I should not, I am currently in the role prior and for a year and understand the WLB and expectations of the role.

Respective of the above, let's say for arguments sake, comp is the same for both roles. I was curious what some might think of either remaining a generalist engineer going from project to project or honing my skills into infra engineering on the AI platforms (model tuning, airflow, containerized workloads, k8s etc.)

https://redd.it/p8sw02
@r_devops