Need Assistance with Cloudfront Distribution Redirects

Hey guys,


Looking for some help with redirecting a request from one AWS bucket to another domain.


i.e [app.domain.com](https://app.domain.com) will return the user to an Cloudfront distribution with a html file that does nothing.
What's the best way to redirect that traffic to [domain.com/docs](https://domain.com/docs) ?


So far using Lambda Edge, redirecting the request using 302 and location headers would maintain the url [app.domain.com](https://app.domain.com) and show some of the content, but accessing any other content in that cloudfront distribution causes issues.


Any advice for more advance routing stuff?

https://redd.it/ee7oy9
@r_devops

container running on my ec2 insatnce cannot connect to my mongodb (atlas)

Hey,

​

so i have created a cluster on mongodb-atlas and peered it with my vpc.
i checked that i can connect from a server to the mongodb and it worked - yay.

now, the issue starts when i run my docker containers on a docker-swarm that runs on the same server.
it looks like the containers running on that instance are not WHITE-LISTED by atlas. this is weird because the entire VPC is whitelisted.
somehow the container doesn't associate with its private ip.
did anyone else encounter the same issue ?
any ideas on how i can solve it ?

https://redd.it/ee4wyj
@r_devops

Making secure Docker Images

Hey guys!

I wrote a blog with some good best practices to keep in mind when you're making Docker images:
[https://blog.phonito.io/making-secure-docker-images/](https://blog.phonito.io/making-secure-docker-images/)

https://redd.it/ee890z
@r_devops

Is anyone using a vpn with Okta integration? What server product?

We are using Okta for SSO although not a lot of services are actually tied to Okta yet in our org, which I'm trying to change. One of these is the vpn, we've currently got a very manual openvpn process of creating signed certs and using an LDAP server that's tied to Okta for synchronization. It ... sort of works? Most of the time? At any rate, I'm looking for a real vpn server that I can run on AWS that's got actual Okta integration, but I'm not coming up with a lot in my searching. Anyone got options? I'm ok telling my management chain that we've got to purchase something rather than just rolling our own open-sourced solution if that's what it takes.

https://redd.it/eecok9
@r_devops

Where shall I begin

Hey there and Happy Holidays!

In the new year my major goal is to get a job in devops. I am looking for some advice on where to start.

Currently a Windows Sysadmin with about 5 years experience working in aerospace/defense classified networks.

I have a basic knowledge of docker decent powershell skills and a limited understanding of devops in general.

Where should I start here? I am considering getting the entry AWS cert and learning python after new year as a starting point. Would greatly appreciate any advice. I have read other similar threads but was hoping for some advice specific to my situation. Merry xmas y'all :)

https://redd.it/eecl6u
@r_devops

Devops in cloud computing project

Hello Guys, I'm a TIC Student at my 3rd year in university and we have a final year project this year, I would like to realize a project about cloud computing and DevOps automation!

I read about cloud computing, containers, docker, Kubernetes, automation

but I still can't figure out a consistent topic, and a clear idea about the project

I would like some help from you if you can suggest me a clear topic with a Feasible application !

Thank you so much!

https://redd.it/ee95em
@r_devops

Should I use docker swarms for "threads"?

I have 1 containerized app (docker). After it launches, it figures out what it needs to do on its own, then after 1-20min, the task ends and it shuts down.

My goal would be to have 20 "threads" running at all time. And maybe even adjust the threads depending on server performance. I've never used docker swarm not any other orchestration tool. Is docker swarm good for this task? Should I just use use a cronjob + bash script?

https://redd.it/ee8ola
@r_devops

Multirepos vs. Monorepo: trying to create a product to manage many repos as there was only one. Any feedback?

Hi,
In my previous job, I worked closely with dev and devops, and realized that the choice of multi/mino repos was an endless battle.
Why not create a product that can reconciliate both worlds.
I’m thinking about a product where you can prevent writing to folders or files, or where you can play with the configuration of all the repos, as you were configuring only one (branch protection, ...).
What do you think about that?
I have a landing page, but I will not provide it to you, otherwise, you will think I m advertising for it. I just want to have a talk with devops people about that.
Thanks

https://redd.it/ee381d
@r_devops

Tools for describing infrastructure of services [Need Advice]

Hi, folks!

My task is to describe (visually) the infrastructure of microservices in our company. The diagram should show servers, virtual servers, microservices and links between them. Could you advise some tools and methods? It will be better if it's free tools)

https://redd.it/eekjaz
@r_devops

DevOps at scale: challenges and solutions

I was asked to implement automation/DevOps at scale, where IT is far from being the core business. I don't want to go deep in the meaning of DevOps, let's say they're ok with automation and pipelines.
If you are in a big org, with thousand of services and apps, which was the biggest challenge? And how did you solve that?

https://redd.it/ee2gef
@r_devops

Kops cluster having different enviroments that are mostly independant of each other

I have a KOPS cluster that I am using for two different environments called envA and envB which I'd like to have share the masters and then have affinity rules on my pods so that they only run on certain nodes. I was thinking that I could use instance groups and node labels? Would this be a safe solution or should I do the extra work and cost to have a differen cluster? I'd rather not but if it's my best option then I guess I have to, neither of the environments are production or external facing

https://redd.it/eenl4h
@r_devops

On-Call Nightmares Podcast Episode 46 - Year in Review with Corey Quinn of The Duckbill Group

Got one more interview in this year, this time Corey Quinn!

Thanks for listening!

[https://www.podomatic.com/podcasts/oncallnightmares/episodes/2019-12-23T11\_00\_16-08\_00](https://www.podomatic.com/podcasts/oncallnightmares/episodes/2019-12-23T11_00_16-08_00)

https://redd.it/eep67c
@r_devops

Getting started for my kinda new responsibility...

So, I was into data infrastructure and little into machine learning pipelining and all in my company... It's a startup, and the DevOps guy is leaving the company for a new one. So, I will be doing the DevOps part now, I have a couple of months to learn things... The whole infra is on Kubernetes on GCP and I don't know about Nginx and Argo/Ingress... They all talk about it... Just thinking if you guys can help...

​

Resources/Experiences/Links/Books/Stories all will help.

https://redd.it/eeoqlw
@r_devops

China's cloud needs are growing at high speed, but is China ready for DevOps?

Local players like Tencent, Baidu, and Alibaba dominate China's cloud market.

While the whole world embraces AWS, Microsoft, Google, and other cloud platforms, Alibaba cloud leads in China and has an exceptional growth rate, with 47.3% of China’s cloud computing market share.

The problem is, China has strong regulations over the usage of the internet in a particular way, and their great firewall of China restricts most of the cloud companies to embrace DevOps. For example, you can't access the Docker images easily in China, and the distribution & collaboration of software seems pretty hard.

I recently wrote an article that should help some of you understand [how the cloud market works in China and how to enter the Chinese cloud market](https://hackernoon.com/cloud-and-devops-market-in-china-a-brief-overview-wcu30p8).

https://redd.it/ee1fdg
@r_devops

Tips for retaining knowledge (skill -> job)

So I am about to start doing LinuxAcademy a lot need to bulk up on skill to break employment. I also have a book "A Practical Guide to Linux" but it is exhaustive.. I can barely remember :sv and :sp in Vim to split panes open file horizontal or vertical or ^W - s or ^W - v to split windows vertically or horizontally.. Yet alone the whole language syntax of Python and (hopefully) coming up: Kubernetes / Ansible. I want to know is it even humanly possible to be fluent in all these tools it seems like I have a tough time even remembering how to split/manipulate windows in Vim I suppose practice would make perfect but how far can I take this without a strategy? It appears as if I would have to take detailed notes to remember all the bits and pieces of the skilled work that cloud engineer / CI CD automation engineer is required to remember. Is this what you do or do you think it is actually humanly possible to memorize everything?

https://redd.it/edd22p
@r_devops

Tying together the infrastructure provisioning and system configuration

Hello devops community,

I wanted to ask for your advices/ideas on a use case I regularly face. Basically, I often need to create a set of resources on a cloud platform, such as load balancers, static ips, virtual machines and so on. After that, I need to configure these virtual machines: install packages, start/enable services, write files and so on - typical configuration management.

Ideally, I want to fully automate this process.

Problem is, different tools excel at different use-cases. Let's take Terraform and Ansible: Terraform is doing a very good job on doing the first, provisioning the cloud resources. However, it is really weak on configuring these machines after: features like local-exec/file provisioner, templating and so on are nowhere near as powerful as Ansible.

If I go with doing the whole job with Ansible, then there is the exact opposite problem: Cloud provisioning plugins exist, yes, but they are pretty buggy, cannot handle state changes well, don't have a state storage like Terraform has, so on and so forth.

Some solutions come to my mind, such as:

\- Calling Terraform from Ansible using terraform module, then dynamically adding created hosts to inventory and configure them.

\- Calling Ansible from Terraform via local-exec and/or cloud-specific startup-scripts. Similar problem as above.

\- Tying them together with a python/bash/similar script, and/or using the CI/CD pipeline to do one after the other.

\- Treat VMs immutable: Create a VM image via Ansible/Packer, then use Terraform to bring a vm up based on this image. As described in this link: [https://www.hashicorp.com/resources/ansible-terraform-better-together](https://www.hashicorp.com/resources/ansible-terraform-better-together)

\- Using another tool that handles both use cases fairly well: Is there any other tool that can do it? Maybe SaltStack?

I'd like to hear what approaches you follow for a similar use case. Any advices?

https://redd.it/eeqqtc
@r_devops

How are people executing communications/notifications for a large, distributed engineering organization?

I work in an engineering organization with \~1000 engineers across 100 teams that is globally distributed. These teams collectively build/maintain/depend on an incredible amount of AWS infrastructure, software, and other resources.

A consistent issue that I see affect our organization revolves around how to structure communications when dependencies/policies/resources change in some way.

* How do we notify and capture the attention of teams that own or depend on these resources when they change? How do we notify people about a breaking change or a policy update?
* How do we even know that teams have seen an announcement?

I'm looking for a tool that could help us streamline this process. We could build something ourselves but I want to ask around to see if anyone else has dealt with this problem before committing to any course of action.

**Existing Tools:**

* We have an existing application that allows teams to self-manage which projects/repos are owned by the team, who is on the team, Slack channels, email list, JIRA board, etc as a reference for the rest of the organization.
* Email list for all engineering members.
* Engineering Slack announcement channel

**Potential Requirements:**

The ideal tool would let us create entities/targets based on our existing team metadata and allow us to send targeted notifications to each team.

* We would like a single entry point that any engineering team can use to send these notifications.
* We would like teams to be able to designate where they would like different types of notifications to be routed. For example, an “Action Required” type of notification could be set to generate a JIRA ticket in a team’s backlog.
* We would like to be able to keep a history of these notifications and refer back to them.
* We would like some notifications to contain “acknowledgement” mechanisms if desired to allow tracking how teams have responded to notifications.

https://redd.it/eemqri
@r_devops

GCP-Nuke v0.1.0 alpha - the GCP project cleanup tool with added radiation

Link: [https://github.com/arehmandev/gcp-nuke](https://github.com/arehmandev/gcp-nuke)

Hi all. Any Google Cloud users here wanting to cleanup projects? Maybe even do a dry-run to see whats taking up those bills?

AWS-nuke seemed to be incredibly popular and mature, so after many nights of rolling around dreaming of GCP support tickets ([Shared VPC ghost subnets? Anyone?](https://cloud.google.com/vpc/docs/deprovisioning-shared-vpc)) I decided to do something about it.

I've written a few CLIs in my time, but nothing prepared me for the unreliability of a delete API operation claiming it was complete, and a dependent resource claiming it still exists. As such, I've added retries, dependency checks, and tried to make each resource as easy as possible to contribute to. There is a roadmap still to improve and add robust testing, and many code reviews I'm sure to come, but its a start.

As of now it supports compute and GKE resources (GCE instances, disks, instance groups, instance templates, GKE clusters).

Let me know what you think, I'm always on the lookout to improve my Go development.

Cheers.

https://redd.it/eelfpl
@r_devops

Boss wants to fire after hours call service, what can we move to?

We currently pay for a small company to answer the phones after hours and escalate to a technician if needed or just take a message. They've been unreliable lately and we want to see about automating it. We are looking for an answering service that could do these things below, what products or suggestions would you have for this?

​

* During after hours we generally just forward our whole company phone \*72 etc to the call center, instead we would forward to this new service.
* IVR Answer and forward to one of four duty phones or straight to after hours voicemail for non urgent stuff.
* Duty phone numbers need to be easily changed or even better scheduled in advance specifying changeover times
* Calls should be recorded
* Metadata should be recorded, from number, duration, IVR selections made etc
* If weekly and/or daily summaries could be sent to a couple people that would be great
* Ideally less than $100/mo.

FreePBX came to mind but that seems like a very high initial investment in labor in getting it running. There's probably some cloud service out there doing what I need I've never heard of, what do you say?

https://redd.it/eemgjh
@r_devops

[Need Advice] Setting up a VPN for my kubernetes cluster without a loadbalancer

First off I want to say that I am very new to devops and I have just started learning about a lot of things. My case is as follows:

I want to add a VPN to my cluster so that I can visit services that are exposed using a ClusterIP service. OVPN has a tutorial / helm chart on how to do this, however these services are installed as Loadbalancers. For the sake of just development I do NOT want to spend money on a loadbalancer if I can avoid this.

I have tried using a nodeport but I have yet to get that working.

Any advice would be greatly appreciated.

https://redd.it/eem5it
@r_devops