sustained-use discount. The discount is irrelevant to the actual machines you run, it ties only into the total amount of resources used. This discount doesn’t increase linearly over time. To understand it better we strongly recommend reading the documentation pages linked above.

 

#Conclusion


Having said all of the above, let’s restate the initial question:

 

**Will I save money if I stop my cloud machines when they are not in use?**

 

The answer depends on a number of factors. To get to the bottom of this you need to:


1. Check if your service will charge you for stopped machines and how.
2. Check your reservations and long term commitments.
3. Don’t take spot into account.
4. If you are using Google Compute Engine, do the math for the sustained-use discount.

 

All these might sound disheartening, but you could potentially save a lot of money. Just to get a sense of ROI, one of our customers was recently able to reduce a 5-digit monthly bill for dev infrastructure by 50%. They did it by automatically tagging machines upon provisioning and then setting a schedule to stop them during off business hours.

 

Bottomline, the effort is well justified. Do your research and good luck!

 

We'd love to hear your feedback on other comparisons that will be useful.

https://redd.it/fhczhu
@r_devops

Cache Artifacts

I have an Nginx caching server that successfully caches anything we put on the origin. There is also a separate Artifactory repository that I'd like to start caching from (use the Artifactory instance as a separate origin). I'm looking for a way to get the Nginx caching server to cache any artifact, not just an rpm repo. Has anyone done this before or have any advice?

I have a *location {}* block and can successfully use the Nginx caching server to GET items but doesn't cache -- Is this because the artifact needs to be changed somehow to to allow caching?

https://redd.it/fi2onc
@r_devops

Terraform workflow/templates management, propagating changes advise

Hi there - I am working in a small DevOps team and trying to improve our Terraform workflow. We have a few environments, and I am trying to have the developers in the company use Terraform templates we are maintaining. How do you deal with that? Do you have ways to propagate changes to templates?

Also: tests. Do you guys run tests all the time? Do you have a way to automate that once the template is in use by team members?

Wondering about best practices, tooling and what can go wrong once we become a bit bigger

https://redd.it/fi1hkc
@r_devops

[Beginner] Simple devops process with Docker / Compose & one server ? I'm lost :-)

Hi there

Being freelancer, I develop applications (small projects) for my clients. Until now, I used to have a dev environment (eg my workstation :-)) and a preprod environment (a dedicated server) where the client can "test" the application on a permanent basis. My deployment process to the preprod consisted in pushing/tagging the code to my git repo, and then pulling it from the preprod environment, for each release of a new feature. So far, so good.

Recently I took the time to learn Docker and Docker Compose. I started to develop with Docker containers installed on my workstation. I like it, because i feel that my computer is not polluted anymore with many versions of various development stacks. I used a lot volumes, rather than bind mounts because I feel this is simpler to organize, and more "encapsulated".

But now I wonder what is the best way to manage the preprod and prod stuff. I had a look on Swarm, I don't know if it is my best bet as I don't need the cluster stuff in itself, I just need to update the preprod application from my dev environment (eg my workstation), very quickly and very often, but still following the good practices.

What would be the minimum devops stack and process to do that?

Many thanks for any advise

https://redd.it/fhyxjh
@r_devops

Google's COVID-19 Screening Website Sources?

I heard Google is working on a website for COVID-19 screening. Anyone familiar with the progress? Is it open-source? Any chance community can participate to make it live sooner?

https://redd.it/fi9imu
@r_devops

Best VPS provider to host a highly available websocket cluster (15TB monthly bandwidth)

As per the title, I'm looking for the best provider for this use-case.

\- AWS EC2 isn't an option as the bandwidth will cost $1500 per month.

\- AWS lightsail comes bundled with the bandwidth but the instances aren't designed for heavy usage + it's unclear if the lightsail loadbalancer can handle secure websocket connections + VPC communication to other AWS services like redis/elasticache is limited

\- Digital Ocean has cheap bandwidth ($100 for 10TB) and is reliable. But it's been confirmed their load balancer doesn't support websocket connections.

\- Hetzner has cheap bandwidth too but again no loadbalancer.

Could I use the cloudflare load balancer in conjunction with Digital Ocean?

Should I just put a single beefy HAproxy or nginx instance in front of my websocket cluster and pray for the best on digital ocean?

Any help appreciated!

https://redd.it/fhykse
@r_devops

April Fool's Pranks

Hey guys,

April Fool's Day is coming soon and as the DevOps guy in my department, I'm trying to find some good pranks to pull off, but I can't think of anything other than changing the profile pictures on our private git to some embarrassing picture of them.

If you have any ideas for harmless pranks that won't get me in trouble I would love to hear them!

https://redd.it/fhxxbg
@r_devops

Biggraphite

How much load(metrics/sec) biggraphite can handle.

Any suggestion how to test biggraphite with stresser?

https://redd.it/fhvsl3
@r_devops

Is being an extrovert required to excel in devops?

As the title states, do you think being an extrovert is required or at the least a big advantage in a "DevOps" position. At work I've been getting more involved (reluctantly) to present more about feature work we are doing that provides the company benefits, code demos, lunch & learns, etc. I'm fine with giving the occasional demo especially when it's about a feature I worked on. Ideally though I'm someone who just wants to provide quality heads down work in addition to quality documentation where applicable and then moves on to the next task. This does not mean I don't like to work collaboratively with others but I don't particularly enjoy presentations showcasing my work all the time.

Maybe "DevOps" is not for someone with my mindset?

https://redd.it/fh4ur7
@r_devops

Handling K8 deploymentswithout full CI/CD

I have two Kubernetes clusters - dev and prod - currently they have everything manually deployed to them as I am without full CI/CD thanks to being unable to connect Spinnaker to ECR but that's a whole different issue.

​

Right now when a service is done local development it's pushed to github which then triggers a Jenkins job which creates a container and pushes it to ECR. After it's in ECR I deploy it to Dev and run tests than if all good go to prod. This works meh in theory, in practice is terrible, not always am I deploying the latest container to the dev cluster nor do I have a way of knowing what was last deployed so I can deploy that exact one to prod.

​

I know a CI/CD pipeline would solve my issues, I can't get that working yet so I need a different plan that is more manual but is less shitty than my current - never know the current state of the cluster

https://redd.it/fh79b2
@r_devops

Can I use an Elastic IP for a instance on a private subnet and use the IP if I use a Jump Box from a public subnet?



https://redd.it/fi7498
@r_devops

Monitoring the Incoming requests and responses Traefik with Grafana

Learn how to deploy Prometheus and Grafana to Docker swarm clusters to Monitor Traefik reverse proxy and how to build a Grafana dashboard to monitor Traefik service and the hosted services.

[https://medium.com/@wshihadeh/monitoring-traefik-with-grafana-1d037af5b952](https://medium.com/@wshihadeh/monitoring-traefik-with-grafana-1d037af5b952)

https://redd.it/fi6pts
@r_devops

Trying to add a Docker with maven installed as an agent/slave without any connection to the Docker Host

I've a master Jenkins running inside a Docker.

I want to connect it to a slave Docker with Maven & git installed in it. Will pull the code inside that agent and build and host the web application in that agent and it should be running all the time so that my app is always up.

However, I don't want to connect to the host of that slave Docker and spin up a slave using the Docker API but instead connect to the slave directly.

Is this possible?

https://redd.it/fh6g9w
@r_devops

What tools do you use for remote teams?

Currently our team is 100% remote. What tools do you use to assist with this? Mainly I want to be able to still have firewalls locked down, and internal tools locked down to only people inside the organization. I have setup own OpenVPN server and set up all employees with a configuration file which we then use tunnelblick / etc to connect with. I can then lock server firewalls down to the VPN public IP. However there seems like there should be a better way to do this. Any tools or recommendations on remote teams would be appreciated thanks!

https://redd.it/fh4vdm
@r_devops

What is your strategy to configure resources not exposed publicly with Terraform?

Hi,

We are using Terraform to setup infrastructure on AWS, and we would also like to use Terraform to configure things which are running inside our VPC, in private-only subnets, without exposing them publicly.

For example, we would like to use Terraform to setup our MySQL and PostgreSQL databases (running on AWS RDS), manage our Consul cluster ACLs, and configure whatever service is running within our VPC.
Basically, if a service has a Terraform provider, we would like to use Terraform to setup that service.

The AWS API is exposed publicly, so there's not so many constraints to configure its resources using Terraform.

However, although we could decide to expose publicly the other resources we want to configure which are running in our private networks (so we can access them easily via Terraform), we don't really feel good about that :) That increases the attack surface a bit too much to our liking.

The private services we would like to access provide either HTTP APIs or TCP endpoints (with or without TLS), and we already have a couple of ideas on how to do that, but I'd be interested to know what others are doing. (We already ruled out Terraform Cloud because we didn't have a to access these services without exposing them completely outside :/ )

For the moment, we have an initial setup where we manually start a couple of SSH tunnels, export new environment variables to reconfigure Terraform to contact internal services through the tunnels, then shutdown the tunnels once Terraform has run. It's a bit manual (we can script that), really ad-hoc and is not well integrated with Terraform itself.

What other methods are you using?

https://redd.it/figa0a
@r_devops

Help with sending local files on MacOS with Filebeat to ELK stack on AWS instance.

Hello devops,

I’m trying to learn ELK and ingesting logs with no problems within my AWS-ELK stack or even from another Ubuntu machine, however, I’m having troubles sending logs from my local MacOS to my ELK stack on AWS.

My filebeat config on the Mac (local):
https://pastebin.com/FCEyDvxW

If you guys need to see other configs on the ELK stack, please let me know. Any help is greatly appreciated.

https://redd.it/fh333s
@r_devops

Keycloak token service not working

Reposting it here

[https://www.reddit.com/r/selfhosted/comments/fh2wpi/keycloak\_token\_service\_not\_working/?utm\_source=share&utm\_medium=web2x](https://www.reddit.com/r/selfhosted/comments/fh2wpi/keycloak_token_service_not_working/?utm_source=share&utm_medium=web2x)

​

Do anyone have experience with keycloak? I am basically stuck.

https://redd.it/fh2y9c
@r_devops

The impact of Apple moving macbook to ARM would effectively kill the platform as a developer workstation

Am I missing something here? If this happens it would seem there would be a huge exodus to Linux and Windows. They might as well kill any "pro" focused products.

* No ability to virtualize linux x86
* No more virtualbox and vmware fusion
* No more vagrant
* No more minikube
* No more Docker for mac
* No more x86 containers, impossible to run and debug the actual Docker container that runs in prod on x86 linux, only potentially obscure "darwin-arm64" containers that would never run anywhere else
* All electron apps would need to be re-built
* No more bootcamp to potentially run Windows Pro as a workaround
* No more hackintosh (no access to build a system with compatible hardware)

This would also impact the SDLC if your company's developers on are macbooks. The entire local development workflow would need to shift to remote environments if your applications are containerized

https://redd.it/fikivt
@r_devops

The concept of workflow engines

What is common in Jenkins, ant and Airflow:
[https://medium.com/@aleksei.kornev/the-concept-of-workflow-engines-c14e8088283](https://medium.com/@aleksei.kornev/the-concept-of-workflow-engines-c14e8088283)

https://redd.it/fih7ll
@r_devops

How do I manage database in docker containers

I have set up MySQL in my docker.compose.yml file how do I make sure that when the application is in prodution I will be managing the database especially backing up the databse making sure that I don't loose anything for some reason. And also accommodate in any event I will be required to migrate to another new server what should I do and consider. If there are any resources that would help me or suggestions I would really appreciate.

https://redd.it/filge1
@r_devops