Can I use an Elastic IP for a instance on a private subnet and use the IP if I use a Jump Box from a public subnet?



https://redd.it/fi7498
@r_devops

Monitoring the Incoming requests and responses Traefik with Grafana

Learn how to deploy Prometheus and Grafana to Docker swarm clusters to Monitor Traefik reverse proxy and how to build a Grafana dashboard to monitor Traefik service and the hosted services.

[https://medium.com/@wshihadeh/monitoring-traefik-with-grafana-1d037af5b952](https://medium.com/@wshihadeh/monitoring-traefik-with-grafana-1d037af5b952)

https://redd.it/fi6pts
@r_devops

Trying to add a Docker with maven installed as an agent/slave without any connection to the Docker Host

I've a master Jenkins running inside a Docker.

I want to connect it to a slave Docker with Maven & git installed in it. Will pull the code inside that agent and build and host the web application in that agent and it should be running all the time so that my app is always up.

However, I don't want to connect to the host of that slave Docker and spin up a slave using the Docker API but instead connect to the slave directly.

Is this possible?

https://redd.it/fh6g9w
@r_devops

What tools do you use for remote teams?

Currently our team is 100% remote. What tools do you use to assist with this? Mainly I want to be able to still have firewalls locked down, and internal tools locked down to only people inside the organization. I have setup own OpenVPN server and set up all employees with a configuration file which we then use tunnelblick / etc to connect with. I can then lock server firewalls down to the VPN public IP. However there seems like there should be a better way to do this. Any tools or recommendations on remote teams would be appreciated thanks!

https://redd.it/fh4vdm
@r_devops

What is your strategy to configure resources not exposed publicly with Terraform?

Hi,

We are using Terraform to setup infrastructure on AWS, and we would also like to use Terraform to configure things which are running inside our VPC, in private-only subnets, without exposing them publicly.

For example, we would like to use Terraform to setup our MySQL and PostgreSQL databases (running on AWS RDS), manage our Consul cluster ACLs, and configure whatever service is running within our VPC.
Basically, if a service has a Terraform provider, we would like to use Terraform to setup that service.

The AWS API is exposed publicly, so there's not so many constraints to configure its resources using Terraform.

However, although we could decide to expose publicly the other resources we want to configure which are running in our private networks (so we can access them easily via Terraform), we don't really feel good about that :) That increases the attack surface a bit too much to our liking.

The private services we would like to access provide either HTTP APIs or TCP endpoints (with or without TLS), and we already have a couple of ideas on how to do that, but I'd be interested to know what others are doing. (We already ruled out Terraform Cloud because we didn't have a to access these services without exposing them completely outside :/ )

For the moment, we have an initial setup where we manually start a couple of SSH tunnels, export new environment variables to reconfigure Terraform to contact internal services through the tunnels, then shutdown the tunnels once Terraform has run. It's a bit manual (we can script that), really ad-hoc and is not well integrated with Terraform itself.

What other methods are you using?

https://redd.it/figa0a
@r_devops

Help with sending local files on MacOS with Filebeat to ELK stack on AWS instance.

Hello devops,

I’m trying to learn ELK and ingesting logs with no problems within my AWS-ELK stack or even from another Ubuntu machine, however, I’m having troubles sending logs from my local MacOS to my ELK stack on AWS.

My filebeat config on the Mac (local):
https://pastebin.com/FCEyDvxW

If you guys need to see other configs on the ELK stack, please let me know. Any help is greatly appreciated.

https://redd.it/fh333s
@r_devops

Keycloak token service not working

Reposting it here

[https://www.reddit.com/r/selfhosted/comments/fh2wpi/keycloak\_token\_service\_not\_working/?utm\_source=share&utm\_medium=web2x](https://www.reddit.com/r/selfhosted/comments/fh2wpi/keycloak_token_service_not_working/?utm_source=share&utm_medium=web2x)

​

Do anyone have experience with keycloak? I am basically stuck.

https://redd.it/fh2y9c
@r_devops

The impact of Apple moving macbook to ARM would effectively kill the platform as a developer workstation

Am I missing something here? If this happens it would seem there would be a huge exodus to Linux and Windows. They might as well kill any "pro" focused products.

* No ability to virtualize linux x86
* No more virtualbox and vmware fusion
* No more vagrant
* No more minikube
* No more Docker for mac
* No more x86 containers, impossible to run and debug the actual Docker container that runs in prod on x86 linux, only potentially obscure "darwin-arm64" containers that would never run anywhere else
* All electron apps would need to be re-built
* No more bootcamp to potentially run Windows Pro as a workaround
* No more hackintosh (no access to build a system with compatible hardware)

This would also impact the SDLC if your company's developers on are macbooks. The entire local development workflow would need to shift to remote environments if your applications are containerized

https://redd.it/fikivt
@r_devops

The concept of workflow engines

What is common in Jenkins, ant and Airflow:
[https://medium.com/@aleksei.kornev/the-concept-of-workflow-engines-c14e8088283](https://medium.com/@aleksei.kornev/the-concept-of-workflow-engines-c14e8088283)

https://redd.it/fih7ll
@r_devops

How do I manage database in docker containers

I have set up MySQL in my docker.compose.yml file how do I make sure that when the application is in prodution I will be managing the database especially backing up the databse making sure that I don't loose anything for some reason. And also accommodate in any event I will be required to migrate to another new server what should I do and consider. If there are any resources that would help me or suggestions I would really appreciate.

https://redd.it/filge1
@r_devops

Optimizing CI CD

Hi all,

I'm trying to move my team to an optimized CI/CD that can release more frequent than 2-3 weeks. While we've built in some good quality gates in our release pipelines, one of our bottlenecks is before pushing to production we have a bottleneck of manual approval such as manual security team code reviews, architect review/sign-off, etc. How are you handling this in your workflows to ensure fast, but secure and quality releases. Where/when in the process is this happening so that it's not causing a slowdown to the fluid movement of code through to Production?

Thanks!

https://redd.it/fiilox
@r_devops

Chef -- Cookbook not executing properly?

Hi everyone,

Bare with me still pretty new to Chef! Right now, I have the following:

**Chef Server**: Hyper-V Ubuntu VM

**Chef Workstation**: Hyper-V Win Server 2019 VM

**2 Nodes**:

**buildagent01**: Win Server 19 with Chef Client installed as well as Jenkins Build Agent

**buildagent02**: Win Server 19 with Chef Client installed as well as Jenkins Build Agent

​

Right now on my Chef Workstation I have a Jenkins freestyle job running the following:

$SecurePassword = 'Password01' | ConvertTo-SecureString -AsPlainText -Force
$cred = New-Object System.Management.Automation.PSCredential -ArgumentList '.\Administrator', $SecurePassword
Invoke-Command -ComputerName buildagent_01 -Credential $cred -ScriptBlock {chef-client}

Simple little PowerShell script that is being run using the **Jenkins slave buildagent\_02** and the script is obviously **executing 'chef-client' on buildagent\_01**. Now this works perfectly fine when I was running one cookbook in the run list for buildagent\_01, which is simply this:

file 'C:\\tmp\\something.txt' do
action :create
content "this worked!"
end

Now, I have created a second cookbook which is running the following recipe:

windows_package 'dotnet-sdk-3.1.102-win-x64' do
source 'https://download.visualstudio.microsoft.com/download/pr/5aad9c2c-7bb6-45b1-97e7-98f12cb5b63b/6f6d7944c81b043bdb9a7241529a5504/dotnet-sdk-3.1.102-win-x64.exe'
installer_type :custom
action :install
end

Now, the the Jenkins job still runs, and the first cookbook works no problem, create the something.txt file and contents within, good to go! But, what's weird is that the second cookbook starts up, but the Jenkins job just runs forever?

If I run 'chef-client' locally on buildagent\_01 from PowerShell, no problem! First cookbook does its thing, and then, boom the .Net installer pops up right away. Not sure why this isnt working when running the Jenkins job? Any help would be much appreciated! Thanks!

https://redd.it/fip1tv
@r_devops

what will next 2 years bring in the DevOps ?

Hi guys, what do you think will be the trend in DevOps in the next year and 2 years?
Please feel free to discuss...im interested in what do you think...Thanks :)

https://redd.it/fih3qw
@r_devops

DevOps metric based governance / analytics

Hey guys, seems like a lot of teams have somewhat nailed DevOps down. One of the so called 'pillars' of a DevOps teams are metric based governance. Next to monitoring the stack, talks from example GoTo or Google bring up the subject of collecting DevOps metrics about for example lead time of stories, escaped bugs, number of deployments or pipeline duration. The idea would then be that based on these indicators, since your team is responsible for steering itself, you have the data to measure the effect of your decisions and adjust if necessary.

When looking up automation for this however, there is not a lot around it seems, and not a lot of teams are yet actively busy with this it seems. There are loads of dashboarding tools, but aggregating this kind of data or generating it does seem hard to come by. Do you have any leads here, experience with or suggestions for DevOps metric based team governance?

https://redd.it/fiqxem
@r_devops

DevOps interview Preparation

How are DevOps interview compared to SDE? Should I focus on Data Structures and Algorithms? Any study guide that anyone can share? Any helpful resources will be appreciated. Thanks!

I am looking for resources to help with prepping for Technical Screenings for DevOps/SRE roles.

* Data Structures and Algorithms. (I havent done prep in a while so would like to start from the basics).

* System Design

* Linux

* Networking

* Troubleshooting issues

https://redd.it/fip52w
@r_devops

Packaging Software with ‘fpm’

> *fpm (eFfing Package Management) enables you to build all sorts of Linux packages with great ease and sanity.*

Basically, ‘fpm’ allows you to deploy any software via OS packages, from an installation tree on disk or from already built artifacts specific to the chosen implementation language.

The main advantage over native tooling is you do not need to know about every minute detail of the involved commands and metafile formats for every platform. In case of Debian, that is at least the “control” and “rules” files, and tools like “buildpackage” and “debhelpers”.

[Read more…](https://dev.to/jhermann/packaging-software-with-fpm-58k3)

https://redd.it/fimmsz
@r_devops

Spark vs Pub/Sub Consumers

Hey,

I am new to spark and looking for realtime stream processing solution.

I didn't really get what advantage does spark streaming provide over simple rabbitmq/kafka consumers.


My current usecase is to get realtime stock data stream and run models to produce near realtime predictions.

Does anyone have experience with stream processing in production? What tools are you using and why?

Thanks!

https://redd.it/fitpn9
@r_devops

How well does your job title describe your daily work?

What is your job title? How would you describe your actual duties and responsibilities? I want to know if there are other, related jobs titles I can be on the look out for. As well as to know what I could be getting myself into.

https://redd.it/filizu
@r_devops

Looking for someone with 20+ github followers.

As the title says, if you have 20+, please open a chat or message me. I'll pay you $20 USD for about 5 minutes of your time, and you can keep your account.

https://redd.it/fix492
@r_devops

Making something good out of this: what can we learn during these two weeks of isolation?

Title basically. What would you advice one could learn during these two weeks? And what resources would you suggest for it?

https://redd.it/fj0ft3
@r_devops