protobox - gRPC dependency management

We needed a way to manage the protobuf dependencies in our projects were i work, so we made a tool for it. Check it out and give it a star if it tickles your fancy.

[https://github.com/UNIwise/protobox](https://github.com/UNIwise/protobox)

https://redd.it/dxmggt
@r_devops

How do you guys manage secrets and API codes in github ?

Are you using any specific tool such as vault or console or perhaps base64 to do it?
What do you think best way to do this ?

https://redd.it/dxksw8
@r_devops

Video-game programmer (c#) getting tired of my dayjob looking for the right path

I work as a bartender part-time as I pursue making my dream projects. Bartending has been fun/lucrative for a few years but I'm getting really tired of people. My friend recommended I get AWS certified and see where that takes me. My ultimate desire is to find a half-decent paying job that is a bit more cerebral than bartending and still allows me enough time to program. Any help is very appreciated.

https://redd.it/dxvqps
@r_devops

Unrecognized services in Puppet Enterprise

I have tried to run the following:

puppet resource service puppetdb ensure=running

and receive the error

Error: Could not start Service\[puppetdb\]: Execution of '/sbin/service puppet start' returned 1: puppetdb: unrecognized service

service { 'puppetdb': ensure => 'stopped', }

I am also running into the same issue with puppetserver. I suspect this may be a certification issue, but wanted to run it by others.

https://redd.it/dxxpsd
@r_devops

AWS ECS Fargate and security ?paranoia? - interview question

I have been a fan of Fargate since it launched, mostly because I like the idea of not having to manage any EC2 instances AND being lazy/reluctant to learn Kubernetes. I had an interview with one of the media companies and one of their senior infra/systems engineers asked me what is my opinion about security of Fargate from the perspective of not being able to "see" where containers are running and if someone in AWS had access to exec into them and lets say see all the secrets that are exposed as environment variables inside of those containers.

I honestly never thought about this and didn't know what to say so I just winged it and said that I think in my opinion the same question can be asked for any managed service, including EC2. There are contracts between us and cloud providers and when you signed up for a fully managed compute services such as Fargate (or any service at all) you already took into consideration and accepted those risks. Also, according to my understanding of AWS shared responsibility model, such incidents would mostly fall under AWS belt.

How would you have answered a similar question? Can we trust cloud providers? - IMO yes! that's the biggest cost and risk of cloud computing which clearly many are willing to pay.

Btw, I passed the interview - but didn't continue with the further process.

https://redd.it/dvk25k
@r_devops

Build and maybe deployment pipeline for hobby projects?

I'm a developer and mainly do development in Nim on MacOS and deploy to linux in the cloud. Nim generates a native executable using GCC. At the moment I have only a couple of artifacts - a crawler and a web server, but I expect the number of artifacts and instances of them to grow over time. At some point I'll need to add a queue and have multiple crawlers pulling jobs assignments off it. They use a hosted database. The code is all in github.

Since Nim generates native executables - which can't be shared between MacOS and Linux, I'm currently manually (well via scripts) pushing source code to a server and compiling it there before deploying it.

Any suggestions on how you'd set up a build pipeline for something like this? I need something simple and easy to maintain since it's only me. A nice bonus would be automatic deployments as well. I have experience with ansible and have only played around with Docker and k8s. I'm willing to learn about whatever tool but there are so many out there that I don't have the time to learn all of them. I need a narrow focus.

https://redd.it/dvigp4
@r_devops

Docker, Git, Jenkins and local image

Hi, we use Jenkins to build our docker container starting from a dockerfile pulled from Git (and other files). I have to build my container by dockerfile, i cannot modify Jenkins job. Docker build is executed by Jenkins, in my dockerfile i use a base image from docker hub but i want to export and use it locally (Reading from Jenkins workspace, stored in the same GIT repo of dockerfile ). Is there any way or workaround to start my dockerfile like "FROM local/directory" ? My server doesn't have access to internet and to docker hub.

https://redd.it/dvgl4g
@r_devops

Tutorial: Run NixOS using Vagrant

I've recently been experimenting with [NixOS](https://nixos.org/) and I've found it really interesting, so I wrote a tutorial on how to install and run NixOS using Vagrant. Includes instructions for running on both macOS and Ubuntu, but should work on most operating systems.

Maybe someone else will find NixOS as interesting as I have. :) I appreciate any and all feedback on the tutorial and the blog. Thanks! :)

https://lunar.computer/posts/vagrant-nixos/

https://redd.it/dveole
@r_devops

Has anyone here used NS1 for DNS service?

Reviewing providers and I had never heard of this one before.
https://ns1.com/

Thanks

https://redd.it/dv8z8t
@r_devops

Deprecating Terraform 0.11

[Time to upgrade and move away!](https://www.hashicorp.com/blog/deprecating-terraform-0-11-support-in-terraform-providers/)

https://redd.it/dy4mye
@r_devops

Demo app to show how Hashicorp Packer, Ansible, Chef Inspec and Terraform can be used together

I created this small demo app to show how Hashicorp Packer, Ansible, Chef Inspec and Terraform can be used together to build, test and deploy an app in to production on AWS.

It works by using Packer to create an AMI. Ansible is used to install Nginx on the server and Inspec is used to test the service is installed and running. Terraform is then used to create a VPC, subnets, security group and an EC2 instance from the base AMI.

Each of these steps can be expanded upon to add more functionality. Hopefully this is useful example to show these tools working together. Here is the source on Github [https://github.com/gordonmurray/packer\_ansible\_inspec\_terraform\_aws](https://github.com/gordonmurray/packer_ansible_inspec_terraform_aws)

https://redd.it/dy59v0
@r_devops

Sonatype getting acquired by Private Equity

Just saw the news - I am a little baffled by how much interest PE is showing in open source companies ( I think Travis also got acquired by PE).

You would think that companies in such a fast changing space would not be ideal for PE. Companies that are sub scale, not very profitable, have very open culture, need continued investment - pretty much opposite to PE firms (Toys r us, Perforce etc).

I think jFrog is the biggest winner in all of this. Wonder what other people think about this?

https://redd.it/dy5oqz
@r_devops

Is a raspberry pi a good platform for learning docker?

Hi all.

Pretty fresh in the devops space. Just passed my AWS Certified Cloud Practitioner test on Wednesday, and looking to continue to build on my knowledge. I figured docker is a logical next step.

Would a raspberry pi be a decent platform to play around with linux containers, or do I need more powerful hardware? I'm not looking to do anything crazy. Just have like one apache web container and one mysql container (i think i said that right). Just trying to get my hands dirty.

I have fairly limited linux knowledge, but I do have some enterprise experience patching/updating Oracle Linux and MySql.

Thanks!

https://redd.it/dy5zt9
@r_devops

Can someone ELI5 Service Meshes (Consul, Istio, etc)



https://redd.it/dy7ecv
@r_devops

Using Datadog just for centralized logging?

I'm at a pretty small shop and we generate \~3GB (120mil events)/mo, which at Datadog would cost $230 for 15-day retention...but with \~100 hosts it looks like you're *required* to pay for DD's infra management at $18/host? So it would be a $1800/mo charge just to turn on Datadog, then an extra $230/mo to add logs?

For comparison 3GB/mo is $108\*3 at Sumo Logic, no infra monitoring fees.

Anyone else use Datadog just for outsourced log management?

https://redd.it/dybghe
@r_devops

Gitlab integrated with Phabricator - Protected Branches (push to master)

Hi everyone,

I'm not entirely sure if this is the right place to post, please let me know if there's somewhere else more relevant.

So I'm in a project where we use Phabricator for Code Reviews and Gitlab to host the project. As it is right now, once the code has been approved, one can 'arc land --onto master' and push to master from Phabricator. As of now, the master branch is protected on Gitlab but everyone has push permissions. When I set it to no one, pushing from Phabricator becomes impossible.

Is there any way to ensure that no one can push directly to master in Gitlab, but can from Phabricator (onde the review is approved)?

https://redd.it/dy31fd
@r_devops

Perf testing ci build?

Do you run perf tests as part of a CI build? Sure I'd like the code to be as near production ready as possible before it's needed to main ( trunk based development) - but worried that developers will not be happy if CI builds take too long. I'd appreciate any recommendations. Thanks VK

https://redd.it/dyaovn
@r_devops

Docker in Vagrant

Hi,

is it a common use case to setup Docker Containers in Vagrant VMs?
And would you do it in production environments?

https://redd.it/dyajer
@r_devops

Two services, same domain on GCP?

Hey folks.


I'm facing a problem that I can't find ways to easily solved it on Google Cloud.

Today, I have an AWS Account with several systems running on a Kubernetes cluster, Lambda functions and Elastic Beanstalk. For accessing them, I use an API Gateway like this:

Domain xpto.com
|----------------> xpto.com/login -> Lambda Function
|----------------> xpto.com/users -> Kubernetes Cluster
|----------------> xpto.com/employee -> Elastic Beanstalk

So, I have the same domain with different paths and each of those paths is redirected to one specific place where a service is running.

The problem is, I didn't find a way to "translate" this API Gateway rules to GCP.

Is there a native way to it? And if isn't, how do you guys recommend a way to solve this (DNS, reverse proxy, ...)?

Thanks in advance for the help.

https://redd.it/dy6m4l
@r_devops

iptables in container as a service, go or not go?

Following the containers best practices, that a single service should be a single running container, how would you approach the following requirement?

In the current environment, non containerized, I am running a single Logstash process. In same machine, I have set up the iptables to forward the UDP traffic from one port to another on same machine (interface).

​

Should be moving the iptables to its own container better approach?

​

If so, I need to took care of updating the iptables rule in case of scaling the Logstash.

​

Or, is it there a better way to forward the traffic? All other approaches seem like an overkill to be honest.


Yes, I am on AWS.


NLB is not the best choice as I have a lot of traffic and it could introduce higher operating costs.

https://redd.it/dy8w2s
@r_devops