Deploying software that depends on a virtual machine using Docker

I am developing a piece of software which consists of a Node.js application which controls a virtual machine that runs Android-x86. Also there are some pieces of the Android SDK like ADB the software depends on.

Currently there is no smart way of deployment whatsoever at all. Everything has to be installed manually. Depending on the system I also get issues regarding networking and so on from time to time.

To solve problems of these kinds I usually would use Docker. Therefore that was my first thought here as well. So such a Docker container would simply run the Node.js application as well as the virtual machine.

For me it became a bit confusing (and maybe even pointless) when I wanted to use a virtual machine inside of a Docker container. Due to there is obviously no way I can run an Android-x86 Docker container I cannot come up with any other solution than a virtual machine inside of Docker.

Is it fine to do as I mentioned or are there any better ways or even best practices to use a virtual machine inside of a container? Also I want to add that a possible solution does not have to be utilizing Docker. If there is any other technology that is able to create a container-ish construct which in further consequence is able to run a virtual machine I would be happy to get to know it.

https://redd.it/dja9zk
@r_devops

First Job in the Industry is in Dev Ops

As the title says, I just got accepted an offer as a Dev Ops Engineer I at a large non tech company. I told them I do not have much experience with Dev Ops, but I have built some apps and web apps on AWS, GCP, and DigitalOcean before for some hackathons and personal projects. My background is more software oriented from my CS degree and personal tinkerings.

What should I learn before I show up for my first day? I have a good understanding of Docker and containers and how to build / use them.

As far as programming languages, python is my jam and I love writing scripts. I'm also a proficient bash scripter.

Any help would be appreciated.

https://redd.it/dj911z
@r_devops

Is it possible to be completely self taught and get a DevOps job?

Thank you for taking the time to read my post.

I have around 3 years experience doing web development and I am finding it increasingly difficult to find a good job. Every web developer job posting lists a laundry list of technologies they expect you to know and the list changes every 3 months that includes the newest fancy framework, tool or technology. The market is severely over saturated with cs grads, bootcamp grads and self taught devs. I haven't found any DevOps bootcamps which gives me the impression that there are opportunities in this field.

I'm considering switching fields and I was wondering if it was possible to teach myself the common DevOps tools required to get a entry level job. Being a web developer I already have some experience with some of the tools like CircleCI, Heroku, Git, JavaScript, Python and completed Docker's tutorial.

I have a few questions and it would be greatly appreciated if you could answer some of them.

- Is there such thing as entry level/jr DevOps jobs?
- Is it a prerequisite to have a CS/Engineering degree?
- With web development specifically front end, learning the Holy Trinity (HTML, CSS, JavaScript) is must have skills. What are some of the MUST HAVE skills for DevOps?
- With web development, you can build a online portfolio showcasing your personal projects. How do DevOps demonstrate their skills to potential employers?
- How proficient do you need to be in Linux?
- How proficient do you need to be in programming?
- Usually developers have to go through 4-5 rounds of interviews which most people agree is ridiculous. What does the typical job interview process like for DevOps? How many rounds? What type of questions do they typically ask? Is there a technical assessment?
- How stressful is your job?
- What do you like most about your job?
- What do you hate the most about your job?
- With someone with my background, how long do you think it would take me to get up to speed?

Thanks everyone for your responses!

https://redd.it/djevpr
@r_devops

Coding Salaries in 2019: Updating the Stack Overflow Salary Calculator

https://stackoverflow.blog/2019/10/16/coding-salaries-in-2019-updating-the-stack-overflow-salary-calculator/

DevOps focused.

https://redd.it/djh9df
@r_devops

Implementing monitoring systems as side job

TL;DR: wanna exchange nice graphs for money?

Hello there!
I am a system engineer living in Italy looking for some side income. A have expertise in implementing monitoring systems with influxdb/telegraf/grafana and log aggregation with ELK stack. In a couple of months I will have few free hours a day, so I was thinking to offer my skills for small monitoring gigs, like implementing the aforementioned services onprem or on the cloud (I said "small gigs" because I think bigger companies may have dedicated teams devoted to that already). Do you think that might work? Do companies outsources these services to individuals? I had a look on upwork, but the proposed hourly rates are very low.

Thanks in advance for any input, I am a total noob when it comes to freelancing.

Matteo

https://redd.it/djmc25
@r_devops

Transporting logs to AWS Elasticsearch

What are people using to get server and container logs into AWS Elastichsearch?

I've not had much luck with the latest filebeat (xpack issues even with the OSS version) so looking for alternatives.

https://redd.it/djnttl
@r_devops

What data source is needed for this simple Grafana setup ? (Apache logging)

I'm hoping to setup a grafana instance to visualize I/O metrics on a Apache web server. The source of data will be the access.logs.

Everything is setup and seems ready to go, but as I understand it, I will need to establish a link between the logs and the Grafana instance via some kind of Time Series Database ? My question is two fold -

1. Why is it necessary to use a TSD for use with grafana, arent the raw logs enough ?
2. Which TSD would be a good choice for feeding Grafana the apache log data ?

https://redd.it/dji1wt
@r_devops

proxy auth + gunicorn

i have proxy auth working for Grafana + nginx.

But I am not sure how to get it to work with Gunicorn and nginx. Trying to get airflow (gunicorn) + nginx

https://redd.it/djg9as
@r_devops

How to create a CI/CD Pipeline to publish python packages 📦

I created this guide on making a build and release pipeline for publishing and packaging python artifacts.

Hope it works as a simple and useful introduction to the topic!

[How to create a pipeline to publish your python package](https://medium.com/raa-labs/creating-a-pipeline-in-azure-devops-to-build-and-publish-python-packages-artifacts-ea2f99410e6c)

https://redd.it/dj8zz4
@r_devops

Bootstrapping a 5 node Kubernetes cluster in 40 seconds

KuberNix now supports multiple nodes, powered by podman and nix. You can run it bare, in containers, and even in containers running containers. 😱

https://github.com/saschagrunert/kubernix

Psst 🤫, docker is supported too

https://redd.it/dj8yl5
@r_devops

How is data protection in cloud hosting? Is cloud based hosting a good decision when it comes to protecting sensitive user data?



https://redd.it/djl0z8
@r_devops

Rancher 2.X pipeline

Has anyone built out a rancher 2 pipeline? Is it worth using over travis/custom?

https://redd.it/djtjnp
@r_devops

Deploy docker services using Ansible

Hi,

In our company, we are using docker-compose to run our containerized services and I would like to automate the deployment using Ansible. Therefore, I would like to create a playbook that will deploy the containers and I was wondering is there any standard way to do it? I have seen different examples on the web and I cannot decide yet what is best.

Cheers

https://redd.it/djkwku
@r_devops

Modern Continuous Delivery

Check out this 37 minute talk from GOTO Amsterdam 2019 by Ken Mugrage - Technology Evangelist with ThoughtWorks. The full talk abstract can be found below:

The first product build specifically for Continuous Delivery pipelines came out over 10 years ago. The Continuous Delivery book came out 9 years ago. In the time since we’ve seen massive changes in the types of software we’re building, testing and deploying. Yet the way we think about pipelines hasn’t changed in many cases.

Now that we as an industry are trying to think “cloud first” what changes does that imply in our architecture? What about our organization? How we test? How we secure our systems?

This talk will show several intertwined changes to how we think about pipelines to support the other changes in our industry.

* [Video](https://youtu.be/w008iz_UwDk)
* [Full Abstract](https://gotoams.nl/2019/sessions/1044/modern-continuous-delivery)

https://redd.it/djkr5i
@r_devops

Service Discovery solutions

Aside from these two I found, what other service discovery tools would you recommend?

1. Eureka - https://github.com/Netflix/eureka
2. Synapse - https://github.com/airbnb/synapse

https://redd.it/djjgqz
@r_devops

Need help with Windows Client (7,8,10) Licensing on AWS or Azure

Does anyone have experience with Windows client (7,8,10 etc) licensing on AWS or Azure? I have a unique use case where I'll have between 50-250 users who connect temporarily connect to a Windows system to complete some work for 30-90 minutes and then the instance will be destroyed. This will happen on a 24/7 basis with a varying number of users and it will be different sets of users. If I want to support a maximum of 250 users at any given time do I just need to buy 250 licenses? They all need their own instance, they cannot share a single system with Terminal Services/ Remote Desktop Services.

With AWS I know it's BYOL and I was hoping Azure had an option where the price was rolled into the hourly cost but that doesn't seem to be the case. Neither seems to support Windows Client OS's very well.

Thank you!

https://redd.it/djbr35
@r_devops

seeking developer to help create a few database and network/application monitoring tools, etc.

In Austin....but, willing would be ideal, but willing to work w remote person(s).

1. Customer base already there!
2. Company equity in compensation....
3. Huge opportunity! Huge...

Cheers - Oday

https://redd.it/djvl94
@r_devops

Advanced Go NFTables, the beauty of io.Reader, a Go refactoring story & more (Go Gazette #77)
https://www.go-gazette.com/issues/error-handling-in-go-1-13-advanced-go-nftables-uber-s-go-style-guide-more-204270

https://redd.it/dk0ow0
@r_devops

Are docker containers even necessary for this?

Basically, I am looking at hosting some websites on AWS. My current plan is to purchase an Ubuntu VPS and utilize nginx as the reverse proxy to an Apache server were there would be multiple virtual hosts and /www environments.

Just recently, docker containers piqued my interest. I just don't know if they are functional for what I want to do.

The scenario in my head, is if I have a VPS and I make each website its own container/environment. Would that be overkill? Because each container would then require an independent Apache/nginx server within the container right?

They way I envisage it is like this:

Internet --> VPS (ReverseProxy) ---->

|---- Container 1 / Website 1 ( -nginx or apache for web server)

|---- Container 2 / Website 2 ( -nginx or apache for web server)

|---- Container 3 / Website 3 ( -nginx or apache for web server)

Any suggestions/corrections would be amazing.

Cheers!

https://redd.it/dk0pbx
@r_devops

Networking in hybrid cloud environments

I'm planning out a hybrid cloud deployment -- oVirt on-prem and AWS/Google/Azure/? for cloud. How do you guys manage networking between datacenters? Traditional wisdom would indicate using a VPN like IPSec or the likes, but that seems like it would introduce a single point of failure. What solutions are you guys using?

https://redd.it/djunmt
@r_devops