AMA Alert! We’re from Devtron Labs, one of India’s first open source platform for Kubernetes

We’ll be going live at 10pm EST and we look forward to your questions on DevOps, Kubernetes, running a start-up and working in the tech industry!

Check us out here - https://devtron.ai

https://redd.it/p36c74
@r_devops

How is bitBucket for cicd pipeline??

Anyone is using bitbucket for cicd? We have source code lying in bitbucket, that is reason I am trying to see if that worth exploring? How is it while compared to GitLab? I think GitLab provides end to end devops tool chain right from the planning to monitoring. Want to get reviews from the real users...

https://redd.it/p37777
@r_devops

What tool do you use to manage ECS Deployments?

We're thinking about using terraform to provision base infrastructure, (maybe with "stub" ECS services).

 

It would be nice to have a simple file that engineers could manage themselves (and that can live with application code), which when applied to ECS would create/modify services. e.g. set container images, env vars, scaling settings.

 

A key requirement here is really being able to do this via a declarative file format, and not by running ad-hoc commands in a CLI.

Does anyone have any good suggestions?


 

Thanks!

https://redd.it/p38993
@r_devops

Sharing some woes with Ubuntu and cloud-init creating a secondary IP on a single NIC

I had written out a question to ask r/devops about Packer building a template on VMware with Ubuntu 20.04.2 but was finally able to find the right combo of holding my tongue while wiggling my ears or whatever, and wanted to share. Mainly so in a month when I hit a similar wall I have somewhere for Google to find it.

The situation I was facing:

I had a weird thing where during the packer building of an Ubuntu template in VMware, the vm gets two IPs on the same nic. That fact isn't really a problem, but the resulting template has the same issue. If I build a vm off that template, either using VMware's OS customizations, not using them, or using any kind of terraform/ansible build process, the VM gets 2 IPs.

Why this bothered me was I've done every combination I could think of with the netplan yaml files to fix it on the final product. Also I had tried several different fixes on the packer build side, such as adding some user-data code to identify the nic (ens33/ens160), set mac as the dhcp-identifyier, etc etc.

VMware has a [KB article](https://kb.vmware.com/s/article/70601) that I thought was related somehow, but their workarounds are just editing the netplan yaml files, which didn't make any lasting change.

On a newly built template, building a VM, under /etc/netplan, I was seeing

00-installer-config.yaml
00-installer-config.yaml.BeforeVMwareCustomization
50-cloud-init.yaml
50-cloud-init.yaml.BeforeVMwareCustomization
99-netcfg-vmware.yaml

The contents of 50-cloud-init.yaml:

# This file is generated from information provided by the datasource. Changes
# to it will not persist across an instance reboot. To disable cloud-init's
# network configuration capabilities, write a file
# /etc/cloud/cloud.cfg.d/99-disable-network-config.cfg with the following:
# network: {config: disabled}
network:
version: 2
ethernets:
ens160:
dhcp4: true
match:
macaddress: 00:50:56:82:c5:59
set-name: ens160

I have attempted the fix, but putting a 99-disable-network-config.cfg in /etc/cloud/cloud.d doesn't help, and there is already a file under the directory containing:

/etc/cloud/cloud.cfg.d$ cat subiquity-disable-cloudinit-networking.cfg
network: {config: disabled}

that is put there by the autoinstaller. Both get ignored which I can't explain

In the end, the right combination was adding this code in the user-data:

network:
network:
version: 2
ethernets:
ens160:
dhcp4: true

and adding

'sed -i "s/dhcp4: true/&\n dhcp-identifier: mac/" /target/etc/netplan/00-installer-config.yaml'

as a late-command.

Also, in the build json file, having this for the boot command:

"boot_command": [
"<enter><enter><f6><esc><wait>",
"autoinstall ds=nocloud;<enter><wait>",
"<wait><enter>"
],

The difference was at some point I had added in between autoinstall and ds=... `ip=dchp` because I wasn't getting a dhcp lease for some reason.

I do have to set a different network block if I'm building in my local VMware install, because locally it assigns the interface ens33 vs ens160, but otherwise it's the same.

There's code to try and let cloud-init identify the nic, but it seems to fail so I just have to set it for either local or vsphere.

Hope this is helpful to someone out there... (also sorry if I mixed up a present/past tense somewhere, this started as a question and just edited to a solution)

https://redd.it/p36zeb
@r_devops

Who still uses vagrant and why?

Basically the title. Are people still using vagrant as opposed to something like containerizing an app? I just noticed that proton is using vagrant still and spins up a VM instead of a container to do build activities. Is this still normal instead of doing the same or similar work with docker?

https://redd.it/p3b75w
@r_devops

Everyone gets a container?

In this article, I attempt to answer some questions you have and explain some concepts you didn't know about software isolation i.e containers and virtual machines, docker and how some of those pieces fit together

https://blog.formpl.us/everyone-gets-a-container-b8f755b404e7

https://redd.it/p3apbr
@r_devops

How many of you actually like doing DevOps work, besides for the ridiculously good paycheck? What do you enjoy most about it?

I was reading this thread and found it hilarious that the top few comments are devops or directly related to devops, because I actually love what I do. Devs hating it means more job security for us and working doesn't actually feel soul crushing, at least for me. What do you think?

https://redd.it/p3d1nz
@r_devops

Hey all we are team Devtron! One of India’s leading open source Kubernetes startup - Ask Us Anything!

We established Devtron in 2019 to redefine how DevOps should be done.

Democratising devops is at the heart of everything that we do and we believe that something as fundamental as security shouldn’t be expensive which is why we have kept Devtron open-source. Our goal is to encourage developers to create new-age applications to enable large scale containerisation.

We bring together over 30 years of experience in the tech industry and have gained incredible experience and insight during our career and we’d love to answer your questions!

From running a start-up, working in the industry to what we ate for lunch - ask us anything!

Check us out here - https://devtron.ai/

https://redd.it/p3dylx
@r_devops

Use Jenkins or investigate a new CICD for front-end development work?

I recently joined a small company where I am the only front-end developer. I have very little experience with CICD tools in general, the only tool I used was CircleCI for my own personal project.

Currently, our back-end developers are using Jenkins which are hosted locally. I was thinking, I can reuse their Jenkins, or investigate a newer CICD tool like Gitlab, or Github actions etc.

I'm thinking of leaning more towards Jenkins because the infrastructure is already there (there is A LOT of Jenkins hate in the DevOps community, but I have no expertise in it to understand why).

What I want to do is something simple. When a developer creates a new PR, run tests, prevent the developer from merging until the tests pass; when the developer pushes the PR to the master branch, run the test again and also deploy it to production.

So while I was creating the pipelines, I came across two checkboxes.

\- Build when a change is pushed to BitBucket

\- GitHub hook trigger for GITScm polling (If Jenkins will receive PUSH GitHub hook from repo defined in Git SCM section it will trigger Git SCM polling logic. So polling logic in fact belongs to Git SCM.)

Can someone explain to me what is the difference between those two?

Thanks, everyone!

https://redd.it/p3e5da
@r_devops

Received equipment for my first job

This is new for me. What do you do when receiving you equipment for a project? I have to get used to a windows machine again, but aside from that, does anyone have any experienced suggestions or tips?

https://redd.it/p3fhld
@r_devops

Terraform - glorified documentation?

Hey,
I’ve been scratching my head over this - is Terraform really just a glorified documentation in most cases - in Kubernetes world? I use Terraform to just define networks, few VMs and a cluster. It doesn’t really fit in a CI/CD pipeline - there is a kubernetes provider but as far as I can tell it would be a pain to use it in continuous deployment.

What makes Terraform a „must have”? I could see the benefit when it comes to disaster recovery as you could deploy your whole infra with just a few commands but other than that how does it make your work quicker and more efficient?

Does anybody run terraform in their ci/cd pipelines? It would make sense if you had an application which is not dockerized and you would need your vms to look exactly as specified (so, packer + terraform). But in the container world?

I define my resources and apply everything manually and I have a weird feeling that I am missing something obvious.

https://redd.it/p39dlf
@r_devops

Weekly newsletter recommendations

Do you know about a cool Devops weekly newsletter that brings all the latest news in the world to your inbox?

https://redd.it/p3h6ge
@r_devops

How do you manage alert creation from customer communication tools like Intercom?

Hey, folks. I run a small but growing startup and am working on improving our team's processes.

We've been looking at OpsGenie, PagerDuty, and Splunk Oncall for actioning on alerts/incident management. Today, we use Intercom for managing support conversations with our customers and Github issues for project management, feature requests, and bug tracking.

I'd like us to be able to create alerts directly from Intercom and have also ideally view alert status updates in Intercom as they get updated.

None of the three vendors I looked at seem to have direct integration with Intercom today. However, Intercom does have bi-directional integration with Github issues. OpsGenie supposedly has integration with Github issues as well, but I can't seem to get it to work at all.

&#x200B;

What are other people doing here? Curious to hear about any success stories others may have had.

https://redd.it/p38ksw
@r_devops

Devops Job requirements

Hi folks,

Hope you are all doing good. So a little something about me. I just graduated last year July 2020 and am currently working as a Devops Engineer in one of the Service Based companies and am looking for a switch.

I have AWS Cloud Practitioner Certification and currently doing some hand-on in GCP, and also learnt a bit of Terraform in the way. What more skills will I be needing to applying for a job interview.

Can you please share some pointers which I should be focusing on, I am planning to apply actively next year but until then am planning to prepare myself.

Thanks in advance :)

https://redd.it/p36bo6
@r_devops

Creating your VM on the fly with a tool or have it premade?

So one case you use a tool like terraform to start a VM on the cloud then on top of it you install whatever you want (by automation) or have this image hosted with things installed already. The first case takes more time and makes terraform scripts more complicated, do you see other pros and cons?

https://redd.it/p3jyv1
@r_devops

How do you structure the hierarchy of your cloud accounts?

As every cloud provider offers some kind of hierarchy to structure your cloud accounts (AWS: Accounts & OUs, Azure: Subscriptions & Management Groups, GCP: Projects & Folders), I'm wondering: what is your strategy for structuring all of these?

Do you also separate different cloud accounts between environments such as dev & prod, or do you do this differently?

How does your preferred structure look like? Per application? Per department? Or otherwise?

I would love to know how you guys approach this.

Disclaimer: I'm currently building an open-source CLI to make it easier to govern clouds, and I'm thinking of including hierarchy structuring as a part of it.

https://redd.it/p3ka7o
@r_devops

Do you use client application names to improve debugging and monitoring of your databases?

Hey folks,

Recently, I wrote an article that your database connection deserves a name.

The basic idea: When a client application connects to a database, it should identify itself with a context-related name, as the application's name.

Why does it matter? If you operate a non-microservice environment, you often deal with multiple applications connecting with the same database. From a database perspective, this can be pretty risky. For example, one application can take down the database (via inefficient queries, high query volume, ...) and affecting the other applications by this. In such a scenario, which application is the troublemaker is not obvious and is hard to debug.

With application names assigned, it is nearly a no-brainer.

Other use-cases are rate-limiting, re-routing of queries to other nodes/clusters or per-app monitoring from the database perspective.

Which systems are supporting this?

I know of

- MongoDB
- MySQL
- NATS
- PostgreSQL
- redis
- Oracle
- SQL-Server / MSSQL

and non-database systems like

- RabbitMQ
- everything HTTP based (e.g., REST / GraphQL APIs)

Code, or didn't happen

I prepared full working (Docker-based) examples for the mentioned systems with Go(lang), PHP, and Python. Have a look at andygrunwald/your-connection-deserves-a-name @ GitHub.

What's your call on this?

What do you think about this? Useful? Waste of time?

https://redd.it/p3k3oc
@r_devops

How to take docker-compose to production?

I have a node.js and postgresql app in docker-compose that I want to take to production and expose to the Internet. What options do I have?
I would prefer to keep it simple and not have to configure or learn different services of cloud providers. IMO it should be transparent. But maybe you guys can tell me better.

Do I need to go for K8 or Service Mesh or aggregate multiple cloud services together?

https://redd.it/p3k2q2
@r_devops

How did you find your VDS/VPS-hoster?

Hi Guys!
Please select the option:

View Poll

https://redd.it/p2yx9b
@r_devops

Using secrets in kube prom stack helm chart

Hey guys. Coincidentally, I was trying to configure alert manager using the kube prom stack helm chart and saw another post along similar lines.

Does anyone have ideas on how I could reference a secret in the values.yaml ? I have a K8s secret created which contains the slack webhook url

...
config:
global:
resolve_timeout: 5m
route:
...
receivers:
- name: 'slack-test'
slack_configs:
- api_url: <<slackApiUrl>>

It works if I have the url pasted directly, but would be good to retrieve the value from the K8s secret that's deployed. Any pointers appreciated!

https://redd.it/p2wpmw
@r_devops

Update on CircleCI Config

Yesterday I submitted this post asking for advice on my CI config: https://www.reddit.com/r/devops/comments/p2y21u/adviceoncircleciconfig/

I am pretty happy with it now, but would like to hear if you have any other suggestions. Here are the changes I have made due to suggestions from that first post:

I created a `compose.test.yaml` file with:

services:

flask:
build:
context: ./flask
dockerfile: Dockerfile
image: myapp/flask
volumes:
- ./testresults:/testresults
environment:
FLASKAPP: "manage.py"
FLASKENV: "test"
FLASKCONFIG: "test"
TESTDATABASEURL: "postgresql://runner:runner@db:5432/circletest"
command: pytest "app/tests" --cov="app" -p no:warnings --junitxml=/testresults/junit.xml
dependson:
- db

db:
image: circleci/postgres:13-postgis
environment:
- POSTGRESUSER=runner
- POSTGRESPASSWORD=runner

New `config.yml`:

build:
machine:
image: ubuntu-2004:202107-02
steps:
- checkout

- run:
name: Create Results Directory
command: mkdir testresults && chmod 777 testresults

- run:
name: Building Containers
command: make testbuild

- run:
name: Running Tests
command: make test

- storetestresults:
path: testresults

- storeartifacts:
path: testresults

I created a `Makefile` with:

testbuild:
@echo "Running Test - Build"
docker-compose -p mytest -f compose.test.yaml build

test:
@echo "Running pytest"
docker-compose -p mytest -f compose.test.yaml up --exit-code-from flask

https://redd.it/p3mk1s
@r_devops