DevOps Perspective: G Suite or Office 365?

I realize this is an odd post, and some may have clicked on it just to scoff, but hear me out.

​

Wearing multiple hats for a project team/startup I need to determine the office/collaboration suite. I haven't been a desktop admin in a long time. Most posts I've found comparing the 2 end up being from the business prospective. I'm more interesting in what appeals more to developers/engineers that would let them automate and customize their workflow to their hearts content. Both provide docs, email, etc. Some of the aspects I'm comparing are:

​

* Automatable workflow. The ability to automate workflow between apps using Tasks, Power Automate, IFTTT, etc
* Scripting (somewhat applies to the first). Powershell, GAM, etc
* Interoperability with the companies cloud solution. O365 and Azure, GSuite and GCP, etc. Both can do some interesting intercommunication between apps and cloud; Using Sheets to change GCP instances, etc, but is any of it useful vs "cool tricks"? (also relates to PowerShell and GAM)
* Azure DevOps. I haven't really used it but everything I'm reading says its amazing. Git, deploy, wiki, kanban, etc. I have also read it can deploy to any cloud or on prem. Any advice or opinions about this would be appreciated.
* Collaboration platform: Teams vs Hangouts Chat (current version and preview). I know Teams isn't as good as Slack and Hangouts Chat is pretty limited with a better version supposedly on the way; but I'd still like some thoughts here.
* Anything I haven't thought of.

​

Thanks in advance for any advice.

https://redd.it/elxn9i
@r_devops

Live Devops Q and A on Twitch Tonight! - 5pm-7pm PST

I'll be answering your Devops questions live tonight on my twitch channel from 5pm-7pm PST.

​

[https://www.twitch.tv/learndevopsinsights](https://www.twitch.tv/learndevopsinsights)

​

* Wondering if San Francisco is all that great?
* Want to discuss the ethics of Tech?
* Curious about benefits and salary?
* Wonder what it's like working in Tech as a minority?

​

I'm eager to here what you got!

​

Can't make it out? Reply back with your questions and I'll be sure to answer them in the stream!

https://redd.it/elxj7u
@r_devops

Seeking advice for a web app project.

Hello everyone and sorry for the probably dumb questions that I'm gonna write but I'm getting confused by all the frameworks and solutions out there and I'm not a web developer...

​

I and my other 2 friends are planning to build a relatively simple browser web app that would also use an external API. We have already built all the design and started to code all the front end stuff with react etc. Now, regarding the backend or the server-side, what would be the best solution and where do we start?

Do we have to connect ours react front end with, for example, Nodejs? And then after having everything working put it in a hosting?

Or are there cloud solutions that we could use? What would the advantages be? We tried to look for firebase but apparently it doesn't allow external communications (like the API that we wanted to use).

​

Any advice would be great!

​

**About the web app:** It is fair simple but should have a db, a matchmaking system and all the application should be scalable

https://redd.it/elwtgm
@r_devops

projects to impress a future employer

I'm looking for some ideas for projects that I can build at home, mostly within my current skill set (listed below). I'd like to build, document, and publish (blog) my work. These projects should be aimed at improving my skills but also my CV, and portfolio.

awesome... thanks a lot

**Current Skillset:**

* python
* bash
* containers
* kubernetes
* AWS
* ansible
* linux

edit: updated skills list

https://redd.it/elpz6o
@r_devops

Online build tools for react native ios

Hi everyone

I'm thinking of a build pipeline from code to deployment on appstore from a react native code, i'll need cover on android for the future.

I want to final check if there are some other alternative before i dive in fully in it.

I'm using gitlab for code versionning.
I sawn that microsoft app center cover build/test/deployment for react native app either in ios or android (i will need in the future) and support gitlab directly [https://devblogs.microsoft.com/appcenter/announcing-gitlab-support-for-visual-studio-app-center/](https://devblogs.microsoft.com/appcenter/announcing-gitlab-support-for-visual-studio-app-center/)

What are the other viable alternative on the market ?

I found fastlane for deployment (that work with gitlab CI/CD) [https://fastlane.tools/](https://fastlane.tools/)
I still need to build it (would like online so that i can have a proper pipeline on gitlab)
And test it (alternative i found is [https://appetize.io/](https://appetize.io/) cost look like cheaper than appcenter but in reality it's not because base hour included are way lower) firebase also can do test but no build for ios. [https://firebase.google.com/docs/test-lab/](https://firebase.google.com/docs/test-lab/) and did not seem to be integrable in a pipeline at the moment.

​

Is there other tools out there that i'm missing ? Thanks in advance to the community

https://redd.it/elrfqe
@r_devops

Strategies for SQL Database Deployments

What strategies do people have in place for deploying SQL database changes without impacting code?


Our SQL Database dacpacs have to deploy when code is deployed currently because they are coupled so closely together, but we are looking to change that. I'm thinking of versioning and then tech debt cleanup, but was curious of other approaches.

https://redd.it/emd3fu
@r_devops

Drone Deployment Event

I am trying to trigger an event after deployment to Kubernetes by sending a GitHub webhook to Drone. Has anyone done this?

https://redd.it/emfw67
@r_devops

Show devops: My fully open source SAST scanner

After years of fighting with slow, expensive and cumbersome commercial SAST tools, (and after being let go by my ex-client!), I decided to build my own based on available oss tools. It's time to present sast-scan

https://github.com/AppThreat/sast-scan

The scanner uses sane defaults for a number of languages and frameworks. I have started adding SARIF conversion feature and this helped integrate the analysis with VS code, Azure DevOps and so on. There is also GitHub action integration.

I have few ideas in mind to make it useful for modern DevOps teams. Would appreciate your comments and support to make this project useful for everyone.

https://redd.it/emctw4
@r_devops

Different Docker images with the same image ID but from different repos

I ran into a bit of an issue today again with docker image ID's being the same for different docker images. This caused the auth service to not start right since it was thinking it was pulling the auth image but actually was starting the user image up.

​

Now both of these are built using Jenkins and I've checked and checked, the repo names are correct in the pipelines as well as that there is different tags which come from the commit hash.

​

What might have happened here and what can I do to prevent it happening again? This is a bit scary since this could take down production, lucky this time it was in staging.

​

<ID>.dkr.ecr.us-east-1.amazonaws.com/auth 24e38c0efca9 ec57f009d2a6 2 days ago 114MB
<ID>.dkr.ecr.us-east-1.amazonaws.com/user 94a52a1e93fd ec57f009d2a6 2 days ago 114MB

https://redd.it/emfkhb
@r_devops

Aspiring DevOps Engineer and IT Professional's Personal Domain Name Ideas/Examples?

Hey Guys,

I'm currently studying and practicing to make a transition into a career as a Site Reliability Engineer (DevOps) and I'm currently an intermediate Systems & Network Administrator. One thing I'm studying is middleware such as NGINX and I'm learning how to deploy/configure such and also HTTPS certificates. I'm going to buy a domain so that I can host a personal wordpress site (for testing/practice but eventually to advertise my skills, bio, and work portfolio). What are some good ideas or examples of an IT Professional's personal domain name? I was thinking *MyInitials*-IT.net? Is that dumb? Should I just make it my *full name*.TLD? Curious what IT professionals use in the real world.

https://redd.it/emezdb
@r_devops

ansible line in file

I have about 10 debug in my task. i am using line in file. I want to know is there a way to have all debug msg have line each. or any other way. I have 10 variables in line parameter and i have to keep going right to add more variable.

Ex. - name: Tcp Ip

debug:

msg: "{{ ansible \_inventory }}"

line: {{ ansible\_inventory}}

https://redd.it/eme5ks
@r_devops

How do you get notified of important CVE?

I'd like to know ASAP whenever a critical CVE is found, but I'm not willing to poll actively the CVE website. However, they don't seems to have a notification mechanism. How do you do so?

https://redd.it/em8ns2
@r_devops

Automating SQL queries

I just started my first role as a devops engineer and one of my responsibilities is running approved SQL queries against our production databases and returning the results (if any) to the team that requested it. I'm trying to find a way to automate this but don't know where to start. I'm used to configuration management via Ansible and don't wan't to put one-off SQL queries into a playbook in Github. There has to be a better way, right?

https://redd.it/emi6o8
@r_devops

Running containers on Google compute engine

Does Google compute engine auto pulls latest image from registry just like Google kubernetes engine ?

https://redd.it/ema5km
@r_devops

Packaging Woes

Hey Guys,

&#x200B;

Just posting to get a little more insight on how other companies operate with their continuous integration.
At present I am trying to integrate chocolatey packaging for Windows & IIS services, then use puppet to update software on a few of the QA servers before running tests (not unit tests). Unfortunately chocolatey is limited to semver v1 so I would be limited to using BUILD ID as some sort of tracking upgrade mechanism.

I would look to mount the chocolatey packaging inside of the build process and push to a repository where testers can tell puppet what to install, to build new tests.

I can't help but think there's simply a better way to do this though.

https://redd.it/em9358
@r_devops

How to standup/provision/maintain Kubernetes infrastructure and processes in 2020?

Hello r/DevOps,

I will be joining a company whose goal is to re-architecture how we provision and maintain our kubernetes infrastructure. They're open to embracing new tools (Datadog, Gitlab, Jenkins) in order to modernize their architecture in a way that other companies have found success in.

Having said that, I would like to know what tools and technologies you guys would use to standup/provision/maintain a Kubernetes environments in 2020.

The only requirements is that the cluster itself needs to be managed by GKE on Google Cloud. Aside from that, the companies is placing no requirements as to what technologies and tools to use to modernize our Kubernetes cluster.

&#x200B;

Here's what I'm planning:

&#x200B;

**CODE HOSTING**

I'll be looking at Gitlab. It has a CI/CD baked in as well as a container registry and some basic Kubernetes management. I wonder whether we should use [GitLab.com](https://GitLab.com) or host our own inside our kubernetes cluster via their helm chart.

&#x200B;

**CLOUD RESOURCE PROVISIONING**

Everywhere I look I see Terraform as the king of IaC. I have experience with Terraform and I just love it. I wonder whether you utilize Terraform Cloud to manage infrastructure changes in PRs or just use the GCP storage backend like I have done in the past.

&#x200B;

**PIPELINES**

If we embrace Gitlab, I plan on using Gitlab CI/CD and configure their runners to run our build, test and deploy jobs on Kubernetes.

&#x200B;

**DEPLOYMENTS**

Looking to automate deployment via Gitlab CI/CD and Helm 3.

&#x200B;

**SECRET MANAGEMENT**

I have experience with checking in our secrets via SOPS in our repo but I've been looking at Vault recently and wonder if that's a even better approach to managing our secrets.

&#x200B;

**CERTIFICATES**

cert-manager to manage our cluster certificates.

&#x200B;

**INGRESS**

Looking to stick with nginx-controller but have been looking at traefik. Does anyone have any input here?

&#x200B;

**MONITORING**

Datadog seems to be king here. Planning to deploy Datadog as a daemonset in my nodes for monitoring and observability across all application layers.

&#x200B;

**ALERTING**

Here, I have no idea. I have used VictorOps but I have no clue as to whether other services offer better packages.

https://redd.it/emmk3a
@r_devops

What’s new in Helm 3.0?

Helm is a package manager that simplifies installing and managing Kubernetes applications.

Helm 3.0 was released on Nov 13, 2019. The main attraction of this release was the removal of the Tiller server, which deployed inside the Kubernetes cluster and interacts directly with the API server to manage Kubernetes resources. With Tiller gone, the security model for Helm is entirely simplified. Helm 3 supports the latest security, identity, and authorization features of Kubernetes.

The following are the capabilities of the new version;

**Elimination of Tiller**

Helm 3.0 has a client-only architecture with the client still called Helm. It operates similar to the Helm 2 client, but the client interacts directly with the Kubernetes API server. No more middle man. Removing tiller helps to increase cluster security.

**Automated Helm state creation**

In Helm 3.0, we don’t need to install Tiller so initializing Helm is obsolete. In other words, removal of the helm inits, and automated creation of Helm environment.

**Release storage changed**

In Helm 2, releases are stored as ConfigMaps in the cluster under the Tiller namespace.

But in Helm 3.0, releases are stored as Secrets by default and storage is in the namespace of the release.

**Changes in Chart architecture**

In Helm 2, chart dependencies are declared in requirements.yaml.

Chart dependencies are consolidated in Helm 3, moving the dependency definitions to Chart.yaml. The lock file has also changed to Chart.lock.

**Library charts**

The common or helper chart provides a reuse pattern for chart definitions in Helm.

A new ‘type’ of the chart was introduced to the chart.yaml and it can be either application or library.

* Application is the standard chart, which creates release artifacts during rendering.
* Library charts are declared as a dependency directive in Chart.yaml and are managed like any other chart, except that they are not installed.

**Chart value validation**

In Helm 3, values passed to a chart can be validated against a JSON schema. This validation is beneficial to avoid setting incorrect values and help improve chart usability.

**Changes in Chart repository**

The Helm Hub is introduced as a central catalog for Helm chart repositories. Local and stable repositories are no longer added by default.

**Improved release upgrade strategy**

The Helm 2 release upgrade used a two-way strategic merge patch.

In the case of Helm 3, the release upgrade uses a three-way strategic merge patch. Helm considers the old manifest, cluster live state, and the new manifest when generating a patch.

**Over-hauled CRD (Custom Resource Definition) support**

Helm 3 simplified Helm CRD support. The crd-install hook is removed and replaced with a crds sub-folder in the chart folder. Helm 3 does not try to provide full CRD support. It just provides support to install a CRD in a simple fashion.

Helm 3 comes along with a rich set of competence which changed it to a new set of capabilities, a one-off.

https://redd.it/emlt0p
@r_devops

Ansible facts/gather facts

i cant find these facts: base clock, turbo clock, tomcat and weblogic app, EOSL, storage type, server type, list of app on server, number of instances of each app, last audit, backup and brought date, and planned decommission.

https://redd.it/emavd6
@r_devops

Debugging with scratch containers

Hey guys,

I am trying to move towards scratch containers in the company I work for. The Dev team I work with have a requirement to occasionally debug e.g. Redis from the POV of the running container, what options are out there to enable this shell access whilst still ultimately running the application in a scratch container

https://redd.it/em7xrz
@r_devops

Devops vs Sysadmin Jobs? What are all the differences?

Hi folks,

I've seen few open positions for Devops and Sysadmin remote jobs. What do you think is the main difference between them in terms of responsibilities?

https://redd.it/em7bdn
@r_devops

CD Pipeline for Flask + DB

Hey everyone,

I'm working on how exactly to architect a continuous delivery pipeline for a small project that will probably grow in scope over the next year. At the end of the day, it's a basic web server (Flask) with a relatively independent database.

I've got both components set up in their own docker containers and configured with a docker-compose script for local development. While I have experience with docker and deploying a single application on a server manually, I would like to set up a pipeline through GitLab to keep the server updated. I'm planning to deploy on Linode but I'd like to figure out a pipeline for the continuous delivery piece before I get too far into manually configuring a server.

From my experience, deploying a new set of code should just be a matter of logging in, pulling the latest code from git, re-building/updating containers, then restarting the services. I would prefer zero downtime but it's not a necessity at this point. Is there any way to automate this within a GitLab runner? I've heard of them but have never used them, so this may be an uninformed question.

I've also heard of Ansible, Chef, Jenkins, and a bunch of other CI/CD services, but I have 0 experience with any of them. Are there any that work particularly better with docker? Do any of these solve this problem easier than others? In terms of scalability, are any better if I needed to scale?

If you've got any advice on the docker configuration, VPS configuration, or general DevOps, let me hear it! Thanks in advance for the help!

https://redd.it/em4fdk
@r_devops