Troubleshooting JFrog Artifactory...

Hi there,

First time posting and too be completely honest, a little out of my comfort zone. I am currently looking into a potential issue surrounding Artifactory that was recently set up for our new Docker instance. The team responsible for it had an issue today that they brought to my attention where they are receiving 400 Bad Requests trying to connect to our local Artifactory server from the Docker command line. However, if we open a browser to go to the web portal, they can log in no problem!

One issue I helped solve was there we needed to set up a \*.server.domain.com DNS A record which set up the sub folder in the parent DNS zone ([domain.com](https://domain.com)). This resolved one issue which was surrounding NGinx/Artifactory for mapping through NGinx to the Artifactory api. But now there maybe seems to be another issue where from Docker cmd they still cannot push to Artifactory?

Would this need a cert setup/installed somewhere? On the server running Docker? On the Artifactory server? Or not at all? Thanks!

https://redd.it/fd3awn
@r_devops

How do you handle development data?

I've been thinking about how to set up test data for development, but haven't found an easy way to get data that has the following properties:


* It's sufficiently similar to production that it's useful for testing. I.e. covers a variety of cases and is up to date with the latest schema.
* It's sufficiently different from production that it:
* isn't a security risk (it's anonymized and whatever)
* isn't gigantic (it's a subset of the production data, or it's mock data)

Is this difficult for you all? How do you deal with development data?

https://redd.it/fd4pl1
@r_devops

Building an onboarding series for new technical hires

I’m starting a new project unlike one most discuss in /r/devops and one I haven’t seen done before: a technical onboarding series for new software developer and engineering talent!

Though the details will differ company to company, but it feels like the overall flow shouldn’t be. At my current company, we have applications that live on-premise within corporate data centers with others in the cloud. Both have some underlying technology prerequisites (Kubernetes, AWS) and should probably have various exercises to go along with them followed by building a simple, first-class application.

The problem is that these are purely my ideas without any concrete examples that others do. I hope someone could point me to good examples to model such a process from.

Regards!

https://redd.it/fd4en0
@r_devops

Cloud Engineer vs Devops Engineer

I was curious on the communities take on which role I should focus my attention on when looking in the job market.

​

I'm interested in building out cloud resources using IaC, automating processes with python/golang/powershell, deploying CI/CD pipelines and using more Docker/Kubernetes.

​

(I understand devops engineer is a catch-all job title but nonetheless)

From what I've been seeing, Devops Engineer roles tend to be focused around building CI/CD pipelines for other teams (primarily devs) using IaC, etc built/maintained by a cloud engineering role.

It seems that Devops is "one layer up the stack" not really needing to focus on how infrastructure is deployed, but mainly on getting it deployed for their pipelines.

​

I just want to make sure I choose a role that is furthering my career in the right direction.

https://redd.it/fd639k
@r_devops

Using Packer to share encrypted AMI to multiple accounts

Hello all,

Would anyone know how I would be able to share an encrypted ami that I create in our Dev AWS account to our Staging and Prod AWS accounts using Packer? Looks like there is multiple ways to do it, but ideally I would like to use just one json file to do the entire share as opposed to my other way which would have been:

\- 3 Packer files

\- 1 creates in Dev unencrypted and share to Stg/Prod

\-1 uses that shared ami in Stg to then encrypt it

\-1 uses that shared ami in Prod to then encrypt it

​

Would be best if I could just create one encrypted AMI in Dev and share it accordingly

https://redd.it/fd52c2
@r_devops

Mulesoft vs Tray.io, Zappier, Workato

Does anyone here have any experience with Tray.io , Zappier or Workato? How do they compare with Mulesoft?

https://redd.it/fd6nae
@r_devops

Vault

We're a really small team. Does anyone have experience running Hashicorp Vault as a small team? I think we'd get utility out of having a central store for our secrets, but I'm concerned about the overhead and also how mission critical it would be. If it went down, everything else goes down.

https://redd.it/fd2nhu
@r_devops

How to securely handle SSL certificate deployment?

Hi all. I was wondering what is the best way at managing the deployment of SSL certificates to multiple servers.

My experience is pretty limited to only doing single server hosting and using Lets Encrypt. However, I'm now working on a rather large project and I want to be able to create a single SSL cert and distribute it to all of my servers. The reason for doing this instead of using, lets say, App Engine's managed SSL service, is that I want to be able to read the file and use it to sign tokens among other things.

The issue is, I'm unsure what is the best way to implement this and how to do it securely. My thought was to have a standalone server that just renews certificates once it nears expiration, upload it to object storage and then on each server, run a cron job that pulls the cert every month or something.

The second thought was to use scp to pull the file directly from the SSL server with a cron job, but then do I need to setup SSH keys for each server to talk to each other?

I'm lost at what to do thus far and any help would be appreciated. Thanks!

https://redd.it/fd8tw1
@r_devops

KPIs

Interested as to what different KPIs different DevOps teams use, and how they measure them.

https://redd.it/fd6qkh
@r_devops

Naming Standards for Infrastructure

I wrote an article [here](https://medium.com/@nandovillalba/devops-naming-standards-5e9e73996dfb) about naming standards with some ideas on how to implement them. I was googling around and I couldn't find many resources on what good practices people follow to name their resources so I drew mostly from my experience. I was wondering if I could get more ideas from you so I can expand the article.

What sort of logic do you follow when you name your resources in general in your company? How do you enforce it?

https://redd.it/fcy3vq
@r_devops

I have Down time and I don't know what to do.

So I just finished a major project, and other members of my team are in the middle of theirs. My manager knows and is cool with it because we should "cherish our down time" when we get it. But I feel antsy not having a project or a problem to solve and I can't think of any real things to automate. Given our business make up, I'm in a shared service model with other business units. The BUs have the developers for their units, and then all of them come to us for any infrastructure needs. They also make plans without us unless it involves infrastructure so it's not like I can improve someone's CI/CD for example because that BU might not need anything done.

I tried learning packer. I see the use case but doesn't REALLY get us much because of how we operate. Don't have anything that I can migrate into terraform. Any docker/ECS initiatives are done. Ansible is humming along. Jenkins is configured so the developers/QA are in charge of their releases so they just deploy as they need (remember, each BU has their own dev team and I'm not part of any BU).

Getting a tiny bit bored waiting for the next big thing. I guess I could torture myself with documentation. /s

https://redd.it/fcxzcw
@r_devops

Let's Encrypt Is Revoking Three Millions Certificates On March 4

More details here: https://www.infoq.com/news/2020/03/letsencrypt-revokes-certificates/

https://redd.it/fdbhtq
@r_devops

Linux vs Windows DevOps, technically speaking

I have been researching the technical differences between Linux and Windows devops since I am recruiting for a Sr. DevOps Engineer in Cerritos, CA. I have a couple of candidates with Linux devops experience and need to know what they need to know on a technical level to be able to quickly ramp up to do Windows devops instead.

Thanks!

https://redd.it/fczjpl
@r_devops

Do you think chef is dead?

I've seen a lot of people acting like chef is a dead product lately because they essentially killed off everything that was open source.

Are there people here who are using the cinc? or are you paying for it? Or did you move on to something else?

I need a solution to manage laptops all over the world and have zero budget. Chef seems like a better option than Puppet for this. I don't think anything else is really viable.

https://redd.it/fd2vhe
@r_devops

Best cloud solution for a small forum + email?

Hi all,

I began working on a car forum a couple months ago and I’m trying to figure out the best cloud solution to host all of my services - what I’m looking for is Ubuntu VPS/VM, email (send transactional emails and send/receive normal), and perhaps some image hosting. I anticipate maybe a couple thousand members and around 10K emails sent every month once it’s 100% ready which will not be for a while.

I am new to using cloud services such as AWS and Azure. I’ve poked around for a bit and I think I like AWS a bit more but I also hear that it may be pretty overkill for my situation. I also began looking into Google Cloud and Digital Ocean, but I’m not sure which of the 4 would be the best fit for my needs, or if there’s another that I am missing. Perhaps cloud in itself is overkill for my situation? However I wouldn’t mind learning all about AWS or Azure since that could help my portfolio. Just looking for some options, as I said I’m new to this whole thing.

What do you guys think? I’d be happy to provide more info. Thank you!

https://redd.it/fcza7m
@r_devops

Openshift configmap in Azure?

Hey guys,

I'm not sure if this sub is also for technical questions, so please feel free to delete this post if that's the case.

I am trying to deploy a Docker Image in my Azure cloud. I have no trouble getting my Image into my registry and starting a container from it. But when trying to put my application.yml with configurations into my deployed container (It is a spring application) I just can't seem to find this option anywhere. In Openshift the option is called configmap, where i can add a configuration file, like my application.yml and then add it to my deployed containers.

Does anyone know what this option is called in azure?

Greetings TRXI

https://redd.it/fdek7z
@r_devops

DroneCI and dynamic dns

Has one implemented or configured DroneCI where a job can create an fqdn entry that an external service can create(such as Bind or Amazon Route53)? What I'd like to build is allow the creation of dynamic dns names based on git branch names that are currently being built. This way, I can easily test (for example a web app) the application based on branch names and not via consistent dns names. For example, curl [https://fix-css.example.com](https://fix-css.example.com) or curl https://feature1.example.com

https://redd.it/fdedij
@r_devops

Opinionated tools/platforms

With DevOps tooling and automation, is there a prevailing view on this topic (highly opinionated vs. non-opinionated)? I'm guessing the answer likely depends on the degree of organizational expertise with DevOps, developer autonomy, etc., but I'm curious about views on the tradeoffs (i.e., workflow flexibility via non-opinionated) and preferences.

https://redd.it/fd19ou
@r_devops

MySQL active/active replication across multiple AWS regions.

My company is having a chat-based application hosted in the US. Now, as our Asian clients are increasing, we cloned that infra in India as well. We are using MySQL master-master replication for that with auto\_increment\_increment and auto\_increment\_offset. In a few cases, I was able to notice that some of the changes are not replicated in the India region until a minute passed. After a minute, everything started replicating again with unnoticeable lag. What approach do people follow in such cases with MySQL? Does anybody face that issue in MySQL replication across multiple geolocations?

https://redd.it/fdgj10
@r_devops

How to integrate project's SonarQube metrics in a Datadog Dashboard

Hi DevOps community !

I want to have a Dashboard that sums up all metrics about the health of a project such as build passed/failed over time, total AWS cost (through AWS tags) and also a bunch of useful metrics of SonarQube such as the code quality.

About SonarQube, I wonder about the technical solution that I can implement. There is no official SonarQube integration inside Datadog so it will be custom metrics. But how can I push those custom metrics ?

I was thinking of a Lambda function that periodically get all useful metrics from SonarQube and push them to Datadog API.

What do you think about it ? I need some advice, thank you very much in advance for your answers :)

​

EDIT : Typos

https://redd.it/fddxpi
@r_devops

Help me improve my infrastructure.

Hello, folks!
I am a systems administrator at a small company, and I would like your opinions on how our infrastructure could be improved.

Our current setup is:

Digital ocean as a cloud
2-10 droplets that serve php (laravel) using apache+php fpm
Few redis droplets
Mysql databases
Cloudflare for load balancer and CDN
our code is divided to packages(using composer a.k.a. dependency hell)
The problems we want to solve are:
1. Ci/Cd (manually deploying each week atm)
2. Serving some files(pdf, images) from digital ocean spaces (we hit rate limit 750 requests per second per ip (5000+ total per sec))
3. Auto scale the web nodes

So I've been thinking about:
1. Migrating to AWS or GCP (it's cheaper and they offer some auto scaling solutions)
2. Using network storage mounted on the web nodes.
3. Using containers maybe? What are the pros and cons?



SORRY for my bad English.

https://redd.it/fdht2m
@r_devops