I'm planning to use aws elasticserach service. I'm mainly using elastic for product listing and search. I don't how to start I created a cluster and mapped a domain for elasticservice in aws. How to create index on that with the existing postgres database with jewellery product details ?

Suggest your approach and thoughts on this scenario .


Thanks

https://redd.it/dou3tv
@r_devops

Why do YOU like DevOps?

Hi, and TIA!

I am a senior in college rn, and graduating pretty soon. I am interested in DevOps (with the couple internships I got to experience it a little bit) and enjoyed my OS/SysArch classes in college and want to continue using that in the real world.

I hear a lot of negative stories/rants on this sub. I was interested in hearing a story of your DevOps experience where you were reminded why you **love** this field instead!

https://redd.it/dos87m
@r_devops

How to have Jenkins execute .sql files in order

I am looking for a way to have Jenkins pull .sql files from my repo and execute them in order. I am not sure if batch command is the only way as I've looked at SQLPlus and it doesn't seem to work. The behavior I have is

Last step of a SQL job is a PowerShell script that starts the Jenkins jobs. Jenkins pulls from my GIT repo and executes SQL files in order so like 1,2,3,4. If one SQL file fails to create the job should fail. Are there any plugins that can do this?

https://redd.it/dou10l
@r_devops

Open Application Model Specification

Open Application Model is a specification for building cloud native applications.

Link: [https://github.com/oam-dev/spec](https://github.com/oam-dev/spec)

Focused on separating concerns of development and operation needs, *Open Application Model* brings modular, extensible, and portable design to building and delivering applications on platforms like Kubernetes.

When it comes to application development and deployment, we think it is important to distinguish between the parts that developers are responsible for, and the parts that operations is responsible for. Otherwise, if these roles get muddled, it would result in communications mishaps, bugs, or even service outages.

*Open Application Model* attempts to solve this problem by modeling the application according to the roles responsible for building and running apps and operating infrastructure.

* *Developers* are responsible for describing what a microservice or component does, and *how* it can be configured. They are the domain experts on the code.
* *Application Operators* are responsible for configuring the runtime aspects of one or more of these microservices. They are the domain experts on the platform.
* *Infrastructure Operators* are responsible for setting up and maintaining the infrastructure within which applications run. They are the domain experts on the low-level details.

https://redd.it/dotcat
@r_devops

Hashicorp Vault - deleting users and revoking all tokens?

Hello,

I'm having an issue where I can't seem to be able to de-login or prevent deleted users from accessing secrets anymore. Even if i delete the user, that user will still have access from wherever he previously logged in - I assume that's going to happen for the entire duration of the 'lease'. My question is...how can I logout all those deleted users? Is my assumption that I need to list all tokens that belong to an user, then revoke them, true? And, if so, how can I achieve that?

​

Thank you.

​

​

LE: My assumption doesn't seem to hold true; i've listed all leases via "vault list sys/leases/lookup/auth/userpass/login/username", then removed them using 'vault lease revoke', but the logged in user still has access to secrets :/

https://redd.it/dondb9
@r_devops

Entering the field

Hi, I'm a 22 years old guy who is looking to enter the Devops field, i got no experience in the IT world, for the last 2 months i've been studying tools like Docker, Git, Linux and aws, I want to go for Integration and automation sphere inside Devops, i got aws SA cert, and i'm thinking about getting the sysops and the developer certs.
In your opinion, what certs should i go for to land me on an interview ?
Maybe even go for CCNA, or RHCSA ?

https://redd.it/dopr6t
@r_devops

Migrate existing Artifactory OSS installation to existing Artifactory PRO installation

I tried setting up a remote-repo on my PRO installation to replicate from the OSS installation but I get an error.

>Error testing pull replication config: Replication to remote open-source Artifactory instance is not supported.

Is there a script that can use the CLI to download each OSS artifact and upload to the PRO installation? Or, do I need to purchase a PRO license, export the OSS version, and import into a new PRO installation, just to be able to replicate from one instance to the other?

https://redd.it/dopou9
@r_devops

Networking device configuration generator?

Hi guys, I'm a beginner to programming/scripting but I can write basic scripts using python, ruby & bash. Scripts like auto ssh, auto snmpwalk etc. and I wanted to create a simple program or webUI now wherein people can input variables and the system will generate a text(from a base template replacing the variables).

​

Can I please have some suggestion on what's the simplest way I can achieve this?

https://redd.it/don0as
@r_devops

What Are Your Go To Tools for Automating and Managing Common Tasks?
https://www.reddit.com/r/aws/comments/dp8p4m/what_are_your_go_to_tools_for_automating_and/

https://redd.it/dpa6l0
@r_devops

What to use for fast startup VMs

I'm working on a game server matchmaking system and I would like to be able to essentially create a VM on the fly to host a match when I determine that I have enough players to play a game. Nothing else on the VM is going to be running except for the game server itself.

I was looking into IncludeOS, which is a unikernel that advertises sub-second startup times, but getting unreal engine to compile with that would be insane. I'm looking at Apline and ClearLinux now, but I'm wondering if anyone has any advice on this before I dig too deep.

https://redd.it/dpb4rm
@r_devops

CI configs should be documentation

I've been toying with this idea for a few years - Whenever I try to follow documentation it's almost always out of date (especially the "install dependencies, start database, and get started")

I wrote an article (and made a product) around the idea that CI configurations themselves can act as documentation - Would love your feedback! https://layerci.com/blog/ci-configs-should-be-documentation/

https://redd.it/dpczar
@r_devops

Deploying with helm to a private GCP cluster

I have a CICD pipeline using circle and helm to deploy. I've been trying to set up a k8s cluster to send all egress and ingress through a NAT but I can't seem to find the configuration to allow deployments with helm when the cluster's traffic goes through the NAT and no external IP to the cluster. Are there established processes for deploying to a private cluster? I've seen this https://cloud.google.com/blog/products/devops-sre/deploying-a-production-grade-helm-release-on-gke-with-terraform and the associated repo as the closest thing to what I'm after but I'm wondering if there are non-hashicorp/completely native to GCP solutions.

Edit: I'm very new to devops and networking especially. If something is unclear, I will explain more. Thanks!

https://redd.it/dpdg1y
@r_devops

What is your team that does DevOps work inside your IT department called?

You might have other duties as well, as not everyone is necessarily exclusively doing DevOps stuff.

A lot of teams had the word "infrastructure" in them, but that isn't strictly accurate anymore, especially if you've gotten rid of your physical servers.

https://redd.it/dpdcmm
@r_devops

Any cool work related projects you guys are working on?

I'm working on getting terraform to a usable state for my team (running in to bugs and have git issues open) with their cloud backend service and AWS.

What about you?

https://redd.it/dp8dy6
@r_devops

Get up to speed on EKS and CloudFormation

Looks like at work we are going to be going with EKS and building it out using Cloudformation as we use CF for everything else. Still waiting on final word but hoping EKS.

I'm looking for resources to get me up to speed on best practices and potential issues that I am likely to encounter. I'm the only DevOps person and already know Kubernetes fairly well, on the skilled beginner/intermediate side of things.

My current plan is to create the EKS cluster, hook it up into what existing IAM and SG we have if possible, then containerize an example application (ours but only 1 part of the whole thing), idea would be to have an endpoint to be able to connect to and be able to send a HTTP request to the endpoint.

What resources will help me get up to speed on what I need to/should know for this?

https://redd.it/dpbdih
@r_devops

Appside secrets management.. How are y'all doing it these days?

Hey folks,

Got a design question.

My company is improving the way it looks at cybersecurity, and one thing that came up was the need to both version control configuration data but to prevent secrets from being leaked through that same vector.

Presently, our apps pull config data from environment variables, which are populated on deployment via an ansible push mechanism.

The threat model has the following vectors:

* A developer virtual machine image being leaked
* A developer virtual machine getting pwned via a network level attack
* Somebody getting access to our git remotes
* Disgruntled employee syndrome
* Somebody getting access (any access) in which they can expose Pam env vars on one of our service instances

Presently, we're transitioning to using Ansible. Ansible Vault has been looked at, but then there's still the issue of storing the AES key somewhere.

We've considered using AWS secrets manager to store our AES key for ansible vault but are additionally concerned about secrets being located in environment variables. I've considered writing an on-demand retrieval mechanism that statelessly pulls the AES keys from AWS Secrets Manager, but then there's the issue of round trip time to actually fetch the key each time. The application runs on a mix of node and PHP, so caching the key natively in application memory isn't really an option.

Reddit, wat do

https://redd.it/dp67io
@r_devops

How to wait for Postgres before running API services through docker-compose when psql can't be installed?

I have a docker-compose.yml file with a database and multiple APIs that I'd like to launch through a simple "docker-compose up" in the terminal. However, I'm running into the issue of my APIs starting up before the Postgres server becomes available.

I saw a solution for using a command statement in the docker-compose.yml file that runs a shell script with "psql" to test the Postgres connection before starting an API service, but the issue there is that my API images only have the API service on them (*no psql, python, ping, etc.*) and I'm pulling those images from AWS ECR so I don't have the option to install those.

To complicate things further, any command statement within docker-compose.yml gets in the way of the API image's command statement from the Dockerfile, which would ordinarily have it run its own docker shell script to start up the service. The Dockerfile that was used to build the image has a command to execute an external script to start the service.

Does anyone know of a solution for this issue? I'm a newbie and lost as to how to proceed.

https://redd.it/dpawwz
@r_devops

how do I add more disk space to my google cloud instance?
https://www.reddit.com/r/googlecloud/comments/dpkfc5/how_do_i_add_more_disk_space_to_my_google_cloud/

https://redd.it/dpknd6
@r_devops

Developers are increasingly interested in and adopting DevOps and Mini apps. Interest and adoption of cryptocurrency and computer vision is also increasing but to a lesser extent.

[https://www.developereconomics.com/resources/reports/state-of-the-developer-nation-17th-q2-2019](https://www.developereconomics.com/resources/reports/state-of-the-developer-nation-17th-q2-2019)

https://redd.it/dpm2dc
@r_devops

Building and deploying lots of microservices using werf and GitLab CI

[Here](https://medium.com/flant-com/building-and-deploying-lots-of-microservices-using-werf-and-gitlab-ci-3ce2b7d19450) is how we build & deploy to Kubernetes (via GitLab CI) many similar microservices (i.e. an application represented by multiple repositories). Our goal is to avoid an obvious pain of copying pipelines/infrastructure configs. We assume that deployments are described by Helm charts and werf is in use.

https://redd.it/dpmev2
@r_devops