How can i keep an each instance in an autoscaling group aware of each other instance?

I have some (3rd party) software that needs me to post a json of all the IPs in the software's cluster to every instance, i'd like to be able to use autoscaling groups the instances are behind a LB. So the annoying part is updating that json every time an instance is created.


My idea is a serverless function get all instances in the autoscaling group, get their ips and return them to the requester. Then each instance will invoke the function then do a local POST of the ips on boot and every x seconds after that to stay in sync.


I don't know how much this will scale up, so if there will be more than 10 instances, i may add a cache in front of the lambda, but since its such a tiny json, it would just be a t2.small redis server.

​

Am i missing an easier way to do this?

https://redd.it/gculca
@r_devops

How do you host internal tools?

Let's say, someone non-DevOpsy comes to you with a script and says "I need a place to run this other than my own computer. It needs to be scheduled every Monday or, perhaps, my team needs to trigger it manually sometimes". What do you do?

E.g. at my previous job we used Jenkins a lot for this. It's a bit messy, but still, Jenkins provides a somewhat unified environment, takes care of scheduling the job, gives you a form for parametrization, etc. I'm wondering if there's something better suited for this purpose with a more human-friendly UI than Jenkins. Something that you could give to non-DevOps people.

https://redd.it/gd3je6
@r_devops

Agile metrics: Evidence Based Management (EBM) and Objective Key Results (OKR) create Flow.

“Agile metrics: Evidence Based Management (EBM) and Objective Key Results (OKR) create Flow.” by Richard Hoedeman https://link.medium.com/WjrCrDWYZ5

https://redd.it/gcnfj9
@r_devops

Deserted Island DevOps wrapup

Deserted Island DevOps was a DevOps conference that happened in Animal Crossing this week. It was a lot of fun, and featured some talks that are very applicable to what teams are facing now. Speakers included Ian Coldwater, Matt Stratton and Aaron Aldridge.

Read my thoughts on the event here, including links to the talks: [https://www.firehydrant.io/blog/deserted-island-devops-wrapup/](https://www.firehydrant.io/blog/deserted-island-devops-wrapup/)

Thanks to everyone involved for putting on such a fun, unique event.

https://redd.it/gdh7sn
@r_devops

GitOps with Flux and Kustomize

Hi DevOps,

Long time Redditor, but I finally decided to separate my personal account from a professional account.

Anyway, I have been writing medium posts for some time now and thought I would share them with this sub.

As of late, I have been really into GitOps. When troubleshooting problems in production, I find that the problem lies in one of three categories.

* code
* environment config
* data

If I'm doing things right, environment config related issues can be easily remedied because when my K8S cluster syncs with my source of truth, I'm back to my desired stated.

​

I wrote this article so others can try it out. Hopefully, it will help.

[https://medium.com/@airwavetechio/gitops-with-flux-and-kustomize-24dfabb8bc5d](https://medium.com/@airwavetechio/gitops-with-flux-and-kustomize-24dfabb8bc5d)

​

Thanks for reading.

https://redd.it/gdf877
@r_devops

GitLab CI vs jenkins? thoughts?



https://redd.it/gdbdrn
@r_devops

DevOps On Kubernetes responsibilities

DevOps Engineers working on kubernetes what are your roles and responsibilities?
Do you write the kubernetes helmet charts or developers do that? What parts should be responsibly of devops and what should be taken care by dev other than writing application code?

https://redd.it/gdb9tp
@r_devops

Question about running MongoDB HA on K8s

I've got a kubernetes cluster running and I've deployed MongoDB using bitnami/mongodb helm chart which created 1 primary and 2 secondary pods, mongodb service that points to the pod labeled primary and mongodb-headless service that points to all mongo pods.

If an app uses the mongodb service to write to the database then it will work only if the primary pod is up, if the primary pod goes down one of the secondaries will become primary but the service won't point to that newly elected primary since it uses labels and the app won't be able to access the database anymore. If an app use the mongodb-headless service then it will sometimes get load-balanced to a secondary pod and won't be able to write.

So my question is how can I make MongoDB always writable even if the main primary pod goes down?

https://redd.it/gd9lq0
@r_devops

Python Azure Serverless [Article]


Wrote the article, which gives an example of using Azure Python Function for obtaining Azure Datacenter and Office 365 IP addresses.

[Article link](https://github.com/groovy-sky/azure/tree/master/func-parse-cloud-00#introduction)

[Obtained data](https://strgy5exht4o56pkq.z6.web.core.windows.net/)

https://redd.it/gdcc0o
@r_devops

Free Early Access to New No-Code Data Apps Builder

Hey guys and gals!

A while ago together with my team, we developed a new no-code visual development platform for data-driven applications. We are hoping to launch it soon, and we've opened up an early access program for the most curious and enthusiastic.

With our platform, you can turn your data into useful tools by developing web apps 5-10 times faster than you would with traditional coding. It's especially great for working with multiple data sources via API and building rich UI interactions.

We developed it to save time when building web apps for our clients, so we made it easy to use but very powerful. Now we want to launch it to the public and we need your help.

If you are interested in giving our platform a try, drop a comment below and I'll send you the invite. We are looking forward to hearing your feedback and suggestions, and to see what you build with it!

Hope to see you there!

https://redd.it/gdbnnj
@r_devops

Question on designing Architecture

I am currently  working as a devops engineer, mostly working/supporting on tools during deployments and troubleshoot during downtime, but never really got a chance to design anything. 


Our techstack includes Jenkins, spinnaker, sonarqube, docker, Ansible, k8's and the list goes on. There are numerous tools and new one's coming out daily. With these many tools and technologies, if you have to architect a plan when on boarding an application. How do you plan it? What would be your suggestions to someone who is new to designing an architecture.


Thank you.

https://redd.it/gdbhzl
@r_devops

What Infrastructure as Code is and how Terraform fits into this concept

New free video course on Terraform, part 1 just released: https://www.youtube.com/watch?v=P0FUfo-Xdg4

https://redd.it/gdbg4u
@r_devops

GitOps and immutable infrastructure

What practices do your teams use to enable immutable infrastructure with CI/CD and GitOps?

If you make a change to your application, do you recreate your entire stack or just your services, leaving network consistent from deploy to deploy? What about changes to just your stack? Do you redeploy everything as well? How do you handle artifact generation to ensure the same stack and application artifact between different stages of deployment?

https://redd.it/gdnsps
@r_devops

Performance Testing With Puppeteer Cluster

Did a lil blog post on stress testing your infrastructure with headless browsers using Puppeteer, Buildkite and Ansible. Includes working code examples for you to try at home.

[https://stackchat.com/blog/puppeteer-cluster-performance-testing](https://stackchat.com/blog/puppeteer-cluster-performance-testing)

https://redd.it/gdkrrl
@r_devops

How to Get Your Digital Data Game on with DataOps

Have a look at the following article in [devops.com](https://devops.com) which covers:

* How enterprises can maximize the value of their data
* The best way to build a data optimization strategy
* How IT leaders can bring their staff up to speed on the latest data optimization techs and practices
* Leading data optimization challenges

You can read the article [here](https://devops.com/how-to-get-your-digital-data-game-on-with-dataops/)

https://redd.it/gdev6f
@r_devops

Custom Web Application vs. DXP

Hello!

I am not sure if this is the best community to post this, but I am hoping to get some guidance and opinions on the info below.

The company I work for is looking to create a custom web application to serve as a client portal and internal database to help us work faster and more efficiently.

High Level Info About the Project:

· Client portal for project management to exchange documents, sign documents, see past projects, associate products we can offer with projects

· We need to create custom decision trees and database query results based on the attributes of a client project

· Back end management of client projects for our team that allows them to log data about the client’s project and flow through the right questions to ask, things to remember, etc.

· Database of vendors we have access to that is searchable and filterable to quicken the time it takes our team to prepare proposals, find appropriate products, etc. (this part is internal only)

· Integrate with HubSpot

· Eventually we would like the client portal to have dynamic presentation capabilities that pull products in different views (part of fleshing out the database portion)

I have been working with custom web application development companies up to this point. One of them suggested a DXP as an out-of-the-box solution that could have custom modules added on to achieve our goal. I am starting to explore this option (Liferay, Core Dna, Site core, Salesforce), but am a little lost as far as customization capabilities go for these software offerings.

My questions are:

1. Is a DXP worth exploring?
2. Are there any that come highly recommended?
3. Are there any specific CMS or DXP products that would meet our needs to a client portal and database?
4. How should we look for a developer who is best suited for this type of project?

https://redd.it/gdamjg
@r_devops

OneDev 3.1 - super easy and high performance GitLab alternative

As requested by many users of OneDev, we added git over SSH and yaml based CI spec support in this version. Checkout [https://github.com/theonedev/onedev](https://github.com/theonedev/onedev) for more info.

https://redd.it/gebwf7
@r_devops

What is more stressful? DevOps or Software coding? (Software Developers)

Just curious.

https://redd.it/ge9jim
@r_devops

The basics of SQL injection and testing for them as an ops engineer

Hi, I wrote a post about the basics of SQL injection because I wanted to get to the bottom of it.
I'm mainly an Ops guy, and recently with all these "SecOps" talks, I thought I should get myself familiar with the basics and how to test my company's applications.

It's also an attempt (probably futile) of having developers pay "wholesome" attention to their own applications. Maybe some will...

[https://dev.to/prodopsio/sql-injection-for-developers-2pi](https://dev.to/prodopsio/sql-injection-for-developers-2pi)

Would love to hear any thoughts and feedback.

Cheers.

https://redd.it/ge1gm1
@r_devops

Very new to Jenkins and maven builds. Please help out

We have a project in git that is built either as snapshot or maven release. They are uploaded to different directories in our artifactory. We have the option to set profiles before build is triggered. I can see when a maven release is done, the profile name is tagged along to all uploaded artifacts. However, in snapshot builds, this does not occur. What can I do?

https://redd.it/ge142v
@r_devops

What are the best AWS devops courses?

What are the best AWS devops courses? I am not sure why, but most AWS courses are not enough hands-on. Ideally, everything we see on the screen should be put in code so that we don't need to be familiar with the UI on different AWS services and deploy everything to AWS and configure it by entering a simple command line to execute some scripts. Is there any course like that or is it too much to ask?

https://redd.it/gebcg3
@r_devops