Build & deploy individual apps from a monorepo

# My Proposed Monorepo Architecture

Monorepo architecture pic

This layout is what I've come up with from reading through tons of articles and being convinced that Nx suits many of our needs where I work. The layout works fine for a company of this size because we need opinionated architecture to keep things running smoothly.

## Goal

I want to achieve isolated development, testing, and deployment while using a monorepo.

I have a few concerns with common workflows that I'm not sure how to approach just yet.

## Questions

Case 1: I want to work only on homepage, how can I avoid having to have the entire mono repo locally?

- I read about how Microsoft solved for this, but we don't have access to Azure DevOps at the moment and I wonder if this isn't solvable in some other way. Also, the open source tool they built requires a platform compatible with it, such as Azure DevOps.
- Are Git subtrees a solve for this? Would my monorepo look like a collection of child repos (subtrees) that, in reality, live in their own repos, and are just declared here for build/deploy reasons? This seems to ruin all the benefits of having a mono repo in the first place.

Case 2: I want to deploy changes I made to the homepage app without having to build & deploy every app in the monorepo. How?
- Is Jenkins able to use Webpack to solve for this and build & deploy only specified apps or changed apps? Even if all of it is in a single repo?

This may be a simple case of not knowing what to search for, but federated modules and monorepos are also relatively new.

https://redd.it/lc6ovb
@r_devops

My first month of being a DevOps freelancer

Me sharing the story about my first month of being a freelance DevOps Engineer. Feel free to reach out if you are thinking about doing the same.

https://brennerm.github.io/posts/first-month-of-self-employment.html

https://redd.it/ld9eg6
@r_devops

Having trouble deploying SSIS from cloud to on prem

So I am new to devops and I have been playing around with trying to duplicate the existing deployment system that I built myself. I got the SSRS to deploy using a powershell script, however I can't seem to get SSIS deploy to work. I have setup my releases pipeline and my deployment group fine, however it seems that the ispac file needs to reside on the actual server I am deploying on? I have noticed that when I build the project in azure using an agent task, it creates the ispac file in the temporary working folder but the Deployment group job cannot seem to access that file. So I have tried copying the ispac file using the file copy to windows task, but it can't see my server's unc path. Any help would greatly be appreciated. Thank you.

https://redd.it/ld95hi
@r_devops

SFTP -> MySQL ETL Service

I have a task that requires grabbing customer csv files from a SFTP server, transforming it, and loading it into a MySQL table.

Looking for suggestions of services out there. Something like stitcherdata but I need to output into a MySQL table.

Not looking to custom code this, we currently do this but we are to the point where we'd like to offload this to a service where it is their core competency.

https://redd.it/ldhhuu
@r_devops

Beginner Question, Are there any useful tutorials on deploying simple web apps (that use both client and server) hosted on the Google app engine

I am completely new to the creation of a web apps, and only have a limited amount of experience making small programs in python and java on my local drive.

The webpage needs to pull in stock data from APIs, based on the users selection (keyed into a text box) perform a computation on it using a python script, and display the output of the computation on the webpage.

I am aware that I need client side and server side scripts, from what I have learned so far I need Javascript on the front end and Python on the back end, but thats as far as my knowledge goes, it sounds basic but I'm suffering from an information overload and wondering if someone could point towards some resources on make a web app that can be deployed on GAE for the above criteria?

Its small, its only going to be used by 1 or 2 people at a time, so the simplest solution with least overhead would be the best!


Again really sorry for the beginner question.

https://redd.it/ldihea
@r_devops

Managing health checks at scale

We used health checks to monitor cron jobs, but it didn't scale, as we had to manually register each job. So I adapted a script from the healthchecks.io maintainer to automatically register the job, and it's been working great.

The article: https://dev.to/15five/managing-health-checks-at-scale-4731

The script: https://gist.github.com/caleb15/1a817ef5e58e8a8caf65190cff33806e#file-healthcheck-sh

Enjoy!

https://redd.it/lddc1u
@r_devops

anyone here have experience with slalom build or simply being a devops engineer/consultant at a consulting firm? Trying to understand the pros and cons

hoping for some insight into slalom build, but otherwise just doing devops in a consulting firm, whether as an engineer or consultant

https://redd.it/ldpqnc
@r_devops

Kubernetes cluster diagram

Hi, I'm a system engineer junior, and I'm on my first big project with cloud and k8s. Nowadays I practice those on my local computer, or in the free tier.

I Haven't seen that big clusters, as our production cluster with a lot of namespaces and \~50 pods and services in each other namespace. I want to draw a diagram explained that cluster. I have a tool: draw.io.

​

My question is; Are there any tips and tricks or good practices to draw a huge cluster like this? Do I have to draw all different pods and services and deployments? Can anyone show me something like this?

https://redd.it/ld83z1
@r_devops

Flow to send mail when workitem is assigned

Hello i am trying to create a flow which will send a mail if workitem is assigned to any users. The mail will be sent to the one who created the work item or user which mail about the issue

https://redd.it/ld481u
@r_devops

How to create alerts in ELK

Hi there,

I am aware of x-pack edition of elastic stack comes with the alerting option ? Does the open source edition of the stack ELK provides the option for alerts ? If yes, how we configure alerts in the ELK stack ?

Thanks

https://redd.it/ld3lad
@r_devops

Alerts in ELK Stack

Hi there,

I am aware of x-pack edition of elastic stack comes with the alerting option ? Does the open source edition of the stack ELK provides the option for alerts ? If yes, how we configure alerts in the ELK stack ?

Thanks

https://redd.it/ld35gh
@r_devops

IaC Snippets - Your input would be amazing

We are beginning to provide IaC snippets for common resources like Docker Containers, S3 Buckets, and DynamoDB Tables in Commandeer.

https://docs.getcommandeer.com/blog/latest/introducing-iac-snippets-for-ansible-docker-compose-serverless-framework-and-terraform/

I'd appreciate any input you might have on any ways we can make this beneficial for your day to day work.

https://redd.it/ldydke
@r_devops

What are your indicators of a system in distress?

When looking at a system, what do you use in consideration to determine if it is in distress? Is it the heap usage? CPU usage?

https://redd.it/le41m4
@r_devops

Free alternative to Dynatrace Pure Path

Hi,

We use Dynatrace in our project for APM needs and i find the pure path feature really helpful to analyze API or service performance. I was wondering is there a free alternative to check for pure path which i can use to analyze my side projects. I can use Prometheus for basic application monitoring n alerting or micrometer.io to check for my application methods , but is there any open source product where i can view end to end flow n time taken for an api call

https://redd.it/le4xji
@r_devops

How can Stackoverflow make you a better developer

We all use SO on a daily basis. I’ve found that participating by asking and answering questions to be very effective for my own coding skills. I wrote a short article on why I think you should try it and improve your programming skills.

https://devopsian.net/posts/so-make-you-better-dev/

Would be glad to hear your opinions.

https://redd.it/le1dwz
@r_devops

How to connect front end to back end?

I want to do a project wherein I am using ML algorithm and train data and get a prediction. I want to take input from my html web page and give output on it. Possibly also a visualization. How to make this happen?

https://redd.it/le0tq3
@r_devops

Gathering interest in podcast or YT channel idea

My friend and I work on two different teams on the same software project (he's a Scrum Master, I'm a Dev Lead) and we've had some success at getting our organization to move toward adopting DevOps and Lean principles for software development.

Our organization is an enterprise IT company with a mix of projects and technologies that were acquired or developed in house. Our particular project has a spotlight on it, and we've been successful over the last year in helping our management become data aware.

We've started to work with other parts of our company to move them in that direction as well, and have learned a lot doing so.

We would like to disseminate our knowledge and thought that some kind of periodic podcast or video channel would be a great way to capture our experiences. Would anyone here find this helpful?

From lurking in this community for a while, it does seem as though the content is more focused on the technology while our idea is more about how to move the organization, so if there is a better place to ask, we'd love to know.

Anyway, looking forward to seeing your comments and ideas.

https://redd.it/ldzdxx
@r_devops

Automate Manual SQL runs

I recently started working with our DBAs to automate some of their workflows. One of the problems I've been tasked with is automating some manual SQL requests they run often. Anything outside of the normal migrations, like adding customer account data or bulk updating columns. Currently our DBAs run these manually but I would like to have a review / approval process before running along with syntax checking and output verification. Any suggestions for how to do this?

https://redd.it/ldyi02
@r_devops

Want to share Interview Preparation Courses

I have organized some of the best interview preparation courses like:

1. AlgoExpert
2. SystemsExpert
3. Epic React Pro by Kent C. Dodds
4. Grokking OOD
5. Grokking The Coding Interview
6. Coderust: Hacking The Coding Interview
7. Grokking Dynamic Programming Patterns
8. Grokking the System Design Interview
9. ZeroToMastery: Master the Coding Interview Big Tech (FAANG) Interviews
10. Gaurav Sen: System Design
11. TechSeries dev: AlgoPro, Tech Interview Pro
12. BackToBackSWE
13. CodeWithMosh
14. InterviewCake
15. InterviewCamp
16. Applied Course
17. InterviewEspresso
18. SimpleProgrammer

And some other courses. DM me if you are interested to have these courses.

https://redd.it/ldy45j
@r_devops

What DevOps KPIs do you track?

Hey folks. I am curious what are some key indicators do you track to have an understanding of how well your organization is doing with DevOps? That is if you could pick 3 metrics that would tell where you should focus and optimize your delivery pipelines, what would they be?

I would also appreciate any links to some tools that could help with such insights.

Cheers!

https://redd.it/lea2nd
@r_devops

How Can I Do Continous Deployment On My VPS With Docker?

I am trying to step up my devops chops by trying to implement a CI/CD (deployment) pipeline for my personal website.

On the CI side, I am working on implementing gitflow, automated testing, and pushing new Docker images on successful merge to master via Github Actions.

As far as the CD side, I am currently hosting my site on a Vultr VPS. I would like to set up a system that checks for a new Docker image for the site, and if one exists, it should pull it down and restart my website (probably via docker-compose) with the new Docker image. I could probably just write a cronjob that runs every few minutes and checks for a new image/redeploys but that seems inefficient and clunky.

I am aware that something like this could easily be implemented using AWS ECS/ECR but I think that would be overkill for my small site. Does there exist some tool that could do the "polling" for a new image and redeployment in a more streamlined way?

Any help/feedback would be appreciated.

https://redd.it/le9v8f
@r_devops