Some general questions about DBs and cloud

I'm looking for some insights into cloud management with DevOps culture in mind. I won't go into much detail, I just need some general information/resources that I can follow, about these topics:


1. When to use container services like Fargate, ACI, App Service? If the project isn't big enough, is it worth to migrate from more traditional approach (so VM instances with docker-compose running inside)?
2. Managed DBs - I totally get their advantages and I'm a huge fan. But they are expensive. How many instances should be deployed? Let's assume that I have 5 independent projects and each project has dev/staging/prod environments. Should I have 15 DB servers (instances) running? Or can I perhaps run one DB instance and serve dev/staging environments from there and keep prod instances seperate? Important: I mean database server instances, not databases.

I've been trying to find some info online but most docs don't go into that much detail. Could you give me some more insight on how to run this type of infra? Mind you, the projects are not big, the databases are 1-2 GB in size (dev/staging DBs much less than that). What approach would you choose and why?

https://redd.it/m3lotp
@r_devops

Where do you go for networking (the people kind)?

I tried to google it but "devops networking" returns results about networking between servers >_<

https://redd.it/m4b3bd
@r_devops

MySQL 5.6 -> postgres 13 ?

Do you guys know of any open source tools for replicating GCP MySQL to GCP Postgres.

I have a live MySQL db and I want to make a Postgres read replica

https://redd.it/m4dxcr
@r_devops

seeking app: wiki/Note-taking, cross-platform, code-friendly

What does everyone else use as a cross-platform, preferably cloud-stored, code-block friendly note-taking app?

I have been on MS OneNote (web edition) because it's free and does all the above except for code-block handling. I might just be accustomed to tools that see markdown-isms and implements them.
I don't want to run a wiki but the content I'm putting into this are very much like wiki content.

So yea, what's everyone else using for keeping their notes and knowledge in a portable place?

https://redd.it/m480lm
@r_devops

New job - confusion!

Hi

Bit of background. I am from a traditional network engineering background and recently started a role at a large company as a 'Devnetops' engineer. The role is primarily cloud vpn, expressroute/direct connects and load balancer deployments to allow clients to access services. In all honesty I don't see much Devops going on apart from a few scripts to speed up deployment of said resources, however I would like understand where I would be best place focusing my efforts to improve things or if it's even possible in .

The big problem I see currently is that most teams are silod (one team works with deploying cloud environment (network/security and servers), one is responsible for the applications the customers consume and we do the 'frontend' connectivity. How everything is done by the other teams I have no idea yet. My main focus is on what we can do in our team. A couple of the guys have a bunch of powershell scripts that are maintained in git that are used to deploy/modify the resources we are responsible for. These are great but there is some vague talk about moving to terraform as this would allow us to work across multiple cloud providers. The other talk is around using Jenkins pipelines.

The confusion I have is whether or not this approach is ideal or should even be pursued based on the nature of the tasks we carryout in our silod nature. (We have 100s of clients - do we just maintain vpn/lb IaC for these whilst every thing else is missing? Is it worth the effort of maintaining IaC for these particular things that might change regularly?). To me it almost makes sense to just expand upon the scripting and maybe have a web form that is used to execute tasks to deploy or modify. I guess I'm new in the role so maybe I am missing a bunch of context and things behind the scenes, but this is my initial thoughts.

As anyone any experience in a similar role that could maybe share some thoughts? As mentioned, this is all new to me, but I am very keen to take a learning path that will be beneficial to our operations and team and don't want to go down an avenue that will be wasted in my current role.

https://redd.it/m438gm
@r_devops

Any good ERD (entity relationship diagram) tool suggestions? Ie. Schemaspy?

Our team used Schemaspy spy years before but want to integrate something on our new system. Wanted to see if there are any new tools on the market worth considering. For context we want to visualize the connections in our DB schema.

Google search returned a smattering but nothing seemed to stand out.

https://redd.it/m42art
@r_devops

Github action failing

I'm trying to implement a pipeline for an app of mine but one command keeps failing when I run it in the pipeline.

https://github.com/tonsV2/urbantz/runs/2102059359?checksuitefocus=true

When I run the helmfile command locally it exits with 0. In the pipeline it actually manage to deploy the chart but still returns 1.

Any clue about what I'm doing wrong?

https://redd.it/m44ww9
@r_devops

DevOps on Linux Terminal

I am trying to groom a community of students with only Linux terminal devices. I am new to DevOps, but been programming for about a decade (Nothing intense, mostly vanilla).
What tools for a DevOps pipeline can one work with entirely on Linux Terminal?

### What I currently offer them:
- Linux commands (basics and intermediary)*
- Neovim
- Git
- Github (gh)
- Mariadb/pgsql (sql)
- Docker

### What I think should be Added (I have little to no experience with some of the tools):
- Kubernetes basics (kubectl)
- Ansible/Terraform/Some other IAC basics (I don't know which plays better with the Terminal)
- AWS CLI basics*
- GCloud CLI basics
- Azure CLI basics
- Digital Ocean CLI basics

**What do you think? What will you add or remove? I'll really like thoughts on IAC of choice for Linux terminal.**

(*Cloud CLI basics mean like VM and container provisioning)

https://redd.it/m44sw4
@r_devops

Prometheus Metrics using CLI

Hi there,

I have a test case, wherein I have to deploy Prometheus to capture the pods and node-specific metrics, such as metrics exposes by node exporter and Kube-state-metrics? The servers are very isolated with no connectivity to the web UI or any dashboard? Need some help to understand, how can we get these metrics in JSON or any other format using any CLI tool? Because of the environment restriction of no access to the web UI or dashboards, cannot deploy Grafana? Your suggestions will be a huge help.


Thanks,

https://redd.it/m4lb3x
@r_devops

Looking for CD tool that tracks git commit

Hi, I’m looking for a CD tool that can track if a git commit reaches a certain stage. Is this something commonly offered or am I asking for too much? 🙏

https://redd.it/m41xx2
@r_devops

Secure Mailserver

I plan to create an absolutely secure mail server. Is it enough to not connect it to the internet?

https://redd.it/m488ag
@r_devops

RN CI/CD

As part of our startup, we are building 3 RN apps and I want your recommendations for a suitable (not expensive) CI/CD solutions.
Any Ideas?

https://redd.it/m408ax
@r_devops

INTERVIEW Q

Hello Guys,

I want to create one file that file name must be same as username of the system by Ansible in 10 different System.

https://redd.it/m44z5j
@r_devops

Battle-tested way to configure a Jenkins server on AWS using IaC/CaC?

Hi, I'm working on a project with mission critical aspects where we need to deliver changes to APIs, web apps a couple times a day. I have a task to have everything done by code. I'm trying to decide on a good practice to deploy the Jenkins server on AWS. Also, I'm not sure if the server has to be a highly available server or not, on what factors is that decided?

Any recommendation is appreciated. Thanks!

https://redd.it/m5207h
@r_devops

How can I change Jfrog Artifactory mimetypes.xml file if I use Artifactory Cloud

Didn't find a way to change it since I don't see a way to access the file on the backend

https://redd.it/m50lh4
@r_devops

Preview environments per Pull Request using AWS CDK and Github Actions

Hello all, I published my first tech article explaining the steps to create your own isolated environments in your Github Pull Request using the awesome AWS CDK.

Here is the link : https://dev.to/jgoux/preview-environments-per-pull-request-using-aws-cdk-and-github-actions-bfi

&#x200B;

It was a great experience writing it. :)

https://redd.it/m4zyji
@r_devops

Question regarding some books on humble bundle

Hello guys. I'm studying to get on to devops and there are some books on humble bundle, particularly on git, bash, linux and python, that caught my attention. Are these any good? Are they outdated?

https://www.humblebundle.com/books/pocket-reference-guides-oreilly-books?hmb_source=humble_home&hmb_medium=product_tile&hmb_campaign=mosaic_section_2_layout_index_2_layout_type_twos_tile_index_2_c_pocketreferenceguidesoreilly_bookbundle

Thanks for the help.

https://redd.it/m4wryq
@r_devops

Software download portal

A little gig on the side resulted in me writing some software for a few companies. This has now turned into something that is more seriously used and downloaded within a few companies and I find myself needing some sort of download portal where logged in users can come to download whichever version they want.

I've looked at offerings from JFrog, Gitlab, Github, and even some WordPress plug-ins but I have no idea which to use. Github/lab both seem to be focused on being source code repositories that I could force to act like a download portal. JFrog has support for managing distributions, although it seems to be tied to some CI/CD, which is more than I want.

I know this isn't exactly DevOps but this was the best sub I could think to post this to.

https://redd.it/m4r33j
@r_devops

Monitor hardware usage from your mobile phone

We have developed an open-source tool to monitor hardware usage from your mobile phone.

The app shows two views for each metric, summary and detail views. Summary views would help you to quickly scan and understand your hardware usages. You can use detail views for more in-depth analysis.

For example, our CPU summary view shows the mean utilization of all cores and the detail view shows the utilization of each core.

Github : **https://github.com/lab-ml/labml**

Writeup: **https://github.com/lab-ml/labml/blob/master/guides/hardware\_monitoring.md**

Samples:

Live Session: **https://app.labml.ai/session/dc3645d86d0111ebae8706496fd25a7e**

Stopped Session: **https://app.labml.ai/session/41b0f9427cc711ebb12e0242ac1c0002**

Supports the following,

1. CPU Utilization
2. Memory
3. Hard Disk
4. GPU Utilization
5. GPU Temperature
6. GPU Power
7. GPU Memory
8. Network

We love to hear your feedback and suggestions. Thank you all and I appreciate the support.

https://redd.it/m4ojkz
@r_devops

How to automate/synchronize large data in two servers?

I need to keep changes to a ecommerce goods up to date between two environment called Production and Development. The ecommerce goods list on Production is huge and does not change frequently, but those changes take up a lot of time for someone to add,update or remove from the Development Admin panel.
Can somebody describe me a way so that changes made on production is also reflected on development server? We can assume that there is a unique product_id for each product matching in both server.
Thank you!

https://redd.it/m4ni7q
@r_devops