How to deploy efficiently

Hi everyone, i've just build a multivendor ecommerce webapp using mern stack its a giant project

Now i want to deploy this webapp on digital ocean

Now i just want to know how do i deploy like deploy directly on digital ocean using nginx
Or
Should i use docker/kubernetes then after containerization go for digital ocean

Or

If you know a better way to deploy im open to suggestions

-should i use one server or two ?

This webapp is going to get around 5000-10000
Per day visits

https://redd.it/oin71c
@r_devops

10 Python modules to simplify your DevOps journey

I was researching this topic(Python modules for DevOps), and as usual, there is a lot of material available on the internet, but they are all over the place. So here is my version; I have put together a list of 10 Python modules, some of which I used frequently and some case-by-case basis. As this is my version :-) so it may not cover all the modules that other DevOps engineers use daily. Would you mind letting me know if there is any module I am missing from the list in the comment section?

https://devopslearning.medium.com/10-python-modules-to-simplify-your-devops-journey-3641b7398b11

https://redd.it/ojk61p
@r_devops

Runbook software

So I work for a small company and I’ve been asked to look into runbook software that we could use. However, most stuff I find is meant for automation. What the business wants is something where they can keep the individual steps to take and it should allow them to log each manual walkthrough - the person performing the task should be able to tick each step as completed as they go through the list.
I’m really lost in this, are there any simple tools (or Jira/Confluence integrations) that would allow you to create such checklists to then tick off and save each time?

https://redd.it/oimt4d
@r_devops

How do you guys securely document your machines?

I've been running into issues working with my machines where it feels like everything lives in the heads of a few people. Any time I need to ssh into an instance in AWS I have to wait for someone to reply with the IP address, even though my credentials are already whitelisted in that instance which becomes annoying. On top of that, there's been a lot of issues with me thinking things are networked one way when they're actually networked another.

Have you all created any single source of truths like a diagram of all your machines with a list of things like their IP addresses/What credentials are needed to access that you stored securely so it doesn't just live in people's heads?

https://redd.it/ojo0h8
@r_devops

Ci/CD stages

I have read several articles and wanted to make sure my understanding is correct wrt ci/cd stages.

Stage 1 : Source where the pipeline picks up code from the commit which triggered the build.

Stage 2 : Build - where the code is built into a war file / docker image etc

Stage 3 : Test - where the compiled artifact is tested using some sort of unit tests.

Stage 4 : Release - where once the above stage is successful the build artifact is deployed to the environment.

The same stages would then repeat in the higher environment using the same commit I'd code/ or be completely independent and only trigger once the changes are merged into master.

https://redd.it/ojoxat
@r_devops

Automated Change Management for Oracle EBS

Has anyone successfully completed 'continuous deployment/delivery' of patches (customization, standard) to Oracle EBS 12.x without using Oracle AMS?

If yes, what were/are the challenges? Did you had to revamp the automation a lot for changes in underlying Oracle tools, standards?

https://redd.it/ojqlsm
@r_devops

Getting started in a DevOps / WD. what do I search for? What was your first job?

I have a fair understanding of throughout the process of planning to completion ( not perfect at all), what is a good entry position/ what was your first job?

Should I search for “ media” as a category? Or what narrows it down to websites ?

https://redd.it/ojq1c8
@r_devops

I'm stuck career-wise and I could use some advice.

I'm a sysadmin of 4 years, and this is my first job out of college. I majored in CS and decided I wanted to be more on the operations side of things, and just use my coding knowledge for automation and to get a leg up.

Now I'm at a place where I want to move into Linux Admin/DevOps/SRE/Cloud (it seems that the entire field is moving there anyway), but I don't have the professional dev experience to do so. Like, sure I can just practice a language or something in my free time, but the killer is my lack of enterprise coding experience. I have nothing to put on a resume, and to be honest I feel like I'd be totally stumped in a dev interview.

I definitely don't want to take a gigantic pay cut and become a junior dev/intern, so I just feel completely stuck and helpless at the moment. Any advice is appriciated.

https://redd.it/ojs8jw
@r_devops

Datadog ECS network monitoring

I’ve recently deployed Datadog agents as an [ECS daemon service](https://docs.datadoghq.com/agent/docker/), and it works great, exposing almost all the metrics we need. There are two things I can’t figure out from the docs:

1. How to enable the [Network](https://docs.datadoghq.com/agent/docker/) integration. The docs say it’s on by default but I’m not seeing them come through

2. Enable ENA monitoring. Our containers are using AWSVPC networking, so they’re being allocated ENAs, which are handling almost/all of our traffic. Based on [this PR](https://github.com/DataDog/integrations-core/pull/8331) it seems like there is a config collect_aws_ena_metrics in the network conf.yaml, but that doesn’t seem configurable via Docker, and the comment seems to say it only applies to hosts

We could potentially deploy both ECS and host-based agents, but there is some duplication and additional complexity there that would ideally be avoided.

Thanks!

https://redd.it/ojs9wp
@r_devops

PagerDuty Required?

I am currently in a devops role that requires me to be on PagerDuty overnight and on weekends. If I want to continue to be a devops engineer, should I expect this role to always require me to be on PagerDuty? Do all companies expect this or do they understand that is what SREs are for

View Poll

https://redd.it/ojuq7v
@r_devops

I developed a tool that allows you to perform automated security audits and code reviews cloud applications by showing vulnerabilities in an easy-to-follow architectural pathway code.

So, the title speaks for itself.

I've been in permanent contact with DevOps Engineers due to my field of work and they've been finding my tool extremely helpful. In a simple manner, CodeShield (name of my tool) performs automated security audits and code reviews cloud applications by showing vulnerabilities in an easy-to-follow architectural pathway code.

If you're experienced with AWS Cloud-Native Apps, I'm pretty sure you might be interested in the working features it offers you.

The early adopters have been finding it tremendously useful and I could not be more excited for the next phase - consolidation.

If I caught your curiosity, feel free to visit Codeshield.io to freely run a test scan on your code and let me know how was your experience doing so.


Would love to hear your feedback!

https://redd.it/ojjmr6
@r_devops

AWS RDS

Hey guys,
I am a DevOps at a data company and deal mainly today with the CI/CD pipelines of the company, writing infra as code and get the infra of the company to a better state.

We use Postgres for new services which are small and run on as an RDS instance.

The company started out at the beginning with a main database in MySQL which is also an RDS instance. However this instance is hard at work, since it records many events and data. After around 2-3 years of activity it reached 1TB of storage need. It has now been upgraded to scale to 1.5TB as a lifeline.

From my point of view it seems like this might be a problem? I mean, pricing wise it does anybody know if an RDS with a bigger storage is priced differently than having an EC2 with the DB and a big EBS attached? Would this be better at large storages deployments?

In addition, how would you approach such a problem? Clean up events from the db which are less relevant for today into a cheaper storage solution and ETL them somehow for querying purposes?

I have less experience working with such dataset sizes so looking for some guidance

Thx for replying 🤩☺️

https://redd.it/ojwnlk
@r_devops

Devops Linux course suggestion

Hi Guys,


I work on AWS and python. Currently on a roadmap to become a DevOps Engineer. I know linux basics and wanted to know much Linux knowledge is essential for a DevOps Engineer.


I lack at networking side. Please suggest some playlists on youtube or paid courses for the same is also ok.


Thanks

https://redd.it/ojxgxo
@r_devops

Recommendation for a monitoring tool

At our company, we've been using new relic from the start. We kept on getting good deals and it was working pretty good, starting from august 2021 the plans have changed and the cost is too much for the usage. Please suggest APM tools. I'm aware of datadog, but not sure if it's better/cheaper than newrelic.

View Poll

https://redd.it/ojw7ij
@r_devops

Advice on how to list down happy paths and negative paths for test cases in Azure DevOps?

Hi Everyone!

In our current setup, we have concerns on how test cases are being added in Azure DevOps. Right now, the test cases are more leading towards a "happy path", which potentially misses out on other test cases.

One general example of a "happy path" in our case is that it follows a step-by-step procedure that satisfies the acceptance criteria of a product backlog item without leading towards an error.

Do you have any suggestions or thoughts how test cases are being segregated and list down in Azure DevOps to cover not only the "happy path" but also the "negative path"?

Thanks!

https://redd.it/ojz99m
@r_devops

Sonarqube community edition

Hi guys. Does anyone here use Sonarqube community edition? Is dev or enterprise edition worth it in your opinion?

https://redd.it/ojztpv
@r_devops

Configuration as code

We are building a microservices project and need to upgrade and create automated release notes. What si the best practices.

I am considering a general database for dev and test environment to hold all secrets and configurations and do a diff between them at every release to ease the process.

I would have to have ideas

https://redd.it/ok03s5
@r_devops

Still using Docker Hub? you can now publish images to GitHub Packages container registry

Hi folks 👋

I guess that like a lot of you, I've been pushing my Docker images to Docker Hub, which has been and still is a good registry.

Though, if you've been following the open source ecosystem development recently, then GitHub Actions and with it GitHub Packages registry is now being more widely adopted.

I wrote up a blog article on how to manage your Node.js Docker images in GitHub Packages using GitHub Actions, which includes building and publishing them to the GitHub packages registry: https://snyk.io/blog/managing-node-js-docker-images-in-github-packages-using-github-actions/

https://redd.it/ok14tp
@r_devops

Cloud IaaS with DevOps pipeline

How do you do your devops pipelines with IaaS?

Speaking based on Azure. I do have ARM templates which declaratively describe desired infrastructure and its configuration. Then I'm deploying applications to infrastructure (whether it is PaaS service like App Service or Azure Kubernetes Service doesn't really matter).

At the beginning - in the simpler cases - I had an approach to create a single devops pipeline which firstly applies ARM templates and then deploys application. The drawback is that even a very simple application change results in rerunning ARM template and with a little bit more complex infra it can take some time even when infra (ARM) didn't change at all.

With the k8s and microservices it makes even less sense to apply ARM template with each microservice deployment.

So right now I think it's probably the best to have 2 separate pipelines:

1. Pipeline for infrastructure - applies ARM templates, triggered only when infra was really changed
2. Pipeline for application code - doesn't touch infra at all. Just deploys application/specific microservice.

In some cases deploying new version of application might need also change in infra (new component like queue, redis, whatever) but I think those are rare cases and then pipelines will just need to be run in correct order.

Any thoughts based on your experience?

https://redd.it/ok1bss
@r_devops

Deploy docker-compose from Github Action to remote server

I want to be able to deploy the latest docker-compose from Github Actions to a remote QA server that is accessible through SSH. One option I can think of is to get the file from git into the remote server and do docker-compose up manually. Are there any standard options available?

https://redd.it/ok0zxh
@r_devops

Install specific version of a package

I have a pretty simple manifest for packages that needs to be installed. It has an array of package names, and then ensures they're installed:

$basicpackagelist = 'p7zip-full','unzip','python3','tzdata','make','build-essential',

exec { 'apt-update':
command => '/usr/bin/apt-get update',
}

Exec'apt-update' -> Package <| |>
package { $basicpackagelist:ensure => 'installed'}

Thing is, some packages need to be installed on a specific version.

In that same manifest, is it possible to create some sort of dictionary that would specify the version that the package has to be?

Thanks ahead!

https://redd.it/ok0ufp
@r_devops