I just made the first step to my goal of becoming an AWS Certified DevOps Engineer!

I passed my Cloud Practitioner exam!! I've been dabbling in AWS for years now and I love how it feels to make those big, impactful changes on a system. Right now I'm a Software Engineer and I've never gotten an official certification or a college degree, so taking this first step has made me happy beyond belief.

My next step is AWS Developer Associate, so if anyone has any words of wisdom for me, let me know.

Anyway, I just wanted to share my successes with everyone cause I couldn't hold it in any longer.

Thanks!

https://redd.it/du3tum
@r_devops

Version control for mono-repo with microservices

Hey guys,

I have been trying to finalize the **version control theory for the new repository structure** that I am working on which has microservices(*currently 3 but can be more*). **The decision that has been taken collectively is to go ahead with MONO-repos**. We can debate about pros and cons of mono-repo vs multi-repo but clearly, the opinions are very much divided if you check the internet.

No, lets talk about how we can create versioning control for End to end product, each microservice and how to maintain the codebase so that in case point in time, we know which microservice was at which version for a global version of product. Let me put an example below:

>Suppose for product ABC, we have 3 microservices. At beginning, ABC and all 3 microservices are at 0.0.0 (as per semantic versioning scheme). Now, we can't control the order in which we update each microservice but what SHOULD be our strategy to bump up the **MAJOR.MINOR.PATCH** part of our product as a whole.

It will also be good to **tag GIT** (source repo) along the process so that we can fetch the code from GIT in case of bugs. And **what happens when we fix them**, precisely, how to update the overall version of product?

Additionally, **how do we handle inter-dependency amongst microservices**. There may not be all microservices that are dependent on each other, but surely there will be few. How do we define this dependency part in our repo. It can be defined in each parent folder of each microservice or how?

>I have researched on google and learnt about Lerna but it seems good fit for webservices based projects. Have read that google and facebook both are using monorepo so I reckon they must be using some tools to achieve this. Any clues about them?

How are you handling this kind of requirement at your workplace? I am sure everyone must be having/ or had this pain while migrating to microservices based deployment from monolithic.

https://redd.it/dtum27
@r_devops

Do you know any server admin panel tool/service with devops features ?

Is there any service, where I can add my own server and run/schedule simple administration commands, git operations, docker, run builds, manage nginx, see stats and similar stuff ? I am thinking about writing my own simple script for that, at least project + git + docker management.

https://redd.it/dtth0u
@r_devops

Cloud migrating production in 18 hours without a plan, and how it made me a better programmer ;)

We had a b2b webapp product in cloud_provider_a which started having trouble serving requests, timing out.

My team (supporting another product in cloud_provider_b) was tasked with setting up a duplicate of prod in cloud_provider_b. I can't even remember why mgmt thought that would help.

By the end of the day, by hook or by crook the call was made to switch Production traffic into a newly made stack in a different cloud than where that application was currently hosted. Despite protest from the engineering and QA teams.

Its all a blur now. Things went horribly wrong for two days. On the third day my team (with no prior knowledge of how this product works) found that the docker containers running the app had an nginx config with a low worker_connections setting.

We changed that one line and the app is back up. But the cost has been high, our customers had a far higher level of disruption these 3 days. Our engineers feel burnt out and disrespected, and our QA teams are appalled.

AMA I guess

https://redd.it/dtoqti
@r_devops

New to Bit Bucket Pipelines -Why can't I read my build logs?

I can access them however every instance of the letter `c` in the log is replaced with `$en$en$en$encryption_keyryption_keyryption_keyryption_key`


Example:
>To see the full sta$en$en$en$encryption_keyryption_keyryption_keyryption_keyk tra$en$en$en$encryption_keyryption_keyryption_keyryption_keye of the errors,

Translates to:

>To see the full stack trace of the errors,

Anyone have any ideas how I can make it readable?

https://redd.it/dt1ah7
@r_devops

Reality of software developers having no guardrails

My company is at a crucial point where the software development side of the business is fed up over the engineering side not providing more self-services platform (compute, networking) and infrastructure (databases, message queues, etc) causing efforts to take significantly longer and don’t invoke “developer joy”. Everything becomes a ticket with the over-utilized, engineering support centers that have partly automated processes, who feel they aren’t brought in on new initiatives to understand priorities or account for capacity. Lastly, there is always complaints when the business asks for anything seen as “undue” process: change management, security, SOX compliance, etc; like there is no justification for any of these things.

Because of this, the software development teams are complaining to leadership that AWS is the only way to solve everything. Comments about having self-service PaaS/IaaS and being able to turn up resources without capacity planning delays have some weight, however most of our software developers are junior without much experience around system administration or operating production services. Most dev managers give into whatever they or their teams think they need to solve problems individually with little thought to broader business or platform needs such that every service looks and operates differently.

Given all of this, I wonder what others in a DevOps / Platform engineering role have done when faced with this culture crisis. Where have you seen guardrails be necessary between software developers and build/release/deliver processes? How much should a software developer know beyond pure product development; networking, OS, automation, packaging, etc?

https://redd.it/du6olo
@r_devops

What startups/new products excite you most?

I just realized that Hashicorp is 7 years old now, Jfrog and Sonatype 11 years, Ansible itself is now a part of RedHat. Many of these startups themselves are now very established organizations.

Just wondering what "new startups" are really revolutionizing DevOps today? Which ones excite you most?

https://redd.it/du6q2n
@r_devops

DevOps Question - DEADLINE IMMINENT

I know nothing about DevOps, so I need your help! Please take pity and give me your wisdom.

I am helping support a program (don't worry, my job is not tech related, it is writing related) and the question is about how to improve the company's DevSecOps pipeline. They are having difficulty with automation; they are experiencing intermittent blackouts and run time execution issues.

Their environment currently supports a hybrid cloud and utilizes methodology such as Agile Development and CI/CD. They want to use Free and Open Source Software (FOSS) to improve their DevOps.

Currently they use Redmine (manage), Gitlab (store), Jenkins/Sonarqube (build/test), Threadfix/Fortify (secure), and Pivotal/AWS (deploy).

What recommendations would you make to improve their DevOps? If you need more information, please just ask specifically and I will answer it if I can. Some of the information is confidential.

https://redd.it/dszb40
@r_devops

ALERT: New powerful Trojan malware is being sold in the dark web
https://www.reddit.com/r/Browser_Isolation/comments/dswkz3/alert_new_powerful_trojan_malware_is_being_sold/

https://redd.it/duass6
@r_devops

How does the browser render a webpage?

Here is the last video in the video series of the most frequently asked question in any DevOps/SRE interviews, "What happens when you enter [google.com](https://google.com) and hit enter in your browser".

Video link: [https://www.youtube.com/watch?v=bhoMvrjRmWE](https://www.youtube.com/watch?v=bhoMvrjRmWE)

Please do share your opinions on the video. The DevOps community has been really supportive of my initiative and would love to have topic suggestions for future videos.

Please do like the video and subscribe to the channel if you enjoyed the content.

https://redd.it/dubleq
@r_devops

How to choose the right DevOps Solution Provider?

What are the criteria we need to consider before choosing the DevOps firms.

https://redd.it/dsvyas
@r_devops

Am I overcomplicating things? Gitlab-ci -> ansible -> docker-compose for deployment

Hi guys,

This might be a little bit better suited for /r/homelab as its more about learning devops at home rather than at work.

I currently have 20 odd docker services (media servers, torrent client, vpn etc) running on an unraid machine and I want to change it so i'm following more of a gitops/iac approach.

I've just learned about the joys of docker-compose and want to use it to configure all my containers, keeping the compose scripts in source control so I can keep track of them rather than relying on unraid.
I also want to have a staging environment so I can test updates before putting it into prod (which my flatmates will use). Lastly, a big goal is to use continuous deployment platforms to automate the process (I like gitlab as its what we use at uni).

My current plan is this:

- Set up a gitlab-ce server with a repository containing all the docker-compose scripts for each service (or collection of closely related services like sonarr+deluge+emby)
- Spin up two debian based virtual machines - one called Prod and the other called Staging
- When a MR in gitlab is merged, use gitlab-ci to run the _docker-compose up_ commands on the Staging server.
- do something similar for Prod except make it manually pushed.
- I was thinking of using ansible for the remote deployment to the VMs as it has what seems to be [docker support](https://docs.ansible.com/ansible/2.6/modules/docker_service_module.html).

Is my idea too convoluted? This feels like alot of steps and I was wondering if there is any better (maybe simpler) way.

I'm currently an undergrad so haven't had much experience seeing how its done in the industry - words like Kubernetes and Rancher get thrown around lots but I feel that they would be too overkill for my needs.

Some thoughts would be appreciated!

https://redd.it/dsej69
@r_devops

[REQUEST] DevOps project tutorials

I learnt the basics of Docker and Ansible and now I want to create a project, so if you guys have some link of videos where the tutor made some live project then please share it.
Project can be related to Docker, Ansible and other DevOps tools.
Thank you.

https://redd.it/dudkn3
@r_devops

Fed up with theoretical docker tutorials? check this out

If you are already fed up with theoretical docker tutorials about basic concepts and commands, I have created a more hands-on, practical guide of **how to actually apply these concepts in real life development/deployment scenarios**.

👉🏼 Part 1: [https://youtu.be/YdKUkDe22RA](https://youtu.be/YdKUkDe22RA)

👉🏼 Part 2: [https://youtu.be/6YisG2GcXaw](https://youtu.be/6YisG2GcXaw)

..and next parts in the making.

Please check it out and let me know what you think 🤓

https://redd.it/dufxuo
@r_devops

Sysadmin transitioning into DevOps role. Been working on TFS and setting up builds releases. I'm starting to understand how code, testing, build, release, monitoring all work together. Infrastructure as code is what I'm learning currently, its been jaw dropping experience finding it's potential.

Are there any good articles or blogs or sites or specific skillset that you which you looked at before delving into this world if DevOps. I'm testing out Terraform to create a web and app farm of azure windows vms, will demo it to my team very soon.

https://redd.it/dugbz5
@r_devops

Has anyone here used Overops?

Talked to a rep a few days ago, though I wasn't sure if it was worth the cost.

We currently have a hodge podge of tools that we use for testing and QA, was wondering if others have some experience with it or any other competitor?

https://redd.it/dugvix
@r_devops

Career Perspective in Cloud: Kubernetes v.s. Cloud Application

Hi all,

I find Kubernetes is discussed many times in this subreddit so I think this might be a good place for my question. If not, please let me know.

I am a junior software engineer (\~ 2 years) and I am currently looking into new opportunities in my company. I am particularly interested in two areas: Kubernetes (all levels of GKE stacks) and Cloud Application (e.g., using cloud in health care or finance industry, mostly develop cloud services and APIs for ML models and/or for external clients). I hope to know what are the career perspectives in these two areas (since I am not familiar with Cloud) ? E.g., which will help me develop more valuable skillset in terms of growth in future?

Thank you!

https://redd.it/dulmt0
@r_devops

Vue.js CI/CD pipeline

I'm looking into figuring out a good CI/CD pipeline for a Vue.js application that is hosted on AWS S3. This is greenfield sorta, I am already using Jenkins and Spinnaker for other parts of the application and would like not to introduce new tools unless very needed.

​

Currently it is planned deployed to [dashboard.example.com](https://dashboard.example.com) and [dashboard.example.dev](https://dashboard.example.dev) both on S3 buckets. I'm using a CDN (cloudflare) as well for the \`.com\`

​

My only idea currently is having two different Jenkins jobs that use the AWS cli to first build on the dev ENV then build the production version once testing is complete.

​

What are my options? I'd like some way of manually gating it so that it doesn't deploy straight to production but instead goes to dev then once I approve it, it would then go to prod.

https://redd.it/duh4nh
@r_devops

What method(s) does everyone use to stay ahead of the curve in engineering?

Reddit? Job postings?

https://redd.it/dubnl0
@r_devops

Cross region secrets replication in aws?

How do you guys handle secrets across regions, especially for DR consideration? Do you treat each each region as fully independent with its own secrets?

https://redd.it/dufd3h
@r_devops