What do you think a Cloud/DevOps Architect needs to master?

As the title says, in your opinion what are the skills and knowledge to become a good Cloud/DevOps Architect. Both hard and soft skills

https://redd.it/oxo3ne
@r_devops

Ansible - Create a role that includes other roles

# SOLVED:


In `meta/main.yml` I can just have the following:

---
dependencies:
- role: role1
- role: role2


_______________________

I have organized all my playbooks into roles. Now that I have all the roles, I'm trying to create a new role that would include all the other roles.

In Ansible, is it possible to create a role that just calls other roles? If so, is it possible to do it as a list, like in a playbook:

---
- hosts: webservers
roles:
- role1
- role2
- role3

Thanks ahead.

https://redd.it/oxp1u8
@r_devops

Alerts Based on Dashboard



Hello Community,

I need some guidance on setting up the alerts, we have the 2 replicas of an application running in a namespace for which I need to set up alerts for the following conditions met,

At 60% threshold, a warning should be triggered

At 75% threshold, an high severity should be triggered

Please note we are fine with using Grafana alerting system, and I understand we need to first create a dashboard to set up alerts in Grafana. What is the query to create the dashboards for a specific pod and namespace cpu and memory utilization?

Thanks,

https://redd.it/oxnrxi
@r_devops

Dev to Devops with concerns

Peers,

I am interested in moving to devops team from the software developer side. I pioneered the deployment at my company at the request of the director of release management / devops. Whom doesn't know how truly to build a deployment pipeline let alone coordinate infrastructure as code. I was solicited to join the team. The problem is - this team works crazy hours. So I know I do not want to participate in deployments multiple nights a week which is overtime hours without the overtime pay.

The question to those of you in here that are purely devops/deployment folks. Is it normal practice to work most evenings every week. I'm taking minimum 48 hour weeks on salary? And yes - there is more technical debt than I can count which presents the need to deploy after hours, but I imagine there would be some comp time or rolling shift schedule to prevent the whole team (< 5 people) to work guaranteed overtime.

https://redd.it/oxadmm
@r_devops

Application settings?

A quick poll on how you're storing and dealing with application settings.

We're mostly rendering and templating them out from yaml to applicationsettings.json with ansible.

Not crazy about this approach and would like to move towards consul/vault.

https://redd.it/oxsgoz
@r_devops

Transitioning from AWS to Azure

Hey there. I’ve been doing devops for the past couple of years but focused only on AWS. Now I accepted a new role but it is using Azure. I was using OSX and terminal to install and run ansible, terraform, and other tools. Now I am on a windows 10 laptop and not sure what the equivalent setup should be. I haven’t used windows to develop in forever. Does anyone have any guides or recommendations for someone like me who is making this transition? How is your Windows environment set up? I’d like it to be as close to OSX as possible.

https://redd.it/ox58e7
@r_devops

Site reliability Engineer(SRE) @Apple, Bangalore

I have upcoming interview for SRE @Apple, Bangalore. However, I had few questions and if anyone could suggest regarding them, it would be awesome

1. How much increase in compensation one can expect?

2. What is the break up of the compensation one can expect(Base? Stocks? Bonus?)

3. How good is role change/transition process @Apple. I am aiming to transition to SDE-2 in 1-2 years at Amazon. I don't mind if it takes a bit more time at Apple due to new company. What is the scope for time change at Apple

4. What are the chances to change teams? Specifically, chances to move to a US team from India

5. What questions can I expect for the interview?

I am currently L5 System Development Engineer @Amazon

YOE - 8


#software #engineering #apple #amazon #sreinterview #sre #systemdev

https://redd.it/ox19bj
@r_devops

Moving From a Full-Stack to DevOps Position, what can I expect?

Currently considering a very good offer for a DevOps Position from a Big Corporation. Always considered a DevOps position to be more of a noncoding role, but my friend, who is a DevOps dev apparently codes all the time. I am 27 and I have alot of experience under my belt as a front-end and back-end dev already.

&#x200B;

I am just wondering, what should I expect when switching over from Full-Stack to DevOps? I enjoy coding and algorithms. I always end up doing a leetcode problem every morning before I start my workday as a sort of ritual. I am hoping the programming aspect of my job will not disappear when I start.

https://redd.it/oxx39e
@r_devops

Do you have to go through user-support roles (sysadmin) to get into Cloud Engineer roles

Hello Guys,

Background: 1st Line/2nd Line IT guy for O365 and Windows 10 etc. for the past 3 years looking to grow career over the coming years. Interested in Azure/Cloud/Powershell/Automation etc.

Supporting users in a traditional IT role with on prem servers or Intune is something which doesn't pay as much and isnt as cool or sexy (at least to me) as being a Cloud Engineer in Azure/AWS setting up servers and apps in servers, devips stuff etc.
Actually the pay is probably 2 times the pay for traditional IT here in the UK

Is it recommended to first be a system admin in a user support role before becoming Cloud engineer in Azure/AWS GCP, basically what I described above? Have any of you done that on your journey?

https://redd.it/oxybrb
@r_devops

Full suite comparison: BitBucket vs Gitlab vs Github?

Hi, so I'm about to start a new web application project and have some years of experience in Fullstack with PHP, Node and Python.
At my previous jobs, I've worked with all three of them, Github, Gitlab and Bitbucket and was wondering which one you suggest and like more, regarding issue tracking, hosting the codebase, CI/CD/Pipelines, Wiki and so on and so forth.

I'm curious what your experiences are and which one you would pick for starting a new startup company with the goal to build enterprise software and scale to a team of 50 one day? (I know, big dreams)

https://redd.it/oy06no
@r_devops

Career growth as a DevOps

What are some of the career growth opportunities as a DevOps Engineer?
What are the expectations of those roles?

https://redd.it/oy1570
@r_devops

Pipeline Orchestration Tool

I'm searching for a tool, or set of tools, to support automating deployment processes for our staging and prod environments. We are not ready for CD (probably never will be) so that's not on the table, but we do have decent CI. Essentially though, this tool would look similar to a CI/CD frontend where various pipeline stages are shown and the user can easily monitor the progress and logs of each task. Each task is basically a script that submits an http request, executes a database query, or executes a Salt master command (yes we use Salt stack I know it's not great). The plan is to provision all of these resources using IaC as much as we can.

In addition, some of the tasks we will perform out of band of a deployment because something went wrong with the deployment or we need regenerate data in our read caches; stuff like that. We exclusively use AWS so something that's supported there would be ideal due to the ease of integrating secret fetching and vpc endpoints, etc, although that's not a hard requirement. Most of these ad-hoc tasks do require some custom input parameters, so having a UI form would be ideal.

The best options right now appear to be AWS Stepfunctions and maybe AWS EMR. I've been looking into stepfunctions quite a bit, and it does appear to support mostly what we want, but it doesn't have a configurable form UI generator (the inputs are just a textbox in json format). The logging in stepfunctions is also a little quirky because there's no easy way to drill down into the logs (afaik). I know that we can build UIs that drive the stepfunctions, but I'm wondering if there's something that already fits our use case.

https://redd.it/oy0l1v
@r_devops

How would the ideal infrastructure based repository look like at a startup

Working on building out the cloud based infrastructure at a startup but I am not used to having no structure at all. How would you recommend I start building out infrastructure in a gaming startup?

We are going with terraform and AWS to start with.

https://redd.it/oy3uav
@r_devops

Need help with understanding deletion of previous docker image in pipeline

Hello guys! I'm pretty new to devops and looking for advise.

I'm trying to implement this strategy called streamline: [https://medium.com/@jbradyaudio/streamline-a-super-efficient-branching-and-ci-strategy-ffa864aa99d4](https://medium.com/@jbradyaudio/streamline-a-super-efficient-branching-and-ci-strategy-ffa864aa99d4)

I'm doing it to learn things.

One step is confusing to me: Deleting old image from PR.

It goes like: devs creating branch named "feature-xxx" of master. Then they do some commits and open PR (or MR in gitlab terms). Pipeline runs tests and builds docker image, then image pushed to registry, then some other tests... Then devs push another commit on top to this PR and pipeline should delete previous image.

I end up with tagging images with `"${CI_MERGE_REQUEST_ID}_${CI_COMMIT_SHORT_SHA}"`, then i have a bash script to call gitlab build-in registry api, find images that have tag started with `${CI_MERGE_REQUEST_ID}` and delete it.

PREVIOUS_TAGS=$( \
curl -s --header "PRIVATE-TOKEN:${GITLAB_API_KEY}" "https://gitlab.com/api/v4/projects/${CI_PROJECT_ID}/registry/repositories/${REPO_ID}/tags" | \
jq -r ".[] | select(.name | startswith(\"${CI_MERGE_REQUEST_ID}\")) | .name" | \
paste -sd, \
)
# then make it array and iterate over with for loop and curl --request DELETE

Gitlab ci pipeline example:

stages:
  - lint   
- clean
  - build
Lint:
rules:
    - if: '$CI_PIPELINE_SOURCE == "merge_request_event"'
stage: lint
image: node:lts-alpine
script:
    - ./node_modules/.bin/eslint "**/*.{vue,js}"

Clean:
rules:     
- if: '$CI_PIPELINE_SOURCE == "merge_request_event"'
stage: clean
image: alpine:3.14
before_script:
    - apk add --no-cache curl jq bash
script:
    - bash ./.cicd/clean-prev-build.sh

Build:
rules:
    - if: '$CI_PIPELINE_SOURCE == "merge_request_event"'
stage: build
image: docker
services:
- docker:dind
before_script:
- docker login -u $CI_DEPLOY_USER -p $CI_DEPLOY_PASSWORD $CI_REGISTRY
- export IMAGE_REPO=$CI_REGISTRY/demo
- export IMAGE_TAG="${CI_MERGE_REQUEST_ID}_${CI_COMMIT_SHORT_SHA}"
script:
- docker build -t ${IMAGE_REPO}:${IMAGE_TAG} -f ./.cicd/Dockerfile .
- docker push ${IMAGE_REPO}:${IMAGE_TAG}

Sadly $CI\_COMMIT\_BEFORE\_SHA always 000000000 for merge request pipelines so i can't use it.

How bad is my solution? Any suggestions to make it better?

https://redd.it/oxsh56
@r_devops

Infra as a code is cloud lock-in

https://flicksfix.com/posts/infra-as-a-code-is-cloud-lock-in/

I've wanted to spark a discussion regarding the movement of doing "everything as a code". I've tried really hard to make it work for my own servers / boxes, but it turns out its a lot easier to maintain them using good-old ssh with some bash scripts here and there instead of full-blown weapons like Ansible / Terrraform.

On the other hand I feel like at work terraform is a blessing when working with cloud providers and I get this big disconection between my own hobby projects and work that I do.

Do you feel the same about it?

I've shared some thoughts and example in (disclaimer: my own) blog post.

https://redd.it/oy0zhb
@r_devops

Creating and Automating a Runbook for an application hosted in AWS

Hi,

I'm a newbie to aws. Looking for a way to create a runbook and automating for deploying applications hosted in AWS.Appreciate your thought on this

https://redd.it/oxq7jd
@r_devops

We built an observability tool for CI Pipelines to help developers identify why their tests fail. It’s free for open-source projects

Hi everyone,

We’ve been working on our new product, Thundra Foresight. Our aim is to help developers to understand test failures and to bring observability into their CI Pipelines for higher productivity and lower CI costs.

It’s free for open-source projects.

# What’s the point to write here?

We’re looking forward to getting feedback on our tool to serve developers in the best manner! And, you can explore foresight (how it works) with the most popular open-source projects.

Thank you for your support!

https://redd.it/oxu2f2
@r_devops

Future of Application Performance Monitoring Pricing

Hello all,

I'm exploring what would revolutionize the pricing for Application Monitoring tools, and would really appreciate your inputs and experience with APM tools such as Dynatrace, Stackify, AppDynamics, etc.

The idea is to make sure that the users/buyers of an APM tool are able to forecast the pricing as well as keep it flexible based on their dynamic infrastructure needs.

The current industry is all over the place with the pricing models and lack simplification and flexibility.

What would be the best pricing method for the future of an APM tool/

View Poll

https://redd.it/oxpri0
@r_devops

Moving out from the on-Prem ghetto

Hello all,

I am a management consultant who ended up falling into a devops role at a client where I ended up building their cluster and their devops tools all on-Prem. Where I live (Asia) the demand appears to be primarily aws/azure related and everyone seems to lose interest when I say I worked solely on Prem. Am I targeting the wrong markets or should I move out - and how do I get substantive aws/azure experience?

https://redd.it/oy9wkq
@r_devops

Caching and real-time notifications in a fully serverless AWS based web application with…

https://towardsaws.com/caching-and-real-time-notifications-in-a-fully-serverless-aws-based-web-application-with-5ae9b67add78

https://redd.it/oyagg2
@r_devops

Deploy .NET project to Hetzner

Is there a way to deploy docker with Visual studio on Hetzner, something like you can do on Azure? Or what is the best/quickest way to deploy .NET project to Hetzner?

https://redd.it/oybn8k
@r_devops