What does it look like to further your DevOps Career?

I see a lot online regarding how to become a DevOps engineer (it is the hot thing right now, after all). But what does it look like to grow your career in this field? What kind of roles would you move towards?

Are Senior/Lead DevOps engineer roles common? DevOps Architect?

https://redd.it/kbixqq
@r_devops

anyone use glowroot?

Just starting to use glowroot on cassandra servers for JVM monitoring, and I was curious if there are any command line tools for glowroot? I am seeing servers where my data.h2.db grows too big and would like to have a way other than going to the webpage and deleting the data and can't find any other way to do it.

https://redd.it/kbe92k
@r_devops

Verify mobile app layout changes on pipelines

On my mobile developer career it was always hard to control which layout changes was made before a release. Sometimes the changes isn't good enough to product team or has some info that mustn't be there. Do you remember of nissan developer busted for copying code from stack overflow? (https://www.theverge.com/tldr/2016/5/4/11593084/dont-get-busted-copying-code-from-stack-overflow)


The process to control the changes is very massive. Usually is like either open the app screen by screen and simulate an user or see screenshots of UI tests one by one and compare them. It is specially hard to small teams because this process waste too much time.


I'm creating the LayoutDiff to help my team control layout changes effortlessly and integrated with development process improving the accuracy of quality assurance and getting fast visual feedbacks.


To know more about it click on the below link:

https://www.layoutdiff.com


The first open source project is free!

https://redd.it/kc61ut
@r_devops

How to skip building a new container if only kustomization files have changed in Gitlab CI?

Recently discovered that Gitlab CI has [a few](https://docs.gitlab.com/ee/ci/yaml/#onlychangesexceptchanges) [ways](https://docs.gitlab.com/ee/ci/yaml/#ruleschanges) to skip a certain job if no files relevant to that job have changed.

I would like to use this to skip building a new container at each merge/push even if only my kustomization files have changed.

So I have one repo with app source, Dockerfile and k8s kustomization manifests.

Why one repo? Well it seemed like the only way to do a full deploy when my devs merge new code. I used to have separate Helm chart repos that would allow for separate Helm chart and source code development but I like kustomize better.

My problem is that my CI jobs use the current "$CI\_COMMIT\_REF\_NAME-$CI\_COMMIT\_SHORT\_SHA" as image tag so if I skip the container job this tag would not exist and kustomizations would result in failed image pull.

There are many ways to skin this cat so I'd love to hear suggestions on what I'm doing wrong.

* I want to push feature branches and see these changes in the staging environment. So relying on tags to avoid this issue won't work during development. Tags are only in use in prod.
* I wish I could make kustomize re-pull an image using a general tag like latest or the branch name, that way I could push two images one with short sha and one with just the branch name. And I'd still be able to make kustomization changes after the container image was built.
* I wish it didn't have to push a new container image every time I edit the kustomizations. Nothing is different with it from the last image pushed.

https://redd.it/kcadr1
@r_devops

What should be critical midnight-alerts?

It's my third year doing DevOps, but first doing On-Call shifts. And to be honest, it was terrible. It felt like a Russian roulette game. And often getting unlucky, meant getting really unlucky.

I took it with my manager, and this conversation had lots of tears being shed on my side, and understanding from my manager. He told me it's a matter of priorities and since it's so painful we'll prioritize it other than delivering features for the rest of the organization.

Now as I feel hopeful, I still have concerns, we have some alerts that seem to be like.."Something broke, good luck" which trigger PD's.


I wanted to ask you, have do you decide which alerts are critical enough to be handled at night, and how do you make them as minimal as possible.

thanks

https://redd.it/kca1p2
@r_devops

Difference between COPY and ADD in dockerfile

New article that helps to know the difference between COPY and ADD commands in dockerfile and the best practices for using these in dockerfile for building docker imagesDockerfile ADD vs COPY

https://redd.it/kcbrdz
@r_devops

Console #31 includes a CLI for easily managing secrets, that I thought /r/devops might be interested in :).

You can find the newsletter here:

https://console.substack.com/p/console-31

It also includes interviews with the developers of the projects and a new help wanted section, in case you're looking for open source projects to contribute to :).

https://redd.it/kca7p3
@r_devops

Nexus Repository on AWS ECS Fargate + EFS

I'd like to deploy Sonatype's Nexus Repository on AWS ECS Fargate and use EFS as the persistent volume (supported since Apr 2020)

I'm aware that EFS is quite expensive, comparing to EBS, but assuming that the cached data is not that big (up to 20GB) I think that it'll be cost-effective.

I saw this terraform module - devops-workflow/ecs-service-nexus but it looks abandoned.

The Question: Any tips/recommendations/thoughts before I start writing my own terraform module?

https://redd.it/kcdtgh
@r_devops

What do you use for inspiration for package configuration?

I have to install diverse number of packages (Redis, Elasticsearch, Postgresql, RabbitMQ).

The stupidest approach is to apt-get install. But I want to provide templates for config files.

Of cause each project has official documentation, source repository, wiki, FAQ, etc. But going through those sources isn't productive way to build "own" configuration.

I used bundled dpkg configs (referenced by /var/lib/dpkg/info/*.list) as a blueprint but I think about another "creative" ways of configuring / creating templates for configs.

Many tools have configuration recipes:

containers & VMs: Vagrant, Docker, Packer, Helm, cloud-init, etc
CM tools: Puppet, Chef, Salt, Ansible, etc
distro packagers: dpkg (Debian), rpm (RHEL), apk (Alpine), ports (FreeBSD), snoop, choco, etc
other packagers: Bitnami (really don't know other alternative in this categoy)

It is helpful to read theirs templates / comments and check which executables, in which order and with which options are called.

Do any practice learning that way from others? What repositories you recommend to "study"?

I started reading Bitnami + official Docker recipes, like:

https://github.com/docker-library/official-images and related https://github.com/docker-library/redis.git
https://github.com/bitnami/bitnami-docker-redis.git

and they are not immediately useful (they are based on lots of Bash code around home-grown "frameworks") - I cannot find templates for Redis config, unpacking or compiling instructions are out of my interest.

Debian or Alpine Linux repos look more helpful. Don't have experience with "recipes" from CM tools.

My goal is to learn, get ideas, not to violate copyright by coping or incorporating others solutions.

https://redd.it/kcfmvt
@r_devops

Pondering over the job scene in Canada vs India

I have been a DevOps/SRE for more than 4 years in India. I've always imagined to work in an outside country to grow myself professionally and personally. With a job that has let me explore plethora of tools and technologies, I am very keen on exploring more and solve different kinds of problems.
However, I do not want to risk a career slowdown this early in the game.
Speaking from a very general perspective, does it make sense for me to consider this move?

https://redd.it/kcgio3
@r_devops

Does anyone actually use Pagerduty’s analytics?

Not a single team I’ve worked on has used it. We’ve sometimes built custom hand-off report scripts that compare alerts for this week vs last week.

https://redd.it/kchyl6
@r_devops

How does your team workflow with a serverless framework look like?

At my work we are beginning to become more structured when it comes to our serverless application development. We began using aws chalice to get a more consistent workflow and since we are a big terraform shop, the packaged terraform feature is amazing. I've loved chalice so far but my concern is the community and project seem slow and brittle, these are clearly not good signs. Since we liked chalice so much we are thinking about picking up a nice framework that will have good support and landed on AWS SAM and Serverless. I'm leaning towards SAM but still unsure how the workflow works working alongside multiple devs all working on the same project. We were able to version and create new stages and workspaces with chalice which made it great for a team. Can someone give some insight on how your team uses SAM and the collaboration workflow? Any frustrations? Any underated benefits? Any input at all?

https://redd.it/kcappy
@r_devops

Puppet Shooting for an IPO in 2021

https://www.oregonlive.com/silicon-forest/2020/11/portland-tech-company-puppet-sets-2021-target-for-ipo.html

Does anyone use Puppet? Ansible is way ahead in market share for configuration management tools, I honestly cannot see this IPO going well.

https://redd.it/kc6s64
@r_devops

I need help

I made a http service that returns 3 endpoints with python and django, created a dockerfile as well with all steps and I dont know how to make the build and test inside of it, what cmd should i write ? as this is my first time with jenkins

https://redd.it/kc72fh
@r_devops

R Leveraging the newest AI patented research for more efficient IT Ops

On 12/16 Wednesday at noon there is an exciting overview of startup innovating in the AI IT space. The company is based on NC State professor Dr. Xiaohui (Helen) Gu's award winning patented technology. Read on for details.

Systems are becoming more complex. Customer expectations for speed and reliability have never been higher. How do you get ahead without sacrificing ROI?

The secret is adding intelligence to traditional IT operations. Join us December 16 at 12:00 PM ET and we'll show you what is possible.

You’ll learn:

\-The business benefits of accurate anomaly detection for machine data

\-Why anomaly detection and accurate incident prediction are valuable together

\-How to automate root cause analysis to prevent downtime

\- How to use AI to prevent future incidents

**https://lnkd.in/dT4sZWC**

https://redd.it/kcm8z6
@r_devops

Question from interview

> A server and a storage. Suggests a mechanism so that at any point in time it would be possible to recover to the most recent image or the one before that.

Question from an interview I'm not sure about. What is the best solution? Create daily copies of the storage?

Thanks ahead!

EDIT: some more:

A sender and a receiver. The packet turn around time is 200 ms.
1. What would be the rate given a packet size of 1500KB and that only 3 in flight packets are allowed.
2. Same with turn around time of 100 ms.
3. What would be the optimal N if an ack is sent every N packets, and if one of the packets gets corrupted all N packets are sent. … href="/Interview/A-sender-and-a-receiver-The-packet-turn-around-time-is-200-ms-1-What-would-be-the-rate-given-a-packet-size-of-1500KB-an-QTN_872769.htm" class="questionResponse">Answer Question

https://redd.it/kcjevs
@r_devops

Programming Group

Pretty soon, I'm going to start doing a weekly event focused around what tech I'm learning. Right now is web technologies such as HTML, CSS, and JS. I'm currently in a class for it and soon enough will be learning about JS. If you would like to join in, I'm thinking about starting at 6pm EST every Wednesday except the last Wednesday each month via Discord.

https://redd.it/kcri48
@r_devops

Should/could I get into DevOps professionally?

BLUF: I'm kind of in a unique position and am hoping to get some career advice.

I am a junior computer science student. I've been fortunate enough to hold a job as a help desk service tech for 4 years. During that time, I've dabbled in a lot of IT infrastructure tasks thanks to my coworkers. Stuff like Active Directory, CentOS and web server (apache) maintenance. What does it take to get into devops? The appeal to me is that you are working on multiple systems. It seems like "advanced IT", something challenging. There is a laundry list of technologies one must learn in order to get hired. That just doesn't seem realistic to expect from a fresh graduate. Also, I am afraid of getting stuck into one discipline. Maybe I decide to learn js frameworks to get a job as a backend web dev. Am I going to be making relatively the same salary the rest of my life? What should I learn now that will set me up for the high paying job down the road?

https://redd.it/kcrebq
@r_devops

How to deal with the new Docker hub rate limit when using Code Pipeline, Cloud Build, EKS or GKE?

On November 20, rate limits anonymous and free authenticated use of Docker Hub went into effect. Anonymous and Free Docker Hub users are limited to 100 and 200 container image pull requests per six hours. This article explains how to deal with this limit when using Code Pipeline, Cloud Build, EKS or GKE.

https://redd.it/kcxm4m
@r_devops

CrowdSec, an open-source & collaborative fail2ban, built by SecOps for DevOps

Hi there,

CrowdSec is, and will always remain, an open-source (MIT license) and free security solution able to identify aggressive behavior & provide an adapted response to all kinds of attacks. The game changer is that it also enables users to protect each other. Each time an IP is blocked, all community members are informed so they can also block it.

The tool is written in Go and just turned 1.0.0, meaning it is now supported by a local REST API, allowing you to deploy in various enterprise configurations. We built CrowdSec for the people in order to make security accessible to everyone.

You can review the project here: https://github.com/crowdsecurity/crowdsec

Looking forward to your feedback!

https://redd.it/kcz2av
@r_devops

how to create a hook script to update local git branches

Looks like an on-going pain especially for new people to the team. I am no git expert either.

Before I create a pull request, I update my local branches. By doing a pull for master then rebasing my feature-branch on top of new changes in master.

Not everyone rememebers to do this which can cause problems sometimes.

Is there a way to automate this by creating a hook script that runs the relevant pull/merge/rebase commands before a certain git command is run such as git add or git commit etc.?

https://redd.it/kd08nu
@r_devops