What factors do you use to determine your 2021 DevOps forecast ?

Example - Delivery Lead Time forecasted for the business in 2021

https://redd.it/kbuit8
@r_devops

Good Devops Resume Examples?

I graduated 2 years ago, went straight into a devops team at a SAAS, work with AWS/Terraform/Jenkins/etc. daily, but I’m being underpaid for my current position and looking to move into a higher salary devops role in Boston or remote.

I know my skills are in demand, but
since I haven’t had to put together a devops-specific resume before, is there anything important I should be adding? Or just make it clear I have experience in a modern stack and list some projects?

https://redd.it/kbzq8a
@r_devops

Resources for Python and Linux

Hello all,

I know Python and Linux skills are needed in the DevOps field but I don’t know which/what type of skills. Does anyone have resources or links to either docs/videos to learn Python and Linux specifically for DevOps? I’m trying to learn the necessities and the musts of Python & Linux just for the DevOps. Thanks in advance!

https://redd.it/kbvmw4
@r_devops

do you prefer deployments referencing specific docker images by some version/git-hash or using something like ":latest"?

I'd like to adopt a best practice with my new deployments. Currently I run with docker images in k8's where the deployment references image tags like prd or qa . Is it a better practice to deploy with specific tag names using git hash or version? When would you prefer one over the other?

https://redd.it/kbsweo
@r_devops

I'm trying to learn how to automate everything from development to production, care to chime in on how I'm doing and what to do next?

Hi r/devops, I hope all of you are safe.

I'm a software engineer that would love to transition to devops some time in the future. I figured that the best way to start is to learn how to implement the "devops" way of an application's lifecycle. As a precursor, I have developed a simple pipeline at work with Bitbucket that:

1. Upon pushing to remote, it runs the automated test suite and reports the result.
2. If something is merged to a branch of interest (like staging), the pipeline will SSH onto the relevant server, run git pull origin <branch>, and then restart Nginx.
3. It then pings a healthcheck endpoint that make sure services such as RabbitMQ or Redis are still functional.
4. A report of the whole process is then emailed to stakeholders

Nothing breathtaking, really. The servers are still provisioned and configured by hand, there's a ton of hardcoded (or not really, they're in Bitbucket's environment dashboard) stuff such as SSH keys that feels icky. But all in all, it gets the job done and I'm proud and happy to work on these kinds of solutions.

Now I have a side project in the works, and I want to use this opportunity to apply better practice with strong emphasis on automation. It is a non-SPA Django app with a Postgres database. I currently have the following things one:

1. Use Docker in development to make sure each dependency is consistent (i.e. I don't even have Postgres and the required Python version to run the app installed in my machine).
2. Use docker-compose to start both the app and the database in development
3. A simple Gitlab CI file that runs the app's test suite, utilizing Docker and docker-compose as well.

I now want to have a publicly available version of this app so that the client can test it. I added the following things:

1. A production docker-compose.yml that spins up nginx in front of the app. Also uses gunicorn to serve the app instead of Django's development server.
1. A Terraform configuration that spins up an EC2 instance and a bunch of other stuff, in which in the end I can access the instance via ssh and http
2. A couple of Ansible playbooks that:
- Install Docker
- Install Docker-Compose
- Copy the application source code to the ec2 instance using the synchronize module
- Rebuild the images and restart the container
- Collect the static assets and run the database migrations
- Create admin accounts if they are not existing yet

With this setup, I can consistently re-create the prod environment with terraform apply + ansible-playbook.

I know this setup is still pretty rudimentary so I have a bunch of questions:

1. After running terraform apply, I run terraform show to get the public ip of the created instance. I then update my /etc/ansible/hosts file. Is there a way to automate this?
2. When running ansible-playbook (or adhoc commands for that matter), I still need the instance's private key in order to connect: ansible-playbook ./initial-setup.yml --private-key=~/Keys/myprivatekey.pem. Is this a normal way of doing things? It just feels weird being tied to this key file, that I need to store it in a non-VCS storage for safekeeping.
3. What's my next step here? Do I integrate Terraform and Ansible into Gitlab CI, and run the commands above according to some trigger?

Thank you for your time to read my queries. All of this is new yet exciting to me, and I can't wait to hear your thoughts. Stay safe!

https://redd.it/kbswda
@r_devops

What does it look like to further your DevOps Career?

I see a lot online regarding how to become a DevOps engineer (it is the hot thing right now, after all). But what does it look like to grow your career in this field? What kind of roles would you move towards?

Are Senior/Lead DevOps engineer roles common? DevOps Architect?

https://redd.it/kbixqq
@r_devops

anyone use glowroot?

Just starting to use glowroot on cassandra servers for JVM monitoring, and I was curious if there are any command line tools for glowroot? I am seeing servers where my data.h2.db grows too big and would like to have a way other than going to the webpage and deleting the data and can't find any other way to do it.

https://redd.it/kbe92k
@r_devops

Verify mobile app layout changes on pipelines

On my mobile developer career it was always hard to control which layout changes was made before a release. Sometimes the changes isn't good enough to product team or has some info that mustn't be there. Do you remember of nissan developer busted for copying code from stack overflow? (https://www.theverge.com/tldr/2016/5/4/11593084/dont-get-busted-copying-code-from-stack-overflow)


The process to control the changes is very massive. Usually is like either open the app screen by screen and simulate an user or see screenshots of UI tests one by one and compare them. It is specially hard to small teams because this process waste too much time.


I'm creating the LayoutDiff to help my team control layout changes effortlessly and integrated with development process improving the accuracy of quality assurance and getting fast visual feedbacks.


To know more about it click on the below link:

https://www.layoutdiff.com


The first open source project is free!

https://redd.it/kc61ut
@r_devops

How to skip building a new container if only kustomization files have changed in Gitlab CI?

Recently discovered that Gitlab CI has [a few](https://docs.gitlab.com/ee/ci/yaml/#onlychangesexceptchanges) [ways](https://docs.gitlab.com/ee/ci/yaml/#ruleschanges) to skip a certain job if no files relevant to that job have changed.

I would like to use this to skip building a new container at each merge/push even if only my kustomization files have changed.

So I have one repo with app source, Dockerfile and k8s kustomization manifests.

Why one repo? Well it seemed like the only way to do a full deploy when my devs merge new code. I used to have separate Helm chart repos that would allow for separate Helm chart and source code development but I like kustomize better.

My problem is that my CI jobs use the current "$CI\_COMMIT\_REF\_NAME-$CI\_COMMIT\_SHORT\_SHA" as image tag so if I skip the container job this tag would not exist and kustomizations would result in failed image pull.

There are many ways to skin this cat so I'd love to hear suggestions on what I'm doing wrong.

* I want to push feature branches and see these changes in the staging environment. So relying on tags to avoid this issue won't work during development. Tags are only in use in prod.
* I wish I could make kustomize re-pull an image using a general tag like latest or the branch name, that way I could push two images one with short sha and one with just the branch name. And I'd still be able to make kustomization changes after the container image was built.
* I wish it didn't have to push a new container image every time I edit the kustomizations. Nothing is different with it from the last image pushed.

https://redd.it/kcadr1
@r_devops

What should be critical midnight-alerts?

It's my third year doing DevOps, but first doing On-Call shifts. And to be honest, it was terrible. It felt like a Russian roulette game. And often getting unlucky, meant getting really unlucky.

I took it with my manager, and this conversation had lots of tears being shed on my side, and understanding from my manager. He told me it's a matter of priorities and since it's so painful we'll prioritize it other than delivering features for the rest of the organization.

Now as I feel hopeful, I still have concerns, we have some alerts that seem to be like.."Something broke, good luck" which trigger PD's.


I wanted to ask you, have do you decide which alerts are critical enough to be handled at night, and how do you make them as minimal as possible.

thanks

https://redd.it/kca1p2
@r_devops

Difference between COPY and ADD in dockerfile

New article that helps to know the difference between COPY and ADD commands in dockerfile and the best practices for using these in dockerfile for building docker imagesDockerfile ADD vs COPY

https://redd.it/kcbrdz
@r_devops

Console #31 includes a CLI for easily managing secrets, that I thought /r/devops might be interested in :).

You can find the newsletter here:

https://console.substack.com/p/console-31

It also includes interviews with the developers of the projects and a new help wanted section, in case you're looking for open source projects to contribute to :).

https://redd.it/kca7p3
@r_devops

Nexus Repository on AWS ECS Fargate + EFS

I'd like to deploy Sonatype's Nexus Repository on AWS ECS Fargate and use EFS as the persistent volume (supported since Apr 2020)

I'm aware that EFS is quite expensive, comparing to EBS, but assuming that the cached data is not that big (up to 20GB) I think that it'll be cost-effective.

I saw this terraform module - devops-workflow/ecs-service-nexus but it looks abandoned.

The Question: Any tips/recommendations/thoughts before I start writing my own terraform module?

https://redd.it/kcdtgh
@r_devops

What do you use for inspiration for package configuration?

I have to install diverse number of packages (Redis, Elasticsearch, Postgresql, RabbitMQ).

The stupidest approach is to apt-get install. But I want to provide templates for config files.

Of cause each project has official documentation, source repository, wiki, FAQ, etc. But going through those sources isn't productive way to build "own" configuration.

I used bundled dpkg configs (referenced by /var/lib/dpkg/info/*.list) as a blueprint but I think about another "creative" ways of configuring / creating templates for configs.

Many tools have configuration recipes:

containers & VMs: Vagrant, Docker, Packer, Helm, cloud-init, etc
CM tools: Puppet, Chef, Salt, Ansible, etc
distro packagers: dpkg (Debian), rpm (RHEL), apk (Alpine), ports (FreeBSD), snoop, choco, etc
other packagers: Bitnami (really don't know other alternative in this categoy)

It is helpful to read theirs templates / comments and check which executables, in which order and with which options are called.

Do any practice learning that way from others? What repositories you recommend to "study"?

I started reading Bitnami + official Docker recipes, like:

https://github.com/docker-library/official-images and related https://github.com/docker-library/redis.git
https://github.com/bitnami/bitnami-docker-redis.git

and they are not immediately useful (they are based on lots of Bash code around home-grown "frameworks") - I cannot find templates for Redis config, unpacking or compiling instructions are out of my interest.

Debian or Alpine Linux repos look more helpful. Don't have experience with "recipes" from CM tools.

My goal is to learn, get ideas, not to violate copyright by coping or incorporating others solutions.

https://redd.it/kcfmvt
@r_devops

Pondering over the job scene in Canada vs India

I have been a DevOps/SRE for more than 4 years in India. I've always imagined to work in an outside country to grow myself professionally and personally. With a job that has let me explore plethora of tools and technologies, I am very keen on exploring more and solve different kinds of problems.
However, I do not want to risk a career slowdown this early in the game.
Speaking from a very general perspective, does it make sense for me to consider this move?

https://redd.it/kcgio3
@r_devops

Does anyone actually use Pagerduty’s analytics?

Not a single team I’ve worked on has used it. We’ve sometimes built custom hand-off report scripts that compare alerts for this week vs last week.

https://redd.it/kchyl6
@r_devops

How does your team workflow with a serverless framework look like?

At my work we are beginning to become more structured when it comes to our serverless application development. We began using aws chalice to get a more consistent workflow and since we are a big terraform shop, the packaged terraform feature is amazing. I've loved chalice so far but my concern is the community and project seem slow and brittle, these are clearly not good signs. Since we liked chalice so much we are thinking about picking up a nice framework that will have good support and landed on AWS SAM and Serverless. I'm leaning towards SAM but still unsure how the workflow works working alongside multiple devs all working on the same project. We were able to version and create new stages and workspaces with chalice which made it great for a team. Can someone give some insight on how your team uses SAM and the collaboration workflow? Any frustrations? Any underated benefits? Any input at all?

https://redd.it/kcappy
@r_devops

Puppet Shooting for an IPO in 2021

https://www.oregonlive.com/silicon-forest/2020/11/portland-tech-company-puppet-sets-2021-target-for-ipo.html

Does anyone use Puppet? Ansible is way ahead in market share for configuration management tools, I honestly cannot see this IPO going well.

https://redd.it/kc6s64
@r_devops

I need help

I made a http service that returns 3 endpoints with python and django, created a dockerfile as well with all steps and I dont know how to make the build and test inside of it, what cmd should i write ? as this is my first time with jenkins

https://redd.it/kc72fh
@r_devops

R Leveraging the newest AI patented research for more efficient IT Ops

On 12/16 Wednesday at noon there is an exciting overview of startup innovating in the AI IT space. The company is based on NC State professor Dr. Xiaohui (Helen) Gu's award winning patented technology. Read on for details.

Systems are becoming more complex. Customer expectations for speed and reliability have never been higher. How do you get ahead without sacrificing ROI?

The secret is adding intelligence to traditional IT operations. Join us December 16 at 12:00 PM ET and we'll show you what is possible.

You’ll learn:

\-The business benefits of accurate anomaly detection for machine data

\-Why anomaly detection and accurate incident prediction are valuable together

\-How to automate root cause analysis to prevent downtime

\- How to use AI to prevent future incidents

**https://lnkd.in/dT4sZWC**

https://redd.it/kcm8z6
@r_devops

Question from interview

> A server and a storage. Suggests a mechanism so that at any point in time it would be possible to recover to the most recent image or the one before that.

Question from an interview I'm not sure about. What is the best solution? Create daily copies of the storage?

Thanks ahead!

EDIT: some more:

A sender and a receiver. The packet turn around time is 200 ms.
1. What would be the rate given a packet size of 1500KB and that only 3 in flight packets are allowed.
2. Same with turn around time of 100 ms.
3. What would be the optimal N if an ack is sent every N packets, and if one of the packets gets corrupted all N packets are sent. … href="/Interview/A-sender-and-a-receiver-The-packet-turn-around-time-is-200-ms-1-What-would-be-the-rate-given-a-packet-size-of-1500KB-an-QTN_872769.htm" class="questionResponse">Answer Question

https://redd.it/kcjevs
@r_devops