Need guidance on how to deploy jenkins build efficiently

Hi, so we build a c# project on a node pc, it takes around 30 mins to build, and currently were using the same pipeline everywhere thats means build step again and again.

Need to make it so that it'll be built once, uploaded to Google Cloud registry or aws, then the same will be pulled by other machines and also rsync can help somehow I was told. I'm trying to find documentation on Google cloud for the same but not sure about it, should I use cloud run for it? I know something similar can be done using ansible, I want to know a good way to do this.

https://redd.it/stzkbs
@r_devops

Which AWS and Azure service is the same as Heroku?

I'm a hobbyist using Heroku to host my portfolio container. I like Heroku because it's super easy to use and deploy to. I'm only deploying one container and I don't need to scale or manage the container.

The AWS and Azure websites don't make it clear to me exactly which service would be similar to Heroku's. I was wondering which services from AWS and Azure I could also use and if they would be better?

https://redd.it/su0uhe
@r_devops

How to organize AWS SecurityHub alerts across multiple clients and multiple accounts per client into actionable tickets?

Hello. My boss has multiple AWS clients with multiple accounts per client and he's trying to turn the AWS Security Hub alerts for each client account into an organized pool of actionable tickets. The idea is to turn these countless alerts across all AWS accounts into an organized ticket pool we can take action on - sorting by the highest priority security alerts in a streamlined MSP-like ticketed way across all accounts.

He has me working on this Frankenstein-like project that uses Terraform to setup SecurityHub integrations in each client account with our main consultancy account via cross account roles and then it integrates with OpsGenie and SNS to organize the alerts by account and keep the live feed of alerts coming to Opsgenie. The project he's had me jump into is a mess requiring terraform state surgery at every turn and I can't help but think there's got to be a better way to do this. How should I propose we do this?

tldr: How can we turn countless AWS SecurityHub alerts across multiple AWS accounts into a streamlined live pool of tickets sorted by priority that we can take immediate action on?

https://redd.it/su1l96
@r_devops

Pure Bash Bible – A collection of pure bash alternatives to external processes

I thought the r/devops subreddit might be interested in this project I just found!

https://github.com/dylanaraps/pure-bash-bible

https://redd.it/su3w04
@r_devops

How to organize AWS SecurityHub alerts across multiple clients and multiple AWS accounts per client into actionable tickets?

Hello. My boss has multiple AWS clients with multiple AWS accounts per client and he's trying to turn all of our AWS Security Hub alerts across all clients into an organized pool of live tickets that we can take action on - sorting by the highest priority security alerts across all accounts.

He has me working on this Frankenstein-like project that uses Terraform to setup AWS SecurityHub integrations in each client account with our main consultancy account via cross account roles and then it integrates with OpsGenie and SNS to organize the alerts by account and keep the live feed of alerts coming to Opsgenie. The project he's had me jump into is a mess requiring terraform state surgery at every turn and I can't help but think there's got to be a better way to do this. How should I propose we do this?

tldr: How can we turn countless AWS SecurityHub alerts across multiple AWS accounts into a streamlined live pool of tickets sorted by priority that we can take immediate action on?

https://redd.it/su1ur1
@r_devops

Pure sh bible – Posix sh alternatives to external processes

I thought the r/devops subreddit might be interested in this project I just found!

https://github.com/dylanaraps/pure-sh-bible

https://redd.it/su4fzm
@r_devops

TSE Interview!


Hey guys, I have an upcoming technical interview with a game server orchestration company that manages multiplayer games worldwide. This is for a TSE position. I was told that the scope of the interview would mostly be linux/docker questions as well as some kubernetes. Any specific commands/documentations I should know to be more prepared than I’m trying to be? Thanks!

https://redd.it/suamqy
@r_devops

Keeping up with external software releases

I've been wondering how everyone keeps up-to-date with software releases for tools they use.
As an example, recently Terraform introduced some breaking changes in their AWS provider v4.0.0.
And yes, I should be pinning providers!
But it got me thinking, I'd like an automated way to keep up with releases so I don't need to go checking sites. Not all have atom feeds so anyone have any good suggestions?

https://redd.it/su28bt
@r_devops

Looking for the right way to club the AWS credentials in a CI - CD pipeline

Hi, guys!

My application talks to a few AWS services like S3, SQS, SNS, CloudWatch, etc. This application uses credentials that I keep in a text file. This text file is kept manually in each VM for every environment (Dev, Stage, QA, etc) separately.

Now, I want to club this credential file with my CI-CD and remove the text file dependency. What is the right way to do it? Shall I use a key-vault? Or, shall I put it on S3 and then make a call to it?

Kindly suggest.

https://redd.it/sudpwd
@r_devops

Prevent commit ill formatted kubernetes yaml to github

Hi, Is there a way to raise error in IDE for ill formatted k8s yaml definitions before they are committed to github.

https://redd.it/suhere
@r_devops

What might be wrong with my node container?


793 silly tarball trying [email protected] by hash: sha1-m98vIOH0DtRH++JzJmGR/O1RYmw=
794 silly extract [email protected] extracted to /amigos.com/node_modules/deprecated (482ms)
795 silly extract [email protected] extracted to /amigos.com/node_modules/orchestrator (481ms)
796 silly extractTree [email protected] -> /amigos.com/node_modules/end-of-stream
797 silly extractTree [email protected] -> /amigos.com/node_modules/sequencify
798 silly extractTree [email protected] -> /amigos.com/node_modules/stream-consume
799 silly extract @sindresorhus/[email protected] extracted to /amigos.com/node_modules/@sindresorhus/is (999ms)
800 silly extract [email protected] extracted to /amigos.com/node_modules/lodash._root (408ms)
801 silly tarball trying [email protected] by hash: sha1-jhdyBsPICDfYVjLouTWd/osvbq8=
802 silly tarball trying [email protected] by hash: sha1-kM/xnQLgcCf9dn9erT57ldHnOAw=
803 silly tarball trying [email protected] by hash: sha1-pB6tGm1ggc63n2WwYZAbbY89HQ8=
804 silly extract [email protected] extracted to /amigos.com/node_modules/locate-path (352ms)
805 silly extract [email protected] extracted to /amigos.com/node_modules/inherits (374ms)
806 silly extract [email protected] extracted to /amigos.com/node_modules/lodash.isarguments (420ms)
807 silly extract [email protected] extracted to /amigos.com/node_modules/critical/node_modules/load-json-file (352ms)
808 silly extract [email protected] extracted to /amigos.com/node_modules/jsesc (509ms)
809 verbose teardown shutting down workers.
810 info teardown Done in 0s
811 verbose type system
812 verbose stack FetchError: request to https://registry.npmjs.org/readable-stream/-/readable-stream-2.2.10.tgz failed, reason: getaddrinfo EAI_AGAIN registry.npmjs.org:443
812 verbose stack at ClientRequest.req.on.err (/usr/local/lib/node_modules/npm/node_modules/node-fetch-npm/src/index.js:68:14)
812 verbose stack at emitOne (events.js:116:13)
812 verbose stack at ClientRequest.emit (events.js:211:7)
812 verbose stack at TLSSocket.socketErrorListener (_http_client.js:401:9)
812 verbose stack at emitOne (events.js:116:13)
812 verbose stack at TLSSocket.emit (events.js:211:7)
812 verbose stack at emitErrorNT (internal/streams/destroy.js:73:8)
812 verbose stack at _combinedTickCallback (internal/process/next_tick.js:139:11)
812 verbose stack at process._tickCallback (internal/process/next_tick.js:181:9)
813 verbose cwd /amigos.com
814 verbose Linux 5.10.60.1-microsoft-standard-WSL2
815 verbose argv "/usr/local/bin/node" "/usr/local/bin/npm" "ci"
816 verbose node v8.17.0
817 verbose npm v6.13.4
818 error code EAI_AGAIN
819 error errno EAI_AGAIN
820 error request to https://registry.npmjs.org/readable-stream/-/readable-stream-2.2.10.tgz failed, reason: getaddrinfo EAI_AGAIN registry.npmjs.org:443
821 verbose exit [ 1, true ]

My node container that builds my css and js by running a gulpfile no longer worked and my latest error message gave me the above. It was on the 25th of last month. It looks like some DNS error, but I am not sure if it's related to the issue I am having. Running docker-compose run css-make gives me an index.js of 1kb with some bogus content. The js file generated should be 256kb, so I am not sure what's happening here. The docker-container doesn't seem to be running like before. In the past, it would output something on my WSL console every time I changed a js file, now I don't see it at all.

FROM node:8.17

RUN apt-get update \
&& apt-get install -y curl nano socat

https://redd.it/su9oo0
@r_devops

Building Tools and Platforms for the 99% Developers

https://future.a16z.com/software-development-building-for-99-developers/

https://redd.it/sulkja
@r_devops

Courses to learn Python Automation?

I want really to work on a DevOps enviroment so I'm following this roadmap: https://roadmap.sh/devops


I'm a junior sysadmin and I have a pretty solid Linux base, with some knowledge on bash scripting. Im currently taking this course: Docker&Kubernetes where I've learned some Travis CI, AWS too...


However I want to first get some knowledge on python automation, what are some good courses?

https://redd.it/sumze6
@r_devops

Quitting?

I’m starting to feel more like a cog than ever before. Often asked to work during PTO, often late nights etc.

Any thoughts or stories to share? In my late 30s and was hoping to finally get a little more work/life balance.

Bailed on a small company for a FAANG like gig and it’s been a nightmare.
We spend hours a week on the company and our culture which bleeds into my evenings.

https://redd.it/suniym
@r_devops

Picking incident severity levels

It sounds really obvious, but if you're ever unlucky enough to be building your company's incident response process, you'll be forced to decide what severities to use.

Lots of the literature is really dense and designed for mega-corps, not your average growing company.

My colleague Stephen has written about how to pick good incident severities, leaning on the experience we've had with our (incident.io) customers and the processes they implement.

For some pragmatic advice and first principal thinking, here's the post:

https://incident.io/blog/designing-your-incident-severity-levels

https://redd.it/suq371
@r_devops

Is Jenkins best suited for my usecase?

I'm trying to deploy a nextjs(react) app and I want the flow to look something like this
Commit is made to repo on github -> VPS is notified via webhook -> VPS builds docker image shuts down previous image and then runs the new one


From what I'm seeing I think Jenkins can do what I want to do but there may be a better way to do it


I'm very new to devops so feel free to give me any advice if there is a better way to do what I'm trying to do

https://redd.it/sur26h
@r_devops

Moving from long-lived to ephemeral environments: why and how?

My company is hosting a webinar on March 2nd about the move from long-lived to ephemeral environments in pre-production workflows. If you're in the process of doing this at your company, drop by or sign up to catch the recording.

https://redd.it/suvtrg
@r_devops

A Postgres toolkit that might be handy

Can be useful if you are managing Postgres. In this docker image, I've collected many Postgres tools that can help with development and maintenance after the release. It can help to generate realistic mocking data, import/export data from files can perform complete Postgres benchmarking (generates test data and benchmarks queries).

It also can help with making backups and saving to S3, as well as scheduling them. Includes a browser-based version of VS-code, terminal, filebrowser, and jobs scheduler.

I open-sourced it in this repository

https://redd.it/sup6u7
@r_devops

Drupal and DevOps... examples, resources.

Hopefully this is the correct place to ask. I'm looking for examples, resources or learning material on using drupal within a DevOps framework. Currently I'm building backend resources for our drupal devs and it's getting old. Since our organization is retooling I would like to automate as much as possible. I have a vision in my head of how it would work but it would help if I could see an examples and access to materials where I can fill in the gaps of my knowledge (which with the retooling is a little wide now). Any 👉 in the proper direction would be appreciated...books, Google searches, videos, courses...etc.

-Editing to give clue as to the tools available.

Azure DevOps, Azure, AWS, Terraform plus others.

https://redd.it/suzfz0
@r_devops

Hiring Managers - what projects do you look for on a “Junior” or “New” persons resume?

Currently looking to shift my career into DevOps.

I’ve done my research about what certifications I want to pursue and obtain… but are there any good projects for new people cracking into DevOps to do and list on their resume? I plan on having a “projects” section on my resume. I was wondering if there were any good resources to start from or follow along to the point where I can put them on my resume with the technologies/tools used.

If you’re a hiring manager or been in DevOps for awhile… what types of “Junior” projects would you want to see on a resume that says you are willing to learn in a Junior role, but have a good grasp of the basics down?

Any suggestions?

https://redd.it/sv3hgi
@r_devops

Does your company use DORA metrics? Do you find them useful or are they just Marketing/Sales bla-bla?

We‘re moving to the cloud and our implementation partner company keeps bringing up DORA metrics.

Do you have an opinion?

Further info: https://cloud.google.com/blog/products/devops-sre/using-the-four-keys-to-measure-your-devops-performance

https://redd.it/sv4fzg
@r_devops