Good Prometheus Grafana Kubernetes pod/container metric Article

Help needed: I am trying to setup a Grafana dashboard to look into kubernetes pod/app/container metrics. I can't find any good articles to understand which metrics I should display and how I should display them.

Anyone has any links pointers ?

https://redd.it/jx4aiu
@r_devops

The Best DevOps Blogs

DevOps is a term that has become more and more popular in job postings and with those looking to break into the industry, especially over the past few years. However, one of the most challenging aspects of DevOps is understanding exactly what it is and how it’s applied in the industry. I’ve rounded up [30 of the best DevOps](https://draft.dev/learn/technical-blogs/devops)[ blogs ](https://draft.dev/learn/technical-blogs/devops)and resources to help you learn about the practice and keep up with changes as they come.

Here are some of the top three DevOps Blogs worth keeping an eye on:

[Arrested DevOps](https://www.arresteddevops.com/)

While not strictly a blog, the Arrested DevOps podcast was one of the first that I listened to when I started getting interested in DevOps. If there is a specific topic you want to learn about, you shouldn’t have a problem finding at least one episode dedicated to that in the archives.

**Total Score: 5**

[The Microsoft Azure Blog](https://azure.microsoft.com/en-us/blog/)

The Azure blog doesn’t focus exclusively on DevOps topics but has a ton of news and information related to cloud computing in general and Azure services in particular. If you use Azure as your cloud provider, this is an especially good blog to follow.

**Total Score: 4.8**

[The Agile Admin](https://theagileadmin.com/)

The Agile Admin is a blog focused on DevOps culture while not ignoring the technical deep dives that many are looking for in a DevOps blog. The standard blog posts are interspersed with technical talks in the form of YouTube videos as well as other kinds of content.

**Total Score: 4.6**

As you can see, there is no shortage of people talking about DevOps and trying to keep up with the changes in the industry. Hopefully, [**the list** ](https://draft.dev/learn/technical-blogs/devops)will help you find a new resource or two that you’ll refer back to in the future.

Do you have a favorite Devops blog that you swear by?

https://redd.it/jx1w9k
@r_devops

Is Terraform a good tool to make code deployments?

I work in a gaming company as a DevOps engineer and currently I'm involved in a project with Unreal Engine and AWS GameLift.

Our build system is TeamCity that works like charm, but we're having some problems with the code deployment, the way this works is:


1. A new build is fired and the resulting artifact is uploaded to S3.
2. A GameLift build is created based on that artifact stored in S3.
3. A terraform project is run to create new GameLift fleets (A fancy autoscaling group managed by AWS), which does all the job of deleting the old fleets, creating a new one based on the required build and updating the relevant resources to point to the new fleets so the game can be consumed.

This works just fine but now we need to look into a multi-region deployment and I'm concerned about Terraform because I don't know if it's an appropriate tool to make code deployments as we're talking of constantly changing infrastructure (Especially in dev where we have builds all the time).

On the other hand I wrote a script in Powershell that does exactly the same thing mentioned above and it works quite fine, but again I'm not 100% sure of the right way to go.

How do you handle deployments in your environment? Do you use a propietary tool? Do you have a deployment script?

And also, what do you think about how I'm using Terraform as described above? Am I doing this right?

Thanks a lot!

https://redd.it/jwzu5j
@r_devops

Kubecon USA videos

hey, does anyone know when they will be available on youtube or if they can be seen anywhere else?

https://redd.it/jwysjr
@r_devops

Advice needed

I'm currently working as a Software Engineer but i'm mostly handling the DevOps side of the project Pipeline/Deployment...etc, with a couple of feature assignments here and there and my company is planning on moving me to full-time DevOps engineer. (just to clarify i have around 2 years of experience)

now my current dilemma is that i have a Business Information System Bachelor, while i did study Full-Stack development during my 4 years, people rather frown upon it for some reason (as if academics ever mattered in a predominantly self-learning industry).

I've considered getting a masters & started a couple of pre-masters classes (a few courses that lacked from my transcript) but so far during the lecture i'm studying stuff that basically has nothing to do with anything useful to DevOps & might i add wasting a lot of time and some money, the main reason i'm trying to pursue this is to have a better career chance whenever i wanna move to a better paying job.

My question is :
Do i waste time/money on a masters degree which won't be useful at all just for name of it or whatever
or
Completely focus on getting my AWS/RHCSA/CKA certification and ignore the whole masters road?

https://redd.it/jwjp2k
@r_devops

Any Producers here?


I want to be a Video Game Producer. I am a young Project Manager (6 months experience) at an organization that uses Traditional project management methodology.

I have an undergraduate degree and have been studying online after work every night. My current short-mid goal is to pick up a CSM and Certified Associate in Project Management from PMI.

Does anyone have advice on how I could swing a jump to a game development industry role in the next few months to a year? Ideally this would be an associate producer role, but I'm willing to start wherever I need to.

Thanks in advance

https://redd.it/jwn1my
@r_devops

Infrastructure-as-code-as-software - applying sw engg principles to infra setups

Infra-as-code-as software post on approaching infra setup in a much more structured, first principles way. I have used some of the patterns described here but it really helps reinforce the learning with principles driving the justification + working code evolving at each stage to embrace these principles to make itself better.


https://medium.com/last9/infrastructure-as-code-as-software-a5e4b2b93e8e 

https://redd.it/jvp4ke
@r_devops

No Experience, Certs to Break into DevOps?

Hi folks,

I did post yesterday but it didn't seem get much traction. I'm a developer looking to transition into an entry level DevOps role. I recognise that entry-level DevOps positions generally do not exist, so I imagine I will have to take a sysadmin job for at least a year prior to making the transition. If anyone who broke into the industry with a non technical background, I'd be really interested to hear your opinions.

It seems that to get noticed, as someone with no experience, I am going to need some certifications so as to stand out. As things stand, it seems that the optimal route to an entry level position would be through attaining the following certs:

1. Red Hat Certified SysAdmin (RHCSA)
2. AWS Solutions Architect or SysOps Admin

Would this be enough to land an entry-level position? I've heard conflicting reports that I may in fact need to attain the Red Hat Certified Engineer cert for an employer to take notice. Any recommendations on other potential certs to get me in on the ground floor would be greatly appreciated. This community has thus far been an invaluable source of information on the industry.

Also shout-out to u/Obj_Sea for the thoughtful responses yesterday, they were super informative, thank you!

https://redd.it/jvod2y
@r_devops

Google Cloud vs DigitalOcean for a Kubernetes Cluster

So I'm looking into where to deploy my Kubernetes cluster. DigitalOcean seems soo much cheaper (**$2.49** per day vs **$6.42** per day).

It's hard to find a more concrete comparison. Is Google simply charging for it's brand, or is there something that Google provides better than DO?

https://redd.it/jvq3oj
@r_devops

They put DevOps on everything

You know how Amazon/Azure/etc just attached DevOps to their tools, even though it has nothing to do with the Three Ways. I think this new thing to put DevOps on it is getting out of hand-- I don't think Gene Kim, John Willis, Jez Humble, or Patrick Dubois runs around in these.

[https://www.amazon.com/stores/page/5A4336E8-973C-4FB2-AB5D-021437D578C6](https://www.amazon.com/stores/page/5A4336E8-973C-4FB2-AB5D-021437D578C6)

https://redd.it/jxcxkb
@r_devops

Holy war topic: There is no reason to migrate from bash to zsh or fish

Don't take this question too close. Let's just talk.

I read comparison between bash and fish, bash and zsh, and all of them states about how convenient those shells are. But one thing I wonder is how those shells backward compatible with bash. And seems to be they have average backward compatibility. zsh a bit better compatible with bash than fish is.

I mean, bash is everywhere. So what is the killer feature have those shells to make me switch to them and abandon bash, and bother with all those compatibility issues?

https://redd.it/jxal6g
@r_devops

Promoting docker images from testing to production

I'm currently working on a project to move several services to k8s/docker. Although there are regression tests to some components of the code there's still manual testing done by a QA team when new changes are introduced.

The QA process can take time as sometimes devs have to wait as testers are finishing other tests and give them feedback about bugs, changes, etc.

Changes are tested by deploying in a QA machine and then as the tests pass and approvals are given in the PRs. The person wanting to deploy announces this in slack, merges to master (with a merge commit) and deploys to production (yes, it is not the prettiest but it works).

If anybody else wants to deploy waits for their turn in the chat.

Notice we build twice, first the feature branch is built in QA and then after the merge we build master in Production.

Let's say your changes are being tested and somebody else deploys a hotfix to master, then when your get your approvals you deploy and you will not overwrite the hotfix because we are doing a merge commit and building again.

I would like of course to streamlined this process with docker and also deploy the same image that is tested in QA to Production, thus promoting the image instead of building a new one.

However, if I build only once during the QA process and a hotfix or another feature is deployed in the meantime then I will overwrite this new changes with my older build because it doesn't contain the new changes.

I'm not sure how can I change a process like this besides looking for ways to make the tests faster and even in that case I feel the bottleneck still resides in the QA step.

Have any of you guys faced a similar situation? How do you avoid overwriting changes when promoting your artifacts?

https://redd.it/jxdpkx
@r_devops

Multi repo CI/CD orchestration

Hi Everyone,


We have 8-10 git repos with different components (backend, ECS cluster, other infra, BI tools , integration components and etc)
At the moment, we release every component separately within their own master branches & their pipelines. We at the moment utilize a single CodePipeline with Codebuild per component


What we want to achieve is the following
1) In all repos, our teammates put a tag on all the components that should be included in a Release


2) There is a trigger from JIRA workflow with a metadata to start building

2) Then, some CI/CD tools should check every repo for this git**TAG** being available and start building only those when it is present. So, if we have a git **TAG** only in 6 out of 8 repos, we start only pipelines only for those 6 repos


So far, I haven't seen such solutions
So, I came up with some AWS lambda python script that does checking and put some overrides on the pipelines (override build settings with TAG we want to release & launch them one by one)


How do you cope with such things? Any alternative cons vs pros ?

https://redd.it/jxd96x
@r_devops

Good & Fun Programming/IT Courses/Curriculums for rusty intermediate programmer

I'm an intermediate programmer (Masters&PhD in Computer Science) who hasn't programmed for a while, has a bunch of free time, and wants to improve his skills in programming in general, software engineering, but also DevOps related areas (Docker, Ansible, Kubernetes, ...) in order to keep up-to-date, be more relevant to the job market, be able to better contribute to open-source projects, improve my useful abilities such as self-hosting and programming home domotics, and so on.

The courses can be broad: (beyond-basic) programming courses, Machine Learning, Data Science, DevOps, and so on. Anything that is good, fun, potentially even certified?

I've experience with Java, C, Python, some light DevOps skills, and have done some programming projects and tasks but am a bit rusty.

An example of what I mean are things like The Odin Project, but I was wondering what else is out there.

https://redd.it/jxpbz2
@r_devops

The Phoenix project

I know this book has been discussed many times already on this sub but I'm about halfway through the book and holy shit.. This book has left me speechless. I have had to put the book down several times as I've found myself clenching and unclenching my fist and sweating. It is so eerily accurate, that is what makes it great but also triggering some serious second hand stress.. any other books in a similar style to recommend?

https://redd.it/jxnike
@r_devops

Looking to understand more about JFrog

I'm not a Devop and I admittedly don't understand much about this sector. As an investor, I was hoping to get some knowledge from people here who have used JFrog and their competitors. I know this is kind of off topic, but I've searched high and low and can't find much discussion about JFrog, their product, and their competition from an investment standpoint. Any help would be much appreciated.

I understand JFrog basically helps to ensure continuous software updates, and their Artifactory, Pipeline, Xray and other tools allow them to streamline updates so that they can be rolled out globally on a multitude of different devices. They envision a world of "liquid software" where updates are seamless and done in such a way to work on devices that run different versions. Their partners include 10 of the top 10 tech firms, 8 of the top 10 financial companies, and they seem to have a lot of big time clients. That could imply their TAM is already pretty saturated. Anyway I was hoping to some input from people who have actually used JFrog.

​

* If you've used it, how do you find the product?
* How does JFrog's product differentiate itself from competitors? What do they do that others don't or can't do?
* Who are JFrogs main competitors? Can JFrog maintain a competitive advantage in the years to come?
* How sticky is the product? Is it easy to switch away to something else, or does JFrog dominate this sector?
* Any other tidbits or information you can share about JFrog and your thoughts on it as an investment would be greatly appreciated!

https://redd.it/jxrxtw
@r_devops

What is the best practices of managing software licenses to be used for automation?

I'm thinking hashicorp vault but seems bit overkill. I was wondering if there is best practices to deploy software and apply licenses using ansible. At first I thought of using ansible vault but it will require pulling secrets from somewhere or input by someone and I feel like it's catch 22. Any suggestion or pointers to known methods would be appreciated it.

https://redd.it/jxn14s
@r_devops

Utilizing Terraform Open Source at your Enterprise

My enterprise is getting frustrated with the outlandish cost of Terraform Enterprise when we aren't fully utilizing it. Open Source was shot down (primarily) because of lack of audit trail built in and no SSO (we could survive without that).

Has anyone else tackled this problem with Open Source Terraform and audit logs? How are you solving it?

https://redd.it/jxwqb2
@r_devops

What are the best certifications for someone wanting to go into continuous improvement while also emphasizing DevOps?

I'm currently a grunt when it comes to DevOps stuff. Yeah, I've read "The Phoenix Project" and I've been to a bunch of lectures by people from Netflix and Google...but I really want to find a path that will allow me to have more decision-making power in transforming organizations to improve their IT production processes. I feel that this part of IT organization that resonates with me. Is the answer just "Become a director"?

https://redd.it/jxxj6q
@r_devops

I wrote a couple of blog posts about Last.fm's migration into the cloud!

Hi! I run the engineering team at [Last.fm](https://Last.fm) and I wrote a couple of blog posts about our migration into the cloud. Hope you enjoy, and I would love your feedback.

The first post is about how we migrated our API with no down time.

[https://medium.com/@benxo/last-fm-to-the-cloud-5e1de10ed58a](https://medium.com/@benxo/last-fm-to-the-cloud-5e1de10ed58a)

The second post is about how we migrated the scrobbling simulator which deals with partners such as Spotify.

[https://medium.com/@benxo/last-fm-to-the-cloud-part-2-scrobbling-from-partner-apps-758d1e74033d](https://medium.com/@benxo/last-fm-to-the-cloud-part-2-scrobbling-from-partner-apps-758d1e74033d)

https://redd.it/jy19m4
@r_devops

Can't connect to AWS DocumentDB from AWS Lambda

r/aws was no help... hoping some of you AWS wizards may know.

I have a lambda that is invoked from API Gateway. It takes the JSON it receives and is supposed to write it to DocumentDB. However, I always get "There was some type of catastrophic error, MongoNetworkError, TransientTransactionError" in some form or another in the response JSON.

Before you jump at me:

1. The Lambda has AWSLambdaVPCAccessExecutionRole and AmazonDocDBFullAccess permissions
2. The Lambda and DocumentDB are in the same VPC and have the same security group
3. DocumentDB is set to allow all inbound traffic
4. I am using async await to handle the request/connection to the db in Node js
5. I have the most up to date public TLS certs for the 'sslCA:' parameter

For the life of me, I cannot figure this out. Thank you!

https://redd.it/jy5a6c
@r_devops