Modern Build/deploy strategy should always be artifact based.

Opinionated poll.
I'd like to posit that any modern build/deploy strategy should be artifact based.

e.g. given a branch we want to test (in any number of "environments") and get to production, we build once, create artifacts and deploy those I'm a repeatable way to each environment (automated preferably) including prod.

View Poll

https://redd.it/pzkkax
@r_devops

Step by step process on how to improve a docker image using highly custom boxes?

Step by step process on how to improve a docker image using highly custom boxes? It's easy to create a node.js docker container, but it's hard to improve an existing wordpress docker container using highly custom docker images. Is there a step-by-step process that allows you to debug and build upon an existing box? Another thing is that sometimes you have a box using ubuntu. Does that mean all your other boxes need to use ubuntu? Could you give me some insights as to how to do this? I noticed that sometimes when I do docker compose exec php bash, I can't access the folders of the other containers, shouldn't they be in the same virtual O.S.? How come this is possible and can you build docker containers using highly disparate images using different O.S. (like combining an ubuntu image with an alpine image)?

https://redd.it/pzk1r8
@r_devops

CloudGraph: an open-source GraphQL powered search engine for your AWS infrastructure

CloudGraph is an open-source search engine for your public cloud infrastructure, powered by DGraph and GraphQL. Within seconds, query assets, configurations, and more across accounts and providers. CloudGraph also enables you to solve a host of security, compliance, governance, and FinOps challenges in the time it takes to write a single query.

We currently support select services on AWS, with more added each day. Support for Azure and Google Cloud coming soon. We’re also looking forward to contributions from the community and have endeavored to make contributing new providers and services as simple as possible.

We would love any feedback you have!

https://redd.it/pzbdxa
@r_devops

Terror with Build YAML! Looking for recommendations!

Hello all,

I work in DevOps at what I'll call a middle sized software company (\~400 employees total \~150-200 repos for all products combined). Our DevOps group manages the build processes on these repos for our \~50 devs. We recently moved up to Azure DevOps from an internally hosted TFS.

We decided to move from task groups to handle builds, to using Build YAML. Seemed to have some benefits at first. We are slowly discovering the hassles associated in needing to touch every single repo's build YAML when we decide on a small change in process/uncover an issue.

With that background out there, I am hoping to get some input from others in potentially a similar scenario (or even from a significantly bigger or smaller company) on how you manage builds on your repos.

We have discussed moving back to taskgroups, or having a centralized YAML file for different builds (webs, APIs, etc) in our DevOps repo. I'm looking for ideas along with potential benefits.

Thanks!

https://redd.it/py11s4
@r_devops

Deloitte/Big 4 Training Process?

Hey guys I recently just accepted an offer with Deloitte consulting on their GPS team (Government and Public Sector) as an AWS DevOps Specialist. I have experience working at a small consulting firm as I was contracted out to the government for a 6 month project. The project was mainly maintenance and not deployment/implementation and ended in February. Since then, my company hasn't been able to find another project for me and so I've been out of DevOps work for the past 8 months (good thing i'm salaried).

My question is, does Deloitte train you for the project you'll be working on? Im a pretty quick learner and am very adapt to change so I can pick up various tools I haven't learned yet within a couple of days. I have a solid foundation of the devops tool stack but like I said, I haven't worked with Ansible, Jenkins, Docker or Kubernetes in almost a year. Should I be worried? What can I expect in the first 3-6 months?

Any information is helpful. Tips/Tricks for Deloitte are also welcome. Thanks in advance

https://redd.it/py4ony
@r_devops

REST API monitoring solution

Hello, I'm in the process to build a REST API monitoring solution for a set of API...

What I need to extract are few parameters/statistics for:

- response time
- response code
- uptime
- # of endpoint calls

I was reading that this can be done with Prometheus and Gafana.. is this true?

If this is the right teck stack, how do I start? Do I need to put an agent in my api's endpoints?

Thank you all

https://redd.it/py170y
@r_devops

Prevent code from being pushed via arbitrary controls on github actions

Hi there,

Sorry for the (probably) dumb question, i'm super newbie in this field and was wondering if there are tools to make automatic checks on the code that is pushed to GH, for example if I wanted to add as a criteria "no Go functions that start with foo", if someone pushes from any branch a code containing "func fooSomething", it would be automatically rejected.

Could you please help me? Thanks in advance!

https://redd.it/pzuub1
@r_devops

Next steps in devops career

Hi all,

I am currently a devops engineer with a strong focus on cloud and automation. I am earning very well for UK standards and it's unlikely that I would be paid more where I live any time soon even if I were to leave my current company.

However, I am still quite early in my career and I would like to plan for what I need to do during the next few years to be able to reach for these higher salaries. I think I might have to make some changes to my career but it is not clear to me what direction I should take and what these changes would be. Before anyone suggests, I am not interested in going into management. What is the career progression path for devops? What is at the end of this path? How can I make myself more valuable on the job market? I already hold some certifications in the tools we use.

Any related suggestions would be welcome.

Thanks

https://redd.it/pzujdo
@r_devops

Need help introducing Terraform in our K8S deployment workflow

Hello redditers,

I am a backend ruby developer a small company. Last year, we moved away from Heroku to a GKE hosted Kubernetes cluster. So I have been transitioning into becoming a devops guy week after week, discovering tools and best practices as I went along.

So far, we have been using a messy bash script called from the CI to automate things like helm and kubectl deployment. Our main app contains a k8s directory with all the yaml files, etc.

Lately, I started looking at Terraform to manage and track the cluster's state. I had done all the configuration by hand, either clicking around in the Google Cloud console or using the cli. I have followed a quick Terraform udemy course and I am now in the process of importing our environments in Terraform states. I have set up an infrastructure repo (we are on gitlab) with a CI that validates, plans and applies the configuration. It is now live and working.

Now I need to know where the limit is. I have seen that Terraform can manage Helm and Kubernetes and I have started importing cluster-level services like prometheus, grafana, and our traefik ingress using the helm and kubernetes providers.

I think this is ok, since we are managing services that are tied to the clusters: if we need an environment, we definitely need monitoring, etc. set up.

But what about the apps? I have seen blog posts advising to stick to kubectl commands, but maybe this was before the kubernetes provider hit 2.0, and before the beta feature that allows for CRD deployment... I see two options:

- Keep a k8s directory in the apps. The app's CI will then be in charge of packaging the app and the deploy stage will be a series of kubectl and helm commands.
- Externalize the deployment by manually editing the infrastructure project whenever there is a change in pod count, new services, etc. - but that seems complex because I need to keep track and sync the two projects. The app's CI would just run kubectl rollouts to update the images.

What is the best practice here? Is there a third way?

(cross-posting this to devops and terraform subs)

https://redd.it/pzoxia
@r_devops

Reviews on Techworld with Nana devops bootcamp

Can anyone please throw light on Techworld with Nana bootcamp and if it had helped someone to transition to a devops role?

https://redd.it/q00vuu
@r_devops

Resume Review for a DevOps/Cloud related internship

Hey all,

Expected to graduate Dec 2022, looking for an internship or possibly a jr level position related to DevOps/Cloud. Would just like to upload my resume here and see if anyone has any tips that could help. Thanks

https://redd.it/q04nae
@r_devops

Logging aggregation using a specific docker app

Hello , Is there any docker app that sutomatically runs on docker host and Is able to capture all logs of all containers running on this specific host and display them via web? I nave a suite of 4 docker running inside a docker-compose environment , and i like to have an additional docker-compose service that Is able to gran all logs and display them in a Simply web interface

https://redd.it/q05jt6
@r_devops

Best way to create a log for api

Hello,

I need to admit that I'm not that skilled in coding, hence I typically outsource my IT developed to 3rd party...

I have a company that does backend stuff and another that does front-end...

Clearly in between there are APIs :)

Backend blames front-end for performance and vice versa...

Now I want to check myself and create a little "ping" application, recording in a log the results such as:

- time of ping
- response time
- response code (200, 401 etc...)
- is body response empty or not...

Where do I start? Please

Note: at the moment I'm using VS code "REST API" extension for individual tests...

Thank you :)

https://redd.it/q0dxro
@r_devops

🔥 When Jenkins deployment goes wrong in DevOps

https://youtu.be/MT5zPMGcB1o

🔥 When Jenkins deployment goes wrong in DevOps

Jenkins is an open source continuous integration/continuous delivery and deployment (CI/CD) automation software DevOps tool written in the Java programming language. It is used to implement CI/CD workflows, called pipelines

See what happens when Jenkins deployment goes wrong in DevOps...

https://redd.it/q0jbji
@r_devops

Where do you host your CI/CD tools that involves iOS development (Xcode)? I want to move my local hosted Jenkins

Where do you guys host your CI/CD tools that involves iOS development? Because, I want to move my local hosted Jenkins to the cloud, but I saw that Mac's VPS are too expensive for my personal (hobby) projects. Do you have any suggestions?

https://redd.it/q0jzue
@r_devops

Learning path

Hello everyone,

I am 18 years old, looking forward to learn about DevOps (I know this is a methodoly of work, but in terms of tools and concepts). What do you recommend to learn to start entering this field? I have been using Linux Ubuntu for almost a year, some Git and watch some tutorials of Docker, Jenkins and Kubernets.

Thank you.

https://redd.it/q0k50h
@r_devops

How to know if the progress made is good progress?

I have been DevOps Intern for six months since July 2020. I have been full time DevOps engineer in same company till date.
My working hours have been different in different times. In all this time, I have gained 2 AWS certifications(CCP and SAA-C02). I have experience with containerization using docker as a tool, kubernetes for orchestration. Experience with AWS as well. I am proficient in use of Terraform for IaC. I can write decent python scripts as well. I also have experience with CI/CD in AWS.

I know I am blaberring about tools, but these are what I worked with.
Last but not the least, I know DevOps is not about tools, its about culture, and I get the big picture, design of resilient architectures, security, etc. And I am gaining experience with those as well.

The problem is here, I have a very small team where I work. So, in a way, I don't know if what I am learning is actually what is used in real world. Seems like I have way too less exposure. And all new job descriptions expect high level of experience in such roles. And I feel that maybe I haven't progressed at all, or maybe for my experience I should be doing something crazy.

TLDR: need a review/evaluation of my profile/progress to know if its good skills/ what all more is needed and how much would companies be willing to pay me for my current skills

https://redd.it/q0na38
@r_devops

I built an open-source GraphQL powered search engine for your AWS infrastructure.

Hey all!

CloudGraph is an open-source search engine for your public cloud infrastructure, powered by DGraph and GraphQL. Within seconds, query assets, configurations, and more across accounts and providers. CloudGraph also enables you to solve a host of security, compliance, governance, and FinOps challenges in the time it takes to write a single GraphQL query.

CloudGraph currently supports select services on AWS, with more added each week. Support for Azure and Google Cloud is coming soon as well. I'm also looking forward to contributions from the community and have endeavored to make contributing new providers and services as simple as possible.

I posted about my OSS project on r/aws on Friday and was truly overwhelmed by the support I received there so I thought I might share it here too in the chance that anyone finds it useful and would be willing to provide me with feedback. I figured there might be some users here who are not a part of that sub?

Anyways, I would love any feedback you have! Not looking to self-promote just genuinely want to get feedback on how I can make this better and more useful for fellow dev/sec/ops folks and hear about potential usecases. In particular, are there any features/providers/capabilities that would be cool to add? Thank you so much for your help - it's hard to get a new project off the ground so your ideas mean a lot!

https://redd.it/q0nn1a
@r_devops

How Much do you make?

Curious about those of you with strong programming skills and strong ops skills. What's your level (junior, mid, senior, staff), salary, total comp and where do you live? I'll go first:

Senior, $215k, $310k, Seattle

https://redd.it/q0owef
@r_devops

Do you need to know how to code to be a DevOps Engineer?

A topic I see come up regulalry, particularly with people in traditional sysadmin roles or operational roles is whether or not they need to know how to code, and if so, to what degree.

In this post I lay out my thoughts on the matter, the value of knowing how to code - if it's required at all - and whether or not it's really coding that's the important facet.

You can read the article here: https://brailsford.xyz/2021/09/do-you-need-to-know-how-to-code-to-be-a-devops-engineer/

As a complete aside, I'm trying to get into writing my thoughts on technical subjects down, this being my first attempt. As much as I welcome discourse on the subject matter, feedback on the writing style, presentation, etc. is more than welcome too! :)

https://redd.it/q0s56g
@r_devops

Cheaper hosting options for headful Puppeteer?

Hello dev op engineers.

I made a Puppeteer app that needs to run in headful mode since it's recording audio/video. For those that don't know, Puppeteer is just a tool to spin up chrome and do things automatically via code. Headful means that it will open it just like you or I do on our desktop, headless meaning it just simulates it in the background but you never actually see it.

Anyway, in order to host this I've just been using an Azure VM, but this is really expensive. Even when when running it on an Ubuntu Server VM with Xfce, the lowest I can turn down the VM to until it can't open chrome and load pages in a timely manner costs about $50/month.

Anyone know of a cheaper way to host this? Or is the fact of the matter just that if a host needs to be powerful enough to run a desktop like Xfce and open the chrome browser, it's going to be about this expensive?

https://redd.it/q0x5xh
@r_devops