Tips for a new learner for terraform / Kubernetes / docker

Hey everyone , i’am new to devops , where do i learn terraform / docker / kubernetes and ci/cd for free with hands on practice ? Thanks everyone


While you’re at it , how do i become really good and knowledgeable in this field ?

Thank you so much everyone

https://redd.it/1e7unz7
@r_devops

CI/CD configs IN App Repos?

Do you keep CI/CD configs in the same repo as your application / service code where devs can manage them? A few teams in my org have recently started using CircleCI on their own and set up their own pipelines in each app repo. I can understand if it was just for building or pre-deploy stages that are more application specific, but these are full CICD pipelines. They aren't consistent across the repos now which makes troubleshooting a nightmare, and I've also found that some of our standard SDLC steps like linting, validation, testing, vulnerability scanning, and so on are missing. Not to mention skipping review requirements and dual approval. There is nothing stopping someone from adding a pipeline that just deploys straight to production. I raised these concerns with our head of engineering who argued that it is necessary to empower the devs to ship as fast as possible. Am I making a stink for nothing?

https://redd.it/1e7w0p6
@r_devops

GitLab with Argo CD

Are there alternative approaches to updating Argo CD Helm chart values in GitLab CI/CD?

script:
- git clone [email protected]:guestbook-toshiro/argocd.git
- cd argocd/$SERVICE
- envsubst < base-values.yaml > values.yaml
- git add .
- git commit -m "Update $SERVICE to version $IMAGE_TAG"
- git push

https://redd.it/1e81uc9
@r_devops

Managing secrets, certs and other sensitive data

What tools are you using for managing secrets, certs and other sensitive data. How did you go about implementing it and what were some of the lessons learned as you implemented it?

https://redd.it/1e83fbo
@r_devops

Is this course a good introduction to the field? IBM DevOps and Software Engineering Professional Certificate

I'm starting my first job as a DevOps Engineer in a few weeks and I want to get a complete picture of what a role like this might involve in terms of tools & tech, methodologies etc.

Does this provide a good overview of the field? https://www.coursera.org/professional-certificates/devops-and-software-engineering?

Note: I'm a CS graduate without prior DevOps role experience.


Any other suggestions for the intended purpose will be greatly appreciated!

https://redd.it/1e854m0
@r_devops

Environment Inventory

I am looking for a tool that my team can use to house dev and test environment details. Such as links, status, associated database details, and other details a client or engineering team will need to know. Those teams rely on our in house solution for this like a landing page to access environments. Something customizable and self hosted.

Our current in house solution uses a source controlled YAML file per environment. It works but is difficult to maintain.

Anyone use something like this that could recommend an alternative?

https://redd.it/1e87buz
@r_devops

I want to build my own Vercel domain manager

Many PaaS services offer a “connect your domain with deployment” feature. Typically you simply add a CNAME DNS entry and then everything works automatically. It’s possible to reconnect the deployment in seconds.
How does it work technically? What services are involved.
I’d like to build something similar. Basically what I want is have one entry point and then a database that redirects the traffic based on the hostname to another server. As far as I know, Vercel is not using Kubernetes.

https://redd.it/1e85x1q
@r_devops

What IaC solution should I use for my company's use case?

I am newer to the devops world, and have moved from a developer role into a more technical devops role. Part of my task in this role is to help decide the companies future with IaC.

# Needs/Use Case

* Be able to spin up and tear down mainly windows VMs and potentially other infrastructure in Azure (and potentially also VMWare) using yaml pipelines
* Have the ability to configure these machines into a state for testing of large on premises applications
* this means being able to install applications both 3rd party and internal apps/builds on machines (this often means the VMs need to be able to restart to finish certain installs)
* settings of all sorts of settings (firewall, registry, users/groups)
* Being able to then delete these VMs and all associated resources
* Keep in mind these steps will run on every test run in an AzuerDevops yaml pipeline. (CreateVMs -> ConfigureVMs for functional tests -> Run Functional Test -> Delete VMs)
* so something with low overhead would be great
* Be able to be templatized within AzureDevops pipelines to allow a custom interface to creating Infra, the company does not want to give direct access to all possible infra to developers **(our end users in this case)**

# Current Approach

* Currently someone wrote an internal tool in powershell that leverages az cli to do creation and deletion of infra in azure
* And for configuration there is a whole custom powershell engine that requires a remote agent for each VM that it will configure and does a bunch of custom configurations steps by using PSSession to install and configure things on the remote machine.
* Limitations of this approach (why do we need to change)
* The current Powershell based configuration engine was written by one person who does not actively work on it anymore, and when anything breaks it can be very confusing to know how to fix
* For the same reason, its hard to add more features
* It doesn't scale particularly well as we need one configuration agent for each machine that we are configuring (and there can often be 10s to 100's of machines needed for a full test suite)

# My Questions/Thoughts

* What tool(s) would you recommend for this use case?
* Should we stick with our custom tooling? (Because I come from a development background, I have the ability to rewrite and simplify the engine to make it potentially scale better and be easier to extend going forward)
* I don't have a real understanding if our use case is what IaC would typically be used for, so do tools like Terraform, Ansible, Pulumi, etc support this use case? And if so which would you recommend.
* Whatever we decide I want it to be able to scale for a large number of VMs (not needing an agent for every machine we want to configure) and to be easy to maintain both from the DevOps side, and from the Developers side who need to write their configuration
* Most of our devs are C++ or .NET developers and can really struggle with complex yaml

Thanks in advance for any feedback! I am really just trying to learn what the industry standards for these types of things are so we can be on the "happy path" rather than trying to fight an uphill battle.

https://redd.it/1e8cjah
@r_devops

Looking for Jira alternatives for non-tech related business

Hello,
I work in a field where we are constantly meeting new people (sometimes already know them) and need to put them into a database of some sort. It needs to have a way to log "incidents" related to these people. Attachments are a must, and it needs to have a way to put certain incidents in a "status".

I have been using Jira for this, but I know it is not designed for that. I am wanting to see if there is something else out there that would better fit my purposes. I have also tried Azure DevOps and YouTrack.

Sorry if this isn't the place to ask, it's kind of a weird question that doesn't fit in anywhere.

Thanks

https://redd.it/1e8dcy9
@r_devops

Pipeline deployment strategy

I have a yaml pipeline that currently hard codes the parameters file that is passed against my template.

The build and deploy work fine, but it doesn’t scale to the next parameters file. I want to deploy the same template but pass different parameters.

I am trying to wrap my head around how this is to be done. Is the right strategy to have a pipeline per infrastructure component or is it better to pass the parameters file as a parameter field?

I started down a path of when a new bicep param ends up in a specific folder it triggers the build, but this seems overly complicated.

Is there a better way to handle this

https://redd.it/1e8emm6
@r_devops

Product - Deployment Strategy for different clients

Hi Folks,

I’m seeking your input on the following scenario regarding our deployment process.

# Product Stack:

Backend: Golang
Frontend: React
CI/CD: GitHub Actions
Infrastructure: Oracle Cloud
Containerization: Docker-Compose
Container Management: Portainer

# Current Workflow:

1. Manual Configuration:
We maintain a backend configuration file (`backend.yml`) that contains client-specific URLs.
For each deployment, we manually update the endpoints in backend.yml for different clients, which is time-consuming and error-prone.
2. Build and Deploy:
Using GitHub Actions, we create a Docker build.
We then update the Portainer stack using a Portainer webhook, which pulls the images from GHCR and updates the stack.

# Objectives:

Automate the configuration management for multiple clients to eliminate manual edits.
Deploy a single branch for all clients while ensuring each client gets its respective backend configuration.


Any idea how efficiently we can achieve this

https://redd.it/1e8hjxh
@r_devops

Running queries on production

Hi,
We are a small company in a heavily regulated space with tons of vendors. We usually face this issue of wrong data in our system and have to manually correct it. We used to raise a PR for migration in an repo and use pipeline to run it on prod but we are not allowed to do this if there's PII data (as Github has servers outside our country, so regulation forbids) involved in the query which is usually the case.

Looking for some solution which can help put approvals on the queries, maintain audit logs and if PII then it needs to reside in the country.

https://redd.it/1e8hch5
@r_devops

Best practices to deploy terraform

What are the best practices deploy infrastructure with terraform through pipeline?

https://redd.it/1e8iebc
@r_devops

👋 Hi dudes! I built my first React JS app all of your feedback means a lot to me and it can help develop my skills

https://goliathreaper.github.io/Procrastination/

https://redd.it/1e8jkda
@r_devops

Do you also create resources in Kubernetes with Terraform?

hello. I'm a beginner.

I'm trying to configure Kubernetes for the first time to deploy my website.

I've created a managed kubernetes from a provider called vultr via terraform and installed the necessary helm charts. So far it's been pretty smooth and easy.

But my question is, do you register all the yaml files of the application after that through terraform?

The existing yaml and tf files are formatted differently, so it's quite a hassle to port them over. I'm thinking it might be easier to just use kubectl apply instead of terraform from here on out.

What do you guys think? What is your general choice when setting up Kubernetes with Terraform?



https://redd.it/1e8jipc
@r_devops

Anyone hire someone right out of school for DevOps?

If so, how did it go? My team is considering hiring for an associate/fresh grad.

https://redd.it/1e8llwd
@r_devops

Jenkins Structure

I am a QA and never used Jenkins, but trying to learn it. Now I have more answers than questions. Please help me with the following: If you use Maven, you have a zipped version of your project on the main repo after you do mvn deploy, so how does Jenkins use that? Secondly, if you already have a JAR, why do you need access to GIT. There is no compiled code there? Thirdly, how can continuous integration happen all the time, if you build if you install and deploy only some times?

https://redd.it/1e8o4kp
@r_devops

Does it make sense to base your entire career about Kubernetes?

Worked as a DevOps engineer for 3 years now. Gained great experience with AWS Infrastructure, Terraform, Docker, bash scripting, CICD via Github Actions. Touched Kubernetes a little bit, but now going for my CKA and want to get a lot more proficient in it.

Just wondering if there are any of you that have a role that is almost entirely based around K8s, or do you just see it as another tool you use, rather than a specialisation of your career/future prospects?

I'm also really interested in improving my Go skills, as I really like Cloud Native products and the whole culture around open source with the Linux Foundation.

https://redd.it/1e8pz2f
@r_devops

What are some good slack communities for dev ops help?

Not just looking to get help and leave. I think I can contribute. I find myself coming to reddit/stack overflow when I'm stuck and a slack community would be great.

https://redd.it/1e8rlzc
@r_devops

Can you help audit my nodejs dockerfile?

This docker image takes forever to build every time, even when the change is minor. I was trying to download dependencies in earlier layers in order to avoid running \`npm i\` every time, but it seems like it doesn't work.

FROM public.ecr.aws/lambda/nodejs:20

RUN dnf update
# this lambda has a python co-dependency for music21. These deps are needed for that.
RUN dnf install -y python3 pkgconfig libX11-devel libXi-devel make gcc g++ mesa-libGL-devel

RUN npm i typescript -g

RUN mkdir -p /tmp/app
COPY . /tmp/app
RUN cp /tmp/app/canela-medium.ttf ${LAMBDA_TASK_ROOT}/canela-medium.ttf
RUN cd /tmp/app && npm ci
RUN cd /tmp/app && rm -rf test
RUN cd /tmp/app && npm run build -- --outDir ${LAMBDA_TASK_ROOT}

# Running npm in task root up front should reduce rebuild-time to only typescript compile (hopefully)
RUN cp /tmp/app/package*.json ${LAMBDA_TASK_ROOT}
RUN cd ${LAMBDA_TASK_ROOT} && npm ci --omit=dev

RUN rm -rf /tmp/app

WORKDIR ${LAMBDA_TASK_ROOT}

# Set the CMD to your handler (could also be done as a parameter override outside of the Dockerfile)
CMD [ "index.handler" ]

I don't think it's the packahge-lock. It doesn't change much.

https://redd.it/1e8s6nj
@r_devops

what resumes are getting interviews?

hi friends. I was a devops engineer for 6 years working as a federal contractor doing mostly build automation and working closely with development teams. I have been out of the market for 2 years due to health reasons and my resume hasn't gotten picked up for any interviews the past two months. I'm super passionate about automation and have the programming background to do it. I'm confused on how to showcase my skillset to at least get an interview. please help.

https://redd.it/1e8wyqp
@r_devops