"test_pipeline_branch"
# when: delayed
# start_in: 5 minutes
#rules:
# - if: $CI_PIPELINE_SOURCE == "schedule"
# - if: $EVE_TEST_SCAN == "true"https://gitlab-ci-token:$[email protected]/testing/$REPO_NAME.git
Now the issue I am facing with the above gitlab CI example template is that, I've created two scheduled pipelines for the same branch where this gitlab CI template resides, now both the scheduled jobs have 8 hours of gap between them, Conditions that I am using above is working fine for the JobA i.e., when the first pipeline runs it only executes the JobA not the JobB, but when the second pipeline runs it executes JobB not JobA but also the JobB is not able to fetch the artifacts from JobA.
Previously I've tried using \`rules:delayed\` with \`start\_in\` time and it somehow puts the JobB in pending state but later fetches the artifact successfully, however in my use case, the runner is somehow set to execute any jobs either in sleep state or pending state once it exceeds the timeout policy of 1 hour which is not the sufficient time for JobB, JobB requires at least a gap of 12-14 hours before starting the cleanup process.
https://redd.it/1i8driq
@r_devops
# when: delayed
# start_in: 5 minutes
#rules:
# - if: $CI_PIPELINE_SOURCE == "schedule"
# - if: $EVE_TEST_SCAN == "true"https://gitlab-ci-token:$[email protected]/testing/$REPO_NAME.git
Now the issue I am facing with the above gitlab CI example template is that, I've created two scheduled pipelines for the same branch where this gitlab CI template resides, now both the scheduled jobs have 8 hours of gap between them, Conditions that I am using above is working fine for the JobA i.e., when the first pipeline runs it only executes the JobA not the JobB, but when the second pipeline runs it executes JobB not JobA but also the JobB is not able to fetch the artifacts from JobA.
Previously I've tried using \`rules:delayed\` with \`start\_in\` time and it somehow puts the JobB in pending state but later fetches the artifact successfully, however in my use case, the runner is somehow set to execute any jobs either in sleep state or pending state once it exceeds the timeout policy of 1 hour which is not the sufficient time for JobB, JobB requires at least a gap of 12-14 hours before starting the cleanup process.
https://redd.it/1i8driq
@r_devops
Apple DevOps Interview
Hi I have a DevOps Engineer 60 min Interview with Hiring Manager coming up coming up for AI/ML team, wondering how to best prepare? Pls share any advice. Thank you in advance.
https://redd.it/1i8fi86
@r_devops
Hi I have a DevOps Engineer 60 min Interview with Hiring Manager coming up coming up for AI/ML team, wondering how to best prepare? Pls share any advice. Thank you in advance.
https://redd.it/1i8fi86
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
LGTM Stack with TF for AWS Infrastructure with Application Integration Running on AWS ECS Fargate
I'm looking for someone who has worked on something similar where he/she has integrated Current AWS ECS Fargate Application Infrastructure for Metrics, Logs & Traces using TF only with smooth integration + Dashboard creation as well. Something similar to i shared in my recent post.
- Application Running on AWS ECS Fargate
- Grafana Stack : Grafana Alloy running as Sidecar with ECS Tasks + Loki, Mimir & Tempo running on ECS/EKS and AWS Managed Grafana for smooth SSO Integration with AWS for easy Login
- Grafana Dashboard for Metrics, Logs & Traces using TF as well
Deployment using TF Apply only, no clickops approach.
Please let me know if you've done something similar.
Thanks.
https://redd.it/1i8cph4
@r_devops
I'm looking for someone who has worked on something similar where he/she has integrated Current AWS ECS Fargate Application Infrastructure for Metrics, Logs & Traces using TF only with smooth integration + Dashboard creation as well. Something similar to i shared in my recent post.
- Application Running on AWS ECS Fargate
- Grafana Stack : Grafana Alloy running as Sidecar with ECS Tasks + Loki, Mimir & Tempo running on ECS/EKS and AWS Managed Grafana for smooth SSO Integration with AWS for easy Login
- Grafana Dashboard for Metrics, Logs & Traces using TF as well
Seperate consolidated dashboards for all the API where Metrics, Logs and Traces for each of them are coupled in single dashboard Deployment using TF Apply only, no clickops approach.
Please let me know if you've done something similar.
Thanks.
https://redd.it/1i8cph4
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
I Did A "compiler" that can embed folders and files inside
https://github.com/OUIsolutions/Darwin
https://redd.it/1i8hvf6
@r_devops
https://github.com/OUIsolutions/Darwin
https://redd.it/1i8hvf6
@r_devops
GitHub
GitHub - OUIsolutions/Darwin: A Boostrapped lua Compiler
A Boostrapped lua Compiler. Contribute to OUIsolutions/Darwin development by creating an account on GitHub.
GIT CI/CD Suggestions Html Templates inside databases
Hello 👋,
I have 3 databases (system integration testing, staging and production). Each have a table holding html templates for different contract types + specifications.
At the moment there is no versioning on the databases itself, so my suggestion was to version them in git, have 4 branches build, sit, stg and prd. I'm a bit green on CI/CD (work as an system engineer but trying to gain devops knowledge) but my idea was to push to build and then merge to the other branches, then eventually trigger a pipeline to test and deploy on the databases.
I need suggestions on how to organise the repo itself. Ideally the templates should be identical in all 3 branches, at the moment the app is still I'm development, so they are not identical. Considering this, should I just push the html templates on the repo directory or segregate them into different folders sit/, stg/ and prd/ ?
https://redd.it/1i8qrxz
@r_devops
Hello 👋,
I have 3 databases (system integration testing, staging and production). Each have a table holding html templates for different contract types + specifications.
At the moment there is no versioning on the databases itself, so my suggestion was to version them in git, have 4 branches build, sit, stg and prd. I'm a bit green on CI/CD (work as an system engineer but trying to gain devops knowledge) but my idea was to push to build and then merge to the other branches, then eventually trigger a pipeline to test and deploy on the databases.
I need suggestions on how to organise the repo itself. Ideally the templates should be identical in all 3 branches, at the moment the app is still I'm development, so they are not identical. Considering this, should I just push the html templates on the repo directory or segregate them into different folders sit/, stg/ and prd/ ?
https://redd.it/1i8qrxz
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Hey folks Anybody interested in Tech Talk call? We've got Michael Hausenblas - AWS Observability principal, CNCF Ambassador, ex-RedHat Developer Advocate ..
Hey Folks,
Michael Hausenblas https://www.linkedin.com/in/mhausenblas/ will do a call where we will talk about:
Its free event. No payments, No ads.
\- Observability (Open Source solutions, SaaS observability, AWS Observability etc.)
\- Career advices and hiring practices, what are the expectations from modern day DevOps engineer
\- Q&A for various other topics
if you are interested write something in the comments and i'll dm details (alternatively even details in my profile post)
29 Jan, 16:00 UTC (or 11:00 EST)
https://redd.it/1i8s9im
@r_devops
Hey Folks,
Michael Hausenblas https://www.linkedin.com/in/mhausenblas/ will do a call where we will talk about:
Its free event. No payments, No ads.
\- Observability (Open Source solutions, SaaS observability, AWS Observability etc.)
\- Career advices and hiring practices, what are the expectations from modern day DevOps engineer
\- Q&A for various other topics
if you are interested write something in the comments and i'll dm details (alternatively even details in my profile post)
29 Jan, 16:00 UTC (or 11:00 EST)
https://redd.it/1i8s9im
@r_devops
Reddit
From the devops community on Reddit: Hey folks Anybody interested in Tech Talk call? We've got Michael Hausenblas - AWS Observability…
Explore this post and more from the devops community
Need help to resolve this
Hey guys I am Ops engineer in one big MNC so I'll give a background so my manager has asked the team that we need to save a some target given money which was spent on cloud basically doing cost optimization and he asked the team to bring some ideas,
Now I have experience of 1 year under my belt but all my ideas and everything are already in place need some ideas from your vast experience to.reduce the cost and optimize the work flow
Some of the implemented solutions:
1. Start -stop.of server in office working hours
2. Auto deletion of ami or machine images
3. Intelligent tiering
Just to tell we use all three clouds big ones so you can tell for any of those clouds
Any help.will.be appreciated
Please give some ideas for cost optimization and also for automation of some tasks like deletion of amis after certain amount of time has passed
Thanks
https://redd.it/1i8s7vc
@r_devops
Hey guys I am Ops engineer in one big MNC so I'll give a background so my manager has asked the team that we need to save a some target given money which was spent on cloud basically doing cost optimization and he asked the team to bring some ideas,
Now I have experience of 1 year under my belt but all my ideas and everything are already in place need some ideas from your vast experience to.reduce the cost and optimize the work flow
Some of the implemented solutions:
1. Start -stop.of server in office working hours
2. Auto deletion of ami or machine images
3. Intelligent tiering
Just to tell we use all three clouds big ones so you can tell for any of those clouds
Any help.will.be appreciated
Please give some ideas for cost optimization and also for automation of some tasks like deletion of amis after certain amount of time has passed
Thanks
https://redd.it/1i8s7vc
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Should I take on the Associate Devops Engineer role as a fresher?
I'm a 2024 computer science graduate who spent the last 7 months learning Devops and cloud Technologies on my own (linux, Jenkins, Docker, Kubernetes, Terraform, Ansible, AWS, grafana etc). Devops has been the field I wanted to work in and now I managed to crack an interview at a company where they're hiring freshers for the role of associate Devops Engineer (they were particularly looking for freshers but only selects the ones that has a good grasp on for everything works. Interview was kinda hard). I've received the offer letter.
I keep on reading in developer subreddits that you need experience in developer or sysadmin roles to be a good devops Engineer. I have moderate knowledge in springboot framework, and web development in react js (but no industry level experience in neither development nor devops, not even internships). So I'm having second thoughts now whether I should take on the devops offer, they'll provide 3 months training but I'm afraid It'll difficult to switch to any developer roles later (if that's something I want in the future) due to the lack of coding experience.
Was anyone of you in a similar boat? Let me know your experience and how it went after you started your career as a devops Engineer without prior developer roles. Is to a bad idea to start as a fresher in this role or am I just overthinking?
https://redd.it/1i8u7lm
@r_devops
I'm a 2024 computer science graduate who spent the last 7 months learning Devops and cloud Technologies on my own (linux, Jenkins, Docker, Kubernetes, Terraform, Ansible, AWS, grafana etc). Devops has been the field I wanted to work in and now I managed to crack an interview at a company where they're hiring freshers for the role of associate Devops Engineer (they were particularly looking for freshers but only selects the ones that has a good grasp on for everything works. Interview was kinda hard). I've received the offer letter.
I keep on reading in developer subreddits that you need experience in developer or sysadmin roles to be a good devops Engineer. I have moderate knowledge in springboot framework, and web development in react js (but no industry level experience in neither development nor devops, not even internships). So I'm having second thoughts now whether I should take on the devops offer, they'll provide 3 months training but I'm afraid It'll difficult to switch to any developer roles later (if that's something I want in the future) due to the lack of coding experience.
Was anyone of you in a similar boat? Let me know your experience and how it went after you started your career as a devops Engineer without prior developer roles. Is to a bad idea to start as a fresher in this role or am I just overthinking?
https://redd.it/1i8u7lm
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Azure Engineer - Where to go from here?
Azure Engineer - Where to go from here?
Where do you transition to after becoming a System Administrator in Azure? Curious what paths people have taken as I feel my skillset is too broad and not niche.
Syadmin roles have been around forever but what about DevOps, Cyber Security etc?
Was a Sysadmin before now a "Cloud Engineer". Have only been working with Azure for about 5 years though.
https://redd.it/1i8rzof
@r_devops
Azure Engineer - Where to go from here?
Where do you transition to after becoming a System Administrator in Azure? Curious what paths people have taken as I feel my skillset is too broad and not niche.
Syadmin roles have been around forever but what about DevOps, Cyber Security etc?
Was a Sysadmin before now a "Cloud Engineer". Have only been working with Azure for about 5 years though.
https://redd.it/1i8rzof
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Feeling Stuck on What to Study!
Hey everyone,
I’m a junior DevOps engineer, and I’ve been feeling a bit stuck lately when it comes to what I should focus on learning next. I love studying and picking up new skills, but my work tasks aren’t particularly challenging or new, and I’m bound by a specific tech stack—so I don’t really get to experiment with other tools at work.
I’ve already studied the core DevOps tools and concepts
Here’s what’s on my mind:
1- should i learn new tools? but i don't get to use them so i feel it's pointless and waste of time?
2- should i Go deeper into concepts and aspects like container and Kubernetes security, reliability engineering, or advanced troubleshooting.
3- should I explore entirely different areas like AI/ML, distributed systems, or backend fundamentals to expand my knowledge beyond DevOps?
I’m not sure how to prioritize or if I’m overthinking it. What’s worked for you in similar situations? How do you decide what to study to stay sharp and keep growing as a professional?
Would love to hear your thoughts and what you’ve been focusing on lately and share experience
and Thanks in advance
https://redd.it/1i8vdon
@r_devops
Hey everyone,
I’m a junior DevOps engineer, and I’ve been feeling a bit stuck lately when it comes to what I should focus on learning next. I love studying and picking up new skills, but my work tasks aren’t particularly challenging or new, and I’m bound by a specific tech stack—so I don’t really get to experiment with other tools at work.
I’ve already studied the core DevOps tools and concepts
Here’s what’s on my mind:
1- should i learn new tools? but i don't get to use them so i feel it's pointless and waste of time?
2- should i Go deeper into concepts and aspects like container and Kubernetes security, reliability engineering, or advanced troubleshooting.
3- should I explore entirely different areas like AI/ML, distributed systems, or backend fundamentals to expand my knowledge beyond DevOps?
I’m not sure how to prioritize or if I’m overthinking it. What’s worked for you in similar situations? How do you decide what to study to stay sharp and keep growing as a professional?
Would love to hear your thoughts and what you’ve been focusing on lately and share experience
and Thanks in advance
https://redd.it/1i8vdon
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Interview question: a pod is not able to schedule. How do you troubleshoot it ?
This was the question asked in the interview. From that there were many other questions like how do I troubleshoot when there's crashbackloopoff etc. I told every possible way for both the questions like checking events, logs, resource constraints, taint or tolerations, checking liveness and readyness probe, node resource everything. But the interviewer was looking for something different. How would you answer these questions ?
How do you troubleshoot when pod is not scheduling
How do you troubleshoot when there's crashbackloopoff
How do you troubleshoot when remains in pending for large amount of time ?
https://redd.it/1i8x7qe
@r_devops
This was the question asked in the interview. From that there were many other questions like how do I troubleshoot when there's crashbackloopoff etc. I told every possible way for both the questions like checking events, logs, resource constraints, taint or tolerations, checking liveness and readyness probe, node resource everything. But the interviewer was looking for something different. How would you answer these questions ?
How do you troubleshoot when pod is not scheduling
How do you troubleshoot when there's crashbackloopoff
How do you troubleshoot when remains in pending for large amount of time ?
https://redd.it/1i8x7qe
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Need help with the interview process | Mastercard-Bizops Engineer 1
Hi guys,
Have a bar raiser interview coming up. Can someone share what kind of questions can you expect and the subsequent interview process.
Thanks
https://redd.it/1i8xkd1
@r_devops
Hi guys,
Have a bar raiser interview coming up. Can someone share what kind of questions can you expect and the subsequent interview process.
Thanks
https://redd.it/1i8xkd1
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Random referrals? Via LinkedIn
not the typical devops post but since i am in a junior role, curious how more senior devops engineers would handle this.
I work for a small company, every one mostly knows everyone, even if its just on an on name basis, less than 100 folks.
They opened up a new senior position for a front end engineer/ux designer.
I get a random message on LinkedIn from someone asking for a referral for the role.
I dont know the person, but upon further digging, i did notice this person knows my brother and went to school with my brother. I know they had a friendship at some point, to what degree, no idea.
I dont talk to this person and I dont know this persons skill set.
How would one go about this? I recently saw the message and i feel like i am in an awkward position. If he bombs the interview, I don’t want to be seen as someone who refers bad talent. He could be good at his position, and a referral bonus would be nice but I wouldn’t know, I’m not front end savvy.
Has anyone dealt with something like this previously?
https://redd.it/1i902vb
@r_devops
not the typical devops post but since i am in a junior role, curious how more senior devops engineers would handle this.
I work for a small company, every one mostly knows everyone, even if its just on an on name basis, less than 100 folks.
They opened up a new senior position for a front end engineer/ux designer.
I get a random message on LinkedIn from someone asking for a referral for the role.
I dont know the person, but upon further digging, i did notice this person knows my brother and went to school with my brother. I know they had a friendship at some point, to what degree, no idea.
I dont talk to this person and I dont know this persons skill set.
How would one go about this? I recently saw the message and i feel like i am in an awkward position. If he bombs the interview, I don’t want to be seen as someone who refers bad talent. He could be good at his position, and a referral bonus would be nice but I wouldn’t know, I’m not front end savvy.
Has anyone dealt with something like this previously?
https://redd.it/1i902vb
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Datafile Management for tablespaces in Oracle 19c
Hello everyone, I hope all is well.
I've been facing an issue for the past few days where there is a PL/SQL code that is causing temp tablespace issues where sometimes it gets stuck on the parallel execution and the temp tablespace just gets fully consumed. Note that the allocated storage for temp is around 500GB. I am using AWS RDS runing on oracle 19c as my database and I've noticed that RDS allocates 1 datafile of size 500GB for the entire temp tblspace.
So I have the following questions:
1-Does having multiple smaller datafile for a tablespace actually enhance performance? And would creating 10 datafiles of 50GB each actually up performance? And would that be at the level of execution time or would it actually help solving the issue mentioned above?
2-Does AWS RDS have an easy way to set this up as I know that RDS is serverless and we do not actually have access to the backend servers and I couldn't find any detailed documentation regarding this
https://redd.it/1i91p0t
@r_devops
Hello everyone, I hope all is well.
I've been facing an issue for the past few days where there is a PL/SQL code that is causing temp tablespace issues where sometimes it gets stuck on the parallel execution and the temp tablespace just gets fully consumed. Note that the allocated storage for temp is around 500GB. I am using AWS RDS runing on oracle 19c as my database and I've noticed that RDS allocates 1 datafile of size 500GB for the entire temp tblspace.
So I have the following questions:
1-Does having multiple smaller datafile for a tablespace actually enhance performance? And would creating 10 datafiles of 50GB each actually up performance? And would that be at the level of execution time or would it actually help solving the issue mentioned above?
2-Does AWS RDS have an easy way to set this up as I know that RDS is serverless and we do not actually have access to the backend servers and I couldn't find any detailed documentation regarding this
https://redd.it/1i91p0t
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
yml.j2 formatters
Are there any formatters for yml.j2 and any other yml files?
Also, how do you format yml files on Linux machines from the cli?
https://redd.it/1i92tv6
@r_devops
Are there any formatters for yml.j2 and any other yml files?
Also, how do you format yml files on Linux machines from the cli?
https://redd.it/1i92tv6
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Article about the number of pipelines
Hello,
I am building a new product, and I want to challenge my usual takes over CICD pipelines, and I am specifically trying to determine how many pipeline do I want.
So I have been searching for resources talking about this, but I have really hard time finding any. I can find 50 articles explaining what is CICD and IAC, another 50 will talk about the different possible tools. And they are always in a very silo philosophy: "Here the info if you want to do IAC pipeline", "here the info if you want to do app pipeline".
But I can not find anything talking about the more global pipelines.
I am looking for example for thing like the values of 1 pipeline for the IAC + 1 per product versus 1 pipeline for everything, or anything in general that consider. Or anything that can be related to the fact that IAC and App are not leaving in their own silo but are totally mingle and the pipeline will be at some level.
So I was wondering if you had good article talking about this?
https://redd.it/1i93oag
@r_devops
Hello,
I am building a new product, and I want to challenge my usual takes over CICD pipelines, and I am specifically trying to determine how many pipeline do I want.
So I have been searching for resources talking about this, but I have really hard time finding any. I can find 50 articles explaining what is CICD and IAC, another 50 will talk about the different possible tools. And they are always in a very silo philosophy: "Here the info if you want to do IAC pipeline", "here the info if you want to do app pipeline".
But I can not find anything talking about the more global pipelines.
I am looking for example for thing like the values of 1 pipeline for the IAC + 1 per product versus 1 pipeline for everything, or anything in general that consider. Or anything that can be related to the fact that IAC and App are not leaving in their own silo but are totally mingle and the pipeline will be at some level.
So I was wondering if you had good article talking about this?
https://redd.it/1i93oag
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Trigger jenkins build when Pr descrption is edited or changed
Hi,
I need to trigger a jenkins build when the description my PR is updated. Is it possible?
https://redd.it/1i95jwn
@r_devops
Hi,
I need to trigger a jenkins build when the description my PR is updated. Is it possible?
https://redd.it/1i95jwn
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Seeking advice on Interview content when switching roles to Systems Engineer / Devops roles.
I have been in professional services for almost longer time around 5 years, now seeking roles and giving interview for Devops / System engineering roles.
How should one even prepare and i am not talking about the tech stack, i know ansible / aws / openstack / linux and terraform / cfn for Infrastructure as code.
The questions that really throws me off in the interview, are something like below ,
1. How do you do version control ? ( thats the only effort interviewer made while explaining ) - My answer was tools like github, git ( turns out is wrong )
2. There is no order, data is store randomly at different places ( How will you bring order or how will you create process to handle large number of data )
Is there some kind of hidden syllabus or learning content that i am missing ? I clear tech with flying colors but shit like above fails me in interviews ? What am i missing ?
https://redd.it/1i9cqin
@r_devops
I have been in professional services for almost longer time around 5 years, now seeking roles and giving interview for Devops / System engineering roles.
How should one even prepare and i am not talking about the tech stack, i know ansible / aws / openstack / linux and terraform / cfn for Infrastructure as code.
The questions that really throws me off in the interview, are something like below ,
1. How do you do version control ? ( thats the only effort interviewer made while explaining ) - My answer was tools like github, git ( turns out is wrong )
2. There is no order, data is store randomly at different places ( How will you bring order or how will you create process to handle large number of data )
Is there some kind of hidden syllabus or learning content that i am missing ? I clear tech with flying colors but shit like above fails me in interviews ? What am i missing ?
https://redd.it/1i9cqin
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Google interview tips
Hi guys, give me tips on how to crack the Google DevOps Engineer role. How many roles will there be, and what kind of programming will they ask? Before that, how can I get my resume shortlisted? I’m from a Tier 3 college. will they accept it?
https://redd.it/1i9ei5m
@r_devops
Hi guys, give me tips on how to crack the Google DevOps Engineer role. How many roles will there be, and what kind of programming will they ask? Before that, how can I get my resume shortlisted? I’m from a Tier 3 college. will they accept it?
https://redd.it/1i9ei5m
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
What's the best way to check the package.json version in the origin/master branch and compare it to the current local branch?
What's the best way to check the package.json version in the origin/master branch and compare it to the current local branch? Are there ways to do this? I tried to find some libraries, but I was out of luck.
https://redd.it/1i9kxpm
@r_devops
What's the best way to check the package.json version in the origin/master branch and compare it to the current local branch? Are there ways to do this? I tried to find some libraries, but I was out of luck.
https://redd.it/1i9kxpm
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Can you help me navigate: Workspaces vs Environment Variables?
Hi everyone,
Currently, our project structure looks like this:
This setup makes it easy to see what exists in each environment. However, as we’re now ready to mature our workflow, I want to DRY up our resources.
The primary difference between
I’m considering moving away from the
One option is to use Terraform Workspaces to handle environment differences. Alternatively, we could pass an
Is there a strong reason to favor one approach over the other, or is there an alternative I should consider?
This is my first time leading this kind of effort, so while I’m confident in these ideas, I’d appreciate any advice to navigate this transition effectively.
https://redd.it/1i9lgc0
@r_devops
Hi everyone,
Currently, our project structure looks like this:
/dev/service_name/main.tf
/prod/service_name/main.tf
/prod/main.tf
/modules/shared-resources/resources.tf
This setup makes it easy to see what exists in each environment. However, as we’re now ready to mature our workflow, I want to DRY up our resources.
The primary difference between
dev, prod, and staging environments—aside from which services are deployed (which I’m working to organize)—is the environment variables passed in. We’ve done a good job of centralizing environment variables (with some default configs still inherited from a higher-level /data repository), making them effectively the control plane for the entire infrastructure. I’m considering moving away from the
dev/prod directories to a structure that allows for deploying all services with less code. For example, we could migrate to: /service_name/main.tf
One option is to use Terraform Workspaces to handle environment differences. Alternatively, we could pass an
$ENV variable to determine the deployment target and handle this via our existing Justfiles (which are like cleaner Makefiles - we have bash scripts that does any heavy lifting that needs doing before we call Terraform, or anything Terraform is not particularly good at). In CI, we’d SSO into the appropriate dev/prod account via the Justfile and apply changes accordingly. Is there a strong reason to favor one approach over the other, or is there an alternative I should consider?
This is my first time leading this kind of effort, so while I’m confident in these ideas, I’d appreciate any advice to navigate this transition effectively.
https://redd.it/1i9lgc0
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community