A fully free alternative to Ansible for android?
omething like ansible but for Android devices? For free
There's the android enterprise management, but at a first glance it seems to be all paid, you need to subscribe to a certified provider with closed doors pricing and feature
https://redd.it/1dp6ykh
@r_devops
omething like ansible but for Android devices? For free
There's the android enterprise management, but at a first glance it seems to be all paid, you need to subscribe to a certified provider with closed doors pricing and feature
https://redd.it/1dp6ykh
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
NEXT STEPS FOR CAREER
Hey Guys,
I got about 3 years of experience in a SWE position and have a CS degree. In those years I dealt with surface level Jenkins and had a superb time with it. I want to learn more about DevOps and potentially make a position change to a more DevOps related position.
What would be the best steps to learn modern DevOps, what should I learn first. I am in mobile development, so AWS stuff isn't as applicable to me.
https://redd.it/1dp7ha4
@r_devops
Hey Guys,
I got about 3 years of experience in a SWE position and have a CS degree. In those years I dealt with surface level Jenkins and had a superb time with it. I want to learn more about DevOps and potentially make a position change to a more DevOps related position.
What would be the best steps to learn modern DevOps, what should I learn first. I am in mobile development, so AWS stuff isn't as applicable to me.
https://redd.it/1dp7ha4
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Azure web app cannot resolve Azure VM hostname
I have a web app and need it to resolve the hostname of an Azure server. When I go to console and tcpping the hostname, I get a host such host message. Both are part of the same VNet and are in the same location. I have the DNS server listed in the VNet. It will resolve with the FQDN but I need the short name to also resolve. Any ideas?
https://redd.it/1dp9ze6
@r_devops
I have a web app and need it to resolve the hostname of an Azure server. When I go to console and tcpping the hostname, I get a host such host message. Both are part of the same VNet and are in the same location. I have the DNS server listed in the VNet. It will resolve with the FQDN but I need the short name to also resolve. Any ideas?
https://redd.it/1dp9ze6
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Go microservice/CICD project ideas
Hey all,
I'm looking for some good Golang project ideas where I could demonstrate my skills with building a Go microservice or some kind of CI/CD automation for my github portfolio.
I'm recently laid off, but I have 6 years of experience as a Devops / SRE professional, but due to the nature of my work I have unfortunately been limited in scope and time which prevented from growing my skills on the job. The old company still had me managing Jenkins and vsphere, fml and good riddance. Some context have experience in AWS, Gitlab, Datadog, and Terraform.
Let me know if you guys have any ideas with regards to some problem in your current position you wish you could solve with Go, or just a good project idea which could highlight my skills. Much appreciated.
https://redd.it/1dpb026
@r_devops
Hey all,
I'm looking for some good Golang project ideas where I could demonstrate my skills with building a Go microservice or some kind of CI/CD automation for my github portfolio.
I'm recently laid off, but I have 6 years of experience as a Devops / SRE professional, but due to the nature of my work I have unfortunately been limited in scope and time which prevented from growing my skills on the job. The old company still had me managing Jenkins and vsphere, fml and good riddance. Some context have experience in AWS, Gitlab, Datadog, and Terraform.
Let me know if you guys have any ideas with regards to some problem in your current position you wish you could solve with Go, or just a good project idea which could highlight my skills. Much appreciated.
https://redd.it/1dpb026
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
What CDN fits this use case?
We have an e-commerce site with a long tail of xx,xxx product pages. Many of these pages are visited infrequently, but when they do get visited, we need them to be performant.
The application is built with Next.js and hosted on Vercel. The pages are statically generated at build time.
Vercel provides their own CDN, but it evicts items from the cache for being accessed infrequently, and their definition of infrequently is if the item “only” gets requested once per day, for example. It doesn’t seem like you can change the cache expiration time. So that doesn’t seem to be a good fit.
I’ve read that AWS Cloudfront provides more control over the cache expiration time, but unless I was reading outdated information, it doesn’t seem to perform well with manual purges. We deploy pretty frequently at times, so being able to purge and repopulate the cache quickly is a feature we’re looking for.
I’ve also read about Fastly, but my understanding is that it’s super expensive, and I wasn’t able to get a hold of anybody when I reached out to them with questions.
Is there a better approach to this, or another CDN I should be looking at? Or maybe I’m wrong in some of this analysis?
Thanks in advance for any guidance.
https://redd.it/1dpacb3
@r_devops
We have an e-commerce site with a long tail of xx,xxx product pages. Many of these pages are visited infrequently, but when they do get visited, we need them to be performant.
The application is built with Next.js and hosted on Vercel. The pages are statically generated at build time.
Vercel provides their own CDN, but it evicts items from the cache for being accessed infrequently, and their definition of infrequently is if the item “only” gets requested once per day, for example. It doesn’t seem like you can change the cache expiration time. So that doesn’t seem to be a good fit.
I’ve read that AWS Cloudfront provides more control over the cache expiration time, but unless I was reading outdated information, it doesn’t seem to perform well with manual purges. We deploy pretty frequently at times, so being able to purge and repopulate the cache quickly is a feature we’re looking for.
I’ve also read about Fastly, but my understanding is that it’s super expensive, and I wasn’t able to get a hold of anybody when I reached out to them with questions.
Is there a better approach to this, or another CDN I should be looking at? Or maybe I’m wrong in some of this analysis?
Thanks in advance for any guidance.
https://redd.it/1dpacb3
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Alternative to Strongdm?
Strongdm just jacked our price by more than double in renewal. Wondering if anyone tested out other tools besides Teleport. We use it for accessing our EC2s, mostly SSH.
https://redd.it/1dpkvlq
@r_devops
Strongdm just jacked our price by more than double in renewal. Wondering if anyone tested out other tools besides Teleport. We use it for accessing our EC2s, mostly SSH.
https://redd.it/1dpkvlq
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Github Actions view variable in a different workflow
Hello guys!
In my workflow I have an input variable which decides which kind of secret I'm using.
I would like to 'publish' this variable, so in the next workflow run, I will be using the same input variable, or overriding the input variables, instead of having to manually input it again, or without it defaulting to the default option.
This workflow is used by multiple people, and each one of them needs a different secret, so it needs to not default the new variable for everyone I guess.
Is there anything like this that exists?
The best solution i've got to, is 'publishing' it by passing it to the step name, and then taking it from there, but it feels a bit wrong.
for example:
name: test
on:
workflowdispatch:
inputs:
secretchoice:
description: 'Override secret id'
required: false
SECRETID:
type: choice
options:
- "secret1"
- "secret2"
- "secret3"
- "secret4"
default: "secret1"
push:
branches: ["master"]
jobs:
test:
runs-on: ubuntu-latest
steps:
- name: "set [ENVSECRETID: ${{ github.event.inputs.SECRETID }}]"
run: echo "published on stage name"
would love to hear an expert opinion
https://redd.it/1dpllp5
@r_devops
Hello guys!
In my workflow I have an input variable which decides which kind of secret I'm using.
I would like to 'publish' this variable, so in the next workflow run, I will be using the same input variable, or overriding the input variables, instead of having to manually input it again, or without it defaulting to the default option.
This workflow is used by multiple people, and each one of them needs a different secret, so it needs to not default the new variable for everyone I guess.
Is there anything like this that exists?
The best solution i've got to, is 'publishing' it by passing it to the step name, and then taking it from there, but it feels a bit wrong.
for example:
name: test
on:
workflowdispatch:
inputs:
secretchoice:
description: 'Override secret id'
required: false
SECRETID:
type: choice
options:
- "secret1"
- "secret2"
- "secret3"
- "secret4"
default: "secret1"
push:
branches: ["master"]
jobs:
test:
runs-on: ubuntu-latest
steps:
- name: "set [ENVSECRETID: ${{ github.event.inputs.SECRETID }}]"
run: echo "published on stage name"
would love to hear an expert opinion
https://redd.it/1dpllp5
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
API connection with incorrect SSL only working on occasions
I have an API server that excepts post requests from the server of clients, which are sent via a wordpress plugin. However I noticed that for one request (where I used wpremoteget instead of curl) only worked for a hand full of users. Then I found that the source of the error was a mistake with my SSL certificate that I forgot to fix. It was towards my main domain and not the subdomain.
Does anyone know what the reason may be that this worked for a couple of users, but not all of them? I tried it from my local testing environment as well as from my staging site multiple times and it always worked. I only noticed the error, when I tried sending a curl post request via the linux console of my server.
https://redd.it/1dplkvi
@r_devops
I have an API server that excepts post requests from the server of clients, which are sent via a wordpress plugin. However I noticed that for one request (where I used wpremoteget instead of curl) only worked for a hand full of users. Then I found that the source of the error was a mistake with my SSL certificate that I forgot to fix. It was towards my main domain and not the subdomain.
Does anyone know what the reason may be that this worked for a couple of users, but not all of them? I tried it from my local testing environment as well as from my staging site multiple times and it always worked. I only noticed the error, when I tried sending a curl post request via the linux console of my server.
https://redd.it/1dplkvi
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Credits and resellers of $100k. Any risk?
As I was searching for how to get AWS/GCP credits, I bumped into multiple people who offered to resell credits. E.g. they’ve got $100k (or less) in credits, they’re not using them, want to split 70/30 or 60/40.
Thinking of taking up their offer after the credits I get run out.
1. Is there any risk if I join an organization?
One of those sellers is not comfortable with disclosing who they are, asked for crypto payments (red flags) but eventually said they’d accept PayPal. He also offered to make an advance of 10k which I can pay in 1.5mo from now.
Is there any risk e.g. can they see my user’s data? Or do I risk losing anything?
1. Can I just keep on joining different organizations, jumping from reseller to reseller?
https://redd.it/1dpnzff
@r_devops
As I was searching for how to get AWS/GCP credits, I bumped into multiple people who offered to resell credits. E.g. they’ve got $100k (or less) in credits, they’re not using them, want to split 70/30 or 60/40.
Thinking of taking up their offer after the credits I get run out.
1. Is there any risk if I join an organization?
One of those sellers is not comfortable with disclosing who they are, asked for crypto payments (red flags) but eventually said they’d accept PayPal. He also offered to make an advance of 10k which I can pay in 1.5mo from now.
Is there any risk e.g. can they see my user’s data? Or do I risk losing anything?
1. Can I just keep on joining different organizations, jumping from reseller to reseller?
https://redd.it/1dpnzff
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
User Behaviour Analysis / Mining
Hey everyone,
due to recent developments we are looking for a solution to monitoring user behaviour across an eCommerce-platform. We want to identify suspicious behaviour (potential data exfiltration, crawling from non-indexing sites, etc) and ideally get alerted when sessions seem suspicious.
We could do this based on access log analysis or session monitoring, but so far our research for tools in that regard has not turned up anything useful. We have monitoring for marketing (conversion, bounce rates) in place already and have things like dead links and infrastructure/performance problems covered, this is specific to user/session behaviour.
Wondering if somebody else is using tools for that purpose and has recommendations?
Thanks in advance :)
https://redd.it/1dpngcq
@r_devops
Hey everyone,
due to recent developments we are looking for a solution to monitoring user behaviour across an eCommerce-platform. We want to identify suspicious behaviour (potential data exfiltration, crawling from non-indexing sites, etc) and ideally get alerted when sessions seem suspicious.
We could do this based on access log analysis or session monitoring, but so far our research for tools in that regard has not turned up anything useful. We have monitoring for marketing (conversion, bounce rates) in place already and have things like dead links and infrastructure/performance problems covered, this is specific to user/session behaviour.
Wondering if somebody else is using tools for that purpose and has recommendations?
Thanks in advance :)
https://redd.it/1dpngcq
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Any companies accepting positions (for visa holders 🙋♂️)
Sorry to ask, but want to see how markets are treating Visa holders in DevOps world right now. I tried two apply in LinkedIn and got instant rejection when I said I need future Visa Sponsorship (I figured its an automated system).
Cheers! 🫡
https://redd.it/1dpqxqr
@r_devops
Sorry to ask, but want to see how markets are treating Visa holders in DevOps world right now. I tried two apply in LinkedIn and got instant rejection when I said I need future Visa Sponsorship (I figured its an automated system).
Cheers! 🫡
https://redd.it/1dpqxqr
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Has anyone used Velero for their backup and DR on kubernetes clusters ? If not what tools do you use ?
Velero is open source and is recommended by aws for kubernetes workloads but has anyone used anything different ?
https://redd.it/1dpshw2
@r_devops
Velero is open source and is recommended by aws for kubernetes workloads but has anyone used anything different ?
https://redd.it/1dpshw2
@r_devops
First Interview - DevOps Student Position, Looking For Tips
Hello everyone!
I have my first interview coming up soon (as a 2nd year B.sc student of CS), and it's for a DevOps student position in one of the big companies.
I've spoken to the team manager as an initial phone interview, and she hinted at me that I'm not supposed to know so many things about DevOps (she knows I'm a student), and in the interview I'd be asked "logical" questions, and maybe some algorithms (in the technical part, of course that there is a regular, personal interview part).
In your experience, how should i prepare for the interview?
My current thinking is learning about the basics of DevOps (version control, Linux, CI/CD tools, cloud etc.)- but really only the basics of most of them, as well as practicing general interviewing, and grinding Leetcode questions. I'll mention I have less than a week until the interview.
Also, I'll use the opportunity and ask what do you think of DevOps as a student position? does it "lock me" in DevOps style jobs further on?
How can I take advantage of this first job to advance my skills as much as I can?
Thank you!
https://redd.it/1dpu9zq
@r_devops
Hello everyone!
I have my first interview coming up soon (as a 2nd year B.sc student of CS), and it's for a DevOps student position in one of the big companies.
I've spoken to the team manager as an initial phone interview, and she hinted at me that I'm not supposed to know so many things about DevOps (she knows I'm a student), and in the interview I'd be asked "logical" questions, and maybe some algorithms (in the technical part, of course that there is a regular, personal interview part).
In your experience, how should i prepare for the interview?
My current thinking is learning about the basics of DevOps (version control, Linux, CI/CD tools, cloud etc.)- but really only the basics of most of them, as well as practicing general interviewing, and grinding Leetcode questions. I'll mention I have less than a week until the interview.
Also, I'll use the opportunity and ask what do you think of DevOps as a student position? does it "lock me" in DevOps style jobs further on?
How can I take advantage of this first job to advance my skills as much as I can?
Thank you!
https://redd.it/1dpu9zq
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Seeking Project Ideas for a Hands On DevOps Refresh
I’m currently the Head of DevOps at my company, which means I’ve been spending a lot of time recently leading people rather than building things. While I love my team and the work we’re doing, I’ve found myself missing the hands-on engineering aspect of DevOps.
For my sanity (and to sharpen my skills), I’ve decided to dedicate some of my free time to building and tinkering with projects. However, every time I sit down to start something, I end up staring at a blank screen, and my mind just goes blank.
I’m looking for suggestions on what to build or work on. Here are a few areas I’m interested in, but I’m open to any and all ideas:
1. CI/CD Pipelines: Always looking to improve and innovate here.
2. Automation: Tools and scripts that can streamline processes.
3. Cloud Infrastructure: I’m particularly interested in AWS, but I’m open to exploring other providers.
4. Monitoring and Logging: Enhancing observability with tools like Prometheus, Grafana, ELK stack, etc.
5. Security: Implementing security best practices in the pipeline and infrastructure.
6. Kubernetes: Anything from setting up clusters to advanced scheduling and scaling techniques.
I’m also very interested in contributing to open source projects. If you know of any active projects that could use some DevOps love, please point me in the right direction. I’d love to help out and collaborate with the community.
If you’ve worked on a project that you found particularly interesting or challenging, I’d love to hear about it. Or if you have any other ideas, please share!
Thanks in advance!
https://redd.it/1dpwrye
@r_devops
I’m currently the Head of DevOps at my company, which means I’ve been spending a lot of time recently leading people rather than building things. While I love my team and the work we’re doing, I’ve found myself missing the hands-on engineering aspect of DevOps.
For my sanity (and to sharpen my skills), I’ve decided to dedicate some of my free time to building and tinkering with projects. However, every time I sit down to start something, I end up staring at a blank screen, and my mind just goes blank.
I’m looking for suggestions on what to build or work on. Here are a few areas I’m interested in, but I’m open to any and all ideas:
1. CI/CD Pipelines: Always looking to improve and innovate here.
2. Automation: Tools and scripts that can streamline processes.
3. Cloud Infrastructure: I’m particularly interested in AWS, but I’m open to exploring other providers.
4. Monitoring and Logging: Enhancing observability with tools like Prometheus, Grafana, ELK stack, etc.
5. Security: Implementing security best practices in the pipeline and infrastructure.
6. Kubernetes: Anything from setting up clusters to advanced scheduling and scaling techniques.
I’m also very interested in contributing to open source projects. If you know of any active projects that could use some DevOps love, please point me in the right direction. I’d love to help out and collaborate with the community.
If you’ve worked on a project that you found particularly interesting or challenging, I’d love to hear about it. Or if you have any other ideas, please share!
Thanks in advance!
https://redd.it/1dpwrye
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Cloud agnostic SFTP
What is everyone's favorite cloud agnostic SFTP solution for prod?
https://redd.it/1dpxp8z
@r_devops
What is everyone's favorite cloud agnostic SFTP solution for prod?
https://redd.it/1dpxp8z
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Seeking Career Advice: Data Engineering vs. DevOps - Your Insights Needed!
Hi, Reddit community,
I need some guidance on choosing the right career path, and I’m hoping to get your insights. Here’s a bit about my background:
* I have a bachelor’s degree in Computer Science.
* Worked as a full-time Data Engineer for 1.5 years, with some minor DevOps tasks.
* Currently, I’m wrapping up my Master’s in CS while working part-time in DevOps, with some occasional Data Engineering tasks.
I’ve had exposure to a variety of technologies and found DevOps tasks particularly interesting. However, there are a few things that concern me:
1. **High Responsibility:** In my DevOps role, I often have to mimic the entire production setup in a testing environment, test changes, and then update the production. The fear of breaking something and the responsibility that comes with it is quite daunting.
2. **Constant Learning Curve:** There are tons of tools in DevOps, and I often find myself referring back to the documentation. It feels like I never quite remember how to use the tools as well as I did in my Data Engineering tasks.
3. **Small Teams and High Responsibility:** It seems like DevOps teams tend to be smaller, meaning each member has more responsibilities. Is this true in your experience?
With my Master’s nearing completion, I need to start looking for a full-time job. Given the current market, I’m trying to decide between pursuing a career in Data Engineering or sticking with DevOps.
**My Questions:**
1. **Should I seek a job in Data Engineering or DevOps?**
2. **Is the constant learning curve and high responsibility in DevOps something that gets better with time?**
3. **Are smaller teams the norm in DevOps, and does that mean significantly more responsibility per team member?**
4. **Any pointers or advice for someone looking to advance in DevOps?**
Your insights and experiences would be incredibly valuable to me. Thanks in advance for your help!
https://redd.it/1dpqczv
@r_devops
Hi, Reddit community,
I need some guidance on choosing the right career path, and I’m hoping to get your insights. Here’s a bit about my background:
* I have a bachelor’s degree in Computer Science.
* Worked as a full-time Data Engineer for 1.5 years, with some minor DevOps tasks.
* Currently, I’m wrapping up my Master’s in CS while working part-time in DevOps, with some occasional Data Engineering tasks.
I’ve had exposure to a variety of technologies and found DevOps tasks particularly interesting. However, there are a few things that concern me:
1. **High Responsibility:** In my DevOps role, I often have to mimic the entire production setup in a testing environment, test changes, and then update the production. The fear of breaking something and the responsibility that comes with it is quite daunting.
2. **Constant Learning Curve:** There are tons of tools in DevOps, and I often find myself referring back to the documentation. It feels like I never quite remember how to use the tools as well as I did in my Data Engineering tasks.
3. **Small Teams and High Responsibility:** It seems like DevOps teams tend to be smaller, meaning each member has more responsibilities. Is this true in your experience?
With my Master’s nearing completion, I need to start looking for a full-time job. Given the current market, I’m trying to decide between pursuing a career in Data Engineering or sticking with DevOps.
**My Questions:**
1. **Should I seek a job in Data Engineering or DevOps?**
2. **Is the constant learning curve and high responsibility in DevOps something that gets better with time?**
3. **Are smaller teams the norm in DevOps, and does that mean significantly more responsibility per team member?**
4. **Any pointers or advice for someone looking to advance in DevOps?**
Your insights and experiences would be incredibly valuable to me. Thanks in advance for your help!
https://redd.it/1dpqczv
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
EU data protection (GDPR) question for contractors!
Hi!
I wanted to ask if it is realistic to work as a contractor for European countries, while residing outside of Europe.
Are there any workarounds to comply, and ensure full data protection for clients?
Will people be willing to hire me if that is the case?
Really appreciate anyone helping me out!
https://redd.it/1dq5id5
@r_devops
Hi!
I wanted to ask if it is realistic to work as a contractor for European countries, while residing outside of Europe.
Are there any workarounds to comply, and ensure full data protection for clients?
Will people be willing to hire me if that is the case?
Really appreciate anyone helping me out!
https://redd.it/1dq5id5
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
What is the way to find DevOps / SRE person for my SaaS project?
As the title indicates, I am seeking a DevOps /SRE to work on my SaaS project. What is the best way to find this person? Fiverr and Upwork haven't been helpful. Are there any other sites or places I can look?
More specially I need someone who can do the following:
* CI/CD implementation
* Data privacy
* Logging/Alerts attached to Staging and Prod environments
* Platform security
* Maintenance (incident management) and bug fixing
Current Stack:
- MERN Stack (MongoDB, Express, React, Node), Bitbucket (currently) - repository, and AWS (EC2,S3)
Feel free to DM me if you have any further ideas/questions, or if you fit this profile and want to chat more.
https://redd.it/1dqbvvg
@r_devops
As the title indicates, I am seeking a DevOps /SRE to work on my SaaS project. What is the best way to find this person? Fiverr and Upwork haven't been helpful. Are there any other sites or places I can look?
More specially I need someone who can do the following:
* CI/CD implementation
* Data privacy
* Logging/Alerts attached to Staging and Prod environments
* Platform security
* Maintenance (incident management) and bug fixing
Current Stack:
- MERN Stack (MongoDB, Express, React, Node), Bitbucket (currently) - repository, and AWS (EC2,S3)
Feel free to DM me if you have any further ideas/questions, or if you fit this profile and want to chat more.
https://redd.it/1dqbvvg
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
MLOPS Question: Deploying Model Ensembles BentoML to Sagemaker Alternatives
Hi, we are using BentoML and serving our model endpoint in an ECS accessible thru an API call. The model endpoint consists of multiple computer vision models (e.g. YOLO models) working together. Our use case is as follows
* should use only CPU VMs for now (GPUs are quite expensive, but it depends on the MLOps design)
* API calls can be sporadic (i.e. mostly single calls, random, etc.) but there are rare times within the day that the API will be called maybe 4-5x simultaneously)
* Predicting if an API request for the model can be somehow predicted as to when someone logs-in to the application, but not foolproof
* The endpoint can take 1-2 minutes to give a full prediction for an API call (since its CPU) but can be faster with a cheap GPU endpoint
* The user does not need the results to be instant. But it shouldnt be longer than 2-5 minutes.
* should not crash when you send concurrent requests
* cheap
Currently, BentoML on ECS (probably because of a very small machine) crashes when it receives multiple concurrent requests (maybe the RAM is getting flooded).
Is Sagemaker a good answer to this use case? Are there some alternatives to this? Thanks
https://redd.it/1dqd24q
@r_devops
Hi, we are using BentoML and serving our model endpoint in an ECS accessible thru an API call. The model endpoint consists of multiple computer vision models (e.g. YOLO models) working together. Our use case is as follows
* should use only CPU VMs for now (GPUs are quite expensive, but it depends on the MLOps design)
* API calls can be sporadic (i.e. mostly single calls, random, etc.) but there are rare times within the day that the API will be called maybe 4-5x simultaneously)
* Predicting if an API request for the model can be somehow predicted as to when someone logs-in to the application, but not foolproof
* The endpoint can take 1-2 minutes to give a full prediction for an API call (since its CPU) but can be faster with a cheap GPU endpoint
* The user does not need the results to be instant. But it shouldnt be longer than 2-5 minutes.
* should not crash when you send concurrent requests
* cheap
Currently, BentoML on ECS (probably because of a very small machine) crashes when it receives multiple concurrent requests (maybe the RAM is getting flooded).
Is Sagemaker a good answer to this use case? Are there some alternatives to this? Thanks
https://redd.it/1dqd24q
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Doubt on Terraform resources sharing between tf states
Just an imaginary scenario,if I define same AWS resource in three tf states (dev,prod,staging) as that resource is shared for using in all environments.If I destroy tf state or remove that resource in any one of the environments tf state ,Will that actually cause deleting that resource? How normally handle these type of scenario? Or we have to keep different statefile for shared resource?
If this question is dumb,pardon.am just a beginner🤝
https://redd.it/1dqhrxk
@r_devops
Just an imaginary scenario,if I define same AWS resource in three tf states (dev,prod,staging) as that resource is shared for using in all environments.If I destroy tf state or remove that resource in any one of the environments tf state ,Will that actually cause deleting that resource? How normally handle these type of scenario? Or we have to keep different statefile for shared resource?
If this question is dumb,pardon.am just a beginner🤝
https://redd.it/1dqhrxk
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
For a DevOps role, how deep should I dive into learning PromQL?
Share your experiences! Is basic understanding enough, or is diving deeper a must? Let's discuss the importance of PromQL in the DevOps toolkit and how much knowledge is truly necessary.
https://redd.it/1dqjmdp
@r_devops
Share your experiences! Is basic understanding enough, or is diving deeper a must? Let's discuss the importance of PromQL in the DevOps toolkit and how much knowledge is truly necessary.
https://redd.it/1dqjmdp
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community