Best Options for running python script every 30 seconds

I'm helping a friend set up some infrastructure stuff for a side hustle he has and im kinda lost with some of the dev ops stuff.


My current set up is the script starts up via a corn job and just runs 8 hours straight in a while loop. Would it make more sense to move it to Azure Functions? If so how does scheduling something like that work to the best of my knowledge you can only run once every minute.


I need this to be stable. Also does anyone have any good tutorials on ci/cd for deploying python scripts to virtual machines. Every tutorial I find is for deploying flask/django apps.


All feedback is welcome I'm new to this side of programming especially the ci/cd stuff.

https://redd.it/144v9mp
@r_devops

Is AWS Directory Service the only way to get an RDS instance join a domain?

We have a requirement for the RDS to be enabled with Windows AD authentication. I couldn't find any other way to achieve this except for using AWS Directory Service which hasn't been setup in our account.

Are there any other alternatives?

https://redd.it/144xr17
@r_devops

Interview Questions

Hi,
I have an interview coming in the next week for a Devops Engineer.

What are things i should be prepared in ?

Any pointers that i need to know of ?

Thanks for your help in advance.

https://redd.it/144xqix
@r_devops

Join the Discussion and Cast Your Vote in our Poll...

What strategies do you employ to reduce logging costs in your cloud environment?

View Poll

https://redd.it/14181ra
@r_devops

DevOps startup around Observability

Hey chads,

I need your honest take on this, we're hustling hard as freelancers, and we're about to level up our game.. we're gonna offer these pre-packaged observability solutions to companies, but here's the kicker, we'll customize it to fit their exact needs, all for a reasonable fee.
The stack is:
Grafana,
Loki
Prometheus/Thanos
Jaeger
Open Telemetry Collector (Traces, Metrics, Logs)
\+ We configure cloud metrics for grafana.. (Cloudwatch, Azure monitor, etc.)

Once deploy the stack we support that, meaning we guarantee timely updates of charts and that every component is up to date and just works.


Do you think there is a market for this?

https://redd.it/1452bfe
@r_devops

Any open sourced status page manager? Cachet alternative

I have been exploring some open source status page, and was intrigued by cachet with features but since it not maintained i am reluctant to implement it and looking for alternatives . Any recommendations?

https://redd.it/14539ii
@r_devops

CICD Test Stage Question

So our CICD Pipelines for each product have A build plan, which is linked to a deployment project that deploys to \~5-6 envs, dev, test, uat, prod, etc).

We kick off a run in the lower env, by running the "commit and acceptance stages" in the build plan, which triggers a deployment to the dev env and test env. After the tasks in the Test deployment env are complete, it then triggers a Test stage in our build plan(withs typically runs the smoke tests).

My question is, what is normally the distinction between what is happening in the Test environmnet where artifacts to deployed to the Test environment, vs what's going in the test stage of its respective build plan(with the smoke tests)? In other words, why does it come back to the build plan test stage after deploying to a test environment elsewhere?

https://redd.it/1454xz2
@r_devops

Why do DevOps managers / directors buy new software stuff?

Need some help with this please all you DevOps people. And if the Mods are kind enough to not delete this, to let me know if I'm completely wrong.

So I see three reasons for buying new software. Firstly, there is a pressing need which is absolutely essential.

Secondly, if a good piece of software comes along which is way cheaper than existing solutions.

Thirdly, there is a tool that allows DevOps leaders to turn DevOps from a cost centre into a profit centre and add value. i.e. Allows DevOps to help drive an initiative through the business that will make it a lot more money / massively more efficient.

Have I got this bit right? Is this true or have I got it wrong?

EDIT: And thanks for all the replies so far. Fantastic. Really appreciate it!

https://redd.it/1453f9s
@r_devops

How do you guys filter your job searches and what sites do you use to apply for/find jobs

Pretty much as the title says, for some LinkedIn has begun to look like it’s the same group of jobs no matter how many pages down I go lol

https://redd.it/145374w
@r_devops

Whats the right basic change / development process in the world of devops?

I'm fairly new to the devops world and as part of that I am just trying to understand the basics where (for a company that has >500 developers):

Code repository / version control = GitHub

Integrate GitHub to Jenkins for CI/CD

Create docker image of application

Push Docker Image to Docker hub.

My question(s) here is, from a risk and controls perspective:

1. At what stage would a developer commit/pull/merge code into Github? Would this be before or after its gone through the Jenkins CI/CD pipeline?
2. When the developer branches code to work on it on their own terminal, do they at that point perform their host of tests and vulnerability scans or would that be built into the CI/CD pipeline? (e.g. use of services like Tanium / Mend / SonarQube etc.)
3. Would things like QA testing and UAT by actual humans be expected to happen before or after the commit / pull / merge request?
4. How is the process really meant to be broken down even prior to the commit, build, test etc. process. Like how do the developers branch code and do the actual "coding" and then get it back into repo and application build?

All really silly and basic questions, I know. But if you know of a youtube link that can explain all this to a 5 year old - please shoot that across also!

https://redd.it/1459cjx
@r_devops

What should you know before iac?

Getting started with Terraform,
What should I know before?

Is Ansible a better beginning point?

I’ve setup a Portainer that that runs Teleport… (really random probably mentioning that)

What should I be familiar with before Terraform?

VM?

https://redd.it/145bpto
@r_devops

Any experience on making the Datadog => Grafana Cloud transition?

Given the cost (especially on custom metrics), we're looking at alternatives to Datadog. I can't find anything comparing it against Grafana Cloud, like not even marketing fluff from Grafana.

Anyone have any experience making, or even just evaluating, the switch?

https://redd.it/145d65j
@r_devops

What are you charging hourly for DevOps work?

Thinking of doing freelance after a small hiatus, was previously charging around 150/hr for DevOps work and was curious what other contractors/freelancers are billing. I understand this depends on many factors but mostly will be doing deployments, dockerizing apps, hosting apps on clients AWS etc.

https://redd.it/145enm8
@r_devops

/r/DevOps - I'm calling on you to be the hero that users need right now and build a Lemmy instance for your favorite community.

With the shitshow that was the AMA today, it's clear that reddit will not be backing down on the API changes anytime soon, and even doubled down on a lot of really dumb stuff. This has prompted an escalation for many communities to make their blackout indefinite or permanent.

In doing this, we have an opportunity to show that community and federated solutions can work and that a community can come together to make change.

/r/DevOps has a unique ability to deliver socially impacting technologies to communities in need, and I think it's time that we act.


I'm doing this with /r/Tucson, and creating tucson.social as a lemmy instance. We are looking at making it a Public Benefits Corp with shareholders that are local to Tucson itself. We are also making an open code of conduct and site terms and conditions to give everyone a say in how it's run.


As I do this, I'll be making a github document detailing how all of this came together, how much it cost, and any technical issues that came up along the way.


I hope that others can be inspired to do similarly - it's the best chance we've got.

https://redd.it/145h7x8
@r_devops

DevOps managers - tell me where I'm going wrong with my resume

https://imgur.com/a/f9Pykmq

I've worked this thing out over and over again. I can't see the forest for the trees anymore. I personally think my resume is to the point and digestible. No word salad, no long ass descriptions.

I'm currently at a startup that is not doing well financially (I haven't been paid in 3 months). I've been applying to roles that I believe are good fits for me, ie. they use similar tech stacks, my skill set would be very complimentary to them. But no bites. Just automated rejection email after automated rejection email. It's very frustrating. I really don't feel like ending up on the streets.

So, like.. what is so wrong about this resume? I'm totally at a loss. Be brutal if you must. It will be a good learning experience for me.

https://redd.it/145if7e
@r_devops

AWS Batch- compute env status is INVALID

Hi Team,

i see my DEV job they are always stuck in runnable state . Mostly runnable is when the compute env is not available or when ec2 is unable to connect to ecs . i tried providing desired vcpu to match with max vcpu but the status goes to INVALID . Have you experienced any sort of this . The specified launch template, with template ID******does not exist.

https://redd.it/14584v2
@r_devops

Anyone need a Jr. Devop?

Anyone/Company looking to hire a Jr. Devop?

I have been in IT for 2.5 years as a network admin.

I have been self-studying to pivot into Devops.

Obtained my Terraform / Docker certifications plus a few Cloud certs.

Working on Kubertnetes/Ansible Cert as well.

I have knowledge of CI/CD pipelines/Git/Jenkins/Gitaction/Github. Just no real hands on experience in production environment.

https://redd.it/145o10o
@r_devops

Trying to come up with a new Continuous Integration (CI) setup

Currently we are relying on a Jenkins based setup for our CI setups, we have a wrapper that was setup around Jenkins for consuming it. And for CD, we are using Flux (great tool).

The CI setup is very old school and tightly coupled with everything where when we cannot build artifacts and promote it into higher environments.

So I am trying to come up with a right strategy to design and build a new CI setup, hoping to decouple these Artifact building and fix the build promotional issues. Also trying to get rid of Jenkins for good.

Any references I can get here to implement the CI setups with my need?

https://redd.it/145yuwq
@r_devops

Serverless and AI: How do you use it?

What was your experience in using serverless infra for AI/ML? How did you manage to resolve the cold start problem, timeouts and memory issues?

We tried building a whole NLP (natural language processing) system using AWS lambdas. And ran into a lot of problems in the training part. For more context you can read https://www.reddit.com/r/devops/comments/1452bfe/devops_startup_around_observability/

https://redd.it/1460zze
@r_devops

How versatile did the Apple Silicon chips have become now that they are getting ready to present the M3 later this year?

I know that at first there were some hiccups with Docker/Terraform and some probably unsolved issues with x86 architecture.

Is anyone using mac on a daily basis here? How versatile is it for a DevOps?

https://redd.it/1462uvm
@r_devops

Server couldn't handle springboot

I am a server guy who deployed a springboot application on t2.medium. there are 3 major issues i am facing now.application is currently under development so no end users using it but the api calls are very slow. I checked the cpu and Ram but there's nothing unusual. Not only api calls are slow but i am also experiencing cors error even though cors is enabled in apache2.
Its not everytime I am experiencing cors error but it just happens randomly. 70% of the time it's fine but remaining 30% suddenly i am experiencing cors error when requesting.
Also not able to send sms. I set up a SMS provider to send sms via api key which works on local machine but doesn't on the server.
Idk why sms works on local machine but didn't on server. Any idea on these guys?

https://redd.it/1463dcg
@r_devops