How Can I Keep the Storage Bill Cheap

Hello Reddit!

I have a project that uses about 16TB of bandwidth per month from users downloading files. I would like to keep quick download speeds, but the site does not make enough money to use any big-name brand providers.

Digital Ocean Spaces starts at $5 a month, but with 16TB, it's closer to $300 a month.

Does anyone know any cheaper alternatives or have advice for lowering the bill?

https://redd.it/nttfkj
@r_devops

Hello Guys- Need a lil of your help!

Hii Guys, I have been thinking to contribute to our developer community for a while now, I think creating informational blogs could be helpful to all kinds of members of this community, now I want your little help here, please tell me what kind of blog content would you want me to create?!

As I do not want to create anything that people are already making and is already been chewed on, So please it would be great If I could get some insights from you guys! Thanks in advance!

https://redd.it/ntrqn5
@r_devops

Favorite way to provision and configure ec2 instances?

Hey people,

​

I'm looking to deploy some applications in ec2. The applications need to be configured with environment variables and require docker. I'm trying to think what are some of the quickest and easiest ways to provision new ec2 instances, and manage their configuration as a one-off and ephemeral instance?



I'd ideally like to use one tool for the provisioning and configuration, and would like to avoid needing to build out a CD pipeline. What tools are you guys using for provisioning and configuration? Ansible, AWS CDK, terraform?

https://redd.it/nuev4p
@r_devops

Python or Batch script

Hello everyone. I recently got assigned with refactoring some batch scripts.

It included multiple logical part that could be seperated. Downloading dependencies, configuring downloaded dependencies and running some tests. The script was a little bit bloated so i moved dependency managment to maven, and wrote a python script so it would be easier to maintain. But %50 percent of the python script is just calling subprocesses to run tests and copying files.

Im kinda on my own. Company dont care how i do it and they are generally new to best practices to devops.

Most useful part of the python script is the -h option generated by argparse module. And i also made the script independent from the working directory (it takes command line parameters for directories it works on and has good default values)

Am i right to rewrite batch into python in this situation? Batch script was seperated into 7 files totaling at 300ish lines. Python script is 100ish lines

https://redd.it/nuhsug
@r_devops

Interview tips for 1 Year Experience Engineer

Hi folks,

I am working in DevOps since last 1 year and now Tomorrow I have an interview for the position of DevOps Engineer.

Interviewer Company is mostly using AWS as cloud platform and some other DevOps tools

Any key points or hint to focus on for better result ?

https://redd.it/nuj5vv
@r_devops

Learn how the Power Platform now enables professional and citizen developers to participate in DevOps

Watch the latest Fusion Teams Development 101 webinar to learn about DevOps improvements to the Power Platform for professional and citizen developers. Fusion Teams | Microsoft Power Apps

https://redd.it/nuop6r
@r_devops

New to IT, should I consider a career in DevOps?

I'm a 26 yo guy, security studies major (geopolitics, military, international relations, internal security, etc. had some IT stuff but not much), just finished my master's degree and I have some decent job prospects in the local government administration or the law enforcement, but my programmer friend (5 years as a full stack developer, Java pro) said I should consider a career in DevOps (he explained to me what that is and after some digging it sounded interesting) considering my skills

so, my skills include:

• I'm a 7 year Linux user, 3 years Arch Linux, I'm not a sysadmin but I know the basics, like managing services, making my own services, managing accounts and permissions, ssh, making simple bash scripts (for selecting audio sinks and utility stuff like that), htop, ps - e, grep on daily basis, I basically love Linux, especially when it breaks, so I can spend countless hours fixing it in vim, when not using browser I tend to spend time mostly in CLI-apps as it feels romantic, neomutt for mail, cli Spotify client, weechat for IRC, etc.

• so Arch has this user package repository called AUR, I maintained few packages there, that's how I picked up git, pulling, pushing, commits, felt simple,

• I learnt a bit of MySQL, I can set up a new database, operate on data, SELECTs, JOINs, etc., we had a database class, that's where I picked up most of it,

• we were also taught how SSL works, so I know how to create a local certification centre, self-sign my website certificate and use it, learnt on apache, it was pretty cool, obviously the browser won't accept it, but still,

• what was also fun, we were taught how to create a private VPN? between two computers, ipsec racoon tunneling, had to generate asymmetric RSA key pairs,

• I installed OpenWRT firmware on my tp-link router, so it would have SSH capabilities, so I can now SSH to my router from my phone, make router send a magic packet to my PC to turn it on and SSH to my PC if I need something,

• I picked up a bit of Java for fun, liked the concept of object programming, I could create simple CLI apps like phone book or polling app on my own, but I gotta say that when I encounter a Python code (happens often when I use some amateur Linux apps) it feels way more readable,

• my friend sent me some simple project which I had to run with docker-compose up, I was amazed at the technology, frontend website, database and main backend program all on three different containers, I could SSH into each of them as all of them had separate internal IPs and different ports, the technology is neat, fascinating stuff, three separate but interconnected Linux installs!

So I'm not sure if this is stuff every IT graduate does like it's nothing or do I hold some promise? I never worked in IT, so it's okay if I don't fit in, it's more of a hobby for me. Cheers to you all, especially those who contribute to open source stuff!

https://redd.it/nuqgnu
@r_devops

NEW Databricks Zero to Hero | Azure SQL Integration with Databricks | Session 6

\-- https://youtu.be/UzQlmMcvm18 \-- This video is the continuation of the "Databricks Zero to Hero" Series Free crash course. In this video , you can learn and refresh 1. How to connect Azure SQL db from Databricks notebook 2. How to install MS-ODBC driver and pyodbc 3. Insert data into Azure SQL database using pyodbc 4. Validate the data from Azure Portal.

​

\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^ Please Subscribe, Like, & Share for more video and to get notified when new video comes⤵⤵⤵ :https://www.youtube.com/c/CloudDataScience?sub_confirmation=1 \^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^\^ #DatabricksHeroToZero

https://redd.it/nupmvi
@r_devops

What are some steps you run in your CI Pipelines?

Obviously every project has different necessities, and there are some steps that every project should run in CI, but just curious what some of you use. Maybe sharing will give everyone some ideas.

We’re run a pretty basic set of instructions at my company so far, just running unit tests and linting over the app.

https://redd.it/nuszy5
@r_devops

Do I need to know a programming language?

I've been in the devOps/infrastructure field for about 5 years now. Since then, I've been working with AWS using tools (Terraform, Packer, Ansible, Chef, etc) rather than writing code in a traditional language (Python, Ruby, Java, JavaScript, etc). I've never run into any problems with building our infra and getting our services to run smoothly with high-availability. I might have had to write a quick script here and there either in Bash or Python to perform some minor task, but it's nothing challenging.

I'm noticing a lot more job postings are looking for people with strong backgrounds in a traditional language (Python, Ruby, and JS show up a lot), but I don't know why. Are people here writing more "traditional" code to do their work? Should I be doing the same? It's really worrying me because as much as I love the company I'm with, I know that one day I might choose to leave or they might downsize me and I don't want to miss out on opportunities for not knowing how to write a web app in Python or something like that.

https://redd.it/nutcu5
@r_devops

how do you manage database migrations

Does anyone here have a rock solid recommendation for handling database migrations in a robust manner?

I feel like backwards compatible schema updates are the best approach i.e ensure that changes are always compatible one schema version ahead.

However, I don't have any good ideas for how to enforce backwards compatability. Also, would love to hear if anyone hear has fully automated migration upgrades AND rollbacks.

https://redd.it/nuu8bc
@r_devops

How to deploy heroku dyno with nodejs web app AND python script?

So what I have is I'm using nodejs/express for website. I am also using another javascript module called spacy-js. To make spacy-js work, I have to run a python file in the spacy module like "python node_modules/spacy/api/server.py" in 1 terminal and then do "npm start" on another terminal so that spacy works on my website. There is a separate requirements.txt inside the spacy-js module. Now, this website uses nodejs website and also runs a python file inside node_modules. How do I deploy this to heroku?

https://redd.it/nutayw
@r_devops

Grafana dashboard for Cloudflare Analytics. its helping me a lot so I though about sharing it.

Hey all,

Sorry for the short and fast text, but basically this guy will query cloudflare api and publish the results to influxdb.

There's also a sample grafana dashboard that you can use with worldmap , but still needs more polishing.
thcp/cloudflare-analytics (github.com)


Feel free to share any critic /suggestion or improvements that could be done :)

https://redd.it/nukrrt
@r_devops

In over my head

I had some light DevOps ish experience on a project over the last year and a former client from when I lived on the West Coast reached out as the head of DevOps at well-established East coast based company and asked if I was interested. I said this wasn't really my forte and that I had no experience with a lot of their technology stack. His reply was, I'll teach you and don't worry. The fact that you have *Nix chops is a leg ahead. That seemed pretty good.

​

Context: My roles have largely been managerial the last few years, though I'm often thrown in as the script kitty and code reviewer/create best practices, but I haven't written code everyday for over a decade.

Anyway, I took the job and it just is clobbering me. Learn K8s, learn Mongo, lean ELK, learn Graphana, Influx, ansible, terraform...

I get that having a job now makes me extremely fortunate, so I don't mean to make light of that. But I just feel like I'm drowning and cant' ever catch up.

Do i just do this until they either fire or I manage to stay afloat? Have only been at a few shops before and I'm totally out of my element. I'm on month 2.5 at the new gig.

https://redd.it/null28
@r_devops

Managing Multiple Environments Effectively

I have started working on automating some of the infrastructure deployment at work for our Azure PaaS offering to customers. I currently deploy customers' infrastructure using Terraform and VM images I build through Packer for the backend servers. For the "frontend" that is presented to our customers, they are given VMs via VMWare Horizon Cloud on Azure.

​

I am easily able to automate away all of the VM/Azure provisioning but then anything in Horizon requires either manual work or me to wrap their API into something usable. What are some options for handling all of this? I can store all the infrastructure states on Terraform Cloud or other software but if I need to run one-off scripts against an API or something, how can I best handle this?

​

Cheers

https://redd.it/nuyy3x
@r_devops

DevOps is getting code released faster than ever. But security is lagging behind

https://planetstoryline.com/devops-is-getting-code-released-faster-than-ever-but-security-is-lagging-behind/

https://redd.it/nuyy0d
@r_devops

LitmusChaos for beginners

Hello folks!

As a beginner, I have been thrilled by working as a Developer Advocate at LitmusChaos. The community strongly believes in its visions of delivering resiliency, smooth complex workflow management, providing an easy beginner-friendly interface with a navigable experiments dashboard to start with, and much more.

Kickstart your learning here by checking out the LitmusChaos repository: https://github.com/litmuschaos/litmus

Resources for better understanding (for beginners): https://github.com/litmuschaos/litmus/tree/master/resources

https://redd.it/nuk6a9
@r_devops

Model tier in trunk based development

Hi guys,

I'm wondering how is the best way to put a MVC monolitic in a trunk based devopment. I might use feature flags in View and controller tiers, but, what about the model tier? How can I allow multiples teams work together without starting a war?

Thanks!!

https://redd.it/nuk0rx
@r_devops

Terraform finally hits v1.0.0

> Terraform v1.0 is an unusual release in that its primary focus is on stability, and it represents the culmination of several years of work in previous major releases to make sure that the Terraform language and internal architecture will be a suitable foundation for forthcoming additions that will remain backward compatible.

>
>Terraform v1.0.0 intentionally has no significant changes compared to Terraform v0.15.5. You can consider the v1.0 series as a direct continuation of the v0.15 series; we do not intend to issue any further releases in the v0.15 series, because all of the v1.0 releases will be only minor updates to address bugs.

>
>For all future minor releases with major version 1, we intend to preserve backward compatibility as described in detail in the Terraform v1.0 Compatibility Promises. The later Terraform v1.1.0 will, therefore, be the first minor release with new features that we will implement with consideration of those promises.

​

https://github.com/hashicorp/terraform/releases/tag/v1.0.0

https://redd.it/nv2mdk
@r_devops

Career change from Network administrator to DevOps

Hi everyone 👋,

Since few months I'm thinking of changing my career towards devops. This culture interesting me very hard and I'm already doing some self practice with the tools that I got already (cicd GitHub actions, docker, powershell and linux scripting etc..)
I'm still busy with my research in this domain to know and practice more as much as i can.
I would like to know what kind of challenges i may expect in real world, which tools i should manage and what should be starting point of someone who wants to become a "devops engineer".
I know that the tools and technology used are highly dependent from the organization business for which I'll be working but any ideas, examples, and suggestions will be appreciated
Thank you in advance,

https://redd.it/nu8qkp
@r_devops

First CICD pipeline

Hey all, I am creating my first CICD pipeline and wanted to run by you guys to see if I am missing anything or doing any bad practices.

Stack: Python+Flask app, GitHub Repo, GCR, Cloud Build (CICD) and GKE

I have separated my project in two GitHub repositories:

* One repo for the application
* One repo for the k8s manifests

I've got two triggers pipeline

1. Any commits to main branch (application)

* Run unit tests
* Run a docker build and tag my image to $SHORT\_SHA
* Push docker image to GCR
* Clone repo (k8s manifests) / checkout production branch
* Modify the tag in my k8s manifest to point to the latest $SHORT\_SHA using sed
$ sed -i "s/COMMIT\_ID/${SHORT\_SHA}/" manifests/deployment.yaml
* Run the kubectl apply -f manifests/deployment.yaml

​

2) Second trigger is to the manifests repo - Any commits to main branch

* Run the kubectl apply -f manifests/deployment.yaml

I understand CICD can be done in a different ways and it depends on my needs but this is a personal project I am working on to practice CICD skills so I wanted to check if you would change/add any stage as I mentioned above.

Appreciate the help in advance.

https://redd.it/nv43ud
@r_devops