I feel like my development team could benefit from some devops practices, but I don't know enough about devops to give any recommendations. Please help.

I work at a company with a small dev team (\~5 people) that primarily does data analytics for healthcare institutions. We use git for development, but basically just to have "backups" of our code. I feel like I don't know enough about devops to ask the right questions, but I think the best way to explain the problem is to explain first (1) what we do with the data on a high-level and (2) then what our development setup/workflow is for adding features/fixing issues.

1. What we do with the data:

We have many clients, each sending us data in several csv files over ftp. We load it into a database on our main server, making tables for each client's data; pretty straightforward, most clients do it the same way with little issues. We also keep the raw data around in a directory for a certain period of time for safety and other dev work.

Then comes to the data analysis part, we have a specific git repo/project for each client because they usually all want some custom analytics or their workflow for some common process might be different from another client that does. So we're looking at different strings in different columns or what have you.

2. Our dev setup/workflow:

Our setup seems strange to me, here's the gist:

all developers have to rdp into our main server which has both dev and prod code.
We have those projects in a directory on a shared drive, the projects also all have git repos and are hosted on bitbucket.
But everyone has access to those project directories to make changes, people can make changes without needing to use git, people hardly ever make commits or push them (not to mention, some non-dev focused people also have access to these directories to run a package for a client or make some small change).
And we can't really clone these projects on our local laptops and test them because all the data we'd need to use for testing is on the rdp server and we're not allowed to have copies of that data on our local laptops.

(When I asked about the reason for this, the answer I got was basically, "our contracts only allow us to have client data on this one server, so we can't clone the project repos on our individual laptops and copy client data to test locally there".)

________________________________________________________________________

It's not like my last job where each developer would clone a git repo for a project and push/pr changes to the repo which would then be built and tested, then and then automatically sent out in weekly builds.

We're planning to soon bring on more people for the dev team, and things have mostly worked out OK so far because the team is small enough that people rarely step on eachother's toes, trying to edit the same projects at once and such. But I think we need to change how we do things, but I don't really know *what* to suggest because of our setup with where our code is "deployed" which is the same server as where all the development happens.

________________________________________________________________________

My attempt at a solution is below, I think it sounds *OK*, but it's contingent on a big if: buying a new dev server.

Devs would have to RDP into the newdev server and clone a project from bitbucket. And have them copy raw data files from our main server to use for testing if they need it.

Spin up a jenkins server that will watch our bitbucket repos for pushes, and then publish the code on the main server to be used by our automated processes.

Then lock down user access to the main server's code/projects directory so that nobody can write to it without having to go through git on the dev server.

______________________________________

Everyone would still be rdp-ing into the same server for dev work, but

projects are pretty small usually, and devs could probably clone em their user directories as needed then push to the source hosting site. Could be an awful idea, I am not sure.

https://redd.it/rjmqn2
@r_devops

Salaries in Canada

I'm a new immigrant to Canada and was wondering what kind of salary range should I expect when I apply for devops jobs here. I have ~5 years of experience, but would like to hear what people are paid at bottom and top end of the spectrum.

https://redd.it/rjr7m5
@r_devops

Looking for an Business Partner with IT experience

Hi,

I am in the process of development of this app idea and looking for an experienced IT business partner to handle the technical side of things. Both of us will be cofounders in contract and I'll bear the costs of the project. Please let me know if anyone is interested.

https://redd.it/rjrsly
@r_devops

What is DevOps | Easy Explained | How is DevOps used in Netflix?

So, what exactly is DevOps? So, in this article, I'm going to answer that question from a perspective that you might be able to relate to, assuming that if you're reading this, you've heard the term DevOps somewhere and it sounds interesting to you, but you want to get past the theory and the political agenda and the eight-hour dissertations and the people trying to sell you stuff and just figure out, what do you actually do for DevOps? more

https://redd.it/rjwpyj
@r_devops

Got a year of spare time to learn. The catch: I don't have any internet access.

Every month, I "work" for 18 days at a military base and then get a 10-day holiday where I get to go home and have access to the internet. The 18 days I spend at the military involve me siting at a computer desk working on administrative stuff for 1 hour, then spending the other 6 hours doing nothing. I'm already two months in and I feel I've forgotten some of the CS stuff I learned in my MIS degree.

Anyways, I want to get into DevOps so I was thinking of buying some PDF textbooks, putting them on a USB stick and then reading them on the computer at the military branch I work in during those 18 days.

The problem is I don't know what's better for me long term: slowly studying CS during this whole year, or learning DevOps so I can find a job when I finish my service by the end of the year.

1. CS route: I would study from the books mentioned on the highly recommended teachyourselfcs site. Thing is, I don't know if I need to know all of this if I want to work in a DevOps role or even a backend role?

2. DevOps route: I've come across the DevOps roadmap recommended often on here and was thinking of buying books for each category (Python, Linux Admin, Networking, IaC, Docker, Cloud). This great comment mentioned by u/jacurtis perfectly illustrates what I mean.

My concern is how feasible would it be to learn these things without internet and without a code editor to practice on for 18 days/month. I'm literally running on stock windows pc with no internet or admin priviglies at the place I'm working in, hence the need for text-based pdf books to study from.

I need some guidance on what you guys think will be good for me in the long term. Which route should I take? Or should I combine a little of both? How do I go about doing this knowing I have 3 weeks no internet access/1 week internet access per month? Please help a lost soldier out...

Note: I have some programming background in C++ and Python, as well as some frontend internship experience. I also took several CS and IS courses in my MIS degree.

https://redd.it/rjwauj
@r_devops

VMware related devops tasks ?

Hi , I am learning python and now it’s a time to start a project and because my main experience is in VMware vsphere , I am thinking to do something in python+VMware . I have no experience with Devops , so please guide me what kind of day to day work you guys do related with VMware or even Linux related.

https://redd.it/rjxkju
@r_devops

Kubernetes, Jenkins, Docker/Packer, and dynamic kickstart server.

I'm running a bare metal k8s cluster with Jenkins as my CI/CD tool and using Proxmox as a hypervisor for all of the x86 nodes. I'm trying to use Packer to build a Gold Image for immutable infrastructure and Terraform and whatnot. It all works by hand in that if I log on to a node that has Packer installed, I can type packer build template.pkr.hcl and a few minutes later, I have my image template ready to go on my Proxmox server.

However, now I'm trying to migrate the code to Jenkins. I'm using a containerTemplate so that I can use the hashicorp/packer Docker image to perform the build. While I could simply install Packer on each of the nodes, I'd rather not. I'd rather just utilize Docker images for my build steps.

The problem is that when Packer runs, it stands up a tiny webserver to serve the kickstart file. My kickstart file is dynamic (in that I generate the ssh_password on every build and have to inject the encrypted password into the kickstart file so the provisioning step can run and get the cloud-init packages installed and so on). But, that tiny webserver not only has a dynamically assigned port number, that tiny webserver ends up attached to the service CIDR address of the k8s-instantiated Docker image which means that Proxmox doesn't have a route.

For instance, Proxmox is running on 192.168.121.5, but the kickstart server is running on 100.65.20.2 which means that Proxmox doesn't have a route into the service CIDR (nor do I want a route for obvious reasons).

Has anybody else faced this same problem and solved it?

One option that I've considered is that I can dynamically update the kickstart file, upload it to a Nexus repository server, inject that Nexus server URL into the pkr.hcl boot command as an environment variable, and delete the kickstart file upon completion, but I was hoping there might be a more elegant solution.

https://redd.it/rk1m9a
@r_devops

Help me to develope my self in Devops

Hello every one now l'm learning devops and i need advices from you
How to start ?
What is the important things which i must to understand it ?
And where i can find internship as a devops engineer ?

https://redd.it/rjvr1d
@r_devops

How would you setup multi AWS environments for your team?

I have the privilege of setting up AWS infra for my team. We currently have everything in one account and my initial thoughts are to make this catch-all account a service account and then have it reach into a dev, stage, and prod aws account for deploys. Are there better patterns?

Alternatively, should I just use the control tower account factory capability of terraform mentioned here? If you have used it, please could you chime in? Or if you've done something similar with AWS CDK, I'd like to hear from you too. Thanks!

https://redd.it/rjjd8b
@r_devops

Being able to design right cloud solution for given software

I am software engineer with 2+ years of experience. I wear multiple hats in projects I work on and one of those hats is designing cloud architecture based on technical requirements and deploying project based on that architecture. The problem is that I have a hard time designing such architectures, as I don't know how to choose a right solution from a right vendor for implementing a specific requirement in project. For example: I have to implement image/video upload & retrieval - I search for the services and learn about the following possible options:

- Use Cloud Storage
- Use AWS S3
- Use DigitalOcean Spaces
- Use AWS EC2 VM as file system for those files
- Use Compute Engine VM as file system for those files
- Use DigitalOcean Droplet as file system for those files

but I can't choose a right solution which will be scalable, reliable, and affordable (important!) among all those vendors and all their services, and hidden costs of each service which becomes visible after scaling up.

What specific skills do I have to learn? What am I doing wrong?

https://redd.it/rk52ka
@r_devops

Grab your Digital Copy of Solutions Architect handbook - HURRY

Packt will be publishing "Solution Architect’s Handbook – Second Edition"

Grab your digital copy now if you feel you are interested.

As part of our marketing activities, we are offering free digital copies of the book in return for unbiased feedback in the form of a reader review.

This book is designed to show you how to create robust, scalable, highly available and fault-tolerant solutions by learning different aspects of Solution architecture and next-generation architecture design in the Cloud environment.


Here is what you will learn from the book:

1. Explore the various roles of a solutions architect in the enterprise landscape
2. Implement key design principles and patterns to build high-performance, cost-effective solutions  
3. Choose appropriate strategies to secure your architectures and increase their availability 
4. Modernize legacy applications with the help of cloud integration 
5. Understand big data processing, IoT, and quantum computing, and how they fit into modern architecture
6. Integrate a DevOps mindset to promote collaboration, increase operational efficiency, and streamline production

Please comment below or DM me for more details.

https://redd.it/rk6a98
@r_devops

How do you use Go in your DevOps job?

I'm pretty proficient with a few languages, however Go has recently caught my eye and im learning the basics.

I know they say Go is up their with Python as the big language for DevOps Engineers.

What are some ways you are using Go in your job?

(I know popular tools like Terraform, Docker and k8s are written in Go. I'd like to exclude these, as it isn't very relevant what language these tools are written in unless you are a contributor to those projects)

https://redd.it/rkd8gd
@r_devops

Best practice for K8's Charts

I am learning k8's for my job but I am not understanding building your k8's charts. I am seeing some people everything in a single chart while others break them apart. What would be best way to write your yaml charts ?

https://redd.it/rkd65x
@r_devops

Developing is hard

I am slowly starting to appreciate all the apps and websites i use more and more lately. The fact that everything works almost perfectly without breaking is very impressive. Reddit is a huge feat. The iOS is a remarkable piece of technology. I appreciate every single one of you. Our work is literally shaping the world.


Good stuff everyone.

https://redd.it/rkh012
@r_devops

Best Coursera tech courses/master track/certificate

​

Hey what is the best one to take for a beginner that want to start a career in tech?

https://redd.it/rkkubo
@r_devops

Today I learned "Signoz architecture is more simpler than Prometheus+Cortex"

One of my AWS client's (a gaming company) was searching for APM and decided to do POC with DataDog, after reading /researching a couple of days I understood DD has more complex & heavy pricing. So I turned towards open-source mainly Prometheus and Grafana, but since it isn't the case of "one-size-fits-all" I was still diving deeper in open source and came across Signoz an open-source APM based on OpenTelemetry component. If anyone has used Signoz please let me know your views about it.

https://redd.it/rkm6e7
@r_devops

Testing in DevOps - Everything You Need to Know

A DevOps testing strategy must be focused on continuous testing. Here's the detailed guide on DevOps workflow, the benefits of testing in DevOps, best practices, etc.

https://www.mindinventory.com/blog/devops-testing-strategy/

https://redd.it/rkkb9b
@r_devops

What do you do (as a junior) when you're new and cannot learn the systems without help but your entire team is too busy?

I'm the only junior in a team of nearly 10.

Been here for almost 2 months on my team. I've learned a few things about our systems. I was new to the vast majority of the technology. I've had about 4 short sessions 1 on 1 for anywhere from 10 mins to about an hour. The problem is that the complexity of this system takes at least 5 or 6 months (according to team)...and that's for more experienced people than myself. And no one really tells me to do anything or helps unless I ask and manage to find a free slot in their schedule.

I feel like I'm not doing much a lot of the time. I look over the ticket I'm working on but I've reached the farthest point I could get to without guidance. The other team members are working on much more important things than this ticket.

At this rate, I'll never learn enough to contribute, learn our systems and function independently. Not sure what to do.

https://redd.it/rkofl1
@r_devops

Groovy scripting for a Jenkins file

Hi I am trying to write a shared library which has to be in groovy language
Does anyone have any suggestions for as to where to learn groovy wrt to Jenkins shared library
Like a best tutorial for groovy+ jenkinsfile
The docs of Jenkins never really helped me any other alternatives or your suggestions?

https://redd.it/rkpa3h
@r_devops

I am not able to upload files to my ftp server's nested directory

I have setup a ftp server using vsftpd, enables the write permission, and I am able to upload files to my home directory /home/ftpuser, however, if I create a sub folder inside my home directory, I am not bale to upload files to that sub-directory /home/ftpuser/test . How can I change this?

https://redd.it/rkqmnz
@r_devops