I'm new in DevOps, Question for Ansible + git + AWS

Hi everyone, I’ve started working from SysAdmin to DevOps, I have a task, use Ansible to automate the deploy from git.

Currently to perform an deploy I perform these steps:

git describe
git status
# Deploy new version
git fetch --tags
git reset --hard <target_version>


Is it possible to automate the deploy of new versions through Ansible? and in case the task fails to return to a previous version?

Regards,

https://redd.it/rimeqx
@r_devops

Are you ready for the holidays?

We wrote about how SREs can prepare for the 2021 holiday season coming up!

https://redd.it/riq5db
@r_devops

Upgrade Google App Engine

Hi folks
I am new to GCP

I have deployed my application of Google app engine. Now traffic load has been increased and I want to increase the compute power. Can anyone help me out how I can achieve this ?

Can you guys share a link ? And we can estimate the cost price

https://redd.it/ripv95
@r_devops

Task Ask your managers or CTO, "What do they think DevOps is"? ... Post their answer.

I find most problems with DevOps is a warped idea of what DevOps is / should be. Let's see how endemic this problem is. :D

https://redd.it/rit9p4
@r_devops

How to use Terraform and Pulumi together to incrementally migrate infrastructure tooling

https://transcend.io/blog/use-terraform-pulumi-together-migrate-infrastructure-tooling

https://redd.it/ritrcv
@r_devops

Build the deployment system around GitHub in minutes.

I thought the r/devops subreddit might be interested in this project I just found!

https://github.com/gitploy-io/gitploy

https://redd.it/ripoxr
@r_devops

How to learn devops in 2022?

So a bit of a background, as of currently i have knowledge of MERN stack (python too), and for version control git. I had also checked for roadmap on (roadmap.sh) but it felt overwhelming. What should be my next steps for devops?, some suggestions for courses and books will be immensly helpful too. Thanx for giving it a read. Have a nice day

https://redd.it/riwqba
@r_devops

Confused about Devops transition

I have been learning devops related technologies from a while. But whenever I go through blind, most of people say SRE/Devops are not much required. They are someone who failed SWE interview. Google needed just support engineers so they names it SRE to look cool.
Especially developers saying, SWE is always a best job and they have to look after Devops related task too

Also on the other side of internet Devops people are getting paid more than SWE sometimes ( for good skills).

I don't understand why these people downgrade Devops/SRE jobs.

So according to you, what skillset a successful devops engineer must have?

https://redd.it/rizzlf
@r_devops

How to become a good DevOps Engineer? Newbie here, I need advice

I need advice from experienced DevOps engineers. I am new in this field and sometimes it's hard to keep up with all the tools, I guess I am having a hard time integrating all the things I've learned so far and continuously learning more.

I have experience as a backend web developer and I transitioned into this role, I'm an intern and I need advice. I enjoy what I do but sometimes I feel a bit lost, tbh.

https://redd.it/rj16u0
@r_devops

Is Terraform is the only choice in 2021/2?

I've been looking at Terraform and know it's very powerful and mainstream.

My only issues:

* HCL language is an interesting DSL, but would prefer just using a mainstream language, but I know CDKTF exists but this seems very young at the moment?
* Terraform state, this deeply troubles me, I think HashiCorp has made a major architecture flaw, a permanent state shouldn't be ever needed in theory at least, however having ephemeral state that can be re-generated would be a good optimisation.

What alternatives are there that is:

* Free open source
* Doesn't use state
* Uses mainstream language and no custom DSL

https://redd.it/rj498b
@r_devops

Is Bret Fisher Docker Course the best one?

I've seen so many students enrolled in Docker Course of Bret Fisher, in Udemy. Is it worth the money to take on that course?

https://redd.it/rjbnhi
@r_devops

What are your important tips when migrating on-prem to AWS?

So I'm studying aws-certified-solutions-architect in order to be able to move my company's on-prem servers to AWS.
What, out of your experience, are the key things to take in count ?

https://redd.it/rjfgbz
@r_devops

A simple open source CLI application to detect large files that are eating up your file system storage

I have developed a CLI application to detect large files of file system that are eating up the valuable storage. I hope it will help you a lot while searching through huge file systems. Please let me know your suggestions to improve this tool.

Github URL: https://github.com/rbrahul/large-file-finder

Available in PyPI repository: https://pypi.org/project/large-file-finder/

Thanks for having a look.

https://redd.it/rjl91c
@r_devops

I feel like my development team could benefit from some devops practices, but I don't know enough about devops to give any recommendations. Please help.

I work at a company with a small dev team (\~5 people) that primarily does data analytics for healthcare institutions. We use git for development, but basically just to have "backups" of our code. I feel like I don't know enough about devops to ask the right questions, but I think the best way to explain the problem is to explain first (1) what we do with the data on a high-level and (2) then what our development setup/workflow is for adding features/fixing issues.

1. What we do with the data:

We have many clients, each sending us data in several csv files over ftp. We load it into a database on our main server, making tables for each client's data; pretty straightforward, most clients do it the same way with little issues. We also keep the raw data around in a directory for a certain period of time for safety and other dev work.

Then comes to the data analysis part, we have a specific git repo/project for each client because they usually all want some custom analytics or their workflow for some common process might be different from another client that does. So we're looking at different strings in different columns or what have you.

2. Our dev setup/workflow:

Our setup seems strange to me, here's the gist:

all developers have to rdp into our main server which has both dev and prod code.
We have those projects in a directory on a shared drive, the projects also all have git repos and are hosted on bitbucket.
But everyone has access to those project directories to make changes, people can make changes without needing to use git, people hardly ever make commits or push them (not to mention, some non-dev focused people also have access to these directories to run a package for a client or make some small change).
And we can't really clone these projects on our local laptops and test them because all the data we'd need to use for testing is on the rdp server and we're not allowed to have copies of that data on our local laptops.

(When I asked about the reason for this, the answer I got was basically, "our contracts only allow us to have client data on this one server, so we can't clone the project repos on our individual laptops and copy client data to test locally there".)

________________________________________________________________________

It's not like my last job where each developer would clone a git repo for a project and push/pr changes to the repo which would then be built and tested, then and then automatically sent out in weekly builds.

We're planning to soon bring on more people for the dev team, and things have mostly worked out OK so far because the team is small enough that people rarely step on eachother's toes, trying to edit the same projects at once and such. But I think we need to change how we do things, but I don't really know *what* to suggest because of our setup with where our code is "deployed" which is the same server as where all the development happens.

________________________________________________________________________

My attempt at a solution is below, I think it sounds *OK*, but it's contingent on a big if: buying a new dev server.

Devs would have to RDP into the newdev server and clone a project from bitbucket. And have them copy raw data files from our main server to use for testing if they need it.

Spin up a jenkins server that will watch our bitbucket repos for pushes, and then publish the code on the main server to be used by our automated processes.

Then lock down user access to the main server's code/projects directory so that nobody can write to it without having to go through git on the dev server.

______________________________________

Everyone would still be rdp-ing into the same server for dev work, but

projects are pretty small usually, and devs could probably clone em their user directories as needed then push to the source hosting site. Could be an awful idea, I am not sure.

https://redd.it/rjmqn2
@r_devops

Salaries in Canada

I'm a new immigrant to Canada and was wondering what kind of salary range should I expect when I apply for devops jobs here. I have ~5 years of experience, but would like to hear what people are paid at bottom and top end of the spectrum.

https://redd.it/rjr7m5
@r_devops

Looking for an Business Partner with IT experience

Hi,

I am in the process of development of this app idea and looking for an experienced IT business partner to handle the technical side of things. Both of us will be cofounders in contract and I'll bear the costs of the project. Please let me know if anyone is interested.

https://redd.it/rjrsly
@r_devops

What is DevOps | Easy Explained | How is DevOps used in Netflix?

So, what exactly is DevOps? So, in this article, I'm going to answer that question from a perspective that you might be able to relate to, assuming that if you're reading this, you've heard the term DevOps somewhere and it sounds interesting to you, but you want to get past the theory and the political agenda and the eight-hour dissertations and the people trying to sell you stuff and just figure out, what do you actually do for DevOps? more

https://redd.it/rjwpyj
@r_devops

Got a year of spare time to learn. The catch: I don't have any internet access.

Every month, I "work" for 18 days at a military base and then get a 10-day holiday where I get to go home and have access to the internet. The 18 days I spend at the military involve me siting at a computer desk working on administrative stuff for 1 hour, then spending the other 6 hours doing nothing. I'm already two months in and I feel I've forgotten some of the CS stuff I learned in my MIS degree.

Anyways, I want to get into DevOps so I was thinking of buying some PDF textbooks, putting them on a USB stick and then reading them on the computer at the military branch I work in during those 18 days.

The problem is I don't know what's better for me long term: slowly studying CS during this whole year, or learning DevOps so I can find a job when I finish my service by the end of the year.

1. CS route: I would study from the books mentioned on the highly recommended teachyourselfcs site. Thing is, I don't know if I need to know all of this if I want to work in a DevOps role or even a backend role?

2. DevOps route: I've come across the DevOps roadmap recommended often on here and was thinking of buying books for each category (Python, Linux Admin, Networking, IaC, Docker, Cloud). This great comment mentioned by u/jacurtis perfectly illustrates what I mean.

My concern is how feasible would it be to learn these things without internet and without a code editor to practice on for 18 days/month. I'm literally running on stock windows pc with no internet or admin priviglies at the place I'm working in, hence the need for text-based pdf books to study from.

I need some guidance on what you guys think will be good for me in the long term. Which route should I take? Or should I combine a little of both? How do I go about doing this knowing I have 3 weeks no internet access/1 week internet access per month? Please help a lost soldier out...

Note: I have some programming background in C++ and Python, as well as some frontend internship experience. I also took several CS and IS courses in my MIS degree.

https://redd.it/rjwauj
@r_devops

VMware related devops tasks ?

Hi , I am learning python and now it’s a time to start a project and because my main experience is in VMware vsphere , I am thinking to do something in python+VMware . I have no experience with Devops , so please guide me what kind of day to day work you guys do related with VMware or even Linux related.

https://redd.it/rjxkju
@r_devops

Kubernetes, Jenkins, Docker/Packer, and dynamic kickstart server.

I'm running a bare metal k8s cluster with Jenkins as my CI/CD tool and using Proxmox as a hypervisor for all of the x86 nodes. I'm trying to use Packer to build a Gold Image for immutable infrastructure and Terraform and whatnot. It all works by hand in that if I log on to a node that has Packer installed, I can type packer build template.pkr.hcl and a few minutes later, I have my image template ready to go on my Proxmox server.

However, now I'm trying to migrate the code to Jenkins. I'm using a containerTemplate so that I can use the hashicorp/packer Docker image to perform the build. While I could simply install Packer on each of the nodes, I'd rather not. I'd rather just utilize Docker images for my build steps.

The problem is that when Packer runs, it stands up a tiny webserver to serve the kickstart file. My kickstart file is dynamic (in that I generate the ssh_password on every build and have to inject the encrypted password into the kickstart file so the provisioning step can run and get the cloud-init packages installed and so on). But, that tiny webserver not only has a dynamically assigned port number, that tiny webserver ends up attached to the service CIDR address of the k8s-instantiated Docker image which means that Proxmox doesn't have a route.

For instance, Proxmox is running on 192.168.121.5, but the kickstart server is running on 100.65.20.2 which means that Proxmox doesn't have a route into the service CIDR (nor do I want a route for obvious reasons).

Has anybody else faced this same problem and solved it?

One option that I've considered is that I can dynamically update the kickstart file, upload it to a Nexus repository server, inject that Nexus server URL into the pkr.hcl boot command as an environment variable, and delete the kickstart file upon completion, but I was hoping there might be a more elegant solution.

https://redd.it/rk1m9a
@r_devops