devops programming languages / how to further my devops career

I've been a sysadmin for 20+ years and through my current job have learned some devops skillsets like terraform, cicd azure devops and aws cloudformation etc. However were mostly just doing security or engineering stuff these days and not too much devops as we have dedicated cloud engineers.

Since ive come from a sys admin / engineering background i dont have much programming knowledge, id like to learn more about programming and devops.

Looking for suggestions to what I can lear to further my devops skills. Such as languages I can learn that could be helpful for my devops career as well as help with my current sysadmin job.

Python has interested me but not sure how much ill actually use it in a devops role. Thinking maybe its best to just upskill in terraform more or learn something like kubernetes although its a bit tough as we dont really get to play with these at work

https://redd.it/uqhtxm
@r_devops

Thoughts on moving from senior management back to an individual contributor? Can this move be done without going "backwards"?

Posting here, since I think it's the closest programming related sub that matches my experience, but happy to take suggestions on other places to ask.

I've been in a financial services company for the majority of my career. About half the time as an individual contributor, the other half as a Director/VP.

I'm currently responsible for a significant portion of the cloud strategy. AWS, networking therein, Dev(Sec)Ops, the works. While my role is classified as senior management, I don't shy away from supporting the team when it comes to getting your hands dirty with an advanced technical problem. I (still) know my stuff.

I'm growing weary of the role though. There's a lot of disfunction in the organization, and I spend more time solving organizational issues than technical ones. And while it's been my ability to solve both technical and organizational issues effectively that's gotten me to where I am now, I get little satisfaction from the latter.

Some days I feel like I would be happier just jumping back into an individual contributor role and making the best of the infrastructure, architecture, automation, and other such skills.

I'd love to hear stories from anyone else who's found themselves in a similar position. How'd it go? What was the reaction from your next employer? Did you stick to the individual contributor role, or did old habits kick in and land you back in management anyways? And of course, one of the most burning questions on my mind... what happened with compensation?

https://redd.it/uqgyif
@r_devops

How we deploy to production over 100 times a day

Hello, I work for Monzo. We have embraced the devops philosophy for deploying software, which I think is fairly unusual for a bank! This has allowed us to maintain a rapid per-engineer release cadence despite a significant increase in headcount.

So I thought it would be interesting to share some details on our engineering culture as well as tooling and architecture that allows us to achieve this.

https://monzo.com/blog/2022/05/16/how-we-deploy-to-production-over-100-times-a-day


I'm happy to answer any questions!

https://redd.it/uqrwq2
@r_devops

CloudFront vs Fastly

CDN pricing is among the most complex I've seen. It looks like Fastly does better if your workload is a lot of small requests but CloudFront does better if you have higher bandwidth or longer lived edge functions. https://www.vantage.sh/blog/cloudfront-fastly-cdn-comparison

Curious what others' experiences have been like?

https://redd.it/uqzio0
@r_devops

Good questions for a "Devops Manager" position

Looking for good questions for a "Devops manager" role.

Our org has dedicated "devops engineers" who manage the CI\\CD pipeline & SRE responsibilities on a per team basis. Some teams have more than one engineer depending on the # of services they support, devops engineers are part of a scrum team and their work shows in JIRA along with the development work for the same team. We are 100% cloud based, mostly in AWS 100% IaC (Terraform). Most of our work is pretty standard websites or web services along with a decent amount of EMR.

Looking for open ended questions to ask our candidates.

https://redd.it/uqvsmt
@r_devops

Site Live & Hosted Elsewhere - But, Need WP Staging Site

Hi,

Our initial website was created with React and it's hosted through AWS. Every edit is sent through our dev team overseas. We want to give our design/copy team access to a CMS (wordpress) to make quick edits.

We're trying to draft/stage a WP website and wondering the best way to do this. It seems like we have to buy a new domain, hosting, and download wordpress in order to start creating a staging site. Eventually, we'll redirect our true domain to wordpress, but we want to have a website fully designed before doing this.

Any ideas on best practice here?

https://redd.it/ur8opf
@r_devops

Devops for a non dev shoP?

So, I work for a shop that has 0 dev presence. We don't write anything above scripts for specific tasks, which are already stored in Git and fully tested via a drone pipeline.

We're primarily a Windows shop, with a very minimal Linux and container footprint.

I'm wondering on the best way to introduce more Devops mindset into an environment such as this. We've already moved to using things like Packer for our image builds, but would love to transistion over to Terraform if possible. In addition, using things like Ansible for VM deploment/Network Deployment/etc are on my short list. But I feel there has to be 'more' than that, as those are things I could do just as easily with Powershell native.

Thoughts?

https://redd.it/urcjz2
@r_devops

Expectations from a Principal Software Engineer (DevOps)

The following job advert for a "Principal Software Engineer (DevOps)" appears to have a high degree of technical skills that are required. Is this realistically what the industry expects or is the employer/recruiter casting a very wide net and hoping to find a candidate that closely matches the skillset?

**Culture fit is everything here, although you will need strong technical experience as well in:**


* Using the right tools are essentials to DevOps practices, the DevOps engineer should understand and have some knowledge on a variety of tools. Ideally have some experience in following toolchain :
* Project and Product planning tools ( e.g., JIRA, Confluence )
* Build and hosting technologies ( e.g., Kubernetes, Docker )
* Infrastructure as Code tool s ( e.g., Cross Plane, Terraform , CloudFormation, Azure Resource Template )
* Source code control tools (e.g., GitHub, GitLab, Bitbucket )
* CI/CD pipeline tools (e.g., GitHub Actions, Jenkins, AWS (Amazon Web Service) CloudFormation + AWS Code Pipeline, Azure DevOps, Bitris e )
* Observability tools (e.g., Splunk )
* Continuous Feedback tools (e.g., ServiceNow, JIRA service management, InstaBug )
* Expert in at least 1 to 2 programming languages below:
* Back-end runtime : C# .NET Core, Java, Node.js, Golang.
* Scripting language : YAML, JavaScript, Shell script
* Command-line interface : Unix, PowerShell, AWS cli, vi, vim
* Front -end : ReactJS, Angular
* Mobile : iOS (Swift), Android (Kotlin)
* Databases : SQL DB (SQL, Oracle, PostgreSQL, Aurora) and NoSQL DB (DynamoDB, Cosmos DB, Snowflake, Google Big Query)
* Automated testing frameworks : Module based, library architecture, Data Driven, Keyword Drive, Behaviour Driven.
* Expert and enterprise experience in modern application design patterns:
* REST API services
* Containers services
* Serverless application
* Deep knowledge and understanding of different hosting pattern covering IaaS (Infrastructure as a service), CaaS (Container as a Services) , PaaS (Platform as a Service), SaaS (Software as a service)
* Enterprise e xperience in at least one of the following cloud hosting platforms:
* AWS cloud – desirable
* Microsoft Azure
* Google Cloud Platform
* Excellent communication and collaboration skills and experience working in a matrix organisation structure, previous experience working under Spotify model or similar agile framework is highly desirable
* You are passionate about keeping up to date with the latest technology

https://redd.it/ure5x4
@r_devops

I'm currently in the process of screening tests for devops bootcamp but I'm afraid it will negatively affect me in the long term

so here's a TLDR:

I've been studying programming for a few months looking forward to start applying soon after I finish Data structures and algos together with a few resume projects but now a GF's friend is an HR in a Devops bootcamp so I can get in for free and they give a job at the end of it if I pass 2 tests in the middle of the bootcamp (currently im on the 3rd out of 4 screening exams for the bootcamp itself)

But im afraid it might damage my software career in the long term since I will be doing devops for some time instead of pure software engineering.

However it might be even easier to land a coding job in the future with all this experience anyway if i'm not mistaken.

I'd like to hear some advice from you guys

https://redd.it/urh7op
@r_devops

What are some really good courses for Docker & Kubernetes?

So I'm someone looking to get into DevOps and I was wondering what the best way would be to learn Docker & Kubernetes from scratch. Are there any Udemy courses that you guys recommend? Any roadmap containing different online courses that you guys recommend?

https://redd.it/urlc3e
@r_devops

DevOps vs Platform Engineering vs Performance Engineering

Hello Everyone - I've been talking to DevOps experts on LinkedIn trying to understand the area of Platform Engineering. Any experts on this forum here who could provide some background on what this field is about? Is it separate from development and DevOps teams - looks like a single team in most small businesses takes care of DevOps and Platform Engineering. Anyone here who is also familiar with Cloud performance engineering?

Reason for this clarification is because I am trying to learn what a current DevOps process looks like (meaning the typical workflow), tools used today - what's working well and what isn't working well, what type of workloads do you typically deploy over a public cloud - any automation that is working well along this DevOps pipeline etc.,.

​

https://redd.it/urk57j
@r_devops

Moving from ops to devops not realistic?

I work as a systems administrator, and I mostly deal with Windows Server, identity management, and on-prem virtualization. I'm currently working on implementing Terraform and Ansible in our environment a meaningful way, but this is challenging since it's a solo project with no guidance other than online documentation.


I have only used PowerShell for my automation up to now. Being told I need to know software development, data structures and algorithms is daunting. I'm not sure teaching myself any of these is viable, since I don't have a computer science degree and my previous attempts didn't go well.

The more I read about the topic of DevOps, the more I feel like it's not really viable for a systems admin to move into DevOps without a CompSci background, am I interpreting the situation correctly? The folks on the sysadmin subreddit don't seem to understand what DevOps is, and seem to parrot that it's just someone who build CI/CD pipelines or implements IAC.

https://redd.it/urei8n
@r_devops

Install a PowerShell module in an Azure Pipeline

Is this the correct syntax to install a PowerShell module in an Azure Pipeline?

- task: PowerShell@2
inputs:
targetType: 'inline'
script: |
Install-PackageProvider -Name NuGet -Force -Scope CurrentUser
Install-Module -Name ReportingServicesTools -Force -Scope CurrentUser

When I run the pipeline I get an error:

========================== Starting Command Output ===========================
##command"C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe" -NoLogo -NoProfile -NonInteractive -ExecutionPolicy Unrestricted -Command ". 'E:\Build1_work_temp\c9a6e80e-2701-48bf-ac75-1e04f5ef1267.ps1'"
WARNING: MSG:UnableToDownload «https://go.microsoft.com/fwlink/?LinkID=627338&clcid=0x409» «»
WARNING: Unable to download the list of available providers. Check your internet connection.
WARNING: Unable to download from URI 'https://go.microsoft.com/fwlink/?LinkID=627338&clcid=0x409' to ''.
Install-PackageProvider : No match was found for the specified search criteria for the provider 'NuGet'. The package
provider requires 'PackageManagement' and 'Provider' tags. Please check if the specified package has the tags.
At E:\Build1_work_temp\c9a6e80e-2701-48bf-ac75-1e04f5ef1267.ps1:2 char:1
+ Install-PackageProvider -Name NuGet -Force -Scope CurrentUser
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : InvalidArgument: (Microsoft.Power...PackageProvider:InstallPackageProvider) Install-Pac
kageProvider, Exception
+ FullyQualifiedErrorId : NoMatchFoundForProvider,Microsoft.PowerShell.PackageManagement.Cmdlets.InstallPackagePro
vider

I don't know if this is related to the syntax or if the agent actually doesn't have internet access.

** edit **

The agent does have internet access as this task worked:

- task: CmdLine@2
displayName: Ping Google's DNS
inputs:
script: 'ping 8.8.8.8'

​

https://redd.it/urqsoe
@r_devops

Test Data Management

Hey All,

I'm looking on some advice for a solution for test data at my company. We are currently using a product called actifio to replicate and dedupe our prod data so we can then mount virtual copies for our Dev and QA environments. Not sure how many people are doing anything like this or if we are just odd ducklings in this regard, but we have several large databases and a bunch of smaller ones that we routinely refresh from our production data so that our development and QA environments have valid data to test with. Due to the size of the data we need something that virtualizes the data so that we don't need 25 copies of all of it. We also can't go to the cloud so I need something that we would host on prem. Or are we just doing things completely wrong and coming at the solution sideways. If there is another way to handle databases for Dev/QA that would also be appreciated. Thanks in advance for any advice you can give.

https://redd.it/urvf48
@r_devops

Larry Ellison on cloud computing - has this aged well?

13 years ago Larry Ellison dismissed Cloud Computing as another fad

"Maybe we'll just change some of the wording on our ads"

"The computing industry is the only fashion industry that changes faster that the clothing fashion industry"

"They said open source was going to kill our software"

"The first thing they said was mainframes are going to die, but watching mainframes die is the slowest thing ever"

Was he right in some ways, too dismissive in others? What do you think?


Video for context/source:

https://youtu.be/0FacYAI6DY0

https://redd.it/urw2yk
@r_devops

Automate All the Boring Kubernetes Operations with Python

Hi /r/DevOps,

Today I published an article titled "Automate All the Boring Kubernetes Operations with Python", where I explain how you can use Python's Kubernetes client library to automate common tasks such as creating/patching resources, watching events, accessing containers and more.

Here's the link: https://betterprogramming.pub/automate-all-the-boring-kubernetes-operations-with-python-7a31bbf7a387

Feedback is very much appreciated!

https://redd.it/us72zr
@r_devops

Lessons Learned Using Vault As A Secret Store

Hi,

some time ago I have presented on a local meetup on a topic of Secrets Management and so I have collected my notes on HashiCorp Vault operation and put it to a blog post. Hope someone finds it useful.

https://www.malgregator.com/post/lessons-learned-using-vault-secret-store/

https://redd.it/usb0ys
@r_devops

About to give up on GitLab (ACL). Any advice appreciated

Disclaimer: Forgive me if If this has been asked before and I just fail at searching or if I'm violating any post guidelines.

​

Quick notes:

Licensing level is flexible. Saving money is good but meeting our goals is better

We have a partitioned, seperate lower env vs prod env, jenkins environment currently. This solves all of our regulatory requirements for separation of duties but jenkins is a lot more hands on, jenkins groovy dsl and addon management is a constant cat mouse issue, and we would like to divest ourselves of custom code where possible ease the maintenance burden.

​

High level goals:

Allow developers to execute pipeline actions/deployments to lower level environments.

Prevent developers from starting any pipeline actions that would result in a deployment to production/ protected environments. Allow a separate privileged group to perform these actions.

​

Basic problem:

Gitlab pipeline ACL is controlled by the yml config. There doesnt seem to be a way to both limit what access groups/users have access to execute on a pipeline at a granular enough level.

​

What has been tried:

* Configuring runners to only be accessible to certain groups and structure group membership in different ways to allow a pipeline to \*see\* a runner but only in for certain user logins
* Result: Doesnt seems workable. Runner visibility seem to be binary, the job can either see the runner or it cant. If it can see it then it can run on it and if it cant, well it cant. there doesnt seem to be any user context to filter on.
* Creating parent Gitlab yamls in other project that are locked to specific groups for editing and used as the base configuration for all other pipelines to inherit from.
* This works well from a yml config sharing perspective but there doesnt seem to be a way to **force** a project inherit from these configs. A user can simply write their own config and targe a production runner and potentially break something. And even if you lock down the merging and setup protected branches, pipelines can be run on branches and use whatever tml is also in that branch so the user could break production with a branch version of a yml config
* Creating protected environments - this seems like its the encouraged path to protect deployments but it seems... incomplete?
* Were still kind of exploring this option but its not obvious to us yet how this will be any better then the above two scenarios

​

Stuff not tried yet:

* publishing artifacts to a different location in gitlab and locking down the pipeline deployment from there.
* seems doable but also kinda defeats the purpose of having a nice connected pipeline to watch a artifact move through the envs
* Plugins or Addons
* not opposed to it but havent explored it enough. somewhat hesitant about external modifications just to achieve what seesm to be very basic acl

https://redd.it/usf09a
@r_devops

Larry Ellison on cloud computing - has this aged well?

13 years ago Larry Ellison dismissed Cloud Computing as another fad

"Maybe we'll just change some of the wording on our ads"

"The computing industry is the only fashion industry that changes faster that the clothing fashion industry"

"They said open source was going to kill our software"

"The first thing they said was mainframes are going to die, but watching mainframes die is the slowest thing ever"

Was he right in some ways, too dismissive in others? What do you think?


Video for context/source:

https://youtu.be/0FacYAI6DY0

https://redd.it/urw2yk
@r_devops

do you read devops news?

I work with several clients in the DevOps / DevSecOps space and I'm curious what news / websites you look at for industry news?

If you don't care to read industry news, but prefer blogs, podcasts, etc. please share those insights too!

https://redd.it/usje9o
@r_devops

What makes a good DevOps manager?

Interested to see what everyone thinks makes a good DevOps manager. What things should they do? What should they avoid doing? What makes them a top 10% manager? What do you hate when a manager does? What matters most to you about your manager?

https://redd.it/ustzqj
@r_devops