Potential job offer, largely a Microsoft shop. Wrong to lose interest over this?

Hi DevOps,

I'm currently working as a DevOps Engineer on the US east coast. Largely working on Linux machines. Been doing so for about three years. My knowledge has grown ten fold since I started and I'm loving it. Love writing infrastructure as code, loved building our deployment pipeline, love using the slew of tools available to us. 99% AWS.

Fast forward to recently and an old colleague references me for their company. Very good company, west coast, huge salary bump (I'm well below average right now, part of why I was interested in moving). I did very well in the interview and have been offered to be flown in to proceed. But they're largely a Microsoft shop. Azure is fine, I have used it. But my fear is they're 99% on Windows servers and I know most of the tools are built with that as an afterthought. This is turning me off to them, but I can't decide if that's "pettiness" as I know terraform, Kubernetes, Jenkins, and most other tools are supported on it.

Ignorance on purpose isn't good either, and it's likely that many positives would come from it, but I feel skeptical about moving away from an industry standard and having to deal with another learning curve.

They're also "in the process of integrating" Kubernetes so they haven't utilized any containerization until now.

On the positive side the position would involve an Angular app, its companion app in Ionic, and using Redis for SQL which sounds really interesting and would broaden my spectrum quite a bit.

All in all I'm not trying to shut myself out from outside of my comfort zone, but I'd also like to stay in the spectrum of what is standard and will make it easier to move when I decide to.

Is it normal to be concerned about this?

https://redd.it/eoq5dt
@r_devops

Can't find an old post on a great way to build Value Chains

Hey!
This isn't directly related to devops and is a little more on the BI/Operations Research side of things.

But a while ago in a conversation in the comments, someone linked a site which described a really cool method for mapping value chains and a dependency graph.

So I'll try and describe it and, hopefully, someone will get what I'm talking about and link it.

Forgive my ramblings and thanks for taking the moment to read this, I'm after a solid hour of googling.

Essentially, it places all parts of the organization on a graph, where the parts on the left are "commodities" and the ones farther right are less so. And then like a normal dependency graph, you connect the parts of the organization that are dependent on each other. This lets you see what part of the organization you need to work on automating and what parts you don't, and plan strategies to achieve the change you want.

The example he gave was based on the film industry, where the Production team is dependent on the Actors Guild (which isn't a commodity and therefore more expensive). So instead of applying pressure on the Actors Guild, the Production team moves another part of the organization that they have more influence over, and through them apply pressure on the Actors Guild.

The authors name was something like "McOwens"


Thanks again!

https://redd.it/eorfjf
@r_devops

Slack app that integrates GitHub and Circle CI to boost collaboration

We developed this app for ourselves to help us not forget about code reviews and notify us about failed and successful builds - but without spammy behavior like other integrations.

It’s really a collaboration booster for us as it takes away the manual hustle of checking the CI and GitHub to see if the build is done and if someone assigned you for a review or if your review is done.

We thought this could help others too, so right now we are looking for just a few companies for our private beta to see if it can solve their problems too.

If you can relate to these problems I will be more than happy to share more with you.
Cheers

https://redd.it/eom6ju
@r_devops

What’s the difference between DevOps and System Admin role?

I’ve been reading around and I don’t really know much about DevOps. Some say it’s a culture, some say it’s a job, and others just write a ton of technologies to learn like AWS, docker, Git, Linux, shell scripting, etc. Is DevOps glorified IT support role? Or is it a systems admin role? Or is it a systems admin role turned into a developer role? I’m not sure what dev ops is anymore based on all the info on this sub. I’m currently a 3rd year CS student very interested in technology and working as a software engineer and all the info on this sub confuses me.

https://redd.it/eow5hy
@r_devops

I Want To Get A Deeper Understanding Of DevOps.

Hello, Everyone !!

I want to get a deeper understanding of the philosophy, tools of DevOps, and learn to put them to use. I have a the basic concepts and understanding of the more popular tools ( Jenkins, TrqavisCI, Chef ,Ansible,Dockers,Kubernetes, Terraform) that doesn't mean I can use them or atleast not yet, but I'd like to. If anyone could suggest books to read, forums or site to look at, magazines, and any education site that would really be appreciated ( a career building or entry lvl online course). I'm not sure if I want to do this as a profession, but I find it fascinating and would like to know before completely diving into this avenue of IT.

Thanks everyone !!!

https://redd.it/eox7di
@r_devops

Is expecting programmers to do dev ops the new normal?

I've had a few interviews recently, and I am being bombarded by questions about continuous integration, deployment, azure, aws... I'm a programmer, applying for programmer roles.

Is this the new normal, or is this just my podunk city? Have you guys worked in places where they had their coders play dev ops? I imagine it's a horrendous idea for obvious reasons. I respect the dev ops skill set and the role they play, but I respect it enough to know I can't do a professional quality job with it.

https://redd.it/eowr7g
@r_devops

NetEng moving to NetOps: best andible/Jenkins books for the money?

Read the Phoenix project and understanding the core concepts of cicd, agile, scrum etc. Now my .org has picked ansible with Jenkins as the toolset of choice for systems/network automation. Read the howtos on red hats site and understand concepts but really need a project book of things to practice and try to get practical experience. What do you senior folks recommend?

https://redd.it/eovn35
@r_devops

CI/CD with Jenkins and Helm

I'm working on setting up some CI/CD pipelines and am wondering how others handle it when it comes to Jenkins and Helm charts. I initally was going to use Spinnaker (for the CD part) though couldn't get ECR to work (too many hours to justify) so back to Jenkins for now.

​

I am wondering how you do your CI/CD pipelines when using Jenkins and Helm charts, I have the ECR build part working (been for a while) and am now wondering how to do the CD portion. Mainly that currently I don't see a way to have a manual judgement process or similar. Best I came up with was using params and when checks.

https://redd.it/eovh59
@r_devops

Ultimate microservices architecture, Spring vs lambda ?

Hi everyone,

I have been studying event-base microservices architecture for a while now and I am still hesitant between using a traditional approach with Spring or an AWS lambda approach using an event fork pipeline and the serverless framework as backbone for the lambda + specific resources (api gw etc.)

If anyone has been building microservices using the two way could give his feedbacks, I would greatly greatly appreciate.

Thanks a lot.

Jonathan.

https://redd.it/eov5p9
@r_devops

Transaction vs Service

Hello All,

Evaluating multiple APM products. They all seem to blur the concepts of services and business transactions. How would you classify the difference?

AppDynamics seems to push that a service represents ONLY by the performance of the endpoint of a service while a Business Transaction is a collection of calls across potentially multiple services to perform a some operation for the applicaiton.

Dynatrace seems to classify a transaction as each individual call made against a service.

DataDog seems to view a service as one or multiple endpoints that work together in some way and a span is the execution of a logical unit of work within or across services.

NewRelic seems to focus on transactions which it defines as one logical unit of work in a software application.

Does anyone know of a good resource to understand the differences? If I have a group of 10 containers each running one process presenting itself in kubernetes as a service and a rest endpoint that when called will need to touch all 10 processes to complete its task: would you say the rest endpoint is a service? or is the collection of all 10 processes the service?

https://redd.it/eov452
@r_devops

Cloud cost overruns with IaC?

I’ve been talking to some folks about when they experienced sizable cloud cost overruns, and any processes or tools they used to deal with it? (notably in a software dev org)

Personally I’ve experienced setting the wrong Azure Search tier in my Terraform script and tripling my monthly bill unexpectedly.

Any war stories anyone wants to share, especially when using Infrastructure-as-Code? Any best practices on how you’ve dealt with the problem?

https://redd.it/eou0c5
@r_devops

Resources regarding cost of various IPC among microservices?

I'm having trouble finding studies that share performance profiles of REST vs RPC among microservices. Has anyone come across such information that can be shared?

https://redd.it/eon7ug
@r_devops

DevOps pipeline vulnerability scanning

I am building some prototype DevOps pipelines to demonstrate the toolchain used in a typical production work flow. I have code running through static code analysis (sonarqube) , container image vulnerability scanning with clay and OpenSCAP scanner. I am wondering how do you handle the code and container vulnerabilities inside the pipeline stages. Do you fail the pipeline stage based on a number of new bugs/cves or manual promotion based on eyeballing? It seems pretty hard to automatically fail/pass stages for vulnerability scanning without manual inspection of the scan results.

https://redd.it/eomhsp
@r_devops

Managing monolithic repositories

Hey /r/devops,

some time ago I asked here how you manage your monolithic repos with subtree splits. Especially the tag syncing was a problem I now solved with a little tool we use in our CI/CD-Pipelines.

You can find my previous question [here](https://www.reddit.com/r/devops/comments/cw3q3o/how_do_you_manage_monorepos_with_subtree_splits/).



The [monorepo-operator](https://github.com/SimonBaeumer/monorepo-operator) is written in go and can be used on linux. It can manage your repos, syncs them and allows you to perform batch tasks on all repos concurrently.

Hopefully this helps other people facing the same problems. If you have any suggestions feel free to give me feedback.

https://redd.it/ep2mrg
@r_devops

How dangerous is it to work with a server that does not have sophisticated firewalls?

I am just starting to learn all the DevOps necessary to deploy my web apps.

My AWS ec-2 are all behind a security group that only allows SSH access from my static IP home address (just got one recently). I have made one DO droplet be accessible via a password (less than 10 letters) so I can screw around with it in class and when im not home. I still didn't learn how to do what I do with security groups in AWS (IP restrictions)on DO.

How dangerous is it? Can my machine ever get internet STD's from SSHing to an instance that is open like that? I read on SO that in mere minutes of my server going on the air, I can expect thousands of brute force attacks. But how can they find me so quick? It takes google weeks to index new domains. How are attackers notified of new instances so quick?

https://redd.it/eom1qx
@r_devops

CircleCI vs Gitlab

Hi all,

I know these topics come up frequently but I havent seen a specific comparison that doesnt end up as a discussion about 50 other CI tools too :)


I'm currently using Gitlab, very happy with it overall (coming from Jenkins originally) but my new client has developers who want to use Circle (and have experience with Circle), particularly for its out of the box macOS build integration (though we can solve that via gitlab with a macstadium runner in any case)


I'm not wedded to Gitlab and I know that CircleCI is a known-good tool, but I can't see any specifically great reasons to use Circle over Gitlab. The only one seems to be Github integration, which Gitlab does quite poorly.

​

Does anyone have any compelling generic reasons for why I should use Circle over Gitlab?

​

Thanks

https://redd.it/eojm6u
@r_devops

nfstream: a flexible network data analysis framework

nfstream is a Python package providing fast, flexible, and expressive data structures designed to make working with online or offline network data both easy and intuitive. It aims to be the fundamental high-level building block for doing practical, real world network data analysis in Python. Additionally, it has the broader goal of becoming a common network data processing framework for researchers providing data reproducibility across experiments. Feedbacks and Contributions are welcome!

[https://github.com/aouinizied/nfstream](https://github.com/aouinizied/nfstream)

https://redd.it/eokhi4
@r_devops

HAProxy scaling for large connection count

Of the people who are currently using HAProxy in large / high traffic scenarios what are your strategies for having large concurrent connection counts.

As far as I understand, using the IPv4 TCP connection the port number is defined through 2 bytes, yielding less than 65535 ports. I read a couple articles suggesting multiple IP addresses which would obviously increase that.

Are you load balancing your load balancers? At what point do you start thinking about that?

Do you control your own DNS and hand out different load balancer IPs?

I appreciate any articles or example setups you are running *successfully* in the wild.

https://redd.it/eoh5cm
@r_devops

Creating a new AWS account for my developers

I've been tasked with preparing an AWS environment for the developers at my company.

Essentially, we already have an existing account but there are a ton of old resources (e.g., VPCs, EC2 instances, S3 buckets) in it and no user management structure in place to differentiate between AWS administrators and developers. Everyone has the same permissions.

My current game plan:

* Nuke the existing resources. Send out a global email to all of engineering and tell them to tag any resource that needs to stay.
* Figure out the best way to lock down permissions for developers. Granularly defining each permission is not a route I'd like to go down. Is there a way to provide access to everything except user management IAM functions (i.e., creating new users, password resets, etc)?

I would appreciate any guidance on how to approach this as testing and development in AWS will begin to ramp up rapidly.

https://redd.it/eogdei
@r_devops

CD Pipeline - How much time does it take in your implementation?

Trying to understand what’s a reasonable expectation in terms of how much time does it take for you to compile,stage,test and deploy to production using an automated pipeline(including automated functional test execution).I understand there are different flavors of CD based on your practices am just trying to gauge a general idea about what’s acceptable in different organizations.

https://redd.it/ep838s
@r_devops