Reddit DevOps
267 subscribers
1 photo
31K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
Any online assessment tools to check hands-on DevOps skills of candidates?

Folks, are there any online coding/assessment tools available to test practical AWS/Azure/GCP/Kubernetes/DevOps hands-on skills of candidates in a cloud environment/sandbox? Not MCQ type questions, but real troubleshooting, configurations etc.?

https://redd.it/ocbc6x
@r_devops
Review Apps - What Platforms Offer Them?

For the last few years I've used Heroku Pipelines for lightweight dev ops for SPA / Node applications. It's pretty fantastic in that it's reasonably easy to setup and it's opinionated in a good way. I've only used it without Docker images but I'm told it works with them as well.

But recently I joined a company that is using GCP with docker containers and basically zero dev ops. They have literally been pushing docker images up to a Kubernetes cluster which was also setup manually. I'm converting all of this to Kubernetes files but that will just get us a repeatable environment, not review apps.

My question is what are the best options for getting Review Apps up and running? I'm looking at GitLab but it's pretty flakey so far and my googles for review apps aren't showing much other than for Azure and it feels a little weird to use Azure to deploy to GCP.

Re: load, there's basically zero load on these servers. Someone just went ham and convinced them they needed all of this infrastructure for hypothetical spikes but it's a B2B company and new customers can't even self-deploy so that's not likely.

https://redd.it/oce4w0
@r_devops
E(F)K stack within ecs

I was curious if my plan to implement a basic centralized logging solution for my small startup sounds fine. I see most tutorials out there are running the EFK stack in K8s but I'd rather not since we don't use K8's anywhere.

Our product is generally deployed in two sets, the core product in AWS(ECS) and a small physical IoT device given to customers on-site(basically a linux box).

I want to collect logs from all these locations and create a central place to monitor them.

For our products ECS stack, I was planning on just adding a fluentd container to run within the cluster to collect and send off the logs to Elasticsearch.

For the small IoT box I was planning on also just running the fluentd container or the td-agent(Haven't determined when to use one or the other)


So my plan is:

1. Create ECS Fargate Cluster with two services - (Kibana and Elasticsearch)
2. Create ALB/ACM & Route 53 record for Kibana - (So the team can access dev-logs.mydomain.com)
3. Create a custom fluentd docker image - (So I can load in the custom fluentd.conf file that contains creds to authenticate and send logs to the remote elasticsearch server, contains any needed fluentd plugins, etc)
4. Run this fluentd docker container in our stack.
5. At this point things should just work?

I was hoping to get feedback if this sounds like a good plan, would this be manageable for a 1 man "ops" department or if there is a simpler / better solution.

https://redd.it/ocf4wm
@r_devops
Is 1 year experience too little to take on a job role where I'd be the only DevOps Engineer?

Looking to make a switch, spoke to the manager and the developers have been managing pipelines and infrastructure, they need an experienced devops engineer to handle everything.

I've been working with a team of Devops engineers and a tech lead, It might be a lot of responsibility and trial and error, but could be worth it.

When did you realize you did not need continuous help from someone, and if you did would you say a role like this (only DevOps engineer) is for someone with more experience?

https://redd.it/ocgjdg
@r_devops
Jaeger gRPC tracing and plugins

I have used Jaeger to trace Rest APIs for quite some time and had no problem with it, but recently my team realized that all of our recently deployed gRPC servers were not having their failed calls being traced as errors. I mean, we can see the event "error" and its message, but the error icon does not appear and it end up looking like a successful call in the UI. Any one has any ideia about it? I haven't find much reference on the internet and the closest thing that I got was the grpc-plugin. To be honest, I have no idea of the use cases for the Jaeger plugins

https://redd.it/ockynm
@r_devops
I built a new visualisation tool for AWS Infrastructure - Quadzig

Hi Reddit!

I am a Site Reliability Engineer by profession and I built Quadzig as a new tool to visualize, understand & search AWS resources. All of Quadzig's visualizations and search functionalities are built to deal well with multi AWS account setups. This means you get a single pane of glass to visualize & search your resources across all your AWS Accounts.

The product is available both as a SaaS offering(with a free tier!) and as a self-hosted solution on AWS Marketplace(if you have stricter compliance requirements).

Reference Links:

1. Quick Video demo of the product - https://www.quadzig.io/#video
2. SaaS Pricing - https://quadzig.io/#pricing
3. AWS Marketplace Offerings - https://aws.amazon.com/marketplace/seller-profile?id=92018d4d-dd3e-4942-8287-282a98a0e377

I would love it if you could give Quadzig a try and let me know your thoughts. I will be around to answer any questions.

PS: If you subscribe to AWS Marketplace offering to evaluate Quadzig, drop me a line at [email protected] and mention this Reddit post and get 100% off on first month of usage. :)

https://redd.it/ockqw7
@r_devops
newb packer ansible copy error

I want to learn the ansible provisioner for packer using vmware-iso.

I'm trying a very simple file copy with ansible during packer vmware template build.

> - name: Install test file
> copy:
> src: /root/provisioning/packer/testfile
> dest: /var/tmp/

I keep getting this error:

vsphere-iso: fatal: 127.0.0.1: FAILED! => {"changed": false, "msg": "Source /root/provisioning/packer/testfile not found"}

The file exists on the ansible controller.

> #cat /root/provisioning/packer/testfile
> this is a test

What am I missing?

https://redd.it/oclqv0
@r_devops
Will DevSecOps replace DevOps in future?

Hii everyone, I read few articles about DevSecOps and I got a bit confused. The thing I could get from the article was that, DevSecOps is a bit more advanced version of DrvOps where security testing and measure are being automated with the Software Development pipelines, but we also take care of security in DevOps ri8?

I don't understand what exactly it means and will it take over DevOps in future, or the two terms will combine in future. Can anyone help me with this ?

https://redd.it/oclczh
@r_devops
What is your tools/service on your daily devOps?

Hi, I have about 2 years in devOps world? And my hobby is to find new tools/services that can boost my productivity.

So I'd love to hear from people here to show what tools they can never live without it.

P/S: If you have a problem/idea and there is no tool out there, feel free to share too

https://redd.it/ocqor4
@r_devops
Hello everyone, I work as a system administrator for half-year. What new I need to know for a DevOps trainee position?

I know how to work with Linux using command shell, create SSH/FTP servers, created servers on the google cloud platform, create VM, Python, and basic Java.
Now, I am training to create docker images from my own projects or from GitHub python projects.

https://redd.it/ocsw3b
@r_devops
Linking Jenkins Jobs to JIRA Tickets

We have a devops set up where artifacts are tested/released to environments via a Jenkins job execution. This is done for cloud infra, micro services and everything. All Jenkins pipelines have a parameter which allows you to specify the JIRA ticket that the release relates to.

But this relies on the developer being responsible enough to link their job execution to the JIRA ticket.

I have been thinking of a system to be able to:

1. As a developer, have the capability to auto-select a JIRA ticket from the parameter in Jenkins. Or alternatively "create build" from inside JIRA (similar to create git branch).
2. Be able to link a build to a release ticket.

If you are constrained to using JIRA and Jenkins (I am aware this is probably easier with other tools), how would you go about this?

https://redd.it/ocw1tc
@r_devops
Salary check - am I being underpaid?

SMB - Hoboken NJ - Senior Cloud Engineer (3 years) - annual salary $110k + $10-20k yearly bonus

responsibilities:
- I architect and manage my company’s entire AWS infrastructure
- I architect and manage all monitoring solutions including AWS CloudWatch, Datadog, and Grafana
- I architect and manage all automation solutions within AWS and our Windows servers (scripting, task scheduling, etc.)
- I am directly involved in the hiring process for my team via interviews and vetting resumes, and training new hires

some of my future projects include:
- AWS AD implementation
- AWS SSO implementation
- Windows Server 2016 to Windows Server 2019 EC2 refresh
- rebuilding entire AWS VPC infrastructure (ideally via terraform)
- passing PCI DSS compliance
- overhauling enterprise credential management
- migrating web applications from one domain to another

In two weeks, I will be be flying solo.

https://redd.it/ocwutq
@r_devops
I have five projects in Azure DevOps boards. My designers might be doing work in one ore more of those projects during a sprint. Is there a way I can do a query that spans all of them to find out what work Designer A still has to do in each project?

Or do I need to go to Project 1 query that, Project 2 query that, Project 3 query that etc.

https://redd.it/ocynwe
@r_devops
redisql | MySQL to Redis migration made easy

Hi everyone! I recently completed redisql, a MySQL to Redis data migration engine. It's still in development, and I plan to implement more features in the future. I'd appreciate feedback on the project so far, especially with regards to documentation and the roadmap. Thanks.

https://redd.it/ocz6om
@r_devops
Is there any platform for dashboards development?

I want to build an advertisement dashboard that will get data from Facebook Twitter and google via APIs and also be able to change parameters such as bids…
Do you know a platform that can help me build dashboard like this?

https://redd.it/od1vdt
@r_devops
Infrastructure as code security - ideas and roadmap

Into: My name is Lior Kaplan, I'm heading Checkmarx's Open Source Program Office. As part of it, we've released KICS - Keeping Infrastructure as Code Secure - as Open Source (see https://github.com/Checkmarx/kics or https://kics.io).

We have our own roadmap for the project (also available on GitHub), but I'm curious to hear your input - what feature or what platform support would help you individually or us as a DevOps community to catch more security issues or to better catch existing ones. Our goal is of course to prevent such security problems arriving to production.


You're welcome to use KICS to write your own security policy/queries and to check your configuration for problems. If you need help with the idea or implementation, we'd be happy to help (github/gitter), please don't be shy (:


Kaplan
https://twitter.com/checkmarxoss

https://redd.it/ocxfex
@r_devops
Are you are support person in your devops team

I know that devops is a culture ideology, and it shouldn't be a specific team. However, I do believe that most of us here are part of a devops team. I am in a dedicated devop team at my company. That's fine, however, I feel like my team operates like a help desk support, but in the domain of devops. As an example, the development teams own their own pipelines, but when they reach out to our devops team whenever they run into an issue that they cannot resolve on their own. To be frank, the developers are better at pipelines than I am, due to the fact that they work on pipelines more that I do.

I can't be the only devops developer that operates in a similar help desk team. How do you find it? Do you like it? I don't personally like it. There are a lot of gaps in my knowledge, that I think can only be filled when I get experience implementing a feature end to end. But when I act as a support person, I don't feel that there is a lot of opportunities to fill in my knowledge gaps. I don't know how support people do it. Developers expect devops developers to know how to solve various issues, but as the devops space is vast and constantly changing, there is no single person that knows how to solve all issues off the top of your head. But, as a senior developer, you have been exposed to many things, so even though you don't know the exact answer, you can find a way to solve it.

https://redd.it/od90ci
@r_devops
There are services in AWS to run the process for the MS SQL Server database in AWS

I am stuck with the CI process for the database (MS SQLServer), I am using the AWS devops services so that the process there CI CD of our projects, I did it successfully on the Azure platform, but when I try to follow the same on the AWS platform, I can reach the process for the front-end and the middle Ware, but when it comes to the part of the database that I can not to achieve it, please, someone gives the best advice.

​

Do you know someone who can respond?

https://redd.it/od8ymb
@r_devops
New to DevOps. Looking for some tips, advices, suggestions to be successful in my new career.

Hello Everyone!

I've been trying to change my career stream from Customer service for a year now and I just landed a new job at an ecommerce company as a Junior DevOps Engineer. Most of the skills I have are pretty basic.

To the huge talent in this community, I request for some tips, tricks and workstation setup(any tools or weblinks that could help make my life easier) that could make my transition easier. Any suggestions/advices on what to look out for and what to do are super welcome.

Thanks in advance for everybody :)

https://redd.it/od84yl
@r_devops