Degraded network end user side vs server side

​

Hey guys, i've been tasked with evaluating how our application performs in a degraded network environment for the end user/client. By degraded network I'm talking about restricted bandwidth, packet loss, and latency. My infrastructure team is pushing that we just throttle traffic coming from the web server (test enviornment) and that "its the same" as if the network was throttled end user side .

Doing this would take work off their plate as we have an end user vm range and they would have to spin up a vm/virtual router to route that traffic through.

I'm not a networking expert but this feels wrong. Issues with packets going out != issues with packets coming down. Thoughts ?

https://redd.it/fygqhr
@r_devops

Looking for a persistent distributed delayed task queue/scheduler

Hello!

I'm currently designing a backend architecture which will have to deal with the following problem: some servers will frequently need to schedule relatively precise (~1 second leaway) tasks to be executed, potentially in a long time (probably up to 72 hours) but sometimes promptly (down to 5 seconds later).

I've seen multiple ways to handle it, some relying on polling some SQL databases regularly, but what comes out to me is that I just really need a strongly persistent, delayed message queue. The task producers would send messages along with their expected execution time in the queue, and consumers would be notified by the queue at the right time to process them. The only missing part in this design is what queue to use, as I really am not confident enough nor have the dedication to build one myself.

I've looked through a few things. The most interesting candidate was RabbitMQ with its delayed message plugin, unfortunately the plugin starts to misbehave after roughly a hundred thousand events stored (and in fact [the maintainers even discourage using it for long term messages](https://github.com/rabbitmq/rabbitmq-delayed-message-exchange/issues/72#issuecomment-258926670) like I would). I've also read about [Celery](https://www.celeryproject.org/), but it being built in Python might not be suitable for the sort of load I need.

Do you know of another queue that would satisfy the kind of work this server would face? Or should I try to come up with a different solution?

Thank you very much in advance.

https://redd.it/fyfa60
@r_devops

Docker image vulnerability scan

Hi! Could You please share solutions You are using for rocker image vulnerability scanning? I am wondering about most popular approach, on one hand there is core of clair available and other we have commercial products like one qualys has in portfolio.

I am talking about architecture where repo is on organisation promise - for example satisfactory, nexus or harbour.

Could You please share Your experience in using image vulnerability scanner?

https://redd.it/fyf7cl
@r_devops

GitLab vs Github? Which one is better?

Hey guys, just released my new article on the topic - GitLab vs Github: [https://blog.codegiant.io/gitlab-vs-github-which-one-is-better-2020-d8ec7fb9542c](https://blog.codegiant.io/gitlab-vs-github-which-one-is-better-2020-d8ec7fb9542c)


Feel free to check it out and let me know what you think. I'm open to further optimization.


Also, let me know in the comments which one do you prefer.

https://redd.it/fyknv5
@r_devops

Working Helpdesk now... Focus on what?

Currently working an IT Support Specialist job. It's a fully Microsoft shop with a hybrid environment. I use Powershell pretty regularly to manage AD and Exchange, mostly. They also use AWS for some things. It's a cool job but my next goal is to have something DevOps/Cloud related. I have an AWS certified solutions architect associate.

I've noticed that my networking knowledge is a bit weak so I've started studying for the Network+ cert. I'm not sure if I'll sit for it but I want to prepare like I will. I also want to get the AWS SysOps cert within the next few months.

My main question is, do you think getting a CCNA would be beneficial to getting into a cloud / DevOps position next? I want to spend my time as wisely as possible and I feel the CCNA could potentially be beneficial, but it sounds like a large undertaking and could potentially not help me as much as I would think. Besides the next AWS cert, what other certs or tools to learn would you recommend to someone who is currently working Helpdesk but wants to break into Cloud next?

I have a PC with Ubuntu on it at home, but haven't played with it much since I started this job (Jan). I also have an active LinuxAcademy sub I haven't used much in the last couple months either. Any advice would be appreciated.

https://redd.it/fz5n58
@r_devops

Jenkins Kubernetes Use Params

I am using jenkins on Kubernetes using the kubernetes plugin. Can someone point me to the syntax on how one can use Jenkins Params inside Pod Templates?

https://redd.it/fycdaa
@r_devops

Sysadmin Learning - What are the first steps to become Devops?

Currently I'm a new Sysadmin working mainly on Windows, and am wanting to advance my career as build a roadmap. I like creating a clear path and I would like some direction on what I should focus FIRST to become a Devops. For example, if I were to tell myself 2-3 years ago how to become a Sysadmin I would have given myself this rough roadmap to figure things out:

1. Active Directory (helps me understand the basics of a domain)
2. Windows Server and their roles
3. Visualizing those Servers using any Hypervisors (using 1 helped me learn the other)
4. Scripting on PowerShell for anything you do
5. Learning those above while getting certified in MCSA/MCSE etc.

I was hoping someone can give me just a list of bare minimum or most popular things I need to know to get started specifically from a non-developer and a Sysadmin to become a Devops. I get a bit overwhelmed searching when people start listing 10 different technologies I have never heard of, I can't figure out what they are or how to dive into it. What's the metaphorical "Active Directory" if you will of Devops...

My own guess that I've found is:

1. Learning containers like Docker? (Is Docker a good starting tool to learn about containers?) Should I learn Chef/Puppet first?
2. Ansible - To automate deployment? (I thought Python did that too, or should I learn Python?)
3. Linux in general
4. Should I skip all that above and learn Azure/AWS?

Do I sound like too much of a non-developer to become a Devops? I need to be more of a Cloud Admin or something?

As you can see I'm quite lost.

Much appreciated!

https://redd.it/fyavs3
@r_devops

Blog Post: How to Parse ARM Output Variables in Azure DevOps Pipelines

Hey guys, I just wrote a shiny new blog post you may enjoy.

Summary: Learn, step-by-step how to take the easy route to convert ARM deployment outputs to pipeline variables.

https://adamtheautomator.com/arm-output-variables-in-azure-pipelines-powershell/

https://redd.it/fz8usl
@r_devops

Any free certification in DevOps (to utilise the lockdown period) ?



https://redd.it/fzcdcb
@r_devops

People with Devops/SRE title, What are your day to day activities at high level?

I know everyone won't be doing the same thing. and each day is different.

https://redd.it/fz7phg
@r_devops

Another free eBook, this time from Google: Building Secure and Reliable Systems

Enjoy! https://landing.google.com/sre/books/

https://redd.it/fz1e97
@r_devops

HashiCorp Vault alternatives

Hi all,

I was wandering can anyone suggest me an alternative to HashiCosp Vault? I wanted to use it, but lack of auto-unsealing and loads of posts I read about it gave me cold feet. I need something running in docker isolated network and be used by services on the same isolated network to keep SSH keys and service username/passwords during image builds and maybe rotating passwords for DBs. Maybe I did not quite understand its logic/purpose, but why would I want to have AWS or GCP instances just to be able to unseal something running locally? If this happens once, that is something I can live with; but on each reset?!

Thank you kindly

https://redd.it/fz2ftl
@r_devops

DevOPs workflow ?

Guys, let me see if I am tripping balls or this is something somewhat achievable. total devops noob here, just know what it means =)

I haven't developed for a couple of years until i got involved in our CTI initiative at my company. Basically maintaning a couple of scripts that grab and parse data from our sandboxes and create stix packages and misp submissions.

It is all done in python and i am using pycharm and our internal gitlab to do most of the work.

Doing this over a couple of times I thought that it would be good to:

1) Have pycharm browse the gitlab (or other?) repository of projects

2) Once I find the repository i want to work on it it would lock the repository (or the file, i have done some research and it looks like there is no repository lock but only file lock on gitlab enterprise)

3) Have the GitLab repository somehow 'tell' Pycharm to setup a remote debugging session where the code on that repository is running.

4) Finally present all the files from the repository as pycharm tabs.

5) As it finishes, push the code to gitlab which will do CI/CD

​

Am I alone ?

https://redd.it/fzmq2n
@r_devops

Finding Good DevOp'ers?

I'm not sure if this is the proper place to ask, but a friend has asked me for advice on finding a good person/people for her website. The MVP started as a Wordpress site with lots of customization for all the API's they needed to hook into all the data sources required for her business. The dev who did the MVP is about at the top of her skill set and I suggested that she containerized the site and break it into microservices for the 2.0 site, as well as create a standardized build environment using Docker so anyone else brought in could jump right in. Unfortunately, the dev has zero experience with any of this and has prevented any real progress with the 2.0 version my friend wants to launch. She feels held hostage by her dev since she isn't a technologist and has no contacts in that arena. I though I'd ask here to see where you guys find good people for project like this. Any suggestions would be appreciated, and mods, sorry if this question goes against any rules here.
Thanks, all!

https://redd.it/fzikde
@r_devops

Hashicorp vault

Hi all I am trying to create a child namespace under the parent namespace and I created the child name space successfully but I am unable to see it do I need to attach any particular policies for the group ? Any suggestions will be helpful

https://redd.it/fzi3k9
@r_devops

Will express-sessions + redis for cookie auth mess up my Next API Route Serverlessness?

Hey - pretty new to all this. Am I good using express-sessions for serverless? Deploying to AWS Lambda

https://redd.it/fzpzbj
@r_devops

Twitter Handles to follow

Any good twitter accounts you guys recommend?

Trying to grow my Twitter. 0 following 0 followers looks pretty great but then I’d be yelling into the void

https://redd.it/fzjtbp
@r_devops

Friends and Family Minecraft Server Terraform Recipe

Now is a great time to setup a virtual space for you and your family to play together digitally. I created this Terraform recipe to make it super easy to get a sanely configured Minecraft server up an running. It's secure and shuts down automatically within 24 hours. Game state is preserved across sessions. Left unattended it will cost less than $2 a month to host. Go show your family the magic of devops :)

[https://www.futurice.com/blog/friends-and-family-minecraft-server-terraform-recipe](https://www.futurice.com/blog/friends-and-family-minecraft-server-terraform-recipe)

https://redd.it/fzvmjh
@r_devops

Is the AWS Devops Certified Engineer a good introduction to devops?

I currently use AWS at work and have been wanting to learn more about devops and possibly work towards getting a devops role.

Is this an overall good cert for learning devops practices and tools? I know you're locked down to AWS tools, but I'm wondering if the fundamentals and processes and are the same and if the knowlege would translate to more commonly used open source tools. Thanks!

*AWS Certified Devops Engineer

https://redd.it/fzx18s
@r_devops

Terraform in resume

Hey community, I've been using Terraform extensively for the last 6 months to **build and provision the architecture of my team**. This involved writing modules for a variety of services such as APIs, queues, functions and others. But now that I am trying to update my resume, I have found it difficult to describe the work as it is literally building and provisioning infrastructure through Terraform, which is one bullet point. I had to do the same issue when adding the Serverless Framework to my resume; which I was using to do the same but in a different team.

Will having one bullet point be enough? Any ideas of how to provide better information? Thanks in advance.

https://redd.it/fzx7it
@r_devops

Should a developer be familiar with SRE practices?

Hi. I am a front-end developer who only worked with javascript related staff.

Recently our company switched development approach, so every developer now has to be familiar with Kubernetes/Jenkins/SLI/SLO and etc. The official reason is that our SRE guys are overloaded and we have to help them by solving some trivial DevOps problems without their involvement.

It's not a small company, we have \~600 R&D people in EU.

What do you think about such an approach ? I have now access to all AWS/Azure environments (except prod) and I'm a little bit worried about it. (I am also thinking of deploying minecraft server to ur cluster)

Also, I am extremely confused with Kubernetes (the third day trying to configure Traefik ingress service on local microk8s cluster without success). There is a lot of information on the internet and it differs depending on the Kubernetes version and its implementation. Could you guys please recommend some good learning plan(resources) for Kubernetes? I would like to learn it on my local Linux system without the virtualization level (VirtualBox) and not mess with the cloud, for now, this is why I chose Microk8s.

https://redd.it/g01f6d
@r_devops