Can't estimate price for stream service on aws with s3 and cloudfront

We have 5TB of video(600 videos) data and 500 users on our platform. We don't know how much data they consume everyday. We want to use streaming service on aws with S3 and Cloudfront.
How can I estimate cost for this?

https://redd.it/dj5o6p
@r_devops

What is the best tool for heavily parametrised integration jobs/pipelines?

Hi All!

Straight to question. Imagine that you have a Jenkins job with the input parameter choice field from a dynamic list. For example, it may be field "Environment" with possible values: "test zone 159", "testing 130", "QA alpha", "QA beta". The list is made from the project's source tree or external source on the fly. It may be the result of grep on some ansible's inventory file or the result of HTTP-request.

I know that some sort of this could be made through groovy-scripting with a special plugin to Jenkins.

Is there any way to do this in GitLab CI?

What is the proper way of doing this?

What are the best practices?

https://redd.it/dj3gxb
@r_devops

Forget The Phoenix Project, go watch HBO's Chernobyl

I watched HBO's Chernobyl miniseries last week and it reminded me so much of some of the Systems Engineer environments I've worked in. From the promotion hungry middle managers overselling his team's capabilities to the YOLO ops run by untrained engineers. Even has the rollback plan that catastrophically fails and brings the entire org down with it. Yea, I had some PTSD moments for sure.

https://redd.it/dilx5e
@r_devops

What's your favorite "task runner"?

I've used a bunch of different task runners over the years: make, ant, maven, gradle, rake, invoke, npm, etc.

For me rake was a bit of a mental game changer so to speak. While make does its thing quite well, I worked at a couple Rails shops a number of years ago and Rake impressed me quite a bit.

Having a more modern version of make which offers some nice DSL/declarative properties but also allowed for full blow imperative coding is wonderful. Also, usability is huge in my book. Standardizing on a build/utility tool in the same language that all the developers are using (Ruby) is a big win.

Of course, this brings up the whole "choose the right tool for the job" debate because almost everyone is using more than one language in-house, nonetheless I'm a big fan of tasks runners.

So tell me r/devops, what task runner(s) do you use and what do you like/dislike about it?

https://redd.it/dk52r7
@r_devops

Integrate openLDAP with FreeRadius 3

Hi,

I do have a FreeRadius 3 server properly configured and up and running since years.
Now I would like to add an Active Directory to our network.

Ideally I would like to use openLDAP in a docker container since all of my process run in docker environnement.
It doesn't seems like there is a lot of documentation as for the integration between them.

Any info you can share?

​

R,

xk3tchuPx

https://redd.it/dk768r
@r_devops

Run Unit Testing in Docker Container

This article will focus on **how to run unit testing inside Docker container**, it will show how to run unit test manually inside the container.

More info about Docker container: [https://mohamedradwan.com/2019/06/30/run-unit-testing-in-docker-container-ci-cd-pipelines-to-run-unit-testing-in-docker-container-tutorial/](https://mohamedradwan.com/2019/06/30/run-unit-testing-in-docker-container-ci-cd-pipelines-to-run-unit-testing-in-docker-container-tutorial/)

https://redd.it/dk4gi3
@r_devops

CronMonit - Free Cron Monitoring Tool. Get Notified Via Email When Your Cron Jobs or Scheduled Tasks Fail

I built this tool since we're using lots of cron jobs in a project that we're working on and sometimes they fail silently or doesn't finish running for some reason and they go unnoticed for days or weeks unless we manually check the logs or the expected results (e.g, data on the database).

We've been using it on production and it works well in our use-case. Hope you'll find it useful too.

Integrating it only takes a few minutes. Your cron jobs or scheduled tasks just needs to ping a given URL by sending an HTTP request when they finished running.

URL: [https://cronmonit.app](https://cronmonit.app)

https://redd.it/dk2tl7
@r_devops

Artefacts - How to handle permissions

Hi guy,
so at our company we recently switched to Artifactory and Im currently struggling with permission setup.
Our RND adopted Large Scale Scrum model and basically anyone can do anything , they are no longer separated by components , etc.
The question is how to handle the access rights in case of automated tasks.
Should I just setup one "read" user or even allow read operation for annonymous user and setup one additional user for deployments ?

Until now the standard was annonymous user + universal deploy account.

It naturally makes no sense for our devs to use their own creds with automated workflows.

How do you handle this in your company ?

https://redd.it/dk11vg
@r_devops

Configuration Management Advice

Hello Everyone,


I am currently learning Ansible, as I understood this to be a pretty easy to learn and use Config Management system. So far, so good.


My question: We currently run our production/stage environments within Elastic Beanstalk (This was chosen by the previous architect and there are no plans in the near or probably distant future to change this architecture). Right now, the way we are configuring instances for deployment, meaning adding required packages, running pre and post deployment scripts, etc is all through the use of .ebextensions. I personally think this is a super clunky as I find myself having to rewrite the same code over and over on our different applications - since each application is a separate project(Bitbucket Repo, so each each project has its own repo with its own .ebextensions).


​

Therefore, I looked for alternatives to be able to configure our systems in one pane of glass across all applications (Example: I wanted to install htop across all servers, so I had to write config files across 4 different application repos just to install this package. I want to have a master file that I just need to apply changes to once and have it apply to all servers as I find myself in that situation a lot.



Anyway, I thought ansible is the best thing to work with (i'm already about 40% of the way into the course for Red Hat's cert on Linux Academy). But, I wanted to know what the community thinks of my choice and my requirements. I also looked at AWS Systems Manager, but I don't know how well this would work with Elastic Beanstalk. These servers need to be in the state they are required to be in each deployment, so I'm not sure if System Manager can fulfill that need. But, it does look powerful and potentially faster to setup that Ansible.


What do you guys think?



Thanks Everyone!

https://redd.it/dir64p
@r_devops

Sending traffic on Static Ip from Load Balancer in AWS
https://www.reddit.com/r/aws/comments/diqh3u/sending_traffic_on_static_ip_from_load_balancer/

https://redd.it/diqhj9
@r_devops

Concourse Fly CLI Cheat Sheet

Concourse is a pipelined-based continuous integration system created specifically for Cloud Foundry. Easy to scale and run, Concourse is built on a few components, all written in Go.

Providing a command-line interface to Concourse, the Fly tool allows for resolving a number of tasks. For instance, one is able to connect to a shell in the build’s container or upload a new pipeline configuration into a running Concourse.

Download >> [https://www.altoros.com/visuals/concourse-fly-cli-cheat-sheet/?utm\_source=quora&utm\_medium=smm&utm\_campaign=Dikusar](https://www.altoros.com/visuals/concourse-fly-cli-cheat-sheet/?utm_source=quora&utm_medium=smm&utm_campaign=Dikusar)

https://redd.it/dinfj3
@r_devops

Terraform workflow and governance?

What is your terraform workflow, more importantly how do you handle governance/access for a team using terraform?

I have used terraform myself for testing and personal stuff, but interested in best practices in an org/team.

https://redd.it/dk96yq
@r_devops

automatically update website on server when i push a new updated version on github ? possible use of containers ?

I have a server online ( running windows ) - and i have a little webproject running here that are currently being updated frequently, and what i do there is ive had to set up a FTP server on the windows machine, where i manually transfer the code ive pushed to github.

Sometimes i need to go through RDP as its running IIS if i want to do some extra managment - 9 out 10 times its okay just to overwrite the webfolder with the new files.

But its a very manual process and am annoyed by it.

Am looking for a simpler model - i was thinking 2 things :

1) create every latest version as a container that runs a webserver, and then i just have to RDP and run the container again

2) create a script serverside that automatically fetches the github repository - and manually copies the files if theres a new version on top.

Around no 1 i might do some additional programming and setup a service i could instruct to reload the container.

​

Am new to devops - ive looked into Jenkins ( and it seems like massive overkill to the point that i actually dont understand it and how it would be able to do the above task ) - abit the same with CI pipelines where ive been looking for a totourial to guide me through exactly the above.

​

Anyone have some inputs ( for dummies ) how to achieve the above the most simple way ? or the dream situation, anyone knows of a docker container that does exactly that ?

https://redd.it/dimkee
@r_devops

MacOS 10.15 no longer supports 32-bit apps. What can you do?

On October 7, 2019, Apple released a new version of its Mac operating system, macOS Catalina. Version 10.15 contains many changes and improvements. One of the significant is the complete phasing out of 32-bit applications. As a developer of such macOS apps, what can you do? You can learn more [here](https://medium.com/pvs-studio/macos-10-15-no-longer-supports-32-bit-apps-what-can-you-do-e9547e27847c)

https://redd.it/dipmjy
@r_devops

JFrog Artifactory - allocating permissions automatically

We're using Artifactory to manage build artefacts, and promoting artefacts from one repository to another based on maturity level. Our naming convention is a bit like that suggested in [JFrog's whitepaper](https://jfrog.com/whitepaper/best-practices-structuring-naming-artifactory-repositories/), so the maturity level is part of the repository name. I need to allocate permissions by group, based on the maturity level for the repository. At the moment, I'm doing this manually each time I create a new repository, but it's error prone and boring, so I'm hoping to find a way of setting Artifactory up to do this automatically.

I see the include/exclude patterns you can configure when setting up a permission, but these seem to be for specifically excluding/excluding things *within* the repository. I want to set up an include pattern for the repositories to target with the permission. E.g. have a 'RC read only' permission that allocated read permission to all repositories with '\_rc\_' in the repository name.

Any ideas?

https://redd.it/di94k6
@r_devops

Automation to end users

Hello everyone.
My boss asked me to create a portal for the end users to run repetitive tasks and after some research I found the sma ( azure pack automation) that could solve this question.
What are your opinions about that?

https://redd.it/di8zs6
@r_devops

[GCP] VPN Gateway shared with other projects

Hey, I've already posted on stackoverflow but you know how it goes over there more often than not...

I'm in the process of starting the design of the networks (VPC, subnetworks and such) as part of the process of moving a rather complex organization on-premise structure, on the cloud.

The chosen provider is GCP and I read and taken the courses to be associate engineer. However, the courses don't go into details of the technical aspects of doing something like this, just present you with the possible options.

My background is of a senior backend, then fullstack, developer. So I lack some of the very interesting and useful knowledge of a sysadmin unfortunately (on that topic, if you have some "for dummies" resources to use, i'd appreciate as well)

My situation is as follows:

* On premise VMs on several racks, reachable only inside a VPN - I've no control over this, an external company manage them
* Several projects on the GCP Cloud
* Two of them need to connect to the on-premise VPN but there could be more going on
* Some projects see each other resources (VMs, SQL, etc) using VPC Peering
* Gradually we will abandon the on-premise, unless we find some legacy application that really is messed up

Now, I could just create a new VPN connection for every project from `Hybrid Connectivity -> VPN` but I'd rather create a project dedicated to having the VPN gateway set up and allow other projects to use that resources.

Is this a possible configuration? Is it a valid design? As far as I explored the VPN creation, it seems that I'll have to create a VM that will expose an IP acting as gateway, if that's the case I was thinking to be using the VPC peering to allow other projects to exit into the on premise VPN.

No idea if I'm talking gibberish here. I'm still waiting for some information (IKE shared key, etc) before attempting anything, so I'm rather lost at this point.

https://redd.it/di5qlq
@r_devops

Stats on "you build it, you run it"

Does anyone if any studies have been done on the adoption of "you build it, you run it" vs. a more traditional IT setup? I'm curious about two figures:

1. What percentage of large companies are working at least partly on a "you build it, you run it" model these days?
2. Any stats on whether those companies are more/less successful

https://redd.it/di4gkz
@r_devops

ansible + jenkins role

Can someone recommend a good Jenkins configuration role? I would like to see how its downloaded but more important configuration (plugins, security, etc..)

https://redd.it/dkjrga
@r_devops

Continuous Integration with IAR Embedded Workbench

https://sakurautio.github.io/2019/10/18/Continuous-Integration-with-IAR-EW/

Hey everyone!

Working with the IAR tools, I didn't really find any verbose community guides on how to set up a proper CI pipeline with the IAR tools (mainly automated builds, static analysis and unit_tests).
So I decided to write a blog post about it which could hopefully help people in working with the tools.

Now the blog post is pretty "bare-bones" and just showcases how to get started really. It doesn't go over the CI system configuration (like how to set up Jenkins or so...) because it was not the point - the point was to show how to integrate the IAR tools to a CI environment.

If you have anything to add or to critisize, feel free to speak your mind. If you have any questions, I will try to answer to them.

I hope this blog post will be of help for someone.

https://redd.it/dkkm6f
@r_devops

The friendly socket and TCP handshake (E04)

Fourth video in the series explaining sockets and TCP 3 way handshake! All sorts of feedback is welcome.

Video link: [https://www.youtube.com/watch?v=L6tePc9Pqxw](https://www.youtube.com/watch?v=L6tePc9Pqxw)

https://redd.it/dkjmh3
@r_devops