Unit Tests coverage integration with Datadog

My team has finally decided to integrate the coverage for unit tests (created by devs) with datadog. If anyone has experience with datadog or another tool, how was the experience? I've been told DD can get pretty expensive. It is being used for mostly UI tests currently.

https://redd.it/ekyq3t
@r_devops

Bit.dev has announced a new feature for Github integration

We're used to having our remote repository as the single source-of-truth but when you share components to a collection, it becomes more complicated than that.

The Bit team has built an integration tool so that your repos are always in-sync. pretty neat.

​

[https://blog.bitsrc.io/announcing-auto-github-prs-for-component-version-bumping-74e7768bcd8a](https://blog.bitsrc.io/announcing-auto-github-prs-for-component-version-bumping-74e7768bcd8a)

https://redd.it/ekypjb
@r_devops

What are important factors when choosing a CI tool?

We are tasked with choosing a suitable CI tool for about 150 engineers. When comparing different options I found that cost is not very relevant, since most solutions are cheap compared to engineering time. What properties / features of a CI tool did you find make it worth using? How does this apply to the CI tool that you are using?

https://redd.it/ekx264
@r_devops

Overcoming lack of mentor on a job

What would you recommend to someone to overcome a lack of mentor on the job in DevOps space, given that he needs one? Hoping to get some better answers than: watch videos, do bunch of labs etc.

https://redd.it/ekwagb
@r_devops

Secret handling in Serverless

Hi guys, what is your way around handling secrets in a serverless environment (for example AWS Lambda). Couple of things to consider and I'd love your opinion about.

1. Do you get the secrets at application runtime, using <a tool>?<an api call> or do you store the secrets during deployment time in something like ENV and then get them using process env variables? I suppose the latter is harder when secrets change often.
2. How do you go about handling secrets across different environments and granting temporary credentials or credentials that change often?
3. Do you prefer to authenticate against your secret backend using AWS IAM or more traditional app based authentication?
4. In what way does secret handling transfer to your local deployment - run of applications? Did it play a role in eliminating the need for an integrated testing environment, so you can run all/most of your tests already on featurebranch lvl and only need a release branch after to go to dev - staging - prod?
5. Do you version your secrets? If yes, how? Do you do that in git, then deploy them, then deploy the app, or directly in your secret backend?
6. Do you keep an audit trail of who accessed or changed or created your secrets?

https://redd.it/ekw11c
@r_devops

Dev-Ops vs No-Ops for career prospects?

Hello all,

I've recently joined this Reddit community because I'm looking to moved into this field from my current job. I'm 26yo and a Software Engineer with Computer Science background but mostly worked in automotive industry developing software in c, kind of got stuck here since it was the first well paid job right out of college and I couldn't turn it down.

Anyhow, I want to get more into the cloud field. Particularly Dev Ops, serverless it really interesting interesting to me. To account for the missing experience I've gotten cloud certs (AWS practitioner and AWS solutions architect). My goal is to get the AWS DevOps Cert as well in next couple of months.

Trying to get an understanding of the job market in DevOps so I've been reading blogs and forums. Serverless is the buzz word it seems. However, after a bit of googling, it seems not many companies are looking for NoOps (serverless) engineers and are still hiring for DevOps with cloud experience. There's a lot of tools and services to learn while I study for this and I'd like to do some small projects along the way to show off on resume later.

I'm still undecided if while I study I should focus on regular DevOps stuff like AWS EC2, CodePipeline, CodeBuild, Chef/Puppet, GitLab, etc. Or for more serverless tools like Lambda, API gateway, AWS SAM, Serverless frameworks, AWS chalice (for python), etc.

I'm worried if I do go the serverless route for DevOps, then it'll be difficult to find a job since not many companies might be hiring for this. People working in DevOps, what do think? Any advice would be greatly appreciated. Thanks!

https://redd.it/ekwf2f
@r_devops

Book recommendations or guides for Terraform .12

Trying to get up to speed on the new features of terraform .12 and looking for the best resources.

https://redd.it/ekvx78
@r_devops

Security advantages of a pull-based CD pipeline

I feel pull-based CD pipelines are under-appreciated and have a lot to offer on the security front.

I wrote a blog post detailing the risks associated with your traditional CI/CD tools and how adopting GitOps practices for Kubernetes (for example, with flux) increases your security posture, removing some attacks paths that threat actors may wish to abuse.

I then argue that this idea needs to be taken a bit a further and extended to the rest of the pipeline.

Would love to get your feedback on these ideas and discuss it here:

https://medium.com/@alexkaskasoli/pull-based-cd-pipelines-for-security-4e044b403f56

https://redd.it/ekuvlm
@r_devops

What are your 2020 projects?

New year, new work. We all have to keep busy to improve the production environment. So what projects do you have lined up or would like to attempt? We're looking at getting more into terraform and serverless on our end. Maybe look at new APMs.

https://redd.it/elcg4w
@r_devops

Looking for an actual comparison between configuration management tools

I am setting up myself a homab, and I want to centralize the configuration of my VMs (tens, not thousands) . There are countless articles of chef vs puppet vs ansible vs salt, but what I'm really looking for is a side-by-side comparison of the of the syntax of these tools.

For example, Im looking for a resource which shows the same configuration files for each of these tools so I can compare what Ill actually be writing.

I'm mainly looking at salt and ansible right now since I like the idea of running agentless. But, in regards to ansible I'm concerned that the configuration is strictly in yaml while salt allows templating through jinja. Is this something I should be worried about or is ansible considered powerful enough that it wouldn't matter?

I know this question gets asked all the time, but I was hoping to get a little more insight on side-by-side comparisons between the actual configuration of these tools as opposed to a list of pros and cons or a table comparing agentless / configuration language / etc

https://redd.it/elc289
@r_devops

Developers: How did DevOps change your working routines?

Hello Fellow Redditors and Developers,

I would like to collect and discuss the impacts of DevOps on your working routines. Any experiences, either bad or good, failure or success, are welcome! Especially I\`m interested in pitfalls, which you encountered and how you would bypass them in retroperspective. E.g. What advice would you give fresh DevOps-Engineers focusing on development?

Some question do get us going:

How did continous feedback improve your software?

What delusions did you have and how did they stand "the test of time"?

Do you think more about Operations? If yes, what aspects?

What anti-pattern did you encounter?

Im thankful for any comment. Let's have fruitful discussion!

Greetings,

\- Martin

https://redd.it/elfjo6
@r_devops

Home project ideas please!

Hello everyone!

Not sure if this is the right sub for my question but here I go. I'll finish my CCNA next week and now I'm looking for projects to work home in my free time. While learning networking, I figured out that I loved the ideas behind DevOps, programming, automation and so on. There's many tools or concepts I saw online but I don't know where to start (Dockers, Kubernetes, Ansible, Chef, Puppet, AWS, etc, etc) My first objective is to learn Python, I have basic knowledge with Linux and scripting.

So yeah I need some ideas for things I could try and mess with as I'm not sure how are all these tools related together. I saw a post the other day very similar to this one and a guy responded with a lot of details about what the other person should do and try to learn these concepts but I can't find it anymore. I think it was in a Linux community but anyways.

Thank you!!

https://redd.it/eld6fr
@r_devops

What to do about vault pki ca expiring

When my vault ca gets close to expiring, it says it can't issue certificates past its own expiration. What's the industry-standard method of getting around this problem?

https://redd.it/elhtwj
@r_devops

Started with 20, grew to around 100 Server & APM Solutions

Back in September 2014, I wrote about an article that touched on the subject of server performance monitoring. After which, a reader asked me via LinkedIn: “I am using New Relic to monitor my cloud servers but need an alternative. Any suggestions?”

So I wanted to share and expand on my answer to that question by creating a quick/go-to list of all the server monitoring and APM solutions out there, as well as get some feedback on tools being used. I haven’t tested all of these services listed. But have used more than one third of them. Some, such as SolarWinds, Nagios and New Relic I have been using for over a decade.

Any feedback on whats missing and/or what should be removed from this 5 year old list is very welcomed.

Full list: [100 Top Server & Application Performance Monitoring (APM) Solutions](https://haydenjames.io/20-top-server-monitoring-application-performance-monitoring-apm-solutions/)

https://redd.it/eldcsi
@r_devops

CI server good to try

[https://github.com/flowci](https://github.com/flowci) is a CI server I hope it can make CI/CD easier. It can be started from docker easily, supports configuration based on YAML, multiple agents, plugins and job statistic view to see the recent build trend. if there are bugs please help to submit issue, and any suggestions are welcomed and appreciated.

https://redd.it/el9yj0
@r_devops

How do you secure configuration files required by CI?

Environment variables are easy to handle. In development, load it from a .env file. In CI, pass it in as an environment variable.

But how do you secure configuration files?

eg. I use my CI to build Android APKs which will then upload it straight to the Google Play Store. I also checked in the .keystore file required to sign the APK. However I recently learnt that the encryption used for .keystore files can be brute forced, and therefore I should avoid checking it in.

________________

How then, should I secure my configuration files?

A) Pass in the file contents as an environment variable, then get CI to _cat_ it to a file. (not practical for large files, also not maintainable)

B) Encrypt the file using AES-256, then decrypt it again when CI runs. (works, but this relies on the belief that AES-256 is uncrackable)

C) Upload the file to some external service (eg. S3), then download the file when CI runs. (seems to be the more secure solution so far. Is there any service out there catered for this?)

https://redd.it/el9htu
@r_devops

Automated scaling, self-healing without Kubernetes

My only and limited exposure has been Kubernetes and i'm interested to learn more about how the rest of the industry that doesn't use k8s handles automated scaling and healing. What are the common strategies and tools? Any favorite resources you would like to share?

https://redd.it/ell03q
@r_devops

Need your precious help with docker volumes on premises!

Hello guys,

I wish you are fine and doing good. I work as devops junior. I have tried to find a solution for a urgent task at work, but am not clear for some points. Related to docker volumes for ELK. I need a solution, how to provide persistend data of logs in docker elk if container is off or server reboots. I have checked some solution, but i would prefer something with docker compose to set up the volume, dockerfile to run and copy path also any script in linux to call the path maybe... I would appreciate if you send me any useful link or any idea. Thanks alot!

https://redd.it/elljsf
@r_devops

Running Docker in EC2 backed by EBS volume for storing data coming from docker containers

How do I save data inside EBS from a node server running inside a docker container and also do the same with mongo server inside docker to store db inside EBS volume directly, if it's possible.

https://redd.it/eljjc8
@r_devops

(AzureDevops) How to view Artifact storage usage per project/feed?

afaik the only way view the storage usage of Azure Artifacts, is by going to Organisation - Settings - Billing. ([link](https://docs.microsoft.com/en-us/azure/devops/artifacts/start-using-azure-artifacts?toc=%2Fazure%2Fdevops%2Forganizations%2Ftoc.json&bc=%2Fazure%2Fdevops%2Forganizations%2Fbreadcrumb%2Ftoc.json&view=azure-devops#view-storage-used))

There you can see the total amount of GB's used.

Is there a way to drill down to a project level or per feed?

https://redd.it/elg0uz
@r_devops