Looking for cloud-native solution to provide multiple sandbox environments to developers

Hey there,

My boss asked me to provide a better solution for creating environments for devs, something that can replace your groovy scripts and Jenkins. We use it with aws cli to create environments and deploy the app. I've been thinking about this for a few hours now. I don't see anything to help me with this except scripts in lambda and Cloudformation templates. It cannot be terraform (because we have almost 100 or more envs, some created to be destroyed immediately after that). Do you know how I could improve this process? Is there a tool that would allow me to manage it better?

https://redd.it/ri2qd6
@r_devops

Deploying and managing software running in containers at the edge of the network comes with a set of unique problems. If you're interested in solving them, read on.

The prevalence of smart devices at the Edge is projected to quadruple by 2025. Deploying and managing software running in containers at the edge of the network comes with a set of unique problems. Catch this live webinar to learn how Portainer has solved them.
https://www.portainer.io/discover-how-to-manage-the-software-running-on-my-edge-devices

https://redd.it/ri28qg
@r_devops

docker: not found in Jenkins pipeline

Hi /r/devops

I'm doing end-to-end CI/CD pipeline practice but I am running into some issues while trying to build docker images in Jenkins.

1. I set up a docker container with jenkins/jenkins
2. Set up and install plugins in the Jenkins instance, including Docker and Docker Pipeline
3. Set up Jenkinsfile copy and pasted from the Jenkins docs :
https://www.jenkins.io/doc/book/pipeline/docker/
4. It gives me docker: not found

I've been stuck on this issue for a good 2 days, I am not sure why I cannot get docker to install automatically from the plugin selection list. I think going into the container to install docker with curl is kind of counter intuitive in the CI/CD / automating resource provisioning sense.

Does anyone know what I can do to get past this road block?

Thanks a bunch

https://redd.it/ri1utn
@r_devops

A Programming Language Preference Survey

Hello everyone. I am part of a dev project that would like some input on programming language popularity. Below you will find a link to a 12 question survey. Any and all input would be greatly appreciated. The survey is annonymous and the results will only be shared amongst our small dev team and no where else. We hope your input will help us build and deliver software tailored to the most popular programming languages so that collective development efforts can be made to make computing better for all of us now and into the future. Your input is very valuable to us and much appreciated. Thank you and keep on developing the future.

Survey Link - https://forms.gle/6wHCVFju526umv1t5

https://redd.it/ri6luq
@r_devops

Nested map in Terraform for azurermstoragedatalakegen2filesystem and looping?

Hello,

I can make multiple containers, and I can assign the same ACLs to those containers.

I can't seem to wrap my head around creating a container and assigning specific ACE/ACLs to the specific container... if that makes sense? I am using the provider below.

[azurerm\storage_data_lake_gen2_filesystem | Resources | hashicorp/azurerm | Terraform Registry](https://registry.terraform.io/providers/hashicorp/azurerm/latest/docs/resources/storagedatalakegen2filesystem)

If you look at the second section below, I have datalakes and ace in locals. Basically, I create two folders, and then assign ace permissions to both. But how can I construct something like this?

I have a block where I have two folders, and each folder gets specific ACE configs....

\---------------------------------------------------

datalakes = {
001 = {
name = "test1"
ace = {
"perm1" = {
scope       = "default"
type        = "user"
id          = "373d54d3-9011-490e-91be-2a70fddd9617"
permissions = "rwx"
        },
"perm2" = {
scope       = "default"
type        = "user"
id          = "3a0d091a-250c-43bf-a286-b704fa443c2d"
permissions = "rwx"
        }
    }
  }
002 = {
name = "test2"
ace = {
"perm3" = {
scope       = "default"
type        = "user"
id          = "yyyy-----"
permissions = "rwx"
        },
"perm4" = {
scope       = "default"
type        = "user"
id          = "xxxx-...."
permissions = "rwx"
        }
    }
  }
}

\------------------------------------------------------------------------

terraform {
required_providers {
azurerm = {
source  = "hashicorp/azurerm"
version = "=2.88.0"
    }
  }
}
# Configure the Microsoft Azure Provider
provider "azurerm" {
# The "feature" block is required for AzureRM provider 2.x.
# If you're using version 1.x, the "features" block is not allowed.
features {}
}
locals {
resource_group_name = "RG-SA2"
resource_location = "Central US"
# Blob Storage
storage_account_name = "sa123xyzjjjkkkk"
account_tier = "Standard"
account_replication_type = "LRS"
account_kind = "StorageV2"
is_hns_enabled = "true"
#Datalake
datalake = "datalaketest"
datalakes = {
001 = {
name = "test1"
  }
002 = {
name = "test2"
  }
}
ace = {
"perm1" = {
scope       = "default"
type        = "user"
id          = "373d54d3-9011-490e-91be-2a70fddd9617"
permissions = "rwx"
        },
"perm2" = {
scope       = "default"
type        = "user"
id          = "3a0d091a-250c-43bf-a286-b704fa443c2d"
permissions = "rwx"
        }
      }
}
module "resource_group" {
source = "../../../modules/resource-group"
name = local.resource_group_name
location = local.resource_location
}
module "storage_account" {
source = "../../../modules/storage-account"
name = local.storage_account_name
resource_group_name = module.resource_group.name
location = module.resource_group.location
account_tier = local.account_tier
account_replication_type = local.account_replication_type
account_kind = local.account_kind
is_hns_enabled = true
}
module "storage_account_datalake" {
for_each = local.datalakes
source = "../../../modules/storage-account-datalake"
name = each.value.name
storage_account_id = module.storage_account.id
ace = local.ace
}

https://redd.it/ri75a0
@r_devops

How To Scale Your Web Applications With Heroku - Guide

This article will show you how to scale your web apps with Heroku: How To Scale Your Web Applications With Heroku

The two ways to scale with Heroku manually is compared. You can either use the Heroku Dashboard or Heroku Command Line Interface (CLI) to allocate additional resources to your app.

Generally, you’ll need to scale the app’s resources before hitting the maximum limit. With that said, it is helpful to learn the exact condition before you need to start scaling.

The article also shows how you have access to auto-scaling capability when you are using the performance tiers of Heroku or have dynos running on private spaces. If you run apps on tiers that doesn’t support autoscaling, you can turn to the Heroku marketplace for alternatives implemented via add-ons.

https://redd.it/rhzy9u
@r_devops

AWS DEPLOYMENT GROUP DOUBT

while creating DEPLOYMENT GROUP in aws I encountered this option..what should i put here

Enter a service role with CodeDeploy permissions that grants AWS CodeDeploy access to your target instances.

(enter a service role ARN)

https://redd.it/rhy1d9
@r_devops

How to Deploy Full Stack Application (PERN) on AWS ( Im a noob)

Hello All,

I have a PERN stack application ( Postgres, express, node, react) that I would like to deploy on AWS. However, I have never used AWS before.

Should I do this with nginx or containerizing everything with ECS? is nginx "outdated"?

Can anyone recommend any courses on youtube or udemy on how to do this? I would also like to learn more about cloud architecture What materials do you guys suggest? Is this the right sub to ask?

thanks in advance.

https://redd.it/rhn3t7
@r_devops

Staying up-to-date: articles and resources...

What DevOps-related podcasts/audiobooks/product webinar content/etc. have you been listening to lately?

https://redd.it/rhd6od
@r_devops

In retrospect what you've spent most of your time in the past 30 days (except meetings)?

I'll be upfront, I'm a startup guy, trying to figure out what to work on in the DevOps space. My personal experience is quite narrow since I worked mostly at startups where I had privilege to work on the most advanced state-of-the-art technologies.


So my question is quite simple. If you look at how did you spent most of your time in the past 30 days and you wish you wouldn't?

https://redd.it/rh63vr
@r_devops

What are your thoughts about IAST/RASP, does it work as it claims?

I am currently working on a POC with Hdiv for security embedded on applications, have you worked with Hdiv or any other related for this matter, specially IAST?, Is it worth it or SAST/DAST can perform just as good?.....any experience or opinions will be greatly appreciated...

https://redd.it/rg8owq
@r_devops

How to monitor Crowdstrike falcon-sensor kernel threads/processes and resources on linux platform?

Hi all,

Is there a good way to monitor falcon-sensor kernel threads/processes and their resource usage? We had issues with it fighting with redis and some other databases and we would like to setup some monitoring on those resources, in particular when it takes a lot of system cpu time and slab.

I was thinking about going systemtap route and combine it with prometheus so I am currently investigating such options, however if someone has already done something in that area I would be quite interested to see possible options.

I have tried asking in Crowdstrike reddit but apparently my account doesn't have enough age and/or carma so my post was removed.

https://redd.it/rg6sxl
@r_devops

Help me save childhood photos

Hey I have flash drive from ~10 years ago and I plugged it into a PC and noticed that many of the pics (.jpg and .png) and vids (.mov) are unable to open (not sure if corrupted is the correct term). One .mobile specifically opened and I watched the video and then I unplugged the flash drive and plugged it back in a few minutes later and that file no longer opens.

I would like to save all the pics and vids but am having trouble figuring out how.

If anyone here can help me save these I'll pay $$$ for your time/help and be forever grateful bc some of these pics and vids have extreme sentimental value

https://redd.it/rgjbih
@r_devops

DevOps course but text based, not video?

I'm in search of a DevOps roadmap course, but text based. I'm not good at following video based tutorials. Any recommendations?

https://redd.it/rig8tm
@r_devops

DevOps Best Practices 2021

To get the most out of any technology, it is important to inculcate or adopt the best practices, as they not only guarantee seamless workflow but also ensure efficient time management, avoid redundancy, save efforts and cost, among other things. Similarly, organizations need to use certain practices and techniques while implementing various DevOps concepts and processes to innovate faster, ensure consistency, and streamlining successful application/software development and infrastructure management. These best practices include:

1. CI/CD
2. Microservice.
3. Monitoring and Logging
4. Infrastructure as Code
5. Shift Left

https://redd.it/rg8hbd
@r_devops

That Junior Dev you hired last week...

You know this is true...

https://redd.it/rgbh67
@r_devops

What is Table of Content for DevOps Career??

What is the best tools that one needs to know to learn devops.
For eg:
1. Version Control: Git
2. Containerization: Docker
3. Jekins
4. Puppet
…..Etc……

https://redd.it/ri5xfs
@r_devops

Ansible troubleshooting - undefined variable How to reproduce the undefined variable error in Ansible, troubleshooting, and fix to be able to successfully print the value of a variable on screen. #ansible #troubleshooting #code #playbook #variable

https://youtu.be/-a3kucoXKAk

https://redd.it/rikxaf
@r_devops

Terraform: remote-exec error ssh failed

I have no idea why I keep getting this error, the key is obviously where it's supposed to be.

Error: remote-exec provisioner error

│

│ with aws_instance.devops,

│ on main.tf line 87, in resource "aws_instance" "devops":

│ 87: provisioner "remote-exec" {

│

│ Failed to read ssh private key: no key found

​

The key is located in the same folder from where I run terraform apply.

​

Here's a relevant part of the script (within aws_instance resource)

​

provisioner "remote-exec" {

inline = [

"echo 'SSH IS READY'"

\]

}

connection {

type = "ssh"

host = self.public_ip

user = "ubuntu"

private_key = file("devops.pem")

}

https://redd.it/riksrz
@r_devops

On-call by default: how we do it at incident.io

https://incident.io/blog/on-call-at-incident-io

Hey all!

My colleague Chris (https://twitter.com/evnsio) wrote a great guide to on-call that we've shared as a blog post.

It's a lot of good common sense, but explained in plain language and might be a good starting point for anyone setting up an on-call rota at their own companies.

Hope you find it useful!

https://redd.it/rin8ii
@r_devops

What does a Cloud Security Engineer actually do?

On one hand, I hear people say Cloud Sec roles are mostly just IAM engineering and management.


While on the other hand, I hear it's a lot of automation of monitoring tools and compliance frameworks.


I'm sure it's both but what could I reasonably expect if I were to walk into a cloud sec job tomorrow?

https://redd.it/rimgfq
@r_devops