What kind of metrics is New Relic bad at keeping track of?

I want to try and keep track of ETL processes and what stage processes succeed and fail on. Is New Relic a good tool for this? I've mainly used it so far for things like success rates and failure rates but is it the right tool for this kind of job?

https://redd.it/pu1f7g
@r_devops

News to the Sub

Hey team. I have been a traditional network engineer for a long time. I can see and feel that it is getting phased out. I am great in programming in Python too. Do we have resources to jump in the SRE/DevOps world?

https://redd.it/pvf2hj
@r_devops

Separation of Duties

If someone can please explain this to me, I would appreciate it.

I understand that a SOD can be enforced in deployment tools or versioning tools/code repositories such as Git, Azure DevOps, Jenkins, etc. through branch protection rules. However, theoretically, couldn’t a developer still have direct access to a production environment?

I think what will help me understand this is better is if someone can explain how access to production is gained in the first place. I understand that production sits on a server with an underlying database, so would access to production be at the server level and possibly restricted through AD groups?

What good are branch protection rules for committing a change to the master branch if a change can be made directly within production? Or is access to production restricted through tools such as Azure DevOps or Git?

Thanks in advance.

https://redd.it/pvjkm8
@r_devops

DevOps please don't kill me!

Hi guys... I have read the post, where a guy asked about blogging. and all that fun stuff, and many of you encouraged this idea. I just wanted to say, that i was preparing for a longer time to engage in blogging on topics related to DevOps, and i would like to apologize if this looks like that i have stole someone idea, please it was not my intention. Today i wrote my first blog post, so if you like, please read it, i would appreciate your feedback on this. It is from Junior perspective.


https://devopsengage.com/devops-please-dont-kill-me

https://redd.it/pvg3qf
@r_devops

Terraform EC2 (Root Block device Encryption error failing to reach target state )

This error is been in the head for over 10 days.

While creating an EC2 Instance in terraform the Instance won’t reach the target state and says

│ Error: Error waiting for instance (i-*************) to become ready: Failed to reach target state. Reason: Client.InternalError: Client error on launch
│

And also we have encryption of new EBS Volumes enabled in our EC2 dashboard.

And my basic EC2 Code looks like this.
```
resource “aws_instance” “web” {
ami = “ami-"
instance_type = “t2.micro”
availability_zone = “ap-south-1a”
root_block_device {
volume_size = “10”
volume_type = “gp2”
delete_on_termination = true
encrypted = true
kms_key_arn = "arn:aws:kms:*************”
}
}
```

https://redd.it/pu0w4o
@r_devops

Gitlab CI server alternative that is more FOSS

Hi

As I understand it gitlab is open core. Are there any alternatives that are more foss (not just the core that is open) and preferably GPL'd?

thanks

https://redd.it/pvrece
@r_devops

K3S | Setup a lightweight Kubernetes Cluster in Minutes | Hands-on Tutorial

Hi folks,

I started a YT channel to share some knowledge and content to easily start into DevOps related topics. There are not many videos yet but I kindly would ask you for some feedback - positive or negative I'll take it all. ;)

I'd like to point out, that this is not about money. I do have a well payed job and do this is in my spare time.

Next topics will probably cover some basic CI/CD stuff, like GitLab && || GitHub Actions or maybe a comparison of open-source vs enterprise monitoring tools in the microservice world?

What do you think? Are there already to much channels around or can there never be enough?

https://youtu.be/1hwGdey7iUU

Cheerio,

Stephan

https://redd.it/pvr4wa
@r_devops

I have built KV Store: Config or settings store in Redis with beautiful UI and code generation

The purpose is to avoid redeploying for simple env var changes.

GitHub: https://github.com/Ananto30/kv-store

Use KV Store to store app settings or other configs that are frequently changed.

It also generates codes (Python & Java for now) to ease development.

https://redd.it/pvt3kt
@r_devops

Does a Shared VPC make sense?

quick rant: I miss the days where you could just spin up a VM on your own computer, practice the linux command line, or whatever you were interested in at the time, and then be on your merry way. Nowadays, with Cloud Native everything, it seems almost impossible to recreate this old time way of learning by doing....unless you really don't mind shelling out a bunch of money to Bezos so you can practice running a K8 Cluster for example.

I'm wondering if there exists a community that runs a VPC, it's members can spin up and practice whatever they want, and in exchange, they donate whatever they can to help out with the cost (or maybe a subscription fee)? If this doesn't exist, do you think the dev community would benefit from such a system? I feel like in doing so, it would help alleviate a lot of people's concern about the initial setup, and they could just start jumping in and learning, building, practicing, etc.

I know there would be a million concerns here with sharing a VPC, and the potential for people to get cute and try running bitcoin mining servers exist, but with IAM, billing reports, and other reporting tools, I feel like it should be feasible to mitigate those concerns, keep cost down for everyone, while letting people just build without the headache of associated cost.

https://redd.it/pvsvm5
@r_devops

AMA: I am 10y+ in backend development with strong DevOps experience

I am Romaric, CEO and co-founder of Qovery. I am building Qovery to help developers deploy their apps on AWS with a Heroku-like experience. I also believe that using a PaaS (like Heroku) should be more transparent on how it works.

Here is my background:

- 10 years ago, I was a systems engineer at Ullink (high-frequency trading ⚡️ - now ITIVITI). Part of the SRE team for 4 years, I was managing thousands of Windows, Linux, UNIX servers around the world 🌎 Scaling and performance issues at all levels :)

- 5 years ago, I was lead backend engineer at Sirdata (ad-tech industry) for 3 years. I was working on processing TB of data per week and scaling our infrastructure. At the time, we were running our infrastructure on-premise on Kubernetes.

- 2 years ago, I launched Qovery - simplifying app deployment in the cloud for every developer. 11000+ developers from more than 150 countries are using our platform. We are running a distributed infrastructure on Kubernetes.

AMA in comments 👇

https://redd.it/pw03ir
@r_devops

How to Install Portainer on Remote Server ft. VSCode?

Portainer is one of the most popular and trusted GUI for managing Docker, Swarms, ACIs and Kubernetes. The company boasts on its’ website for having 500K users, and there’s no doubt to the number looking at how easy it makes managing the tools.

This post goes on the very basics of why and how to install and configure Portainer on a Linux Virtual Machine and then use port forwarding to access the popular GUI. For this tutorial, we would focus on the Community Edition (CE) of Portainer (Installation for BE is the same but you need to plug in license during configuration) and configure it to help you manage Docker.

Link: *https://www.p3r.one/install-portainer-on-vm-vscode/*

https://redd.it/pw0blt
@r_devops

Managing Continuous Deployment with a Site that Manages Long Term Projects

I've got an interesting deployment problem I'm trying to solve. We have a website that brings you through a project step by step, with many steps relying on the data generated by the pervious step. These projects could take anywhere from a couple days to over 6 months to get through all the steps. Up to this point we have been able to coordinate with our users to time deployment of updates to the process between projects in order to avoid the issue of previous versions of the process not being backwards compatible with the new version of the process. However, this is going to be unsustainable as we begin to scale, and we would like to be able to deploy updates on a much more frequent clip than we currently do.


I'm assuming this must be a somewhat common issue and am hoping you guys might be able to point me in the direction of some of the best proven strategies for handling this type of issue. Mapping projects to a specific version of the site and keeping multiple versions of the site up and running seems like it could quickly become a nightmare for both the deployments and maintaining the code, but somehow ensuring backwards compatibility for all updates seems impossible. Thanks in advance!

https://redd.it/pvlfnk
@r_devops

On-Premise Systems Version Control

Hi folks! I have a problem with having many on-premise customers. My company used to have many different modeled databases,different column types-names..,etc. I have developed an ETL to have an unified postgresql and started to migrate all data. The main problem the system is so complex that I can still get error while deploying my script because I can never know what kind of problem I will face with different customers. I can be okay with 50 customers but 51. will throw an error. I can fix this for this specific customer but it will be different than the rest. My idea is create a repo in gitlab (company currently uses it) and run a airflow scheduler to trigger it everyday and download the python script and run it. This way I can update every customer with the same version. I have never done something like this before so any idea to do this better?

*I dont wanna be a DevOps. It can be simple :)

https://redd.it/pttsg9
@r_devops

What is your experience as a freelancer?

I work since 5 years as a consultant and being involved in many projects working focusing on provisioning, configurating & integrating services like Kafka, Spark, snowflake and many other tools/cloud services & databases. Building CI/CD pipelines (Gitlab, Azure DevOps & Github Actions), the automation tools I use mostly based on Hachicorp stack and Ansible.

I am thinking to leave my current job and start as a freelancer, in Germany. What is your opinion on such move considering the are of foucs I've mentioned above?

I would love to hear your experience and advices if you have shifted from working as full-time employee into opening your own company or Bein a freelancer.

https://redd.it/pw4gsj
@r_devops

How to pin point EKS cluster to a helm chart?

I’m trying to deploy helm on a cluster but don’t know how to pin point it to find it

https://redd.it/ptnrv3
@r_devops

Please Vote : Dynatrace Idea :Pie chart widget for SLO in the Dashboard for visualisation instead of Number

Hi Everyone,

Are there any other Dynatrace users out? How do you find the platform?

​

Also, I submitted a feature https://www.dynatrace.com/support/help/shortlink/service-level-objectives?\_ga=2.56844266.1579419949.1632188484-330688188.1630396371#analyze-problems \- it would be greatly appreciated if the subreddit could vote for it if they find it useful.

https://redd.it/psatei
@r_devops

Ubuntu + DataSourceVMware via Terraform's extra_config

##### Mission statement:
I am attempting to deploy Ubuntu VMs with Terraform on vSphere 7. Unfortunately, I've had no luck using `extra_config` to pass metadata/userdata to DataSourceVMware. It's very easy to use `vApp Properties` to transmit `hostname`, `instance-id` and `user-data` as they're clearly exposed by template. But, user-data is not a valid location for specifying network (https://cloudinit.readthedocs.io/en/latest/topics/network-config.html#default-behavior). So my solution (for network configuration) has been to use `runcmd` to create a `netplan` file in `/etc/netplan`. This is a silly kludge, it seems.

This may be an Ubuntu or Terraform specific question. If so, and this is the wrong sub, my apologies.

##### Question / Request for Assistance:
Has anyone successfully used the extra_config to interface with the VM during deployment as referenced below (copied from Grant Orchard's blog):
```
extra_config = {
"guestinfo.metadata" = base64encode(file("${path.module}/templates/metadata.yaml"))
"guestinfo.metadata.encoding" = "base64"
"guestinfo.userdata" = base64encode(file("${path.module}/templates/userdata.yaml"))
"guestinfo.userdata.encoding" = "base64"
}
```
If so, what might I be doing wrong? Something to disable vapp properties? Specify something in TF to enable the extra_config?


##### References:
https://grantorchard.com/terraform-vsphere-cloud-init/
https://github.com/vmware-archive/cloud-init-vmware-guestinfo

##### Version details:
- Client system (on which terraform is run): Ubuntu 20.04.3 LTS
- ESXi: 7.0.2 / Build: 18538813
- vCenter Server: 7.0.2 / Build: 18455184
- Cloud Image: https://cloud-images.ubuntu.com/impish/current/impish-server-cloudimg-amd64.ova
- Terraform v1.0.7
- on linux_amd64
- provider registry.terraform.io/hashicorp/template v2.2.0
- provider registry.terraform.io/hashicorp/vsphere v1.24.3

https://redd.it/pweoaj
@r_devops

Distributing GH actions over private GH repos / docker repos

The GH actions docs says:


The actions you use in your workflow can be defined in:

* A public repository
* The same repository where your workflow file references the action
* A published Docker container image on Docker Hub

I work for a customer with GH private repositories only, so distributing over public repos is not an option. I wonder what could be an alternative?

As I see it's also possible to distribute actions using docker containers, but again they should pulled from public Docker Hub, or maybe there is alternative to use private docker repositories?


Thanks

https://redd.it/pwkgtn
@r_devops

Simplest way to automate deploys

Hi everyone, i'm a backend engineer trying to get into devops. At the moment, i've been trying to set up a pipeline that triggers a docker-compose build task after a push to a given branch.

After some research, resources like Jenkins and Gitlab CI/CD seem kinda overkill for what i want to do.

Are there simpler technologies available to solve this problem, or should i just go for one of these?

https://redd.it/pwmejc
@r_devops

Top resources for learning Linux

I'm an Azure Cloud Admin and come from a Windows background. I've been learning and using Terraform, Docker, and python to position myself towards more of a DevOps type role. I think I've come to the point in my career that in order to move any further along in my career I need to finally learn Linux. It's always been on my list of skills to learn and I'm seeing that most DevOps/CloudOps positions are requiring solid Linux knowledge.

​

I'm not starting from zero in regards to Linux knowledge but I wouldn't say I'm much better than a beginner with it. I really want to become a Docker/Kubernetes expert so if there is a way to bundle in learning Linux along with either of those technologies I'd be all for it.

https://redd.it/pwop2i
@r_devops

Has anyone here moved from devops to another role?

Recently I've been thinking of switching things up as I'm not particularly interested in "devops" anymore (read IaC, cloud and building pipelines) but just stick around due to it being a fairly easy job and pretty well paying.

I've been thinking of perhaps switching to network engineering as I've got pretty good knowledge of networking already (all my experience is in the cloud though). Has anyone else made this switch or similar?

https://redd.it/pwpk38
@r_devops