Is there a good self-serve tool for infrastructure deployments?

The company I am in has been growing beyond the scale of our DevOps team and I was wondering if there is a tool that allows for sane self-serve deployments of cloud resources like Kubernetes clusters, network policies, etc...

My main requirements are:
- IAC (Can be rebuilt from scratch with code)
- Simple setup
- Low maintenance
- Preferably open source

Things I looked at:

- Rundeck(Not IAC)
- Ansible Tower (unreliable)
- Writing my own( don’t wanna reinvent the wheel if there is one)

Thanks

https://redd.it/fj0xwd
@r_devops

Your own Kubernetes controller - Laying out the work

It’s hard nowadays to ignore Kubernetes. It has become the ubiquitous platform of choice to deploy containerized applications.

>Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications.

In a few years, Kubernetes has entrenched itself deeply in the DevOps landscape under the tutelage of the Cloud Native Computing Foundation. One could speculate about the reasons. IMHO, one very compelling argument is that it allows users to be independent of the API of a single cloud provider. If you’ve been living under the monopoly of Microsoft on the desktop in the 2000’s, you probably know what I mean.

Another reason for Kubernetes to be so widespread is that it’s relatively easy to extend it. In fact, it’s so easy a lot of software providers who offer a Docker image also provide one more operators.

In this 3-parts post, I’ll describe how to start implementing your own controller in a language other than Go, assuming zero knowledge of the subject but Kubernetes itself.

https://blog.frankel.ch/your-own-kubernetes-controller/1/

https://redd.it/fj4agk
@r_devops

What is your preferred cloud service to manage a postres db?

I'm most experienced with mongo and atlas, but right now I'm working on a side project and for sure want to go with postgres, but there are a lot of cloud service options for that and I'm kind of overwhelmed by them and in rush. So what's your favorite? Preferably it'd be low cost.

This project has 35 million+ users and that's going up fast so it'll be useful to have a redis cache as well to reduce db calls.

While the number of reads will be really high, the number of total documents and writes will be relatively small to begin with.

https://redd.it/fixw6v
@r_devops

Tomorrow I will be telling story tales for engineers

Hello everyone.

I am convinced that if you explaining something to a group of people who are engineers like you, you do not need to go deep into details, because I assume that tech people can understand the idea even without knowing to many details. But tomorrow I am going to explain what is devops to such group of engineers. Suddenly I come up with idea not to used tech language but try to make up imaginary situation or even story which have to draw the picture in their minds. Short story long. What do think? Is it good story to tell?

Imagine you are pirates. Our company is a ship, dev teams are ship crew. The ship crushed and when storm died down we found out that most of us are on island, somewhere in the ocean. Our main goal is to survive because nobody knows when we will be rescued. After stand-up meeting we decided to start building house and make the island our temporary home. We have to act quickly. The thing need to be done first, is to gather remainings of the ship, and everything that could help us survive. When we were done. It turned out that one group of people collected all the tools an instruments, another group, all the food we had on the ship. Of course there were people who collected nothing but they had experience which is nevertheless very helpful in such situation. Every time when group of people have something valuable they will convince the others that something they have is the most important thing and everybody should obey them. No doubts without tools we can not build houses and we can not get by without food. What if group of people which owns tools starts limiting the access to these tools? What if the group of people which owns food starts using food for manipulating the others? Probably we end up in fighting and arguing. Instead of finish building in 7 days we will have finished in 20 days if we will be lucky. As you probably have understood, group of people is the team, things they possess, is silos, house is the application. In order to finish building house on time we have to work together as one team. Our responsibility is not to keep safe the stuff we own, instead we are responsible for final result, for building house, for building application.

https://redd.it/fj6iua
@r_devops

Intern with a lot of struggles with Consul Connect

Hi

For my BA I'm doing in an internship with another student, where we have to research Service Mesh in Kubernetes. But we're having a big struggle with consul connect.

We wanted to setup circuit breaking (a envoy proxy feature) while using bookinfo (the sample application from the Istio guys). Do you guys have any tips how to configure the envoy proxies?

Installing consul was easy but configuring the proxies are giving us a hard time because it's the first time for us. Or do you guys have some easy examples?

Hope you guys can help :)

Cheers!

https://redd.it/fiz2gh
@r_devops

What is the cheapest way to run my program on AWS?

I have a small python bot to handle all my PR on instagram and facebook for my small business. What is the cheapest way to run my program once a day for its duration and shut down.

Ive looked into Lambda a little bit and think it might be what i'm looking for. I was also looking at the aws boto library for writing a script that would launch and instance and shutdown when complete.

Any insight would be very helpful=)

https://redd.it/fiu6ag
@r_devops

Ansible and Kubernetes for DevOps Free [Until End of March]

Thanks u/geerlingguy! As you mentioned the current turmoil is not good for the majority ...but an opportunity for all to either learn a new skill for themselves or for a new opportunities.

[https://www.jeffgeerling.com/blog/2020/you-can-get-my-devops-books-free-rest-month](https://www.jeffgeerling.com/blog/2020/you-can-get-my-devops-books-free-rest-month)

https://redd.it/fjnxlq
@r_devops

MySQL Docker Setup | How To Run MySQL In Docker Container

MySQL Docker Setup | How To Run MySQL In Docker Container

​

Watch the full video here: [https://youtu.be/EG3RhQNl00o](https://youtu.be/EG3RhQNl00o)

​

Kindly Subscribe to my channel and give your comments.

https://redd.it/fjpodu
@r_devops

Which APM are you using to monitor your .NET core and JAVA services?

Hi all

Currently we are checking the solutions to monitor our services on high load

Our existing monitoring:
- AppDynamics: in some cases it can add 20% of overhead. Performance issues if you are using the latest technologies and libraries
- NewRelic: Cost is unbelievable

There are some solutions which we want to check - Atatus and Dynatrace but I want to know your feedback and recommendations

Can you please share what are you using?

Really appreciate your suggestions

https://redd.it/fjq3f6
@r_devops

Government trys to ban encryption once again

Please help by contacting your representative.

https://act.eff.org/action/protect-our-speech-and-security-online-reject-the-graham-blumenthal-bill

https://redd.it/fjs380
@r_devops

Good ways to “fail over” to new DNS target (in event of downtime)

Currently using a fairly popular DNS provider to point our domain name to our app(s).

In the event that any target servers go down for an extended period of time, what are some quick and effective ways to transfer to a static page to control the messaging?

What are some best practices around this sort of thing?

https://redd.it/fjrsko
@r_devops

Git hosting services security (Gitlab)

How easy it is to hack a private repository with a decent password, 2 step verification and ssh.
Asking to feel safe hosting projects on gitlab, for instance.

https://redd.it/fk2609
@r_devops

Cloud-Native Technologies Mentoring - for people who want to grow or switch to Cloud-native

This company is helping candidates who want to grow their careers or switch to Cloud-Native by providing 15 minutes of 1:1 mentoring sessions. The company's senior engineers basically share their experiences/journey so far, learnings and guide the interested candidates in the right direction.


[here's the link](https://www.infracloud.io/career-in-cloud-native/)

https://redd.it/fk36u6
@r_devops

Is DevOps the answer to how to accomplish drastic & progressive changes in the workplace? I think so

I have always practiced a lot of the principles of what DevOps is founded on before I knew what DevOps was.

I started as a field tech, helpdesk, systems admin/engineer, then moved into a DevOps "swat team" role to help lead the charge with the culture shift. I've always focused on automation, visualized work, metrics-based decision making, monitoring, collaboration, the concept of feedback loops to help adjust and adapt to changing goals, priorities and objectives.

In hindsight, I can see many "I told you so" moments in my career. I've been a firm advocate for distributed workforce/WFH culture and enablement for many reasons. Now that it's critical to our economy and business operations, the "butts in seats = productivity" crowd seem to have evaporated into thin air. Pets vs cattle, "don't restore from backup, redeploy from source", immutable and distributed infrastructure, fault tolerance & high availability are all topics people are talking about again.

Be sure to take the opportunity with your peers and leadership to advocate for real, actual change to prevent this from happening again. Offer to help coordinate a retrospective to evaluate how problems/issues could have been prevented and find paths forward to implement your ideas (with some way to measure your success with quantifiable metrics/KPIs, of course).

Personally, I'm in the middle of a job hunt and have been steadfast on the WFH aspect. The hiring manager is ok with it, but the company culture would need to change so they're saying it is something that I’d need to help everyone work towards. With the recent events, I’m planning on being very firm on "no, I’m going to WFH now, and everyone else can catch up. I can help them if you want, but I’m not willing to give that up right now, it's too important to me".

My point is this: we're all valuable to the markets and industries we work in. We can be picky and push about the things we want, it's up to them to come to us. DevOps and Agile are 90% a culture shift, and that's what is truly needed to solve real, actual, hard problems that we're facing. We are uniquely capable of helping drive that change and steer its direction along the way. We're experts at adapting, learning, and surviving in chaotic & tumultuous environments.

https://redd.it/fk6zt3
@r_devops

NAGIOS and InsightVM with AWS EC2 best practices

Developer here that recently inherited some AWS infrastructure. Had a question on NAGIOS and InsightVM and best practices when used with EC2.

We have a vendor running vulnerability and NAGIOS scans from external servers against some of our EC2 instances. The security group for the EC2s is wide-open (all TCP port access) for these external servers.

​

This smells fishy to me ... someone can compromise those external servers and gain access. What are best practices? Run the scans from a private NAGIOS server inside our VPC?

​

Thanks for any advice!

https://redd.it/fk5bre
@r_devops

Autoscaling with Haproxy

[https://medium.com/devops-enthusiast/aws-autoscaling-for-haproxy-6aa35b44ebf7](https://medium.com/devops-enthusiast/aws-autoscaling-for-haproxy-6aa35b44ebf7)

Article on setting up AWS autoscaling with Haproxy as Load Balancer. Clap if you find it useful. Feedback is welcomed and appreciated.

https://redd.it/fk5h7s
@r_devops

Is inspec a good tool for testing file changes in Ubuntu systems

We are currently evaluating inspec to test our ubuntu systems. One of the our usecase is to test if contents of any of the configuration files have changed from the last time checked. In inspec I found the sha256sum which evaluates the checksum value of the file against what I manually calculate and store. But this seems to be a lot of effort to do as we have multiple environments with many config files ,to calculate the checksum of all files and store in one place is tideous.

Is there any other way in inspec that I can test this scenario ? Or should I look for another tool for this ?

https://redd.it/fk7j3v
@r_devops

Devops from scratch

Hi guys my organisation is moving to devops setup,I will be implementing this.i need help how can I acheive this .
I have worked in CICD and have decent knowledge about devops.

Git /Jenkins/sonarqube/junit these tools would be used .

how can I aquire configuration knowledge .

How to plan for this .

How can I practice or get help when I'm stuck.

How to make sure I don't break something in produc

https://redd.it/fk4bet
@r_devops

How to Answer "Containers" vs. "VM" Interview Question?

I've been asked this question several times during a job interview, and every time I'm left unsure on how to answer the question.

I've been also asked how does a VM work and also failed to give a proper answer.

How would you answer these questions?

https://redd.it/fk0jev
@r_devops

Terraform & Gitlab-CI



Hi,

We are trying to integrate terraform with gitlab-ci but are running into an issue when pipelines are run. The runner is using the shell executor Basically the pipeline will do a validate, plan and then apply once merged to master, however our plan always fails with:

`Error: No valid credential sources found for AWS Provider.Please see https://terraform.io/docs/providers/aws/index.html for more information onproviding credentials for the AWS Provideron main.tf line 1, in provider "aws":1: provider "aws" {`

`ERROR: Job failed: exit status`

The runner and gitlab are self hosted in AWS and there is a IAM instance profile attached to the EC2 instance which allows resources to be built so there is no need to have access keys. So there isn't a .aws/credentials file. When a plan is run from the cli using the gitlab-runner user it works no problem it only fails when its run as part of the pipeline, also aws commands work from the cli but not in the pipeline.

I have spun a runner up in my own AWS account using the same code, IAM instance role permissions etc and registered it against my own gitlab account and the pipelines run fine. Again there are no credentials stored on the server and its using the exact same gitlab-ci.yml file, there is no role\_arn in the provider block in the TF code. It just has the below:

`provider "aws" {`

`region = "eu-central-1"`

`}`

I have enabled debugging and can see the below

`Ignoring AWS metadata API endpoint at default location as it doesn't return any instance-id`

I can run a terraform plan from the CLI and it assumes the role fine.

`AWS EC2 instance detected via default metadata API endpoint, EC2RoleProvider added to the auth chain`

`plugin.terraform-provider-aws_v2.53.0_x4: 2020/03/17 08:01:15 [INFO] AWS Auth provider used: "EC2RoleProvider"`

`plugin.terraform-provider-aws_v2.53.0_x4: 2020/03/17 08:01:15 [INFO] Attempting to AssumeRole arn:aws:iam::00000000000:role/gitlab_runner_role (SessionName: "SESSION_NAME", ExternalId: "EXTERNAL_ID", Policy: "")`

Any help would be appreciated, i'm at a lose.

https://redd.it/fk24w7
@r_devops