GitLab-ci alternative on github

I am planing to move project I have on GitLab where I have CI configured with agent installed on one of my workers to GitHub. According to https://github.com/marketplace/category/continuous-integration there are number of integration with various with CI tools, could anyone give me a hint what is the easiest method to do so?

https://redd.it/dzmcz1
@r_devops

Custom Autoscaling in Kubernetes
https://www.reddit.com/r/kubernetes/comments/dzmswt/custom_autoscaling_in_kubernetes/

https://redd.it/dzohj7
@r_devops

Hashicorp Vault Policy Management

Hey all,

Quick background, my team is currently working on getting Vault up and running so that it can be used by the other teams where I work. There are going to be dozens of different teams and different applications that will be requiring access to Vault and each having its own use case.

Based off the research I have already done, ideally the policies would be tested through a jenkins pipeline before being applied to a cluster and there would need to be some form of approval process around these policies to insure that teams don't use things don't need. Using namespaces is going to be huge because of keeping everything separate from each other.

So, my question is, does anyone have any recommendations for best practices to follow when managing the inevitable mountain of policies that are going to be necessary for running this? Also, are there any lessons that you learned when you started using Vault? Or any thing else that you think would be useful.

Thank you.

https://redd.it/dzkggz
@r_devops

Container orchestration for single host production setups

I mostly deal with single host deployments, because high availability isn't a requirement, but I find the advantages that containers and orchestration tools provide pretty useful for developing and deploying applications. At the moment I'm using Docker Swarm mode to manage the handful of containers on each host, and this works fine. The main reason I'm using Swarm with a single host is the ability to run multiple replicas of my app containers so I can deploy updates with healthchecks and without downtime. I'm of course aware of Kubernetes, but find it far too complex and overkill for a single node setup. I'm still considering using k8s or k3s with Rancher, but since it's highly discouraged for production, I'm kind of wary.

Since Docker, the company, is going through all these changes and the future of Swarm is bleak, I was wondering if there are any other container orchestration solutions which have the following features:

* Simple configuration and setup like Docker Compose/Swarm
* Production-ready on single hosts
* Has some type of bridge networking to connect services easily
* Rolling updates without downtime
* Can rollback containers if needed
* Is actively developed and isn't about to be deprecated

https://redd.it/dzh94w
@r_devops

Support Guy - Zero programming

Hello everyone,

I'm trying very hard to learn programming as I'm getting insults in my workplace. My juniors are good in programming and they talk technically on programs and stuff .I'm stuck there . I work 10 to 12 hours on office mundane work , assign tasks , follow up and report to leader ship etc.. I'm not that great leader too . In the process of leading a team with 8 years support experience.

I feel very bad for my career decisions. I would like to somehow learn python programming alone to the expert level from zero .

After coming from office , I will have to attend calls from onsite folks and update the updates as well and my energy goes down .

Apart from programming, what is the best roadmap for hot skills in the market,

1.Cloud Aws
2.Cloud GCP
3.Devops
4.Docker
5.Kubernets .

Can someone please take a time to respond.. thanks all.

https://redd.it/dzgt2d
@r_devops

Untrusted CI: Using Nix to get automatic trusted caching of untrusted builds

Learn how Nix's new post-build hooks feature can automatically sign and upload artifacts to a binary cache in a trusted way.

[https://www.tweag.io/posts/2019-11-21-untrusted-ci.html](https://www.tweag.io/posts/2019-11-21-untrusted-ci.html)

https://redd.it/dzsg57
@r_devops

Blog post: Deploying your First Container with Docker for Windows

Hey guys, Devin Rich just wrote a shiny new blog post you may enjoy on the ATA blog. It's targeted to beginners to Docker that want to get started on Windows.

He worked hard on this one (and I edited it). I think it turned out great because it covers all of the absolute basics someone may need to get started learning Docker on Windows.

I'm curious, for all of you Docker pros, what are some of the most common gotchas you ran into when starting out with Docker? I'd love to make this post better.

https://adamtheautomator.com/docker-for-windows/?utm_source=redditdocker&utm_medium=social&utm_campaign=newblogpostnotifications

https://redd.it/dzr7b5
@r_devops

CI/CD solutions for Kubernetes

I have a Jenkins server that does what I need for various jobs and what not, it produces some docker images as one of the many types of jobs it does. I wanted to have Spinnaker be the CD portion of my CI/CD but I can not for the life of me get it to work at all. Mix between Kops, github for helm charts, and ECR being royal pains which have been a show stopper so far.

​

What other options are good for working with Kubernetes that are not Spinnaker and work well with Jenkins (on an EC2 instance)?

https://redd.it/dzs0p8
@r_devops

Example of a gitlab CI pipeline that deploys to AWS SAM?

Hi, I've started working on my first gitlab CI pipeline (coming from AWS Codepipeline) and am struggling a bit.

My pipeline needs to: Build a docker image and push it to a repository (ECR), compile typescript code and deploy it with AWS SAM, and build


To get started, I attempted to modify this code to work with my own repository; however, I realized after a little while that it does not actually work. The Gitlab user is named "gitlab-examples" so I mistakenly took it to be an official repo, but I don't think that it is.

Does anybody know of a public repo with an example of a working Gitlab CI + AWS Cloudformation/SAM deployment?

https://redd.it/dzvbtr
@r_devops

Git repository summary on your terminal

Here is a fun little tool, you might enjoy; It doesn't do much other than showing a bunch of infos about your Git Repo along side an Ascii logo of the dominant language. Written fully in Rust, onefetch implements the Kitty and Sixel protocol to render graphics (images) to the screen of the terminal emulator, more info [here](https://github.com/o2sh/onefetch/wiki/image-Backends)

Github: [https://github.com/o2sh/onefetch](https://github.com/o2sh/onefetch)

https://redd.it/dzr9pk
@r_devops

Which tool do you use for your ci/cd pipelines?

I'm trying to investigate what tools other teams are using, at the moment I'm guessing the majority use Jenkins.

https://redd.it/dzie1o
@r_devops

Making Grafana charts publicly accessible

How can one make Grafana charts publicly accessible? I just installed the Grafana helm chart and by default it's user/password authentication enabled.

Is there a way that I could allow people to just view the charts without authenticating?

https://redd.it/dzgs55
@r_devops

Preparing for growth

Hi everyone!

I've recently released my first app for iOS on the App Store. Right now we've only got a handful of users, but it sounds like we've hit a stroke of luck and are going to be featured in a widely watched tech review TV show. Assuming things go well, we're going to have a large influx of people checking out the app at that point, so I'd like to do some preemptive scaling of my servers. Since this is the first time I've ever had servers running in production I was hoping to get some advice about the best way to proceed.

Details: My backend is a go API and MongoDB database hosted on (separate) DigitalOcean droplets. Both the API and the database are running on droplets with 8gb of RAM and 160gb disks. The server isn't doing a whole lot of continuous work, just login/authentication, periodic data storage/retrieval of JSON files with less than 10 fields (and normal users probably wouldn't create and interact with more than a couple of these files), and interacting with the Stripe API to handle payment processing.

Here are some of the questions I'm thinking about:

1) Should I create more api droplets and use a load balancer to distribute work between them? (This one feels like a high priority)

2) Should I redeploy the api droplet with a beefier processor?

3) Should I increase the disk size of my mongo droplet?

4) Should I make more mongo instances to make the database distributed? (This one seems like it would come with a substantial increase in complexity)

We've got almost 10K of credits with DigitalOcean through a startup program, so (at least currently) the price of running more powerful machines isn't a big issue.

Any and all advice or feedback would be greatly appreciated. Cheers!

https://redd.it/dzdqqk
@r_devops

how to intentionally configure a web server to return 500



I am seeking for guidance. My goal is to intentionally create a 500 to test if the website can properly show our customized page.

I have a web site hosted on website (docker on ec2 with nginx) behand a load balancer. I am aware that I can configure LB to return a fixed response code based on path.

Nginx I wonder what is the best practice to test such test case? I am thinking I can purposely miss configure the nginx to make a 500 page, or do something like this [https://www.digitalocean.com/community/tutorials/how-to-configure-nginx-to-use-custom-error-pages-on-ubuntu-14-04](https://www.digitalocean.com/community/tutorials/how-to-configure-nginx-to-use-custom-error-pages-on-ubuntu-14-04)

Express server: I am wondering how to test to see if our express server catches 500 and displays a custom error page?

Please advise.

Thanks

Jay

https://redd.it/dzeeo3
@r_devops

Looking to do an interesting demo

Hey guys,

Applying for a job and need to prepare a demo of something Devops related. I don’t have a lot of background in the field, looking for something SaaS based to do. Anyone an idea? Have this weekend to prepare.

Thanks

https://redd.it/dyy1hg
@r_devops

Best practices for managing Zookeeper configurations across environments?

We use Zookeeper to store our application configuration and passwords for apps that require database access. Today, these configurations are not in source control and as such, we don't have great visibility into current state across environments.

Assuming the plan is to continue using Zookeeper, what tools and/or methods have you used for managing additions/changes to application configurations?

Ideally, we're looking for a secure, version controlled (we use Git/Bitbucket) solution.

https://redd.it/e06lpc
@r_devops

Those looking for a roadmap to devops career

https://roadmap.sh/devops

Found this and it's probably one of the best explanations of what to learn.

https://redd.it/e031ex
@r_devops

Building ARM images with Packer

An easier way to build your ARM images (multiple modes, platforms supported).

Article: https://mkaczanowski.com/arm-images-with-packer
Github: https://github.com/mkaczanowski/packer-builder-arm

https://redd.it/e073e7
@r_devops

How did you set up Prometheus?

We have several Ubuntu servers that I am looking to set up Prometheus monitoring on. Would love to see what methods, guides, or githubs you guys followed in order to set it up.

Are you exporting metrics to a main server for dashboards? What metrics? Any tips?

https://redd.it/e02jl2
@r_devops

When _ shouldn't _ we use infrastructure automation (eg. leave a database out of cloudformation to prevent accidental deletion)

I'm most familiar with AWS' cloudformation and assume that other infrastructure automation tools are similar. It feels very uncomfortable to put a database or cognito userpool or s3 bucket in a cloudformation template that will also be used for code.


I know that some resources (eg. Aurora, S3) have flags to prevent accidental deletion -- however, I still feel uncomfortable putting them into cloudformation stacks because it then inhibits us from quickly deleting those stacks!


The alternative that I have come up with is a "state-stack" (bad name maybe) that contains resources that are stateful and hold data. Then, we export arns and values from that stack and grab it in other stacks. However, there can be a chicken or the egg problem with this approach... for instance, our networking stack should be able to be torn down, but a database like Aurora depends on those subnets.


Just curious for general thoughts on this topic although I'm sure each application is different.

https://redd.it/e0d3v2
@r_devops