Reddit DevOps
274 subscribers
68 photos
32.1K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
How to setup NuGet caching in Azure DevOps

Azure Pipeline NuGet caching can save your builds from painfully downloading the same packages over and over on each new run. I ran into some problems while setting this up, and there wasn't much of a tutorial out there going through the entire process. It saves a bunch of time on our build runs and I thought I'd share:

[https://blog.soenneker.com/how-to-setup-nuget-caching-in-azure-devops-8d94c57b5321](https://blog.soenneker.com/how-to-setup-nuget-caching-in-azure-devops-8d94c57b5321)

https://redd.it/emss5m
@r_devops
What are the best emails or emails you are more likely to respond to regarding new solutions.

So I’m very new to the industry and I get emails everyday and it’s hard to keep track, especially when they are ones that don’t require immediate attention. Also, many of the times they are things I’m not interested in or that just waste my time.

I wanted to see what everyone’s viewpoint was in emails that you get and which ones I should keep my eye out for.

Just looking for a good discourse to have.

https://redd.it/emud7z
@r_devops
Is datadog worth the cost?

How does datadog compare to prometheus operator when talking about Kubernetes clusters? I know Data dog costs a hell of a lot more them prometheus however it's dead simple to setup where prometheus is a royal pain to do. I've tried both and I like datadog just not sure about the cost of it.

​

Is there any major advantages to datadog that would not be present in prometheus? Trying to figure out if I should shell out for datadog or not

https://redd.it/emr6pi
@r_devops
Best installation script practices

Hey everyone, I’m writing an installation script for our infrastructure. Everything is Docker based and we have a Makefile that will deploy the infrastructure. However there is some setup required before the Makefile can run on a new system (docker must be installed along with some other system configs). I wrote a bash script to handle all that and it works great, but I started musing about what best practices are for system installation. What’s the best language to create an installer that can install to different OS (Windows, Ubuntu, RHEL, etc). I’m thinking about a Python script that detects the system configuration and then generates a bash or powershell script with the appropriate commands. Are there better languages for this? Are there installer frameworks out there that I don’t know about? I enjoy crowd sourcing opinions so I’d love to hear from you all.

https://redd.it/emu9v8
@r_devops
What could I build to make your life easier?

I'd like to start a for-fun, side project. Not sure what to build though. Anything I could build to help you (e.g. open source, CLI tools, IAC, scripts, etc.)?

Most my background is in Node, Terraform, AWS, and Digital Ocean.

https://redd.it/en2mfk
@r_devops
Where does Serverless Fit in nowadays with everyone running K8s

So it seems to me to be Kubernetes everywhere or at least a lot of companies and environments. I know there are plenty of traditional set ups with simple VMs. What about Serverless Technologies? What is the general feeling towards this technology right now? I feel like it’s taken a back seat.

Personally I want to focus in that direction a bit - honestly it just seems a little bit more interesting to me. I don’t know a ton about it. I know more of the AWS side about different ways to set it up but just curious about everyone’s thoughts.

Thought I do remember hearing some of you guys went through some serious pain with it.

https://redd.it/en1oa9
@r_devops
Looking for design questions and scenarios?

Some clown posted a question on a Facebook group I'm in, he was given a sort of pre-interview question and was asking for someone to do it for him.

The exercise actually looked really interesting and I would enjoy a book or video series that went through questions of a similar nature explained possible solutions, pros, cons, traps ect. Does such a thing exist?

​

Below is the question just for reference.

​

​

Design Question

We have an e-shop application that contains multiple microservices. Each service provides a
few APIs. Some are public APIs while the others are for internal use only. The application uses a
database for data storage.
Service list:
• user-service
o POST /api/v1/login (public)
o POST /api/v1/logout (public)
o POST /api/v1/signup (public)
• product-service
o GET /api/v1/products (public)
• payment-service
o POST /api/v1/pay (public)
o POST /api/v1/cancel (internal)
• db-service
o GET, POST, DELETE /api/v1/user (internal)
o GET, POST, DELETE /api/v1/creditcard (internal)
o GET, POST, DELETE /api/v1/product (internal)

We want to deploy this e-shop application into our Production environment now so we can sell
our products online. It has such requirements:
1. People can access this e-shop application via www.happyshopping.com
2. It should be fast
3. It should be secure
4. It should have high availability
5. It should be able to scale based on workloads
6. It must run within Kubernetes cluster
As a solution architect, you need to propose a deployment architecture for this Production environment:

1. Please describe the architecture with diagrams and some explanations. Feel free to use other services that you think will be helpful.
2. Please provide the Kubernetes manifest files at your best effort so we can see clearly what it

https://redd.it/emzw0h
@r_devops
Pathway for learning

I am interested in devops but have little knowledge about python akd network. Where do I start from?

https://redd.it/emzi9a
@r_devops
ISPConfig with remote dockerized webservers

I use IspConfig for managing some webservers and its great, I have some servers that are running PHP/Nginx in a docker compose environment but I would like to be able to remotely control and configure them using something like ISPConfig, anyone know of anything out there that is capable of this ?

https://redd.it/emr4xv
@r_devops
Starting new Job as a consultant - any advices?

Hello
Ill start a new job as a consultant for DevOps related projects.

I thought about running a private git server and wiki for documenting all the things I did and the lessons learned.

Apart from that, are there things I can prepare or keep in mind that help me performing better?

Kind regards

https://redd.it/emo99k
@r_devops
Gitlab AutoDevops: TLS handshake error

Hi guys,

Following this guide https://rancher.com/blog/2019/connecting-gitlab-autodevops-authorized-cluster-endpoints/ ; we integrated k8s cluster into GitLab, installed Helm & Gitlab Runner and they are running fine in a cluster. Created a project with Dockerfile in a root folder of the project. Enabled AutoDevops and ran pipeline. Build is failed https://prnt.sc/qlrwop with TLS handshake error, which seems like it cannot talk to the Internet and pull the dotnet image from DockerHub. Any suggestions/help on that?

Thank you

https://redd.it/empwgu
@r_devops
Teamcity Nodejs Test tab not showing

Hello,

I am using this Nodejs plugin [https://teamcity.jetbrains.com/viewLog.html?buildId=2539985&buildTypeId=bt434&tab=artifacts](https://teamcity.jetbrains.com/viewLog.html?buildId=2539985&buildTypeId=bt434&tab=artifacts)

I need to run test cases and generate code-coverage on Teamcity dashboard.  Does it require any additional step to be performed to get "Test" and "Code coverage" tabs to see the test results? #teamcity #continuous-integration

https://redd.it/emprdz
@r_devops
Any hosted SSH key managers that your trust?

I'm trying to get a grasp on all the ssh keys that are floating around but I don't want to add another internal service (like Vault) to maintain. Is there any hosted ssh key managers that you use? If not what would be holding you back from using them?

https://redd.it/emoi25
@r_devops
How common is it to get a signing bonus as a DevOps Engineer? If you get a job in the SF Bay area, do they help with relocation as well? If not, is it okay to ask if they do?

Im from Jersey and looking to move to SF Bay Area and want to explore my options before beginning the job application process.

https://redd.it/enau12
@r_devops
How to effectively monitor and respond to events in Openshift?

Hi

I got challenge to project dashboards or another solution where support the support team will see when there is a problem with application and where will be some place where in where in case of failure immediately they can see point of failure and incident response path. In small company with traditional java apps we can use nagios and check status of servers and load, ram, cpu and is java process. But now it will be something different that will be around 60 namespaces with around 30 microservices in one namespace. So I think that integration with nagios isn't good because this is changing enviroment and there will be many false postives.

We thought about Grafana. One main dashboard with all namespaces and there will be some value that will determine whether the namespace is working properly and then when we click on this tile with the name of namespace then we will see all tiles with microservices in this namespace and then when we again click on tile with name of microserivice some information what happens with each microservice (ram, cpu, requirements etc.). But that make problem that we will have a lot of dashboards in Grafana, a lot of clicking, a lot of queries to influxdb and prometheus and I'm not sure that isn't it too aggravating. For example 60 namespaces with 30 microservices it is 1800+dashboards in Grafana only for applications in private cloud. So maybe its always go into openshift and see whats going on. I don't know. I don't have too much expirience with this system. Maybe someone know how big companies monitor microservices and how they respond to failures? They have kibana with elasticsearch too.

https://redd.it/en8m29
@r_devops
I've tried everything, but I still can't prevent servers from kicking me out of SSH session

I have tried to login via OpenSSH (windows 10 peasant). Got inside my ec2. Then kicked out after 2-4 minutes. I've edited various KeepAlive settings into every ssh\_config file I could find on my machine. Didn't work.

I tried using mobaXterm. Kicked out. I edited the SSH to "keep alive" on the settings. Still kicked out. I scrounged the web for mobaXterm timeouts even after enabling the keepalive and what i've found is to connect via SCP. Didn't work.

I am really at the end of my wits here guys. Neither hard configuration on the native OpenSSH client, or GUI configs through clients like mobaXterm work. I know I can config the keepalive in the server, but A) too much of a linux newb to pull it off in the 2 minute time window the SSH gives me B) it's bad practice anyways.

What should I do?

P.S: I am being kicked out from ec2 AWS and DO droplets if that matters. I don't use passwords - only private keys.

https://redd.it/en995k
@r_devops
What is AWS CodeStar in AWS DevOps?

As per my understanding, it is a cloud-based totally service for growing, handling, and operating with software improvement initiatives on **AWS**. You may speedy increase, construct, and deploy applications on **AWS** with an **AWS** CodeStar undertaking. An **AWS** CodeStar assignment creates and integrates **AWS** services for your undertaking development toolchain.

**Please share your understanding in the comments below?**

https://redd.it/en45h3
@r_devops
What better DevOps tooling would you like to have?

Hi, I am one of the founders of Commandeer. We are currently building out our IAC tooling. It let's you run command line services like Ansible, Serverless, Docker and Terraform from a desktop app. On the left hand-side is your playbook.yml, serverless.yml etc, and on the right is the conole output. I'd love to get some input as to what tooling you would love to see built in as we are tackling this right now. We are planning on integrating [Circle.ci](https://Circle.ci), Azure Pipelines, and Jenkins as well. The tools let's you deploy to AWS or to LocalStack. [Ansible Runner](https://imgur.com/gallery/wFjw9ow) [Serverless Runner - GIF](https://imgur.com/gallery/XkknoJL) [LocalStack Dashboard](https://imgur.com/gallery/Z8wxxe2) Thanks in advance!

https://redd.it/ene603
@r_devops
Need Advice: Buildtime vs Runtime Debate

I need advice on buildtime vs runtime config management. We are configuring our Bamboo Agents as code with Packer and Ansible to build an AMI image. I have a developer who has written several bash scripts which essentially look at aws tag metadata and update bamboo config (such as what bamboo server it points to, pulling for changes to a bash script repo and pulling latest versions). So he puts some of these scripts on the image at build time which allows for runtime updates/changes. However there is some conflicting ansible code that installs the agent that needs a build time variable defined to point to a certain bamboo server. If we continue down that path it would lead to 1 AMI per enhancement. So my question is, what's best practice here? 1 AMI for any environment. This doesnt allow us to do local test/development of our ansible code. Or AMI per environment? That would require building several more bash scripts and smart logic there. I personally lean to 1 AMI per environment because I want an immutable image and not have tons of bash scripts but I also see the argument for 1 AMI.

https://redd.it/enfw2o
@r_devops
Looking for a new CI/CD platform with UI similar to Concourse.

I have been using the tool [concourse](https://concourse-ci.org/) for a few years and I am now exploring new job opportunities to start fresh with a brand new CI/CD platform. One thing I really love about concourse is its UI ([here's an example from their website)](https://concourse-ci.org/examples.html).

* It's very visual and easy to dive into individual resources, jobs, tasks, tabs, etc.
* It shows what resrouces and jobs connect to other resources and jobs.
* The url's are all human-readable and can very easily be inserted into scripts without having to lookup complex UUIDs.

I've been trying out some other SAAS CI/CD tools like Gitlab and CircleCI, but their dashboards are not quite what I'm used to (at least from what I have found so far). What are some CI/CD tools in widespread use today that have a visual map showing pipelines?

Edit: I'm also looking for one that makes it easy to create multiple pipelines from the same repository.

https://redd.it/eneu3u
@r_devops
How long it usually takes to build a CI/CD

Hi,
I am wondering on average how long it usually take you to build an automated infrastructure and CI/CD For your application regardless of the technologies / tools used (AWS, Terraform, Ansible, Packer, Kubernetes, Jenkins, Cloud Based CI)... Etc

https://redd.it/endipd
@r_devops