Does this sound like devops?

I received an invitation to sit for an interview for a Devops Trainee position but the job description sounds so vague and different from what I googled about devops. I'm from a non-tech background and it was a role I randomly applied for without much consideration because I didn't actually think I would get an interview. Now I'm wondering if it's a clickbait job title to draw in inexperienced applicants and if the interview would be worth my time. My goal is to eventually to transition into tech but I'm not sure if this is the right way forward. Would some appreciate some advice.

​

Work with tech team to develop a deep understanding of the business cases for change, then drive the approval of projects through site and IT governance processes
Manage site IT Risk, Change, & Compliance tasks for daily operations and during project deployment
Maximizes business value via technical knowledge of strategic IT Applications
Key role in promoting good information practice, utilising technology and improving business processes.

https://redd.it/lmdeci
@r_devops

Image Pull Error K3s

Hey guys,

I am trying to debug the below issue while deploying MariaDB 10.1.14 version on the cluster.

pulling image: rpc error: code = NotFound desc = failed to pull and unpack image "docker.io/library/mariadb:10.1.14": failed to unpack image on snapshotter native: failed to extract layer sha256:42755cf4ee95900a105b4e33452e787026ecdefffcc1992f961aa286dc3f7f95: failed to get reader from content store: content digest sha256:5c90d4a2d1a8dfffd05ff2dd659923f0ca2d843b5e45d030e17abbcd06a11b5b: not found

We are using the native snapshotter because of the environment feasibility.

Any leads on debugging are highly appreciated.

Thanks

https://redd.it/lmgjvb
@r_devops

The Reports of Devops's death are greatly exaggerated

Hey everyone. I wrote a post about the transformation of devops:

https://adnaan.badr.in/blog/2021/01/25/the-reports-of-devopss-death-are-greatly-exaggerated/

This covers my experience and doesn't comment on every aspect of devops out there. Would love to hear some thoughts.

https://redd.it/lmhtim
@r_devops

Any one with good spark kafka experience

Spark kafka automation managing tons of different users with high eps any thoughts tips

https://redd.it/lmcsg7
@r_devops

Blog A CLI tool that can easily manage more than 281 runtimes, making it easy to keep things updated and/or switching between versions. And it’s open-source :)

I just wrote this post. I'm showing an OSS tool that can easily keep things updated on *NIX/Windows and/or easily switch between versions. It's very useful on CI/CD pipelines.

Feedbacks/suggestions/* are always welcome :)

See on Medium: https://medium.com/bash-tips-and-tricks/an-easy-way-to-switch-between-runtime-versions-nodejs-terraform-and-279-53fdfbcb4049?sk=43548418bf394d80e277a39a76070843

See on my Website: https://www.lozanomatheus.com/post/an-easy-way-to-switch-between-runtime-versions-nodejs-terraform-and-279

https://redd.it/lm57x5
@r_devops

WireGuard for fleets?

I've been wanting to see if WireGuard might work for our fleet, but I honestly can't see how it can work at a large scale if you need to generate a keypair for every host and drop the public key into the server's config.

I guess a single key could be reused across hosts but that seems insecure.

We currently use OpenVPN with TLS auth, so all we need is a signed cert on the client's side to authenticate which works quite nicely. But WireGuard supports no such thing.

I've also seen paid solutions like Tailscale but I would have a hard time convincing the company to fork out enough money given our fleet size. Also checked out ZeroTier, but despite being open source, their licensing means you have to pay for their network controller. Not affordable for our fleet size.

https://redd.it/lm15u2
@r_devops

Nextjs10 & Serverless Framework

Working on a boiler plate project for serverless framework & NextJs10.

This seems to be the latest plugin: https://github.com/serverless-nextjs/serverless-next.js

I don't seem to be getting anywhere following this simple guide.

Does anyone have any advice or material I could use to get off the ground with this please?

https://redd.it/lml2rp
@r_devops

NodePort issues

Hi there,

I am performing some testing on MySQL pod using sysbench running on a remote server.

I tried to mount the NodePort service to the host but it doesn't work, see below the criteria and results.

k get pods -o wide

NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES

mysql-7d9bcb665c-cdkfx 1/1 Running 0 3h36m 10.42.0.36 k3s-node2 <none> <none>

[root@testsytem\]# k get svc

NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE

mysql NodePort 10.43.84.78<none> 3306:30016/TCP 22m

From the host, if I curl to the pod cluster IP with the port, it works fine but the Nodeport

curl -Iv 10.42.0.36:3306

* Trying 10.42.0.36:3306...

* TCP_NODELAY set

* Connected to 10.42.0.36 (10.42.0.36) port 3306 (#0)

\> HEAD / HTTP/1.1

\> Host: 10.42.0.36:3306

\> User-Agent: curl/7.65.3

\> Accept: */*

\>

Results for nodePort

curl -Iv localhost:30016

* Trying 127.0.0.1:30016...

* TCP_NODELAY set

* connect to 127.0.0.1 port 30016 failed: Connection refused

* Failed to connect to localhost port 30016: Connection refused

* Closing connection 0

curl: (7) Failed to connect to localhost port 30016: Connection refused

I see on the ports on the host, nothing listens on 30016?

How can I debug this issue?

Thanks

https://redd.it/lm4c4n
@r_devops

Hashicorp packer on macbook M1?

I recently decided to invest on a laptop and dedicate it on development and devops stuff..


I thought it would be a good idea to get the new Macbook M1 pro.. It could be a mistake..


I tried installing Packer through brew and it does not find a bottle.. at first I was hoping it was an issue related to Big Sur but then I realised it works just fine in all of my other macbooks that have an Intel cpu.


Has anyone had the same issue and managed to solve it ?


Thanks!

https://redd.it/lm3a5z
@r_devops

Tool to deploy static sites from Github repo into AWS account

Hey friends of /r/DevOps. I wanted to share a free tool that we built that connects up your Github repo and your AWS account and deploys static sites.

This came from something my team and I personally experienced - infrastructure is annoying to deal. You need to spend a lot of time and effort to set up the workflow and processes required to build, deploy, and monitor your infrastructure. At the end of the day, as a developer first, you just want to write code and not worry about the underlying infrastructure.

I think tools like Netlify and Heroku are great but at the end of the day, you never have the truly visibility and ownership. With what we built, you have full ownership of the infrastructure and if you decide to leave us, your stuff will still stay running.

This is our super early beta MVP. We're really looking for feedback and opinions.

Oh and here is a quick demo video in case you don't want to go through the hassle.

Thanks and looking forward to some comments!

https://redd.it/lmolv9
@r_devops

Curated GitHub repository on how organisations around the world use AWS

Curated GitHub repository on how organisations around the world use AWS

I’m curating engineering blog posts, videos and other cool resources on AWS

https://github.com/upgundecha/howtheyaws

https://redd.it/lmpu7g
@r_devops

Why not use Kube API and GitOps to manage infrastructure?

Kube API and GitOps are some of the major advances in the industry we got recently.
Yet, most Infrastructure as Code (IaC) types of tools do not embrace them, at least not fully.
Except, as far as I am aware of, Crossplane, combined with GitOps-type of tools like Argo CD and Flux.
Here's a quick overview.
\>>> https://youtu.be/n8KjVmuHm7A
What do you think? Can Crossplane be a blueprint for the next-gen IaC tools?

https://redd.it/lmqtua
@r_devops

Cutting Build Time in Half with Docker's Buildx Kubernetes Driver

Hey friends, I wanted to share with you all how we've recently undertook a project to revisit our build infrastructure. Long story short, we were able to cut our build times in half by migrating to Docker's Buildx Kubernetes driver. Here's a link to a blog article my peer wrote that fully details what we tried and what we found to be successful.

For the next few hours, we're hanging out in zoom to demo some of this or field any questions. (Check the bottom right of the page.) If you're free, stop by to hang out and talk Kubernetes, Docker, devops or whatever with us!

https://redd.it/lmt9rr
@r_devops

Cluster Infrastructure with Docker Swarm, Docker Compose, and Traefik

Hey, I thought I would share 2 articles I wrote about Docker Swarm, Docker Compose, and Traefik recently:

Container orchestration with Docker Swarm: https://juliensalinas.com/en/container-orchestration-docker-swarm-nlpcloud/

Routing requests to the right service with Traefik: https://juliensalinas.com/en/traefik-reverse-proxy-docker-compose-docker-swarm-nlpcloud/

I'm basically talking about how we're doing things behind the hood at NLP Cloud, where each spaCy NLP model is running inside its own container.

I hope some of you will find these posts useful.

https://redd.it/lmo6h0
@r_devops

Architecting with Google Kubernetes Engine

Colleagues, the Architecting with Google Kubernetes Engine specialization will teach you how to implement GKE solutions including building, scheduling, load balancing, and monitoring workloads, as well as providing for discovery of services, managing role-based access control and security, and providing persistent storage to these applications. It incorporates hands-on labs using our Qwiklabs platform.Gain high-demand skill in Google Compute Engine, Google App Engine (GAE), Google Cloud Platform and Cloud Computing.Training modules includes: 1) Google Cloud Platform Fundamentals: Core Infrastructure: Learn the computing and storage services available in Google Cloud Platform, including Google App Engine, Google Compute Engine, Google Kubernetes Engine, Google Cloud Storage, Google Cloud SQL, and BigQuery, 2) Architecting with Google Kubernetes Engine: Foundations: Review of the layout and principles of Google Cloud Platform, followed by an introduction to creating and managing software containers and an introduction to the architecture of Kubernetes, 3) Architecting with Google Kubernetes Engine: Workloads: learn to perform Kubernetes operations; creating and managing deployments; the tools of GKE networking; and how to give your Kubernetes workloads persistent storage, and 4) Architecting with Google Kubernetes Engine: Production: Learn about Kubernetes and Google Kubernetes Engine (GKE) security; logging and monitoring; and using GCP managed storage and database services from within GKE.

Enroll today (individuals & teams): https://tinyurl.com/y82vmyun

Much career success, Lawrence E. Wilson - Online Learning Central (https://tinyurl.com/gh8n9uq7)

https://redd.it/lmvbxv
@r_devops

Accessing large amount of files via distributed file system and kubernetes cluster

Hi,

I recently stumbled across this awesome subreddit and wanted to ask for some advice.

The main question for me is: Which distributed file systems would be suited to store large amount of small files in a kubernetes cluster? I saw that you can dump for example wikipedia articles and have around 2TB of data and around 5mio files Id like to get access to via a distributed filesystem and maybe do a small web-app in which I can search over all the files or upload new files.

I try to understand the topic of big data and dfs a bit more and am not a professional working in devops rn, I study cs and just got interested in that topic. I started to read more papers about infrastructures like hdfs on hadoop for example and that larger amount of files can cause performance issues since each file will be stored in individual blocks ranging from 128MB to 256MB in size and since namenode’s memory is limited it could be a problem, if I understood that right.

I found distributed filesystems like hdfs, ceph, lustre or filetypes like hdf5 but have to check these more out to write about that tbh.

Id love to hear of your experience with maybe a similar topic and like to learn from your guys experience.

have a great day

https://redd.it/lmsnhj
@r_devops

Service desk to dev ops

Hello guys I'm currently working in service desk as the title says but I want to get into devops and the cloud. I recently started studying for az-900 but just found it it's basically for sales people. I'd say I do understand the core fundements but I'd say I don't think I should take it because of money issues and I'd rather pay for a more helpful cert. Just wanted to know what kind of certs I can get and which types of roles I can move to step by step before I get to a devops role. I also only have a work laptop where I can't download nothing on or run vms or practice Linux so I feel like that might be something holding me back. Could someone shed some light plss

https://redd.it/lmxt2h
@r_devops

Jenkins - trying MSBuild plugin to build .net project in a linux system throws fatal error.

Hello everyone. I was hoping you guys could help.

I have Jenkins (version 2.263.4-1.1) installed on a CentOs 7 box. I need to build a project that is coded in visual studio (C#) and am trying to achieve this by using the MSBuild plugin. Every time I try to build I get the following error.

1. FATAL: Unable to use this plugin on this kind of operation system

I've pointed jenkins to the msbuild location `/var/lib/jenkins/plugins/msbuild/META-INF/maven/org.jenkins-ci.plugins/msbuild`

If I don't point jenkins to the msbuild location I get a "missing msBuild.exe" error.

I followed a few other tutorials and installed dotnet and nuget along with some SDK packages per the tutorial recommendations. but still, my project fails to build.

Is it because Jenkins is in a linux environement? I've been struggling with this for a month now. any help is greatly appreciated.

https://redd.it/lmx4ud
@r_devops

Using AWS CLI with Google apps Saml login

Hey guys.
In my organization users are logging in via Gsuite with Saml.

Therefore they don't have access key and so on.


How can they Access aws CLI easily?


Please assist.

https://redd.it/lmsixp
@r_devops

Integrating github Actions with gopaddle for a seamless CI/CD on Kubernetes

Continuous Integration (CI) and Rolling Update to a kubernetes service can be achieved seamlessly when using gopaddle Deck and Propeller together. However, in some scenarios, you may choose to use a different tool/platform in place of Deck to build the docker images and use Propeller deploying and managing the applications. For example, you may choose to use github Actions and then integrate with Propeller for rolling updates. Read more to know how to use github actions with gopaddle for a seamless CI/CD on kubernetes. #kubernetes #docker #github #devops #cloud #azure #microservices https://blog.gopaddle.io/2021/02/18/integrating-github-actions-with-gopaddle-for-a-seamless-ci-cd-on-kubernetes/

https://redd.it/lmsa7t
@r_devops