Best courses to learn Kubernetes, Dockers and Containers from scratch

Hello

I am looking for some suggestions from experts here to help me with the courses to learn the important concepts of DevOps.
I have Linux Academy membership and can also buy courses from Udemy.

Please let me know where to start with.

Thank you

https://redd.it/lvdqij
@r_devops

Infrastructure State Visualisation For Terraform

Hi everybody!

This one is for the Terraformers among you. I’ve always felt the plan/apply output is pretty messy and could be improved upon, so I decided to do something about it. I’m currently working on a little project called Pluralith. We’re essentially talking about an application that visualises your Terraform state and integrates directly with the Terraform CLI.

The application is currently in an early state with a private alpha starting soon. I demoed the application at HashiTalks 2021 some time ago and the reception was overwhelmingly positive. I already posted in r/Terraform a while ago, but since Terraform is a pretty popular devops tool these days I thought I’d share the project in here and collect some more feedback from people all over the devops landscape. The project could take many directions in the future so if you’re not a Terraform user, but have any ideas or questions that involve any other tools in your workflow I’d also very much like to hear about that :)

If you want to get a better feel for the project check out the website **HERE**. If you are interested in being an early tester or simply want to know when the thing is available for download for your OS leave me your email and I’ll make sure to notify you when you can get your hands on it.

I’ve also created a little subreddit for user feedback, discussions, feature requests etc. We are already over 90 people strong so head over there and join r/Pluralith if you are interested in the project!

I’ve also created a little Linkedin page here so if you’re a Linkedin type of person you can find Pluralith **HERE**

As said feedback, questions, comments etc. are very welcome!

Cheers,

Dan

https://redd.it/lvd0bi
@r_devops

MailServer on EC2 Or Kubernetes

Hello,

we're using some external mailserver which have many issues.

so we want to host our own mailserver internally.

We need a mailserver that Have API to create (inbox according to input name), Get Inbox by email name, Api to get email/delete emails by filters (subject)

​

​

Please recommend on good ones that easy to setup on EC2 instance or on K8S (Existing cluster)

But full guide please.

​

Thanks!

https://redd.it/lvbjw9
@r_devops

CVE-2020-28243 SaltStack Minion Local Privilege Escalation stealthcopter stealthcopter Read more posts by this author.

Command injection vulnerability in SaltStack's Salt that allows privilege escalation via specially crafted process names on a minion when the master calls restartcheck.

Affected Versions: All versions between 2016.3.0rc2 and 3002.5
CVSS Score: 7.0 High
https://sec.stealthcopter.com/cve-2020-28243/

https://redd.it/lv4a8h
@r_devops

Last minute UAT issue putting release at risk

Hi all,

New to DevOps and just starting to learn so apologies if this is dumb question...

Recently on a Friday before a weekend release our UAT team found a potential defect. Basically significant delays in messages being received between two components. I was surprised this came up so late.

Performance testing in the NFT environment, which I was told closest to Prod, could not replicate the issue nor in other environments INT etc. It seemed to me an issue with the UAT environment it self, but this Monday I was told the issue had been found, fixed and a new build promoted to UAT.

It just confused me, because it seemed UAT and NFT are not working on the same builds or perhaps not using all components.

We have a "DevOps" team who tame care of deployment and maintain the environments, but the UAT seems a pretty manual affair hence thought I would as here.

Thanks for any thoughts!

https://redd.it/lva9nq
@r_devops

Startup founders looking to create an MVP

Hi,

I thought there might be an interest in learning more about my startup,MVP Nowwhich helps non-tech domain experts build web and mobile apps without developers in just one hour.

Our team is on a mission to help businesses build software at the speed of their thoughts. I am a Lean startup practitioner and technology advisor at several tech cohorts in Atlanta , GA.
MVP Now Studio is an additional service we provide along with our MVP Now no-code tool to help small business and startups with:-Lean startup advisory (We guide startups on best practices and personalized business consulting)-Lead generation (Out-sourced lead generation, part of customer discovery and sales development)-Website and Application Design and wire framing-Development and technical consultingEarly adoptersThe stage of our development currently is BETA testing our products with early adopters. In this case, we have already created a solution for a non-tech domain expert in the environmental science industry to help find qualified volunteers for environmental projects Nova Conservationhttps://www.novaconservation.com/ We helped Nova Conservation to build a web and mobile app MVP in 1 hour without a single line of code. At this stage, our no-code tool is ready to build common applications such as CRM, HR, and other solutions available for external use with different types of users.Our next steps are to add additional features to help create more targeted solutions like social media, e-commerce, finance and other workflows to cover all possible cases for startup ideas. With this goal in mind, we are looking for non-tech founders and startups who can become our early adopters. We greatly appreciate any pre-accelerator members you can refer to us who might be interested in our services. We look forward to hearing more from non-technical startup founders about proposed solutions for their customers. We are happy to offer free feedback and explain how we might be able to create an MVP for your company today. Look forward to learning more from you !

https://redd.it/lv9uq7
@r_devops

Embedded microservices

Hey folks! I share with you one of my project: a fully modular bike alarm. It's FULLY modular because I'm using containerization to build "embedded microservices" ➜ https://www.luos.io/blog/a-new-way-to-design-embedded-app-using-luos-step-1

https://redd.it/lv8jsf
@r_devops

Am I basically doing DevOps?

Hi,

I've been a software developer for two years. I originally started at my new company in September of last year, and it's been crazy, with sometimes pulling in 45-50 hours a week. The company specializes in document validation. Almost all of our software is in PHP, some of our older work being in Zend and CodeIgniter, and the newer stuff in Laravel and some Python. We are not a startup, but due to circumstances that caused the company to become very small at one point, I started off with a small team where there were only 2 other developers and the CEO, and now we have added 3 more people and want to add more.

I am always looking to grow, and I see my boss relying on me more and more. He often messages me early in the morning, at night, and on the weekends to make sure we are ready for this demo or something something is up with the database. I find myself doing less code, but I do a lot of the planning for our software, like the pipelines, the message queues, redis, which database to use, writing config scripts and merging and fixing issues, as well as setting up Sentry, CPanel and AWS resources. I would like to dockerize things but that is difficult to do with our current infrastructure. I will often write the Laravel jobs and the routes for functions, but the core programming algorithms in Python, (the functions themselves), which involve searching and sorting through data structures and solving specific tasks, I leave to a teammate who relies on the pipeline to do his work. I also support a frontend guy with his queries to the database and help him solve problems in the debugger. I also write documentation for the databases and how to operate the software. So I do a bit of delegation, and I have quite a high level of responsibility for the role I technically am (formally just software designer, but basically junior developer).

I was wondering if this basically constitutes devops - I know that devops is a broad subject, but I would like to grow in my career and know which direction I am heading so that I can focus on the professional development needed to grow. I am interested in software configuration, though I find it extremely challenging.

The biggest fear I have always is breaking something, or having a security breach take place under my watch. But I find that I am often having to do investigative work, whether it's related to our application's permissions or work that was left behind by a previous developer and trying to figure out what they were trying to do.

If I am in fact doing DevOps work, and my boss is relying on me to essentially be his right-hand guy, I would like to ask for my title to change to DevOps developer (just the title for now, I don't think I've been at the company long enough for a raise), just because I feel the responsibility I'm taking on is getting very large. But if it is not DevOps, I don't want to overstate my qualifications. Part of me wanting to make clear my title is because if my role is more clearly defined, I am able to confidently delegate and do certain procedures that I know I can be sanctioned to do.

https://redd.it/lv8gnq
@r_devops

Getting an "SSH authentication failed" error when creating EC2 instances using Terraform

I am trying to run an Ansible to create an EC2 instance using [this example](https://github.com/startup-systems/terraform-ansible-example).

It is creating the EC2 instance along with the security groups and VPC, however, at some point, I am getting the following error:

>Error: timeout - last error: SSH authentication failed ([email protected]:22): ssh: handshake failed: ssh: unable to authenticate, attempted methods \[none publickey\], no supported methods remain

This is how the log looks like:

aws_instance.web (remote-exec): Connecting to remote host via SSH...
aws_instance.web (remote-exec): Host: 18.212.56.230
aws_instance.web (remote-exec): User: ubuntu
aws_instance.web (remote-exec): Password: false
aws_instance.web (remote-exec): Private key: false
aws_instance.web (remote-exec): Certificate: false
aws_instance.web (remote-exec): SSH Agent: true
aws_instance.web (remote-exec): Checking Host Key: false
aws_instance.web: Still creating... [5m20s elapsed]

Error: timeout - last error: SSH authentication failed ([email protected]:22): ssh: handshake failed: ssh: unable to authenticate, attempted methods [none publickey], no supported methods remain

Does anyone have any idea why it happens and how I can solve it?

Thanks!

https://redd.it/lv5uz6
@r_devops

What did you do on your first week as a DevOps engineer?

I come from a dev background, starting my first day as a DevOps engineer next week, am super excited!!! As per title, I'm curious what did you folks do on your first week as a DevOps engineer? Were you taking it easy or did you have a lot of things to do?

https://redd.it/lw54dd
@r_devops

DevOps for blogging with Pelican

I set up Jenkins to automatically publish my blog posts. Are there more people who are so lazy that I automate everything?

My full blog post.

https://redd.it/lw3gzu
@r_devops

How does the recruitment process for DevOps engineers actually work?

Hi,

I have a question for those who have been involved in recruiting DevOps engineers.

It seems that the term is somewhat misleading due to the sheer range of skills and backgrounds required in a functioning DevOps culture i.e., One DevOps engineer could have completely different qualifications to another, save for a mutual understanding of DevOps and how it works. I even heard one engineer say that he hates the term because it mostly exists for the benefit of recruiters.

My question is this: when you need someone with a specific skillset, would you even look for DevOps engineers specifically, or is this something you would expect the candidate to pick up once they join? e.g., recruiting for a software developer position and mentioning your DevOps culture in the job description but not the job requirements.

Would you use terms to look for a specific type of DevOps engineer?

Would you even say you are looking for a 'DevOps engineer', or would this attract the wrong kind of candidate?

https://redd.it/lw2e94
@r_devops

Ansible linting with GitHub action

Hi...I am new to ansible , need to complete a task ..when user create Pull Request ansible lint should kick and show the user whether code is mergable or not , should be automated ,so need to create jenkin pipeline file as well, can some one help me out

https://redd.it/lw1zcm
@r_devops

Devops entrepreneur

Any experienced dev/architect wanting to jump on a consulting/service startup?

https://redd.it/lwfaw4
@r_devops

Fluentd-File Output Plugin

Hello Community,

I have setup fluentd on the k3s cluster with the containerd as the container runtime and the output is set to file and the source is to capture logs of all containers from the /var/log/containers/*.log path. am finding it difficult to set the configuration of the file to the JSON format. Any fluentd experts, can you help on this. below is the fluentd config file with an example log from the output log file.

Ex log format from the output file

{"stream":"stderr","logtag":"F","log":"{\\"component\\":\\"virt-api\\",\\"contentLength\\":377,\\"level\\":\\"info\\",\\"method\\":\\"GET\\",\\"pos\\":\\"filter.go:46\\",\\"proto\\":\\"HTTP/1.1\\",\\"remoteAddress\\":\\"10.42.0.1\\",\\"statusCode\\":200,\\"timestamp\\":\\"2021-03-03T01:50:22.739834Z\\",\\"url\\":\\"/apis/subresources.kubevirt.io/v1/healthz\\",\\"username\\":\\"-\\"}","docker":

Fluentd-Config

Name: fluentd-config

Namespace: default

Labels: app.kubernetes.io/instance=fluentd

app.kubernetes.io/managed-by=Helm

app.kubernetes.io/name=fluentd

app.kubernetes.io/version=v1.12.0

helm.sh/chart=fluentd-0.2.2

Annotations: meta.helm.sh/release-name: fluentd

meta.helm.sh/release-namespace: default

Data

====

01_sources.conf:

\----

\## logs from podman

<source>

u/type tail

u/id in_tail_container_logs

u/label u/KUBERNETES

path /var/log/containers/*.log

pos_file /var/log/fluentd-containers.log.pos

tag "#{ENV['FLUENT_CONTAINER_TAIL_TAG'\] || 'kubernetes.*'}"

read_from_head true

<parse>

u/type "#{ENV['FLUENT_CONTAINER_TAIL_PARSER_TYPE'\] || 'json'}"

time_format %Y-%m-%dT%H:%M:%S.%N%:z

</parse>

emit_unmatched_lines true

</source>

02_filters.conf:

\----

<label u/KUBERNETES\>

<match kubernetes.var.log.containers.fluentd**>

u/type relabel

u/label u/FLUENTLOG

</match>

&#x200B;

\# <match kubernetes.var.log.containers.\*\*\kube-system_**>

\# u/type null

\# u/id ignore_kube_system_logs

\# </match>

&#x200B;

<filter kubernetes.**>

u/type kubernetes_metadata

u/id filter_kube_metadata

skip_labels false

skip_container_metadata false

skip_namespace_metadata true

skip_master_url true

</filter>

&#x200B;

<match **>

u/type relabel

u/label u/DISPATCH

</match>

</label>

03_dispatch.conf:

\----

<label u/DISPATCH\>

<filter **>

u/type prometheus

<metric>

name fluentd_input_status_num_records_total

type counter

desc The total number of incoming records

<labels>

tag ${tag}

hostname ${hostname}

</labels>

</metric>

</filter>

&#x200B;

<match **>

u/type relabel

u/label u/OUTPUT

</match>

</label>

04_outputs.conf:

\----

<label u/OUTPUT\>

<match **>

u/type file

path /var/log/fluent/myapp/example.log

format json

compress gzip

<buffer>

timekey 120m

timekey_use_utc true

timekey_wait 10m

</buffer>

</match>

</label>

Events: <none>

https://redd.it/lwq9pg
@r_devops

Junior DevOps - Job Interview - Tech Exam Preparation

I have the second stage (Technical Stage) of an interview for a Junior DevOps position tomorrow.

The tech task will be a scenario-based whiteboard task around a basic web stack.
The Interviewer will show you the whiteboard and ask some questions around it.

The Job is at a Software Development company but this role is more on the Ops side than the Dev side.

As far as I'm aware the company use both AWS and Azure for cloud hosting and use a varied amount of tools for their DevOps pipepline as they have said they adapt to each customer requirements and do not have a single set of tooling that they religiously use.

The first stage involved chatting with a DevOps Engineer and a Senior DevOps engineer and they already went over some technical questions with me mainly around the topics "Scaling", "High Availability", "Load Balancers", "CDNs" and "Caching".

I'm obviously going to be doing my own preparation from now until tomorrow but was just wondering if anyone else has been in / carried out an interview with a similar scenario and can shed some light of exactly what questions they may ask and what I can best do to prepare.

Keep in mind this is for a Junior DevOps role so I assume they are not going to ask me to draw out a complete CI/CD pipeline but I would like to be as prepared as possible for this.

Please let me know if I can provide any further information :)

https://redd.it/lwtn7v
@r_devops

Devopsdays Texas Day2!

We're running a FREE DevOpsDays Texas today.

Join us won't you?

https://links.devopsdaystx.org/tickets

https://redd.it/lwvc9g
@r_devops

We’re the engineers rethinking Kubernetes at Spotify. Ask us anything! crosspost r/kubernetes

https://www.reddit.com/r/kubernetes/comments/lwb31v/were\_the\_engineers\_rethinking\_kubernetes\_at/

https://redd.it/lwxp48
@r_devops

Burned out from work and lockdown

So it’s been more than a year that I’ve been stuck at home and I’m starting to feel burned out. The workloads keep increasing and timelines getting more ridiculous. Former manager left, his successor left and I seem to be headed in the same direction but can’t find inspiration to start interviewing due to current workload. I spoke to them briefly and they all came back with the burn outs made them start looking as well.

I took the advice of some and didn’t take the leadership role but now things are getting worst for the team since someone else took it.

How do you guys get inspired to start interviewing after being burned out?! I got a few interviews already but I just feel exhausted having to spend 8 hours interviewing per employer.

Edit: fix typos

https://redd.it/lwtr4p
@r_devops

Fosdem talk about infrastructure drift

We were lucky enough to hold a talk about infrastructure drift at Fosdem recently and decided to share it as a blog post for those who couldn't attend the conference.

https://driftctl.com/fosdem-pokemon-drift-talk/

https://redd.it/lwxr7v
@r_devops

Devops intern interview.

I have interview for devops intern next week. What questions should i expect from the recriuter and what should I know?

https://redd.it/lwwjyq
@r_devops