How to use a custom external service LB on K3s

I am sharing my experience of using an external service LB on K3s:

https://cloudybytes.medium.com/k3s-using-loxilb-as-external-service-lb-2ea4ce61e159

Did anyone have experience of using other external LB like metalLB or Klipper with k3s ? Kindly share your experience if any.

https://redd.it/10n3n00
@r_devops

Moving to another fellow EU country as remote worker

Ok I thought to give it a go since I am sure here are some brilliant people who have broken the matrix and they are keen to look after their selfs and their best interests to live their life on the own terms so...

I am working in a company mostly remote.
I am close to office but I don't go more than few times per year and I have to pay a expensive rent on a small town also that restricts me to a lot things...
So I was thinking if it's possible to change country and rent to another city in another country and visit the company on these few occasions.
I don't intend to inform anyone of this for obvious reasons so I was wondering if it's possible to have any legal issues...
Is any way where the country government can check on that?
If I am not mistaken even working full remote for a company if you are applied to country's tax system you should have a permanent resident/address and you must also be 5 or 6 months stated in the country?
Anyone have done that?

https://redd.it/10mzbyt
@r_devops

Question about IT

Hello hello!
Can anyone explain to me please what is the difference btw a DevOps engineer, an Infrastructure engineer, and a software engineer?

https://redd.it/10n6oqz
@r_devops

Any gotchas with Organization name change?

We want to change our org name in DevOps. i.e. from https://dev.azure.com/companyA/ to https://dev.azure.com/companyB/

​

This seems easy enough to do Organization Settings --> Name. Change the name, then update the URL and that's it.

​

Aside from the obvious name and URL change, does it impact, in any way, the existing projects that are linked to the Organization name, including all source code, tickets, shared projects, and permissions?

https://redd.it/10mto23
@r_devops

Remediating flags from tools in the CI/CD pipeline

Because of the great responses on our previous article on this channel, we have created one of the promised follow up articles.

This one is focused on the how-to of fixing the initial set of flags the chosen tools in the CI/CD pipeline have raised. This includes raising the test coverage, and ensuring that all third party software is configured with best practices and passing security benchmarks.

Enjoy the read, and feedback is always welcome: https://www.coguard.io/post/security-hardening-react

https://redd.it/10muk1b
@r_devops

Advice for a student

Hello ,

I don't know if the right place to ask my question, so sorry in advance.

I am currently a computer science student on my penultimate year of study, and I want to start a career as a DevOps engineer (after taking a year off).

I've already had the opportunity to learn a lot of technology related to the field (docker, terraform, Jenkins ....), and I've come to wonder if I should start learning more about this technology or if by the time I work my knowledge will have become useless.

Should I already get certifications ( AWS , terraform ....) or should I wait? Or do I wait for the moment when I would like to work to get trained, to get the certifications .

Thank you in advance for your advice and feedback.

Ps: if the post doesn't fit here, can you advise me a /r where I can ask my question?

https://redd.it/10mtymz
@r_devops

Anyone studying for RHCSA?

Studying for RHCSA. Anyone else doing this that wants to help keep each other accountable? Any discord servers that may have people studying for this?

https://redd.it/10nda8i
@r_devops

OneUptime: Open Source StatusPage.io Alternative

Hey r/devops,

I'm working on a project called OneUptime. Its an open-source StatusPage.io alternative. All of it is MIT licensed on GitHub. You can check the project out here: https://github.com/oneuptime/oneuptime

Please let me know what you think.

https://redd.it/10nfihi
@r_devops

Can anyone give tasks to practise in Devops and Aws?

We are group of self learning Devops studs. We are unable to offord premium training programs. we want some real time experience persons to guide and give us simple to moderate tasks that you perform as part of your Devops job.

We have setup free GCP account for playground. Thank you in advance.

https://redd.it/10merfb
@r_devops

How long would it take you to deploy a ECS cluster in a brand new AWS account?

Recently I did some work for my client which included setting up an ECS cluster, load balancer and a database for prod and dev environments. Also automated deployment by using Gitlab CI/CD.

My initial estimate was between 8 and 10 hours but it took my longer.

Now I am just wondering how long would take someone else?

Just to note that deployment was trough GUI because it probably matters discussion wise.

https://redd.it/10medw7
@r_devops

How do you define SLO (and SLA) for a cloud platform

So we're starting to define our SLA. We're an AWS based SaaS platform.
I have read the Google SRE book on SLI/SLO/SLA, and the way to go is with request based SLO.

However, I'm confused that should we not take in to account the SLAs of the services we use in the backend.

As a simple example, if I'm running a web server on AWS, and this server is using a RDS database, our web server cannot have a SLO better than the Dabs SLA, can it?

If the SLA for the DB is 99.9%, our web server cannot have a SLO of 99.99%. isn't that right?
If the uptime of the DB is 99.9%, the web server cannot have an uptime of 99.99%.

Or should I not take in to account the services we use to serve the web server traffic?

https://redd.it/10nhle0
@r_devops

Are there any advanced Jenkins Scripted Pipeline tutorials available?

I've recently joined a new DevOps team and they use Scripted pipelines to an extent that I have never seen before. My background consists of 2 years working with declarative pipelines and 1.5 years of groovy. I've checked out the docs for Jenkins and there seems to be one small section dedicated to explaining scripted pipelines. There aren't too many tutorials on the site either. Can anyone suggest any intermediate to advanced tutorials for scripted pipelines?

https://redd.it/10njapx
@r_devops

How to handle multiple log streams inside one container?

I have a single app service that runs inside the docker container.
The app service itself has five different log streams, all of them are important and has different format. Some in json, some in a plain text. Right now, all these log streams are pointed into stdout, and it gives me a headache to handle it, since these log streams should be separated and handled differently.
I can easily configure this service to write logs into separate log files inside the container. But in this case, what will be the best way to read them? What is your proposal to handle this situation?

I am using simple docker swarm if it's important.

https://redd.it/10nnoht
@r_devops

Using Kubernete & minIO. If anyone is able to assist me in finalising my minIO deployment, I'd appreciate it

Everytime I try accessing my minIO console via the browser with a port-forward, the connection will work briefly with multiple connection messages of:

Handling connection for 9000 Handling connection for 42935 Handling connection for 42935 Handling connection for 42935 Handling connection for 42935 Handling connection for 42935 Handling connection for 42935 ...

Then a moment later, this error message

E0128 18:22:01.801739 40952 portforward.go:378] error copying from remote stream to local connection: readfrom tcp6 ::1:42935->::1:50796: write tcp6 ::1:42935->::1:50796: write: broken pipe

Before it finally spamming with multiple messages of:

E0128 18:22:31.738313 40952 portforward.go:346] error creating error stream for port 42935 -> 42935: Timeout occurred Handling connection for 42935 E0128 18:22:32.120930 40952 portforward.go:346] error creating error stream for port 42935 -> 42935: write tcp 192.168.0.16:50776->34.133.9.102:443: write: broken pipe Handling connection for 42935 E0128 18:22:32.574837 40952 portforward.go:346] error creating error stream for port 42935 -> 42935: write tcp 192.168.0.16:50776->34.133.9.102:443: write: broken pipe ...

Here's my deployment file:

apiVersion: apps/v1 kind: Deployment metadata: name: minio-deployment namespace: minio-ns spec: replicas: 1 selector: matchLabels: app: minio template: metadata: labels: app: minio spec: containers: - name: minio image: minio/minio args: - server - /data - --console-address - ":42935" volumeMounts: - name: minio-pv-storage mountPath: /data volumes: - name: minio-pv-storage persistentVolumeClaim: claimName: minio-pv-claim --- apiVersion: v1 kind: Service metadata: name: minio-service namespace: minio-ns spec: selector: app: minio ports: - name: minio port: 9000 targetPort: 9000 - name: minio-console port: 42935 targetPort: 42935 type: LoadBalancer --- apiVersion: v1 kind: PersistentVolumeClaim metadata: name: minio-pv-claim namespace: minio-ns spec: accessModes: - ReadWriteOnce resources: requests: storage: 1Gi

I changed the minio-service type to LoadBalancer (from ClusterIP) to access the console via the browser along with adding the --console-address flag and exposing the necessary port. This worked in allowing the minIO console to show despite being in a constant loading state. If I try to login, it will just refresh until crashing/timing out

https://redd.it/10nt2e0
@r_devops

Datadog vs Graylog vs ELK

Hi all,

At my company, we use Datagog for metrics and Graylog for log management (and generally also derived metrics). Both Datadog and Graylog are getting older and we are thinking about upgrades.

All of our infra is on AWS in a bunch of accounts, what we need is to have monitoring with dashboards with metrics and alerting (very important). We need basic stuff - CPU/mem/disk/traffic/io/HTTP graphs. Our Graylog ingests around 5GB of logs a day.

Now, I was reading more about all 3 apps (Datadog, Graylog, ELK) and I can't make up my mind (not enough live experience), what we should do (worked closer only with ES, but not for monitoring):

\- use only Datadog and skip Graylog (I understand that Datadog can ingest logs as well)

\- use only Graylog (but I don't see it being able to show basic OS metrics)

\- use ELK with +beats for metrics

\- use AWS OpenSearch as above (but know it's a fork from an older version)

\- stick with just CloudWatch?

​

Or maybe there is some other system (Grafana/Loki, Splunk ....) that you would recommend?

Most important requirements:

\- metrics

\- logs management

\- alerting (setting custom thresholds)

\- the cheaper - the better, but the price is not an important factor

\- nice to have - good integration with AWS

\- nice to have - multi-user / fine-grained ACLs

\- nice to have - integration with Github and Atlassian stack

\- nice to have - easy deployment (Docker preferred)

​

Thanks in advance for any comments/recommendations :)

https://redd.it/10ntvs1
@r_devops

Simple PAAS open source that run on docker or docker-compose insted of openshift

Hi in work environment we want to make a PAAS platform but openshift if heavy to run and we want a light alternative and in next time migrate to Kubernetes PAAS platform any return of production ready that you can use ?

https://redd.it/10nkqgu
@r_devops

Tool for app testing?!

I don't know if this is the right subreddit for this question but I have a network where I have many systems that are directly unsupported for the application our organization is working on and what to set up an in-network server for the testing application.

I've heard about Citrix and Winflactor for my use case but both cost a ton and Citrix even has a complicated learning curve.

I'm looking for an easy-to-use solution, preferred open source software, that works on Windows and Mac OS.

https://redd.it/10mq20v
@r_devops

How about a tool convert form .tf to png/design ?

I like Terraform, but I always want to know what my terraform code looks like in a design graph.

​

I want to know how my Terraform code is represented in the Cloud service:

How resources are grouped under the network
How resources are grouped under a region
How resources are grouped under a resource-group
How resources cost
Verify if our initial design is as same as the design terraform code generate
Etc.

​

If someone makes a tool for that, will you use it and pay for it?

https://redd.it/10o16a5
@r_devops

(GITOPS) Progressive Delivery Tools and Rollbacks to Git ?

Hello,

For GitOps - Git is the source of truth. Let's imagine a situation when deployment fails and the application is rolled back to the previous configuration and version.

Should state in Git reflect that ?

What we do if we want to revert something in Git ? We create a revert commit. Then the state in git reflects reality that this change does not work and thus was reverted.

Do any of the GitOps tools are aware of that ?

An ideal GitOps approach pipeline would be:

- I commit a change to repository (change of state in Git)

- Tool pick-ups the change and compares it with the state on the Cluster

- Tool applies the state on the cluster - but the metric says the change causes a failed state

- Tool creates a rollback to the previous version

- Tool notifies something that was tracking Git that this change does not work

- This something else prepares a PR with revert to Git with explanation that this version failed due to X

- It's up to human to merge the PR thus restoring the Git state to again reflect what is truth

Thoughts ? Ideas ?

Seems like we have a gap in currently available tooling.

https://redd.it/10o4ux0
@r_devops

How to automate baremetal migration

My team wants me to setup automation for the an application which is in baremetal/physical server, since this migration happens every year.

Bellow are the steps i need to automate. How would you do it? What tools would you use?

1. Procure new baremetals servers

2. Get IPs allocated

3. Get VIPs from network team

4. Open firewall rules - ticket to network team

5. Configure tomcat and install application

6. Configure database

7. Setup monitoring

8. Configure gslbs to point to new Load balancers

https://redd.it/10o3al5
@r_devops

Which CD solution would you use - if you had to start fresh?

If you were tasked to build a new K8s environment from scratch, what would you use for CD?

Considerations:

\- Minimal set-up time
\- Easy rollback
\- Cloud agnostic
\- Canary deployments


This is only part of the picture of course - if you chose one of these CDs, can you share what the rest of your set-up looks like?


View Poll

https://redd.it/10o6i2m
@r_devops