Best Practices for Managing On-Call Rotations

Here's an article with tips on how to best manage on-call rotations! Those lessons were hard-earned from over a decade in the trenches!

https://certomodo.io/best-practices/incident-management-oncall.html

https://redd.it/131un1v
@r_devops

How do I restrict access to a Vercel app to traffic from my companys VPN?

I have this complex form I have deployed on Vercel and I only want people to be able to view it from the company VPN. How do I go about this? Do I dockerize the app with nginx and set up some rules, or do I use some Vercel plugin?

P.S: Can you pause or shelve a deployment? I can only see an option to delete but not to pause or take something offline.

https://redd.it/131ylq0
@r_devops

Octopus Deploy with TFS

Hi, We are considering Octopus but we still use TFS not GIT.

How's their support for TFS?

https://redd.it/131tmpm
@r_devops

Best AI course for a senior DevOps engineer?

I am a senior DevOps engineer with some backend knowledge.
I have recently worked on several projects, and I am now interested in learning how to use AI and integrate it into my daily work and projects.

Can anyone recommend an AI course that covers the basics of AI and its implementation in projects using Python?

https://redd.it/1324o7i
@r_devops

Best way to control Code PR Merge/Approval at Github/Gitlab level or at Argo/Jenkins Level?

I might be wording it wrong here, but basically I want to hear out opinions on best way to handle the code deployments onto EKS Setups.

Do we put a guardrails and validate that we are merging the right code at Gitlab/Github and then let the Dummy CD tools (Like Argo or Jenkins) pull and push the code or do you think the best way is to let users provide an option at Argo (or Jenkins) to approve the code coming to their end and let the deployment goes through??

​

Any thoughts on this silly topic??

https://redd.it/131sba9
@r_devops

Dev podcast listeners - what do dev podcasts never talk about?

Basically the title. If you listen to dev podcasts, what topics do you feel are not getting enough attention? What should be talked about more? What would you like to hear?
I'm an editor at a new dev podcast, I feel like "Top 10 AI dev tool" listicles created with ChatGPT are getting kind of boring. Would love to hear your thoughts.

https://redd.it/131swu7
@r_devops

Is there any good Open Source Alternative to Ploi, RunCloud, ServerPilot...

Like the title said, is there any open-source alternative to those services that is equal in features?

I want an open source alternative that I can install on one server and have the ability to connect an manage many other servers.

https://redd.it/1329kd7
@r_devops

Issue with ingress-nginx on Windows

https://github.com/kubernetes/ingress-nginx

​

Read the docs, but this command doesn't work:

kubectl apply -f https://raw.githubusercontent.com/kubernetes/ingress-nginx/controller-v1.7.0/deploy/static/provider/cloud/deploy.yaml

​

I get:

Resource: "batch/v1, Resource=jobs", GroupVersionKind: "batch/v1, Kind=Job"

Name: "ingress-nginx-admission-patch", Namespace: "ingress-nginx"

for: "https://raw.githubusercontent.com/kubernetes/ingress-nginx/controller-v1.7.0/deploy/static/provider/cloud/deploy.yaml": Job.batch "ingress-nginx-admission-patch" is invalid: spec.template: Invalid value: core.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"ingress-nginx-admission-patch", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:time.Date(1, time.January, 1, 0, 0, 0, 0, time.UTC), DeletionTimestamp:<nil>, DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string\]string{"app.kubernetes.io/component":"admission-webhook", "app.kubernetes.io/instance":"ingress-nginx", "app.kubernetes.io/name":"ingress-nginx", "app.kubernetes.io/part-of":"ingress-nginx", "app.kubernetes.io/version":"1.7.0", "controller-uid":"8326bc68-6f8c-426f-91d5-72d58694b3e7", "job-name":"ingress-nginx-admission-patch"}, Annotations:map[string\]string(nil), OwnerReferences:[\]v1.OwnerReference(nil), Finalizers:[\]string(nil), ManagedFields:[\]v1.ManagedFieldsEntry(nil)}, Spec:core.PodSpec{Volumes:[\]core.Volume(nil), InitContainers:[\]core.Container(nil), Containers:[\]core.Container{core.Container{Name:"patch", Image:"registry.k8s.io/ingress-nginx/kube-webhook-certgen:v20230312-helm-chart-4.5.2-28-g66a760794@sha256:01d181618f270f2a96c04006f33b2699ad3ccb02da48d0f89b22abce084b292f", Command:[\]string(nil), Args:[\]string{"patch", "--webhook-name=ingress-nginx-admission", "--namespace=$(POD_NAMESPACE)", "--patch-mutating=false", "--secret-name=ingress-nginx-admission", "--patch-failure-policy=Fail"}, WorkingDir:"", Ports:[\]core.ContainerPort(nil), EnvFrom:[\]core.EnvFromSource(nil), Env:[\]core.EnvVar{core.EnvVar{Name:"POD_NAMESPACE", Value:"", ValueFrom:(*core.EnvVarSource)(0xc00a791ac0)}}, Resources:core.ResourceRequirements{Limits:core.ResourceList(nil), Requests:core.ResourceList(nil), Claims:[\]core.ResourceClaim(nil)}, VolumeMounts:[\]core.VolumeMount(nil), VolumeDevices:[\]core.VolumeDevice(nil), LivenessProbe:(*core.Probe)(nil), ReadinessProbe:(*core.Probe)(nil), StartupProbe:(*core.Probe)(nil), Lifecycle:(*core.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*core.SecurityContext)(0xc00a0ea5a0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[\]core.EphemeralContainer(nil), RestartPolicy:"OnFailure", TerminationGracePeriodSeconds:(*int64)(0xc0104743c8), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string\]string{"kubernetes.io/os":"linux"}, ServiceAccountName:"ingress-nginx-admission", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", SecurityContext:(*core.PodSecurityContext)(0xc00a6ed4d0), ImagePullSecrets:[\]core.LocalObjectReference(nil), Hostname:"", Subdomain:"", SetHostnameAsFQDN:(*bool)(nil),

Affinity:(*core.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[\]core.Toleration(nil), HostAliases:[\]core.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), PreemptionPolicy:(*core.PreemptionPolicy)(nil), DNSConfig:(*core.PodDNSConfig)(nil), ReadinessGates:[\]core.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), Overhead:core.ResourceList(nil), EnableServiceLinks:(*bool)(nil), TopologySpreadConstraints:[\]core.TopologySpreadConstraint(nil), OS:(*core.PodOS)(nil), SchedulingGates:[\]core.PodSchedulingGate(nil), ResourceClaims:[\]core.PodResourceClaim(nil)}}: field is immutable

https://redd.it/132buze
@r_devops

Localstack on Docker

Hi all, I have a school project that requires me to use LocalStack for AWS services on docker. My task is to write AWS Lambda scripts, some linkage to S3 as well as to the web API on LocalStack in a docker container. Can anyone share with me some good resources I can refer to?

&#x200B;

Many thanks!

https://redd.it/131q9vj
@r_devops

A question about how pods creation with requests

Hi guys,
I am new to kubernetes I need some direction to what ways can I create a pod with each request, for example 2 request hit and then 2 pods will create and then when the request is finished then 2 pods should kill with autoscale . I have been explored custom metrics but I don't know how to write conditions. If someone already worked can you please send some references links or somebody give any ideas to create pods based on the requests . I have been using load balancer as metal LB cluster for LB.


Thanks in advance

https://redd.it/131tjls
@r_devops

liberal arts major switching to a career in DevOps.

I did my undergrad in a liberal arts degree and I'm looking forward to switching my career into tech.

I'm not very proficient but I have tried my hands at Django, React and Postresql, tried MERN stack too ( I didn't really stick with it but if you asked me to build a simple demo app using one of the stacks I will know how to go about it)

I graduated with a BA last year and I've applied for MS in Computer science at a few unis in the UK ( since the UK has a lot of masters programs in CS for non-cs undergrads like me )


now I heard from a few of my friends from the UK that they hire only people who have experience, especially in DevOps and how finding internships in the UK is harder since there are a lot of international students applying for the same job posts.

so my question is :

Let's say I managed to grind through and get certs in Azure Fundamentals, or any one of the associates certification. Would the fact that I had no previous industry experience affect my job prospects? Can I apply for entry level jobs?

https://redd.it/132f8yg
@r_devops

cannot set up ingress

apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
name: ingress-service
annotations:
kubernetes.io/ingress.class: nginx
nginx.ingress.kubernetes.io/rewrite-target: /
spec:
rules:
- http:
paths:
- path: /service
pathType: Prefix
backend:
service:
name: myservice
port:
number: 8080

[192.168.49.2:8080/service](https://192.168.49.2:8080/service) doesn't respond, is there any error I did. I tried using the old configs, but it didn't work.

I also tried this:

apiVersion: networking.k8s.io/v1beta1
kind: Ingress
metadata:
name: ingress-service
annotations:
kubernetes.io/ingress.class: 'nginx'
nginx.ingress.kubernetes.io/use-regex: 'true'
nginx.ingress.kubernetes.io/rewrite-target: /$1
# UPDATE THIS LINE ABOVE
spec:
rules:
- http:
paths:
- path: /api/?(.*)
# UPDATE THIS LINE ABOVE
backend:
serviceName: myservice
servicePort: 8080

All my ports are mapped to 8080, so I am wondering why I get a timed out error.



&#x200B;

I am just trying to map the load balancer to the ip-cluster (myservice) and everything maps to 8080 and all instances are just different instances of the same backend api,

https://redd.it/132fh8k
@r_devops

People who went back for a degree, what degree did you get

What degree did you get? Did your work pay for it? How did you manage your time? Did your degree advance your career.

https://redd.it/132js8u
@r_devops

setting up ingress easily on your local machine


Metadata

Name
ingress-serviceNamespace
defaultCreated
Apr 28, 2023 Age
2 hours ago UID
28d85070-b377-40f3-be2b-268b8c46f69eAnnotations

kubectl.kubernetes.io/last-applied-configuration
kubernetes.io/ingress.class: nginx
nginx.ingress.kubernetes.io/rewrite-target: /$1
nginx.ingress.kubernetes.io/use-regex: true
Resource information
Endpoints
192.168.49.2
Rules
Host Path Path Type Service Name Service Port TLS Secret - /?(.*) Prefix ip-service 3000-
Events
NameReason



MessageSourceSub-objectCountFirst Seen



Last Seen



ingress-service.175a4928eb9af7d0SyncScheduled for sync nginx-ingress-controller -3 an hour ago 20 minutes ago

I was able to set up ingress, and I was using "Docker and Kubernetes The Complete Guide" configs for the ingress, but it seems it doesn't work at all and I can't connect to [192.168.49.2](https://192.168.49.2), because it's still scheduled for sync. Is the config 100% deprecated? Because in the tutorial it works locally with minikube, but I can't access it on my local machine after fixing the deprecated configs that no longer works.

&#x200B;

Is there a really easy way to set it up now, because everything seems to be deprecated. He's also not using the official ingress library.

https://redd.it/132jvv2
@r_devops

Help with upcoming devops interview

Hi guys, I am a recent software engineering bootcamp grad and I have a devops engineer interview in a few days. It’s for a apprenticeship - so very junior. Although I don’t know much about devops I would love to get this job. I have to give a presentation on devops, the future of the devops etc. does anyone have any tips on what I might what to research or include in the presentation that would be great!

Thanks

https://redd.it/132nkar
@r_devops

Anyone want a mentor? Staff engineer looking to pay it forward

Hey folks,

I was promoted to staff engineer a few months ago and this community was instrumental in getting me started on the wonderful road of DevOps about 6 years back.

Given that, I'd like to pay it forward and offer ongoing mentorship to one, maybe two people.

I'm imagining having weekly video chats of about 30-50 minutes where we can discuss areas where you'd like to grow, be they soft or technical skills. If there's an appetite, it could also be fun and helpful to work on practical exercises together.

A little about me, I work for a SaaS company in a department of about 80 technologists and am responsible for developer productivity, cloud infrastructure architecture (Azure), and quite a bit of cybersecurity.

Here's how I see the ideal mentee:

* Already working in a software role with some DevOps responsibilities
* Able to meet weekly or biweekly at a reasonable time (Eastern Time)
* Has a goal in mind to start the conversation
* Precocious but more importantly is a hard worker
* Speaks English fluently

If this sounds like you and you'd like to chat then please shoot me a PM with a few paragraphs introducing yourself, describing your background, and topics that you'd like to start with.

If you're not already working in a software role but think you would be an excellent mentee, then by all means drop me a line anyway.

Cheers!

https://redd.it/132sem4
@r_devops

how do you map your deployment to the ingress-nginx-controller locally?

$ kubectl get service ingress-nginx-controller --namespace=ingress-nginx

NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE

ingress-nginx-controller LoadBalancer 10.108.27.17 127.0.0.180:32606/TCP,443:32504/TCP 21m

&#x200B;

I am confused, because the starting config I had was:

&#x200B;

apiVersion: apps/v1
kind: Deployment
metadata:
name: app-deployment
spec:
replicas: 1
selector:
matchLabels:
app: myapp
template:
metadata:
labels:
app: myapp
spec:
containers:
- name: myapp
image: node:latest
command: "/bin/bash", "-c", "--"
args: "while true; do sleep 30; done;"
ports:
- containerPort: 3000

apiVersion: networking.k8s.io/v1
kind: Ingress
metadata:
name: ingress-service
annotations:
kubernetes.io/ingress.class: 'nginx'
nginx.ingress.kubernetes.io/use-regex: 'true'
nginx.ingress.kubernetes.io/rewrite-target: /$1
spec:
rules:
- host: example.local
http:
paths:
- path: /
pathType: Prefix
backend:
service:
name: my-ip-service
port:
number: 3000
apiVersion: v1
kind: Service
metadata:
name: my-ip-service
spec:
type: ClusterIP
selector:
app: myapp
ports:
- port: 3000
targetPort: 3000

I had to modify the config, because it used a deprecated version, but it seems like the starter yaml was also changed, which meant that I had to use minikube tunnel to get the loadbalancer working, but in the old tutorial we didn't need a load balancer it just worked without it, so how do I fix my config, I am kinda confused. I am thinking I need to map it to 32606 instead, but I am thinking it might be an internal port that's used internally by kubernetes.

https://redd.it/132tt0o
@r_devops

First interview was a disaster

I picked up the 3 associate AWS certs last year with the last being in October. I’ve been teaching myself Python and doing small personal projects since.

I interviewed for an entry engineering position internally at my company on Thursday. It was a technical interview and that’s really all I knew going into it. I was expecting the format to be cloud scenario based questions and maybe talking through how I’d solve a few Python problems. I was so wrong.

Instead, it was AWS trivia and live coding. It almost felt like a ‘gotcha’ interview. I was asked things I definitely would’ve known if I was fresh off of my exam or studying, but no entry level person would just know. It was almost purely facts about services like nuanced rules about them instead of scenario based or “which services would you use for building an application like this?” One asked me to list the types of private endpoints (not even what they do just name them) and another asked for how many IPs were in a /24 block. I would’ve known these if I was still studying but I don’t just have this knowledge retained all the time without being in an engineering role.

And the live coding problems weren’t even that challenging. I knew “oh I need to use the join method for this one or a for loop for this one” but to not be able to look up docs or google was kinda ridiculous. My syntax ended up being off slightly and I fumbled through them for 15-20 minutes awkwardly until I gave up.

Anyway, I’m sorry I just needed to vent. I feel absolutely humiliated after it and I’m still reeling a few days later. My confidence is ruined and I’m questioning whether this was a fair interview.

https://redd.it/132y7ud
@r_devops

How do I convert my CloudFormation template into a Terraform file?

I know that there is Terraformer (to grab AWS resources and convert them into terraform files) but is there a tool that can take a CloudFormation template and convert it into a terraform file?

https://redd.it/132v5ha
@r_devops

Nomad/Consul integration doubts

Hi!
I'm trying to create a Consul+Nomad cluster, across multiple VPSs and physical hosts (using tailscale), and i have a few doubts on how to setup the integration between Consul and Nomad..

Actually i've followed the consul and nomad reference architecture described here (https://developer.hashicorp.com/consul/tutorials/production-deploy/reference-architecture) and then installed 3 Nomad servers, 3 consul servers and as many clients.

So i have something that looks like this:

- A -> Nomad server + consul server
- B -> Nomad server + consul server
- C -> Nomad server + consul server
- D -> Nomad client + consul client
- E -> Nomad client + consul client
- F -> Nomad client + consul client

Each of them is listening on the tailscale0 interface

(I also did this because the A,B,C hosts are more powerful)

But now, when i need to connect nomad to consul (using this config block : https://developer.hashicorp.com/nomad/docs/configuration/consul), how should i do it?
The documentation warns about that:

Nomad agents should be configured to talk to Consul agents and not Consul servers. If you are observing flapping services, you may have multiple Nomad agents talking to the same Consul agent

So How can i do that? Am i missing something?

https://redd.it/1330lai
@r_devops