Kubernetes, Jenkins, Docker/Packer, and dynamic kickstart server.

I'm running a bare metal k8s cluster with Jenkins as my CI/CD tool and using Proxmox as a hypervisor for all of the x86 nodes. I'm trying to use Packer to build a Gold Image for immutable infrastructure and Terraform and whatnot. It all works by hand in that if I log on to a node that has Packer installed, I can type packer build template.pkr.hcl and a few minutes later, I have my image template ready to go on my Proxmox server.

However, now I'm trying to migrate the code to Jenkins. I'm using a containerTemplate so that I can use the hashicorp/packer Docker image to perform the build. While I could simply install Packer on each of the nodes, I'd rather not. I'd rather just utilize Docker images for my build steps.

The problem is that when Packer runs, it stands up a tiny webserver to serve the kickstart file. My kickstart file is dynamic (in that I generate the ssh_password on every build and have to inject the encrypted password into the kickstart file so the provisioning step can run and get the cloud-init packages installed and so on). But, that tiny webserver not only has a dynamically assigned port number, that tiny webserver ends up attached to the service CIDR address of the k8s-instantiated Docker image which means that Proxmox doesn't have a route.

For instance, Proxmox is running on 192.168.121.5, but the kickstart server is running on 100.65.20.2 which means that Proxmox doesn't have a route into the service CIDR (nor do I want a route for obvious reasons).

Has anybody else faced this same problem and solved it?

One option that I've considered is that I can dynamically update the kickstart file, upload it to a Nexus repository server, inject that Nexus server URL into the pkr.hcl boot command as an environment variable, and delete the kickstart file upon completion, but I was hoping there might be a more elegant solution.

https://redd.it/rk1m9a
@r_devops

Help me to develope my self in Devops

Hello every one now l'm learning devops and i need advices from you
How to start ?
What is the important things which i must to understand it ?
And where i can find internship as a devops engineer ?

https://redd.it/rjvr1d
@r_devops

How would you setup multi AWS environments for your team?

I have the privilege of setting up AWS infra for my team. We currently have everything in one account and my initial thoughts are to make this catch-all account a service account and then have it reach into a dev, stage, and prod aws account for deploys. Are there better patterns?

Alternatively, should I just use the control tower account factory capability of terraform mentioned here? If you have used it, please could you chime in? Or if you've done something similar with AWS CDK, I'd like to hear from you too. Thanks!

https://redd.it/rjjd8b
@r_devops

Being able to design right cloud solution for given software

I am software engineer with 2+ years of experience. I wear multiple hats in projects I work on and one of those hats is designing cloud architecture based on technical requirements and deploying project based on that architecture. The problem is that I have a hard time designing such architectures, as I don't know how to choose a right solution from a right vendor for implementing a specific requirement in project. For example: I have to implement image/video upload & retrieval - I search for the services and learn about the following possible options:

- Use Cloud Storage
- Use AWS S3
- Use DigitalOcean Spaces
- Use AWS EC2 VM as file system for those files
- Use Compute Engine VM as file system for those files
- Use DigitalOcean Droplet as file system for those files

but I can't choose a right solution which will be scalable, reliable, and affordable (important!) among all those vendors and all their services, and hidden costs of each service which becomes visible after scaling up.

What specific skills do I have to learn? What am I doing wrong?

https://redd.it/rk52ka
@r_devops

Grab your Digital Copy of Solutions Architect handbook - HURRY

Packt will be publishing "Solution Architect’s Handbook – Second Edition"

Grab your digital copy now if you feel you are interested.

As part of our marketing activities, we are offering free digital copies of the book in return for unbiased feedback in the form of a reader review.

This book is designed to show you how to create robust, scalable, highly available and fault-tolerant solutions by learning different aspects of Solution architecture and next-generation architecture design in the Cloud environment.


Here is what you will learn from the book:

1. Explore the various roles of a solutions architect in the enterprise landscape
2. Implement key design principles and patterns to build high-performance, cost-effective solutions  
3. Choose appropriate strategies to secure your architectures and increase their availability 
4. Modernize legacy applications with the help of cloud integration 
5. Understand big data processing, IoT, and quantum computing, and how they fit into modern architecture
6. Integrate a DevOps mindset to promote collaboration, increase operational efficiency, and streamline production

Please comment below or DM me for more details.

https://redd.it/rk6a98
@r_devops

How do you use Go in your DevOps job?

I'm pretty proficient with a few languages, however Go has recently caught my eye and im learning the basics.

I know they say Go is up their with Python as the big language for DevOps Engineers.

What are some ways you are using Go in your job?

(I know popular tools like Terraform, Docker and k8s are written in Go. I'd like to exclude these, as it isn't very relevant what language these tools are written in unless you are a contributor to those projects)

https://redd.it/rkd8gd
@r_devops

Best practice for K8's Charts

I am learning k8's for my job but I am not understanding building your k8's charts. I am seeing some people everything in a single chart while others break them apart. What would be best way to write your yaml charts ?

https://redd.it/rkd65x
@r_devops

Developing is hard

I am slowly starting to appreciate all the apps and websites i use more and more lately. The fact that everything works almost perfectly without breaking is very impressive. Reddit is a huge feat. The iOS is a remarkable piece of technology. I appreciate every single one of you. Our work is literally shaping the world.


Good stuff everyone.

https://redd.it/rkh012
@r_devops

Best Coursera tech courses/master track/certificate

​

Hey what is the best one to take for a beginner that want to start a career in tech?

https://redd.it/rkkubo
@r_devops

Today I learned "Signoz architecture is more simpler than Prometheus+Cortex"

One of my AWS client's (a gaming company) was searching for APM and decided to do POC with DataDog, after reading /researching a couple of days I understood DD has more complex & heavy pricing. So I turned towards open-source mainly Prometheus and Grafana, but since it isn't the case of "one-size-fits-all" I was still diving deeper in open source and came across Signoz an open-source APM based on OpenTelemetry component. If anyone has used Signoz please let me know your views about it.

https://redd.it/rkm6e7
@r_devops

Testing in DevOps - Everything You Need to Know

A DevOps testing strategy must be focused on continuous testing. Here's the detailed guide on DevOps workflow, the benefits of testing in DevOps, best practices, etc.

https://www.mindinventory.com/blog/devops-testing-strategy/

https://redd.it/rkkb9b
@r_devops

What do you do (as a junior) when you're new and cannot learn the systems without help but your entire team is too busy?

I'm the only junior in a team of nearly 10.

Been here for almost 2 months on my team. I've learned a few things about our systems. I was new to the vast majority of the technology. I've had about 4 short sessions 1 on 1 for anywhere from 10 mins to about an hour. The problem is that the complexity of this system takes at least 5 or 6 months (according to team)...and that's for more experienced people than myself. And no one really tells me to do anything or helps unless I ask and manage to find a free slot in their schedule.

I feel like I'm not doing much a lot of the time. I look over the ticket I'm working on but I've reached the farthest point I could get to without guidance. The other team members are working on much more important things than this ticket.

At this rate, I'll never learn enough to contribute, learn our systems and function independently. Not sure what to do.

https://redd.it/rkofl1
@r_devops

Groovy scripting for a Jenkins file

Hi I am trying to write a shared library which has to be in groovy language
Does anyone have any suggestions for as to where to learn groovy wrt to Jenkins shared library
Like a best tutorial for groovy+ jenkinsfile
The docs of Jenkins never really helped me any other alternatives or your suggestions?

https://redd.it/rkpa3h
@r_devops

I am not able to upload files to my ftp server's nested directory

I have setup a ftp server using vsftpd, enables the write permission, and I am able to upload files to my home directory /home/ftpuser, however, if I create a sub folder inside my home directory, I am not bale to upload files to that sub-directory /home/ftpuser/test . How can I change this?

https://redd.it/rkqmnz
@r_devops

How to install Ansible in OpenSUSE Leap 15 How to install the latest version of Ansible in openSUSE using the official SUSE Leap "update" repository. #ansible #installation #opensuse #suse #leap #update



https://youtu.be/Hr6VduYEKdA

https://redd.it/rkrp5q
@r_devops

EC2 vs Lightsail

If my plan is to have a Wordpress blog with 20-40 multi sites each with a few plugins, do I go all in on EC2?

The first multisite is already bogged down on crappy $7/mo shared hosting. Is lightsail going to be enough of a step up today? Is it going to be very expensive to switch from lightsail to ec2 in 5 months with 5 or so multisites up and running?

Can somebody link me to an article as to how I can learn about server usage? They talk of on demand hourly rates and network performance in gb’s used.


Hoping to learn a bit today! Love resources if you can point me the right direction!

https://redd.it/rksoyw
@r_devops

Bachelors in IS or CS

Hey all,

I'm looking at continuing education. I currently have an Associates in Computer Systems Administration and have been a DevOps Engineer/SRE for the past 5 years. I was wondering if I should continue down the IS path or branch out and go down the CS path.

I want to continue working in the SRE/Cloud space but I do know my shortcomings are around development (Python, Go).

Would love to hear everyone's feedback.

https://redd.it/rkrjw4
@r_devops

Which Macbook Pro 14 inch configuration to get for DevOps?

Not sure if the 14in base model is sufficient or if I should upgrade the RAM and GPU? Problem is the upgrades are costly. So I don't know if it's worth it or even needed in the first place.

https://redd.it/rko0et
@r_devops

Setting up on premise cloud on windows mini pc for learning & keeping up my nextcloud instance

Hi guys,

I recently bought a low profile J4125(2.0GHz up to 2.7GHz) Windows 10 Mini computer RAM 8+256GB Ssd

While i want to learn vagrant and terraform.
I have some very basic questions:
I have some insight of using vagrant in past, however i want to know can I use vagrant on my linux laptop to spin a vm instance on windows machine remotely?

Secondly, All the videos on internet shows terraform deploying infrastructure to linux machines , can terraform be used to deploy virtual box instance of ant OS? Or i would need to use vagrant in between? I am aware of provider concept in terraform. But i dont quite get browsing trough the world wide web how virtual box provider will spin instances using terraform! 😕

https://redd.it/rkyitx
@r_devops

Cannot get podman to work

Hello, I just installed podman with Homebrew and can't get it to work. I can search for images on docker.io but I get 503 errors when I try to pull them. I need to use --tls-verify=false because my work has deployed Zscaler, which basically injects its own cert.

% podman pull --tls-verify=false docker.io/library/busybox
Trying to pull docker.io/library/busybox:latest...
Error: initializing source docker://busybox:latest: Requesting bear token: invalid status code from registry 503 (Service Unavailable)

https://redd.it/rkzot5
@r_devops

AWS SNS for phone number verification (OTP)

Hello folks, we have a mobile application that we want to use a phone number verification mechanism such as OTP to verify users before signing in. For the backend we are planning to use AWS SDK to interact with the AWS resources that are needed for this. We are thinking of using SNS for this purpose but we aren't sure of all the things we need around this to achieve our goal.

What we are thinking;
\- Create SNS Topic and Subscription with SMS Protocol
\- Create a DynamoDB table to store the OTPs.
\- Use AWS SDK to interact with the resources.

We aren't sure whats the best and easiest method to achieve this, will we need Lambda functions or the backend can handle this process using the SDK? We're very open to suggestions.

https://redd.it/rkzgqu
@r_devops