Learning Golang

Hi everyone, I wanna learn Golang for DevOps purposes. Now I am using Python and Bash scripting as automation, CI/CD flows, and general scripting. But I am observing Golang's popularity and capability, so it means Golang is more of a preferred language for DevOps usage. Could you recommend for me good sources for starting? Doesn't matter whether they are free or paid sources. I don't need deeply learn Golang at the Software Engineer level. I will use it just for DevOps scripting and integrations.


Thanks for advance

https://redd.it/10v6n34
@r_devops

Android and iOS app development

Hi !

First of all my apologies if this does not fit the sub, I'll delete if it is the case, I'm not sure where to post this.

As part of a project with a friend I need to develop a mobile application a bit like Uber eats. Basically, there will be a customer side, and a manager side (so that everyone can fill in the data related to their business).

I have no experience in app development, we are 2 data scientists with a technical background but almost exclusively Python oriented. I've heard about low-code or no-code tools and I'm a bit lost. I've seen things like bubble, glydeapp etc but there are too many choices!

My question is this: Have you had to deal with similar tools and what did you think of them? Do you think the no code approach is good, especially for a first quick PoC/mvp?

So here it is, sorry if it's a bit vague, it's because I don't really know where to start!

Thanks for your feedback if you have any !

https://redd.it/10v693a
@r_devops

fluentd failing when TLS added

I am adding TLS config to Fluent (working on HTTP), when I add the TLS Config and restart the service it crashes although the config is parsed okay.

There is no passphrase on the cert key (generated from vault).

<source>
@type forward
bind 0.0.0.0
port 24224
tag "host_logs"
<transport tls>
cert_path /etc/pki/tls/certs/fluentd.crt
private_key_path /etc/pki/tls/certs/certs/fluentd.key
</transport>
</source>

service output:

systemctl status td-agent
● td-agent.service - td-agent: Fluentd based data collector for Treasure Data
Loaded: loaded (/usr/lib/systemd/system/td-agent.service; enabled; vendor preset: disabled)
Active: failed (Result: start-limit) since Mon 2023-02-06 15:06:22 GMT; 20min ago
Docs: https://docs.treasuredata.com/display/public/PD/About+Treasure+Data%27s+Server-Side+Agent
Process: 17157 ExecStop=/bin/kill -TERM ${MAINPID} (code=exited, status=0/SUCCESS)
Process: 19107 ExecStart=/opt/td-agent/bin/fluentd --log $TD_AGENT_LOG_FILE --daemon /var/run/td-agent/td-agent.pid $TD_AGENT_OPTIONS (code=exited, status=1/FAILURE)
Main PID: 3390 (code=exited, status=0/SUCCESS)

Feb 06 15:06:22 prometheus.server systemd[1]: td-agent.service: control process exited, code=exited status=1
Feb 06 15:06:22 prometheus.server systemd[1]: Failed to start td-agent: Fluentd based data collector for Treasure Data.
Feb 06 15:06:22 prometheus.server systemd[1]: Unit td-agent.service entered failed state.
Feb 06 15:06:22 prometheus.server systemd[1]: td-agent.service failed.
Feb 06 15:06:22 prometheus.server systemd[1]: td-agent.service holdoff time over, scheduling restart.
Feb 06 15:06:22 prometheus.server systemd[1]: Stopped td-agent: Fluentd based data collector for Treasure Data.
Feb 06 15:06:22 prometheus.server systemd[1]: start request repeated too quickly for td-agent.service
Feb 06 15:06:22 prometheus.server systemd[1]: Failed to start td-agent: Fluentd based data collector for Treasure Data.
Feb 06 15:06:22 prometheus.server systemd[1]: Unit td-agent.service entered failed state.
Feb 06 15:06:22 prometheus.server systemd[1]: td-agent.service failed.

logs:

2023-02-06 15:06:20 +0000 [info]: parsing config file is succeeded path="/etc/td-agent/td-agent.conf"
2023-02-06 15:06:20 +0000 [info]: gem 'fluent-plugin-elasticsearch' version '5.1.4'
2023-02-06 15:06:20 +0000 [info]: gem 'fluent-plugin-flowcounter-simple' version '0.1.0'
2023-02-06 15:06:20 +0000 [info]: gem 'fluent-plugin-kafka' version '0.17.3'
2023-02-06 15:06:20 +0000 [info]: gem 'fluent-plugin-prometheus' version '2.0.2'
2023-02-06 15:06:20 +0000 [info]: gem 'fluent-plugin-prometheus_pushgateway' version '0.1.0'
2023-02-06 15:06:20 +0000 [info]: gem 'fluent-plugin-record-modifier' version '2.1.0'
2023-02-06 15:06:20 +0000 [info]: gem 'fluent-plugin-rewrite-tag-filter' version '2.4.0'
2023-02-06 15:06:20 +0000 [info]: gem 'fluent-plugin-s3' version '1.6.1'
2023-02-06 15:06:20 +0000 [info]: gem 'fluent-plugin-sd-dns' version '0.1.0'
2023-02-06 15:06:20 +0000 [info]: gem 'fluent-plugin-systemd' version '1.0.5'
2023-02-06 15:06:20 +0000 [info]: gem 'fluent-plugin-td' version '1.1.0'
2023-02-06 15:06:20 +0000 [info]: gem 'fluent-plugin-utmpx' version '0.5.0'
2023-02-06 15:06:20 +0000 [info]: gem 'fluent-plugin-webhdfs' version '1.5.0'
2023-02-06 15:06:20 +0000 [info]: gem 'fluentd' version '1.14.3'
2023-02-06 15:06:20 +0000 [info]: brokers has been set: ["kafka.server:443"]
2023-02-06 15:06:20 +0000 [warn]: For security reason, setting private_key_passphrase is recommended when cert_path is specified

https://redd.it/10v9gwu
@r_devops

terraform-repl : A terraform console wrapper for a better interactive console experience

terraform-repl is a terraform console wrapper that aims at providing a better interactive console for evaluating Terraform language expressions.

https://github.com/paololazzari/terraform-repl

If you've used terraform console then you will be familiar with its limitations. This programs allows you to do everything you could normally do with terraform console, plus you can:

- Create new local variables on the fly
- View resources without having to specify the whole identifier
- View command history
- Clear screen

https://redd.it/10v9iv5
@r_devops

cloudtrail-event-fuzzy-viewer: cli tool for searching cloudtrail events using fuzzy search

I built a cli tool that allows you to easily search and view cloudtrail events.

The program fetches cloudtrail events with the aws cli lookup-events cli call, and then gets you in an interactive fuzzy search command line (fzf).

For whichever event you look for, the body of the event itself is displayed on the right.

Here's how it looks:

https://github.com/paololazzari/cloudtrail-event-fuzzy-viewer/blob/master/doc/demo.png

You can find it on github:

https://github.com/paololazzari/cloudtrail-event-fuzzy-viewer

https://redd.it/10v9e2e
@r_devops

Is it possible for ticket statuses to trigger pipeline builds?

I am new to Devops but in my dream development world there is no more need for merging of code. Previously I build a lot of custom bat files, stored procedures and SQL jobs that would deploy all of our database code using a combination of SVN and msbuild. This took an enourmous amount of time, but it is now very stable and our QA team only needs to execute one stored procedure to deploy all of our SSDt projects (i.e. SQL, SSIS, SSRS and SSAS). We did not use TFS and that is a long story but we were stuck with old SVN and doing manual merging between different branches, DEV, QA and Production.

What I would like to do in Devops (if it is possible) is that all code is associated with a ticket, whenever the status changes on a ticket, that triggers a pipeline execution. (Release to production is probably more complicated and would require some manual intervention.) So for example, let's say you have ticket statuses of:

Created,In progress, Pending Release to QA, Ready for QA, QA In progress, QA Complete, Pending Release to UAT, Ready for UAT, UAT in Progress, UAT Complete

So certain changes of status would trigger a pipeline, for instance, Pending Release to QA would be set by the developer after development is done, this would trigger the pipeline release to QA, taking only code from the repo associated with tickets with that status. After the pipeline completes successfully then the status for all the tickets are automatically set to "Ready for QA". The QA team member ticket owner then manually changes to "QA In Progress". "Pending Release to UAT" is set by the QA member which then triggers a pipeline that deploys to the UAT environment etc.

So theoretically then there would no longer be a need for merging, since the statuses determine what code is deployed to what server. The only issue would be reverting code, but I was thinking that if each pipeline release automatically takes a snapshot, then you could then just deploy from the previous snapshot to "revert", although the code itself would just have it's status changed back to "In Progress".

Is this possible? Does it even make sense? Thanks.

https://redd.it/10vdr0v
@r_devops

A nice tool to render pretty markdown in the terminal

Pretty Markdown rendering in the Terminal:

https://www.youtube.com/watch?v=h9JJjyiHOAw

https://redd.it/10v5bqo
@r_devops

(Windows) Containers for People in a Hurry!

Hey folks,

I enrolled myself on a mission of trying to understand the inner-workings of Containers and, along the way, created 15 InfoGraphics that cover various topics from "What is Container" all the way to "How is it distributed". Since I can't upload images here, I'm sharing a PDF from my Google Drive: https://drive.google.com/file/d/13vyoHrc3bvAG480GTFDl4Xs1mfJP5PqP/view?usp=share\_link. If anyone wants the actual images, just let me know and I'll send you PDFs.

Why I think this is useful? Because I deeply believe that even in 2023 many people don't really "get" containers and yet they usually have "better" things to spend time on than dealing with Containers. And I'm saying this from the first person view :)

My hope is that this series of graphics may be of use to anyone who wants to learn containers and yet has no time to do so :)

Let me know what you think!

P.S. I hope this is in accordance to the rules?

https://redd.it/10vgy7n
@r_devops

What type of companies should i be targeting that usually follow best devops practices as a junior?

I'm considering getting into Devops now for the **nth** time after doing software dev (99% webdev) for a few years now. Naturally, I'm already familiar with some of the Devops related tools such as Docker, CI/CD and doing linux related stuff in the CLI and others.

From what I've read a lot of companies out there are doing Devops wrong which then causes stress and headaches for the Devops employees such as all of you people!

So my question is, what type of companies/industries should I be specifically targeting that is known to follow good Devops strategies/practices so that in 3 years I won't be a burned out miserable f*ck wishing that I never got into Devops in the first place.

Thanks Guys!

https://redd.it/10vi390
@r_devops

Do you need Cloud <> K8s validation?

Hi All, I've got a question for SRE/DevOps/DevSecOps.

Is anyone interested in querying or validating cloud resources with Kubernetes manifests? Do you need to check if public cloud resources used in K8s clusters are present and have specific properties set? How about the other way around? What is your use case? Troubleshooting, security, compliance, cost management, or something else? Would you like to see those in a dashboard, generate a report, or prevent certain conditions from happening?

I'd love to learn more about your case. I'm working on a project, and I might be able to help.
Please DM, comment below, or email: [email protected]

https://redd.it/10vfvud
@r_devops

Best cloud platform for free or low cost website

I've been doing some light devops and webdev stuff for the last year for my company and would like to build my own website on a cloud platform for better experience. A lot of the stuff I'm doing is either very specific to the job right now (not really marketable to other companies) or the it's light modifications to existing code. I'd like to do something from scratch, build a website to host some of my photography to give me experience in building my own site and hosting it on a cloud platform.

I've used AWS and Azure for work stuff, but all that stuff is backed by the deep DoD budget that the companies have. I'm trying to stay free if possible, or as low cost as I can get it. What cloud platform might you recommend for this?

https://redd.it/10vlgkz
@r_devops

How in demand are skills in Docker and Kubernetes for operations roles?

How often do you use Docker and Kubernetes on the job and how important are having those skills when applied to your day to day work? I'm trying to see if investing time in learning them is worthwhile if I want a position as a DevOps Engineer or SRE.

https://redd.it/10vn0jd
@r_devops

Build iOS app using MS AppCenter

Hi All,

Anyone has experience using MS AppCenter to build iOS apps. I want to understand what are the limitations vs if I use a macOS server to build app ipa. Similarly for test automation are there any limitations?

Thanks

https://redd.it/10v5nxn
@r_devops

Question: What is "Ops" in DevOps Topologies?

I studied the DevOps Topologies and I am a little confused on what exactly the blue circle "Ops" refers to here. It appears inconsistent between the models; in Type A, it appears to be more like application operation while in Type C, it appears to be more like the platform and the green Circle is application operation. This confuses me alot because how can I understand those models if on every graphic, something else is meant by "Ops"?

Type C for example explicitly states that "Ops" is basicly amazon (in a cloud world), which is quite confusing because nobody would really say "my Ops Team is Amazon"? Meanwhile, in Type A, clearly Ops is not Amazon because you are not really talking with them?

Anyone can give me some clarity? Thanks!

&#x200B;

EDIT: This is a specific question to understand a specific information on the specific linked page. While general introductions to DevOps are certainly good-hearded and well-intended, they sadly don't really help. I know what Dev and Ops are in the "classical" world, I know (as far as anybody could even say that) what DevOps is about, I know the problems that arise and how DevOps tackles them, even used it successfully in different projects. I'm just having trouble to bring that knowledge and experience together with a specific detail on the linked page.

https://redd.it/10v55kc
@r_devops

10 Docker Alternatives

This article presents 10 tools that can replace Docker in various container management aspects:

https://phoenixnap.com/kb/docker-alternatives?utm_source=reddit&utm_medium=community&utm_campaign=social

https://redd.it/10v8tza
@r_devops

Noob AWS question: How do I retrieve the IAM user name given its secret key and access key ID?

Hello everyone! Wondering if any DevOps guys can help me out here.

I am working on a study guide for AWS DevOps interviews as I'm working on practice questions for my AWS tests, and there is one question that I can not seem to figure out the answer to.

In a scenario where I am provided an AWS_SECRET_KEY and an AWS_ACCESS_KEY_ID , as well as the REGION and ACCOUNT_ID for the AWS account of the infrastructure, how can I obtain the IAM user name so that I can login to the AWS console via the front-end?

I have been looking at possibilities from calling the IAM Query API with Postman, to trying to run aws iam list-users, but the problem is I'm not given the sso_start_url to be able to configure SSO so I can run these AWS CLI commands.

Could anyone here help steer me in the right direction? I am really scratching my head at this..

Thanks in advance!

https://redd.it/10vuibr
@r_devops

CI/CD for dummy project

Hi guys. I started to learn Devops & AWS a week ago.
I created a small dummy application - backend node/express.js, Mysql DB and frontend in React.

The code is located on Github. I have Dockerfiles for backend and frontend and corresponding docker-compose script.

I want to deploy everything on AWS and establish CI/CD, please guide me.

Should I grab an EC2 instance, install docker and docker-compose on it, and do everything via a docker image/container?

Should I do all this without docker? I know that the can be cloud native and outside of the EC2 instance.

What does CI/CD should mean for my project? What do I have to do to comply with this form?

Any instructions or comments are welcome. I'm interested in best practices. I'm doing all this just to get my hands dirty with AWS.

Thank you very much. <3

https://redd.it/10vwl0j
@r_devops

Need some project recommendations (AWS, Terraform, AI)

Hi,

do you have some simple project recommendations which involve AWS, Terraform and some super simple AI stuff ? I secured a new position and want to build some experience before I start working at the new place.

Thank you !

https://redd.it/10vxgvr
@r_devops

First day as a Cloud & Devops

I will mainly work with AWS so any advice with best practices , well architected , security , logs , best cheap options etc.. and should i use ECS or EKS for a food order app .

This company didnt had any filled mentioned position so i must do all the things from scratch .

I appreciate your help thank you.

https://redd.it/10vx92a
@r_devops

Devops Apprenticeships?

I didn’t know these existed. Does this seem legit? I’m working help desk and plan was to move onto NOC for a year and then try to get a Linux admin or cloud support job. Wondering if this would be a better path.

https://redd.it/10vz0ck
@r_devops

How do you manage deployments with multiple repos?

Currently working on a project that has multiple repos and git submodules are really killing me. --recurse-submodules does the trick but I must edit first the .gitmodules url from https to ssh.

How do you do this in your projects? Is deploying them as a whole a good idea or deploying on a per repo basis better?

https://redd.it/10w09m5
@r_devops