How do you document CI/CD: containers, pipelines, toolchains, etc?

as the title explained: how do you document your containers, pipelines, repositories, environments, etc... ?

​

do you have anything automated? do you follow any convention, any framework?

​

as for me, i manage a huge gitlab space, we've 200-300 repositories, with 20-30 centralized pipelines. we are dealing with python, java, node pipelines. quality gates with sonarqube, xray and other security tools. we are dealing with an artifactory and a sonatype instance.

we've also a legacy jenkins instance with 30, 40 pipelines. we're usign maybe a 100 vms divided in various clusters.

we release a product that is composed by almost 20 containers, and we manage 3-4 releases in parallel.

as an architect i've inherited a confluence space with a huge mess of pages and sections. basically documentation is unexisting.

pipelines are not documented and I don't have any clue how to start organize things. i'm leading 4 team mates and all devops/ci-cd activities are "oral handovers"

to start automatizing things i've written a python script that parses the ansible hosts.ini and publish on confluence the list of environments/server. it's integrated into a gitlab pipeline, so anytime someone updates the hosts.ini, confluence page gets updated. it's just a simple thing, but still useful to the developers team

https://redd.it/ut397y
@r_devops

Devops more ops then dev?

If I look at the current state of DevOps in my country (Netherlands) it has not become what I expected.

Instead of seeing developers maintaining their own infrastructure work or developers and operations working together in one team. In my opinion it's nowadays some ops guys doing some DevOps work like: IaC, writing CI/CD pipelines for developers, maintaining stuff (observability) etc.

Is this really what it become? and does this sound familiar to you guys? Im quite dissapointed to be honest as a junior

https://redd.it/ut3kgu
@r_devops

What makes a good DevOps manager?

Interested to see what everyone thinks makes a good DevOps manager. What things should they do? What should they avoid doing? What makes them a top 10% manager? What do you hate when a manager does? What matters most to you about your manager?

https://redd.it/ustzqj
@r_devops

Calculating supply chain risk, math question

Can someone ELI5? Or ELI18 maybe? I was reading a document on an organization's DevOps strategy today and came across this statement:

>If the compiler is 90% secure, the code repository is 90% secure, the artifact repository is 90% secure, and the container orchestrator is 90% secure – the overall system is not 90% secure. The cybersecurity level of the end-to-end ecosystem is actually .9 * .9 * .9 * .9, or roughly 65% secure.

I don't get it. I mean, first off, I don't get what it would mean to be "X% secure" in the first place. But even accepting some intuitive sense of that, if a security event happened in 1 out of the 10 times that step 1 occurred, and in 1 out of the 10 times that step 2 occurred, then it occurs in 2 out of the 20 times... wait, that's not right. Okay, so you have 10 possible situations for step 1, 9 of them being safe and 1 being a security event. After that you have another 10 possible situations or events. So you map out each possible path. There's 100 possible paths. 1 -> 1, 1 -> 2, 1 -> 3, so on to possibility 2 in step 1, which could then be 2 -> 1, 2 -> 2, 2 -> 3, etc.

Ah. Okay. With four steps of ten possibilities each, that's 10,000 possible sequences. Out of that 10,000, to go through only safe events you'd have to hit one of the 9 safe events in the first step, and each of the 9 could only hit 9 of the events in the second step, and... that's how you get the formula they used in the quote. 9 * 9 * 9 * 9 = 6561. Then 6561 / 10000 = 0.6561 or "roughly 65%". I get it.

Hey good chat everybody. Nice to catch up. = )

https://redd.it/utcuwb
@r_devops

Azure Terrafy- Azure’s best Terraform buddy

https://www.linkedin.com/posts/ormaman\_azure-terrafy-azures-best-terraform-buddy-activity-6933150295745040384-d2oW?utm\_source=linkedin\_share&utm\_medium=member\_desktop\_web

https://redd.it/utci3h
@r_devops

Better Language for Pulumi?

I'm going to spend some time this weekend trying out Pulumi.

Before I dig in though, I wanted to know if there were any particular issues with a supported language. We all know the marketing speak that they have all these supported languages, but in the real world, I'm guessing they probably have some shortcomings or are unequal.

Ignoring discussion of the language itself, are there sections of the SDK that aren't available in certain languages? Or all they all 100% compatible? Are there any common idioms in their SDK that just feel wrong or duck-tapey in certain languages? Are there 3rd party plugins or libraries that don't work with certain languages? Is the developer community stronger with certain languages? Docs better? The list could go on. I want the real talk from anyone who's spent time with it and felt the pain.

https://redd.it/utl0oh
@r_devops

Apply now or wait till i get my degree?

​

I'll shorten the whole thing,

\-i live in germany

\-my boss is getting on my nerves he is not a computer scientist or dev ,but an economist and has no idea what I do ...

\-I get too little money in my opinion ... 35k as a java developer they lured me with the fact that I already got 20k as a trainee last year which was quite ok as a trainee but now well....

\-what i do is currently pretty boring and i feel underchallenged

\-i get my cs bsc degree in about 11 weeks only

Should I apply somewhere else now or wait until I have my degree in the bag?

https://redd.it/uto3kg
@r_devops

is 90DaysOfDevOps good for learning?

Its on github with bunch of links to learn relevant technologies.

Or can you suggest any alternatives regardless if its good or not?

edit: heres the link: https://github.com/MichaelCade/90DaysOfDevOps

https://redd.it/uttp4m
@r_devops

Collectd crashes when enabeling apache plugin

After I enable collectd plugin for apache collectd crashes

I uncommented collectd.conf

<Plugin apache>
<Instance "tktestapache">
URL "https://127.0.0.1/server-status?auto"
</Instance>
</Plugin>

When I checked the status

systemctl status collectd.service

I am not able to find any specific reason why it is failing. Am I missing any step in setup?

collectd.service - Collectd statistics daemon
Loaded: loaded (/usr/lib/systemd/system/collectd.service; enabled; vendor preset: disabled)
Active: failed (Result: start-limit) since Fri 2022-05-20 12:09:13 UTC; 8min ago
Docs: man:collectd(1)
man:collectd.conf(5)
Process: 4302 ExecStart=/usr/sbin/collectd (code=exited, status=1/FAILURE)
Main PID: 4302 (code=exited, status=1/FAILURE)

May 20 12:09:12 ip-10-2-27-88.ec2.internal systemd1: collectd.service: main process exited, code=exited, status=1/FAILURE
May 20 12:09:12 ip-10-2-27-88.ec2.internal systemd1: Failed to start Collectd statistics daemon.
May 20 12:09:12 ip-10-2-27-88.ec2.internal systemd1: Unit collectd.service entered failed state.
May 20 12:09:12 ip-10-2-27-88.ec2.internal systemd1: collectd.service failed.
May 20 12:09:13 ip-10-2-27-88.ec2.internal systemd1: collectd.service holdoff time over, scheduling restart.
May 20 12:09:13 ip-10-2-27-88.ec2.internal systemd1: Stopped Collectd statistics daemon.
May 20 12:09:13 ip-10-2-27-88.ec2.internal systemd1: start request repeated too quickly for collectd.service
May 20 12:09:13 ip-10-2-27-88.ec2.internal systemd1: Failed to start Collectd statistics daemon.
May 20 12:09:13 ip-10-2-27-88.ec2.internal systemd1: Unit collectd.service entered failed state.
May 20 12:09:13 ip-10-2-27-88.ec2.internal systemd1: collectd.service failed.

https://redd.it/utv3so
@r_devops

mkincl - A simple way to reuse Makefiles and scripts across multiple repositories

Hey,

Here's the implementation of an idea I've been playing around with and I thought I'd share. The jist of it is to utilize Makefiles to construct reusable CI/CD pipelines that can be ergonomically executed locally.

https://github.com/mkincl/mkincl

https://redd.it/utyns3
@r_devops

Is Cloud Foundry relevant in 2022?

I get this question a lot and want to limit the options to a simple 'yes' or 'no'. I'm simply curious about everyone's gut reaction.

View Poll

https://redd.it/utyv7g
@r_devops

Should your Infrastructure as Code get its own repository?

Hey folks,


I would like to know your strategy with your IaC (terraform, ansible, ...) files. Do you prefer it in a separate repository, or do you share it within the repository of the application? Please explain why you made this decision and if your strategy has some downsides that you discovered.


Cheers

https://redd.it/uu1tcp
@r_devops

Time and Task management at work

I'm interested to know how you guys manage your tasks because especially in a devopsy role where devs want your time, something breaks, pd calls, plans for improvement, your own assigned tasks, also need to be learning and looking out for new things, its easy to get into some task and get sucked into it. I often forget something that I know is important to do, and makes me feel I did nothing at all. I know some senior people who handle this with ease, probably comes with experience, I feel I need some method to sort by importance, urgency and could it be ignored. How do I start planning these? I like the easy of planning on apps but doesn't work that well for me, reminders dont always ring on my android and I miss a lot of things, pen and paper is too much and I dont look at it often.

https://redd.it/uu415b
@r_devops

Popularity of serverless

Hi All,

Just wanted to know the latest stuff going on in the field of cloud and devops.

Have any of you migrated any applications with short running workloads to lambda ?

What was your experience ?

Would you recommend other developers to do the same ?

I am starting to explore AWS lambda and the whole shebang from interview perspective.

Just want to focus on what services are actually being used in production

Thanks

https://redd.it/uu44zl
@r_devops

Average Mid Devops Pay?

Good afternoon /r/devops,

&#x200B;

I am a Senior System Administrator with a strong Linux background and transitioning to a Devops role and start interviewing after some more certs/learning some programming/cloud concepts. What is the average pay range for a mid Devops role?

I do not want to really go into a junior role and wondering if others have transitioned from a Senior/Lead role in a different department/specialty ( in legacy systems, VMs etc. ) and went down the Devops route with automation tools.

https://redd.it/uuchd2
@r_devops

Jailer: A tool for database subsetting, schema and data browsing

Jailer is a tool for database subsetting, schema and data browsing.
It creates small slices from your database and lets you navigate through your database following the relationships..
Ideal for creating small samples of test data or for local problem analysis with relevant production data.
https://github.com/Wisser/Jailer


Features

Creates small slices from your productive database and imports the data into your development and test environment (consistent and referentially intact).
Improves database performance by removing and archiving obsolete data without violating integrity.
The Data Browser lets you navigate through your database following the relationships (foreign key-based or user-defined) between tables.
A demo database is included with which you can get a first impression without any configuration effort.

https://redd.it/uuhtsn
@r_devops

Simple bash debugger using trap DEBUG

bash allows to set traps(handlers) not only on signals, but also on some events: ERR EXIT RETURN DEBUG. The last one allows to make a simple debug mode for a bash script.

Blog post: https://selivan.github.io/2022/05/21/bash-debug.html

Simple debugger: https://github.com/selivan/bash-debug

https://redd.it/uulkby
@r_devops

Can I work in DevOps without a college degree?

Hello all,I am currently a flight attendant and wanting to work in IT. Remote work is really attractive to me lately since I’m burnt out from traveling and dealing with passengers.

I live in Miami but found a really good 6 month course in Chicago which guarantees finding a job right after graduating but I am skeptical.

I’d love to hear from your experiences.

https://redd.it/uuotzz
@r_devops

Using bash to compare commits

I am trying to write a bash script to compare git commits. If the commits are different I want to use this to change the branch pointer to start a release automation. I know I can compare with git diff branch1..branch2 but at a lost on how to use the output in a if statement.

https://redd.it/uv026t
@r_devops

Does it make sense to consider consultancy / working for a MSP?

Does it make sense to consider consultancy / working for a MSP?

Looking for some advice whether it makes sense to go into consultancy. 7 years of professional experience. First 3 years dedicated backend dev. After those years, I switch jobs and without knowing I applied for a cloud engineering / devops gig (80% cloud, 20% backend development). Fast forward four years, I’m now working at a medium sized product company as the sole cloud engineer / system administrator.

I’m happy with the ops related side of this gig but far less about the development work. I’m part of a development team and occasionally do both backend and frontend development. Moreover, I’m on support rotation for helping out with application specific issues while barely having any domain knowledge (due to my system administration responsibilities).

I’m growing tired of application development and I’m therefore considering a specialised cloud / devops position. I see four options at the moment:
- Join a large company with dedicated platform teams
- Work for cloud partner consultancy shop
- Work for a cloud Managed Service Provider (MSP)
- Related to the consultancy option: go into contracting

I’m hesitated to go back to a large company again (which was my previous three year long gig). Too much meetings and general lack of technical challenges. I’m considering working for a cloud MSP or consultancy firm. What are some things to consider?

I get the impression that people (at least application developers) always favor a product company over MSP / consultancy but I’m not sure if that’s the case for me. There is often no dedicated ops team in small / medium sized product companies. This means I will work alone (I miss working together with people currently) and I’m obligated to take a more jacks-of-all-trade role.

Another thing that really bugs me but seems to be standard is that there is zero management directions for cloud engineering related work. It really sounds great that you can do whatever you want (I have my own backlog and decide myself what I’m working on) but I sometimes get the feeling that I’m all doing it for nothing because there’s nobody in the company taking any interest in my work. This is why I’m gravitating towards a MSP: a customer wants something instead of me deciding something is necessary.

What’s your take on this? Would it be a mistake to get into consultancy or working for a MSP?

https://redd.it/uv3ysb
@r_devops

Should I apply for techOps engineer position?

Hi,

I will be graduating from software engineering soon, and I've been looking for a devOps position. Problem is no one in my area advertises these positions to graduates.

I found a successful trading company offering intern techOps engineer position. From my understanding techOps is something between sysadmin and devOps, is this correct?

The only devOps thing that the ad mentioned was Linux and bash scripting. So no docker, kubernetes, terraform, cicd etc.

Do you think that this could be a pathway to devOps engineer? Are the skills in techOps transferable to devOps? Does it matter if this is a trading company?

Thank you.

https://redd.it/uv3j31
@r_devops