Using AWS CLI with Google apps Saml login

Hey guys.
In my organization users are logging in via Gsuite with Saml.

Therefore they don't have access key and so on.


How can they Access aws CLI easily?


Please assist.

https://redd.it/lmsixp
@r_devops

Integrating github Actions with gopaddle for a seamless CI/CD on Kubernetes

Continuous Integration (CI) and Rolling Update to a kubernetes service can be achieved seamlessly when using gopaddle Deck and Propeller together. However, in some scenarios, you may choose to use a different tool/platform in place of Deck to build the docker images and use Propeller deploying and managing the applications. For example, you may choose to use github Actions and then integrate with Propeller for rolling updates. Read more to know how to use github actions with gopaddle for a seamless CI/CD on kubernetes. #kubernetes #docker #github #devops #cloud #azure #microservices https://blog.gopaddle.io/2021/02/18/integrating-github-actions-with-gopaddle-for-a-seamless-ci-cd-on-kubernetes/

https://redd.it/lmsa7t
@r_devops

Discas de DEV

Boa tarde!

Qual e o básico que tenho que aprender para entrar no mercado de trabalho ? Atualmente estou estudando Python e um banco de dados. (Estou caminhando galera, todas as dicas e opiniões construtivas serão muito bem vindas)

https://redd.it/lmqh1h
@r_devops

Choose Life - Choose Terraform Enterprise

Was at a client site this week and caught this printed out on the wall.

* [Terraspotting](https://imgur.com/a/whjnoUi)

https://redd.it/lmepu3
@r_devops

Need ideas for end-of-studies project

I just started my end-of-studies internship a couple of days ago. Due to timing, I had to accept a project that I'm not very convinced of. The project consists of finding a solution to analyse and monitor logs (network equipment, mostly Cisco).

The steps that have been given to me are gathering the data (logs), creating a database to store the logs and creating/implementing a monitoring/analysis tool that includes dashboards and KPIs.

The project is not very well guided so I have to figure out everything on my own.

The first solution that I thought would work is using Elastic Stack, but I found that it would be way too simple or even too mundane as an end-of-studies project.

I've always wanted to work with DevOps tools or DevOps methods (CI/CD pipelines, containers, virtualization...) and on something cloud-based but that won't be possible due to the fact that the company's architecture doesn't include anything cloud-based.

What I'm looking for are ideas that would help me include any tools or methods used in DevOps (or any other idea) to help me make my project more interesting.

Any proposition is welcome. Thank you in advance.

https://redd.it/lmna4s
@r_devops

Less is one of my favourite "invisible" CLI tools, what are yours?

Tacit knowledge is sometimes hard to appreciate or even notice. A few days ago, I realized how often I use less for all kinds of things, and how many little tricks I've internalized over the years around it.

I'm curious - what's a very useful, but almost invisible tool in your CLI toolbelt. One you hardly notice, but without which your days would be a lot more toilsome?


Very curious to learn!

https://redd.it/lmhb4m
@r_devops

Nextjs10 & Serverless Framework

Working on a boiler plate project for serverless framework & NextJs10.

This seems to be the latest plugin: https://github.com/serverless-nextjs/serverless-next.js

I don't seem to be getting anywhere following this simple guide.

Does anyone have any advice or material I could use to get off the ground with this please?

https://redd.it/lmk7y6
@r_devops

Asking for a pay rise - new in devops

Sorry if this is the wrong place to post this but I'm looking to get help in asking for a promotion/payrise.

I've been a Windows engineer in a devops role since Jan 2020, since then I've learnt to use Linux, azure, aws, salt, terraform, git, powershell scripting (it's been a busy year). In that time I've gained my Azure fundamentals and completed courses is salt and terraform.

Job at the moment - extremely stressful, we work in a high pressure environment where we have to deploy alot of infrastructure in not alot of time and complete ad hoc tasks where needed, we have had 3 experienceed members leave meaning newbie like me has had to step up and now become a SME in one of our products.

I'm deffo on the low band on the pay scale for dev ops (26k) and with how busy we've gotton and the strides made over the last year, I want to approach my boss and ask for a (I think) well earned bump.

I have an idea in how to approach this, list my contributions and improvement over the year, accreditations ect, also I was thinking of showing a list of jobs available in the area as another good reason I should be bumped.

Any advice would be greatly appreciated!

https://redd.it/lmjvv5
@r_devops

Prevent user login before mount is complete

All our workstations are Ubuntu 18. The `/home/` is a network mount (nas). This is how it looks in `/etc/fstab`:

nas:/mnt/export/home /home nfs nfsvers=3,_netdev 0 0


The problem is: when users boot their computer, they login before `fstab` is able to mount `/home/` which messes up their desktops and settings.

If it matters, the `/etc/fstab` file is being managed by puppet, along with everything else on workstations.

My question is, how can I prevent users from logging in before the `/home/` mount is complete? In other words, how can I make it so users would be able to login ONLY after the `/home/` mount is complete?

Thanks ahead!

https://redd.it/lmiooq
@r_devops

VMware Tanzu Kubernetes

Can someone please explain in simple terms what "VMware Tanzu Kubernetes" actually is? Is it just a Kubernetes cluster running on VMware VMs? If so, why would anyone needed it? Can't you just build/buy a Kubernetes cluster which is not VMWare Tanzu and get exactly the same functionality?

https://redd.it/lmidme
@r_devops

What does those stickers mean?

Hello Reddit! About a mount ago I bought some "programming stickers" from Ali Express, and they finally arrived. While searching trough them I found those and I don't know what do they mean. Could you help me find out?
Here's the photo: Photos (gyazo.com)

https://redd.it/lncatd
@r_devops

Tools for experiment tracking, dataset management, and visualization

Hi!

I am looking for good solution set for the following tasks:

1. An experiment management tool to set experiment configs and save experiment logs. I came across sacred, and it seems to be suitable for me. Multiple different logs will be generated for one experiment, with different structures, and entries, on different machines.

2. All data generated in each experiment should then be collected centrally in a DB

3. A web-based tool to access those datasets in detail and experiment configurations.

4. Explore and visualize some metrics stored from the logs, mostly as time-series

I am not talking here about typical ML experiments and datasets. I have more networking and computing tests in minds, so not sure if dedicated tools from ML community like MLFlow, or similar can be suitable.

I started to work with ELK stack, seems to be great for logs indexing and visualizing, but not 100% sure how to deal best with dataset and experiment management. Any tips or alternatives?

https://redd.it/lmhhhi
@r_devops

HashiCorp packer cannot be installed on Macbook M1

I recently decided to invest on a laptop and dedicate it on development and devops stuff..

I thought it would be a good idea to get the new Macbook M1 pro.. It could be a mistake..

I tried installing Packer through brew and it does not find a bottle.. at first I was hoping it was an issue related to Big Sur but then I realised it works just fine in all of my other macbooks that have an Intel cpu.

Has anyone had the same issue and managed to solve it ?

Thanks!

https://redd.it/lm3g6e
@r_devops

Web app security bugs, who's responsibility to test and alert?

Hi, found a relatively simple bug in a shop I'm using, and as an OPS/SEC guy I went down the rabbit hole and shared it with the shop.
Tried to make a story out of it and would love any kind of feedback from professionals:
https://dev.to/omerxx/hacking-your-application-may-be-easier-than-you-think-4g4c

Was wondering what kind of checks (or whether at all) devops engineers are running against the systems in their domain?

Is that the developer's responsibility or dev"sec"ops ?

https://redd.it/llpt6e
@r_devops

What open-source tools to use to create easily sharable and deployable configured VMs with custom software installed?

I need to create sharable IaC configs for Windows and Linux VMs that will: install the OS, configure them, and install custom software on them. I'm looking for a way to do this in a easily sharable manner such as Dockerfile/Vagrantfile where a client can download the script/config, maybe tweak the software installed, run it, and have it deployed as a VM locally.

Should I just go with Vagrant or do I look at other tools like Packer, Terraform, or Ansible?

https://redd.it/llmfkh
@r_devops

Seamless Deployment to External Linux? (not hosted on AWS or gcloud)

I'm a dev making a golang/python application that needs to be deployed to a server I'm renting.

The server is a regular VPS ubuntu machine and not part of AWS/google cloud. I have worked at several companies that had their devops set up such that once their circleCI/gitlab pipeline completes, a new image with the changes is automatically built and deployed. All the developer had to do was push, and several minutes later the changes would appear on production.

What is the process for deploying to any server of your choice? would I upload the image to dockerhub and then pull it on my rented server? wouldn't have to log into the server to do that step?

I'm fairly new to devops, and have no experience deploying my code to docker environments. Are there tools that help make this process more seamless? I'd be looking for a setup where I could commit to github/gitlab and the code would be deployed on my server automatically once the pipeline completes.

Code is currently on github but I have no attachment to circleCI and would be happy to use other tools.

https://redd.it/ll9iru
@r_devops

Using liquibase-percona on kubernetes migration (via job)

Hey all.

we're using RDS MySQL

We want to have smooth migrations without locking tables, so we can avoid downtimes.

Any guide on how to use liquibase-percona in kubernetes job?

please assist.

https://redd.it/ll130a
@r_devops

How to build complex Well-Architected serverless infrastructures?

Article covers:

\- How and why did the AWS Well-Architected Framework come to be?

\- Why should you even care about it?

\- Well-Architected serverless lense

\- Design principles

\- Challenges and solutions for serverless teams

https://dashbird.io/blog/building-complex-well-architected-serverless-architectures/

https://redd.it/lnldck
@r_devops

Salary range for DevOps Engineer at Netherlands

Hi Team,

Just wanted to get a figure on the average salary for devops engineer at Netherlands, for below experience and skillset.

Experience - 10 years in release engineering and devops together
Skillset - AWS, Azure,Docker, Kubernetes, Terraform, Prometheus, Grafana, Jenkins, Azure Devops, GitHub, GitLab, Nodejs, Python,.NET, IoT platform services


Any pointers will be much appreciated. Thanks much!

https://redd.it/ll0bvg
@r_devops

Should Dev Rels ever report to marketing teams?

I've been looking for an evangelist for months and I'm struggling. I find great people but many are not a good fit because

* Our product is used by dev teams internally to work together better (not by developers to build things) which is different for most dev rels
* The role reports to the VP of Marketing (me) because the primary goal of the role is to grow awareness of our company through speaking and writing and to manage our Discord community (which marketing maintains) and they candidates don't want to work in marketing
* The candidates are good at helping devs build things but aren't great at writing and speaking

I need help! Can you look at this job description and tell me if the title is wrong or if I'm doing something else wrong. Thank you :-)

We are a hot start-up (11X growth last year), just closed series-A (not announced yet) and we have 1,000+ dev teams that LOVE our product. Just need to find someone with credibility to help get the word out.

[https://www.linkedin.com/jobs/view/2380356863/](https://www.linkedin.com/jobs/view/2380356863/)

https://redd.it/lno17j
@r_devops

I'm working on a software production risk model. Will it work in its current form?

The concept behind the model came about from thrashing on the burning question, "How do we deliver software with less production risk?".

There's already a baseline of teams working on production matters. But we want to develop an easier path to continuous improvement and resilient operations.

**So I broke production risk down into 4 sections**

These are reliability, availability, security and quality (RASQ).

Each section has a series of activities that offer a proactive approach. Here's an example for each section:

* Reliability - chaos engineering
* Availability - autoscaler config
* Security - threat modelling
* Quality - code review system

Nothing controversial yet, right?

**Now, how do we get better outcomes in these areas?**

Here's an idea that may spark up a *"Hmm, are you sure about this?"* response...

**Involve software engineers in the production risk culture.**

Yes, you heard me right. ¿Loco, no?

Here's the thing: [Google's DevOps culture expounds "risk-sharing"](https://cloud.google.com/solutions/devops/devops-culture-westrum-organizational-culture#how_to_implement_organizational_culture:~:text=Share%20risks.%20Along%20with%20this%2C%20encourage,right%20tool%20choice%2C%20can%20enable%20collaboration) as a virtue. I'd like to push this concept a smidge further. Have specialists run each section - perhaps SREs/DevOps for reliability, Infra for availability, AppSec for security and senior SWEs for Quality. Depends. SWEs could serve tours of duty throughout the risk space - [job rotation in a technical sense](https://arxiv.org/abs/1906.05365).

**Now, why would we want to get SWEs involved?**

1. Give SWEs an appreciation of what it takes to keep their code running
2. Pipeline our next lot of ultra-skilled Ops talent with coding backgrounds - I've heard from some SWEs keen on SRE but getting rejected due to lack of experience.
3. Ensure resilience - if someone goes on vacation or leaves and your Ops people are already hands-full, why not let a SWE take on some ops work with confidence?

Note: involving SWEs is not 100% necessary, especially if it makes for hostile manager negotiations. But it's worth considering for experimentation especially since we are not all hyperscale businesses and some of us crave polymath talent.

We could just run this RASQ model with Ops people alone.

**Even if SWEs don't get involved, it still would work**

You could keep this in-house as a single view of what typically becomes run by factions.

The key is to build resilience. I've seen before that great production systems often happen because of consistent teams. Hotshot APM expert leaves? No problem, you've had some people rotate through the APM post, so you'll know how each of them did. Put on the best one until you get another hotshot.

**Some principles to go by:**

* Assign activities but also let people self-select into work they are interested in
* Give the contributors constructive feedback - have scaffolds to prevent criticism or gushing
* Let anyone share something that learned fast "today's actions = tomorrow's lessons"
* Rotate gently - more frequently than once or twice a quarter can be jarring

**How could we make all this easier to manage?**

We could block out a huge wall for planning on this model, but it might get stale after a while. So why not use our software abilities and make a digital operations canvas? Maybe open-source it.

**So what benefit/s would a digital view of the model give?**

The first benefit would be that we could move contributors around a lot faster. The second benefit that we could automatically collect stats on who's doing well and where.

We could:

* employ microlearning techniques to share new technical ideas in the context of activities
* allow for senior staff and leaders to provide continuous, constructive feedback
* add runbooks directly linked to the activities if there is a demand for this

Ultimately, we will be able to strengthen our production muscles. What do you think?

I await your