AWS SA Associate -vs- Professional difficulty

Basically what the title says. For anyone who has taken both, how much more complex is the professional certification in comparison to the associate one?

Given they are both multiple choice, I’m wondering if the difference is that significant.

https://redd.it/e8awpv
@r_devops

Vault Auth methods for Users

Hi folks,

Curious to hear how y'all have provided access to users for vault. We currently don't actively use any of the given UI methods as a company so are looking at implementing a wrapper script around the AWS or Alicloud auth methods for access via CLI since we already have and use these accounts and don't want to manage another set of credentials.

Wondering if anyone else has done the same? Had some trouble with Alicloud, doesn't look like vault has the means to process the credentials if they are user based rather than server based. AWS looks to have better functionality but before I dive in thought I'd see if anyone else had done the same.

https://redd.it/e8b16f
@r_devops

What is LDAP and Why I should use it in my auth system?

Hi folks!

I've tried to set up IdP(Keycloak) and read a lot of materials about it. In every second article or docs, I've met the term **LDAP**. I don't understand how usually it uses in the auth flow. Is this some standard for security access to directories? And how it related to the web auth?

https://redd.it/e89spr
@r_devops

Jenkins inconsistency (files change every time)

I am new to Jenkins and still trying to understand how it actually works.

What I am trying to do is pretty simple. I trigger the build whenever I push it to my Github repo.

Then, I try to \`ssh\` into a server.

My pipeline looks like this:


pipeline {
agent any
stages {
stage('SSH into the server') {
steps {
withCredentials([sshUserPrivateKey(
credentialsId: '<id>',
keyFileVariable: 'KEY_FILE')]) {
sh '''
cd ~/.ssh
ls
cat ${KEY_FILE} > ./deployer_key.key
eval $(ssh-agent -s)
chmod 600 ./deployer_key.key
ssh-add ./deployer_key.key
ssh root@<my-server> ps -a
ssh-agent -k
'''
}
}
}
}
}

It's literally a simple \`ssh\` task

However, I am getting inconsistent results.

When I check the log,

&#x200B;

**Failed Case**

Masking supported pattern matches of $KEY_FILE
[Pipeline] {
[Pipeline] sh
+ cd /bms/home/pdsint/.ssh
+ ls
authorized_keys
known_hosts
known_hosts.old
+ cat ****
++ ssh-agent -s
+ eval 'SSH_AUTH_SOCK=/tmp/ssh-hb6yX48CJPQA/agent.51702;' export 'SSH_AUTH_SOCK;' 'SSH_AGENT_PID=51703;' export 'SSH_AGENT_PID;' echo Agent pid '51703;'
++ SSH_AUTH_SOCK=/tmp/ssh-hb6yX48CJPQA/agent.51702
++ export SSH_AUTH_SOCK
++ SSH_AGENT_PID=51703
++ export SSH_AGENT_PID
++ echo Agent pid 51703
Agent pid 51703
+ chmod 600 ./deployer_key.key
+ ssh-add ./deployer_key.key
Identity added: ./deployer_key.key (./deployer_key.key)
+ ssh root@<my-server> docker ps -a
Host key verification failed.

When I \`ls\` inside the \`.ssh\` directory, it has those files.

In the success case,

&#x200B;

**Success Case**

+ cd /bms/home/pdsint/.ssh
+ ls
authorized_keys
authorized_keys.bak <----------
known_hosts
known_hosts.old
+ cat ****
++ ssh-agent -s
+ eval 'SSH_AUTH_SOCK=/tmp/ssh-yDNVe51565/agent.51565;' export 'SSH_AUTH_SOCK;' 'SSH_AGENT_PID=51566;' export 'SSH_AGENT_PID;' echo Agent pid '51566;'
++ SSH_AUTH_SOCK=/tmp/ssh-yDNVe51565/agent.51565
++ export SSH_AUTH_SOCK
++ SSH_AGENT_PID=51566
++ export SSH_AGENT_PID
++ echo Agent pid 51566
Agent pid 51566
+ chmod 600 ./deployer_key.key
+ ssh-add ./deployer_key.key
Identity added: ./deployer_key.key (./deployer_key.key)
+ ssh root@<my-server> docker ps -a
Warning: Permanently added '<my-server>' (RSA) to the list of known hosts.

It has the \`authorized\_keys.bak\` file.

I don't really think that file makes the difference, but all success logs have that file while all failure logs do not. Also, I really don't get why each build has different files in it. Aren't they supposed to be independent of each other? Isn't that the point of Jenkins (trying to build/test/deploy in a new environment)?

Any help would be appreciated. Thanks.

https://redd.it/e8f45q
@r_devops

How does Spotify get millions of songs and info about those songs from record labels into their storage system???

As a bit of a test I am trying to create a beta version of a music streaming app but then the question it hit me, how did Spotify upload millions of information about the songs (Like Artists and Song names) into their database along with the songs files themselves???

https://redd.it/e8gks7
@r_devops

Do we have to stop docker-compose every time we update the docker images that we are using?

I am trying to use a script to automate pulling docker images from my docker hub and then use \`docker-compose up\` to put my server up (I don't need to \`docker-compose build\` again since I'm using images).

One thing that I wasn't able to find the answer online is, do I have to stop docker-compose every time whenever I re-up the server with the updated images with new tags?

What I do right now is:

services:
frontend:
container_name: frontend
image: "dockerhub_url/...:tag"
ports:
- "80:80"

in my docker-compose.yml but when I change the tag to the recent one, not sure if I have to stop the docker-compose then put it up again.

Thanks in advance!

https://redd.it/e8i4qn
@r_devops

Does having a CDN such as AWS built with my website/App makes Music or video streaming faster and more reactive?

So I am currently working on a beta music and music video streaming app using the flutter framework but I realized that each time I try to skip to a next song, it takes some time to load before the next song plays. In order to solve this issue do you think that a CDN server will be able to help so that as soon as I skip to the other song it will play instantly or a bit faster?

https://redd.it/e8jauf
@r_devops

Intern looking for some test proxy server advice

Hey guys, first timer here so correct me if I am doing anything wrong.

I am currently an intern at a Software company and they have recently asked me to take on a new project. I need to build a test proxy server that will run against one of our micro services. I am currently in the Crawl segment of my research and just hoping to get some advice or some interesting reading/viewing material that could help me get a better understanding to what I am trying to accomplish. Everything helps and I greatly appreciate any help y'all are willing to offer.

https://redd.it/e8eqm1
@r_devops

[AWS] sending a notification from account X to an SNS topic in account Y.

Hey. I'm trying to send a notification to an SNS topic that is in a different account and region than the one I'm sending it from, but when it comes time to choose the topic, it can't seem to access the topic that exists in the other account. Can anyone share some links to help me out with relevant reading?

&#x200B;

If I put in the ARN in "send notification to..." when creating an alarm, it tells me:

"This IAM user does not have permission to access the SNS topics and subscriptions for this account."

&#x200B;

Thanks!

https://redd.it/e8ci16
@r_devops

No More Youtube Ads + More with Clutch Chrome Extension

[https://chrome.google.com/webstore/detail/smuuvr/emfncmdgioneiofbidgfafcekldnfbld?hl=en-US](https://chrome.google.com/webstore/detail/smuuvr/emfncmdgioneiofbidgfafcekldnfbld?hl=en-US)

https://redd.it/e8mrre
@r_devops

What if we deploy on Friday?

Monday or Friday, how does it matter?

If the team is terrified to deploy on Fridays, that just seems like the team is not yet ready and is not confident enough with its DevOps capabilities. It means the firm's DevOps initiatives are not matured enough.

DevOps is (it's a culture, I know) about failing fast and learning fast, so you get the first-mover advantage, just like the initial companies who dared and used Docker and Kubernetes in production are the ones that are reaping enormous benefits today. Isn't it?

But my question is, how does it matter whether it is a Monday, Tuesday or Friday to deploy?

I think that the Deployment distribution graph is an interesting way of measuring your level of DevOps maturity. If you aren't on this level yet, try to get there.

BTW, you don't say you are doing DevOps just because you are using Jenkins. It is about consistency and matured CI, CD pipelines in place. A complete culture setup for dev and ops with a great collaboration mindset.

Note: CD has two different meanings, continuous delivery and continuous deployment.

Correct me if I am wrong:)

https://redd.it/e8m0wn
@r_devops

A tool prompts me for a token as input. Can I make Ansible automatically give the prompt the required input?

In the playbook i execute a tool...the tool says "enter token to use" I usually just paste the token in manually. Can I make ansible do this for me? To my knowledge I don't think I can feed the tool a text file as input.

https://redd.it/e8jve3
@r_devops

Windows deployment & IAC

Hello everyone,

In my current company, we deploy baremetal servers and VMs (immutable), all in on-premise and on Windows.

We used WDS/MDT/GPO for OS deployment & configuration.

And difficult to have a full overview of the configuration, as it's done with few software..

So since few weeks, I checked what will be the best way to move to IaC.

First we have Jenkins/Gitlab servers in production (Just in case...).

My goal is:

\- Store all the OS configuration/Postinstall scripts in Gitlab.

\- During OS deployment, load all the configuration from Gitlab (Pull).

\- Stop with the multitude of Windows WIM files.

\- Be able to launch unit tests from Jenkins (based on what we do during post installation)

\- Use the same WIM file to deploy VM & Bare metal servers.

\- Stop with PXE (iPXE, UEFI http boot, ...), too slow and not secure.

\- On-click deployment: Technician select the OS & project to deploy (IIS server, ...)

Problem:

I read tons of documentations, reddit posts, etc...

But difficult to find the best way to do what I want.

DSC seems to be a good product (embedded), but end of life if I have understood.

Ansible only support push mode.

[Glazier](https://github.com/google/glazier) another candidate, boot on a WinPE and deploy server from a source control, but not a lot of docs found.

[Setupcomplete.cmd](https://technet.microsoft.com/en-us/windows/dn898472(v=vs.60)): I can maybe load a PS script that will download configuration scripts from Gitlab and run it.

Other: Packer from Hashicorp, BoxStarter, ...

On your side, what do you use to provision Windows on On-premise server (VM & Bare-metal) ?

Thanks for your feedback :)

https://redd.it/e8fmrw
@r_devops

AWS security, compliance + efficiency



Trend Micro recently acquired the ability to scan, report on, and auto correct (if so desired) cloud accounts against both the “Amazon Well Architected Framework” and “NIST 800-53”. In just a few clicks, you can have complete visibility across your cloud workloads and we can help you stay compliant in an ongoing manual and/or automated fashion.

**A demo of our new cloud configuration solution, Cloud Conformity, takes under 30 minutes. Anyone interested in a call next week?**

https://redd.it/e8fagx
@r_devops

Vault OSS - Backups?

Just trying to get my head round deploying vault and getting some form of DR in place. We have 3 nodes in 3 AZs and three Consul nodes providing backing. From my understanding Consul provides a snapshot capability that we can use to snapshot the storage for a point in time of the store. Reading around some of the mailing lists I can see that there is a discussion that restoring from a storage backup may lead to vault being in an inconsistent state.

I am struggling to get my head around the process for recovering from a total vault/consul outage - essentially an etch-a-sketch end of the world where we no longer have vault nodes or consul nodes. Would it be a case of spinning out new clusters of each and then restoring the consul snapshot to the consul nodes? I feel that there is sufficient HA to cover the majority of failures but would feel happier if I knew we could recover the whole thing if needed. Or is it that the key/value store is not that important to recover as vault can regenerate but the policies we wrote on the vault server are more critical to recover?

https://redd.it/e8ptyk
@r_devops

How are you supposed to provision RDS when using Elastic Beanstalk & Terraform?

I'm setting up a Rails app with Elastic Beanstalk & Terraform.

The app requires some initialization in the database, some seeding & such.

I don't understand how i am actually supposed to do this.

- There is apparently no way to specify container_commands through Terraform.

- I was thinking of running a local_exec provisioner & importing a `.sql` file, but that would require the database to be exposed publicly or having some kind of bastion ec2 instance which seems overly complicated.

- There might be a way to use a launch script, but i dont know how you are supposed to tell it to only run on the initial deploy & on one machine.

Should i just not use Beanstalk? This seems like a very trivial problem and i cannot find any info on solving this.

https://redd.it/e8e2pb
@r_devops

What role does Enterprise Architecture play in your DevOps team / organisation ?

What role does EA (Enterprise Architecture) play in your DevOps team or organization? It's a hot take for some time now that EA might be redundant as design can be done by teams themselves, or that they should provide some guidelines based on money / business requirements.
However in other organizations they still have an iron grip on every piece of design and using Architecture documents enforce old fashioned standards on teams.
Some try to create more deliverable architecture, use documentation in code and provide shield for audits to have a broader relevance in DevOps.

In any case, the field is changing and different approaches to it are taken. I was curious to hear about your opinion and / or your organizations stance.

https://redd.it/e8srtj
@r_devops

Is anyone using eBPF for monitoring?

Did some research the past few weeks on monitoring startups using eBPF (link below).

Outside of a few large tech companies (Facebook and Netflix in particular) and some startups building products *using* eBFP, is anyone using actually using it for system, network, or application monitoring? If so, what has your experience been like?

My post on startups using it + some background:

[https://monitoring2.substack.com/p/ebpf-a-new-bff-for-observability](https://monitoring2.substack.com/p/ebpf-a-new-bff-for-observability)

https://redd.it/e8tqu7
@r_devops

Would Love Some Help Translating This IBM Listing

I've been deep in Python for a while now, and I'm growing more confident in my abilities to code, but I know I'm still a beginner. I've been trolling around the internet looking for good entry-level jobs where I could get both experience in the field and some professional mentoring from seasoned programmers. This lead me to IBM, where I found half a dozen entry-level openings for devs and enigneers. One of them is a DevOps position located here:
[https://careers.ibm.com/ShowJob/Id/717577/Entry-Level-DevOps-Developer-Engineer/?lang=en](https://careers.ibm.com/ShowJob/Id/717577/Entry-Level-DevOps-Developer-Engineer/?lang=en)

Now, I have no CS degree or prior experience, but I'm learning a lot on my own, have a reference inside IBM, and am **thirsty** for a position in this field and will do the legwork to get there.

To you, the experienced members of r/devops, what would you say are good things a candidate for this position should be able to do. It's a bit vague in some areas, like the "You are great at solving problems" part, but I'd like to know how to focus my study. Thank you.

https://redd.it/e8usgo
@r_devops

Jira/Atlassian documentation is insane

Please tell me im not the only one going insane trying to comprehend the atlassian documentation on jira development? I would would regard myself as a competent developer but it cant just be me finding the docs hard to read and understand, it reals like its been written by an inifinite amount of monkeys!

has anyone worked on jira before, written any react apps or extended the base code with java. We are looking to invest time and resources into building an application for our business to use daily im wondering is it worth it, the documentation is putting me off and giving me red flags, should I beware of using jira?

https://redd.it/e8qdw4
@r_devops

Best options to monitor Nginx

Just wondering what people are using to monitor/graph Nginx web servers. I have A grafana/prometheus setup already in use for other metrics so I'm learning toward using one of the Nginx prometheus exporters, I see two on their official exporters page Nginx metric library and Nginx VTS exporter (not sure what the difference between the two is yet or which is better). Then there are other options such as collectd/telegraph etc. I assume using a prometheus exporter may be the best route?

https://redd.it/e8slbe
@r_devops