Reddit DevOps
269 subscribers
4 photos
31K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
Has anyone found success in switching to a night role?

Generally, this question is rooted in a lifelong struggle with ADHD but for a long time (years) I've avoided the reality that I can work much better at night, focus better at night, have zero need for medication at night or live with the anxiety and guilt of struggling through each day in the workplace. I believe this may be a better solution than getting back on stimulants, I can't put my body through that anymore.


My question is, has anyone out there had this realization and switched to night hours or found a role fitting that description in the wild and if you did make that switch, did you find that it worked for you? Any unexpected tradeoffs? I can think of a few that might come up with communicating with daytime hour teams or mandatory early meetings when they happen, etc.


Typically I don't see this in job postings but people in this sub are probably used to working with staggered team schedules/international teams in different time zones anyway.


Thanks for humoring my question.

https://redd.it/ni7xw5
@r_devops
MidLevel DevOps Engineer Interviewing Sr DevOps Engineer

I work at a large company, and my manager asked me to conduct the “team member interview” portion of the hiring pipeline.

I’m a MidLevel DevOps Engineer with 2 - 3 years xp and will be interviewing an applicant with 6 years xp. I’m conducting the interview for our sister team, and am familiar with their tech stack, but am not sure how to “interview up” as I’ve only ever interviewed interns and seasonals (college job, not tech).

Any Sr engineers or up-interviewers have advice?

Thanks guys!

PS: Love this subreddit

https://redd.it/ni33gl
@r_devops
Gitlab-CI: Passing version from one stage to the next

I'm running into a bit of an issue which I'm not sure I'm solving in the right way. This is for a personal project, basically to continue learning things about gitlab-ci, etc...

​

What I am trying to achieve is:

1. Commits pushed to master
2. Gitlab CI runs on master and runs tests, lint, whatever
3. If tests pass, CI stage runs an automatic version: release-it, semantic-release, etc, bumps the version number and creates a commit with the updated package.json and CHANGELOG.md
4. The new version is then packaged into a docker image (tagged with new version, sentry release created with new version).
5. New docker image is pushed to deployment.

Problem being that the commit made in step 3, is not reflected in steps 4 and 5.

e.g.

Software is at 1.0.0 and I make some changes and run the pipeline. Step 3 runs and says, "cool, we can make this into 1.0.1 " and makes a commit back to the repo.

Steps 4 and 5 run and bundle the software and deploy it, which still shows 1.0.0 on the front end, with the version from package.json and without the updated CHANGELOG.md which was created/updated during the pipeline.

I hope that makes sense, and I'm totally unsure if I'm approaching this the right way. Basically I want the pipeline to create the next version of the software and release it.

I've found a bunch of stuff on automatic semantic versioning, but noting about carrying the new version forward through the pipeline.

https://redd.it/nhyxq5
@r_devops
Question about nip.io and including port number in ip address

Hi, I'm relatively inexperienced in this area. I have a machine with an external ip address from gcp. I want to create an oauth app (say google oauth) but they do not accept an ip address as it is not a "valid url". I did some digging and learned about nip.io, which I assume is just a service that forwards requests from xyz.nip.io to xyz , xyz being the ip address.

Now, I write wep apps that listen to a certain port (say 2021) and receive requests there. So I would usually do 11.123.12.12:2021 to go to say the index of my web app. But, I don't know how to specify that with nip.io. Should I do 11.123.12.12.nip.io:2033 say? Or, maybe 11.123.12.12.nip.io works and some default port receives the request on the gcp machine (I did some googling to no avail).

I'm hoping someone can provide insight on this (I'm a newbie so if possible simplified terms would be great), and if my understanding of using nip.io in this situations works. I hope this question is ok here!

https://redd.it/nhyj5n
@r_devops
Github integration with teleport

Hi,

I have configured teleport with github as the oauth provider. I am able to login via the Web ui and tsh. I get the admin role which I had configured while setting up github oauth.

The problem is I am getting the username of the profile I logged into in the node connection user list. The username normally dosen't exists.

How should I setup github oauth such that the logins defined in a role are given to the user signing in via github. Normal username and password authentication gives the correct login list for all the nodes.

Any help will be appreciated. Thank you.

https://redd.it/nhxyzc
@r_devops
Will this CI/CD pipeline work out?

Hi all,

I‘m a Junior Dev and try to come up with an idea how my company (very small) could make use of a CI/CD pipeline to streamline some processes which are still done manually.
This is just a idea without any details, would be grateful if you point out what I‘m missing.

3 Stages: Dev, Test, Production
3 Branches: feature, develop, master

1. Every Push to any feature branch triggers build, unit/integration tests and code analysis
2. After merging feature -> develop
a. Build docker image
b. Deployment to Dev stage
c. Extended automated tests
d. If passed, deployment to Test stage
3. Optionally manual tests on Test stage or customer review
4. Trigger deployment to Production stage, merge develop -> master branch


Thanks, any feedback is highly appreciated.

https://redd.it/nhx0xp
@r_devops
IaaC and secrets

How do you guys handle your secrets (service passwords/tokens) as a code? We wanted our secrets to live in source control (encrypted with git-crypt) and be written to some secrets storage, like vault or AWS SSM, with Terraform. However, since we've been using Terraform Cloud, we couldn't get git-crypted files decrypted on Terraform Cloud side. My colleague is working on Terraform provider for reading git-crypted files. If it works out, we are going to have our secrets under source control being managed by Terraform. It's going to remain decrypted in TF state, but we are ok with that since Terraform Cloud keeps it securely. I expect it to work well but I'm wondering if there are any other ways to achieve managing secrets under VCS in a secure way. Can you guys share your experience?

https://redd.it/nhuhdx
@r_devops
Prometheus Metrics Push/Pull Relay?

I was wondering how you folks set up Prometheus scraping for endpoints that don't have inbound traffic enabled.

I am thinking of a use case such as servers running on-site, but running Prom/Grafana in AWS. Or maybe IoT devices deployed in remote locations, or just don't have web servers running.

Is there any sort of Prometheus relay that an endpoint can push metrics to, which will expose those same metrics for Prometheus to pull from? I believe Telegraf can do this, but I'm sure there are other methods, no?

https://redd.it/nhrnnp
@r_devops
Passing and creating metrics in Prometheus using Postgres queries

HelloI want to create metrics which I got from Postgres db.So far the metrics appear in Prometheus using this query-exporterThe problem is that both metrics are big integers in Postgres so the values which i`ve got are not the real ones for some reason..This is a code sample for my queries

databases:
db1:
dsn: postgres://........

metrics:
delay:
type: histogram
description: A sample gauge
id:
type: histogram
description: A sample summaryqueries:
query1:
interval: 5s
databases: [db1]
metrics: [delay, id]
sql: SELECT delay AS delay, id as id from table

These are metrics got from prometheus

id_bucket{container="prom-postgres-monitor", database="db1", endpoint="http", instance="0.0.0.0:9560", job="prom-postgres-monitor", le="+Inf", namespace="dev", pod="prom-postgres-monitor-g3g43g34g3g", service="prom-postgres-monitor"} 6141id_bucket{container="prom-postgres-monitor", database="db1", endpoint="http", instance="0.0.0.0:9560", job="prom-postgres-monitor", le="0.005", namespace="dev", pod="prom-postgres-monitor-g3g43g34g3g", service="prom-postgres-monitor"} 0id_bucket{container="prom-postgres-monitor", database="db1", endpoint="http", instance="0.0.0.0:9560", job="prom-postgres-monitor", le="0.005", namespace="dev", pod="prom-postgres-monitor-g3g43g34g3g", service="prom-postgres-monitor"} 0id_bucket{container="prom-postgres-monitor", database="db1", endpoint="http", instance="0.0.0.0:9560", job="prom-postgres-monitor", le="0.005", namespace="dev", pod="prom-postgres-monitor-g3g43g34g3g", service="prom-postgres-monitor"} 0

Most of them are zeros but some real values which i have in postgres are - 10024958860, 10027398870, 10027401148 etc..

What metric option should i use to get some real data - enum, histogram, summary etc..

Also does it matter what is the data type which i have in postgres - for example as i said now is big integer and i`m not shure if Prometheus is ok with this values ?

https://redd.it/nikmlq
@r_devops
Simple Bitrise build dashboard

My writeup on simple bitrise build dashboard that can visualise all the branches with its buld statuses. You can see your colleague’s or dependent branch status in a single web page.

https://link.medium.com/zLevB0MWsgb

https://redd.it/nihlx7
@r_devops
Progressively Build an Optimized Docker Image for React Projects

Hi everyone, I'm following up on the series of building Dockerfiles, now with React:

https://www.codingholygrail.com/build-docker-image-for-react-projects

Hope you enjoy and as always please provide me with feedback how you 're deploying React on your container clusters.

ps. I know the vast majority of react apps are being deployed in CDNs and other cloud providers (Vercel, Netlify). If you're using Docker what more steps do you take?

https://redd.it/nid6sk
@r_devops
How do I know if a devOps/SRE career is right for me?

Topic. I am a new grad with a Masters in CS and trying to evaluate my career options. One thing I have been considering for a while is going into devOps/SRE as I'm pretty sure I enjoy working with systems instead of just strictly writing code all day. I am trying to figure out the pros and cons of being in the devOps/SRE space as opposed to just being a SWE, system engineer, or even a security role such as security analyst. Could anyone elaborate on this or point me in the right direction? It would be much appreciated.

https://redd.it/nig1lu
@r_devops
Python Parallel Workflow/Dataflow Framework

Want an easy and powerful python framework for writing parallel devops workflows using just "plain old python"? Have a look at my framework! :)
https://github.com/radiantone/entangle

https://redd.it/niuna3
@r_devops
Best way to run 100+ concurrent jobs on K8s over and over, CI or Parallel processing?

Hi,

Most CI tools are "triggering a workflow, job X then job Y then deploy, integration with many repositories" etc but I feel running 100+ concurrent jobs is more like a parallel processing problem than a CI one.

All the jobs are a single docker image (with sidecar) getting different environment variables at each run.

Kubernetes Job type works but it requires a different job.yaml file for each changed variable and when the jobs finish they need to be cleaned up before resubmitting or new jobs need to be renamed.

I feel there must be a cleaner way to do this.

Thoughts on Jenkins X? Argo Workflow? Tekton CI/CD?Some parallel processing tools on Kubernetes? Just `kubectl run` ? A better way?

Thank you!

https://redd.it/nidvdz
@r_devops
gitlab many projects on one boards

Its posible to create board with tasks from many projects?

https://redd.it/niqwsk
@r_devops
More than monitoring

I don’t want to give my position quite yet but, thoughts on Dynatrace? Pros & cons?

https://redd.it/niq36e
@r_devops
DevOps best practice cheat sheet?

Is there some DevOps best practice cheat sheets available for Software Engineers? Example, not deploying on a Friday before weekend, Keeping Monday reserved for troubleshooting issues generated over the weekend etc.

https://redd.it/nj7xan
@r_devops
Difference between modern dev-op tools Ansible / Vagrant / Packer ...

I'm a developer with almost no background in modern automated dev-op tools. I've been reading on what these tools are about and would greatly appreciate if someone can elaborate by examples why why and when we may need these separate tools?

From how I understand it, Ansible and Vagrant sound almost the same. They both configure and manage VMs.

For Packer, it's not clear to me why we may need this as well. My question is more alluding to why can't we just use Ansible completely to bring about the changes we need on top of a VM? If we use something like Packer, where do we draw the line as to how much should be included in the VM image vs how much Ansible should do with the VM image afterwards?

https://redd.it/njjr6t
@r_devops
tOOLING TIPS FOR LOG PARSING AND FOLLOW UP ACTIONS

Hello friends, comrades, patriots and fine nerds.

I find myself in a position were I need to grab various logs, ranging from Laravel logs, Linux Syslogs, Windows syslogs, logs from own written python scripts and so on so fourth, and depending on what it is, do X or Y action.


I am sure there are great tools out there for this rather than writing my own python parser for each and every log, Prometheus and so on.

However, this is a field in which I am not very familiar so if _you_ could write down some short ideas on how to build something "slightly" more scalable than making 1 python container per log, I'd be most grateful.


Examples:


>Laravel.log throws an REST-API error that Unit 411 has been locked out from $ERP-APP > Make a slack error or trigger PRTG alarm

>Linux syslog throws an error that $FTP_user is using wrong password > Send an email to [email protected]

>$Proprietary_integration_platform throws a log error that $customerFTP is not answering. > Send a text message to /u/guemi and tell him to bitch at someone

>$CustomMadeApp log shows that an automated job has completed > Update a statistics DB that then get's printed to pretty graphs in Grafana so management can look at pretty numbers and statistics

Etc etc etc


EDIT: Uh, sorry guys. I think my caps lock may have been accidentally turned on when I wrote the title. :D

https://redd.it/njgem1
@r_devops
Would an early job switch pigeonhole me?

Hi.

I've been working for a little over a year as a software developer. I'm unhappy with my current employer, so I've been applying for other jobs. One of those jobs was titled as a devops role, which was offered to me.

My understanding is I would be doing a lot of programming in the form of automation. I really like automating things and making people's lives easier, which is what drew me to the position.

Will an early job switch from developer to devops kill my chances of returning to a developer role if I wanted to? I want to explore and try new things while I am still comfortable doing so. I'm young and don't have much as far as commitments go, so I'm thinking why not, but change is always scary so I'm reaching out to hear the experience of others.

Any insight would be appreciated.

https://redd.it/njewm0
@r_devops