Willing to pay someone to do my exam, it consists of kubernetes, ansible and gitops. DM me
Willing to pay someone to do my exam, it consists of kubernetes, ansible and gitops. DM me
https://redd.it/kj4s4a
@r_devops
Willing to pay someone to do my exam, it consists of kubernetes, ansible and gitops. DM me
https://redd.it/kj4s4a
@r_devops
reddit
Willing to pay someone to do my exam, it consists of kubernetes,...
Willing to pay someone to do my exam, it consists of kubernetes, ansible and gitops. DM me
Syncronize time by NTP before starting any services in Linux
Regular NTP clients change clock gradually. So if host started with big clock error(AWS instances sometimes happen to start several minutes in the past), you have timestamps and log events in the past. Not always a good idea.
Article on how to force NTP time syncronization before starting any services using chrony:
https://selivan.github.io/2020/12/23/ntp-sync-time-before-starting-any-services.html
https://redd.it/kixcry
@r_devops
Regular NTP clients change clock gradually. So if host started with big clock error(AWS instances sometimes happen to start several minutes in the past), you have timestamps and log events in the past. Not always a good idea.
Article on how to force NTP time syncronization before starting any services using chrony:
https://selivan.github.io/2020/12/23/ntp-sync-time-before-starting-any-services.html
https://redd.it/kixcry
@r_devops
selivan.github.io
Syncronize time by NTP before starting any services in Linux
Servers often have wrong clock on startup. NTP services, like ntp, chrony and systemd-timesyncd try to correct clock gradually to avoid weird bugs in software. Therefore, if server has a large clock offset on startup, it works with incorrect clock for several…
Crash Course in Linux from a DevOps Perspective?
tldr: what are some good resources for learning Linux from a DevOps perspective, or if that seems less important, some resources for picking up on the DevOps toolchain as a whole?
Hey gang! I've been lucky enough to land a DevOps internship at a mid-sized telecommunications company recently. I just finished up a two year program in mobile development (js, java, swift, kotlin, agile practices etc) and was offered an internship in a non-technical department of the company at the start of quarantine. I didn't feel like being choosey about a paying gig in such an uncertain time. I requested a transfer to one of the software departments, and this opening in DevOps was the first position available to me.
I know imposter syndrome is pretty common in the field, but I really don't feel like I would've been given this position if it wasn't a transfer. I think I would feel this to a smaller degree in a department specifically in development. I have some small experience developing in Linux (with java) and have heard of most of the tools in our DevOps toolchain, but for the most part have a hard time figuring out my tasks.
I don't mind a challenge, and I'm finding that I really enjoy this field. I'm not really getting any training, it's more of throw-them-in-the-deep-end form of training, although I've been given a mentor after asking for one. My concern is that I'm so under-qualified that I'm not pulling my weight, and that I might be fired or transferred. I thought learning more about the DevOps toolchain might be the best kind of course to pick up first, but after my first one-on-one with my boss, it sounds like learning Linux deeper might be a better use of my free time.
My question is what kind of Linux material should I be learning? Should I focus on shell scripting, network engineering, network security, or something else I don't know? All of the above? Maybe they're all more interrelated than I currently realize.
My current resource is Lynda.com, which I have access to from my school account. One nice thing about it is that certificate completions also show up on LinkedIn, but I'm obviously open to any free resources if you know of any specific videos/tutorials/courses. Or if you have any advice for someone that feels overwhelmed to a concerning degree.
I didn't scour the subreddit thoroughly, so my apologies if I missed a simple beginner's resources pin somewhere. Longtime Reddit lurker, I think this might be my first post though, so you know it's important to me!
Thanks ahead of time for any helpful advice or resources. (:
https://redd.it/kivgjb
@r_devops
tldr: what are some good resources for learning Linux from a DevOps perspective, or if that seems less important, some resources for picking up on the DevOps toolchain as a whole?
Hey gang! I've been lucky enough to land a DevOps internship at a mid-sized telecommunications company recently. I just finished up a two year program in mobile development (js, java, swift, kotlin, agile practices etc) and was offered an internship in a non-technical department of the company at the start of quarantine. I didn't feel like being choosey about a paying gig in such an uncertain time. I requested a transfer to one of the software departments, and this opening in DevOps was the first position available to me.
I know imposter syndrome is pretty common in the field, but I really don't feel like I would've been given this position if it wasn't a transfer. I think I would feel this to a smaller degree in a department specifically in development. I have some small experience developing in Linux (with java) and have heard of most of the tools in our DevOps toolchain, but for the most part have a hard time figuring out my tasks.
I don't mind a challenge, and I'm finding that I really enjoy this field. I'm not really getting any training, it's more of throw-them-in-the-deep-end form of training, although I've been given a mentor after asking for one. My concern is that I'm so under-qualified that I'm not pulling my weight, and that I might be fired or transferred. I thought learning more about the DevOps toolchain might be the best kind of course to pick up first, but after my first one-on-one with my boss, it sounds like learning Linux deeper might be a better use of my free time.
My question is what kind of Linux material should I be learning? Should I focus on shell scripting, network engineering, network security, or something else I don't know? All of the above? Maybe they're all more interrelated than I currently realize.
My current resource is Lynda.com, which I have access to from my school account. One nice thing about it is that certificate completions also show up on LinkedIn, but I'm obviously open to any free resources if you know of any specific videos/tutorials/courses. Or if you have any advice for someone that feels overwhelmed to a concerning degree.
I didn't scour the subreddit thoroughly, so my apologies if I missed a simple beginner's resources pin somewhere. Longtime Reddit lurker, I think this might be my first post though, so you know it's important to me!
Thanks ahead of time for any helpful advice or resources. (:
https://redd.it/kivgjb
@r_devops
LinkedIn Learning: Online Training Courses & Skill Building
Accelerate skills & career development for yourself or your team | Business, AI, tech, & creative skills | Find your LinkedIn Learning plan today.
Business side of DevOps
Hi! I've been looking into devops positions as to try to change fields. And I'm wondering, if more business-oriented approach is a plus. In this article business side is highlighted, not tech one - of course, technology is key, but the approach and points themselves. What are your thoughts - being only tech orienter or combining tech+business understanding is better to get hired?
https://redd.it/kjgsxo
@r_devops
Hi! I've been looking into devops positions as to try to change fields. And I'm wondering, if more business-oriented approach is a plus. In this article business side is highlighted, not tech one - of course, technology is key, but the approach and points themselves. What are your thoughts - being only tech orienter or combining tech+business understanding is better to get hired?
https://redd.it/kjgsxo
@r_devops
Custom Software / Apps Development Company
How DevOps Services Can Benefit Businesses
Read more on how DevOps brings transparency to projects, helps development and operations, allows to build quality product in less time and cost. Contact us for professional DevOps services!
Kubernetes API Explained
Kuberenetes API is made of several smaller components. In this video you will see how a request has to go through authentication, authorisation, mutation & validation before it is persisted by Kubernetes.
https://youtu.be/aTFmtac2wCg
https://redd.it/kjdcu5
@r_devops
Kuberenetes API is made of several smaller components. In this video you will see how a request has to go through authentication, authorisation, mutation & validation before it is persisted by Kubernetes.
https://youtu.be/aTFmtac2wCg
https://redd.it/kjdcu5
@r_devops
YouTube
Kubernetes API Explained
Kuberenetes API is made of several smaller components. In this video you will see how a request has to go through Authentication, Authorisation, Mutation & V...
Deployer - an easy trigger for deploy script from remote
Hi everybody! Let us present to you a small useful tool for DevOps - deployer. This tool trigger deploys a new app version to target Linux servers. Main idea: you are adding commands for deployment to a config file and then call them remotely by HTTP/HTTPS.
We are using this tool to deploy new app versions from the GitLab pipeline to our servers. We hope that it will be useful for you as well! It is an open-source tool, and we are open to any suggestions!
This utility is located in repositories:
https://gitlab.com/junte/devops/deployer \- main repository
https://github.com/Junte/deployer \- mirror from GitLab
https://redd.it/kjc21j
@r_devops
Hi everybody! Let us present to you a small useful tool for DevOps - deployer. This tool trigger deploys a new app version to target Linux servers. Main idea: you are adding commands for deployment to a config file and then call them remotely by HTTP/HTTPS.
We are using this tool to deploy new app versions from the GitLab pipeline to our servers. We hope that it will be useful for you as well! It is an open-source tool, and we are open to any suggestions!
This utility is located in repositories:
https://gitlab.com/junte/devops/deployer \- main repository
https://github.com/Junte/deployer \- mirror from GitLab
https://redd.it/kjc21j
@r_devops
GitLab
Junte / DevOps / Deployer
Need advice on how to set up authentication for an internally hosted webserver/service
When it comes to auth I feel I'm in a little over my head. I am the owner of an internally hosted gRPC server for our (large) company, hosted on a basic kubernetes multi-pod cluster deployment. Its endpoints are currently exposed with no authentication enabled, so anybody within the company can hit them. There are a couple of ways the server receives requests:
​
\- Via other gRPC Golang clients hosted outside of the cluster
\- Via web browser
​
My requirements are to lock down the client + endpoints with permissions.
​
\- Users must log into our web-browser client via company SSO, and their token maps to certain permissions that we set in the backend (I am guessing the way to do this is have an "Auth" table that maps SSO tokens to various levels of permissions)
\- Golang clients must be white-listed and authenticate with our server in some way. I am guessing certificate-based auth?
​
Is there somewhere I can read or learn about a standard approach to implementing these authentication requirements?
https://redd.it/kjlpwo
@r_devops
When it comes to auth I feel I'm in a little over my head. I am the owner of an internally hosted gRPC server for our (large) company, hosted on a basic kubernetes multi-pod cluster deployment. Its endpoints are currently exposed with no authentication enabled, so anybody within the company can hit them. There are a couple of ways the server receives requests:
​
\- Via other gRPC Golang clients hosted outside of the cluster
\- Via web browser
​
My requirements are to lock down the client + endpoints with permissions.
​
\- Users must log into our web-browser client via company SSO, and their token maps to certain permissions that we set in the backend (I am guessing the way to do this is have an "Auth" table that maps SSO tokens to various levels of permissions)
\- Golang clients must be white-listed and authenticate with our server in some way. I am guessing certificate-based auth?
​
Is there somewhere I can read or learn about a standard approach to implementing these authentication requirements?
https://redd.it/kjlpwo
@r_devops
reddit
Need advice on how to set up authentication for an internally...
When it comes to auth I feel I'm in a little over my head. I am the owner of an internally hosted gRPC server for our (large) company, hosted on a...
2020 Cloud and Development Trends. Thoughts?
Hey All,
I've been thinking a lot about the different cloud and dev trends throughout 2020. I came up with five that I think are the most relevant and the most eye-opening.
The first is GitHub Codespaces. The more we write code, the more we need a centralized location to write the code. For example, let's say there are 5 devs on a team that are writing code. Each dev (perhaps) has a different workstation setup. If they don't have the same extensions and tools as everyone else, there could be unknown issues that you can't really prepare for.
The second is Azure Arc, specifically Azure Arc for Kubernetes. Although the tech, in general, is really cool, I think it shows that Microsoft is starting to think about on-prem and hybrid again. It's pretty clear that at least not anytime soon, on-prem isn't going away. Because of that, why not manage the on-prem stuff in Azure as well?
The third is infrastructure-as-software. With AWS CDK, Hashicorp CDK, and Pulumi, we're starting to see a HUGE trend in creating and managing cloud services with a general-purpose programming language (Go, JavaScript, etc.)
The fourth is something that we've been seeing for a while, but it's because extremely apparent this year - coding for sysadmins and infrastructure engineers. I think we're going to see an upward trend that everyone will be coding in some way or another
Finally, I love the specialty and career-driven certifications that we're seeing. I've never been a huge certification guy myself, but I'm definitely more interested now that most Azure and AWS certs are career-focused.
What are your thoughts on this? What are your top five trends you saw that are worth noting?
If you're interested, I created a short 5-minute video on the topics above. Let me know your thoughts :) https://www.youtube.com/watch?v=E4nrPXoUV0w
https://redd.it/kjl1wx
@r_devops
Hey All,
I've been thinking a lot about the different cloud and dev trends throughout 2020. I came up with five that I think are the most relevant and the most eye-opening.
The first is GitHub Codespaces. The more we write code, the more we need a centralized location to write the code. For example, let's say there are 5 devs on a team that are writing code. Each dev (perhaps) has a different workstation setup. If they don't have the same extensions and tools as everyone else, there could be unknown issues that you can't really prepare for.
The second is Azure Arc, specifically Azure Arc for Kubernetes. Although the tech, in general, is really cool, I think it shows that Microsoft is starting to think about on-prem and hybrid again. It's pretty clear that at least not anytime soon, on-prem isn't going away. Because of that, why not manage the on-prem stuff in Azure as well?
The third is infrastructure-as-software. With AWS CDK, Hashicorp CDK, and Pulumi, we're starting to see a HUGE trend in creating and managing cloud services with a general-purpose programming language (Go, JavaScript, etc.)
The fourth is something that we've been seeing for a while, but it's because extremely apparent this year - coding for sysadmins and infrastructure engineers. I think we're going to see an upward trend that everyone will be coding in some way or another
Finally, I love the specialty and career-driven certifications that we're seeing. I've never been a huge certification guy myself, but I'm definitely more interested now that most Azure and AWS certs are career-focused.
What are your thoughts on this? What are your top five trends you saw that are worth noting?
If you're interested, I created a short 5-minute video on the topics above. Let me know your thoughts :) https://www.youtube.com/watch?v=E4nrPXoUV0w
https://redd.it/kjl1wx
@r_devops
YouTube
Cloud Computing 2020 Wrap-Up
The end of the year is upon us! What does that mean? It's time to chat about the FIVE THINGS that made tech in 2020 pretty awesome!
1. GitHub Codespaces
2. Azure Arc for Kubernetes
3. Infrastructure-as-software
4. Coding for sysadmins and infrastructure…
1. GitHub Codespaces
2. Azure Arc for Kubernetes
3. Infrastructure-as-software
4. Coding for sysadmins and infrastructure…
How to create executors of different types in the Circle CI orb?
I got an issue. I have a Circle CI orb that was created by my colleagues. As this orb is in active use, I cannot just change the executor, so I need to add a new executor of a different type. I posted a question in [StackOverflow,](https://stackoverflow.com/questions/65354545/how-can-i-create-several-executors-for-a-job-in-circle-ci-orb) but no success.
How can I adjust the job itself so that it will accept executors of different types? Please, see the example of a job I want to change below.
Executor:
description: >
The executor to run testcontainers without extra setup in Circle CI builds.
parameters:
# https://circleci.com/docs/2.0/configuration-reference/#resource_class
resource-class:
type: enum
default: medium
enum: [medium, large, xlarge, 2xlarge]
tag:
type: string
default: ubuntu-2004:202010-01
resource_class: <<parameters.resource-class>>
machine:
image: <<parameters.tag>>
Another executor is Docker-based.
Job:
parameters:
executor:
type: executor
default: openjdk
resource-class:
type: enum
default: medium
enum: [small, medium, medium+, large, xlarge]
executor: << parameters.executor >>
resource_class: << parameters.resource-class >>
environment:
# Customize the JVM maximum heap limit
MAVEN_OPTS: -Xmx3200m
steps:
# Instead of checking out code, just grab it the way it is
- attach_workspace:
at: .
# Guessing this is still necessary (we only attach the project folder)
- configure-maven-settings
- cloudwheel/fetch-and-update-maven-cache
- run:
name: "Deploy to Nexus without running tests"
command: mvn clean deploy -DskipTests
https://redd.it/kjni2z
@r_devops
I got an issue. I have a Circle CI orb that was created by my colleagues. As this orb is in active use, I cannot just change the executor, so I need to add a new executor of a different type. I posted a question in [StackOverflow,](https://stackoverflow.com/questions/65354545/how-can-i-create-several-executors-for-a-job-in-circle-ci-orb) but no success.
How can I adjust the job itself so that it will accept executors of different types? Please, see the example of a job I want to change below.
Executor:
description: >
The executor to run testcontainers without extra setup in Circle CI builds.
parameters:
# https://circleci.com/docs/2.0/configuration-reference/#resource_class
resource-class:
type: enum
default: medium
enum: [medium, large, xlarge, 2xlarge]
tag:
type: string
default: ubuntu-2004:202010-01
resource_class: <<parameters.resource-class>>
machine:
image: <<parameters.tag>>
Another executor is Docker-based.
Job:
parameters:
executor:
type: executor
default: openjdk
resource-class:
type: enum
default: medium
enum: [small, medium, medium+, large, xlarge]
executor: << parameters.executor >>
resource_class: << parameters.resource-class >>
environment:
# Customize the JVM maximum heap limit
MAVEN_OPTS: -Xmx3200m
steps:
# Instead of checking out code, just grab it the way it is
- attach_workspace:
at: .
# Guessing this is still necessary (we only attach the project folder)
- configure-maven-settings
- cloudwheel/fetch-and-update-maven-cache
- run:
name: "Deploy to Nexus without running tests"
command: mvn clean deploy -DskipTests
https://redd.it/kjni2z
@r_devops
Stack Overflow
How can I create several executors for a job in Circle CI orb?
NOTE: The actual problem I am trying to solve is run testcontainers in Circle CI.
To make it reusable, I decided to extend the existing orb in my organisation.
The question, how can I create several
To make it reusable, I decided to extend the existing orb in my organisation.
The question, how can I create several
Checkout a specific branch of Jenkins job configuration itself before triggering a build of that job
Hey people!,
First, I'd like to explain the current way we are triggering Jenkins jobs, before asking the main question.
Our CD pipeline is represented by a set of parameterized jobs: some have 1-2 parameters, others have up to 25-30 parameters.
The whole pipeline is driven by a set of shell scripts that trigger Jenkins jobs in correct order with correct parameters, based on what the user wants to do.
We follow IaC practices, so our Jenkins build scripts are version controlled. For that, we have a `ci` repository with folders named after the job names, and inside those folders we have a `build_script` file.
All jobs have a `branch` parameter, and always check out the `ci` repo at master as the first step.
The `branch` parameter tells what branch the job's `build_script` needs to be taken from, so if that branch exists in `ci` repository, that branch is checked out.
Then the `$WORKSPACE/$JOB_NAME/build_script` file is executed as the only job's shell command.
This pattern allows us to work safely on Jenkins build scripts and replicates the usual development feature branch workflow, without affecting the master pipeline execution code.
While this works perfect for us when changes are in build scripts, this method doesn't work when the job configuration itself needs to change. For example, Jenkins job parameters are not "version controlled", and you can't "checkout" a specific version of the Jenkins job that has a different set of parameters, while keeping the master parameters untouched.
This makes it hard to test Jenkins job configuration, and requires introducing backward compatible changes to the single master Job configuration, which instantly affects the master pipeline workflow.
​
My question is: are you guys aware of any way to achieve this?
\- maybe there are some Jenkins plugins that allow you to checkout Jenkins job's code before triggering builds of that job?
\- i'm not very familiar with Jenkins pipelines, but maybe they allow doing something similar?
\- are there any better CI solutions that can handle such use case?
​
Thank you!
https://redd.it/kjieqf
@r_devops
Hey people!,
First, I'd like to explain the current way we are triggering Jenkins jobs, before asking the main question.
Our CD pipeline is represented by a set of parameterized jobs: some have 1-2 parameters, others have up to 25-30 parameters.
The whole pipeline is driven by a set of shell scripts that trigger Jenkins jobs in correct order with correct parameters, based on what the user wants to do.
We follow IaC practices, so our Jenkins build scripts are version controlled. For that, we have a `ci` repository with folders named after the job names, and inside those folders we have a `build_script` file.
All jobs have a `branch` parameter, and always check out the `ci` repo at master as the first step.
The `branch` parameter tells what branch the job's `build_script` needs to be taken from, so if that branch exists in `ci` repository, that branch is checked out.
Then the `$WORKSPACE/$JOB_NAME/build_script` file is executed as the only job's shell command.
This pattern allows us to work safely on Jenkins build scripts and replicates the usual development feature branch workflow, without affecting the master pipeline execution code.
While this works perfect for us when changes are in build scripts, this method doesn't work when the job configuration itself needs to change. For example, Jenkins job parameters are not "version controlled", and you can't "checkout" a specific version of the Jenkins job that has a different set of parameters, while keeping the master parameters untouched.
This makes it hard to test Jenkins job configuration, and requires introducing backward compatible changes to the single master Job configuration, which instantly affects the master pipeline workflow.
​
My question is: are you guys aware of any way to achieve this?
\- maybe there are some Jenkins plugins that allow you to checkout Jenkins job's code before triggering builds of that job?
\- i'm not very familiar with Jenkins pipelines, but maybe they allow doing something similar?
\- are there any better CI solutions that can handle such use case?
​
Thank you!
https://redd.it/kjieqf
@r_devops
reddit
Checkout a specific branch of Jenkins job configuration itself...
Hey people!, First, I'd like to explain the current way we are triggering Jenkins jobs, before asking the main question. Our CD pipeline is...
Docker Practical Guide-3: Docker Compose with Node and Mongo
# (Video Series) ⚡️𝗗𝗼𝗰𝗸𝗲𝗿 𝗣𝗿𝗮𝗰𝘁𝗶𝗰𝗮𝗹 𝗚𝘂𝗶𝗱𝗲⚡️ 𝗣𝗮𝗿𝘁-3 📢 Docker Compose with Node and Mongo
# https://www.youtube.com/watch?v=TZ5E8NE0_A8
https://redd.it/kjxbzd
@r_devops
# (Video Series) ⚡️𝗗𝗼𝗰𝗸𝗲𝗿 𝗣𝗿𝗮𝗰𝘁𝗶𝗰𝗮𝗹 𝗚𝘂𝗶𝗱𝗲⚡️ 𝗣𝗮𝗿𝘁-3 📢 Docker Compose with Node and Mongo
# https://www.youtube.com/watch?v=TZ5E8NE0_A8
https://redd.it/kjxbzd
@r_devops
YouTube
Docker Practical Guide-3: DOCKER-COMPOSE with Node and Mongo
It's a Series on DOCKER- ⚡️DOCKER Practical Guide⚡️This one is 👉 Part-3: Docker Compose with Node and Mongo👉 Part-1: https://www.youtube.com/watch?v=lPd8T6...
Spot and on-demand on the same node group
Is there a way to setup spot instances and on-demands on the same EKS node group, and let the cluster autoscaler to launch the spots first (fallback to on-demand)?
https://redd.it/kjz70y
@r_devops
Is there a way to setup spot instances and on-demands on the same EKS node group, and let the cluster autoscaler to launch the spots first (fallback to on-demand)?
https://redd.it/kjz70y
@r_devops
reddit
Spot and on-demand on the same node group
Is there a way to setup spot instances and on-demands on the same EKS node group, and let the cluster autoscaler to launch the spots first...
Best way to support local VMs and developers
Hi all,
I have a heavy public cloud background (AWS/Azure/etc.) but have been tasked with supporting our local development efforts.
Developers work on different projects, so I'd need to somehow keep project-related VMs in their own area. I want developers to have freedom to use things like Terraform or other IaC tools, but not step outside their boundaries. We currently have a vSphere instance on-prem that isn't be used so I'm wondering if that's a good resource to tap into and repurpose.
I'd love to be able to have some sort of Devops dashboard that shows what the developers are up to and what resources are being used.
Any insight appreciated!
https://redd.it/kk2r39
@r_devops
Hi all,
I have a heavy public cloud background (AWS/Azure/etc.) but have been tasked with supporting our local development efforts.
Developers work on different projects, so I'd need to somehow keep project-related VMs in their own area. I want developers to have freedom to use things like Terraform or other IaC tools, but not step outside their boundaries. We currently have a vSphere instance on-prem that isn't be used so I'm wondering if that's a good resource to tap into and repurpose.
I'd love to be able to have some sort of Devops dashboard that shows what the developers are up to and what resources are being used.
Any insight appreciated!
https://redd.it/kk2r39
@r_devops
reddit
Best way to support local VMs and developers
Hi all, I have a heavy public cloud background (AWS/Azure/etc.) but have been tasked with supporting our local development efforts. Developers...
Moving database by buckets of data
We are planning to move from one no-sql database to another. Our customer data is stored in buckets like user, access, documents, etc.
We have a migration tool that extracts keys/values from a bucket into an intermediate json and the same tool can be then used to push the keys into the other no-sql db.
But these buckets for one customer are so huge that it will take 10 days to extract all their data into this intermediate file and another 10 days to push into the new db. Even if we do bucket by bucket, each bucket can take 5-7 days. Some buckets have more data than the others.
I was looking at AWS batch and that's what we need. Use the command as a batch process and let AWS spin up 100s of instances and execute them. But how to tell one process to extract between 1-1000, second to extract from 1000-2000, etc.
Is there a way to index all the contents of the bucket and let AWS batch split into say 100 ec2 instances and each instance does 1000 at a time in parallel?
https://redd.it/kkmxun
@r_devops
We are planning to move from one no-sql database to another. Our customer data is stored in buckets like user, access, documents, etc.
We have a migration tool that extracts keys/values from a bucket into an intermediate json and the same tool can be then used to push the keys into the other no-sql db.
But these buckets for one customer are so huge that it will take 10 days to extract all their data into this intermediate file and another 10 days to push into the new db. Even if we do bucket by bucket, each bucket can take 5-7 days. Some buckets have more data than the others.
I was looking at AWS batch and that's what we need. Use the command as a batch process and let AWS spin up 100s of instances and execute them. But how to tell one process to extract between 1-1000, second to extract from 1000-2000, etc.
Is there a way to index all the contents of the bucket and let AWS batch split into say 100 ec2 instances and each instance does 1000 at a time in parallel?
https://redd.it/kkmxun
@r_devops
reddit
Moving database by buckets of data
We are planning to move from one no-sql database to another. Our customer data is stored in buckets like user, access, documents, etc. We have...
Are you seeing more Python than Go?
Hey All,
Wondering if you're seeing this same trend. Essentially I'm seeing far more Python than Go being used from an automation/cloud development perspective.
Why do you think that is?
https://redd.it/kkl0mx
@r_devops
Hey All,
Wondering if you're seeing this same trend. Essentially I'm seeing far more Python than Go being used from an automation/cloud development perspective.
Why do you think that is?
https://redd.it/kkl0mx
@r_devops
reddit
Are you seeing more Python than Go?
Hey All, Wondering if you're seeing this same trend. Essentially I'm seeing far more Python than Go being used from an automation/cloud...
CD for WordPress on a VM?
Hi all,
I am looking for ideas for CD for a WordPress instance on a VM. Usually we stop apache. Copy existing directories to a backup folder locally. Copy over new contents. Start apache. Test the website with the ew content.
Sometimes we may even need to take a backup of the dB on rds.
Any suggestions on how we can do it for WordPress apache. I know it's easier to do with a docker image but this is different.
https://redd.it/kkj7gv
@r_devops
Hi all,
I am looking for ideas for CD for a WordPress instance on a VM. Usually we stop apache. Copy existing directories to a backup folder locally. Copy over new contents. Start apache. Test the website with the ew content.
Sometimes we may even need to take a backup of the dB on rds.
Any suggestions on how we can do it for WordPress apache. I know it's easier to do with a docker image but this is different.
https://redd.it/kkj7gv
@r_devops
reddit
CD for WordPress on a VM?
Hi all, I am looking for ideas for CD for a WordPress instance on a VM. Usually we stop apache. Copy existing directories to a backup folder...
Is FedoraCore OS good alternative to the CentOS?
We recently came know about CentOS moving rolling release mode. Then there was two recent articles on Fedora Magazine about Fedora CoreOS.
[https://fedoramagazine.org/deploy-fedora-coreos-with-terraform/](https://fedoramagazine.org/deploy-fedora-coreos-with-terraform/)
https://fedoramagazine.org/getting-started-with-fedora-coreos/
I know CoreOS is an acquisition of Red Hat.
But cannot we use Fedora CoreOS in the place of CentOS? Anyone using Fedora CoreOS please share their experience.
https://redd.it/kke1ht
@r_devops
We recently came know about CentOS moving rolling release mode. Then there was two recent articles on Fedora Magazine about Fedora CoreOS.
[https://fedoramagazine.org/deploy-fedora-coreos-with-terraform/](https://fedoramagazine.org/deploy-fedora-coreos-with-terraform/)
https://fedoramagazine.org/getting-started-with-fedora-coreos/
I know CoreOS is an acquisition of Red Hat.
But cannot we use Fedora CoreOS in the place of CentOS? Anyone using Fedora CoreOS please share their experience.
https://redd.it/kke1ht
@r_devops
Fedora Magazine
Deploy Fedora CoreOS servers with Terraform - Fedora Magazine
Learn how to deploy Fedora CoreOS at scale using Terraform, as well as tips for configuring your distributed system at provision time.
(CDK vs Pulumi) vs Terraform
Hey everyone.
I've recently been hired to take lead on the IaaC side of a small company. I'm a big time Terraform guy and was initially going to go with that to provision our infrastructure. However, no one else on the team is very familiar with it, but they're all good with Python. I was wondering what people thought about CDK vs Pulumi and how the better one compares to Terraform (outside of the obvious imperative vs declarative stuff).
https://redd.it/kl7t9u
@r_devops
Hey everyone.
I've recently been hired to take lead on the IaaC side of a small company. I'm a big time Terraform guy and was initially going to go with that to provision our infrastructure. However, no one else on the team is very familiar with it, but they're all good with Python. I was wondering what people thought about CDK vs Pulumi and how the better one compares to Terraform (outside of the obvious imperative vs declarative stuff).
https://redd.it/kl7t9u
@r_devops
reddit
(CDK vs Pulumi) vs Terraform
Hey everyone. I've recently been hired to take lead on the IaaC side of a small company. I'm a big time Terraform guy and was initially going to...
Configuration management for deployed applications/microservices
Hi /r/devops!
How do you handle application configuration for multiple applications across several environments? Let's say you have 100 microservices, every microservice needs to have separate configuration for database connection string, some message broker like Azure Service Bus and endpoints to other 3rd party APIs. All of them vary between different environment (QA, Staging, Production). What is the best way to handle those in a bigger number?
https://redd.it/kl99dd
@r_devops
Hi /r/devops!
How do you handle application configuration for multiple applications across several environments? Let's say you have 100 microservices, every microservice needs to have separate configuration for database connection string, some message broker like Azure Service Bus and endpoints to other 3rd party APIs. All of them vary between different environment (QA, Staging, Production). What is the best way to handle those in a bigger number?
https://redd.it/kl99dd
@r_devops
reddit
Configuration management for deployed applications/microservices
Hi /r/devops! How do you handle application configuration for multiple applications across several environments? Let's say you have 100...
Musings around a Dockerfile for Jekyll
If you like cool stories about how an engineer, faced with an impossible problem, overcame all odds and solved it, this post is not for you. This is a story of how I spent a non-trivial amount of time, how I hit a couple of walls, and how I nearly came back to square one. Why do I write it?
The first reason is for me: I want to document my journey so if I ever think about trying again in the future, I’ll have some arguments against it. Second, in opposition to the actual zeitgeist, you learn a lot more by failing than by succeeding. Writing about one’s learning "bury" it deeper into memory.
https://blog.frankel.ch/musings-dockerfile-jekyll/
https://redd.it/kl7oqx
@r_devops
If you like cool stories about how an engineer, faced with an impossible problem, overcame all odds and solved it, this post is not for you. This is a story of how I spent a non-trivial amount of time, how I hit a couple of walls, and how I nearly came back to square one. Why do I write it?
The first reason is for me: I want to document my journey so if I ever think about trying again in the future, I’ll have some arguments against it. Second, in opposition to the actual zeitgeist, you learn a lot more by failing than by succeeding. Writing about one’s learning "bury" it deeper into memory.
https://blog.frankel.ch/musings-dockerfile-jekyll/
https://redd.it/kl7oqx
@r_devops
A Java geek
Musings around a Dockerfile for Jekyll
If you like cool stories about how an engineer, faced with an impossible problem, overcame all odds and solved it, this post is not for you. This is a story of how I spent a non-trivial amount of time, how I hit a couple of walls, and how I nearly came back…
Ops Tools Marketing Bullshit Dictionary
I feel that often the marketing is dishonest and/or feels like the product or service is shoved down my throat. Do you feel the same way?
Here are some examples of bullshit and what in my view should be the response:
https://ilya-sher.org/2020/12/27/ops-tools-marketing-bullshit-dictionary/
https://redd.it/kkz1sh
@r_devops
I feel that often the marketing is dishonest and/or feels like the product or service is shoved down my throat. Do you feel the same way?
Here are some examples of bullshit and what in my view should be the response:
https://ilya-sher.org/2020/12/27/ops-tools-marketing-bullshit-dictionary/
https://redd.it/kkz1sh
@r_devops
Ilya's blog
Ops Tools Marketing Bullshit Dictionary
This article is aimed mostly at juniors. Lacking experience, you are a soft target for marketing bullshit. I encourage critical thinking for evaluation of products and services that are forced down…