Shrinking size of EBS volume mounted as XFS

I have an EC2 instance with an EBS volume mounted as an XFS filesystem that is way too large than what we need it to be. I'd like to shrink the volume of the filesystem/volume to something much more in line with our needs, but I am having difficulty doing so. I tried doing something like this (https://cloudacademy.com/blog/amazon-ebs-shink-volume/) where I create a new smaller EBS volume, attach it to the instance, make a new filesystem and mount it to that. Then, I rsync everthing from the larger filesystem to the smaller filesystem, stop the instance, detach both volumes, and reattach the smaller volume to the block device (i.e. /dev/sdf) that the larger volume used to be attached to.

However, when I start my instance back up something goes wrong and it starts up in some sort of emergency mode based on reading the system logs. I can't even SSH into it anymore. Does anyone have any ideas on what I can do?

https://redd.it/laj3o8
@r_devops

Git hook to remove credentials

Hi
I have a file which contains some credentials. This file needs to be pushed to git. Before actually pushing or committing I'd like to remove the creds from this file.
I tried using git's pre-commit hook which replaces the creds, then does git add and commit again but this ofcourse creates an infinite loop of commits.
Any ideas or solutions to this problem?

https://redd.it/la9lqi
@r_devops

Prometheus alternative for serverless

Hey there 👋,

I'm working on a node.js app with a REST API that is deployed to AWS Lambda. Having worked a lot with Kubernetes, Prometheus, and Grafana, I'm used to instrumenting the API code and exposing white-box metrics from the app (error counts, latency histograms, request counts, and histograms for DB queries) and having those pulled by Prometheus for altering and also visualisation with Grafana.

I was curious to know if there are any tools or services that enable this level of detail in metrics for serverless?

Alternatively, if I go down the route of a long-running Node.js process using something like Google Cloud Run, are there any other tool or services that give similar functionality (short-term storage, visualisation and altering), without the operational overhead and cost of Prometheus?

https://redd.it/la391q
@r_devops

Backend developper who is tired of coding looking to move into DevOps

So, to start off with, I'd like to say that I'm relatively aware of what a DevOps specialist does as it's what my wife does. That being said, I'm sure I have some misconceptions but, either way, the profession looks quite interesting.

​

I've read the "getting into dev ops" sticky but I had a slightly more point question: how much, if any, actual coding goes into being a DevOps engineer? I have a software engineering background but I'm super tired of the general monotony of pouring over code day in and day out like I've done for the last 7 years so I'm really looking for a tech-facing job that doesn't have me in the code.

​

Thank you very much

https://redd.it/la32zh
@r_devops

Changing my technology from an IBM iseries developer to Devops Engineer

Hi,

As you've read I want to change my technology from AS400 to Devops. Currently I have 2.5 years experience in AS400 and I'm working with a MNC in india. I want to switch from as400 to Devops .
But the problem is I don't know how to start. How many certifications do I need to do. ?
Since yesterday I've started a LinkedIn learning 40hours course on Devops which is a certified course which will teach me chef, kunernetes , ansible and everything . Is this course enough?
Do I need to learn any programming language as well to switch successfully in devops ? Currently the only programming languages I know are RPGLE , SQLRPGLE , cl programming

Ps: I know my way around Jira, jenkins , bitbucket, rational developer for ibmi.

https://redd.it/lau0y1
@r_devops

Digital Transformation & Cloud Adoption in Pandemic

Digital transformation is reshaping businesses all over the globe, and Cloud platforms are enabling rapid digital changes with unprecedented growth. Even today, deploying all the data of the enterprises to Cloud is a challenge for many organizations, mainly because traditional IT departments do not have the technical skills and are unfamiliar with digital transformation processes.

Xavor is helping companies succeed in the digital-first world by bringing businesses and IT closer together and optimizing processes to create new business value for them. We provide services like leveraging of cloud infrastructure, IoT integrations and business insights, AI, Data Analytics/Management & marketing platforms. Our Business Technology Platform strategy includes cost optimization, business continuity, and security & compliance working to help businesses compete in the digital economy.

We are the proud partners of the world’s leading digital platforms like Azure, AWS, Google Cloud, and our Certified professionals enable you to take benefits of Cloud innovative technology services.

https://redd.it/la214t
@r_devops

What other software is there like Jenkins? Is there anything better or is Jenkins the best one?

I am learning Jenkins and I was wondering if there is any other tool like Jenkins and how those work and how they differ

https://redd.it/l9y0bz
@r_devops

The Unspoken Challenges of SecDevOps



In the fast-paced world of cloud-native, code changes frequently, and the attack surface and the risk profiles change just as quickly - giving rise to the SecDevOps.

As companies embrace SecDevOps, new challenges arise as different teams need to learn new concepts and technologies that aren’t normally associated with their day-to-day responsibilities. Now the DevOps teams need to learn how to secure their software and infrastructure and security team needs to adapt to a rapid delivery environment.

Aside from the new skills that need to be learned, a common thread between the 3 teams must be established. With varying goals and different perspectives to boot, coming to that common understanding is where most run into their first set of unspoken challenges nobody openly talks about.

Join us in the upcoming fire chat with Scott Surovich, HSBC's Global Container Engineering Lead, as we have an honest discussion about navigating the cultural and technical challenges of the journey to SecDevOps.

You will get to hear and learn about:

The technical and cultural challenges of shifting security left and how to overcome them.

Build a common thread between Devs, Ops, and Security teams.

How policies, workflows, and analytics are 3 pillars in establishing a secure Cloud-Native environment

How to get your Cloud-Native security initiatives off the ground

Register here: https://www.magalix.com/the-unspoken-challenges-of-secdevops

https://redd.it/la2a2v
@r_devops

windows metrics relabeling in Prometheus

​

​

Hello team, need some help,

I have in Grafana at metrics from my windows pods ( using windows_exporter):

if i try get metrics for example: rate(windows_container_cpu_usage_seconds_total[5m\])

I will see only container_id ( pod id) for example: docker://0040308261f7aa694ac13ca1d7fc92ee9c781892de774b4b87ea4f6a167344be not a pod name/container name because windows_exporter can provide only at container ID

as I understand I need to do relabeling in Prometheus-operator ( I'm using helpfile for this in kube-prometheus-stack)

how I understand I need to add metric_relabel_configs in values but I do not understand how I can do this.



additionalScrapeConfigs: [\]

\# - job_name: kube-etcd

\# kubernetes_sd_configs:

\# - role: node

\# scheme: https

\# tls_config:

\# ca_file: /etc/prometheus/secrets/etcd-client-cert/etcd-ca

\# cert_file: /etc/prometheus/secrets/etcd-client-cert/etcd-client

\# key_file: /etc/prometheus/secrets/etcd-client-cert/etcd-client-key

\# relabel_configs:

\# - action: labelmap

\# regex: __meta_kubernetes_node_label_(.+)

\# - source_labels: [__address__\]

\# action: replace

\# targetLabel: __address__

\# regex: ([\^:;\]+):(\\d+)

\# replacement: ${1}:2379

\# - source_labels: [__meta_kubernetes_node_name\]

\# action: keep

\# regex: .*mst.*

\# - source_labels: [__meta_kubernetes_node_name\]

\# action: replace

\# targetLabel: node

\# regex: (.*)

\# replacement: ${1}

\# metric_relabel_configs:

\# - regex: (kubernetes_io_hostname|failure_domain_beta_kubernetes_io_region|beta_kubernetes_io_os|beta_kubernetes_io_arch|beta_kubernetes_io_instance_type|failure_domain_beta_kubernetes_io_zone)

\# action: labeldrop

https://redd.it/l9ysz8
@r_devops

Only sign code from the source code repository

The recent SolarWinds attack was made possible because the build server was able to sign code that didn't come from the source code repository. There is a way to ensure that only code that comes from the source control repository gets signed, and even to enable scanning on that code, without sacrificing time in the CI/CD pipeline.

https://redd.it/l9xtjj
@r_devops

Question about devops engineer's job

Hi everybody, I am currently doing an engineer's school to work in IT jobs. I have both network and programmation's courses. I took some interest in the job of "Devops Engineer" (At least what I understood about it on Internet). I think that the information about this job is pretty lame. I would like to know if you could tell me more about it ? Moreover, I like to write code. Do you code as a Devops Engineer ? If yes, what kind of programs or scripts do you write ? Is Devops Engineer only about network management ? Is it about both ?

I would like to specify that i like both network management and programming.

Thank you for your answer

​

P.S : Sorry if I made mistakes. English isn't my first language and i didn't write it since 3 years.

https://redd.it/l9s1iz
@r_devops

When are DevOps the blockers?

Hey everyone. Been a DevOps engineer for close to a year now.

I know the purpose of our role is to streamline processes, through automation, best practices, etc. But when do we become the blockers?

I've noticed situations where devs are blocked, because DevOps have to review PR's which create infrastructure through TF or management via Ansible. But our roles are so busy, we have tickets coming in every second, that this just ends up blocking the devs since they're waiting.

Or another case, where even most members of DevOps don't have AWS permissions to do anything. So we have to use the CLI to get most of our work done, which is a huge blocker. For example, doing something on the console is 10x faster than figuring out the inline json syntax from the CLI.

Is my experience normal? And if so, what practices do you guys follow that makes DevOps less of a blocker, for others and for themselves?

https://redd.it/lb4ux1
@r_devops

Recommended Git client for Windows

Linux luser looking for some help migrating Windows users from TortoiseSVN on a network share to GitHub. Would people recommend TortoiseGit or GitHub Desktop or something else for the GUI approach? Would chocolatey git be the best command line / Ansible approach? Last time I tried running the git-scm.com installer it gave weird errors. Users are on Windows 10. Deploys will go to 7 or 10. Thanks!

https://redd.it/laxxrq
@r_devops

What makes a DevOps standup/scrum etc successful ?


I work on a small team at a \~100 person tech company.

2 "Sr. SRE" (including myself), a DBA, a buildmaster, and a newly promoted "Manager, DevOps" who is reasonably technical but was previously in a Sr. customer success type role sortof like a sales engineer but who was on our team. There is a totally separate small team that handles "Production Operations" and I have significant overlap with them in terms of responsibilities, often more than my own team, The only difference being I generally work on stuff before it is deployed vs after, in theory at least.

​

We've been having a monday morning standup call/meeting since I started over a year ago and frankly I feel like it's lacking and unfruitful. Nobody really comes prepared, we just rattle off what we are planning to work on that week, I sometimes references my jira queue etc, but there is little coherence to the whole thing and no followup on it, the next monday just rolls around and we do the same thing.

​

I've talked to some other companies that do standups daily or 4x/week. It seems like we should have a list of items prepared and then review our progress as a team at the end of the week or something.

​

So what makes a successful scrum, what should a lead of a small team like this be doing to ensure productivity and success?

https://redd.it/lb29ei
@r_devops

What is the best infrastructure as code tool for dynamic deployment?

I am searching for the best tool to dynamically and on the fly manage and edit my infrastructure. By that I mean we have a Kubernetes cluster on AWS or Azure or Google cloud and I want to add a new worker group on the fly and when I am done I will delete that.
At the moment I am using Terraform for setting up the cluster but our product needs to continuously manage the underlying infrastructure and it should be able to at least cover the three bigger players (AWS, Azure, Google) and another requirement is any tool that I am going to use must have a Golang client or expose an API so I can interact with it from Go.
Any suggestion?

https://redd.it/lasett
@r_devops

[HELP] Octopus deploy: Run a script in a worker container from an external feed

Hi all,

Pre-apologies if this does not fit this sub.

**What I am trying to do:**

* I am using hosted Octopus Deploy. I need to run an AWS CloudFormation job from a Octopus worker. The job is written in NodeJS.

**How I am trying to do it:**

* I am trying to use a dynamic Ubuntu 18.04 worker node that is offered on the hosted Octopus Deploy variant.
* I am trying to get the Ubuntu worker node to spin up a custom Alpine container from AWS ECR that contains all dependencies for the deployment. (I don't want to have to install all dependencies on the worker directly per deployment).
* I am trying to run a script in a GitHub repository on the Alpine container.

**What is happening:**

* The Ubuntu worker node gets the Alpine container and the GitHub repository containing the script successfully.
* The GitHub repository is unzipped to `/home/Octopus/work/xxxxxxxxx-xxxx-50` (notice the `50` at the end). This is the current working directory for this step.
* The Ubuntu worker then spins up the Alpine container successfully, but mounts the **wrong** directory. It mounts `/home/Octopus/work/xxxxxxxxx-xxxx-51` (notice the working directory has changed `51`).
* The script attempts to execute an fails with `standard_init_linux.go:211: exec user process caused "no such file or directory" ` which appears to be a Docker error message. A verbose message states that `Process /bin/bash in /home/Octopus/work/xxxxxxxxx-xxxx-51` exited with code 1 `

**What I have already tried:**

* Running the same steps above but directory on the Ubuntu worker. It is successful as the working directory is not changing from `50` to `51`.
* Moving the package to `/home/Octopus` (as this directory is mounted within the Alpine container), then using an inline script (i.e. copy/pasted code directly into the step rather than an external script from GitHub) to call the script that was moved to `/home/Octopus`. This fails as the inline script in the step is being placed into working directory `50` then `51` is being mounted to the container.
* Simply running an inline script within a container. Also fails with the same issue of the wrong working directory.


Any help to be able to even run a `Hello World` script from within my Alpine container will be greatly appreciated!!!

https://redd.it/lautoz
@r_devops

Is Jenkins mandatory for beginner?

Hello,

I wanted to pick up on CI/CD tool for my next dev project just to learn how it all works. I wanted to make use of GitHub Actions, since I use GitHub extensively. However, everyone everywhere recommends to learn Jenkins, and I get the feeling that it's everywhere and I will miss out. Is it good idea to learn something else first, like mentioned GitHub Actions? Are those skills transferable between CI/CD technologies?

Thanks :)

https://redd.it/larz2v
@r_devops

Is The DevOps Handbook. Good read to learn and get into Devops?

I am leaving oking for a book to read and I keep seeing Project Unicorn and The Devops Handbook around. I read The Phoenix project which I liked so I am going with something baking that line

https://redd.it/lbczug
@r_devops

Discussion: Agility

I've been reading The Phoenix Project. I quote, "...get your build process automated." "Get humans out of the deployment business. Figure out how to get to ten deploys a day." (Chapter 30)

Getting 10 deploys a day was just a number that Erik threw out as a baseline for Bill to work towards. But, that number can be at any threshold that works for your business.

I wanted to open this up to a discussion about agility in your day to day.

1. What does your current build process look like? (Is it fully automated from Dev to Prod? Is human interaction required?)
2. How did you get your build process automated? (tools/solutions used)
3. How many deploys are you pushing a day/week/month?
4. What is your deploy frequency? (on demand/daily/weekly/monthly?)
5. What constraints or bottlenecks, if any, are you still hitting?

https://redd.it/lb99en
@r_devops

Client side javascript usage - best practice how to analyze it?

So we have moved our applications to the cloud in Azure Kubernetes Services. We have the prometheus stack installed for some interesting analysis.

Our main website is a react clientside website. We want to monitor how our users use the website. I am talking what menu items they press, what configuration preferences they have stored in their local storage etc.

We already have a method to store "server side" metrics via Prometheus.net (it's a .net application).

I have looked into Azure Application Insights. They mention things like monitoring Retention, Funnels and Users, sessions, and events analysis. I am not sure if this makes sense for our scenario.

I am curious, what is the best practice way to gather this type of clientside data?

https://redd.it/lb5nxo
@r_devops

CI-CD Platform (A new initiative) --- Trying to make CI-CD processes smoother

Hey Everyone,

I am a Product Manager & is driven by the aim of bringing innovation to B2B SaaS & delivering ground breaking product initiatives.

One of the opportunity areas identified is “Making DevOps teams less busy & more productive”. We envision to achieve this by conceptualising & building a “CI-CDaaS Platform” to offer seamless experience and efficient software delivery pipeline management without hiccups and much manual intervention.

If your daily life involves a tussle with the CI-CD processes, understanding the challenges faced by you will be of UTMOST IMPORTANCE to us and will help us to identify the right problem areas to solve.

Below is the link to a short survey to get your thoughts:

https://forms.office.com/Pages/ResponsePage.aspx?id=2bCoUwDZzEidflk13I1bF0GBbFQhc-5BqssHSqnq37NUMFk2QUFVWTZVSFJKNUxPUUdSMFlaSlBDWC4u

I would sincerely appreciate your response.

Cheers...!!

https://redd.it/larjvh
@r_devops