Where do people host internal jobs?

I've run into situations where a job or script is needed by non-technical team members. These scripts might be as simple as one or two API calls to our backend, a SQL query, or a monthly report generator. Typically, we tell these folks to make the calls from Postman or have a Jenkins job they can input a few params into and run (we usually want to keep it simple and avoid building UI's). However, it feels weird giving this much access.

Has anyone else run into this problem? I'm wondering if there's any better solutions out there.

https://redd.it/ptdgpl
@r_devops

What do you, as a DevOps, use for infra downtime prevention, APM, and log management?

Hello all!


I'm new to the DevOps world and want to understand what solutions are worth relying on when the thing comes down to anomalies tracking, log analyzing, APM, alerting.

I had an experience with Zabbix, Datadog, InsightCat. You've probably heard about them. According to my colleagues, these solutions are the leaders. Also, we don't forget about ELK stack, obviously :)


I would appreciate your help. Thank you!

https://redd.it/pt4juj
@r_devops

What is DevOps Life Cycle?

DevOps practice that aims at merging development, quality assurance, and operations (deployment and integration) into a single, continuous set of processes.

DevOps roles include development, IT, operations, security, and support.

DevOps is an approach to culture, automation, and platform design intended to deliver increased business value and responsiveness through rapid, high-quality service delivery.

DevOps is complementary with Agile software development; several DevOps aspects came from the Agile methodology.

📷

Plan: Requirements and feedback are gathered from stakeholders and customers and it is used to build a product roadmap to guide future development.

Code: Involve software designs to writing code, designing infrastructure, automating processes, defining tests, and implementing security.

Build: The Build phase is where DevOps really kicks in. Once a developer has finished a task, they commit their code to a shared code repository.

Test: This phase Involves continuous testing (manual or automated) to ensure optimal code quality.

Release: The Release phase is a milestone in a DevOps pipeline — it is the point at which we say a build is ready for deployment into the production environment.

Deploy: The build is ready for its release into production. There are several tools & processes to automate the release & to make it reliable with no outage window.

Operate: The operations team makes sure that everything runs perfectly. The environment scales automatically based on hosting service configuration.

Monitor: In this phase, monitoring, identifying, and collecting information about issues from a specific software release in production is taken care of.

https://redd.it/pt5m4n
@r_devops

The new "cat /etc/passwd" on developer machines is... ?

find . -name ".env" -exec cat {} \\;

https://redd.it/psqua2
@r_devops

Do you have to find work in your team or someone assigns it to you?

I am in a weird position where my manager does not assign tasks to anyone. I am of an introverted nature and do not have the habit of latching on to tasks during sprint planning, which others seem to do.

When I don’t have many tasks, I ask other members if they need help with something, most of the times they don’t as already 2 people are working on one thing.

This is causing me to become depressed. I have been pairing with one teammate, but he manages to do things alone, so he doesn’t need my help. I already mentioned it to my manager and he mentioned that its okay, still keep working with him. I don’t want to upset my manager, but seems like he doesn’t think well of me, which is happening for the first time for me.

I could really use some perspective on this. I am planning to move to backend because of this, preparing on my own, not sure if the same happens there as well.

Thank you

https://redd.it/ptp86d
@r_devops

Retry curl command in jenkins pipeline

I'm trying to run my integrationtests through Jenkins but I have trouble. My full step look like this:

sh 'docker-compose -f docker-compose.dev.yml up -d'
sh 'curl -sfv --connect-timeout 30 --retry 15 --retry-connrefused --retry-delay 2 https://127.0.0.1:8181/health'
sh './gradlew integration'

But when I call the curl command I get: Recv failure: Connection reset by peer
* Closing connection 0

If I run a sh 'sleep 30' before my curl it passes which added to the fact that it fails in around 5 seconds leads me to believe that it doesn't actually retry but reads the exit code from the first curl command.

My question is how can I either retry my curl or await my containers dynamically without a sleep or similar hardcoded solutions?

https://redd.it/ptqgt6
@r_devops

A new voyage in the sea of observability

In the observability market, new tools based on open-source projects as well as commercial solutions are emerging and it can be difficult to understand differences and advantages. So if you want to learn more, check out this new article and find out why NexClipper is embarking on this exciting new voyage!

https://nexclipper.io/nexclipper-a-new-voyage-in-the-sea-of-observability/

https://redd.it/pto42a
@r_devops

Securing Serverless Applications with Critical Logging

In this article, how serverless architecture can benefit your application; graceful scaling, cost efficiency, and a fast production time are just some of the things you think of when talking about serverless.

But what about serverless security? What do I need to do to ensure my application is not prone to attacks?

Read here: https://towardsaws.com/securing-serverless-applications-with-critical-logging-2a2d0da8697d

https://redd.it/ptoznz
@r_devops

Terraform loops are improved be still complete rubbish

Fight me

https://redd.it/ptuq21
@r_devops

GITLAB CI/CD PROCESS NOT STARTING

Notes:

* CI/CD is already set up across all repos

* new repo is made following the same structure and has the correct .gitlab-ci.yml file

* runners are available

yet, after code is pushed, the pipeline doesn't start. It says the pipeline isn't setup... So i went to the settings page for it --> turned off CI/CD --> saved --> turned on CI/CD --> saved --> no luck

can anyone suggest next steps I can take? The CTO is away and i'm slowly learning this but have hit a roadblock

https://redd.it/ptxedx
@r_devops

SilverSurfer - An OpenSource project to check ApiVersion Status and provide Migration path for Kubernetes objects when upgrading Kubernetes to 1.22 or any other.

Hey Everyone, as Kubernetes released its version 1.22, Developers and DevOps Engineers need to upgrade Kubernetes Objects before upgrading Kubernetes. It's a tedious task to know whether the current ApiVersion of the Object is Removed, Deprecated or Unchanged. We thought why not build a tool, Silver-Surfer, that would not only validate against the given Kubernetes version but also provides a Migration Path to a newer ApiVersion. It shows exact errors which need to be resolved for migration to newer ApiVersion as well as specification errors with respect to the provided ApiVersion in case it is not removed.

https://github.com/devtron-labs/silver-surfer

I know that there are other tools that provide similar functionality but they seemed Inadequate

Kubeval \- Well known, It only validates against the given Kubernetes Version but doesn’t provide a migration path

Kubent \- Only provides Info about removed and deprecated api but no schema validation

Kubepug \- Only checks whether the existing objects have any Deprecated ApiVersions

Silver-Surfer uses openapi spec provided by the Kubernetes with releases, for eg. in case of target kubernetes version 1.22 openapi spec for 1.22, to validate the Kubernetes objects for depreciation or non-conformity with openapi spec. This allows it to validate against any kubernetes version as soon as its specs are released on the github kubernetes project.

It's a side project we took up as these issues were a hassle upgrading one of our Platforms, Devtron.

Would love to know what you think of this, any suggestions and Contributions are welcome :)

https://redd.it/pty4bh
@r_devops

Any Unity (Game) DevOps Engineers Have Advice For CI/CD?

I am setting up the CI/CD for game development in a repository. I am using gameci and trying to get it to run in AWS but it is proving to be more difficult than expected. Our current stack is GitHub actions, AWS, and Github.


if you work on game development with Unity, what is your current CI/CD workflow and what advice would you have for me?

https://redd.it/pu035w
@r_devops

Why does Bazel not get more love?

We just ran a PoC to port over all our dev, build, and deploy tooling to run on Bazel, and so far it’s been an absolute dream. We have a medium-sized codebase, probably a bit small for Bazel’s ‘sweet spot’. But, forgetting all the reasons why Google made it, having one set of tools that compiles and deploys all your code to any environment, and with only the changes that are necessary, feels like the future.

We’re thinking about rolling this out to the whole of our org, but we’re getting pushback because, frankly, it’s an unknown. There aren’t that many articles on it outside of the C++/Java world, and we’re a JS/PHP/Go shop. But why? There seems to be plenty of support in the actual code. It feels like a diamond in the rough.

I could talk about it for hours but I’d love to hear your opinions. Did you consider adopting it? What did you ultimately end up choosing?

https://redd.it/pu30to
@r_devops

Does anyone use Hashicorp's Waypoint? Thoughts?

Hey all. Just wondering whats the outlook of this tool almost a year out? I am a big fan of Hashicorp's tools, and Waypoint is exciting to me as I've transitioned to mainly application development. What are people's thoughts on it?

https://redd.it/pu3xrn
@r_devops

Monitoring rootless Podman containers - Cadvisor, alternative solutions?

We have some services we've been running with Docker on some edge hosts, but some requirements have changed (supporting RHEL8, namely) and we need to start using Podman. I've got our app up-and-running, but cannot for the life of me get CAdvisor to work with Podman (FWIW, we are running Podman rootlessly).

It doesn't seem like CAdvisor currently supports Podman (https://github.com/google/cadvisor/issues/2424), but maybe there is some workaround.

Have you implemented container monitoring with CAdvisor + Podman? If not, what are you using to collect information about metrics (Mem, CPU, etc.)?

https://redd.it/pu3myn
@r_devops

Concourse CI Pipeline that can set a variable from a file in Git repo

I'm experimenting with Concourse CI pipelines and really enjoying the process of grabbing an app, building it into a container image and pushing that image to a registry (Harbor in my case).

One thing I'd like to do, but after a bit of research haven't quited figured out how to do so is - Have my pipeline use a Gitlab resource to read the contents of a file in the Gitlab repo and set that string (contents of the file) as a variable for another resource/task to use.

I guess part of the problem is wording exactly what I'm hoping to do.

For an example we might have a simple text file "config.txt" living in a Git(lab) repo. We would want the Concourse pipeline to look at /grab/ pull that text file and store it's contents (a string) as a variable that could be used elsewhere in the pipeline.

https://redd.it/pu1oz9
@r_devops

Architecture Review from Peers

I'm trying to move my org's CI pipelines from Jenkins to GitHub Actions. As part of the transition, I want to still support Jenkins in case we run into difficulties. We have some CD pipelines in Jenkins and the rest in Rundeck (legacy).

I want to introduce a service in between our CI and CD pipelines that would be a router of releases and deployments to the appropriate platform and pipeline. I'm thinking about leveraging Brigade as it'll allow us to add some event-driven scripts to direct traffic appropriately. Here's a rough design:

* GitHub Actions pipeline creates an asset or Jenkins pipeline creates an asset
* Brigade receives an event and retrieves the details needed as a parameter to the CD pipeline
* Jenkins or Rundeck job is kicked off and handles the release and possibly the deployment

We want to avoid storing secrets in GitHub Repo Secrets. In addition, while I like Azure DevOps, I want to avoid that for now due to a lack of resources.

Let me know if you have any questions.

https://redd.it/pu8dgz
@r_devops

Portainer and Canonical Expand Partnership Launching Business Charm for Charmed Kubernetes

Portainer has announced the launch of its Portainer Business Charmed Operator, allowing for seamless integration with Canonical’s Charmed Kubernetes distribution.

The new Portainer charm allows users of Canonical’s Charmed Kubernetes distribution to automatically install and integrate Portainer Business as part of the Kubernetes cluster deployment process, using Juju, the Charmed Operator framework.

https://www.portainer.io/blog/portainer-business-charm-launched-for-canonicals-charmed-kubernetes

https://redd.it/pu7lje
@r_devops

Hello all! I’m someone who is just starting out in DevOps

I was hoping I could get your advice on whether I should start a blog writing about stuff I’m learning about. my biggest challenge is I don’t have much experience writing a blog and I don’t have much experience in the industry. Although I do have lots of ideas about topics I want to write about. So really just hoping to get some motivation on if this is something I should do.

https://redd.it/pu919y
@r_devops

Analytics to devops

I m tableau developer with 3 years of experience and good knowledge in Machine learning .I m right now confused to pursue which one as my next career transition I'm so excited about devops and same time interested in ML . Should I leave my analytic experience and start fresh in devops does my analytics experience will be barrier to make jump?
I have knowledge in Jenkins ,python ,Aws ,SQL and basis Linux stuff and tableau administration.

https://redd.it/pu8g7y
@r_devops

Sharing files securely using S3, CloudFront, and signed URLs

With terraform example.

Read on: https://towardsaws.com/sharing-files-securely-using-s3-cloudfront-and-signed-urls-15e170365422

https://redd.it/pudu98
@r_devops