Should we test Infra/provisioning/configs ?

That's a large topic so let's just put an open question. I would like to know your take on this.

I'm thinking of writing an article about this subject if I can't find what I need.

I've thought about it a lot (and still do), and read multiple articles relating this subject, and tried various libraries and methodology (TDD).

What do you think should be tested, and what's your rationale to test it (or not). Also, I would very like to hear about your personal/professional experience on that matter, and if/how rewarding/expensive the adoption was.

Thank you

https://redd.it/nmswb5
@r_devops

Monitoring multi-dyno Heroku app

Hello there.

I'm trying to set up some metrics monitoring on Heroku which would eventually be wired to Grafana Cloud. The formation on Heroku is multi-dyno (one web dyno running Rails and two dynos for some workers), with dynos potentially scaling up (especially web dyno).

I've gave a shot at setting up Prometheus, trying out different Ruby gems (discourse/prometheus\_exporter and prometheus/client\_ruby) but with no luck. The problem I'm facing is that dynos are isolated, so even both of these gems have multi process support, it just doesn't work on Heroku. E.g., the official Prometheus client has DirectFileStore
which writes to the same file on the filesystem so that different processes can write to it and then expose the same metrics when /metrics
is called. This doesn't work on Heroku because each dyno gets its own filesystem, so the file can't be shared.

Another option I've looked into potentially is using StatsD, but that will require running a deamon parallel with the Rails app or workers.

Was anyone in a similar situation before? Or do you use something totally different for your metrics for Heroku apps?

Thanks in advance!


P.S. I've posted the same question over at r/rails (link). Hope that doesn't violate any rules.

https://redd.it/nmscnc
@r_devops

Integrate Github with Rundeck

Is there a way to "natively" integrate github with Rundeck? Specifically, the 1st step of a job is to clone github repo to an inline script (step) so the job can always have the latest version of the script. Moreover, the code can live on github as opposed to an inline script (step) in Rundeck.

https://redd.it/nmsazg
@r_devops

Recommendations for Dashboard for Exec team and Business

Hi All,

Can this forum please recommend a reference architecture/implementation pattern for dashboard to measure Agile/DevOps metrics? We have just started on the journey and looking for something to measure where we are currently in a way that is easily visible to Business and the Exec Team.

Platform: Jira, Jenkins, Bitbucket Cloud, SVN (Some items will be migrated), k8s + Rancher, sonarqube On-Prem + Sonarcloud

**MVP:**

* Show completed stories within sprints tied into releases
* Show sonarqube stats for repositories
* Show commit metrics for sprints for repositories
* Read-only dashboard, no user input expected.

Things already considered:

* Hygieia
* Custom web app for dashboard using Angular, MongoDB etc. (likely more effort due to having to learn web development)
* DataDog

Anything else you guys can recommend? Leaning towards Hygieia, only issue is the lack of documentation.

https://redd.it/nn6e46
@r_devops

Github Example Projects for strengthning my Job application

Guys, In order to strenghten my job application I want to build a Github profile with some good projects that recruiters might find interesting. However, I have no idea on what to post on Github since most of the stuff I do seems to me to be very trivial since I am still learning and a newbie to this field. I had an idea of posting a repo that helps new users on learning DVCS especially git, but to be frank it doesn't look like a project to me or anything that has not been done a hundred times already (I know I'm stupid). Anyways can anybody suggest ideas on what to build and if anyone can share their github profile that has projects, so I can get a rough idea on what sort of things to do. If that is or seems unethical please tell me and forgive me since English is not my first language

https://redd.it/nn585n
@r_devops

Any trusted software review sites? Jira, sharepoint, Monday.com, Asana, etc

Hey all.


Trying to help my company make an educated decision using hard data/ or real reviews. Is this a thing? Can I find trusted review sites, or trusted data surrounding specific professional software (revolving around project, task, and process management).


Thank you!

https://redd.it/nn0dce
@r_devops

What is the difference between Engops and Devops?

I have only recently seen the term "EngOps" thrown around but I don't understand what it is. Anybody have any insight?

https://redd.it/nn2yrt
@r_devops

Any course that would help me reach a level of proficiency to architecture such a complex architecture?

https://youtu.be/Rgx8dpiPwpA?t=224

​

I am a full stack, I am a "senior" developer, but I am light years from being able to architecture a system that's as highly scalable and complex like the one shown in the video, so could you maybe recommend some video tutorials that would help me reach that goal some day?

https://redd.it/nnagxi
@r_devops

Which are the best online platform to learn DevOps hands on which is close to real world?

Which DevOps course is close to real world scenarios? Iam a complete beginner and would like to learn hands-on and prepare for interviews. In this context iam looking for resources/websites which can give as much hands-on as possible and equip me to do job in the real corporate setup

https://redd.it/nn1sj7
@r_devops

CI/CD as a NO-CODE Service (Start-up idea validation)

Hey guys,

I have following idea for a startup and wanted to ask your opinion about it. I am not a pro in creating CI/CD pipelines. For some small project of mine I had to invest a lot of time to get my application built and deployed. And most of my projects have the same steps, which had to be configured again and again. I mean you have to execute tests, package/compile, dockerize your app and to deploy it to some registry. For java you will typically use maven or gradle, for JS/TS you will use npm. My idea is to create a service, where a software developer can upload the code or connect it to some git repo. The service should then automatically recognize which framework will be used and process the required steps. The user should have the possibility to configure the steps with a UI, which could do some autosuggestion or validation.

​

What do you think about that idea? The target group would be small teams, which cannot afford a DevOps engineer or just do not have the know how about CI/CD.

https://redd.it/nn15ij
@r_devops

Serverless Stonks checker app for Wall Street Bets: week 3 activity report

A few weeks ago we set up an #API to monitor hot stocks via the Wall Street Bets subreddit. Since then we’ve seen quite a lot of activity in the app.

In this article, we’re showing you some interesting findings: https://dashbird.io/blog/serverless-stonks-checker-activity-report/

https://redd.it/nmutd9
@r_devops

Is 39 too old to make a career change into Tech more specifically a Devops role?

Is 39 too old to make a career switch? I got turned down for a job that I thought had a great chance at. It was an entry level Cloud Position where they actually get you up to speed on cloud providers your first few months. Then shadow, and eventually on your own. I was even willing to take a pretty big pay cut from my current position (Mechanical Engineer). A couple interviewers even mentioned I was more advanced than what the role required. I have 3 AWS certs (SAP, CDA, SAA). The interviews went great, or so I mustve thought. They were hiring about 3-5 ppl for the same position, and found out today I got passed on. I have a very difficult time even getting my resume seen by the right people let alone getting a call back. Ive applied to hundreds of places within the past year with only a handful of interviews where ive since filled in and have  been filling in knowledge gaps that have showed up during these interviews. I have been applying at Jr level positions and rarely get an interview. Its been very defeating and today just made me feel like ive wasted so much time and effort in the past year to study with all of my free time and i do mean all (After work, weekends, even stopped going to the gym in order to study, Ive gained 30lbs in the past year). It makes me wonder that if at my age its just too late to enter the tech industry?

https://redd.it/nl7c51
@r_devops

Testing Suite for Terraform Projects

Hello /r/DevOps.

​

We're building a product in Terraform and are looking for recommendations on testing suites for our development process.

The product is a serverless, AWS-based management tool for our company.

​

We would like the deployment pipeline to verify pre-requisites on the AWS accounts we deploy to (ie roles or other resources created by external processes).

We'd also like to unit-test any lambda functions (developed in python)

And then do integration & end-to-end testing as needed post-deployment.

​

We're using checkov and tfsec for static terraform analysis, but anything we need to do with more advanced logic we are planning on writing custom testing fixtures in python.

​

We have looked at pytest, clarity, behave, moto, and a few others. What would be your recommendations based on experience?

https://redd.it/nl9402
@r_devops

Container run time scanning tool?

Hope all are doing well.
I have used container scanning tools like twistlock for docker image/ registry scanning.
now I wanted to achieve the same for container run time scanning , is there any recommendation tool ?

https://redd.it/nlcd57
@r_devops

Which operating system do you use for your CI/CD agents?

Hi r/devops,

I'm doing some research around modernising a CI/CD process and one of the things I'm curious about is what the share is between different operating systems for CI/CD agents?

Do any of you know if there's any published survey results/report from CI/CD vendors that presents this kind of breakdown?

I've looked at the Jenkins, GitLab, GitHub, GitKraken, StackOverflow etc reports but haven't found this information to be captured.

I'd equally welcome any anecdotal information about what you've seen in your experience (including reasons for why it was the case)!

And for good measure... I've made this post a poll to capture your passing votes :)

Thanks!

View Poll

https://redd.it/nlbwxe
@r_devops

How and where learn DevOps

I want to learn DevOps. What practical course would you recommend to sign up for?

https://redd.it/nlbj1f
@r_devops

ansible playbook execution using jenkins pipeline

Need to create a Jenkins job to upgrade tomcat using playbook , but getting below error while creating pipeline job

https://redd.it/nl9k8q
@r_devops

Podman 3 and Docker Compose - How Does the Dockerless Compose Work?

One of the main Podman 3 features is the support of Docker Compose. You can take any of your existing docker-compose.yml and just use it with Podman. In my new short video, I am showing how I moved from Docker to Podman in a real docker-composed application:


https://www.youtube.com/watch?v=15PFfjuxtvM

https://redd.it/nl9e8v
@r_devops

Rundeck ACLs

Im trying to configure a Rundeck ACL to allow a group to have access to only this project and 1 specific job in the project. The project has several jobs but I want the users to only be able to see the jobs I allow. I was thinking of creating a folder and only allowing jobs that are in that folder to be visible by the group.

https://redd.it/nl4o1p
@r_devops

Continuous Delivery from Git Repo to CPanel

There are so many tutorials to teach you to implement CI/CD to deploy apps, that are developed by using latest front-end and back-end frameworks, on firebase, aws servers, google cloud platform, etc. But this tutorial is to deploy a simple website or a web-app on a shared hosting. There are still many of us, who host their sites and apps in shared hosting, because the app is simple and the cost is low as well. Lets start to learn how to deploy your code to shared hosting via FTP (File Transfer Protocol) whenever something new is pushed to Bitbucket repository.

https://ravinduramesh.blogspot.com/2020/03/continuous-delivery-from-bitbucket-to-CPanel-FTP-Server.html

https://redd.it/nl2dcc
@r_devops

One ops team doing all releases is bad, right?

I work in production operations for a large public company. The culture here demands that the prod ops team be the team that moves releases from preprod to prod, and we don't allow product teams to manage their own production secrets, both seemingly out of fear of developers breaking things.

As we move from a lot of manual deployments to hopefully a future of actually automated CI/CD, there still seems to be a goal of my team pulling the levers to allow releases to move from preprod to prod.

I run into this attitude so regularly that I'm starting to doubt myself, despite my last job laying what I think was a great foundation for devops (each team owns everything from code to infra to pipelines). Is this sort of a thing I'm fighting with in my current role as much of an anti-pattern as I think it is? Or are there real reasons (perhaps regulatory compliance) why a monolithic production operations team would need to be the barrier between software developers and production?

Looking for both advice and a place to vent. Hopefully I'm not the only not-crazy person here!

https://redd.it/nkzosx
@r_devops