How do you debug and log CI docker-build failures?

As intended, I have Jenkins Pipelines connected to Github repositories of my developer's services and a function that builds the service for them on commit. Sometimes, of course, the pipelines fail. My Jenkinsfiles are split into stages, but even that doesn't make it clear enough why it failed. More specifically, if the developer introduced a build-error, we have to scroll through logs until we understand in what layer the error occurred and why.
Is there any method or tool to extract build logs, errors and status without string manipulation or other Jenkins hacks? I could send this result to slack or any other place, but I need first to make it clear why the pipeline failed, and if it failed on build, why specifically did the build fail.

https://redd.it/10jgrih
@r_devops

is DevOps just another job now?

So I've been around a while and when the conversation and thinking began to change in my circles around 2010-2012, DevOps was a concept , a culture. Building on Agile principles and bringing in the thought leadership of the likes of Jez Humble and a dozen others.

It was universally felt at that time that you couldn't have a "DevOps engineer" and job postings for that role were mocked as recruiters and orgs not having an understanding of what DevOps was..

Rolling forward 10 years..DevOps engineer is now a commonly found standard role which seems to me to be an owner/enforcer of automation tooling..

Conversations I'm having with newer "thought leaders" sound very much like DevOps is just tooling and I'm doubting my own understanding or recollections of the past.

Seeking discussion and viewpoints on this ideally from others who were around pre 2012 and have worked through this evolution.

Does the original DevOps still exist? Did it ever? Or has it become something else now?

https://redd.it/10jnyyd
@r_devops

Career Options as a CS Sophomore

Hello everyone! I am a 2nd year Computer Science Student. I've been checking out DevOps quite lately and I eventually want to work as a DevOps engineer after graduation. However, as I've heard from this sub, I can't work as a DevOps straight as a freshman out of college since I may need experience as a software developer and internships are quite rare. If this is 100% true, what other career options can I purse that'll help ease me to getting eventually to DevOps (cloud engineer, solutions architect...?).

https://redd.it/10jnwu2
@r_devops

Learning how we can make code interviews better, especially for neurodivergent applicants.

I've been reading studies and anecdotes about code interviews and the plight of neurodivergent applicants (those with autism, dyslexia, anxiety disorders, and similar) and started writing about how to try to make them better. I'm not making any money on this work. I just want to share what I learn to improve life for everyone.

What I am asking is for ideas, stories, studies, support groups, corrections, or clarifications to improve what I have learned so far. If this goes well, I'll try to turn it into a talk to apply to present to events like DevOpsDays or other similar gatherings.

This is what I have so far. If it helps you, feel free to share it with those who may need to see it. If I'm just full of BS, also let me know so I can fix it. https://www.linkedin.com/pulse/your-code-interview-discriminatory-heres-how-fix-daniel-gentleman

https://redd.it/10jj06v
@r_devops

How to connect a message broker as an Argo event source?

https://medium.com/memphis-dev/connect-memphis-as-an-argo-event-source-5ae05bae01d8

https://redd.it/10jcswn
@r_devops

Experiences with Visual Studio App Center?

I'm requested to investigate this and decide if it is worth it for one mobile application.
What's your experience? Do you think it helped? Was it challenging to learn?

https://redd.it/10jclpq
@r_devops

Small team of data analysts using SQL, Python and PowerBI, should we use Git or Github?

Hey guys, I work in a small team of data analysts, I myself have been an analyst for 5 years now (1.5 with this company) and we're a small team of 5. We mostly write SQL code to query databases but have some specialty projects that use python to create sql db's that we are hoping to take to the cloud and also a ton of PowerBI reports. Is it necessary for me to put forward the business case that we we will need a organisational Github account to keep our code, would there be a cheaper version such using Git to version control files in our google drive ,or is that a bad idea? (please go easy on me, I watched a video about git on youtube on saturday night while rocking daughter to sleep so I have no idea what I even don't know, let along what I know.) Also is Github secure since the code we write queries organisational databses and the like, would we need to make any changes for security purposes.

https://redd.it/10jcljv
@r_devops

Introduction to DevOps

Free online course

Introduction to DevOps

DevOps helps in efficient software development, and this course aims at introducing you to DevOps, an in-demand industrial skill.

https://formationgratuite.net/Introduction-to-DevOps

https://redd.it/10jd3z4
@r_devops

AWS API Gateway error

AWS API Gateway is throwing - {"message":"Forbidden"}

​

My architecture looks like - Route 53 --> AWS API Gateway --> ALB --> Fargate

I created a domain using Route 53 and validated it. I attached this custom domain to API Gateway. I also added the ALB integration using private resource option and VPC link and the route I have configured is "ANY /{proxy+}". On my ALB, listener is port 80. I have opened security groups for pretty much all traffic for testing purpose. It works when I directly hit from ALB url. My ALB is internal but I tried it with Internet facing ALB also.

​

I feel like I am messing up in VPC Link, what subnet should I use private or public? I tried both.

​

I do not understand where this is going wrong, do tell me if I missed a step. Thanks!

https://redd.it/10iibyz
@r_devops

Work split on modules vertical or horizontal

I worked in cooperations where every developer had one module for himself to work on and if they weren't experts in their layer (e. g. databases) they would ask for others so while every developer was responsible for only his module each module was rather the result of teamwork than of just one individuals' work.

I am now working in a cooperation where a whole team of 5 developers works on one module. The database expert does one layer, the frontend expert does one layer, the deployment expert does one layer, etc. If the deployment expert does not have time you will have to wait a few sprints and if the deployment expert does not like a certain module, he might use his authority as an expert to delay things since other employees are not allowed to do his work since there might be errors. Management is scared of angry customers so they do everything to avoid that.

I know that nothing is black or white but which of the following ways of developing software in a company with SAFe and agile is better if one could even say that. My point of view may be highly subjective that is why I want to know the perspective of someone else.

https://redd.it/10ifcsv
@r_devops

I'm running k8s IPv4/IPv6 dual-stack in production

Curious about people's experience with this

View Poll

https://redd.it/10ih1cg
@r_devops

Anyone use AWS Managed Prometheus Grafana? Confused because it looks like a non-managed prometheus solution?

I started looking at Amazon's solution for prometheus to try to get away from managing my own prometheus database and stack and (like most AWS products) it seems to be designed in a roundabout and confusing way.

Looking at the architecture graph here, it looks like you still need to run your own stack and prometheus database, and you forward your data to a write endpoint. I was expecting to not do that and to simple be able to direct their managed prometheus instance to scrape my exporter endpoints.

Am I missing anything here? Has anyone made this work with their use case?

https://redd.it/10hvvwi
@r_devops

From your experience, what are some use cases that make you use an APM provider like Datadog, NewRelic, blah, blah? Instead of lean open-source solutions (Prometheus, Jaeger, Loki)?

Can you guys give me actual use cases instead of a feature list?

https://redd.it/10k0oc8
@r_devops

Taking over internal tools built by ppl who quit (DevOps/SRE)?

So,

Ppl here say that there is no DevOps without Dev part, so lets assume someone wrote very complex internal tooling that is extensively used by the company.

But the ppl who wrote that quit the company some time ago. The knowledge about how stuff works in details was lost.

You are left with various Java and Go services that are required by the platform to operate but you have no idea how they work.
Most stuff works based on magic injections of extensions.

Whats your methodology to reengineer all knowledge that was lost :D ?

https://redd.it/10k4tgj
@r_devops

Datadog questions

Hi guys, where do you ask your datadog related questions? i see their r/datadog channel is dead and their slack has 0 replies in most of the questions, thanks!

https://redd.it/10k1gnc
@r_devops

Help us gather feedback in the annual community driven AWS survey

This is a yearly survey to collect data on the the state of AWS and related services. The data collected will be released publicly as a resource for all. The more people who submit the more meaningful the data will be, which is why I'm posting it here.

This survey is in not supported, sponsored or endorsed by AWS. It is unofficial and is entirely community made.

After using the State of Javascript website many times, Pete wanted something similar for AWS. After asking around at re:invent 2022, he couldn't find anyone who had put something like this together, so he decided to kick it off.

You can help spread the word and fill it out here! Thanks everyone.

https://answersforaws.com

https://redd.it/10kcj20
@r_devops

Best CI Service for Use with Gitea?

Hey all, I'm looking into deploying my own development environment among other tools that I'm currently setting up on Kubernetes (K3s) and was wondering if there have been any new players in the CI space.

Last I checked, Agola and Drone are the most popular. I tried Woodpecker initially, because it's a fork of Drone and I really want something truly FOSS if possible, but immediately had issues with the log output not being shown in my pipelines. I don't know what it's caused by, but the fact that Woodpecker is still far from a v1 release means it'll have a couple of these issues that I'd like to avoid.

Agola looks great, but the docs are still quite slim and don't mention a setup that doesn't rely on volumes. I want the setup to be distributed and want to be certain I can replace SQLite and whatever else Agola uses with Postgres/S3. Does anyone have experience setting that up?

Drone ends up being the default choice. I set it up, and it immediately worked. Still need to up my Containerd fsnotify limit, but other than that it does the job and has the largest ecosystem among the Gitea-supported CI services.

Between Drone and what I currently was able to find, it seems I'll have to either wait for Gitea to complete their own implementation of CI/CD, or Agola/Woodpecker to improve their documentation so I can solve the problems I've had with them.

https://redd.it/10k61p1
@r_devops

Getting put on pip has made my fears turn into a reality and shaken my confidence.

I've been in the industry for 3.5 years. 1.5 years at my current company (consultancy) where I was about to be put onto pip for under performing. Long story short, I've handed in my resignation and got two offers elsewhere.

My issue is that I had fears of this happening when I left my first company of not knowing enough and that fear has become a reality. The two offers I have I'll be one of two engineers. Which means I relied upon and this pip has really shaken me. Which will mean I'll be heav I feel I need to be in a team of engineers so they can support me and I can learn from them.

They also pay around 10% more, which is also worrying me as higher pay means higher expectations. I couldn't even hack my current job so does asking for more money seem silly?

Can anyone provide me with some advice?

https://redd.it/10ketz7
@r_devops

APM / Observability

Can someone please point me to a reseller or Systems Integrator partner that works with different Observability vendors such as Datadog, Dynatrace, New Relic etc. We would like to speak to someone who would be able to compare the pros and cons of these different vendors, and any would have insight into customer feedback on these products. If you used a reseller/partner when choosing your Observability vendor, please share.

Thx.

https://redd.it/10k8wyc
@r_devops

Best practice for building an internal developer platform

Hi guys,

QQ: We have a green-field project where we are planning to build an internal developer platform with backstage, crossplane and argocd. We don't have much experience as everything is new and we are learning as we go. We have some internal discussions on the team, I think the platform idea changes the development processes, therefore such solution needs evangelisation within the organisation and adoption from the teams, which will require a migration to this new approach.

The other part of the team wants to fit the old processes somehow within the platform and I just don't think how it could work. There's some resistance to changes mostly from dev teams and if we tell them here's a new tool, you need to change how you work and now you own your infra might cause a backslash. Suffice to say It would be messy and very complex to fit our current way of doing things to this new concept.

How should we go about it? We are using Azure, should we even have a different subscription, with different architecture? How can we sell this to management and dev teams?

Any hints would be greatly appreciated. Thanks

https://redd.it/10k20bg
@r_devops

Is 80k/year enough for mid level engineering in major cities in Canada?

I been in DevOps for 3 years now, been in IT for 6 years, I make 120k/year remote.

2 years ago I remember finding a lot of remote jobs for 120k+

The last few months I've been getting a lot of LinkedIn recruiters messaging me offering interviews for non-remote roles in Downtown Toronto for 80k/year.

80k a year after tax in Ontario is about 4,500$/month.

Rent in Downtown Toronto is 3k/month for bare minimum places.

I'm not looking for a new job, I'm just wondering what ya'll think of this?

https://redd.it/10kgunc
@r_devops