Gaming dev industry insight

I have been working as project manager (PM) within ERP for about 9 years as consultant and have managed different type of projects within digitalization which often are cross-functional with a larger group of stakeholders involved and a mix of agile and waterfall dev.

So I have lately been interested of continuing as PM though within the gaming industry and would like to have some insights of how those type of projects looks like on a high level, what type of roles are included, the different project phases, system used for knowledge sharing and tracking (ServiceNow, JIRA etc...).

Thanks in advance! 🙏

https://redd.it/n62pze
@r_devops

Oracle integration with git .

Hello r/DevOps
We had oracle database that we use . We store our schéma in SVN. We are now planning to migrate our code into git. What is the best way to setup git that will track any schema and table update . So the build will build what have changed on the database. we can build with Jenkins to our server.

https://redd.it/n5thor
@r_devops

Code profiling dashboards of monitoring tools



I already have datadog running along with cloudwatch that has the microservices running in Kubernetes without EKS. I want to have a consolidated dashboard along with code profiling insights, similar to continuous profiler of datadog . I am looking for a cloudwatch dashboard that has the metrics as :

* time spent by method/functions on CPU,
* garbage collection,
* lock contention
* I/O
* Monitor code performance variations in production by applying long-term, code-level metrics to alerts and dashboards
* Compare code behavior and impact across hosts, services, and versions during canary, blue/green, or shadow deploys
* Isolate the most resource-heavy functions to quickly understand what is causing a spike and decide whether to roll back or ship a fix

Though datadog is used in the environment and for continuous profiling dashboard I learnt that it would change$0.10 per compressed GB of log data that is scanned . Could anyone suggest any of such dashboard in aws cloudwatch along with prices.

Would really appreciate if added with two cents on other monitoring tools with low pricing.

https://redd.it/n5suds
@r_devops

Grafana and AWS CloudWatch Urgent

I want to obtain custom metrics like mem utilization and project them in Grafana


I am successful in configuring custom metrics in cloudwatch but can't able to obtain them in Grafana


The predefined metrics(CPU_Utilization) are working fine in Grafana but when I give metrics as "disk_used_percent" it's saying "no data"


immediate help would be appreciated

https://redd.it/n5j564
@r_devops

Direktiv: serverless custom plugins in Go, Java, Node, Python or Rust (or anything)

G'day DevOps,

We previously posted about our open-source project for serverless workflows called Direktiv. Since then we've added examples on how to integrate and run your own plugins / containers in the platform. We've added examples to the GitHub repo:

https://github.com/vorteil/direktiv-apps/tree/master/examples

We've also written an article which we hope would help:

https://blog.direktiv.io/direktiv-serverless-custom-plugins-in-go-java-node-python-or-rust-or-anything-1b41a257af91

Any feedback as always welcomed and helpful!

https://redd.it/n6jo5m
@r_devops

Projects to work on in personal time?

Hi guys,

I'm starting to get into DevOps, currently in help desk. I'm working on my Linux+. I'd like to do some projects on the side to get more familiar with aspects of devops in practice, but I have no idea where to start, or the projects I look up sound like gibberish. I need an ELI5 project, lol. Anyone have any ideas/links?

https://redd.it/n5i9ph
@r_devops

What tools are you using for log/event monitoring?

I just started working for a company that wants to make better log monitoring/management tools for DevOps individuals/teams. They have great engineers, but all come from enterprise backgrounds so they don't know exactly what smaller teams need.


I always worked solo in web dev so I used pretty basic setups/tools. It was simple enough for me to jump into logs directly to investigate. So I also don't have a lot of experience here.


I was wondering 1) what tools are you using that you love, and 2) what is still missing from those tools? I'm hoping your feedback will help point our team in the right direction!

https://redd.it/n5gt1o
@r_devops

enter the abattoir - Building a la carte gitops tooling for microservices

I wrote this about our journey to microservices at Achievers. We wanted to create a self-serve deployment model to allow engineers to own their service in production.

https://achievers.engineering/enter-the-abattoir-ee5e2019f0b3

https://redd.it/n5fkql
@r_devops

Suggestions on what services to choose for migrating to AWS

Hi all.

I'm interested to migrate my application to the cloud and specifically to AWS. The thing is that I've never before had an experience with these platforms and how to choose based on your needs.

So here is a brief technical description of my app. It is just a JAVA spring boot API that uses Maria DB and Couchbase for data storage. Some days ago, I was reading the documentation of the Chouchbase their suggestion about an r4.4xlarge instance only for hosting the Couchbase.

So based on my little knowledge of that kind of stuff, I thought to host the rest of the app within an a1.4xlarge general purpose instance.

One more piece of info that could be helpful to decide is probably the traffic of the app. So based on some exaggerated calculations there could reach 4.750.000 requests/month.

Based on all these are the above instances wise choices? How would you approach this migration? Any ideas, tutorials, and tips are very welcomed.

https://redd.it/n5dv9b
@r_devops

Strategy for alerting on database when query results differ b/w DB

What would be the most standard way of alerting if some values in database vary from environment to environment? I would like to have a high level idea of the tooling/components required to do this, ideally FOSS.

I've seen alerts on single query using Redash but i doubt i would be able to correlate the results of queries to different databases.

EDIT I'm also struggling to find the right combination of search keywords to properly google and get relevant results /EDIT

Context:

I have applications running in different environments with rds or aurora databases depending on the application. I would like to be alerted if there is different results for the same query in different environments.

https://redd.it/n6ib3l
@r_devops

How to make all my traffic HTTPS even if they attack the ip?

I have a server running apache and I have an angular app running on port 3000. Then that is bind to the port 80 and 443 thanks to the Apache configurations and makes the redirection to https, but if I attack the ip directly it doesn't do it.

How can this be done?

(Hopefully I was clear enough)

https://redd.it/n6hqkj
@r_devops

Thoughts on Splunk observability tool?

I know people have strong feelings either way on Splunk, especially in the DevOps world, but I've heard good things about Splunk's integration of SignalFx and Omnition into a new observability / tracing / monitoring tool. I believe the idea is to eventually fold in capabilities from Plumbr (seems to be some niche APM capabilities) and Rigor (digital experience monitoring) into the offering as well.


Has anyone looked at it / used it? They are also including a logging solution integrated into the suite called Log Observer.

https://redd.it/n6ccfl
@r_devops

Is it possible to describe tests with xUnit so that the description is displayed in DevOps?

Standard CI/CD pipeline that's running tests on every release. Does anyone know if it's possible to add descriptions to those tests so that they are displayed in DevOps?

https://redd.it/n5b7b7
@r_devops

Cloudflare: I'm using it wrong?

I've been using Cloudflare for a few years now, I manage a few websites and management applications, with therefore restricted areas that contain personal data of many people.

At the moment all this data goes through Cloudflare, so Cloudflare could theoretically see and log all this personal data.

Should this concern me? Should I handle the data communication in some other more confidential way?

What are your experiences and thoughts about it?

https://redd.it/n6xl5x
@r_devops

Fluent-bit syslog input doesn't provide syslog Client hostname/Addr?

Idk if this is the right sub (as there doesn't seem to be a standard fluentd/bit sub) but I am working on log aggregation and filtering of physical devices and I have decided upon using fluent-bit as the syslog aggregator of these devices (which natively can forward their syslog to a pre-defined host/port). I am able to parse the syslog messages emanating from these products with the following basic config:

[SERVICE]
Flush 5
Daemon off
Log_Level debug
Parsers_File parsers.conf

[INPUT]
Name syslog
Alias xsync_syslog
Parser syslog-rfc3164-local
Listen 0.0.0.0
Port 514
Mode udp

[OUTPUT]
Name stdout
Match *
however I see the syslog client connection's address is not included in the event logs:

[0] syslog.0: [1620233326.000000000, {"pri"=>"185", "time"=>"May 5 16:48:46", "ident"=>"notifyd", "pid"=>"1979", "message"=>"In Sync"}]
I've used logstash in the past and it seemed to automatically add the client's hostname to the event however I cannot find any way to do so with fluent-bit (even after reading the documentation unless I missed something). My current solution would be to forward the syslog messages to another service, such as syslog-ng which can add the host info to the messages, and then to fluent bit however i'd like to use as few service as possible. Any suggestions/recommendations?

https://redd.it/n7512e
@r_devops

Face Palm

Today I learned 90% of my company's multi-million dollar revenue generating steams rely on 3 database backups :(

https://redd.it/n73y8w
@r_devops

How do you organize/track your maintenance needs?

Most of my background is strictly in software engineering, but I just joined a new company and our team is hybrid software/ops engineering.

We've got a ton of out-of-date stuff and it's hard to keep track of all the different things that need to be updated/migrated/maintained - OS versions on our cloud VMs, kubernetes version, old language versions (Ruby 2.1, Python 2.7) still in use, old/unsupported Docker images, etc.

Googling around, I haven't come across any industry best-practice thought-leadership kinds of solutions for this, so I figured I'd ask here. How do you keep track of all the stuff your team has to maintain? What works? What doesn't work?

https://redd.it/n74fjq
@r_devops

Has anyone used the O'Reilly book "Python for Dev Ops" for self study, if so would you recommend it to a newb with intermediate python and linux/bash background? Any other materials you'd recommend? I have an O'Reilly account through school if that matters..

Python programmer looking to get into devops, have spent some time learning Linux fundamentals and Bash Scripting. Looking for a good book or video course to follow. I also looked at Kode Kloud but couldn't tell if it was bloat (nearly every course has redundant sections, same videos being used over and over in multiple courses in the learning path etc).

https://redd.it/n70v83
@r_devops

What tools does your organization use for storing binaries?

What tools does your organization use for storing binaries?

How is your experience with it? Any complaints?

https://redd.it/n72406
@r_devops

Load Testing Tool

Can anyone recommend a good Load Testing tool? Not too complicated. Fairly straightforward to install. Preferably free.

https://redd.it/n70qfn
@r_devops

Is there a metrics endpoint for thanos querier which shows all the metrics from the stores and not just thanos itself?

I tried /metrics at end of the thnaos querier url, but it only shows the thanos metrics not the stores metrics that are connected to it

https://redd.it/n6yozh
@r_devops