Reddit DevOps
270 subscribers
5 photos
31K links
Reddit DevOps. #devops
Thanks @reddit2telegram and @r_channels
Download Telegram
New relic Alert for VPN

I have vpn tunnels hosted on Aws. I want to create an alert if the tunnel is not responding for more than 5 minutes. Can anybody help me with this.

https://redd.it/nw0snz
@r_devops
Tell me your opinions about full-stack monitoring solutions

For those of you who have used multiple monitoring solutions, I'd like to hear your experience and your opinions about which is best and why. To be specific, I'm talking about solutions which offer log aggregation, host metrics, application metrics, APM, outside->in monitoring (synthetic checks), and alerting.

I've looked at Elastic, DataDog and New Relic. I think New Relic doesn't hold the prestige it once did. I'm my opinion, it has fallen behind it's competitors and become more of an enterprise solution. I have used DataDog briefly, and am a long time Elastic user/admin, but have never used the paid versions so no APM or "AI" features (correlation, anomaly detection, etc).

What do you all think is the best of the three, and why?

ETA: If I'm considering Elastic this time around, the paid features are definitely on the table.

https://redd.it/nwd2hn
@r_devops
How to transition from IT Analyst to DevOps?

Looking to possibly transition into DevOps.

Past:

Help Desk
NOC tech
Point of Sale Analyst
Web App Server Implementations
IT Analyst /Incident Manager at a Fintech (current)

10 YOE

I work with DevOps on a regular basis and it feels like it would be a great next step. Both in career growth and in compensation.

Figured I’d ask Reddit, what’s the top 3 things I can focus on to land a DevOps role?

GitHub actions? Azure proficiency? Python for automation purposes? AWS?

Thanks!

https://redd.it/nwevse
@r_devops
Best paas to host a wildfly aplication?

Hello everyone, in less than a week I need to put a wildfly application on one paas. It is going to be an ear and it also uses remote jms queues. There seems to be a lot of options but most of them dont support wildfly out of the box. The service has to be free because it will be used for testing for now.

https://redd.it/nwdzy3
@r_devops
How to Build SQL Database Deployment Automation Pipeline Tutorial

Hey guys,

Gijs Reijn just wrote a new blog post you may enjoy on the ATA blog.

"How to Build SQL Database Deployment Automation Pipeline Tutorial"

Summary:
Tired of manually deploying changes to your SQL databases? Learn how to to build a database deployment automation pipeline!

https://adamtheautomator.com/database-deployment-automation/

https://redd.it/nwh3yn
@r_devops
Limitation for consul-template to discover changes and invoke reloads in HAProxy.

Hello there,

I'm refactoring old consul-template (further called just consul), that generates HAProxy config and my goal is to reduce amount of reloads to minimum. Currently whenever service is being auto-discovered due to its auto-scaling, consul reloads my config. I'm also switching from static config generated by consul at every service change to so called haproxy server-template with KV for slot configs.

But I'm struggling to find any information related to how to limit consu to watch only KV changes not service changes.
- Is it like if something is used in config then consul watches for changes there?
- Or is it being invoked after every small change?

https://redd.it/nvul4b
@r_devops
Best storage solution for normalized relational data if I'm locked to GCP?

Hey /r/devops

Got a GCP question. If I have data that is relational and highly normalized, what's the best option for me on the platform?

I'm using BigQuery a fair bit in the same project, but the data I'm dealing with in there is completely denormalized, which the BigQuery docs says is the way to go.

The relational data that I'm storing isn't actually going to be queried often - instead my server running in prod will sync with it from the cloud every hour or so, and that's where the bulk of the live querying takes place.

What I'm looking for is a place to keep my data in the cloud (specifically GCP) so I can back it up often, query it offline, sync with prod/staging/dev environments. Should I still use BigQuery if I'm not querying the data from there often, but just using it for "lukewarm" storage to be pulled down elsewhere?

---

Edit: for context the relational data isn't huge. It's a bit under 30mb at most. The other stuff I'm doing with BigQuery is dealing with gigabytes of denormalized data (so I'm already using it in this project for other stuff)


---

Edit 2: Having the SQL interface on the data is still important - I'd like to query it while it's in the cloud as well (on top of the other stuff I mentioned like pulling it down into prod/staging/dev environments to be consumed by Postgres for example).

https://redd.it/nvtbhg
@r_devops
MAAS set default cloud-init script

I have a MAAS server that deploys Ubuntu workstations.

When I deploy, I paste in a bash script I made

Is there a way to set this bash script as default? So that MAAS would always use this cloud-init on machines I deploy?

Thanks ahead!

https://redd.it/nwjna3
@r_devops
Provisioning a preconfigured Nexus Repository Manager (NXRM) Docker container

Hi all, I've created a preconfigured NXRM Docker image, with an init-script - provision/entrypoint.sh,

Link to project @ GitHub - https://github.com/unfor19/nexus-ops
Link to Docker image @ DockerHub - https://hub.docker.com/r/unfor19/nexus-ops

Here's a TL;DR of what the entrypoint.sh script executes upon running NXRM:

1. Changes the initial random password that is in /nexus-data/admin.password to admin
2. Enables anonymous access - allows anonymous users to access localhost:8081 with READ permissions
3. Adds Docker Bearer Token Realm - allows anonymous pulls from local Nexus registry localhost:8081
4. Creates two Docker repository of type proxy
1. docker-hub - DockerHub
2. docker-ecrpublic - AWS ECR Public
5. Creates a Docker repository of type group
1. docker-group - The above Docker repositories are members of this Docker group

https://redd.it/nwl81k
@r_devops
How to make a social media app for your community?

The industry of mobile app development for social media is continuously growing. For example, Instagram is visited by over 500 million people every day.

And it’s never too late to come up to the market with a new exciting idea. Most people are always open to something new – just look at the enormous popularity of TikTok with 1.5 billion installations or Clubhouse that is currently #5 in the “Social Networking” category of Apple’s App Store and will be released on Android soon in 2021.

These days, you can build a digital network for entertainment and communication (e.g., to post short videos and find like-minded people), for business (e.g., a real estate social network), for sharing opinions, etc.

Do you want to create your own mobile app for social media? This article will provide you with essential information on the industry’s specifics, an app’s features, and development processes.

Before making a plan for how you will make your app, it’s helpful to gather more information on different social media, the prominent trends, and users’ expectations. You should also discover what metrics are useful to assess the popularity and how to make money with an app.

>“Social media is not a media. The key is to listen, engage, and build relationship”David Alston, author and entrepreneur

Indeed, social media are different from classical newspapers or TV channels. You need to create a community and actually engage with people, which gives you lots of challenges and even more benefits.

1. Interacting with your community directly. Once you create your own platform and a social media app, you establish the rules and communicate quickly and effectively, without any mediators.
2. Advanced user analytics. When you make a social media app, you can better understand your community, use smarter target strategies, and operate all social media marketing tools.
3. Built-in e-commerce options. With a customized social media app, you can easily monetize certain functions or add one-click purchases.
4. Safe spaces for creative and innovative ideas. Post and comment length, content types, functionality, or design conception – there are no limitations if you create and run a social media app by yourself.
5. Maximized reach and no distractions. If you make a bespoke app, you can operate social algorithms to show users more quality content based on their interests. There won’t be any distracting information (ads, news, memes) from widespread media, just you and your community.

All of these will be the result of bespoke mobile app development for social media. You need to elaborate your business idea and find a team of experienced designers and developers. And first of all, choose the niche to create a social media app.

HOW DO SOCIAL MEDIA WORK IN 2021?

>“The first rule of social media is that everything changes all the time. What won’t change is the community’s desire to network”Kami Huyse, PR & social media strategist, CEO of Zoetica Media

What earlier trends are still relevant:

Chatbots and artificial intelligence technology – though these trends appeared in 2017, they remain in demand among social media apps users.

Brands’ engagement with customers – people more often use social media as quickly working client support, while companies invest in reliable social media presence.

Social commerce – Facebook, Instagram, and others offer multiple tools for businesses and allow people to buy goods and services directly via social media.

Blogging on social media – people and brands publishing engaging content and share it with as many users as possible.

Once you have chosen a niche for your social media app, it will be easier to select its features and marketing strategies.

Here are some recent stats showing
How to make a social media app for your community?

The industry of mobile app development for social media is continuously growing. For example, Instagram is visited by over 500 million people every day.

And it’s never too late to come up to the market with a new exciting idea. Most people are always open to something new – just look at the enormous popularity of **TikTok** with [1.5 billion installations](https://www.businessofapps.com/data/tik-tok-statistics) or **Clubhouse** that is currently #5 in the “Social Networking” category of Apple’s App Store and will be released on Android soon in 2021.

These days, you can build a digital network for entertainment and communication (e.g., to post short videos and find like-minded people), for business (e.g., a real estate social network), for sharing opinions, etc.

Do you want to create your own mobile app for social media? This article will provide you with essential information on the industry’s specifics, an app’s features, and development processes.

Before making a plan for how you will make your app, it’s helpful to gather more information on different social media, the prominent trends, and users’ expectations. You should also discover what metrics are useful to assess the popularity and how to make money with an app.

>“Social media is not a media. The key is to listen, engage, and build relationship”[David Alston](https://www.crunchbase.com/person/david-alston), author and entrepreneur

Indeed, social media are different from classical newspapers or TV channels. You need to create a community and actually engage with people, which gives you lots of challenges and even more benefits.

1. **Interacting with your community directly.** Once you create your own platform and a social media app, you establish the rules and communicate quickly and effectively, without any mediators.
2. **Advanced user analytics.** When you make a social media app, you can better understand your community, use smarter target strategies, and operate all social media marketing tools.
3. **Built-in e-commerce options.** With a customized social media app, you can easily monetize certain functions or add one-click purchases.
4. **Safe spaces for creative and innovative ideas.** Post and comment length, content types, functionality, or design conception – there are no limitations if you create and run a social media app by yourself.
5. **Maximized reach and no distractions.** If you make a bespoke app, you can operate social algorithms to show users more quality content based on their interests. There won’t be any distracting information (ads, news, memes) from widespread media, just you and your community.

All of these will be the result of bespoke mobile app development for social media. You need to elaborate your business idea and [find a team of experienced designers and developers](https://exceed-team.com/blog/how-to-make-social-media-app-for-your-community?s=re&a=d). And first of all, choose the niche to create a social media app.

**HOW DO SOCIAL MEDIA WORK IN 2021?**

>“The first rule of social media is that everything changes all the time. What won’t change is the community’s desire to network”[Kami Huyse](https://www.linkedin.com/in/kamihuyse), PR & social media strategist, CEO of Zoetica Media

What earlier trends are still relevant:

**Chatbots and artificial intelligence technology** – though these trends appeared in 2017, they remain in demand among social media apps users.

**Brands’ engagement with customers** – people more often use social media as quickly working client support, while companies invest in reliable social media presence.

**Social commerce** – Facebook, Instagram, and others offer multiple tools for businesses and allow people to buy goods and services directly via social media.

**Blogging on social media** – people and brands publishing engaging content and share it with as many users as possible.

Once you have chosen a niche for your social media app, it will be easier to select its features and marketing strategies.

Here are some recent stats showing
that social media is one of the most effective tools for introducing specific audiences to brands, services, and products.

What types of social media apps are there?

As of today, there are ten types:

* Social networks
* Business networks
* Media sharing networks
* Interest-based networks
* Consumer review networks
* Anonymous social networks
* Community forums
* Blogging platforms
* Social gaming platforms
* Audio social networks

What are the most important metrics to assess if a social media app brings value?

* CPI or Cost Per Install
* CAC or Customer Acquisition Cost
* User activation
* User retention
* User engagement

https://redd.it/nwl7bl
@r_devops
AWS Loadbalancer && || Nginx reverse proxy

Hi all,

​

I am doing a project for which I have created terraform code that makes me:

VPC, pub + priv subnets, security groups, loadbalancer, nat gw, some ec2 instances (and necessary other stuff)

We are making a small app, with angular FE, a service BE and a DB. For a simple first step I made jenkins (in priv subnet) to deploy the app to another ec2 in priv subnet. There I wanted to run it as we do locally, just spin up docker-compose. It has 3 containers, mysql, springboot, and nginx serving the FE with a reverse proxy.

The loadbalancer serves 2 subdomains listening on 443: jenkins.mydomain.com and the-app.mydomain.com. I attached rules to differentiate between so traffic is redirected accordingly.

Now it almost works, but when I click on a link in the app that should make a request to the BE it gets blocked. If I docker exec into the containers I can ping them and that works fine.

I am new to this stuff and trying to wrap my head around all the traffic going on :)

Some questions:

1) I imagine the traffic going from 1 container to 2 directly without ever going outside of the docker network, but I guess that is wrong ... If so: the instance in priv network makes a call to localhost/api/something ... how does that go? Maybe I should allow some more traffic in the security groups somewhere? (now the ec2 only receives :80 from the public sg that holds the LB)

2) disregarding for now that the settings could be inproved for security, if the nginx settings work locally, should they work in this architecture? Or do I have to add stuff? It now is very simple:

server {
listen 80;
listen :::80;
servername localhost;

#charset koi8-r;
#accesslog /var/log/nginx/host.access.log main;

location /api/ {
proxypass https://flashcards:8080/api/;
}

location / {
root /usr/share/nginx/html;
index index.html index.htm;
try
files $uri $uri/ /index.html;
}

}


3) Is it more logical to add rules, and remove the reverse proxy completely? (does that work with necessary headers and so on ?)

Hoping to learn something more from you guys n girls here. Thanks in advance for any pointers!

https://redd.it/nwo4hc
@r_devops
The MTTR that matters

Hey folks! I see a lot of people use mean time to resolution as a metric for measuring how effective their incident response is, and I wrote a post on a better metric that you can start tracking!

https://firehydrant.io/blog/the-mttr-that-matters

https://redd.it/nwpoxj
@r_devops
Take the 2021 DORA State of DevOps Survey

Learn how to improve your team's software delivery and operations performance while providing insights into how other teams can improve.

https://cloud.google.com/blog/products/devops-sre/take-2021-state-devops-survey-shape-future-devops

Results from this year's study will be shared sometime around October.

https://redd.it/nwnkjx
@r_devops
Kubernetes monitoring: Which tools your reviewed and why you've chosen them?

Hi,



We are at the moment reviewing multiple tools for monitoring the microservice app in KubernetesAt the moment, the Datadog looks a bit pricy but more attractive. More integration options, tracing, super popular with the community, seen peers using it.

There are other options, like LogZ, Dynatrace, and others

Logz \- cheap, but looks like this is just managed ELK. So, we would have to cook it, just give more resiliency

Dynatrace \- more expensive, though popular. But, haven't heard any peers actually using it. Even though Gartner in the report puts the as industry-led (really??)

Own ELK - we would need to manage it, spend time and costs for maintenance and cook it. And,still would be quite far from any polished by millions of users products.

Sentry \- they have a simple helm chart for tracing errors. But this is not a login solution

Cloudwatch \- hemm..hopefully, no one suggests it. It is horrible from UI/UX and tracing standpoint. More like a dev tool. It is a hell of a ride with distributed microservices...Someone can say to use X-RAY with it, but then we have to make changes to our apps and instrument a lot.

What have you chosen and why?

View Poll

https://redd.it/nwtmzz
@r_devops
Fluentd delete old processed log files

Hello Everyone,

I have use case where i need to stream apache access and error logs to kafka brokers, to which i plan to use fluentd. I am completely new to fluentd so i am still figuring out how it works. 1 thing am not able to figure out or not been able to find the answers online is how to get rid of the log files which are already processed by fluentd? I mean after pushing the events to kafka i don't want these log files sitting in the machines for no reason.

Any help or suggestion will be really helpful.

\-Thanks

https://redd.it/nwsvyc
@r_devops
Thoughtworks have moved GitOps to “hold” on their tech radar due to the complexity in implementing good branching practices. I must say, I quite like GitOps and have not had trouble with branches. What are your thoughts on GitOps?

https://www.thoughtworks.com/radar/techniques?blipid=202104006

https://redd.it/nwwlfl
@r_devops