I have a small training budget i need to use before EOY - any suggestions for quality commercial/paid courses or resources like books?

just as the title says.

https://redd.it/kdlc6s
@r_devops

Beginner here, would love if someone could help me a bit

Hey! How are you doing? Hopefully you are feeling good!

I'm kinda lost not going to lie :)

I'm not sure if I'm posting on the right subreddit, but hopefully someone will help me.

I'm trying to deploy a small simple Django app using kubernetes and ingress-nginx. I'm not sure how to put everything into production and how to create a simple development flow for everything using travis and git and gke.

I would be really grateful if someone would help me with some advice and such!

https://redd.it/ke5cdb
@r_devops

Need help with collection of logs from Nifi , storing in Elasticsearch and displaying in Grafana.

My Nifi is running in a container separate from the one containing fluentd, elasticsearch and grafana. I wanted to configure fluentd to collect logs from nifi processors and forward it to elasticsearch and later query the same from grafana and display. How can I achieve this? I am able to see the count of logs as of now in grafana, but in my docker logs I get this warning everytime a new log is generated from nifi:

fluentd_1 | warning: 299 Elasticsearch-7.2.0-508c38a "[types removal] Specifying types in bulk requests is deprecated."

https://redd.it/ke71v2
@r_devops

Automation tools for VMware + potential hybrid in the future?

We're looking at tooling options to finally move to automation. We're heavily VMware on-prem, mostly Windows, but likely to introduce more Linux over time, and likely to use hybrid cloud (Azure) in the future.

Are there any obvious tooling options that I'm missing in this list, or any that would be recommended over others?

\- VRealize
\- Packer/Ansible/Terraform
\- SaltStack

​

Thanks

https://redd.it/ke9om8
@r_devops

Is there a practice to incorporate blue/green into names of resources?

I think about following practice of blue/green deploy and wonder how people name duplicating assets?

For blue/green I have to temporarily duplicate resources, like prod-app-1, prod-redis-1, prod-job-1. I think that I have to alter naming schema from ENV-APP-COPY to: ENV-COLOR-APP-COPY, resulting in resources: prod-blue-app-1, prod-blue-redis-1, prod-blue-job-1 this release and prod-green-app-1, prod-green-redis-1, prod-green-job-1 next release.

This also means instead of marking Git/Hg with master I will move colors blue / green and use master / old-master just for informational purpose (to hind which color is a new release). I mean that I will embed blue / green into apps config because those names represent variations (current and previous release) while master denotes the tip so same name cannot be used in releases (how could you express different "master" in blue & green env? by naming blue-master & green-master?).

Prefixing resources with a color I can avoid conflicts between old/new deploys (only LB + DB are shared between releases) and can dispose no longer unused resources later.

Any ideas?

https://redd.it/ke945x
@r_devops

K8S troubleshooting made easy

Hi everyone,

In the last couple of months, we have been working on Kubernetes native product to help dev+ops teams troubleshoot efficiently. We provide system-wide visibility and control. For each service, we automatically construct a coherent view, including relevant deploys, config changes, and alerts. You can then drill down and explore suspicious changes and their ripple effect. Our platform sits on top of your existing source control, CI/CD tools, the underlying infrastructure, and monitoring tools and has quick and seamless integration.

So, in case you are running on top of Kubernetes and want to join our closed beta - DM :)

Complete service view

Deployment tracking

Full changes diff

https://redd.it/kebjm2
@r_devops

Three-Part Guide to How to Set Up as CI/CD Workflow - would love your feedback!

We just published the last post in our three-part series on setting up a CI/CD workflow. Hopefully it's a useful guide! Please let us know what you think? Easy to follow? Anything you'd add? Cheers!


Part One: how to set up a CI workflow using GitHub and AWS. https://monadical.com/posts/set-up-ci-workflow.html

Part Two: how to set up a CD workflow with Docker on AWS, using ECR and ECS. You’ll learn how to create a pipeline to get your image from the image repository to your production cluster. https://monadical.com/posts/set-up-ci-workflow-part-two.html

Part Three: introduces testing and linting to the workflow, and shows you how to adapt what you’ve learned so that it works for different containers by using a containerized Python application. https://monadical.com/.../set-up-ci-workflow-part-three.html

https://redd.it/kebjyf
@r_devops

Do we need powerful laptops with all the tools installed?

With the emergence of browser-based tools like Gitpod, GitHub Spaces, and others, we might want to rethink the needs we have for development environments. Did you try any of those? WDYT?

​

\>> https://youtu.be/QV1fYt-7SLU

https://redd.it/kef5rd
@r_devops

Flipaclip

Hello, I’m a newbie and wondered about FlipaClip app... Can I make similar one with unity game engine? How is this possible to build sth like this app?
Its a cartoon/animation maker app...
Danke

https://redd.it/kei79k
@r_devops

We want to compile tons of data into an easy to use (for non-technical folks) database. Where to start?

Hello peeps! Thanks for checking this out,

We have a mountain of data in multiple CSV and TXT files we want organized to dump into a single, searchable, secure, database.

Each data object we want to insert into this database, has between ten to fifteen fields per entry, and can be up to a terabyte in size. We get a new one to process every month or so.

My coder head first went to building a custom app on Cassandra or MySQL or something.. But this has to have been done many times before. Is there a goto or convention for this thing?

Thanks!

https://redd.it/keivlb
@r_devops

Advice re development environment

Hey All!
So i feel like I'm going to get destroyed here...


I work for a company in the states that never had a proper setup to begin with, and its so far gone i don't know how to fix it.


We have 2 dedicated servers, IIS and a database setup on each. one is our live server and the other is the Dev server. the developers RDP into the Dev server and code. Changes are then moved to the live server via FTP.


There is no version control. No Automation. our products are SASS, individual databases per client, also individual code bases, that all vary based on customization's and the inability to keep old ones up to date.

We are approaching almost 2000 "codebases". hundreds of GB's of files.


I guess the goals would be to

1) Version control. How would you even handle something of this scope?

2) Get the devs working on their local machines, not sure how this is possible with the amount of files etc. I have had something working with SSH although it wasn't super ideal.

3) Some sort of deployment method?


Any ideas on what i should start looking into? limited resources and lack of experience make this pretty daunting. Ive played with GIT a little bit on personal projects, but how to handle this is beyond my knowledge.



Thanks!

https://redd.it/kek6fb
@r_devops

Looking for feedback for database

We are an early stage startup in the database space. We are paying devops engineers who are struggling to scale their current setup to have a 30 minute conversation with our founding team and to give us feedback on what we've built. The pay will be a $100 gift card of your choice if you hop on a zoom call with our team. You can PM me or reply on this thread.

https://redd.it/kehazf
@r_devops

How do you protect your sensitive information (e.g. passwords, OAuth tokens and SSH keys) in Kubernetes? Do you use K8s secrets or other solutions?

We know many programmers hard code sensitive information in the open for convenience during development. What are your preferred techniques to protect this sensitive information when you move to production? Do you use K8s secrets? How do you ensure no sensitive information is coded out in the open?

For reference: https://kubernetes.io/docs/concepts/configuration/secret/

https://redd.it/keb89a
@r_devops

Is storing a docker image for every build overkill? How do you do docker image versioning and promotion to prod?

Everytime a commit get's pushed to my repository, I'm building a docker image that deploys it to "dev" environment. That happens multiple times a day so I end up with tons of images that never get promoted to prod. How do you guys version your docker images in your container registries?

https://redd.it/keoena
@r_devops

RFC Tried to document my DevOps Continuous Release pipeline. Is it comprehendible?

I have tried to document my automated release process with the Archimate language.

In short, the process is using

github for source code
github actions for builds
amazon sns/sqs for triggering deployments
spinnaker as deployment engine for deployment pipelines.
a custom solution to run terraform in spinnaker as a Run Job in K8s.
every deployment is a terraform apply run by spinnaker and deploys into Amazon EKS.

My Archimate DevOps Continuous Relase pipeline https://i.imgur.com/x9Nfo3L.png

The base config for the environment is done by Terraform: https://github.com/dniel/terraform

And an example service beeing deployed by the whole process: https://github.com/dniel/whoami

The diagram is quite complex, but I have tried to cut it down to the bare essentials of services that orchestrate the deployment. I would LOVE to get some feedback on how to do this even more clear.

​

https://redd.it/kecir3
@r_devops

How does Nagios work?

On a server, Nagios either runs as a service or daemon. Plugins that reside on the same server are being run by the Nagios; basically, they contact the hosts or servers of your network or on the internet. We can check the status by web interface; even notifications can also be received by email or SMS when something happens.

Nagios service runs certain scripts after a fixed time interval, so it acts as a scheduler. It can store the script result and run other scripts when it is changed.

https://redd.it/ke72w7
@r_devops

What is docker networking and bridge networking tutorial

A beginners tutorial docker networking and tutorial about using bridge network with two alpine standalone containers. Take a 10 mins read of What is docker networking and bridge networking

https://redd.it/kerpzm
@r_devops

DevOps as First Job

I'm starting my first entry-level job as a DevOps engineer this week. I have no other experience and I am still working on my CS degree. This will be my first job ever actually. I've never been paid a salary before. I feel a little in over my head, honestly, seeing as I don't have any experience with anything.

Do most DevOps engineers have a background in a different field before getting into devops?

I know that devops is turning into its own field at this point, but I'm curious how many people really get their first job doing devops as a devops engineer.

And if you have any advice for a kid about to start his career, I love advice. Especially from strangers on the internet...

https://redd.it/kerulf
@r_devops

How DevOps will look like in 2021?

Will it be the same as before or things like Serverless, AIOps, GitOps, and other buzzwords enter the community?

https://redd.it/kesjr3
@r_devops

Best practices for analyst data consumption

Hello! I work for an organization that has recently began building a development team after many years of having a single developer. Our current growing pain is deciding the best way to allow our BI/team of data analysts to begin consuming data from our web applications (most of which as APIs).

The BI data warehouse and most of my teams apps reside in an on-premise data center. As we grow I expect to have 10+ applications that our BI team will want data for in some fashion to add our data to business line dashboards.

I want to avoid giving BI read only access to the prod app databases. We have discussed creating a replication process to separate databases for BI to have read only access to or having a process to create SQL views based on BI needs and restricting access to those views. Both have pros and cons but I’m wondering how other teams handle this. Are there other options or best practices I’m not aware of. Thanks for reading!

https://redd.it/kenri8
@r_devops

What's the most popular Linux Distro in 2020 and can we trust DistroWatch saying MXLinux ? Learning Linux sysadmin what would be the biggest difference if I learn Manjaro/Arch compared to Ubuntu for production env ?

(french man here excuse my english)

1) What's the most popular Linux Distro in 2020 and can we trust DistroWatch saying MXLinux ? Learning Linux sysadmin what would be the biggest difference if I learn Manjaro/Arch compared to Ubuntu for production env ?

2) Does it really matter with DE env I learn linux on if everything is automated with scripts bash/python with AWS tools in production env when you automate everything with pre configured os iso's ?


3) What's going on with Centos is it a big blow to the Linux community on the server/corporate side of things in the long run à la IBM kind of screw you up things compared to RedHat of old ? I mean is it a bad things to learn the Centos stack today instead of Ubuntu or things won't change much for servers ? for example could Debian become big ?

thank you very much for your time

https://redd.it/ke4wok
@r_devops