Is there a practice to incorporate blue/green into names of resources?

I think about following practice of blue/green deploy and wonder how people name duplicating assets?

For blue/green I have to temporarily duplicate resources, like prod-app-1, prod-redis-1, prod-job-1. I think that I have to alter naming schema from ENV-APP-COPY to: ENV-COLOR-APP-COPY, resulting in resources: prod-blue-app-1, prod-blue-redis-1, prod-blue-job-1 this release and prod-green-app-1, prod-green-redis-1, prod-green-job-1 next release.

This also means instead of marking Git/Hg with master I will move colors blue / green and use master / old-master just for informational purpose (to hind which color is a new release). I mean that I will embed blue / green into apps config because those names represent variations (current and previous release) while master denotes the tip so same name cannot be used in releases (how could you express different "master" in blue & green env? by naming blue-master & green-master?).

Prefixing resources with a color I can avoid conflicts between old/new deploys (only LB + DB are shared between releases) and can dispose no longer unused resources later.

Any ideas?

https://redd.it/ke945x
@r_devops

K8S troubleshooting made easy

Hi everyone,

In the last couple of months, we have been working on Kubernetes native product to help dev+ops teams troubleshoot efficiently. We provide system-wide visibility and control. For each service, we automatically construct a coherent view, including relevant deploys, config changes, and alerts. You can then drill down and explore suspicious changes and their ripple effect. Our platform sits on top of your existing source control, CI/CD tools, the underlying infrastructure, and monitoring tools and has quick and seamless integration.

So, in case you are running on top of Kubernetes and want to join our closed beta - DM :)

Complete service view

Deployment tracking

Full changes diff

https://redd.it/kebjm2
@r_devops

Three-Part Guide to How to Set Up as CI/CD Workflow - would love your feedback!

We just published the last post in our three-part series on setting up a CI/CD workflow. Hopefully it's a useful guide! Please let us know what you think? Easy to follow? Anything you'd add? Cheers!


Part One: how to set up a CI workflow using GitHub and AWS. https://monadical.com/posts/set-up-ci-workflow.html

Part Two: how to set up a CD workflow with Docker on AWS, using ECR and ECS. You’ll learn how to create a pipeline to get your image from the image repository to your production cluster. https://monadical.com/posts/set-up-ci-workflow-part-two.html

Part Three: introduces testing and linting to the workflow, and shows you how to adapt what you’ve learned so that it works for different containers by using a containerized Python application. https://monadical.com/.../set-up-ci-workflow-part-three.html

https://redd.it/kebjyf
@r_devops

Do we need powerful laptops with all the tools installed?

With the emergence of browser-based tools like Gitpod, GitHub Spaces, and others, we might want to rethink the needs we have for development environments. Did you try any of those? WDYT?

​

\>> https://youtu.be/QV1fYt-7SLU

https://redd.it/kef5rd
@r_devops

Flipaclip

Hello, I’m a newbie and wondered about FlipaClip app... Can I make similar one with unity game engine? How is this possible to build sth like this app?
Its a cartoon/animation maker app...
Danke

https://redd.it/kei79k
@r_devops

We want to compile tons of data into an easy to use (for non-technical folks) database. Where to start?

Hello peeps! Thanks for checking this out,

We have a mountain of data in multiple CSV and TXT files we want organized to dump into a single, searchable, secure, database.

Each data object we want to insert into this database, has between ten to fifteen fields per entry, and can be up to a terabyte in size. We get a new one to process every month or so.

My coder head first went to building a custom app on Cassandra or MySQL or something.. But this has to have been done many times before. Is there a goto or convention for this thing?

Thanks!

https://redd.it/keivlb
@r_devops

Advice re development environment

Hey All!
So i feel like I'm going to get destroyed here...


I work for a company in the states that never had a proper setup to begin with, and its so far gone i don't know how to fix it.


We have 2 dedicated servers, IIS and a database setup on each. one is our live server and the other is the Dev server. the developers RDP into the Dev server and code. Changes are then moved to the live server via FTP.


There is no version control. No Automation. our products are SASS, individual databases per client, also individual code bases, that all vary based on customization's and the inability to keep old ones up to date.

We are approaching almost 2000 "codebases". hundreds of GB's of files.


I guess the goals would be to

1) Version control. How would you even handle something of this scope?

2) Get the devs working on their local machines, not sure how this is possible with the amount of files etc. I have had something working with SSH although it wasn't super ideal.

3) Some sort of deployment method?


Any ideas on what i should start looking into? limited resources and lack of experience make this pretty daunting. Ive played with GIT a little bit on personal projects, but how to handle this is beyond my knowledge.



Thanks!

https://redd.it/kek6fb
@r_devops

Looking for feedback for database

We are an early stage startup in the database space. We are paying devops engineers who are struggling to scale their current setup to have a 30 minute conversation with our founding team and to give us feedback on what we've built. The pay will be a $100 gift card of your choice if you hop on a zoom call with our team. You can PM me or reply on this thread.

https://redd.it/kehazf
@r_devops

How do you protect your sensitive information (e.g. passwords, OAuth tokens and SSH keys) in Kubernetes? Do you use K8s secrets or other solutions?

We know many programmers hard code sensitive information in the open for convenience during development. What are your preferred techniques to protect this sensitive information when you move to production? Do you use K8s secrets? How do you ensure no sensitive information is coded out in the open?

For reference: https://kubernetes.io/docs/concepts/configuration/secret/

https://redd.it/keb89a
@r_devops

Is storing a docker image for every build overkill? How do you do docker image versioning and promotion to prod?

Everytime a commit get's pushed to my repository, I'm building a docker image that deploys it to "dev" environment. That happens multiple times a day so I end up with tons of images that never get promoted to prod. How do you guys version your docker images in your container registries?

https://redd.it/keoena
@r_devops

RFC Tried to document my DevOps Continuous Release pipeline. Is it comprehendible?

I have tried to document my automated release process with the Archimate language.

In short, the process is using

github for source code
github actions for builds
amazon sns/sqs for triggering deployments
spinnaker as deployment engine for deployment pipelines.
a custom solution to run terraform in spinnaker as a Run Job in K8s.
every deployment is a terraform apply run by spinnaker and deploys into Amazon EKS.

My Archimate DevOps Continuous Relase pipeline https://i.imgur.com/x9Nfo3L.png

The base config for the environment is done by Terraform: https://github.com/dniel/terraform

And an example service beeing deployed by the whole process: https://github.com/dniel/whoami

The diagram is quite complex, but I have tried to cut it down to the bare essentials of services that orchestrate the deployment. I would LOVE to get some feedback on how to do this even more clear.

​

https://redd.it/kecir3
@r_devops

How does Nagios work?

On a server, Nagios either runs as a service or daemon. Plugins that reside on the same server are being run by the Nagios; basically, they contact the hosts or servers of your network or on the internet. We can check the status by web interface; even notifications can also be received by email or SMS when something happens.

Nagios service runs certain scripts after a fixed time interval, so it acts as a scheduler. It can store the script result and run other scripts when it is changed.

https://redd.it/ke72w7
@r_devops

What is docker networking and bridge networking tutorial

A beginners tutorial docker networking and tutorial about using bridge network with two alpine standalone containers. Take a 10 mins read of What is docker networking and bridge networking

https://redd.it/kerpzm
@r_devops

DevOps as First Job

I'm starting my first entry-level job as a DevOps engineer this week. I have no other experience and I am still working on my CS degree. This will be my first job ever actually. I've never been paid a salary before. I feel a little in over my head, honestly, seeing as I don't have any experience with anything.

Do most DevOps engineers have a background in a different field before getting into devops?

I know that devops is turning into its own field at this point, but I'm curious how many people really get their first job doing devops as a devops engineer.

And if you have any advice for a kid about to start his career, I love advice. Especially from strangers on the internet...

https://redd.it/kerulf
@r_devops

How DevOps will look like in 2021?

Will it be the same as before or things like Serverless, AIOps, GitOps, and other buzzwords enter the community?

https://redd.it/kesjr3
@r_devops

Best practices for analyst data consumption

Hello! I work for an organization that has recently began building a development team after many years of having a single developer. Our current growing pain is deciding the best way to allow our BI/team of data analysts to begin consuming data from our web applications (most of which as APIs).

The BI data warehouse and most of my teams apps reside in an on-premise data center. As we grow I expect to have 10+ applications that our BI team will want data for in some fashion to add our data to business line dashboards.

I want to avoid giving BI read only access to the prod app databases. We have discussed creating a replication process to separate databases for BI to have read only access to or having a process to create SQL views based on BI needs and restricting access to those views. Both have pros and cons but I’m wondering how other teams handle this. Are there other options or best practices I’m not aware of. Thanks for reading!

https://redd.it/kenri8
@r_devops

What's the most popular Linux Distro in 2020 and can we trust DistroWatch saying MXLinux ? Learning Linux sysadmin what would be the biggest difference if I learn Manjaro/Arch compared to Ubuntu for production env ?

(french man here excuse my english)

1) What's the most popular Linux Distro in 2020 and can we trust DistroWatch saying MXLinux ? Learning Linux sysadmin what would be the biggest difference if I learn Manjaro/Arch compared to Ubuntu for production env ?

2) Does it really matter with DE env I learn linux on if everything is automated with scripts bash/python with AWS tools in production env when you automate everything with pre configured os iso's ?


3) What's going on with Centos is it a big blow to the Linux community on the server/corporate side of things in the long run à la IBM kind of screw you up things compared to RedHat of old ? I mean is it a bad things to learn the Centos stack today instead of Ubuntu or things won't change much for servers ? for example could Debian become big ?

thank you very much for your time

https://redd.it/ke4wok
@r_devops

Automation Query

I was reading a posting in r/vmware on Automation and VMware but we're using RH Virtualization so I thought I'd be a bit more specific with our use-case, address this in r/devops, and maybe get some answers more aligned with my environment.

I'm a long time Ops guy and have a bunch of years of computer experience primarily in Ops. I see automation as a valuable methodology but was blocked at every attempt to get it going at my previous company. I've recently switched companies and into a DevOps role and one of my goals is take the things I was learning about automation and wanting to enable, and forwarding those goals at my new job. The boss is 100% on board and I'm free to get started with upgrading the current environment.

The environment is Red Hat with RHEL8 and RH CoreOS, RH Virtualization (aka KVM), RH IDM, RH Satellite, and RH OpenShift. I also use Ansible for configuring servers after the are provisioned.

I've recently (like yesterday) gained ownership of the underlying physical servers so I have privileged access to rebuild the boxes, deploy VMs, and install pretty much any other software such as our own DNS servers as we have our own IP ranges.

I've looked at a process of creating and managing a Gold Image and then using Terraform to deploy to a specific needed server. Then using Ansible to initially configure a server and Ansible Tower to automatically manage the configurations across the servers.

It seems from lots of reading that I'm on the right path. I'm interested if there are other tools, processes, etc I might investigate before I take a step on this path.

https://redd.it/kf2r8x
@r_devops

When did you feel ready to switch into a DevOps role?

When did you feel ready to switch into a DevOps role? What did you do before?

I have a few years of experience both as a developer and a sysadmin. DevOps seems to be a magical combination of my favorite aspects of both fields and DevOps/SRE seems like the next logical progression in my career.

I'm learning about AWS, CI/CD, Docker, etc. but I'm not sure how much is enough before recruiters/interviewers will take me seriously. That's why I'm wondering where you all were at in your career/knowledge before making the switch.

https://redd.it/kf463l
@r_devops

Management wants to use Spinnaker over ArgoCD(cuz Netflix uses it with k8s, which is incorrect).

After four months of using Spinnaker for CD on k8s(in prod and non-prod envs), we are getting slowed by support issues, the failures, etc. Ultimately the devs get blocked.

For instance Spinnaker does not show all k8s objects and any appropriate error message for what kind of failure it is(just a generic message).

They kept harping about how other orgs are using it and someone like Netflix is using this with k8s, and that they are willing to get paid support for 3-6 months, instead of judging by the feature and operational overhead. None of them have experience with k8s/infra.

Later in the evening I searched around and found that Netflix uses Titus and not K8s!Informed this to them, but I doubt they will change their mind.

https://redd.it/kf3olm
@r_devops

What's your lead time?

Out of curiosity, what's your typical lead time to get an application, service, API, etc... from concept to production ready?

This includes a pipeline, being compliant, proper security, it's scalable and self-healing. How long does it take folks around here to roll that out?

https://redd.it/kf5ohe
@r_devops