Web Dashboard for Process Scheduling

Hi Everyone,

I am building a system (largely in python) that will need to start, stop, and moderate processes periodically.

​

The use case could be:

\- I have a script I want to run everyday at 12 AM

\- I have a executable I want to run constantly (so in this case should just start the executable on bootup and have the executable infinitely run)

\- I have a process I want started at 10am and terminated at 2pm.. daily

​

In the past I have used Jenkin's for task scheduling like this. I liked how you could see the progress of each build. However I've been told to not use jenkins for long running processes. I just figure there has to be something out there like this... that has Web Dashboard access.

https://redd.it/eizhkw
@r_devops

DevOps Blogs + Reddit

Sadly I don't have time to read all of these. Which 3 do you recommend? Already reading AWS, CloudTech News & following most of these on Twitter.

https://redd.it/eiw9fy
@r_devops

Consultant and company rates difference

Hi,

I work as a devops consultant with 6 years of experience and I started thinking about the difference in my md rates vs rates of a company that does the same.

Usually the companies that have several consultants and several references charge way more than my md rate, lets say double the amount. I find it weird, as I have worked fir these companies in the past and there wasn't much of a difference in the delivered services between theirs and mine.
Still, I might be a no-name to the client even though I do have good references if my own, so I charge less.

Is there a coeficient of how much less should I as a freelancer charge in comparison to companies that do the same of the same quality and experience (basically everything the same)? Because if it is the same, why exactly should I get paid less (I don't want to sound greedy, I just don't know).

Could you please advise me?

https://redd.it/ejfi2q
@r_devops

Book recommendations on Architechting for deployability

As per Nicole Forsgren and Jez Humble’s Accelerate. The biggest factor that impacts the deployability of a system (measured by how often it is deployed) Is it's architecture and I really do agree with it (reading it was line was one of those “aha!” momments as I’ve been repeating the same thing for years). Now comes the tough part, how can i learn to architect for deployability? I mean i think I know how to do it, I’ve been “doing” it, but I also feel that it may not be the best way to do it and my method is absurdly tainted by my biases. Is there any book or training or articles or case studies you would recommend to learn how to do this from other people? Like i feel Im versed on event-driven archs and kafka, but im sure there is a lot more things out there.

Thanks!

https://redd.it/ejgyqk
@r_devops

Kubernetes Secrets vs Hashicorp Vault

I am currently working on removing secrets from code and have come across both k8s secrets and vault. Half my system is k8s. I'm having a hard time seeing what vault provides that k8s secrets cant do. Even for nodes outside of k8s could access secrets using the api and rbac right? Any insight would be helpful.

https://redd.it/ejfzhl
@r_devops

Vault Root Account Replacement

Once I revoke the root token, I want to create a couple of accounts that have root access to all of vault.

The documentation seems to suggest creating an admin policy for this that looks like this: [https://gist.github.com/kawsark/4cdb66093d6206d9e036ecd1294e6509](https://gist.github.com/kawsark/4cdb66093d6206d9e036ecd1294e6509)

But I am wondering why not create a policy that looks like this instead?

path "*"
{
capabilities = ["create", "read", "update", "delete", "list", "sudo"]
}

This block seems to do the same (and more?) and it is less verbose than the above, also (I assume) it covers all cases. Is there any best practice against this?

https://redd.it/ejfc1w
@r_devops

Which flow should I take during deploy of big API changes to keep the consumers in sync?

Hello

I am running a project that is in dev stage (so there are breaking changes etc.), but I met with a problem of keeping the changes in sync with UI client / consumer.

Let's say that there is 1 developer to maintain both backend API and frontend App, when this developer commits a change to develop branch then Jenkins is doing some shell magic to deploy the stuff.

So, if the developer pushes change to API, then a long process of deployments starts; Before the API deployment ends he pushes another change to UI App which deployment takes seconds and we are in a state where UI can throw random errors since the API deployment did not finish.

Even if we reverse the case, ie. the first deploy goes for UI App, the API changes are still not deployed so there still will be random errors in UI App.

While I know about things like backward compatibility and such, a big changes still may happen in the process, and this scenario is from what I can think of - the simplest. This is no rocket science microservice architecture but plain API - UI project for now.

In perfect world the API and UI deployments ends in the same time.

https://redd.it/ejds19
@r_devops

Pubsubbeat + elasticsearch creates only one index

Hi.

I've just set up pubsubbeat + elasticsearch in order to get logs from stackdriver to my private elasticsearch cluster. Everything works fine except that it's only using one index. It created an index called pubsubbeat-8.0.0-2019.12.31-000001 and it's adding all the documents inside the same index instead of creating one every day. Do you know how to force it to create an index daily? I've found the delete\_by\_time query but I would prefer to delete a whole index, looks cleaner.

Thanks

https://redd.it/ejdgfs
@r_devops

Do you use hot redeploy in production or have downtime for new release installation? Is hot redeploy actually needed for your system?



https://redd.it/ejlipp
@r_devops

Zero to Hero guide 2020

Hi, I am a software developer with 3 years of experience and just recently had to work on a project that uses AWS.

No need to say that I was overwhelmed by all the terminologies and network configuration.

I learned about Docker and bought a very simple course on Udemy about Deploying a NodeJS application docker container to AWS EC2, but that was it... I think I need some sort of pipeline to work with that will make CD/CI easier and pain free.

What resources (books, course, YT channel) you guys recommend getting started on DevOps, especially on AWS, in 2020?

https://redd.it/ejkfm4
@r_devops

DNS SSL Apache in Docker Container

The current setup is ec2 ubuntu instance with docker container that runs my app during development and demo purposes only.

My question is how do you setup ssl cert in your server? do you set it up inside the container? or in the ec2 instance itself and you just mount it on the container?

https://redd.it/ejalr3
@r_devops

What do you recommend my learning path be? I’m looking to deploy Django projects in an intelligent way- currently looking at AWS EBS + Docker + git

Unfortunately I’m getting a little tired of the endless articles that don’t cover everything, and that’s nothing against them.

For someone like me, how do you recommend I proceed? “All” I want is an easy way to develop and deploy.

I’m sure that’s what everyone says though.

Whether it’s books, coursers, or whatever, I’m all ears for the practical knowledge.

I am partial to docker though, it’s been helpful for my speed in development, and it’s my understanding that it helps in deploying, right?

Thank you for your time.

https://redd.it/ejonhe
@r_devops

How many environments do you use per project?

At my workplace, most teams have 4+ envs (e.g. dev, qa, uat, staging, prod).

I'm curious if many other teams do it this way or if the norm is to keep things simpler with just staging and prod?

https://redd.it/ejmat1
@r_devops

RShiny Dashboard for rendering AWS Biling reports

Happy New Year!

Thinking of creating an R shiny dashboard that produces data visualization off AWS billing reports for Management to view.

Thinking of downloading the cost and usage reports on to an S3 bucket where my R code reads and filters the data and produces the visuals

Just curious if anyone has implemented this before

Thanks

https://redd.it/ejvvbm
@r_devops

Those of you in .NET, do you manage windows images with Packer? If so, how do you update them with new code?

I am trying to develop a new standard around development environments and our infrastructure as code. I would like to know the fastest way to have updated windows images because I plan on using spot instances for the development environments.

So my question is, is packer just another AMI where you would have pre-installed programs and/or the pre-deployed code? This seems very inefficient because code is updating all the time.

If spot instances are terminating and coming online left and right, I would want the most efficient way to get the newest code on the new instances that are coming back online. Using a pre-baked AMI would be fast, but updating that AMI to always have the latest code (or different versions/tags of code) seems like the challenge.

What is the industry standard way of doing this?

https://redd.it/ejzj0j
@r_devops

Measuring uptime

I work for a SaaS company in charge of IT Ops. Our executive team is constantly asking me to publish uptime stats of our various applications which continues to prove to be very difficult to do. I am wondering what others are doing.

For some background we run web based applications and we use StatuaCake to simply verify our apps in the datacenters are responding. I typically use this but many people immediately push back saying just because the app was up doesn't mean it was actually working for our customers.

We use New Relic for an APM tool which is great for telling us how we are responding but it doesn't give a great way to easily report uptime that our executives could understand (unless I'm just missing something).

We have some infrastructure monitoring via PRTG as well but I don't think I can use that for this ask.

How are others doing this? I'm sure I'm just missing something obvious that would help me figure out how best to present numbers to our company.

https://redd.it/ejyntx
@r_devops

WebDev or DevOps – what am I better off learning now as a 3rd-world uni student?

I have an interest in both. But what interests me more is finding an employer willing to sponsor me (the sooner the better). Which job do you think is more common for sponsorship? Which job is more future-proof (next 10 years)? Which offers more remote opportunities?

https://redd.it/ejye8s
@r_devops

How would you explain DevOps to Management?

How would somebody explain or justify the adoption of engineering practices around DevOps to management? What arguments would resonate with people who are often focused on financial results and deadlines before anything?

I've come with some arguments myself, they're not in any order of priority, but I think they would come up as something average business focus management would understand:

​

1. Behavioral science developed for approximately 7 years now ( State of DevOps, DORA, Accelerate, etc), demonstrate (data-driven) that the **engineering practices of DevOps (TDD, BDD, Test Automation, etc) are strongly correlated with organizational culture and the overall organization results**;
2. It doesn't make sense to restructure the teams to work in a fake-agile fashion if you're still delivering projects rather than managing an end to end product lifecycle. **Every project objective is to deliver something on budget and on time. A product objective is to deliver the value of any kind to a customer**;
3. You won't go the extra mile of automating tests or developing test cases before you actually write the function code if you'll simply throw your code over the wall to operations. DevOps is not about transferring Operations tasks to the Development of vice-versa, it's about having the teams (squads) responsible for what they build. Y**ou build it, You'll run it**. If you'll get called 2 AM to fix a problem caused by a known error that was re-introduced in the code, you'll immediately understand the benefits of regression testing.
4. If you don't consider quality in the design of your product, chances are that in the long run, you'll consume most of your budget maintaining bad code you kicked out the door rather than developing new features for the customers. The cost per feature/business function should remain relatively flat or at least predictable upon the adoption of DevOps and will explode on the Ops side if the practices are not correctly established. The increasing complexity of systems and the interactions among the stakeholders will likely take them to a point where enterprises will spend a lot of money keeping them alive without delivering real value to their customers or decide to spend even more money to replace it altogether. **Bottom line is that DevOps is not only about quality but makes a lot of economic sense.**

What arguments would you use?

https://redd.it/ejy41o
@r_devops

Blog Post: How to Build an Azure Pipeline (Build/Release) from Scratch

Hey guys, I just wrote a shiny new blog post you may enjoy on the ATA blog.

Summary: Learn how to set up an Azure Pipelines build and release pipelines from scratch in this step-by-step tutorial with tons of screenshots.

https://adamtheautomator.com/azure-pipelines-tutorial/

If you'd like to write posts like this, get promoted and get paid, join us! https://adamtheautomator.com/friends

https://redd.it/ejxzrf
@r_devops

Supercharge your Kubernetes setup with OhMyZSH + awesome command line tools

`kubectl` can be quite cumbersome to work with, as it has long commands and no support for regex-based querying (e.g. when querying pod logs). For example

kubectl logs -f myLongNamedPod-xxx-yyy -n myNamespace

Wrote a quick article about several command-line tools I've used over the years to speed up my kubectl workflow, hope you guys will find it useful.

For instance, with the `stern` tool, you could perform the above command as

stern LongNamed

and tail the logs of all pods matching this name pattern.

https://agrimprasad.com/post/supercharge-kubernetes-setup/

https://redd.it/ejrja5
@r_devops