How did you start out before becoming DevOps?

Hello, I just graduated last year, and currently working as an IT support. I just realize that I have a passion for writing Python automated script to do my boring daily routine tasks. Therefore, I'm thinking of becoming a DevOps in the next year or two.

According to my research, there are not many DevOps junior positions.

* So how did you guys start out before becoming a DevOps Engineer?
* Do you like this job or not? Any hardship?
* What about job security and growth?
* Any advice on becoming a DevOps?

Thank you for reading my post. I'm looking forward to your answers soon.

https://redd.it/e68rfi
@r_devops

Terraform 11 to 12 upgrade

curious on how people handled this upgrade.

We have a large platform/deployment model and it's broken into terraform layers. Different layers interact with each other by reading the state of the layer its interacting with.

It's my understanding that we can't upgrade some layers to 0.12 and except 0.11 layers to also work and vice versa, essentially we need to upgrade ALL of our terraform to 0.12 in one go.

The answer may be as simple as following - https://www.terraform.io/upgrade-guides/0-12.html through each of our layers?

https://redd.it/e62pdv
@r_devops

Terraform support for HCL <-> JSON conversion

I recently found this quote from [a post published by HashiCorp](https://www.hashicorp.com/blog/terraform-0-12-reliable-json-syntax/) back in August 2018:

&#x200B;

>In future versions of Terraform, we will also support native tooling to convert HCL to JSON *and* JSON to HCL cleanly (including comments). This gives additional tooling more power in working with Terraform configurations and also enables people to author configurations in whichever language they feel comfortable.

Does anyone know the status of this feature? There doesn't seem to be any reference to HCL <-> JSON conversion in the Terraform docs, and I'm having trouble finding references to it on GitHub. I've found a few third-party tools that sort of fit the bill (such as [json2hcl](https://github.com/kvz/json2hcl)), but so far nothing that is native to the Terraform CLI.

For reference, I'm working on a project that scaffolds Terraform configurations for various types of infrastructure. Up until now, it was possible to use a template language to generate my TF, however things have become complex enough that I need a programmatic solution.

https://redd.it/e63x41
@r_devops

Api management

I work as a java architect in the computer sector of an insurance company.
As part of its digital transformation strategy, management defined the need to incorporate a product for the management and publication of API (API Management product).
Currently we work with open technologies (JEE / JBoss mainly) and we use SOAP services (both internally between our applications and for external clients that communicate with us).
I've been researching product alternatives but I'm a bit overwhelmed by so much information.
Could you please give me any suggestions?
It can be an already established market product as well as a suite of products or technologies.
Thanks!

https://redd.it/e6mxbx
@r_devops

Thought experiment: You take over 20 servers from a previous admin. There is no monitoring or devops infrastructure setup. What do you do?

Bob Smalls of Small Bobs Inc., a successful Beanie Baby collecting/Historical reenactment company, just fired his previous "IT guy" who administers every server the company uses. You, singular, are reponsible for the entirety of Small Bobs' 20 servers. These servers are of various shape and size and run primarily on Ubuntu and CentOS and they are live in the cloud hosted by an off brand provider.

Of the servers you have something like:

(Linux)

2 mail server

1 proxy

12 application servers

3 web servers

2 file servers

You can of course spin up as many new servers as you want. The only thing you can't do is hire any more people to help you. You also have to take calls occasionally to help end-users when they have trouble with using internal software.

What are the first 5 to 10 things you do to make you managing these servers, and thus your life, way easier?

https://redd.it/e6ng5h
@r_devops

Anyone have one of those days when Kubernetes makes you want to paint the ceiling?

I love K8s but gosh sometimes it just doesn't work as expected.

https://redd.it/e6pj57
@r_devops

To deploy vault on kubernetes or not?

We are an early stage startup on GCP and using GKE.
I want to introduce vault in the ecosystem for storing secrets and I am looking for advice on how should I go forward with it.

To give more details - we have a private GKE cluster with NAT and manage the infrastructure with terraform.

1) Should I deploy vault in the same kubernetes cluster? Or as a separate cluster on compute machines.
2) If same, wouldn't it consume a lot of resources along with consul?
3) If different, what's the best way to authenticate services with it?
4) We don't have any use-case for consul, what would be the best alternative as a store? postgres?

This is my first post here. Any advice is much appreciated. Thanks to the kind ones.

https://redd.it/e6lspv
@r_devops

How can i provision Elastic Beanstalk with Terraform?

I'm setting up an Elastic Beanstalk app to run a Rails API using Terraform.

I need Terraform to ssh in & create, seed the RDS instance on creation. I would imagine i can do this with a provisioner but i'm not sure how & i cannot find any documentation.

The other option i assume would be to use EB container commands through Terraform, but i'm not sure how to do this either.

Any ideas?

https://redd.it/e6pbl5
@r_devops

AppVeyor vs CircleCI vs Travis

So I'm not a devops, but I've spent some time using CircleCI. I liked its features plus the local cli tool was a big plus. However that's the only CI tool I know of.

How do AppVeyor and Travis compare?

Is it just a matter of tastes? Are they pretty much the same? Any benefits choosing one over the other?

https://redd.it/e6ovyj
@r_devops

I get to start a DevOps program from scratch. Suggestions???

Hi all!

I was just put in charge of some pretty big projects at my job. Think creating a data warehouse, IAM, and all scripting support to the NetOps team, to name a few.

Here is the exciting part. I get to create this DevOps environment from scratch. My boss is giving me all the tools I need. I’m already familiar with SDLC/Agile, and that’s the model I’m going with.

I want to set this up correctly so, here’s my ask: what are common mistakes made in DevOps? What are some good resource websites? I saw the YouTube Bootcamp, are there any other good trainings out there? Any suggestions?

Again, my boss is giving me free reign. He’s already pretty impressed with my pre-project reports and trusts me to do whatever’s necessary to create a good environment.

Thanks!

https://redd.it/e6n9rl
@r_devops

Keeping track of infrastructure

I have a dozen of physical hardware laying around being Jenkins slaves. These slaves are actively used by multiple departments for building and testing on real hardware(mostly microcontrollers, but also android/osx phones). \*It's currently a goddamn mess\*. I'm not joking when I say that we don't even know if we have all the machines inventoried and what machine does what because the jenkins labels are all over the place. Some machines have custom scripts running on them to fix unrelated bugs that affect other systems. It's frustrating and needs a big overhaul, without bringing down the current setups. Some of the machines are misconfigured to the point that we can't even access them anymore, others are just unstable.

As part of that we started standardizing jenkins labels, installed monitoring tools MANUALLY(ansible would be nice, if IT allowed us to use it properly lmao i'm in devops this is WIP) and are now basically going to inventory everything.

What kind of tools can be used for this? Currently it's just some random webpage/wiki that needs manual updating, which is incredibly prone to error and a Bad Idea(tm). I need something that can be deployed automatically and monitored real-time. Zabbix is an option but it doesn't seem to have a "public" view without logging in(departments should be able to look at the status, but not touch). Also requires a master/slave setup, and I'd prefer agentless if possible

Other advice is also welcome

Yes, I know normally maintaining infrastructure isn't really part of devops. I just got on the job and have legacy stuff to deal with.

https://redd.it/e6w353
@r_devops

When writing deploy/rollback scripts - pick target based on current branch. Good or bad?

We are having this discussion internally. Some say that is safer to have specific scripts, other that because its automated, having a single on that switch depending on branch is cleaner.

&#x200B;

What are good practices on that? Does that even make sense that we are having this discussions?

https://redd.it/e6wzsi
@r_devops

How to group IT Monitoring Tools by Market?

Hey everyone,

Fresh graduate who wants to join an IT monitoring company as a junior Product Management. I am researching the space so as to understand the market better.

How would you categorize the different IT monitoring solutions (e.g Nagios, Zabbix, Prometheus, Influx, Netdata, Datadog,etc.)? I am trying to find the different markets (segments) that exist inside the domain.

I have some ideas, but I don't want to nudge anyone.

**Thank you so much for your time, it is highly appreciated :)**

(I just cross-posted to maximise exposure from r/sysadmin)

https://redd.it/e6yu7h
@r_devops

Code formatting and cleanup as part of pipeline

Hi

We are getting our pipeline set up, and want to add a phase before build to format and clean up code. Is this a good plan? We have pre-commit hooks already for our node packages which does this already, but our java and c# does not. Some of our team don't want to do this automatically as it will add a commit by our pipeline to the history, but others feel it's the only way to get all of the code in standard formatting and clean style.

Thanks.

https://redd.it/e6u9ot
@r_devops

Options for AWS cross account CI/CD no IAM

Im interested in the best options for cross account CI/CD. I am moving from single to multi account architecture. I currently have a Jenkins instance and I am not interested in rebuilding it (Default VPC) in order to use direct connect.

My client does not want to use IAM for this.

&#x200B;

What are you guys thinking ?!

https://redd.it/e6m2y7
@r_devops

2020 one year challenge to get into the Cloud / DevOps space from fast food employee with basic tech knowledge to a working level.

Hello everyone. I will be challenging myself to be in the Cloud / DevOps space by EO2020.

# Current skills

1. Intermediate Python knowledge
1. Basic understanding of core data types
2. Can create a program / script given enough time
2. Extremely basic Linux knowledge
1. Understanding of commands like cd, ls, mv, I know how to switch users, log into root
3. Extremely basic Networking knowledge
1. I know a few different protocols like DNS, DHCP, etc. The basic shit. I only know these at a theoretical level, if that makes any sense. No practical knowledge working with them

# Gameplan

1. **Try** and get a helpdesk position for a better source of income, while learning. If I have to stay in fast food until EO2020, that's fine too. Fuck it.
2. Obtain a Linux Academy subscription
3. Start off by learning Linux System Administration fundamentals by following the Junior Linux System Administration course on Linux Academy which will lead to my **RHCSA**
4. Next, learn fundamental Networking, by following and understanding the [Networking course by Google](https://www.youtube.com/watch?v=QKfk7YFILws)
5. Database Administration and SQL Language Basics course on Linux Academy
6. Source Control With Git course on Linux Academy
7. DevOps Essentials course on Linux Academy
8. Using Terraform to Manage Applications and Infrastructure course on Linux Academy
9. Jenkins Quick Start course on Linux Academy
10. Certified Jenkins Engineer course on Linux Academy
11. Ansible: Setup, Configure, and Ad Hoc Commands Deep Dive on Linux Academy
12. Ansible: Playbooks Deep Dive course on Linux Academy
13. AWS Concepts course on Linux Academy
14. AWS Essentials course on Linux Academy
15. AWS Certified Solutions Architect Associate

\- Yes, throughout the year I will also be focusing on learning the processes behind DevOps, not just solely focused on tooling

\- Yes, I will be trying to put together projects

\- *"You need to get professional experience for this stuff, which will help you learn about the processes, pain points, blah blah".* Yes Mr Reddit poster, I would need to get a job to be able to understand these things at a solid level. Oh wait, in order to get a job, I need experience. Oh wait, in order to get experience I need a job. **That** is the problem a lot of the more seasoned engineers don't see on here for us new guys wanting to even learn any of this stuff / get a job in the space.


\- *"Don't just chase certs, they're meaningless".* Yes Mr Reddit poster, I understand that exp > certs any day of the week, but remember, in order for me to get experience, I need...... a job. Bingo. The only certs I'm getting are the RHCSA + AWS SAA. The Jenkins cert I will study for, **but not actually take.**

Anybody who wants to use my path as a guide, and challenge themselves as well, feel free to do so. Will provide an update at the end of the year. Worst case scenario? I don't get a job, and stay a fast food pleb with 10x more tech knowledge than I knew before. Best case scenario? That's what we're going to find out.

Peace.

https://redd.it/e6z74j
@r_devops

HTTP Availability and Polling Intervals

My question is this: Is it true to say, that polling an endpoint every 30 minutes for availability is too long? My thoughts are that if there is a minute of downtime when that poll occurs, that will count for 30 minutes of downtime (as the next check is done 30 minutes later).

Is there any best practices on polling intervals for endpoints? In fact, how often do you poll?

https://redd.it/e72lbc
@r_devops

K8s deployment/config files : how do you maintain them?

So, we've started using K8s recently and have gone live too. We've started doing releases too and realised that we have to update the Prod K8s configmaps/secrets comparing it with the UAT. Some values change for the Prod keys. We're doing the prod deployments manually. We just copy the deployment dir to a new one, change the image names and then deploy them.

I know this is far from a best practice, but we've just started out. So I'm asking around to understand what's the best practices you guys follow? We're looking at Spinnaker too but that's not in the immediate future.

https://redd.it/e72nz7
@r_devops

Need Suggestion for logging from a distributed system (Servers, UI, Sensors)

Currently I am working on a project for logging all events in a distributed system. The goal is to make the development team's job more efficient by being able to observe the full stack logs in one place. As of now, there is no efficient tracing mechanism for exceptions and events after pushing to production and staging. Our stack is mainly Python, JS, and some C++. All services are currently running on Azure app services and Azure IoT hub (for logging IoT devices' data) . Azure provides Application insight service which makes it easy to stream logs using their SDK from app services to app insight. They have dashboards that can be customized by the users to show desired charts and also it provides possibility of querying logs. I dont want to jump in and use app insight only because we are using app services in Azure. I am researching and reading about all the possibilities for different log management systems. I have used ELK ( Elasticsearch, Logstash, Kibana) in past, I am not sure if we need extra tech stack added to our technologies.

Also, I look into the Sentry if you heard about them. Their aim is for providing a better tracing for exceptions and linking the root causes of the exception together. They have SDK almost for all languages.

Another system that I looked into was Greylog which seems like is more for monitoring the server events and network and less concerned about exceptions and customized logs.

I also looked into Datadog, Splunk, and Sumo Logic.

Questions that I ask myself

\-----------------------

\- Is it better to stick with Application Insight (Azure)? Why?

\- What happens if we want to move away from Azure to another could system or even in house servers? ( Application Insight can be decoupled from Amazon app services )

\- Should we just use ELK since we can customize the metrics and provide as much as telemetry that we want?

\- Should we host our own logging management portal in house?

&#x200B;

Any suggestion and questions that can help me to narrow down and get to the right solution would be highly appreciated, it would be a big help

Thanks in advance

https://redd.it/e73reg
@r_devops

I'm trying to gauge the value of containerization

I have just begun the process of evaluating containerization for the PWAs I write for various organizations. I host the apps on a CentOS server on DigitalOcean and everything is great. Would I gain any value by containerizing the apps in a Docker environment vs. letting them be stand-alone apps on the server?

https://redd.it/e72rj8
@r_devops