I have two vpc stack templates that produce two seperate vpc environments. How can I consolidate them into a single vpc stack? (code below)

So I have a root template that deploys two vpc stacks. Like this:

root.template
\-> vpcstack1.template
\-> vpcstack2.template

In each template vpc resources (vpc, security groups, subnets, ect.) are deployed. They both belong to an app stack on their own vpcstack1 goes to app1 and vpcstack2 belongs to app 2. I'm being required by my organization to deploy both apps into one unified vpc stack. Which makes perfect sense. Why do I need 2 vpcs for 2 apps when I can have 1 vpc hosting 2 apps and all their required network resources.

Below is a snippet of my vpcstack2.template

Vpc:
Type: AWS::EC2::VPC
Properties:
CidrBlock:
Ref: VpcNetBlock
InstanceTenancy: default
EnableDnsSupport: 'true'
EnableDnsHostnames: 'true'
Tags:
- Key: Name
Value:
Fn::Join:
- '-'
- - vpc
- Ref: AWS::StackName
- Key: Platform
Value: nexus-repository-manager
- Key: Version
Value:
Ref: NexusRepositoryManagerVersion


This gives me my second VPC and all the resources in them. How can I get rid of the second vpc and take all the network resources and dump them into vpcstack1.template for a unified stack?

https://redd.it/ei6awx
@r_devops

VMware completes the acquisition of Pivotal. What will happen next?

Business Insider reported saying Pivotal is preparing for layoffs ahead of its $2.7B acquisition by VMware, and this sparked a protest by Pivotal employees internally and then went out on the public. As per the report, Employees started circulating an open letter asking VMware and Pivotal leadership to retain the workplace operations team.

When these acquisitions happen, it is usually so much confusing.
What to expect next?

https://redd.it/ehxtv2
@r_devops

Here's an off the wall question. Anyone in here dealing with or providing care for those with chronic or major health issues, what is your opinion of 'operations' in the medical industry?

After two years and about a million dollars spent on my wife's health, I have to say the entire thing is not inspiring confidence.

https://redd.it/ehws4a
@r_devops

IPAM / DCIM for the cloud

My organization maintains a spreadsheet with a list of all our subnet assignments across several dozen AWS accounts. This list is updated regularly by several people and is not always up to date, and overlaps do happen.
As our deployment continues to scale, the spreadsheet will not. So I'm looking for an IPAM solution, preferably something with auto-discover, that we can use to centralize management of limited networking resources.

I looked at Netbox which seems more geared towards physical DCs, and also doesn't have auto-discover capability (or at least I couldn't figure it out). Before I go and write a script to loop through all our AWS accounts and populate all the VPC and subnet data, does anyone have a better solution?

Thanks

https://redd.it/ehz9mg
@r_devops

Logging solutions that intelligently assigns log entries to a user or session context

Historically, I've used [Timber.io](https://Timber.io) for logging across a number of production accounts, and one of my favorite features is the deep integration with Rails (and other frameworks) that automatically assigns log entries to a user or session context, making troubleshooting functional issues much more efficient.


Their customer support has always been slow on the uptake, but in the last 6-12 months, they've become categorically unresponsive. I'm not sure if the service has been abandoned.


Are there any other out of box logging solutions that have this type of functionality? I'm aware you can cobble together a solution using tags, etc, but having a solution with this type of "magic" integration has been invaluable.


Tapping the wisdom of the community, what other solutions have I missed? Or am I overvaluing the elegance of this solution?

https://redd.it/ehxjfu
@r_devops

Not sure if a company needs what you offer enough to make an application?

Having seen quite some end user company IT environments as well as partner IT companies and there recruitment process let me tell you:

A lot of time they really don’t know what they are looking for. They might even have a dev ops team integrated in their other development environments but depending on who you in the end actually talk to is crucial.

I work for a 3.500 employee company with an IT of around 350 central and a distributed about 70 staff developer team in another country.

The team I applied for had nothing to do with dev ops. Now I’m doing a lot of that though, why?

A lot of companies with a big legacy backbone have stiff 10 year old deployment processes, testing etc. in my case there are fully fledged full stack really beastly kind of nerds. But the ERP team I joined did not have any of these state of the art dev ops processes integrated even though they were in their nearest vercinity.


Not enough time to transfare knowledge.


So the ERP team it self with 5 developer, some internal, freelancer, consultant, some admins and db admins with a product owner in an “agile” environment “:) :)” is kind of stuck in 2006. I work there as a developer originally with half my time being dev ops prioritised nowadays.

Not because they want „dev ops“. Or knew they wanted. But not having to rollout manually on a Sunday seems to be nice. With mails attached to rollouts „Mh nice“.

„Oh we can view all these logs from here now, with dashboards? And the 80k free text passwords from the db disappeared as well Mh nice.“

As said I’m not a dev ops guy I’m a dedicated developer. But I feel like the field has much to offer that’s very in transparent to companies.

After some time of integration let’s say half a year later the value always seemed to be completely out of question. It just became the new way to do it, always.

Every team with digital products as results or input of every field would benefit by having a dev ops dedicated guy in them.

At first it does not seem obvious to them though, try to find ways around that, you probably have a very special off skillset to offer. There are a lot of different development teams in most companies. The ERP teams I usually develop for have a very strong fundamental knowledge of how to do ERP.

Like scary knowledge, knowing they manually file transferred there releases for 15 years every two Sundays.

These specialized developers often don’t really care, for good reasons, how to containerize something or orchestrate it. Automatic rollouts, development plans, general utility or other more ops heavy topics a lot of times are completely of the charts for quite some developers.

Like reaaaally of the charts.

I work as a quite jumpy (1-2year interval) ERP developer (NAV) which is modifiable through its own C/AL language.

But my approach to „nice software“ always leads into a nieche position of doing 50% .Net, 40% dev ops and 10% ERP development it self.

Not because I know things nobody knows. But because the team I sit in naturally does know all the things I don’t know so I can know all the things they don’t know for teams up to 15 developers that worked well since 8 years for me.

It always felt like going the way of least resistance in my job but turned out to be the best random nieche to have found.

There is a 25 man .net developer team with a Kubernetes orchestrated enterprise storage management system (feeding our ERP) they have Elasticsearch, Kafka for messaging, fledged rollouts on commis etc.

To the front of the room I sit in. Even though working there as a full time .net dev there would seem nice I can’t imagine it to be, there all the “good shit” already is with me providing much more value in other teams.

With a 100 man java heavy web shop team. Fully automated, everything, state of the art, way to expensive feeding our ERP through questionable interfaces. Duo to web shop developers naturally not knowing how an ERP works internally and an ERP developer naturally not knowing what kind of in

terface clock work is the best for web shop infrastructures the result often are scary scary sql synchs duo to that being the only common ground these different teams can find.

At the end of the hallway 20meter away.

With the ERP team ONLY being able to work *inside* the ERP duo to that being what an ERP developer is. In medium companies with team sizes around 25 developers with 4-5 teams having to work together, the ERP team in 4 predecessor end user companies didn’t think about hiring more .net/other exotic resources until I randomly brought them in my bag with me cloaked as an ERP dev 😎

I feel like there probably are similier naturally good fitting fields of work for specific skill sets. But this combination feels like cheating.

https://redd.it/eiek67
@r_devops

What are some of awesome online tools/apps/services that are free, but require a credit card?

What are some of awesome online tools/apps/services that are free, but require a credit card?

https://redd.it/ehw234
@r_devops

What I learned about Product Delivery in 2019

I've been a long time reader of r/DevOps and noticed that most of the content posted here is on the technical side of DevOps (AWS, k8s, IaC) but very little is posted about the delivery and methodology aspects.

At the start of the year I (a Developer) joined a product team at a large tech company. I knew very little about DevOps and Product Delivery. Here's a write up of the books I've read and things I've learned in this area. Most of these are focused on the philosophy of DevOps and how it relates to developing, shipping, and monitoring products.

> What is Product Delivery? I’d define it as a set of practices, attitudes, and tools which can be used to improve the quality of software and the speed at which it’s delivered to customers. It’s a large field which takes in areas of Lean Product Development, Agile, Software Development, DevOps, and SRE. My approach was to read a lot of books and blogs on these topics and discuss the ideas with colleagues around the office. I’ve written this from the point of view as a developer on a product team at a large tech company. A lot of these ideas are applicable to solo entrepreneurs and those working on side projects.

https://isthisit.nz/posts/2019/product-delivery-learnings-2019/

https://redd.it/eioalg
@r_devops

Using Packer to fetch Ubuntu ISO and convert to template - vSphere -- waiting for IP address issue

As the title states, attempting to use packer, to fetch a ISO, pull it down, configure it with basic items and then convert to a template.

It works up until the very end, when at the packer CLI, it says "Waiting for SSH to become available".When i log into vsphere, I can see the image boot up, run through the installer then gets to the login prompt. Even though it has an IP address, its at the login prompt, packer is 'stuck' waiting or SSH to become available. (i can SSH to the box to verify openssh-server is accepting connections, which it is).

==> Some builds didn't complete successfully and had errors:
--> vsphere-iso: ssh: handshake failed: ssh: unable to authenticate, attempted methods [password none], no supported methods remain

Ultimately what happens is a timeout, then every backs out, the VM is deleted.

I feel I am so close and missing something very very easy and simple.

I am using packer 1.35 and jetbrains vpshere-iso plugin.

Here are my files:

{
"builders": [
{
"type": "vsphere-iso",

"vcenter_server": "{{user `vcenter_server`}}",
"username": "{{user `username`}}",
"password": "{{user `password`}}",
"insecure_connection": "true",

"vm_name": "temp_ubuntu18",
"datastore": "{{user `datastore`}}",
"folder": "{{user `folder`}}",
"convert_to_template": "true",
"cluster": "{{user `cluster`}}",
"network": "{{user `network`}}",
"boot_order": "disk,cdrom",

"guest_os_type": "ubuntu64Guest",

"ssh_username": "{{user `ssh_username`}}",
"ssh_password": "{{user `ssh_password`}}",

"CPUs": 1,
"RAM": 1024,
"RAM_reserve_all": true,

"disk_controller_type": "pvscsi",
"disk_size": 16768,
"disk_thin_provisioned": true,

"network_card": "vmxnet3",

"iso_urls": "https://cdimage.ubuntu.com/releases/18.04/release/ubuntu-18.04.3-server-amd64.iso",
"iso_checksum": "7d8e0055d663bffa27c1718685085626cb59346e7626ba3d3f476322271f573e",
"iso_checksum_type": "sha256",

"floppy_files": [
"./preseed.cfg"
],
"boot_command": [
"<enter><wait><f6><wait><esc><wait>",
"<bs><bs><bs><bs><bs><bs><bs><bs><bs><bs>",
"<bs><bs><bs><bs><bs><bs><bs><bs><bs><bs>",
"<bs><bs><bs><bs><bs><bs><bs><bs><bs><bs>",
"<bs><bs><bs><bs><bs><bs><bs><bs><bs><bs>",
"<bs><bs><bs><bs><bs><bs><bs><bs><bs><bs>",
"<bs><bs><bs><bs><bs><bs><bs><bs><bs><bs>",
"<bs><bs><bs><bs><bs><bs><bs><bs><bs><bs>",
"<bs><bs><bs><bs><bs><bs><bs><bs><bs><bs>",
"<bs><bs><bs>",
"/install/vmlinuz",
" initrd=/install/initrd.gz",
" priority=critical",
" locale=en_US",
" file=/media/preseed.cfg",
"<enter>"
]
}
],

"provisioners": [
{
"type": "shell",
"inline": ["echo 'template build complete'"]
}
]
}

Here is my variables file:

{
"vcenter_server":"xxx.xxx.xxx.xxx",
"username":"XXXXXX",
"password":"XXXXX",
"datastore":iSCSI-storage",
"folder": "_Templates",
"cluster": "crazytown",
"network": "vDEV",
"ssh_username": "root",
"ssh_password": "XXXXX"
}

Finally, my preseed file:

d-i passwd/user-fullname string dude
d-i passwd/username string dude
d-i passwd/user-password password mypassword
d-i passwd/user-password-again password mypassword
d-i user-setup/allow-password-weak boolean true

d-i

partman-auto/disk string /dev/sda
d-i partman-auto/method string regular
d-i partman-partitioning/confirm_write_new_label boolean true
d-i partman/choose_partition select finish
d-i partman/confirm boolean true
d-i partman/confirm_nooverwrite boolean true

d-i passwd/root-login boolean true
d-i passwd/root-password password mypassword
d-i passwd/root-password-again password mypassword


d-i pkgsel/include string open-vm-tools openssh-server

d-i grub-installer/only_debian boolean true

d-i preseed/late_command string \
echo 'dude ALL=(ALL) NOPASSWD: ALL' > /target/etc/sudoers.d/dude ; \
in-target chmod 440 /etc/sudoers.d/dude;

d-i finish-install/reboot_in_progress note

Driving me bonkers because i feel it is simple.

Something simple I am missing? something out of order?

Appreciate the help and extra eyes.

Cheers

&#x200B;

TCG

https://redd.it/eip3ne
@r_devops

Looking for a dashboard for github actions

Hi, I'm used to dashboards surfacing CI/CD status on GitLab, is there anything like that for github actions?

https://redd.it/eioj0b
@r_devops

What are the chances of getting remote DevOp Jobs?

Hey! I am from a small island in the Caribbean, what are the chances of getting an entry level remote job as a DevOp with foreign companies?

My only option is remote work due to my location and opportunities at hand.

Thanks!

https://redd.it/eikjuh
@r_devops

Considering if to continue in the devops field

I guess this is more a personal issue, but an insight might be helpful.

I'm a woman in my mid 30's. Currently, was fired from my job after 3 months. I worked part-time (60%) The mutual understanding is this wasn't necessarily based on technical issues but more fitting issues. I have good skills but I also think they should be improved.
The company is around 20 people, there are 2 devs in Ukraine while the managers are based in my country. I was the only woman in the office.
I felt they don't really had understanding what Devops means and everything was abstract, which made it dificult to accomplish anything.

The reason I work part-time is because Im also doing art and painting. This was a hobby that got extended and it's hard for me to let go.
In my country, it's dificult to find good devops so even when sent resume to full time jobs I still got called and they agreed to consider 60%.
I'll admit that I have mild mental issues like anxiety and depression that I'm handling but it's still exist.
My fear is, that even if i'll still be able to find something else the characteristics made me failed here will be similar in other places. In the long run, I prefer to do a change now than in my 40's.


TL;DR- a woman in mid 30's, artist, some mental issues, still a devops for now. What do you think my options and if I have any?

https://redd.it/eilqta
@r_devops

Need suggestions for contract templates for DevOps side work

Finally getting back into contracting with a job for a former manager to help him set up his infrastructure from scratch for his new business. Last time I did some contract jobs, I didn't really do things right and left myself open to some serious liability. This time around I've established an LLC with a business partner who is handling security related jobs, a separate business account, insurance, and soon a CPA and expense tracking software.

I was wondering if there are any good contract templates that are geared towards this type of work that folks here can recommend?

Any other recommendations on doing this the right way? Thanks!

https://redd.it/eijfsp
@r_devops

suggestion on what to explore after deploying a model using

flask, gunicorn, docker at heroku/AWS, nginx( indirectly using elastic beanstalk).

what would be the next thing that I should explore? \*nothing too difficult\*

I'm going this route ( back to front ) as I'm in an analyst.

Thanks.

https://redd.it/eiim8x
@r_devops

Where are Rspec reports created?

Hi there,

Apologies for a noob question. I am trying to upload the Rspec reports generated during a Jenkins AMI build. When the build reached Test stage, archiveArtifact fails saying serverspec.* Doesn't match any pattern. So I was wondering where the reports are saved and with which name?

Thanks

https://redd.it/eiu5dt
@r_devops

Suggestion on choosing the auth backend in vault system

Initially [posted](https://www.reddit.com/r/hashicorp/comments/eig3su/suggestion_on_choosing_the_auth_backend_in_vault/) in r/Hashicorp for suggestions and as there is no reply, trying my luck in devops community.

I am building an internal app for our ops team with intention to login using an SSO credentials and then request the ActiveDirectory, AWS, Azure and GoogleCloud secrets from the Vault. In a way similar to what [BanzaiCloudPipeline](https://banzaicloud.com/blog/oauth2-vault/) is doing. But there are few changes.

The way I am expecting it to work is:

1. I would keep the users and his roles in the app backend database system.
2. User will login using SSO creds.
3. After successful authentication, will get a token from the auth-provider and also will create a session for user in the app.
4. I have the information of a session token and what role the user should've at this point.
5. Next, I would need to get policy and a token for each user from vault using the information that I have collected till this point without requesting anything else from user.

Up to 4th point, I can design the workflow but have confusion on how to implement the last point w.r.t each user from the Vault.

So, using which auth backend, can I implement the above workflow without introducing additional complexity?

If the question is out of scope, that's fine.

https://redd.it/eitppk
@r_devops

Which DevOps tool you would like to replace in 2020 and why.

Even though ours is a startup, I would like to replace Docker Swarm with Kubernetes.
I would like to see it’s power that everyone else is talking about. Our containers and workloads are increasing in number and yes I think it’s better to make use of Kubernetes at this point.

Which tool your world like to replace from your existing stack and why?

https://redd.it/eitfsi
@r_devops

How do you guys handle rollbacks with automated CI/CD pipelines?

Title. If you have a bad release, what do you do? Revert master to the last good commit, then let the pipeline take care of things? An alternative process?

https://redd.it/eid1ak
@r_devops