Provide SFTP access to Non-tech people

So an organization sends us files in our SFTP server and I fetch them and send it to our operations team but now the operation teams wants access to remove my dependency to make the process quicker. I get those files in our server in private subnet for security purpose.

How can I provide them access as they don't know linux commands?

https://redd.it/sbkl93
@r_devops

CircleCI Adds Free Unlimited Access Tier to CI/CD Service

<https://devops.com/circleci-adds-free-unlimited-access-tier-to-ci-cd-service/>

https://redd.it/sblwwt
@r_devops

CircleCI Adds Free Unlimited Access Tier to CI/CD Service

<https://devops.com/circleci-adds-free-unlimited-access-tier-to-ci-cd-service/>

https://redd.it/sblwwt
@r_devops

Pipeline Patterns

Is there a good reference page with examples on how to setup the following pipeline situations:

Full deployment?

Partial deployment with only updated files being pushed?

Pipelines that call other pipelines that include infrastructure then code related parts?

https://redd.it/sblmuf
@r_devops

Specifying IAM Role in Packer

So I am currently trying to default to using IAM roles/polices for packer to use rather than specifying environment variables.

So the question is in two parts which is:


1. When creating the IAM role, how is this specified within the HCL template?

2. When I use this specific IAM role, will packer require any other credentials to initiate the build or will it automatically recognise using the name of the profile?

Bonus question:

If I'm using Jenkins to create a pipeline, how do I specify the same IAM role to be used, will any work be needed on the slave (windows server) or on the Jenkins instance for it to initiate a connection to AWS to initiate the build?


I've done some research on how this is possible but all examples i haven't been able to visualise how it's possible within a working piece of code: https://www.packer.io/plugins/builders/amazon#iam-task-or-instance-role

Feel free to let me know if clarification is needed.

https://redd.it/sbke47
@r_devops

Help comparing CircleCI to Github Actions from cost perspective only

The pricing for both of these are rather convoluted and depends on number of users, number of minutes needed for the runners. So I want to set some constants to de-convolute it and just compare pricing between GitHub Actions and CircleCI, irregardless of the differing feature sets. Here are the constants:

Runner: Linux 2-core machine
Minutes needed: 1200/day
Number of users/seats: 10
Assume the use of dependency caching

Can anyone speak to the cost of just these two platforms with the given constants? Are there other variables that should be fixed to make the comparison more straight-forward?

https://redd.it/sbpx3h
@r_devops

What will better futureproof your career - learning serverless or containers/k8s?

Obviously if I had all the time in the world I'd learn both, but I'm curious what you all think might be the better option?

https://redd.it/sbs9pi
@r_devops

Cannot delete ArgoCD app

There isn't a ArgoCD sub reddit so I figured this is the next best place.

I'm having some trouble with deleting an application in ArgoCD. I deleted the app without cascade and deleted the resources manually via kubectl delete -f manifest.yaml (basically to reverse it) however the application will reappear in ArgoCD and it will say it is out of sync which I expect at this point.

If I delete the now out of sync app within ArgoCD, I see the green box to indicate that it has been deleted but a few seconds later the application will reappear! If I also try to delete the manifest from the repository it will complain that it cannot find the path of said manifest it expects to find so I cannot even delete the application.

Any ideas how can I discard this app so it does not appear in ArgoCD?

https://redd.it/sbmp9y
@r_devops

Learning path critique for experienced dev

# Background

I have been mainly an automation engineer in a QA department wearing many other hats (performance benchmarking , basic full stack web dev for internal tooling , release management ) for about 6.5 years in 1 small-ish company . I recently quit my job because of burnout , being paid peanuts and wanting to shift fully to reliability engineering / platform engineering area.

I have breathed bash , shell , linux and python so I feel confident on those. I have worked with AWS , docker, ansible , jenkins for years but at a very small scale and at their most basic . eg : AWS instances were deployed via interal python tools using awscli never a cluster or exceeded 10 instances at once , docker instances were launched in a small quanity by internal python tool & not by K8 or somethign , etc . I also want to learn kubernetes to some degree as everyone's mom , dad , uncle , pet wants that . So I want to work and cover these gaps to some degree that a person can in a homelab setup while understanding that this will never rival the complexities of production grade environment.

I also want to priortize FAANG because of visa purposes as I am not from US but my gf lives in US so I want to shift to US. Relocation is possible in other companies but is easier achieved here.

# Goal

Get a mid to senior level devops/SRE type role in preferably FAANG tier

# Plan

Do the udemy K8 intro course and CKA course by Mumshad . AWS SAA course by Stephen Maarek . Get the CKA and AWS SAA certs to boost my confidence and apply this knowledge in personal project setups hosted on github/gitlab. I will document all of this on a CV blog that I already have.

&#x200B;

Personal project : get react apps in cotainers managed by K8s , deployed by terraform in a CI/CD pipeline . Show or have a usecase/example for scaling (simulate http request) and reliability (deliberately turn off instances). Iterate on this as I learn more

&#x200B;

Grind Leetcode daily : 1 medium problem everyday and keep touching on data structures to make it easier to learn.

# Queries

Should I priortize getting the certs first or getting the homelab setup going ? I like building things so I am inclined to the later but from what I have read that certs can help me get my foot in the door as some mid level companies have cert classifiers.
Leetcode : Do I need to do this ? I hate grinding it day in and day out but it seems like a necessary evil to get into FAANG which is what I want because of my visa situation.
Any other advice?

&#x200B;

TL;DR : quit job. Wanna shift to reliability engineering . Need crtique on learning plan.

https://redd.it/sbst8r
@r_devops

Career transition Dilemma

Hi, I m an experienced BI Data Analyst with around 3.2 years of experience in Reporting and writing SQL queries. I have recently completed my masters in CS in Europe with majors in (Machine learning and Big data ) as well. But Lately, I m interested in Cloud DevOps Engineering and even cleared AWS SA certification. Is it a good move to shift to DevOps/cloud  ? or should I concentrate on Data Engineering?  my only concern for Data Engineering even while applying for jobs is half of DE jobs are based on tools like ADF, Informatica,SSIS and remaining have good job openings like SQL,Spark, Python, Airflow, etc. Despite all that DEVOPS ENGINEER were paid more than Bigdata Engineers and has a high volume of openings too, To add on that DevOps engineers have the same tech (AWS,Jenkins,Linux,Dokcer,Git and Python )stack everywhere unlike Data Engineers(Some using Python & ETL coding and some are heavy tool based ).

Is this a good choice moving from BI data analyst to Devops cloud Engineer ? Does hiring manager will even consider some one like me for Devops positions ?

https://redd.it/sbv2dw
@r_devops

Bitbucket Pipelines repository variables and parallel steps

Hey all! Hoping someone else has encountered this before as I can't find anything with Google and Bitbucket's support is atrocious.

I'm rewriting some deployments to work in parallel. My understanding is that the first step receives the repository variables and then it's my job to pass them to each subsequent step. So I have something like:

- step: *prepare-build
- parallel:
- step: *step1
- step: *step2
- step: *step3

With each of the * portions being defined elsewhere and re-used across the different environments.

The problem I have is that the environment variables aren't passed to the `prepare-build` step, but instead are passed to the `step1` step instead. Before rewriting the steps to parallel, `step1` was the only step that existed.

Is this intentional behavior, in that BB passes the variables to the first parallel step? Is it a result of some weird caching policy? Something else I've overlooked?

https://redd.it/sbv1s5
@r_devops

What may a typical technical interview look like for an infrastructure engineer?

I have an initial interview today for my dream job being an infrastructure engineer at a very large company. I've only ever interviewed for SWE positions at small companies so I'm currently kind of at a loss for how it normally goes. This position also seems pretty new at this company so there's currently no information on how the interview process goes for anyone besides SREs and SWEs.

I'm pretty confident but the only thing I'm worried about is a technical interview. I've never practiced leetcoding or anything so I'm worried if there is a leetcode-type interview I'll fail miserably. But to me it also seems like that's not super useful for an infrastructure engineer position.

Has anyone interviewed at a large company for a similar position that can give some guesses on what to expect if a technical interview does come up?

https://redd.it/sby1xp
@r_devops

What does a Devops portfolio look like?

Hi

So I'm currently working in QA and I'm really fascinated by devops. At the company I work for there is an opportunity for me to apply and transition in DevOps.

At this moment in time I'm still studying and hoping to start putting together personal projects while I wait for my opportunity.

What I'd like to know is:

What does the average Devops Portfolio look like ?

What are some examples of some respectable entry level projects?

Id also be very thankful to look at any personal portfolios sites or projects that you admire.

Thank you in advance to everyone that goes out of their way to point me in the right direction

https://redd.it/sbw9wg
@r_devops

Advice to a beginner thrown into a disorganized SaaS startup environment?

My boss is brilliant but hard to get a reach of as he's more focused on producing and architecting than managing (but he does try on the latter). While he's created some documentation, it's VERY sparse. My peer and I simply can't attack ad-hoc issues with the application in the same way that he can. He's a diligent worker but it just all ends upon him.

I want to take some of that workload off him, so I try to attack any requests that I can but, again, it's very sparse. In stuck situations, there are times I am afraid to ask especially because it will take a long time to answer/explain and I don't want to detract him from some of the projects we're trying to get going atm. I also am concerned it might reflect poorly on me, even though I've received a lot of good feedback.

Cutting to the problem, in conjunction with how new I am to the field, I have trouble knowing how to approach certain requests from our users because I don't really know how our application even works.

As an example, I don't have a lot of in-depth knowledge on SSO. My boss showed me how to implement it once (using SAML), which kind of gave me enough to understand and toy around to implement it for a few other customers. But now I've been given what looks like OAuth2 data which I have no idea if we support.

Another example, we have our repo that's full of Ansible and Terraform IaaC. I've been able to debug and toy around and make my own contributions, but that's all templated from his work. I don't really know how to write my own because again, I'm new, and I don't know what my restrictions are. We have a rough systems diagram but I don't think it's detailed enough for me to understand what I'm working with.

Appreciate any tips!

https://redd.it/sbza0q
@r_devops

Elastic Beanstalk- fastest processor for deep learning?

I am wondering what is the fastest processor I can use for an application that uses deep learning through elastic beanstalk?

https://redd.it/sc2r0w
@r_devops

Scared of Carrer Transition -DevOps

I am currently working as Lead QA Automation engineer(10+ yrs) and trying to move into DevOps. Sometimes i feel there is no much scope and will not earn much in QA if you get more experienced. To Start DevOps i am doing a lot of side projects and below are the questions always comes in my mind whenever i learn DevOps and below points are pops in my mind its affecting my progress(especially #4th point).

1) Why I Cant be in QA and try to earn like DevOps by switching company. But i feel that Automation testing is something overcrowded and considering ever changing DevOps field i can stand out from the crowd if i update myself technically

2) I would like to start attending interview DevOps in 8 months but by seeing tons of tools/approach,Sometimes i feel overwhelmed and not sure whether i could study all these in 8 months(Linux, AWS, Docker, K8s, Terraform, Build Tools, Nexus, WebServeres, Jenkins, Ansible, Monitoring tools,SSL,Networking etc) & leetcode problems for good product companies :)

3)Since my company is not allowing me to move to DevOps- I am starting to learn on my own but sometimes i get scared that should i have to lie in interview that i am working in DevOps tools & methodology even though i don't have real time experience?

4)Even though i do side projects in DevOps, I am always getting thought that I don't have real time experience that may affect my future DevOps Job and get me fired? as because Real Time DevOps jobs will deal with 100s of real production/test environment servers and I will be working with real DevOps colleagues. what if i get screwed and this is the biggest concern i am having for my Carrer Transition

Note: I am average at coding and know Python & Java and basics of Linux. and I really like DevOps more than QA.

Sorry for the long post. Need some inputs from you guys.

https://redd.it/sc2szp
@r_devops

Escaping Tutorial Purgatory

Hi All, I hope this is the right format/sub for this.

I’m looking to get some ideas for projects in the following technologies. I currently work in tech sales role but like to get hands on and have a strong background in networking up to CCNP level with half-decent programming ability. I increasingly have to be aware of, and architect solutions involving and with consideration to DevOps and related technologies/concepts but I want to make something bigger with these technologies, rather than just the way they integrate with the solutions I am familiar with for my day to day job.

I have a good theoretical understanding of these technologies and have also played with them to the point of creating “mini” projects to understand them individually, but I’m struggling creatively to work on something bigger to encompass as many of the technologies working together as possible and really break some stuff on the way to taking my understanding to the next level.

Any input is greatly appreciated. The main technologies I’ve worked on and would like a project to include are:

Kubernetes/Docker/LXC

Bash Scripting

Terraform

Ansible

Public Cloud

https://redd.it/sby699
@r_devops

Tests Basics in Kraken CI

I have prepared an article that present various aspects and features of testing in Kraken CI: https://nowikowski.medium.com/tests-basics-in-kraken-ci-e92688cb286
What do you think about that?

https://redd.it/sc6oo1
@r_devops

Take GitHub Actions Course For Free

A beginner-friendly, and free, course to help you take your first steps as a DevOps engineer is available as a series of YouTube videos.

https://www.i-programmer.info/news/90-tools/15165-take-github-actions-course-for-free.html

https://redd.it/sc85yt
@r_devops

Docker resilience strategy

Hello! I have a basic Docker setup for home lab use and am trying to figure out what long-term strategy for it is. I probably only have about 15ish containers, but I want to make the environment as a whole more resilient and potentially more portable. The Docker host I'm running is just an Ubuntu box. Docker was installed via Snap. I thought I had a decent idea of how to detach the Docker environment's dependency upon the stability of the one Ubuntu machine by moving all the containers' volumes to a second disk in the Ubuntu box. I followed a guide that had me move the whole /var/lib/snapd directory to the second disk. It worked flawlessly and the containers load from the second disk just fine. However, attempting to attach that disk with all Snap data on it to another Ubuntu machine, the Docker containers aren't automatically detected and I don't know how to add them. So, taking a step back, am I approaching this correctly? Is there a better strategy for preserving the entire environment than exporting or saving container-by-container?

https://redd.it/sc878v
@r_devops

Versioning ECR docker images

Hi,

So we want to implement semantic versioning and want to version our ECR images accordingly. Currently in our Buildspec.yaml file we just tag it "latest" and hence all the previous images are shown as "undefined".

We wanted something better than that. So how do I update the version of my docker images so that in ECR repo I can go back to previous images easily. It can be accordingly to our CodeBuild build number or v1, v2, v3 and so on. Just something better than "lastest"

Thanks

https://redd.it/scaig1
@r_devops