How social portals avoid mixed content errors?

As we may know, a website that uses a SSL certificate do not (at least by default to my knowledge) shows that page is secure if there is an http link.

If you may write a post or some other form of dynamic content on a website, then what server settings are related to allowing for mixed content without removing that sweet lock in our URL bar?

https://redd.it/lqwzp7
@r_devops

Circle CI and airflow tips, suggestions and help welcome!

I'm using Circle CI for the first time and am not that familiar with setting up a CI.

I want to setup A CI to smoke test DAGS from airflow and test other parts in the code. Circle CI has a specific set of installs and dependancies that made it hard to test.

​

I'm Using the docker puckel/docker-airflow too simplify the installation progress and setup of the env.

I got the idea that I'm doing something wrong. any suggestions, tip or help would be appriciated!

The current config looks like this. The pwd and ls are for reference so I now what to copy where and the current structure(Still not familiar with debugging CI)

 yml
version: 2.1

workflows:
    test:
        jobs:
            - build-and-test
jobs: 
    build-and-test:
        docker:
            - image: puckel/docker-airflow:1.10.9              
        steps:
            - checkout
            - run:
                  name: install dependencies
                  command: |
                    pip install -r requirements_test.txt
            - run: 
                command: |
                    pwd
                    cd ..
                    pwd
                    mkdir dags
                    cp -r project/airflow/dags/* dags/
                    export AIRFLOW_DAGS=/usr/local/airflow/dags 
                    cd dags
                    airflow initdb
                    pwd
                    python -m unittest -v tests/test*

                name: Test

ps. Sorry if this is the wrong reddit to ask such questions

https://redd.it/lqe7s9
@r_devops

Best tracing tool for serverless ? (maybe Lambda, Azure Functions, etc..)

I was thinking on tracing tools to keep observability in serverless applications/architectures.

So, in your experience guys, which are the best options to integrate serverless tracing/observability in our architectures.


I love the way of Jaeger works for micro services. And I know there are options like X-Ray for lambda, but: did you know automations, integrations or any useful resources to implement tracing on serverless?

https://redd.it/lqcixf
@r_devops

Gitlab Artifact storage solutions

Hello everyone,

We use gitlab CI and one of the problems we have been having is running out of storage space. Currently we store all the artifacts locally in the default path /var/opt/gitlab/gitlab-rails/shared/artifacts and its proving to not be working out. I am just curious how others have dealt with storage issues in gitlab and if there are any recommendations.

Currently the solutions that come to mind are either using AWS s3 or using a big company NAS.

https://redd.it/lqaikm
@r_devops

Order of operations for BDD tests in pipeline and API dependency from FE microservices

Building a CI/CD pipeline and I'm trying to wrap my brain around a few things:

* Where in the pipeline steps do the BDD tests go?
* I was original thinking (based on some tutorials) that I'd have a step where the Linux VM is made, then the microservice is built in the VM, then tests are run... if they pass, build the Docker image and deploy to K8S. But it seems like I should be building the Docker image, running the image in a container and testing that since that is what is getting deployed to K8S.
* How do I handle what seems like a pretty common use case where the FE makes a call to the API, but they have separate pipelines?

https://redd.it/lqz2o9
@r_devops

I heard on a Podcast that the CompTia Server+ might be a good step into DevOps... thoughts?

I was listening to a Podcast hosted by CloudSkills.io (the podcast is called CloudSkills.fm on Apple Podcasts) and the host Mike Pfeiffer mentioned that someone who has little to no experience in the IT world, and wants to break into and take a step towards DevOps, that system administration is important. He mentions that the CompTia Server+ certification is a good vendor neutral cert to get some knowledge about servers, networking, virtualization. He mentions once you understand those core concepts -- then move on to a Fundamental Cloud cert like Azure Fundamentals or AWS Cloud Practitioner.

What's your thoughts on this? I have a few years of IT Help Desk under my belt, and want to take the next steps on moving towards system administration and cloud. Searching through LinkedIn at people that work in the field of DevOps -- I don't see many people have it. Also, looking at job listing for DevOps Engineers -- I don't see this cert mentioned in there either.

What's your opinion?

https://redd.it/lqryv4
@r_devops

What tools to you use to automate security hardening of your images for EC2 or for your containers ?

I'm been using this ansible role for my linux VMs.

https://galaxy.ansible.com/dev-sec/os-hardening

I'm looking for recommendations to harden my linux-based VMs and containers.

https://redd.it/lqqijs
@r_devops

Laptop Recommendations to build a Home Lab

I'm looking to buy a laptop to build my own personal home lab. Does anyone have any recommendations for the type of laptop to buy that will help me get a home lab started?

https://redd.it/lqs1pq
@r_devops

Insights on Cloud4C?

Does anyone have any insight on Cloud4C that they can share?

Across the usual touchpoints (twitter, reddit, glassdoors, google), I can only find loads of press releases and positive sentiment, and not one person using colorful expletives to describe the company, which is the most suspicious thing. It irks me...

Thoughts?

https://redd.it/lrhr6g
@r_devops

I did it guys

Had to tell someone as it's not yet official

But I've secured a role at my company as a Platform/DevOps Engineer

Once HR and the managers sort it all out I'll be transitioning over from ServiceOps

I'll be finally spending my days building the platform rather than resetting a developers password or restarting a windows service ... Happy days

https://redd.it/lregzj
@r_devops

Git Concepts and Theory Resources

Hey All! I'm a bit new to DevOps, and I am looking to beef up my knowledge of Git and its general theory and principles, as well as different branching strategies. Wanted to see if anyone had any resources or online tutorials that they recommend?

Thank you!

https://redd.it/lrjv3k
@r_devops

Docker vs LXC for testing environments

I'm building my own CI setup for web development. I'm at the stage when I'm asking myself a question - should I use Docker or another, nested LXC/LXD hypervisor for hosting testing environments for my branches. I'm familiar with Docker, and I'm quite familiar with LXC. I'm pretty sure I'll continue to use Docker for local development, but for public testing environments LXC is kinda tempting. Maybe because it's conceptually simpler than Docker, and more similar to the production environments.

What are your experiences? Would spawning LXContainers be a better idea than spinning up Docker environments? Both seem to have everything needed for this task, but I feel like LXC will be slightly easier to maintain, I'm not sure if I'm right though. I have admittedly more experience with Docker than LXC.

And I'll answer "Why not cloud?! \~_\~" already: just learning purposes :) .

https://redd.it/lrkkmv
@r_devops

CI/CD tools similar to octopus deploy (IIS)

So one thing I like about Octpus Deploy is that it has the ability to configure IIS and it's a CI/CD tool. Are there other CI/CD tools that can do this natively aswell as if they are free and open source (nice to have but not a deal breaker). Right now we have jenkins and been writing ansible (config management) playbooks to boot strap iis configs (site, app pools, bindings, web apps, virtual directories). I can handle this all in powershell/ansible but this is more for my team of various skill levels with some of them being more of a Jr to mid-level sysadmin who work better with GUIs than straight code like powershell. Some of them execute code from the net without understanding what they are executing to fix an issue so that's what I'm working with. I'm not management, so unfortunately I'm trying to find a tech solution to a partial human issue.

We do not let our developers do this as part of their code base because they are developers at their core with no ops experience and there have been plenty of instances where we had to step in to stop them from shooting themselves in the foot. So that's another reason why specifically a CI/CD tool.

https://redd.it/lrgnux
@r_devops

Terraform EC2 post deploy configuration

Wondering if anyone can share their ideas on getting config files and installing packages on new EC2 instances provisioned using terraform.

options considered:

\- baking packages into AMI & deploying config files to EC2 instance using Terraform

\- using Terraform to run post exec hooks on the EC2 instance after deploy

\- using Ansible to deploy scripts and packages to EC2 instance after deploy

These seem to be the only ways to keep the configuration of the instance located with the IAC package, I'm a little fuzzy on how I would execute these solutions so any advice if you have done it before or think it's a good idea would be useful.

Would like to avoid deploying supporting resources like a chef or puppet server.

https://redd.it/lrn3e4
@r_devops

Would love some clarification about Kubernetes deployment to EC2

Hey all,

I am coming from a Python development background (backend) and I just got a new Backend/DevOps job offer from a company I am really interested in.

The assignment is:

>Create a Jenkins declarative pipeline to deploy a Kubernetes cluster (1 to 3 Nodes). The K8s should be deployed on top of AWS EC2 Instances and it should be used by Terraform and Ansible.

As I have absolutely zero knowledge about the technological stack mentioned above, I wanted to ask if I got it right in my head to make sure I am doing this right.

1. Create 3 Ubuntu instances on Amazon EC2 using the AWS console
2. Create a Jenkinsfile that will be used to deploy the K8s cluster to the EC2 instance

Now, few things I don't get,

1. What is the use of Terraform and Ansible in this assignment? How should I implement it?
2. All the configuration (i.e building the EC2 instances and deploying K8s) should be in the Jenkinsfile? If so, where I can find some examples related to what I need to do (Google was not very helpful, surprisingly)
3. Should I use the EC2 plugins for Jenkins?
4. What do "1 to 3 nodes" mean?

Thanks a lot!

https://redd.it/lrevfa
@r_devops

a better model for CI/CD cycling



Hello DevOp'ers !

I am having some troubles finding a better model for my CI/CD cycle.

This is mainly gitflow issue.

My current model : We have 2 bitbucket branches : master and develop.

Both are linked via webhooks to jenkins to be deployed to prod. and dev. servers.

QA team for testing features and releases on dev. server.

Team of developers for both frontend and for backend. With lots of troubles.

The problem : Team manager wants to be able to have better control over accepted/rejected features. Say : developer1 commited a feature to develop branch, developer2 added a hotfix to develop, we want QA team to easily test them both separately, and then testing both together with the least hussle possible. And afterwards easily select what commit stays and moved to master branch.

As I said, this is mainly gitflow issue.

Any suggestions ?

https://redd.it/lre433
@r_devops

Kubernetes CPU cores

Hi community,

Need some help in understanding this concept. I have a mysql pod running on a 8 cores single node k3s cluster, i have set the request to '200m' and the hard limit is set to '500m'. During benchmarking mysql using sysbench, i have noticed mysql process uses all the 8 cores during the process despite of setting the limit to 500m which is just about 6.5% of the total cpu. The idle cpu during the Benchmarking process is approx 60%. I am trying to understand, why the processes are spread across all cores , is this how it works in Kubernetes ? Can we control, the cpu cores limits as well on top of cpu time limit ?

Thanks

https://redd.it/lr9e1g
@r_devops

For IaC: Pulumi or Terraform?

I am moving toward supporting Cloud IaC and am learning new tools in the process. For those that have supported both AWS and Azure using Terraform and/or Pulumi, what was the good and the bad?

https://redd.it/lrvkc8
@r_devops

How to use a Lambda function to deploy single-tenant applications to an EKS cluster?

I am working on a pet project which will have an EKS cluster where I want to have a tool do automated deployments of single-tenant applications. Got a good part of it working but not the Lambda part.

I have a single-tenant application that will need to be deployed to an EKS cluster and I am planning on having it so there is an SQS queue that will get messages of what to deploy. The idea being a user will 'sign up' so to speak and then that would create an SNS notification that will fan out to two or three SQS queues. One being the queue to set up the database and the other being to deploy the application to the EKS cluster. Third, being maybe a status system I am debating.

My question/design issue is how can I have a Lambda function be the one to process this? I have built a rough tool that does most of what I want in a single script run locally however I am trying to figure out how to get Lambda to process it and handling the EKS security part. IE currently it is running against EKS via my local kubeconfig but that doesn't work in Lambda and I really don't want to hard code the kubeconfig into the Lambda function as that is both a security issue and an operations issue..

The way I have Lambda handle this must work across multiple Lambda functions deploying at once as well as work in Lambda functions that do stuff like delete a deployment (more than just a K8s deployment).

https://redd.it/lru0wb
@r_devops

Opinions on gruntwork.io infra code library

Hello

I am curious if anyone has or had a subscription to gruntwork.io's code repo to leverage their IaC library of TF modules and if so any feedback that you can share.

Thanks!

https://redd.it/lrt20h
@r_devops

Pods Disk Utilization

Hi, community,

How can I track the storage of the pods running in the cluster? I have metrics server and Kube-state-metrics deployed but the problem is I cannot access the web UI as it's just a test environment running behind VPN? Is there any way I could fetch this data using the command line? Are there any lightweight tools that can be used to query from CLI or any functions to query Kube-server using the command line?

Thanks a lot

https://redd.it/lrz24c
@r_devops