Autoscaling CI with Kraken CI

Hello,
I wrote a new instalment of a series of articles about Kraken CI (https://kraken.ci). Part 3 is about autoscaling CI on AWS: https://nowikowski.medium.com/autoscaling-ci-with-kraken-ci-d1afb9d6b2c8

https://redd.it/oo160s
@r_devops

Have you thought to go / come back to a Software Engineer role ?

I am really thinking to leave my "DevOps/Cloud Engineer" job and go back to a software engineer role, even if it means losing my experience and salary.

Being a jack-of-all trades was nice at the beginning, but it feels like at the end it's just being an Ops 2.0, fancy tools, large scope, but with the same stress, pressure and lack of ressources (but maybe that's just in my organization ?).

The peace of mind I had before feel like a dream...

Have you already thought of leaving your post for a post of software engineer ? Or no way ?

https://redd.it/oo2pw6
@r_devops

Devops practices for a non-agile environment

So, I work in a legacy government industry, where the majority of our day to work is supporting vendor-supplied legacy apps in a heavily windows environment. Our internal developers are primarily web devs, with some custom node apps that are not updated frequently, if at all. A very strong setup of 'do it once and never touch again' mind set.

I've been slowly but surely moving more of our internal processes to a more devops-focused environment, codifying our infrastructure, automating deploys, building ci/cd pipelines to test the aforementioned, and basically automating myself out of a job. However, beyond 'making VM's deploy faster' and 'enforcing baseline configs and metrics', I'm struggling to find more places that I can show the benefits of Devops mindsets in an environment such as described. Would love any suggestions!

https://redd.it/oo22uw
@r_devops

Puppet's 2021 State of DevOps Report is out today

https://puppet.com/resources/report/2021-state-of-devops-report/

https://redd.it/oo5hrd
@r_devops

What is the relevance of Redhat Certifications from the perspective of DevOps field?

Redhat certfications are widely respected in traditional system admnistration and IT infrastructure field. Preparing for the RH certifications itself is definitely a great way to improve knowledge as it is hands on. How is Redhat certifications faring in the world of cloud and DevOps? The current RHCE has moved to Ansible with cloud and DevOps in focus. Does it add any value to your knowledge base. Or has it lost its relevance

https://redd.it/oo4tas
@r_devops

Vantage AWS Cost Leaderboard

Vantage just launched https://leaderboard.vantage.sh/ - a daily updating website showing the top AWS services ranked by total costs incurred by Vantage users. Pretty interesting data that I thought folks might find interesting here.

Kind of surprised that Amazon Polly is as high as it is.

https://redd.it/oo75gf
@r_devops

How do I become a carpenter

Any good suggestions ?

https://redd.it/oo944r
@r_devops

Where I can practice devops tools ?!

Is there any websites similar to katacoda where we can practice devops and learn it’s technologies ?!

https://redd.it/oo9kaz
@r_devops

Does this interview test seem like a red flag, or is it normal?

I recently received this interview test for a "Sr. DevOps Engineer" position. It seems like a lot to me, and something that seems like what you'd give for a "Fullstack Developer" position. I was asked to do the following:

1. Build a containerized web app using a popular framework
* Must have data entry
2. Build a containerized web service using a popular language
* Must have an endpoint that accepts JSON requests and logs the requests to a DB
* Must have an endpoint that take query params
* Must have an endpoint that retrieves data from a DB
3. Build a containerized SQL DB
* Must be pre-filled with data

* All code must be formatted & linted
* Must have unit tests with 80% coverage
* Everything must be containers
* All building, testing and running must be automated (make, shell, etc)
* Bonus points for
* User accounts w/ secure password storage
* Endpoint authorization with JTW
* Health endpoints
* CI/CD
* Kubernetes manifests


I'm supposed to put this all in a git repo and send it to them.

Oh, and they said don't spend more than 12 hours on it. I have 3 days to turn it back in.

---

With my day job and normal "life" stuff, I don't know when I'd have time to do half of this. I also basically have no web dev experience.

I haven't interviewed in 10 years, but this seems wild to me. Am I overreacting? Is this common?

https://redd.it/ooaeah
@r_devops

I am trying to do service discovery without k8s, does anyone have any thoughts?

This is probably the wrong place to post this (if anyone has any ideas I'm open). Starting to go mad, but I want to do something very simple, but I can't find any solution online.

I am currently using openSLP for one service to discover another service. My architecture is that I have 1 parent node and many children nodes. The children do not run the same software as the parents, but they potentially could run a shared sidecar or implement the same library. I am very experienced with docker, but k8s scare me as I mainly work in air-gapped environments, but we have a specific deployment model where our parent can be on some remote network (thus requiring use of public IPs). openSLP is usually only used in LANs, but I've made my own hacks to allow for communication to endpoints behind a public IP, but I don't necessarily agree with doing SLP over the internet.

I keep on doing searches for service discovery and every. single. time. I get things like istio, and consul that do not seem relevant for what I want to do. The children nodes never communicate with each other (actually isolation is preferred here). I don't care to have some raft-based HA nonsense (its nonsense) to share data between my nodes. I just want the parent to know about the children in a concise, simple to understand manner, and I'd preferably prefer some kind of zero config support (like I have with unicast SLP).

Does anyone have any idea what I'm talking about? Am I a madman?

https://redd.it/oo8uc3
@r_devops

Setup Azure DevOps account

https://youtu.be/gpfTYtOCcR0

https://redd.it/ooch4u
@r_devops

Should I use a self-hosted version of GitLab or setup components I require manually?



Hi I trying to work out if its worth deploying a self-hosted version of GitLab or setup indivusal comments (docker registry, git server, jenkins ci/cd pipelines etc) manually.

Without getting into too much detail I like to do a lot of hands-on learning and can’t afford a lot of OpEx costs associated with running things in the cloud and prefer to make use of equipment I have at home to run things.

For now I been using Github (free tier), however I have been eat a good chuck of the free time available running regular docker builds and other CI/Unit test pipelines. I am not overly keen on paying for the pro account. I am also aware that I can run my own runner/agent, however I not overly keen on this (for a number of security reason – my network / security background).

For now, I have decided I want to attempt to move what I can to on-premise (git server and docker registry and ci/cd pipeline solution), as I have no need for anything to be public.

One option is that my NAS can easily act as a remote Git Server and I can deploy my own docker registry and Jenkins server. This would meat most of my needs however its not a very elegant solution (and would involve a bit of setup).

The other option is should I deploy Gitlab self hosted version on my own infrastructure. The only downside is GitLab is very overboard for what I need (git repo, docker registry and Ci/CD pipeline), as I don’t need wiki’s dashboard etc, I also image there be a lot of post deployment tweaking required (ie security).

What are peoples thoughts on this and what do you currently do? Perhaps I should just bite the bullet and pay for GitHub or GitLab (however all these subscriptions start adding up)

https://redd.it/oocf8b
@r_devops

Are Kubernetes and Terraform exclusive or complementary?

Have been learning a bit about Terraform in the past 2 weeks. 0 kubernetes knowledge. Something that I'm still not sure is where kubernetes fits with Terraform.

Are they totally different tools, are they complementary or are they exclusive (you can use one without the other).

Can one also do Infrastructure Provisioning with K8s?

https://redd.it/oobd91
@r_devops

Bitbucket cloud + Jenkins integration?

I know Bitbucket server can work with Jenkins, but does anyone have experience getting Bitbucket Cloud to work with Jenkins? Thanks.

https://redd.it/ooakmy
@r_devops

A short (less than 6 mins!) introduction to Continuous Integration!

I have made a short video (less than 6 minutes long) on Continuous Integration, intended for anyone to view! Whether you're from a data, infrastructure, operations or developer background, this should give you some insight into the why, how and what of Continuous Integration.


https://cloudchris.ws/7t

https://redd.it/oo5xgp
@r_devops

Overwhelmed with information

This is geared towards senior devops and people with experience hiring devops positions. I’ve been in IT for just about three years I have a degree in cyber security, and I want to move into a devops position. Currently I am an IT coordinator for a small firm. I have my AWS solutions architect associates Certification and also learning terraform and Git.
What are some hands-on projects that would get me hired for junior level and above the devops positions?

https://redd.it/ooip4o
@r_devops

Managing multiple secret keys in CI/CD tools

Typical CI CD process involves lots of heterogeneous tools Jenkins , Git , Sonar , GCP cloud build , Docker reg etc.

In a given process all these tools should be communicating/integrating with each other.

To enable integration there are tokens, secrets to be managed across multiple tools.

As a best practice these tokens need to be managed and rotated safely. I always noticed managing these keys and rotating them is a manual process. Are there any tools that will allow to manage keys and rotate them , secure them effectively after a one time setup across every tool ?

https://redd.it/oo3s9h
@r_devops

DeFi Q&A

In one hour (6PM CEST) we will start our Q&A session on TwitterSpaces!

It's gonna be a DeFi discussion with Stani Kulechov, Joseph DeLong & Greg Vardy

Join us if you're interested!

https://redd.it/oo3z7u
@r_devops

crond isn't running unless I ssh to the container

This is my Dockerfile

​

FROM php:7.4-fpm-alpine

COPY / /var/www/

RUN apk update && apk add php libraries ..

WORKDIR /var/www

# add the crons
RUN mkdir /etc/periodic/minutely
COPY docker/crons/minutely/crons.sh /etc/periodic/minutely/crons.sh
RUN chmod -R 0755 /etc/periodic/minutely
RUN chmod +x /etc/periodic/minutely/crons.sh
RUN (crontab -l 2>/dev/null; echo "* * * * * cd /etc/periodic/minutely && sh crons.sh")| crontab -
RUN crond start

EXPOSE 9000

​

This won't start \`crond\` but if I ssh to the container after it starts running and run `crond start` again, everything works fine, why?

https://redd.it/oo3wq9
@r_devops

Set hostname in Dockerfile

There's an API we use that raises docker containers and it doesn't allow us to start container with specific hostname (-h hostname123). The only thing it accepts is a dockerfile.

Is there a way to have the Dockerfile set a specific hostname? It stops from something else to work

If you're curious why I'm asking:

> (we use SGE, and I'm building a container that would be able to submit jobs. SGE only accepts specific hostnames, and doesn't allow wildcards. It only accepts jobs that are sent only form a static list of full hostnames. For testing, I started a container with -h hostname123 and it did work)

https://redd.it/oo29fp
@r_devops

(Poll) What is DevOps?

What do you see DevOps? Is it a Role/Job title? Is it a way of working with both development and operations? Both? Something Else? Share your view in comments :)

View Poll

https://redd.it/oom4er
@r_devops