Progressively Build an Optimized Docker Image for Golang Projects
Hi, I'm working on building a series of blog posts about cloud native, containers, CI/CD, devops and microservices.
I'm starting by describing how to build images, and more specifically Golang with [this\](https://www.codingholygrail.com/build-docker-image-for-golang-projects) post.
If this is something you're interested in please let me know in comments below!
https://redd.it/ncyhe0
@r_devops
Hi, I'm working on building a series of blog posts about cloud native, containers, CI/CD, devops and microservices.
I'm starting by describing how to build images, and more specifically Golang with [this\](https://www.codingholygrail.com/build-docker-image-for-golang-projects) post.
If this is something you're interested in please let me know in comments below!
https://redd.it/ncyhe0
@r_devops
Codingholygrail
Coding Holy Grail
Coding Holy Grail | content about containers, cloud native, CI/CD, devops and microservices.
How to configure hashicorp nomad service to service network?
I want to use nomad to replace docker-compose. In docker compose you can specify the dependent containers and you will be able to reach the container with the name.
Things doesn't seem that easy with nomad somehow. I have this test job that creates mysql container and another application container.
from the application container
I am struggling with this for a day so any help would be much appreciated!
https://redd.it/ndaqfb
@r_devops
I want to use nomad to replace docker-compose. In docker compose you can specify the dependent containers and you will be able to reach the container with the name.
Things doesn't seem that easy with nomad somehow. I have this test job that creates mysql container and another application container.
job "hippo_services_db" {
datacenters = ["dc1"]
group "services" {
volume "mysql_data" {
type = "host"
read_only = false
source = "mysql_data"
}
network {
port "mysql_srv" {
static = 3306
}
port "toad_srv" {
static = 8080
}
}
task "mysql" {
driver = "docker"
volume_mount {
volume = "mysql_data"
destination = "/var/lib/mysql"
read_only = false
}
config {
image = "mysql:8.0"
ports = ["mysql_srv"]
}
env {
MYSQL_ROOT_PASSWORD = "root"
MYSQL_DATABASE = "hippo"
MYSQL_USER = "hippo"
MYSQL_PASSWORD = "m06rs011e9h9ihuboi7s"
MYSQL_ALLOW_EMPTY_PASSWORD = "no"
}
resources {
cpu = 100
memory = 900
}
}
task "toad" {
driver = "docker"
config {
image = "clivern/toad:release-0.2.4"
ports = ["toad_srv"]
command = "./toad"
args = [
"--port",
"${NOMAD_PORT_toad_srv}",
]
}
env = {
IS_STATEFUL = "false",
}
resources {
network {
mbits = 10
}
}
}
}
}
from the application container
toad i want to access the mysql container. You can install mysql client inside toad container as explained below:$ docker ps
# Get the toad app container id
$ docker exec -it $ID bash
$ apt-get update && apt-get install -y git curl libmcrypt-dev default-mysql-client
$ mysql -h $IP -P3306 -u root -proot
I am struggling with this for a day so any help would be much appreciated!
https://redd.it/ndaqfb
@r_devops
reddit
How to configure hashicorp nomad service to service network?
I want to use nomad to replace docker-compose. In docker compose you can specify the dependent containers and you will be able to reach the...
Getting started
Hey there smart people. Well I just finished college in cybersecurity and now I am enrolled in VET TEC. It's a program that the VA has added to the pathway program. Which give Vets like me the opportunity to gain a career in IT.
So I will be working on getting my security +, then CEH, and lastly Splunk certification. This will take most of the summer and well I feel like am ready. So wish me like because it's a new career path since I was a chef for 20 yrs.
https://redd.it/ndbtbu
@r_devops
Hey there smart people. Well I just finished college in cybersecurity and now I am enrolled in VET TEC. It's a program that the VA has added to the pathway program. Which give Vets like me the opportunity to gain a career in IT.
So I will be working on getting my security +, then CEH, and lastly Splunk certification. This will take most of the summer and well I feel like am ready. So wish me like because it's a new career path since I was a chef for 20 yrs.
https://redd.it/ndbtbu
@r_devops
reddit
Getting started
Hey there smart people. Well I just finished college in cybersecurity and now I am enrolled in VET TEC. It's a program that the VA has added to...
Three Monsters: The path to Self Growth
If you ever take a journey down your daily journal, you would find certain traits that set you back and harm your trajectory to success. Now, if you are busy and don’t have time to write a journal (aka no time for self-discovery) but want to discover these traits (I like to call them monsters), you
https://www.p3r.one/three-monsters-the-path-to-self-growth/
https://redd.it/ncwdul
@r_devops
If you ever take a journey down your daily journal, you would find certain traits that set you back and harm your trajectory to success. Now, if you are busy and don’t have time to write a journal (aka no time for self-discovery) but want to discover these traits (I like to call them monsters), you
https://www.p3r.one/three-monsters-the-path-to-self-growth/
https://redd.it/ncwdul
@r_devops
p3r
Three Monsters: The path to Self Growth | p3r
Growth is impossible when you have inner monsters engulfing you piece by piece every day. The strategy is to understand them and tackle them so that you're not stuck with your probelms
From a REST Api to a Time serie
Hi all,
I'm trying to find a solution that will cover this case: I have a REST api that allows me to ask for instant reading of some IoT sensors.
What I would need to do is to frequently poll this API and store such metrics in a TSDB so that I can visualize data with Grafana and such.
Do you have any suggestion?
I read something about Apache Kafka but I couldn't find any free REST connector.
Thanks a lot
https://redd.it/ndj37o
@r_devops
Hi all,
I'm trying to find a solution that will cover this case: I have a REST api that allows me to ask for instant reading of some IoT sensors.
What I would need to do is to frequently poll this API and store such metrics in a TSDB so that I can visualize data with Grafana and such.
Do you have any suggestion?
I read something about Apache Kafka but I couldn't find any free REST connector.
Thanks a lot
https://redd.it/ndj37o
@r_devops
reddit
From a REST Api to a Time serie
Hi all, I'm trying to find a solution that will cover this case: I have a REST api that allows me to ask for instant reading of some IoT...
How does a “day in a life of a DevOps engineer” looks like?
Trying to become one myself, wanted to know what is going on in your day of work?
https://redd.it/ndn7sn
@r_devops
Trying to become one myself, wanted to know what is going on in your day of work?
https://redd.it/ndn7sn
@r_devops
reddit
How does a “day in a life of a DevOps engineer” looks like?
Trying to become one myself, wanted to know what is going on in your day of work?
spotinfo - cli for exploring AWS spot instances
The spotinfo is a command-line tool you can use for exploring AWS Spot instances across multiple AWS regions.
Under the hood, the tool uses the same data feeds as AWS Spot Advisor and AWS Spot Pricing.
Compared with the AWS Spot Advisor, the
A short overview blog post is available here
https://redd.it/ndq6bg
@r_devops
The spotinfo is a command-line tool you can use for exploring AWS Spot instances across multiple AWS regions.
Under the hood, the tool uses the same data feeds as AWS Spot Advisor and AWS Spot Pricing.
Compared with the AWS Spot Advisor, the
spotinfo supports advanced filtering and sorting (also with regex), in-place spot prices, cross-region comparison, and multiple output formats (plain text, JSON, table, csv).A short overview blog post is available here
https://redd.it/ndq6bg
@r_devops
GitHub
GitHub - alexei-led/spotinfo: CLI for exploring AWS EC2 Spot inventory. Inspect AWS Spot instance types, saving, price, and interruption…
CLI for exploring AWS EC2 Spot inventory. Inspect AWS Spot instance types, saving, price, and interruption frequency. - alexei-led/spotinfo
What will be the future of DevOps?
Hello,
As things are getting automated and there are many easy to use tools for automation.
Will DevOps be merged with development?
Single guy doing Full Stack + Deployment and Maintenance?
Will DevOps Engineers who don't have knowledge of Development will lose their jobs in future?
https://redd.it/ndv7bp
@r_devops
Hello,
As things are getting automated and there are many easy to use tools for automation.
Will DevOps be merged with development?
Single guy doing Full Stack + Deployment and Maintenance?
Will DevOps Engineers who don't have knowledge of Development will lose their jobs in future?
https://redd.it/ndv7bp
@r_devops
reddit
What will be the future of DevOps?
Hello, As things are getting automated and there are many easy to use tools for automation. Will DevOps be merged with development? Single guy...
CI\CD or something else
Hello guys,
I have github repository whenever their is change or addition or commit occur on that repository, we need to clone repository to our 300 windows machine and 250 reel machine.
For now we are manually copying the files to server by ansible.
I'm thinking to automate the job and wants to learn ci\cd as well so this may be case of Jenkins?
In that case I learn Jenkins and job also get automated.
Please suggest your view that this is right and if you have any good link for learning jenkins. Because each time I tried learn, I fail as unable to correlate the example.
Thanks
https://redd.it/ndnmoe
@r_devops
Hello guys,
I have github repository whenever their is change or addition or commit occur on that repository, we need to clone repository to our 300 windows machine and 250 reel machine.
For now we are manually copying the files to server by ansible.
I'm thinking to automate the job and wants to learn ci\cd as well so this may be case of Jenkins?
In that case I learn Jenkins and job also get automated.
Please suggest your view that this is right and if you have any good link for learning jenkins. Because each time I tried learn, I fail as unable to correlate the example.
Thanks
https://redd.it/ndnmoe
@r_devops
reddit
CI\CD or something else
Hello guys, I have github repository whenever their is change or addition or commit occur on that repository, we need to clone repository to...
How to Select My Path of Work
Hi
Please I am lost now and I need help from who better than me..
I am a Newly graduated student, I graduate from Electrical Engineering College ( I was looking to study something in Networks or Cyber Security but it's not available at that time).
Now after graduation, I want to study and work in something that I like, (( Especially in DevOps or Cyber Security ))
So, please what can I do now? from where can I start?
Study MSc in Cyber Security or Network Engineering ?? can you nominate a Good Online University?
or is there some Certificates and Courses online it can help me to work in this field?
​
Thank You
https://redd.it/ndm9qz
@r_devops
Hi
Please I am lost now and I need help from who better than me..
I am a Newly graduated student, I graduate from Electrical Engineering College ( I was looking to study something in Networks or Cyber Security but it's not available at that time).
Now after graduation, I want to study and work in something that I like, (( Especially in DevOps or Cyber Security ))
So, please what can I do now? from where can I start?
Study MSc in Cyber Security or Network Engineering ?? can you nominate a Good Online University?
or is there some Certificates and Courses online it can help me to work in this field?
​
Thank You
https://redd.it/ndm9qz
@r_devops
reddit
How to Select My Path of Work
Hi Please I am lost now and I need help from who better than me.. I am a Newly graduated student, I graduate from Electrical Engineering College...
How to write docker-compose file for vue js and setup environment variable
I want to create a Docker-Compose file in which Vue-js app and Postgres sql must be gross and also add environment variable.
https://redd.it/ndlz12
@r_devops
I want to create a Docker-Compose file in which Vue-js app and Postgres sql must be gross and also add environment variable.
https://redd.it/ndlz12
@r_devops
reddit
How to write docker-compose file for vue js and setup environment...
I want to create a Docker-Compose file in which Vue-js app and Postgres sql must be gross and also add environment variable.
Next step for DevOps
Hey everyone,
I was given the wonderful opportunity to work as a Jr. Devops for some time but unfortunately due to the financial circumstances of the company, I was laid off a few days ago. I'm currently on the lookout for my next gig and in the middle of self study and job searching. I want to bolster and add to my skill set and was wondering what type of tech stacks are being utilized nowadays. For context, here are the tech stacks that I've used to date (I won't go into depth on what I've done but this should be enough for some context)
OS: RHEL 7/8
Languages: Perl, Bash, Python
Containers: Docker, Docker Swarm
Logs and alerting: NagiOS (I know...), Zabbix, ELK
Networks: LAG/LACP, BGP
Infra-as-code: Terraform, Ansible
CI/CD: Jenkins, Gitlab
Virtualization: QEMU
From projects/past experience:
K8's
Setting up Kubeflow
Happy to answer any questions that anyone might have. Thanks!
https://redd.it/ne0kqk
@r_devops
Hey everyone,
I was given the wonderful opportunity to work as a Jr. Devops for some time but unfortunately due to the financial circumstances of the company, I was laid off a few days ago. I'm currently on the lookout for my next gig and in the middle of self study and job searching. I want to bolster and add to my skill set and was wondering what type of tech stacks are being utilized nowadays. For context, here are the tech stacks that I've used to date (I won't go into depth on what I've done but this should be enough for some context)
OS: RHEL 7/8
Languages: Perl, Bash, Python
Containers: Docker, Docker Swarm
Logs and alerting: NagiOS (I know...), Zabbix, ELK
Networks: LAG/LACP, BGP
Infra-as-code: Terraform, Ansible
CI/CD: Jenkins, Gitlab
Virtualization: QEMU
From projects/past experience:
K8's
Setting up Kubeflow
Happy to answer any questions that anyone might have. Thanks!
https://redd.it/ne0kqk
@r_devops
reddit
Next step for DevOps
Hey everyone, I was given the wonderful opportunity to work as a Jr. Devops for some time but unfortunately due to the financial circumstances of...
Help setting up teleport
Hi,
I am trying to setup teleport in my environment. I have a few questions :
1. Is there any way teleport gives user access to a specific server rather than all the servers at one's. Suppose a user has access to two servers in a cluster, can teleport only give access to one server at a time.
2. Should I use nginx to redirect requests coming into 443 for the proxy server to port 3080.
3. In their youtube page, they are configuring using Let's Encrypt. I have certbot installed in my machine. Should I just pass the acme url and it will automatically fetch from let's encrypt.
4. Is there any detailed guide as to how to setup teleport for production use. Their website is not upto the mark for me, like they don't specify how the authentication pin is set.
I am fed up with this product and trying to set this up because I don't have the necessary experience regarding this.
A sidenote, can someone please point out a video series where https, how certificates and CA, CA chain works. I really would like to improve my knowledge regarding this.
Any help will be appreciated.
https://redd.it/ndixko
@r_devops
Hi,
I am trying to setup teleport in my environment. I have a few questions :
1. Is there any way teleport gives user access to a specific server rather than all the servers at one's. Suppose a user has access to two servers in a cluster, can teleport only give access to one server at a time.
2. Should I use nginx to redirect requests coming into 443 for the proxy server to port 3080.
3. In their youtube page, they are configuring using Let's Encrypt. I have certbot installed in my machine. Should I just pass the acme url and it will automatically fetch from let's encrypt.
4. Is there any detailed guide as to how to setup teleport for production use. Their website is not upto the mark for me, like they don't specify how the authentication pin is set.
I am fed up with this product and trying to set this up because I don't have the necessary experience regarding this.
A sidenote, can someone please point out a video series where https, how certificates and CA, CA chain works. I really would like to improve my knowledge regarding this.
Any help will be appreciated.
https://redd.it/ndixko
@r_devops
reddit
Help setting up teleport
Hi, I am trying to setup teleport in my environment. I have a few questions : 1. Is there any way teleport gives user access to a...
How to get started with DevOps?
I'll be graduating in the month of June with a Bachelor's in Computer application. I heard about DevOps and it has started to interest me a lot. So I'm thinking of getting started with it. But I don't know from where should I start. I also want to know how much preparation time I need to put in so that I could get a job. Thank you in advance.
https://redd.it/ndwrf0
@r_devops
I'll be graduating in the month of June with a Bachelor's in Computer application. I heard about DevOps and it has started to interest me a lot. So I'm thinking of getting started with it. But I don't know from where should I start. I also want to know how much preparation time I need to put in so that I could get a job. Thank you in advance.
https://redd.it/ndwrf0
@r_devops
reddit
How to get started with DevOps?
I'll be graduating in the month of June with a Bachelor's in Computer application. I heard about DevOps and it has started to interest me a lot....
Who knows DevOps?
Howdy DevOps Community.
This is my first time posting here.
Ive been so interested in getting myself qualified to be called a devops engineer. I currently mess around with gitlab's CI/CD platform but their cert is waay expensive. Does anyone know of any other certifications or course that a beginner on the devops journey could look into, possibly free or at least not $600+
https://redd.it/ndfz0l
@r_devops
Howdy DevOps Community.
This is my first time posting here.
Ive been so interested in getting myself qualified to be called a devops engineer. I currently mess around with gitlab's CI/CD platform but their cert is waay expensive. Does anyone know of any other certifications or course that a beginner on the devops journey could look into, possibly free or at least not $600+
https://redd.it/ndfz0l
@r_devops
reddit
Who knows DevOps?
Howdy DevOps Community. This is my first time posting here. Ive been so interested in getting myself qualified to be called a devops engineer. I...
Cloud provider for medical device produced data in Europe.
Hi all.
We started a startup that manufactures a small diagnostic device that is operated through an application. All the data produced from the device are then stored on a cloud infrastructure (API + DB).
So far it is under testing environment and thus no problem. But If the time comes to get out in the market I'm wondering which European cloud provider to choose.
I read that AWS and US-based companies, in general, are better to be avoided due to data exposure to third countries.
Does anyone here have a similar experience? Which is the way to go?
Any suggestions are very welcome.
https://redd.it/nect0f
@r_devops
Hi all.
We started a startup that manufactures a small diagnostic device that is operated through an application. All the data produced from the device are then stored on a cloud infrastructure (API + DB).
So far it is under testing environment and thus no problem. But If the time comes to get out in the market I'm wondering which European cloud provider to choose.
I read that AWS and US-based companies, in general, are better to be avoided due to data exposure to third countries.
Does anyone here have a similar experience? Which is the way to go?
Any suggestions are very welcome.
https://redd.it/nect0f
@r_devops
MobiHealthNews
Germany’s DiGA - Secure data in the cloud?
As of last July, developers of digital health apps (DiGA) in Germany could no longer host sensitive personal data on American cloud servers. Dr Philipp Kircher from the Health Innovation Hub reveals
Is there a module cache for Terraform?
Terraform has the
Do you know how to achieve that modules are stored somewhere central instead inside each module directory (
https://redd.it/nefd1t
@r_devops
Terraform has the
plugin_cache_dir to enable plugin cache but I have not found a way to set a directory for module caching. Do you know how to achieve that modules are stored somewhere central instead inside each module directory (
.terraform/modules)?https://redd.it/nefd1t
@r_devops
reddit
Is there a module cache for Terraform?
Terraform has the `plugin_cache_dir` to enable plugin cache but I have not found a way to set a directory for module caching. Do you know how...
WEBINAR AI(work)Ops: A Research View of AIOps Implementations
Register now for an insightful webinar by Valerie O’Connell, Enterprise Management Associates (EMA), Research Director of Digital Service Execution, on May 18 as she discusses her recent field research about AIOps, its key capabilities, challenges, and demonstrated benefits.
https://info.enterprisemanagement.com/a-research-view-of-aiops-implementations-ws
https://redd.it/nehdm1
@r_devops
Register now for an insightful webinar by Valerie O’Connell, Enterprise Management Associates (EMA), Research Director of Digital Service Execution, on May 18 as she discusses her recent field research about AIOps, its key capabilities, challenges, and demonstrated benefits.
https://info.enterprisemanagement.com/a-research-view-of-aiops-implementations-ws
https://redd.it/nehdm1
@r_devops
Enterprisemanagement
[WEBINAR] AI(work)Ops: A Research View of AIOps Implementations
New research from EMA examines the characteristics that are common to the 21% who rate the impact of AIOps on the IT/business relationship as “transformational.”
The Easiest Way to Debug Kubernetes Workloads
Hi /r/DevOps,
Today I published an article about troubleshooting Kubernetes workloads using
Here's link to the article: https://towardsdatascience.com/the-easiest-way-to-debug-kubernetes-workloads-ff2ff5e3cc75
Feedback is very much appreciated!
https://redd.it/negrgd
@r_devops
Hi /r/DevOps,
Today I published an article about troubleshooting Kubernetes workloads using
kubectl debug - a beta feature of Kubernetes. In the article I explain how to make it available in your cluster, how it works, as well as some use cases for it for debugging both pods and cluster nodes.Here's link to the article: https://towardsdatascience.com/the-easiest-way-to-debug-kubernetes-workloads-ff2ff5e3cc75
Feedback is very much appreciated!
https://redd.it/negrgd
@r_devops
Medium
The Easiest Way to Debug Kubernetes Workloads
The fastest and easiest way to debug and troubleshoot any application running on Kubernetes…
How does your team track work / measure impact?
Hey Folks!
We're playing around with different approaches to tracking work / measuring impact. One direction we're leading in is OKR, and Jira boards.
We're mostly an infrastructure support team. Based on the OKR model we're adopting, it requires us to create epics and plan work months in advance. OKRs will be created quarterly and be linked to a new Epic. As an infrastructure team, it seems counter productive to create new Epics each quarter as our work always exists in the same spaces and we don't exactly develop new features, our features are security patching and system availability improvements and live inside an Epic such as System Health.
In my opinion, our epics should live around service support models such as System Health, Infra work, etc and exist nearly indefinitely. Creating a new epic each quarter means we lose some easy reporting and visibility into work history in critical spaces and seems to create confusion and complexity when using the tools to collaborate within the team (i.e. no one understands where work items should go).
What is your experience in tracking work, what is the ideal way you'd setup a Jira board for effective tracking and collaboration in these tools?
https://redd.it/nei70k
@r_devops
Hey Folks!
We're playing around with different approaches to tracking work / measuring impact. One direction we're leading in is OKR, and Jira boards.
We're mostly an infrastructure support team. Based on the OKR model we're adopting, it requires us to create epics and plan work months in advance. OKRs will be created quarterly and be linked to a new Epic. As an infrastructure team, it seems counter productive to create new Epics each quarter as our work always exists in the same spaces and we don't exactly develop new features, our features are security patching and system availability improvements and live inside an Epic such as System Health.
In my opinion, our epics should live around service support models such as System Health, Infra work, etc and exist nearly indefinitely. Creating a new epic each quarter means we lose some easy reporting and visibility into work history in critical spaces and seems to create confusion and complexity when using the tools to collaborate within the team (i.e. no one understands where work items should go).
What is your experience in tracking work, what is the ideal way you'd setup a Jira board for effective tracking and collaboration in these tools?
https://redd.it/nei70k
@r_devops
reddit
How does your team track work / measure impact?
Hey Folks! We're playing around with different approaches to tracking work / measuring impact. One direction we're leading in is OKR, and Jira...
User can't access EKS cluster after creation from Terraform module.
Background: I've got a kubernetes module that looks like [this](https://gist.github.com/IndieDiscovery/c97091ef6522bb7103f1d7244e121994) based off of "terraform-aws-modules/eks/aws." I try to run the following command after creation:
aws eks --region us-east-1 update-kubeconfig --name foo-prod --role-arn arn:aws:iam::12345678910:role/eks
But I still get the following error when doing a kubectl get po command:
An error occurred (AccessDenied) when calling the AssumeRole operation: User: arn:aws:iam::12345678910:user/indie is not authorized to perform: sts:AssumeRole on resource: arn:aws:iam::12345678910:role/eks
Any ideas? I even tried adding an assumeRole policy inline as follows:
{
"Version": "2012-10-17",
"Statement": {
"Effect": "Allow",
"Action": "sts:AssumeRole",
"Resource": "*"
}
}
However it doesn't seem to be working...
https://redd.it/nef3sq
@r_devops
Background: I've got a kubernetes module that looks like [this](https://gist.github.com/IndieDiscovery/c97091ef6522bb7103f1d7244e121994) based off of "terraform-aws-modules/eks/aws." I try to run the following command after creation:
aws eks --region us-east-1 update-kubeconfig --name foo-prod --role-arn arn:aws:iam::12345678910:role/eks
But I still get the following error when doing a kubectl get po command:
An error occurred (AccessDenied) when calling the AssumeRole operation: User: arn:aws:iam::12345678910:user/indie is not authorized to perform: sts:AssumeRole on resource: arn:aws:iam::12345678910:role/eks
Any ideas? I even tried adding an assumeRole policy inline as follows:
{
"Version": "2012-10-17",
"Statement": {
"Effect": "Allow",
"Action": "sts:AssumeRole",
"Resource": "*"
}
}
However it doesn't seem to be working...
https://redd.it/nef3sq
@r_devops
Gist
k8s
GitHub Gist: instantly share code, notes, and snippets.