Why GitLab pipeline stays in "Checking pipeline status"?
Hi Folks! I create a GitLab Pipeline in order to check the **Lighthouse** between two branches.
*This should be the rules:*
* *Doesn't run if you push something into* ***main*** *branch*
* ***Only works*** *when you perform a* ***merge request***
* ***Only should work IF*** *you are doing a* ***merge request to main branch,*** so, *it should't work if you try to merge dev-2 into dev*
**The problems happends when** i try to do a merge request from *dev-2 into dev...*
If you go to this merge request: [https://gitlab.com/RicardoRien/lighthouse\_pipeline/-/merge\_requests/9](https://gitlab.com/RicardoRien/lighthouse_pipeline/-/merge_requests/9)
you can see, that **stays in a infinite load spinner with this message "Checking pipeline status."**
Do you know why? Thanks in advance!
**.gitlab-ci.yml**:
image: cypress/browsers:node14.15.0-chrome86-ff82
stages:
- compare
compare:
stage: compare
script:
- |
# install required dependencies
npm install -g http-server puppeteer [email protected]
# check the current branch scores
http-server . &
sleep 5
lighthouse https://localhost:8080 --output=json --output-path=./current-branch-mobile-score.json --chrome-flags="--headless --no-sandbox" || exit 1
lighthouse https://localhost:8080 --output=json --output-path=./current-branch-desktop-score.json --emulated-form-factor=desktop --throttling-method=provided --chrome-flags="--headless --no-sandbox" || exit 1
CURRENT_BRANCH_MOBILE_ACCESSIBILITY_SCORE=$(node -e "const data = require('./current-branch-mobile-score.json'); console.log(Math.round(data.categories.accessibility.score * 100));") || exit 1
CURRENT_BRANCH_DESKTOP_ACCESSIBILITY_SCORE=$(node -e "const data = require('./current-branch-desktop-score.json'); console.log(Math.round(data.categories.accessibility.score * 100));") || exit 1
# Check the main branch scores
# Be aware it's pointing to "main"
git remote set-branches --add origin main
git fetch
git checkout main
http-server . &
sleep 5
lighthouse https://localhost:8080 --output=json --output-path=./main-branch-mobile-score.json --chrome-flags="--headless --no-sandbox" || exit 1
lighthouse https://localhost:8080 --output=json --output-path=./main-branch-desktop-score.json --emulated-form-factor=desktop --throttling-method=provided --chrome-flags="--headless --no-sandbox" || exit 1
MAIN_BRANCH_MOBILE_ACCESSIBILITY_SCORE=$(node -e "const data = require('./main-branch-mobile-score.json'); console.log(Math.round(data.categories.accessibility.score * 100));") || exit 1
MAIN_BRANCH_DESKTOP_ACCESSIBILITY_SCORE=$(node -e "const data = require('./main-branch-desktop-score.json'); console.log(Math.round(data.categories.accessibility.score * 100));") || exit 1
# logging out the scores and compare them
# exit 1 Pipeline fails
echo "Main branch mobile accessibility score: $MAIN_BRANCH_MOBILE_ACCESSIBILITY_SCORE"
echo "Current branch mobile accessibility score: $CURRENT_BRANCH_MOBILE_ACCESSIBILITY_SCORE"
echo "Main branch desktop accessibility score: $MAIN_BRANCH_DESKTOP_ACCESSIBILITY_SCORE"
echo "Current branch desktop accessibility score: $CURRENT_BRANCH_DESKTOP_ACCESSIBILITY_SCORE"
if [ "$CURRENT_BRANCH_MOBILE_ACCESSIBILITY_SCORE" -lt "$MAIN_BRANCH_MOBILE_ACCESSIBILITY_SCORE" ] || [ "$CURRENT_BRANCH_DESKTOP_ACCESSIBILITY_SCORE" -lt "$MAIN_BRANCH_DESKTOP_ACCESSIBILITY_SCORE" ]; then
echo "Current branch scores (mobile accessibility: $CURRENT_BRANCH_MOBILE_ACCESSIBILITY_SCORE, desktop accessibility: $CURRENT_BRANCH_DESKTOP_ACCESSIBILITY_SCORE) are lower than main branch scores (mobile accessibility: $MAIN_BRANCH_MOBILE_ACCESSIBILITY_SCORE, desktop accessibility:
Hi Folks! I create a GitLab Pipeline in order to check the **Lighthouse** between two branches.
*This should be the rules:*
* *Doesn't run if you push something into* ***main*** *branch*
* ***Only works*** *when you perform a* ***merge request***
* ***Only should work IF*** *you are doing a* ***merge request to main branch,*** so, *it should't work if you try to merge dev-2 into dev*
**The problems happends when** i try to do a merge request from *dev-2 into dev...*
If you go to this merge request: [https://gitlab.com/RicardoRien/lighthouse\_pipeline/-/merge\_requests/9](https://gitlab.com/RicardoRien/lighthouse_pipeline/-/merge_requests/9)
you can see, that **stays in a infinite load spinner with this message "Checking pipeline status."**
Do you know why? Thanks in advance!
**.gitlab-ci.yml**:
image: cypress/browsers:node14.15.0-chrome86-ff82
stages:
- compare
compare:
stage: compare
script:
- |
# install required dependencies
npm install -g http-server puppeteer [email protected]
# check the current branch scores
http-server . &
sleep 5
lighthouse https://localhost:8080 --output=json --output-path=./current-branch-mobile-score.json --chrome-flags="--headless --no-sandbox" || exit 1
lighthouse https://localhost:8080 --output=json --output-path=./current-branch-desktop-score.json --emulated-form-factor=desktop --throttling-method=provided --chrome-flags="--headless --no-sandbox" || exit 1
CURRENT_BRANCH_MOBILE_ACCESSIBILITY_SCORE=$(node -e "const data = require('./current-branch-mobile-score.json'); console.log(Math.round(data.categories.accessibility.score * 100));") || exit 1
CURRENT_BRANCH_DESKTOP_ACCESSIBILITY_SCORE=$(node -e "const data = require('./current-branch-desktop-score.json'); console.log(Math.round(data.categories.accessibility.score * 100));") || exit 1
# Check the main branch scores
# Be aware it's pointing to "main"
git remote set-branches --add origin main
git fetch
git checkout main
http-server . &
sleep 5
lighthouse https://localhost:8080 --output=json --output-path=./main-branch-mobile-score.json --chrome-flags="--headless --no-sandbox" || exit 1
lighthouse https://localhost:8080 --output=json --output-path=./main-branch-desktop-score.json --emulated-form-factor=desktop --throttling-method=provided --chrome-flags="--headless --no-sandbox" || exit 1
MAIN_BRANCH_MOBILE_ACCESSIBILITY_SCORE=$(node -e "const data = require('./main-branch-mobile-score.json'); console.log(Math.round(data.categories.accessibility.score * 100));") || exit 1
MAIN_BRANCH_DESKTOP_ACCESSIBILITY_SCORE=$(node -e "const data = require('./main-branch-desktop-score.json'); console.log(Math.round(data.categories.accessibility.score * 100));") || exit 1
# logging out the scores and compare them
# exit 1 Pipeline fails
echo "Main branch mobile accessibility score: $MAIN_BRANCH_MOBILE_ACCESSIBILITY_SCORE"
echo "Current branch mobile accessibility score: $CURRENT_BRANCH_MOBILE_ACCESSIBILITY_SCORE"
echo "Main branch desktop accessibility score: $MAIN_BRANCH_DESKTOP_ACCESSIBILITY_SCORE"
echo "Current branch desktop accessibility score: $CURRENT_BRANCH_DESKTOP_ACCESSIBILITY_SCORE"
if [ "$CURRENT_BRANCH_MOBILE_ACCESSIBILITY_SCORE" -lt "$MAIN_BRANCH_MOBILE_ACCESSIBILITY_SCORE" ] || [ "$CURRENT_BRANCH_DESKTOP_ACCESSIBILITY_SCORE" -lt "$MAIN_BRANCH_DESKTOP_ACCESSIBILITY_SCORE" ]; then
echo "Current branch scores (mobile accessibility: $CURRENT_BRANCH_MOBILE_ACCESSIBILITY_SCORE, desktop accessibility: $CURRENT_BRANCH_DESKTOP_ACCESSIBILITY_SCORE) are lower than main branch scores (mobile accessibility: $MAIN_BRANCH_MOBILE_ACCESSIBILITY_SCORE, desktop accessibility:
$MAIN_BRANCH_DESKTOP_ACCESSIBILITY_SCORE)"
exit 1
else
echo "Current branch scores (mobile accessibility: $CURRENT_BRANCH_MOBILE_ACCESSIBILITY_SCORE, desktop accessibility: $CURRENT_BRANCH_DESKTOP_ACCESSIBILITY_SCORE) are higher than or equal to main branch scores (mobile accessibility: $MAIN_BRANCH_MOBILE_ACCESSIBILITY_SCORE, desktop accessibility: $MAIN_BRANCH_DESKTOP_ACCESSIBILITY_SCORE)"
fi
# Add a comment to the merge request
curl --location --request POST "https://gitlab.com/api/v4/projects/$CI_PROJECT_ID/merge_requests/$CI_MERGE_REQUEST_IID/notes" --header "PRIVATE-TOKEN: $PAT" --header "Content-Type: application/json" --data-raw "{ \"body\": \"🎉Lighthouse scores comparison:\n\nMain branch mobile accessibility score: ${MAIN_BRANCH_MOBILE_ACCESSIBILITY_SCORE}\nCurrent branch mobile accessibility score: ${CURRENT_BRANCH_MOBILE_ACCESSIBILITY_SCORE}\n\nMain branch desktop accessibility score: ${MAIN_BRANCH_DESKTOP_ACCESSIBILITY_SCORE}\nCurrent branch desktop accessibility score: ${CURRENT_BRANCH_DESKTOP_ACCESSIBILITY_SCORE}\" }"
only:
refs:
- merge_requests
variables:
- $CI_MERGE_REQUEST_TARGET_BRANCH_NAME == "main"
except:
- main
https://redd.it/1cch4fd
@r_devops
exit 1
else
echo "Current branch scores (mobile accessibility: $CURRENT_BRANCH_MOBILE_ACCESSIBILITY_SCORE, desktop accessibility: $CURRENT_BRANCH_DESKTOP_ACCESSIBILITY_SCORE) are higher than or equal to main branch scores (mobile accessibility: $MAIN_BRANCH_MOBILE_ACCESSIBILITY_SCORE, desktop accessibility: $MAIN_BRANCH_DESKTOP_ACCESSIBILITY_SCORE)"
fi
# Add a comment to the merge request
curl --location --request POST "https://gitlab.com/api/v4/projects/$CI_PROJECT_ID/merge_requests/$CI_MERGE_REQUEST_IID/notes" --header "PRIVATE-TOKEN: $PAT" --header "Content-Type: application/json" --data-raw "{ \"body\": \"🎉Lighthouse scores comparison:\n\nMain branch mobile accessibility score: ${MAIN_BRANCH_MOBILE_ACCESSIBILITY_SCORE}\nCurrent branch mobile accessibility score: ${CURRENT_BRANCH_MOBILE_ACCESSIBILITY_SCORE}\n\nMain branch desktop accessibility score: ${MAIN_BRANCH_DESKTOP_ACCESSIBILITY_SCORE}\nCurrent branch desktop accessibility score: ${CURRENT_BRANCH_DESKTOP_ACCESSIBILITY_SCORE}\" }"
only:
refs:
- merge_requests
variables:
- $CI_MERGE_REQUEST_TARGET_BRANCH_NAME == "main"
except:
- main
https://redd.it/1cch4fd
@r_devops
Using the open-source version of Prometheus to monitor a service on Google Cloud Run?
Hello, I'm wanting to learn how to use monitoring tools. Prometheus sounds like a good OSS to use for monitoring my cloud environment. However, I can't seem to find anything regarding monitoring a Cloud Run service.
I looked through the docs and only found a configuration for Compute Engine?
https://prometheus.io/docs/prometheus/latest/configuration/configuration/#gce\_sd\_config
I've also seen that there is a managed service for Prometheus offered by Google Cloud, but I'd rather use a local version on my computer than use a managed service for this. Is this possible?
Also, is Prometheus mainly meant for virtual machines? That seems to be the case in that configuration doc from Prometheus.
I'd appreciate any help.
https://redd.it/1cc98pj
@r_devops
Hello, I'm wanting to learn how to use monitoring tools. Prometheus sounds like a good OSS to use for monitoring my cloud environment. However, I can't seem to find anything regarding monitoring a Cloud Run service.
I looked through the docs and only found a configuration for Compute Engine?
https://prometheus.io/docs/prometheus/latest/configuration/configuration/#gce\_sd\_config
I've also seen that there is a managed service for Prometheus offered by Google Cloud, but I'd rather use a local version on my computer than use a managed service for this. Is this possible?
Also, is Prometheus mainly meant for virtual machines? That seems to be the case in that configuration doc from Prometheus.
I'd appreciate any help.
https://redd.it/1cc98pj
@r_devops
prometheus.io
Configuration | Prometheus
Prometheus project documentation for Configuration
Any platforms using AI for Hiring?
In today's digital landscape, innovation and efficiency are the order of the day, with many companies looking for ways to streamline important necessities like hiring. With the global talent pool and the barriers that come with using traditional hiring methods, companies are unable to tap into the pool of talent and identify the right talents amidst a sea of applicants. Although some companies have built models to help improve hiring practices and identify special talents, I can't help but think that the infusion of AI in hiring practices can help revolutionize the recruitment process.
The use of AI can help companies cut across a vast number of applicants across a promising and talent-filled global pool, especially in tech hiring such as front-end, back-end, and full-stack, to mention a few. Infusing AI with machine learning can refine algorithms that help analyze this vast application process of sifting through resumes and candidate profiles, which will in turn help shortlist the most suitable matches for the required position.
Unlike the traditional hiring process plagued with human bias, nepotism, and favouritism, AI plays an advantage in curbing such vices during hiring. The use of AI can help eliminate conscious and unconscious human biases from hiring processes. This ensures that shortlisted candidates are evaluated based on their qualifications and how they fit the hiring needs, thus improving diversity and inclusivity, one important direction that companies across the world have recently embraced.
In recent times, with the rise of so many startups and businesses needing tech hiring on short notice, the use of AI in hiring processes can help expedite such needs. Infusing AI would help fast-track the screening and shortlisting processes, thus saving time and resources for businesses that need urgent hiring. As mentioned above, AI can help cut through a vast number of applications and select only the top candidates, ultimately speeding up the hiring process.
On a personal note and from personal experience, I would like to believe that the use of AI in hiring processes can aid individuals with non-tech skills in hiring developers. Having suffered from hiring wrongly due to my inability to test the skills of applicants vying for a developer role, I believe infusing AI in hiring processes can solve this problem by offering advanced assessment tools to test a candidate's skill sets, which could help people like me make informed decisions, and in general reduce the risk of mismatch and poor hiring, all of which would harm a business.
https://redd.it/1ccnjqv
@r_devops
In today's digital landscape, innovation and efficiency are the order of the day, with many companies looking for ways to streamline important necessities like hiring. With the global talent pool and the barriers that come with using traditional hiring methods, companies are unable to tap into the pool of talent and identify the right talents amidst a sea of applicants. Although some companies have built models to help improve hiring practices and identify special talents, I can't help but think that the infusion of AI in hiring practices can help revolutionize the recruitment process.
The use of AI can help companies cut across a vast number of applicants across a promising and talent-filled global pool, especially in tech hiring such as front-end, back-end, and full-stack, to mention a few. Infusing AI with machine learning can refine algorithms that help analyze this vast application process of sifting through resumes and candidate profiles, which will in turn help shortlist the most suitable matches for the required position.
Unlike the traditional hiring process plagued with human bias, nepotism, and favouritism, AI plays an advantage in curbing such vices during hiring. The use of AI can help eliminate conscious and unconscious human biases from hiring processes. This ensures that shortlisted candidates are evaluated based on their qualifications and how they fit the hiring needs, thus improving diversity and inclusivity, one important direction that companies across the world have recently embraced.
In recent times, with the rise of so many startups and businesses needing tech hiring on short notice, the use of AI in hiring processes can help expedite such needs. Infusing AI would help fast-track the screening and shortlisting processes, thus saving time and resources for businesses that need urgent hiring. As mentioned above, AI can help cut through a vast number of applications and select only the top candidates, ultimately speeding up the hiring process.
On a personal note and from personal experience, I would like to believe that the use of AI in hiring processes can aid individuals with non-tech skills in hiring developers. Having suffered from hiring wrongly due to my inability to test the skills of applicants vying for a developer role, I believe infusing AI in hiring processes can solve this problem by offering advanced assessment tools to test a candidate's skill sets, which could help people like me make informed decisions, and in general reduce the risk of mismatch and poor hiring, all of which would harm a business.
https://redd.it/1ccnjqv
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Wordpress 0 downtime deployment from Dev to Prod
I have a dev environment for Wordpress (a landing page for a company) running on 2 docker containers (apache2 and mysql). The apache2 sits behind a reverse proxy (currently using NPM). On production environment I only run the apache2 container that connects to the DB which runs as a separate cloud service. When the developer makes all the changes on the dev environment asks me to deploy it to production environment. I have some scripts running to dump the DB, push it and the wp-data file to git repo. On production I pull the repo, parse the sql db file to rename the domain name. Then I create the db with the naming containing the commit ID from git. I bring up the new container and make test curl request to make sure the container can access the db. The final step is to change the upstream name in NPM pointing it to the new container.
This way I achieve deployment with 0 downtime.
This is not ideal but I feel like there are more things to improve. I need some side advices about this.☺️
https://redd.it/1ccny46
@r_devops
I have a dev environment for Wordpress (a landing page for a company) running on 2 docker containers (apache2 and mysql). The apache2 sits behind a reverse proxy (currently using NPM). On production environment I only run the apache2 container that connects to the DB which runs as a separate cloud service. When the developer makes all the changes on the dev environment asks me to deploy it to production environment. I have some scripts running to dump the DB, push it and the wp-data file to git repo. On production I pull the repo, parse the sql db file to rename the domain name. Then I create the db with the naming containing the commit ID from git. I bring up the new container and make test curl request to make sure the container can access the db. The final step is to change the upstream name in NPM pointing it to the new container.
This way I achieve deployment with 0 downtime.
This is not ideal but I feel like there are more things to improve. I need some side advices about this.☺️
https://redd.it/1ccny46
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Harbor registry upgrade 2.4 to 2.8
TL;DR: migrating images of proxy-cache project in harbor without re-pulling them all due to low bandwidth
I've helm-deployed harbor registry with a proxy-cache project which includes hundreds of images on my k8s cluster. At harbor upgrade docs note of step 6: "The schema upgrade and data migration of the database is performed by core when Harbor starts", so I tried little k8s magic to use the same 2.4.0 pv's for the 2.8.0 pods to use and everything worked as expected, I could pull already-pulled images in the proxy cache project, without running any migration script or something. Worth to note that at "Upgrading Harbor Deployed with Helm" they basically only do a simple helm-upgrade, but I'm not sure it keeps the data from the previous version.
At the core pod of new-harbor I saw that an automatic migrate.go code ran and upgraded the schemas! Which is nice 🙂
That sounds wrong and not best-practice, but at the end of the day - it worked. Plus, it was not a major upgrade. What do you think? Do you have other ideas to do it? Are there any immediate/long-term issues I should take into consideration?
Which PV's should I migrate - only registry or database and redis too? because at their logs I didn't see any automatic migration script.
THANKS A LOT IN ADVANCE!
https://redd.it/1ccpiru
@r_devops
TL;DR: migrating images of proxy-cache project in harbor without re-pulling them all due to low bandwidth
I've helm-deployed harbor registry with a proxy-cache project which includes hundreds of images on my k8s cluster. At harbor upgrade docs note of step 6: "The schema upgrade and data migration of the database is performed by core when Harbor starts", so I tried little k8s magic to use the same 2.4.0 pv's for the 2.8.0 pods to use and everything worked as expected, I could pull already-pulled images in the proxy cache project, without running any migration script or something. Worth to note that at "Upgrading Harbor Deployed with Helm" they basically only do a simple helm-upgrade, but I'm not sure it keeps the data from the previous version.
At the core pod of new-harbor I saw that an automatic migrate.go code ran and upgraded the schemas! Which is nice 🙂
That sounds wrong and not best-practice, but at the end of the day - it worked. Plus, it was not a major upgrade. What do you think? Do you have other ideas to do it? Are there any immediate/long-term issues I should take into consideration?
Which PV's should I migrate - only registry or database and redis too? because at their logs I didn't see any automatic migration script.
THANKS A LOT IN ADVANCE!
https://redd.it/1ccpiru
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Join us for a FREE course on Automation with Ansible & AWX by TechLatest! Discover the power of Ansible AWX, the upstream project behind Red Hat Ansible Tower, in our new course.
Join us for a FREE course on Automation with Ansible & AWX by TechLatest! Discover the power of Ansible AWX, the upstream project behind Red Hat Ansible Tower, in our new course.
Plus, get access to our Ansible Tower VM for a seamless web-based CI/CD experience. Centralize IT deployment & configuration, manage inventory, schedule jobs, and more—all with a user-friendly graphical dashboard.
Features of our Ansible Tower VM:
🔧 Web-based Ansible Tower environment
🎛️ Role-based access control
📅 Job scheduling
📩 Integrated notifications
🖥️ Remote GUI Desktop
🐟 Fish Shell for enhanced command-line experience
Don't miss out on this opportunity to level up your automation skills! Enroll now and take control of your IT infrastructure with Ansible AWX.
For more information and enrollment, visit https://www.udemy.com/course/automation-with-ansible-awx-free-course-by-techlatest/.
VM Page Link:https://azuremarketplace.microsoft.com/en-us/marketplace/apps/techlatest.blackarch-linux?utm_campaign=blackarch-linux&utm_source=techlatest-website&utm_medium=support-page
https://redd.it/1ccrx2c
@r_devops
Join us for a FREE course on Automation with Ansible & AWX by TechLatest! Discover the power of Ansible AWX, the upstream project behind Red Hat Ansible Tower, in our new course.
Plus, get access to our Ansible Tower VM for a seamless web-based CI/CD experience. Centralize IT deployment & configuration, manage inventory, schedule jobs, and more—all with a user-friendly graphical dashboard.
Features of our Ansible Tower VM:
🔧 Web-based Ansible Tower environment
🎛️ Role-based access control
📅 Job scheduling
📩 Integrated notifications
🖥️ Remote GUI Desktop
🐟 Fish Shell for enhanced command-line experience
Don't miss out on this opportunity to level up your automation skills! Enroll now and take control of your IT infrastructure with Ansible AWX.
For more information and enrollment, visit https://www.udemy.com/course/automation-with-ansible-awx-free-course-by-techlatest/.
VM Page Link:https://azuremarketplace.microsoft.com/en-us/marketplace/apps/techlatest.blackarch-linux?utm_campaign=blackarch-linux&utm_source=techlatest-website&utm_medium=support-page
https://redd.it/1ccrx2c
@r_devops
Udemy
Free Google Cloud Tutorial - Automation with Ansible & AWX - Free Course by TechLatest
Mastering IT Cloud Infrastructure Automation and Orchestration with Ansible AWX(Ansible Tower Open Source Alternative) - Free Course
Building a Document-Q&A Bot on AWS with Llama3
Hey there! I've crafted a nifty tool called Pluto, which can assist you in creating a document-oriented Q&A bot on AWS. This guide is your roadmap, detailing every step of the way as you develop and launch your own Q&A bot using Pluto, all while harnessing the might of Llama3 and LangChain. The best part? There's no need for you to log into the AWS console at all! All that's required are tokens from GitHub, HuggingFace, OpenAI, and some coding on your end. With this bot, you have the power to designate a specific GitHub repository and then employ the Llama3 model to carry out Q&A sessions based on document content.
https://pluto-lang.vercel.app/cookbook/rag-qa-bot-llama3
https://redd.it/1ccqogm
@r_devops
Hey there! I've crafted a nifty tool called Pluto, which can assist you in creating a document-oriented Q&A bot on AWS. This guide is your roadmap, detailing every step of the way as you develop and launch your own Q&A bot using Pluto, all while harnessing the might of Llama3 and LangChain. The best part? There's no need for you to log into the AWS console at all! All that's required are tokens from GitHub, HuggingFace, OpenAI, and some coding on your end. With this bot, you have the power to designate a specific GitHub repository and then employ the Llama3 model to carry out Q&A sessions based on document content.
https://pluto-lang.vercel.app/cookbook/rag-qa-bot-llama3
https://redd.it/1ccqogm
@r_devops
pluto-lang.vercel.app
Document-Q&A bot based on Llama3 – Pluto
This article guides you on how to develop and deploy a document question-answering bot using Pluto, which is built upon Llama3 and LangChain. You can specify a GitHub repository, then utilize the Llama3 model to conduct Q&A based on the content of the documents.
Choosing a linux for a java developer switching to devops profile?
Hi guys, I´ve been reading around and this seems like a newbies question to ask here but anyway. I´m starting as a Java junior developer and on the side I want to learn about DevOps technologies to switch my profile. Reading other posts the most common linux distros recommendations are Fedora, CentOS, Ubuntu and OpenSuse. The thing is that I read that at some point it´s needed to work with isolated areas, but it can collider with some of the Java work that I do importin libraries and so on (as far as I know).
Should I just pick one that feels good to me and virtualize other so for isolated things or Im lost in a cloud of concepts I dont fully understand?
Edit: I had a couple of years of experience in Ubuntu and Manjaro,
Thank you all
https://redd.it/1ccumm0
@r_devops
Hi guys, I´ve been reading around and this seems like a newbies question to ask here but anyway. I´m starting as a Java junior developer and on the side I want to learn about DevOps technologies to switch my profile. Reading other posts the most common linux distros recommendations are Fedora, CentOS, Ubuntu and OpenSuse. The thing is that I read that at some point it´s needed to work with isolated areas, but it can collider with some of the Java work that I do importin libraries and so on (as far as I know).
Should I just pick one that feels good to me and virtualize other so for isolated things or Im lost in a cloud of concepts I dont fully understand?
Edit: I had a couple of years of experience in Ubuntu and Manjaro,
Thank you all
https://redd.it/1ccumm0
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
What recommendations would you give for the right developer roles to push start-up growth?
Startup growth can be altered by several factors and wrongful hiring can be one of them.
Often, wrongful hiring doesn't mean hiring developers who can't meet the project needs or whose qualifications are falsified. It can often mean hiring the wrong roles as a priority. Most non-tech business owners fall victim to this.
From experience(s), what developer role(s) do you fill first in an app building or MVP stage?
Why is the role the priority? How does it support startup growth? Where do you hire from?
https://redd.it/1ccw779
@r_devops
Startup growth can be altered by several factors and wrongful hiring can be one of them.
Often, wrongful hiring doesn't mean hiring developers who can't meet the project needs or whose qualifications are falsified. It can often mean hiring the wrong roles as a priority. Most non-tech business owners fall victim to this.
From experience(s), what developer role(s) do you fill first in an app building or MVP stage?
Why is the role the priority? How does it support startup growth? Where do you hire from?
https://redd.it/1ccw779
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
A DevOps team’s approach to scaling a leading open-source project to over 100k+ Docker and 44k+ Kubernetes deploys
https://plane.so/blog/streamlining-self-hosting-managing-100k-docker-44000-kubernetes-deploys-ease
https://redd.it/1ccwiis
@r_devops
https://plane.so/blog/streamlining-self-hosting-managing-100k-docker-44000-kubernetes-deploys-ease
https://redd.it/1ccwiis
@r_devops
Plane
How we made self-hosting Plane a breeze for 100,000+ Docker + 44,000 Kubernetes deploys
Plane, like any other open-source B2B software, offers both a Cloud hosted edition and a self-managed one. While our Cloud users far outnumber our self-hosted users, it's nice to see for an early-stage start-up like ours an estimated 50,000+ active self-managed…
Paycut to move to Devops
I just got an offer from a gov contractor to basically be a DevOps consultant. It would be about a 10k pay cut give or take most would be reduced benefits but it things go well I would get TS clearances sponsored by them. I'm really interested in the offer and think that if I was to take a pay cut for a year or two I would be able to come out on the other side in a much better place. I'm currently at 115 for total comp but have another offer on the table for 150k for a more traditional implementation engineer at an MSP. The problem I have with that offer is it's entirely on-prem focused with no room for growth internally or for the tech (would be boomer boss who during the interview process told me "you can't automate VMware") and it would be 3 or 4x the work I'm doing now.
The other part is I'm interested in DevOps and have been teaching myself python and automating my current position away for some time now. This new offer looks like I wrote it in a wet dream in terms of what tech I would get to play with.
So the question is do you think 2 years as a DevOps engineer would get me back to the 115+ range or even the 150 ish range? Should I focus on just jumping right to a higher paying DevOps job after more study and a few basic certs?
https://redd.it/1cczlja
@r_devops
I just got an offer from a gov contractor to basically be a DevOps consultant. It would be about a 10k pay cut give or take most would be reduced benefits but it things go well I would get TS clearances sponsored by them. I'm really interested in the offer and think that if I was to take a pay cut for a year or two I would be able to come out on the other side in a much better place. I'm currently at 115 for total comp but have another offer on the table for 150k for a more traditional implementation engineer at an MSP. The problem I have with that offer is it's entirely on-prem focused with no room for growth internally or for the tech (would be boomer boss who during the interview process told me "you can't automate VMware") and it would be 3 or 4x the work I'm doing now.
The other part is I'm interested in DevOps and have been teaching myself python and automating my current position away for some time now. This new offer looks like I wrote it in a wet dream in terms of what tech I would get to play with.
So the question is do you think 2 years as a DevOps engineer would get me back to the 115+ range or even the 150 ish range? Should I focus on just jumping right to a higher paying DevOps job after more study and a few basic certs?
https://redd.it/1cczlja
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Troubleshooting AWS IoT Custom Authorizer: Resolving 403 Forbidden Error for MQTT and HTTPS Requests
Hello, I have a AWS IOT custom authorizer that i have configured using this guide: https://docs.aws.amazon.com/iot/latest/developerguide/custom-auth-tutorial.html
I am able to test invoke the authorizer and it works as expected. However when a device through mqtt, or if i use Postman and send a https request, I am getting a 403, Forbidden Message. Can someone help me set this up. The use case is to connect a third party device on to my IOT mqtt network.
Thanks
https://redd.it/1cd15ks
@r_devops
Hello, I have a AWS IOT custom authorizer that i have configured using this guide: https://docs.aws.amazon.com/iot/latest/developerguide/custom-auth-tutorial.html
I am able to test invoke the authorizer and it works as expected. However when a device through mqtt, or if i use Postman and send a https request, I am getting a 403, Forbidden Message. Can someone help me set this up. The use case is to connect a third party device on to my IOT mqtt network.
Thanks
https://redd.it/1cd15ks
@r_devops
Amazon
Tutorial: Creating a custom authorizer for AWS IoT Core - AWS IoT Core
This tutorial demonstrates the steps to create, validate, and use Custom Authentication by using the AWS CLI. Optionally, using this tutorial, you can use Postman to send data to AWS IoT Core by using the HTTP Publish API.
Already Drained
Started a new position as Platform Security Manager where I will be working hands on in DevSecOps, AppSec, and Cloud Security. You can read my other post.
I proposed we use GitLab for CI/CD and have all the reason FOR doing it instead of going through CodePipline which is what the Developers proposed.
We just got a new TPM who has halted the discussion of going with GitLab as our solution, and instead is questioning why I am going with GitLab instead of CodePipline.
Going to make a pros and cons list, but why is he taking it upon himself to insert himself into the discussion on how we choose to architect our infrastructure?
Am I missing something?
On top of this, this is the second time I have been told that they want to switch my title kind of jokingly, but it’s getting old.
First they wanted me as a Security Architect, now they joked about putting me as DevOps.
It’s tiring.
Please all you knowledgeable legends, can you help me come up with a way to own this meeting tomorrow that I feel like I have to prove myself and what I bring to the table, and leave them flabbergasted!
Thank you!
https://redd.it/1cd373v
@r_devops
Started a new position as Platform Security Manager where I will be working hands on in DevSecOps, AppSec, and Cloud Security. You can read my other post.
I proposed we use GitLab for CI/CD and have all the reason FOR doing it instead of going through CodePipline which is what the Developers proposed.
We just got a new TPM who has halted the discussion of going with GitLab as our solution, and instead is questioning why I am going with GitLab instead of CodePipline.
Going to make a pros and cons list, but why is he taking it upon himself to insert himself into the discussion on how we choose to architect our infrastructure?
Am I missing something?
On top of this, this is the second time I have been told that they want to switch my title kind of jokingly, but it’s getting old.
First they wanted me as a Security Architect, now they joked about putting me as DevOps.
It’s tiring.
Please all you knowledgeable legends, can you help me come up with a way to own this meeting tomorrow that I feel like I have to prove myself and what I bring to the table, and leave them flabbergasted!
Thank you!
https://redd.it/1cd373v
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
I always wondered, what do you say when hear the question: “Why do we need Devops?”
.
https://redd.it/1cd32mh
@r_devops
.
https://redd.it/1cd32mh
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
AI tools for CI/CD?
With the explosion of generative AI tools focused on application code, anyone know of AI tools for optimizing CI/CD pipelines?
https://redd.it/1cd5nzu
@r_devops
With the explosion of generative AI tools focused on application code, anyone know of AI tools for optimizing CI/CD pipelines?
https://redd.it/1cd5nzu
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
How reliable is the CI at your workplace?
At my workplace they use a combination of Gerrit and Zuul for the CI, and it often takes 2 - 12 hours to get a patch to merge because there are too much load and too many network/infra related timeouts and failures. If I have a patchset that has 10 patches in it, it will take days to get them merged, and almost always, we end up working on the weekends to get the patches in, so that traffic is much less during that time.
Our CI tests have about around 10 jobs that runs per patch.
Whats astounding is the number of times I have to kick the CI to retest because of the network/infra issues. I'd like to know whats the delays at your workplace like? What software do you use for CI ?
https://redd.it/1cd7n4r
@r_devops
At my workplace they use a combination of Gerrit and Zuul for the CI, and it often takes 2 - 12 hours to get a patch to merge because there are too much load and too many network/infra related timeouts and failures. If I have a patchset that has 10 patches in it, it will take days to get them merged, and almost always, we end up working on the weekends to get the patches in, so that traffic is much less during that time.
Our CI tests have about around 10 jobs that runs per patch.
Whats astounding is the number of times I have to kick the CI to retest because of the network/infra issues. I'd like to know whats the delays at your workplace like? What software do you use for CI ?
https://redd.it/1cd7n4r
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Is it worth it to make the interview?
This has happened with two companies I've applied to recently, they have the process of selection fully automatized, so is just a link, it asks some questions about your personality, technical questions, you answer, ok.
Then, you need to do a technical exam, the system is the following, you are recorded, if you move your head too much or get out of frame, it removes points and it doesn't have anywhere to search terms or anything, everything must be in your mind and on the description of the exercise(? the thing doesn't let you test as much as you want, either you do it correctly once, or goodbye little friend, and there are 3 exercises to resolve in 1 hour.
So, my question stands, Is it worth it to make the interview for something like this?
On glassdoor they have 100% bad reviews on the interviews and I mean... I don't even know if it's worth it anymore, I don't know if maybe I'm exagerating.
https://redd.it/1cd96ad
@r_devops
This has happened with two companies I've applied to recently, they have the process of selection fully automatized, so is just a link, it asks some questions about your personality, technical questions, you answer, ok.
Then, you need to do a technical exam, the system is the following, you are recorded, if you move your head too much or get out of frame, it removes points and it doesn't have anywhere to search terms or anything, everything must be in your mind and on the description of the exercise(? the thing doesn't let you test as much as you want, either you do it correctly once, or goodbye little friend, and there are 3 exercises to resolve in 1 hour.
So, my question stands, Is it worth it to make the interview for something like this?
On glassdoor they have 100% bad reviews on the interviews and I mean... I don't even know if it's worth it anymore, I don't know if maybe I'm exagerating.
https://redd.it/1cd96ad
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Guy on our team wants to have a standing meeting on my calendar to ask questions about their stories?
This guy IMO is not qualified for the team he joined, and is struggling quite a bit. I am honestly doing my best to be a good guy, and try to help him, but he just isnt getting it!
He complained that he feels we as a team need to spend more time communicating and reviewing our work as a team... ok yea makes sense I suppose.. but we also do all the normal grooming, demos and retros that hopefully hit all these areas of concern..
I think this week I shit you not Ive had 5 meetings to review the same exact story with this person lol. This story is well written and defined. Anyone should be able to pick it up and complete it. HELL its a god damn SPIKE lol
Man.. I'm just at my wits end here.. do I tell my manager in my next 1:1 that hes just not a good fit? He has 20+ years of "experience", which also makes it more frustrating to have to hand hold. I dont mind doing this for our more junior guys.
https://redd.it/1cd946r
@r_devops
This guy IMO is not qualified for the team he joined, and is struggling quite a bit. I am honestly doing my best to be a good guy, and try to help him, but he just isnt getting it!
He complained that he feels we as a team need to spend more time communicating and reviewing our work as a team... ok yea makes sense I suppose.. but we also do all the normal grooming, demos and retros that hopefully hit all these areas of concern..
I think this week I shit you not Ive had 5 meetings to review the same exact story with this person lol. This story is well written and defined. Anyone should be able to pick it up and complete it. HELL its a god damn SPIKE lol
Man.. I'm just at my wits end here.. do I tell my manager in my next 1:1 that hes just not a good fit? He has 20+ years of "experience", which also makes it more frustrating to have to hand hold. I dont mind doing this for our more junior guys.
https://redd.it/1cd946r
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Apisix canary implement in kubernetes
I use Alicia for application gateway, it all implement in kubernetes,now, I want to deploy the application with canary,but I don’t how to do it,can anyone give some suggestions?thanks in advance
https://redd.it/1cd8yxo
@r_devops
I use Alicia for application gateway, it all implement in kubernetes,now, I want to deploy the application with canary,but I don’t how to do it,can anyone give some suggestions?thanks in advance
https://redd.it/1cd8yxo
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community
Widening skills as SWE towards Ops stuff. Questions, roadmap, certificates.
Hello,
currently i am working as a software engineer focusing mostly on backend stuff in microsoft environment - c#, .net, powershell, sql server, azure etc.
I want to develop as an engineer and it is pretty natural that as backend I'd rather go more into operational stuff than moving divs on screen. In my work I need to manage sometimes pipelines, create some releases, installations and similar pretty easy stuff (in small scope obviously).
I started thinking about going deeper into this field - do more operational stuff like pipelines, containerize stuff (in future) etc. I do not have unfortunately too much opportunities using stuff like jenkins, docker, k8s or writing own pipelines in yaml as most of stuff is done in ADO or done by different teams.
Nevertheless I need to improve in this field and hopefully be better at my work or have more chances for a good job in future :)
I have got a lot of questions and most of them I forgot during writing post but there are few of them.
Are there good/relevant free stuff I can learn from? YT is full of garbage and throwing it out and dont watching tutorials made be better developer, but maybe DevOps field has much better YT creators than devs :)
I was thinking about learning for certificate and maybe even trying to attain one. As I work in Azure environment I found two that match - AZ104 and AZ204, which one would be better in my case, easier or is more respected (or obviously learning it gives me more knowledge). But It doesnt matter if AWS has something better in this field.
I know that I need to go deep into Linux and thats going to one of the next steps - question is about distro, there are plenty of them and Ubuntu can be reasonable choice (i used to work on it and it made me sick that i couldnt install jbl headphones... and os crushed from time to time).
What would be next steps? More teoretical stuff like networking or dirty hand ci/cd, containers etc?
​
https://redd.it/1cdes3x
@r_devops
Hello,
currently i am working as a software engineer focusing mostly on backend stuff in microsoft environment - c#, .net, powershell, sql server, azure etc.
I want to develop as an engineer and it is pretty natural that as backend I'd rather go more into operational stuff than moving divs on screen. In my work I need to manage sometimes pipelines, create some releases, installations and similar pretty easy stuff (in small scope obviously).
I started thinking about going deeper into this field - do more operational stuff like pipelines, containerize stuff (in future) etc. I do not have unfortunately too much opportunities using stuff like jenkins, docker, k8s or writing own pipelines in yaml as most of stuff is done in ADO or done by different teams.
Nevertheless I need to improve in this field and hopefully be better at my work or have more chances for a good job in future :)
I have got a lot of questions and most of them I forgot during writing post but there are few of them.
Are there good/relevant free stuff I can learn from? YT is full of garbage and throwing it out and dont watching tutorials made be better developer, but maybe DevOps field has much better YT creators than devs :)
I was thinking about learning for certificate and maybe even trying to attain one. As I work in Azure environment I found two that match - AZ104 and AZ204, which one would be better in my case, easier or is more respected (or obviously learning it gives me more knowledge). But It doesnt matter if AWS has something better in this field.
I know that I need to go deep into Linux and thats going to one of the next steps - question is about distro, there are plenty of them and Ubuntu can be reasonable choice (i used to work on it and it made me sick that i couldnt install jbl headphones... and os crushed from time to time).
What would be next steps? More teoretical stuff like networking or dirty hand ci/cd, containers etc?
​
https://redd.it/1cdes3x
@r_devops
Reddit
From the devops community on Reddit
Explore this post and more from the devops community