Forwarded from Machine Learning
๐ฅ Awesome open-source project to learn more about Transformer Models! ๐คโจ
We found this interactive website that shows you visually how transformer models work. ๐๐
Transformer Explainer:
https://poloclub.github.io/transformer-explainer/
#TransformerModels #OpenSource #AI #MachineLearning #DataScience #Tech
We found this interactive website that shows you visually how transformer models work. ๐๐
Transformer Explainer:
https://poloclub.github.io/transformer-explainer/
#TransformerModels #OpenSource #AI #MachineLearning #DataScience #Tech
โค4
Forwarded from Machine Learning with Python
Found an easy way to learn math for ML: Mathematics for Machine Learning ๐๐
This is a curated collection on GitHub, including books, research papers, video lectures, and basic materials on math for studying and reviewing the mathematical foundations of machine learning. ๐๐
It helps build a stronger knowledge base by bringing together trusted resources around topics that machine learning engineers constantly encounter: linear algebra, mathematical analysis, probability theory, statistics, information theory, matrix calculus, and deep learning mathematics. ๐งฎ๐ค
Free public repository on GitHub. ๐ปโจ
https://github.com/dair-ai/Mathematics-for-ML
#MachineLearning #Mathematics #DataScience #Learning #GitHub #AI
This is a curated collection on GitHub, including books, research papers, video lectures, and basic materials on math for studying and reviewing the mathematical foundations of machine learning. ๐๐
It helps build a stronger knowledge base by bringing together trusted resources around topics that machine learning engineers constantly encounter: linear algebra, mathematical analysis, probability theory, statistics, information theory, matrix calculus, and deep learning mathematics. ๐งฎ๐ค
Free public repository on GitHub. ๐ปโจ
https://github.com/dair-ai/Mathematics-for-ML
#MachineLearning #Mathematics #DataScience #Learning #GitHub #AI
GitHub
GitHub - dair-ai/Mathematics-for-ML: ๐งฎ A collection of resources to learn mathematics for machine learning
๐งฎ A collection of resources to learn mathematics for machine learning - dair-ai/Mathematics-for-ML
โค4
Assembling GPT-like LLMs from scratch on PyTorch ๐ฅ
https://github.com/analyticalrohit/llms-from-scratch
๐ 10 notebooks. Step-by-step explanation.
๐งฉ Breaks down the architecture of LLMs into simple parts.
โ Suitable for beginners.
๐ Completely hands-on.
#PyTorch #LLM #AI #MachineLearning #DeepLearning #Code
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
https://github.com/analyticalrohit/llms-from-scratch
๐ 10 notebooks. Step-by-step explanation.
๐งฉ Breaks down the architecture of LLMs into simple parts.
โ Suitable for beginners.
๐ Completely hands-on.
#PyTorch #LLM #AI #MachineLearning #DeepLearning #Code
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค4
Learning AI doesnโt need another random tutorial rabbit hole. ๐ซ๐
AI-Study-Group is a public GitHub learning journal for builders trying to navigate AI resources across books, courses, videos, tools, models, datasets, papers, and notes. ๐๐ค
It helps you make your own learning path by collecting the materials the author used while learning AI, with quick-start recommendations up front and sections you can scan by resource type. ๐บ๏ธโจ
Key features: ๐
โข TL;DR starting path โ points to one book, one LLM video, and the Hugging Face Agents Course ๐๐ฅ
โข Books section โ lists AI/ML/DL books with short notes on where each one helps ๐
โข Courses and videos โ collects practical lectures, tutorials, and talks from sources like MIT, NVIDIA, Hugging Face, Karpathy, and 3Blue1Brown ๐
โข Tools and libraries map โ groups frameworks, platforms, visualization tools, and Python libraries for builders ๐ ๏ธ
โข Broader study material โ includes models, model hubs, articles, papers, datasets, and AI notes ๐
Free public GitHub repo. ๐
https://github.com/ArturoNereu/AI-Study-Group
#AI #MachineLearning #DeepLearning #GitHub #StudyGroup #TechLearning
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
AI-Study-Group is a public GitHub learning journal for builders trying to navigate AI resources across books, courses, videos, tools, models, datasets, papers, and notes. ๐๐ค
It helps you make your own learning path by collecting the materials the author used while learning AI, with quick-start recommendations up front and sections you can scan by resource type. ๐บ๏ธโจ
Key features: ๐
โข TL;DR starting path โ points to one book, one LLM video, and the Hugging Face Agents Course ๐๐ฅ
โข Books section โ lists AI/ML/DL books with short notes on where each one helps ๐
โข Courses and videos โ collects practical lectures, tutorials, and talks from sources like MIT, NVIDIA, Hugging Face, Karpathy, and 3Blue1Brown ๐
โข Tools and libraries map โ groups frameworks, platforms, visualization tools, and Python libraries for builders ๐ ๏ธ
โข Broader study material โ includes models, model hubs, articles, papers, datasets, and AI notes ๐
Free public GitHub repo. ๐
https://github.com/ArturoNereu/AI-Study-Group
#AI #MachineLearning #DeepLearning #GitHub #StudyGroup #TechLearning
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค3
๐ Create an LLM from Scratch!
I came across a great find from Vizuara โ a series of 43 lectures that truly delivers on its promise: showing how to build a large language model from scratch. ๐ง โจ
Most people use ChatGPT.
But only a few actually understand how it works under the hood. โ๏ธ
This playlist step by step breaks down all the key concepts without overloading with complex explanations.
๐ What you will learn:
โ The architecture of Transformer ๐๏ธ
โ The internal structure of GPT
โ Tokenization and BPE ๐งฉ
โ Attention mechanisms ๐
โ The process of training an LLM ๐
โ Full implementations in Python ๐
โ Suitable for:
โข ML engineers
โข AI enthusiasts
โข Developers entering the GenAI field
โข Anyone who is tired of explaining AI as a "black box" ๐ต๏ธ
If you really want to understand what lies at the heart of models like ChatGPT, Claude, and Gemini โ this material is worth watching. ๐
๐ Link to the playlist:
https://www.youtube.com/playlist?list=PLPTV0NXA_ZSgsLAr8YCgCwhPIJNNtexWu
#LLM #AI #MachineLearning #Python #GenAI #DeepLearning
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
I came across a great find from Vizuara โ a series of 43 lectures that truly delivers on its promise: showing how to build a large language model from scratch. ๐ง โจ
Most people use ChatGPT.
But only a few actually understand how it works under the hood. โ๏ธ
This playlist step by step breaks down all the key concepts without overloading with complex explanations.
๐ What you will learn:
โ The architecture of Transformer ๐๏ธ
โ The internal structure of GPT
โ Tokenization and BPE ๐งฉ
โ Attention mechanisms ๐
โ The process of training an LLM ๐
โ Full implementations in Python ๐
โ Suitable for:
โข ML engineers
โข AI enthusiasts
โข Developers entering the GenAI field
โข Anyone who is tired of explaining AI as a "black box" ๐ต๏ธ
If you really want to understand what lies at the heart of models like ChatGPT, Claude, and Gemini โ this material is worth watching. ๐
๐ Link to the playlist:
https://www.youtube.com/playlist?list=PLPTV0NXA_ZSgsLAr8YCgCwhPIJNNtexWu
#LLM #AI #MachineLearning #Python #GenAI #DeepLearning
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค6
๐ Found a huge database on System Design for GenAI and LLM! ๐ค๐
500+ real reviews of GenAI, LLM, and ML systems from OpenAI, Anthropic, Google, Microsoft, Netflix, and dozens of other companies. ๐๐ข
A real find for those who are building AI products or want to understand how market leaders do it. ๐๐ก
โ๏ธ Link to GitHub
https://github.com/themanojdesai/genai-llm-ml-case-studies
#SystemDesign #GenAI #LLM #MachineLearning #AI #Tech
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
500+ real reviews of GenAI, LLM, and ML systems from OpenAI, Anthropic, Google, Microsoft, Netflix, and dozens of other companies. ๐๐ข
A real find for those who are building AI products or want to understand how market leaders do it. ๐๐ก
โ๏ธ Link to GitHub
https://github.com/themanojdesai/genai-llm-ml-case-studies
#SystemDesign #GenAI #LLM #MachineLearning #AI #Tech
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค5
Transformers & LLMs Cheatsheet.pdf
1.4 MB
The only LLM cheat sheet you'll ever need ๐
Covers the main concepts, architectures, and practical applications.
### Basics
- Tokens (tokenization, BPE)
- Embeddings (cosine similarity)
- Attention mechanism (Attention formula, Multi-Head Attention)
### Transformer architecture and its variants
- BERT (models with only an encoder)
- GPT (models with only a decoder)
- T5 (models with an encoder and a decoder)
### Large language models (LLMs)
- Prompting (context length, Chain-of-Thought)
- Pre-training (SFT, PEFT/LoRA)
- Preference tuning (Reward Model, Reinforcement Learning)
- Optimizations (Mixture of Experts, Distillation, Quantization)
### Applications
- LLM-as-a-Judge (LaaJ)
- RAG (Retrieval-Augmented Generation)
- Agents (ReAct)
- Reasoning models (Scaling)
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
#LLM #AI #MachineLearning #DeepLearning #PromptEngineering #Tech
Covers the main concepts, architectures, and practical applications.
### Basics
- Tokens (tokenization, BPE)
- Embeddings (cosine similarity)
- Attention mechanism (Attention formula, Multi-Head Attention)
### Transformer architecture and its variants
- BERT (models with only an encoder)
- GPT (models with only a decoder)
- T5 (models with an encoder and a decoder)
### Large language models (LLMs)
- Prompting (context length, Chain-of-Thought)
- Pre-training (SFT, PEFT/LoRA)
- Preference tuning (Reward Model, Reinforcement Learning)
- Optimizations (Mixture of Experts, Distillation, Quantization)
### Applications
- LLM-as-a-Judge (LaaJ)
- RAG (Retrieval-Augmented Generation)
- Agents (ReAct)
- Reasoning models (Scaling)
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
#LLM #AI #MachineLearning #DeepLearning #PromptEngineering #Tech
โค6
The ultimate guide to fine tuning.pdf
15.2 MB
๐ The Big Book on Fine-Tuning LLMs
A free 115-page book dedicated to the retraining of large language models. ๐
It's suitable for those who want to understand how to prepare datasets, configure training, and improve the quality of LLMs for their tasks. ๐
#LLM #FineTuning #AI #MachineLearning #DataScience #Tech
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
๐ Level up your AI & Data Science skills with HelloEncyclo โ a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โ 13 courses live + 40+ coming soon
๐ฏ One access, lifetime updates
๐ Use code: PRESALE-BOOK-WAVE-2GFG
๐ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
A free 115-page book dedicated to the retraining of large language models. ๐
It's suitable for those who want to understand how to prepare datasets, configure training, and improve the quality of LLMs for their tasks. ๐
#LLM #FineTuning #AI #MachineLearning #DataScience #Tech
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
๐ Level up your AI & Data Science skills with HelloEncyclo โ a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โ 13 courses live + 40+ coming soon
๐ฏ One access, lifetime updates
๐ Use code: PRESALE-BOOK-WAVE-2GFG
๐ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค2
Forwarded from Machine Learning with Python
A new collection of free courses has been added:
๐ https://github.com/dair-ai/ML-Course-Notes
Those studying ML through dozens of random tabs and unclosed playlists may find this repository useful for organizing their learning. ๐
Machine Learning Course Notes is an open collection of notes on machine learning, NLP, and AI, compiled around full-fledged courses, not just individual videos. ๐ง
What's inside:
โข Courses from the Machine Learning Specialization, MIT 6.S191, CMU Neural Nets for NLP, CS224N, CS25, and others
โข A table with lectures, descriptions, videos, notes, and authors
โข Links to the original lectures and accompanying notes
โข WIP markers for incomplete materials
โข Instructions for contributors on adding and improving notes
The idea was appreciated. ๐
Instead of another collection of hundreds of links, a course map has been created where one can systematically go through the material without getting lost after a week of studying. ๐บ๏ธ
#MachineLearning #AI #DataScience #TechCommunity #LearningResources #OpenSource
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
๐ Level up your AI & Data Science skills with HelloEncyclo โ a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โ 13 courses live + 40+ coming soon
๐ฏ One access, lifetime updates
๐ Use code: PRESALE-BOOK-WAVE-2GFG
๐ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
๐ https://github.com/dair-ai/ML-Course-Notes
Those studying ML through dozens of random tabs and unclosed playlists may find this repository useful for organizing their learning. ๐
Machine Learning Course Notes is an open collection of notes on machine learning, NLP, and AI, compiled around full-fledged courses, not just individual videos. ๐ง
What's inside:
โข Courses from the Machine Learning Specialization, MIT 6.S191, CMU Neural Nets for NLP, CS224N, CS25, and others
โข A table with lectures, descriptions, videos, notes, and authors
โข Links to the original lectures and accompanying notes
โข WIP markers for incomplete materials
โข Instructions for contributors on adding and improving notes
The idea was appreciated. ๐
Instead of another collection of hundreds of links, a course map has been created where one can systematically go through the material without getting lost after a week of studying. ๐บ๏ธ
#MachineLearning #AI #DataScience #TechCommunity #LearningResources #OpenSource
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
๐ Level up your AI & Data Science skills with HelloEncyclo โ a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โ 13 courses live + 40+ coming soon
๐ฏ One access, lifetime updates
๐ Use code: PRESALE-BOOK-WAVE-2GFG
๐ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
GitHub
GitHub - dair-ai/ML-Course-Notes: ๐ Sharing machine learning course / lecture notes.
๐ Sharing machine learning course / lecture notes. - dair-ai/ML-Course-Notes
โค1
Stop studying LLM from random articles and videos that only explain individual pieces of the puzzle.
๐ LLM from Scratch โ this is a practical course on PyTorch for those who want to understand the entire path of modern LLMs: from the first Transformer block to RLHF.
Instead of endless theory, here we gather a complete model training chain:
๐น Pretraining โ Finetuning โ Alignment in one course
๐น Transformer from scratch: positional embeddings, self-attention, multi-head attention, MLP, residual connections, LayerNorm, and full Transformer blocks
๐น Own training loop without Trainer magic: tokenization, batches, cross-entropy, validation loss, text generation
๐น Modern architecture improvements: RMSNorm, RoPE, SwiGLU, KV Cache, sliding-window attention, and streaming cache
๐น Full section on alignment: SFT, reward models, PPO-style RLHF, and GRPO with an analysis of how it looks in the training loop in practice
https://github.com/vivekkalyanarangan30/llm_from_scratch
#LLM #PyTorch #MachineLearning #DeepLearning #AI #Transformer
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
๐ Level up your AI & Data Science skills with HelloEncyclo โ a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โ 13 courses live + 40+ coming soon
๐ฏ One access, lifetime updates
๐ Use code: PRESALE-BOOK-WAVE-2GFG
๐ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
๐ LLM from Scratch โ this is a practical course on PyTorch for those who want to understand the entire path of modern LLMs: from the first Transformer block to RLHF.
Instead of endless theory, here we gather a complete model training chain:
๐น Pretraining โ Finetuning โ Alignment in one course
๐น Transformer from scratch: positional embeddings, self-attention, multi-head attention, MLP, residual connections, LayerNorm, and full Transformer blocks
๐น Own training loop without Trainer magic: tokenization, batches, cross-entropy, validation loss, text generation
๐น Modern architecture improvements: RMSNorm, RoPE, SwiGLU, KV Cache, sliding-window attention, and streaming cache
๐น Full section on alignment: SFT, reward models, PPO-style RLHF, and GRPO with an analysis of how it looks in the training loop in practice
https://github.com/vivekkalyanarangan30/llm_from_scratch
#LLM #PyTorch #MachineLearning #DeepLearning #AI #Transformer
โจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk
โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
๐ Level up your AI & Data Science skills with HelloEncyclo โ a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โ 13 courses live + 40+ coming soon
๐ฏ One access, lifetime updates
๐ Use code: PRESALE-BOOK-WAVE-2GFG
๐ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค2