Data Analytics
30.9K subscribers
551 photos
21 videos
48 files
373 links
Dive into the world of Data Analytics โ€“ uncover insights, explore trends, and master data-driven decision making.

Admin: @HusseinSheikho || @Hussein_Sheikho
Download Telegram
Free Certification Courses to Learn Data Analytics in 2025:

1. Python
๐Ÿ”— https://imp.i384100.net/5gmXXo

2. SQL
๐Ÿ”— https://edx.org/learn/relational-databases/stanford-university-databases-relational-databases-and-sql

3. Statistics and R
๐Ÿ”— https://edx.org/learn/r-programming/harvard-university-statistics-and-r

4. Data Science: R Basics
๐Ÿ”—https://edx.org/learn/r-programming/harvard-university-data-science-r-basics

5. Excel and PowerBI
๐Ÿ”— https://learn.microsoft.com/en-gb/training/paths/modern-analytics/

6. Data Science: Visualization
๐Ÿ”—https://edx.org/learn/data-visualization/harvard-university-data-science-visualization

7. Data Science: Machine Learning
๐Ÿ”—https://edx.org/learn/machine-learning/harvard-university-data-science-machine-learning

8. R
๐Ÿ”—https://imp.i384100.net/rQqomy

9. Tableau
๐Ÿ”—https://imp.i384100.net/MmW9b3

10. PowerBI
๐Ÿ”— https://lnkd.in/dpmnthEA

11. Data Science: Productivity Tools
๐Ÿ”— https://lnkd.in/dGhPYg6N

12. Data Science: Probability
๐Ÿ”—https://mygreatlearning.com/academy/learn-for-free/courses/probability-for-data-science

13. Mathematics
๐Ÿ”—http://matlabacademy.mathworks.com

14. Statistics
๐Ÿ”— https://lnkd.in/df6qksMB

15. Data Visualization
๐Ÿ”—https://imp.i384100.net/k0X6vx

16. Machine Learning
๐Ÿ”— https://imp.i384100.net/nLbkN9

17. Deep Learning
๐Ÿ”— https://imp.i384100.net/R5aPOR

18. Data Science: Linear Regression
๐Ÿ”—https://pll.harvard.edu/course/data-science-linear-regression/2023-10

19. Data Science: Wrangling
๐Ÿ”—https://edx.org/learn/data-science/harvard-university-data-science-wrangling

20. Linear Algebra
๐Ÿ”— https://pll.harvard.edu/course/data-analysis-life-sciences-2-introduction-linear-models-and-matrix-algebra

21. Probability
๐Ÿ”— https://pll.harvard.edu/course/data-science-probability

22. Introduction to Linear Models and Matrix Algebra
๐Ÿ”—https://edx.org/learn/linear-algebra/harvard-university-introduction-to-linear-models-and-matrix-algebra

23. Data Science: Capstone
๐Ÿ”— https://edx.org/learn/data-science/harvard-university-data-science-capstone

24. Data Analysis
๐Ÿ”— https://pll.harvard.edu/course/data-analysis-life-sciences-4-high-dimensional-data-analysis

25. IBM Data Science Professional Certificate
https://imp.i384100.net/9gxbbY

26. Neural Networks and Deep Learning
https://imp.i384100.net/DKrLn2

27. Supervised Machine Learning: Regression and Classification
https://imp.i384100.net/g1KJEA

#DataAnalytics #Python #SQL #RProgramming #DataScience #MachineLearning #DeepLearning #Statistics #DataVisualization #PowerBI #Tableau #LinearRegression #Probability #DataWrangling #Excel #AI #ArtificialIntelligence #BigData #DataAnalysis #NeuralNetworks #SupervisedLearning #IBMDataScience #FreeCourses #Certification #LearnDataScience
๐Ÿ‘3โค2๐Ÿ”ฅ1
โšก๏ธ All cheat sheets for programmers in one place.

There's a lot of useful stuff inside: short, clear tips on languages, technologies, and frameworks.

No registration required and it's free.

https://overapi.com/

#python #php #Database #DataAnalysis #MachineLearning #AI #DeepLearning #LLMS

https://t.iss.one/CodeProgrammer โšก๏ธ
Please open Telegram to view this post
VIEW IN TELEGRAM
โค7
๐Ÿ‘ A fresh deep learning course from MIT is now available publicly

A full-fledged educational course has been published on the university's website: 24 lectures, practical tasks, homework assignments, and a collection of materials for self-study.

The program includes modern neural network architectures, generative models, transformers, inference, and other key topics.

A great opportunity to study deep learning based on the structure of a top university, free of charge and without simplifications โ€” let's learn here.
https://ocw.mit.edu/courses/6-7960-deep-learning-fall-2024/resources/lecture-videos/

tags: #python #deeplearning

โžก @codeprogrammer
Please open Telegram to view this post
VIEW IN TELEGRAM
โค3
๐Ÿ—‚ A fresh deep learning course from MIT is now publicly available

A full-fledged educational course has been published on the university's website: 24 lectures, practical assignments, homework, and a collection of materials for self-study.

The program includes modern neural network architectures, generative models, transformers, inference, and other key topics.

โžก๏ธ Link to the course

tags: #Python #DataScience #DeepLearning #AI
โค6
Assembling GPT-like LLMs from scratch on PyTorch ๐Ÿ”ฅ

https://github.com/analyticalrohit/llms-from-scratch

๐Ÿ“š 10 notebooks. Step-by-step explanation.

๐Ÿงฉ Breaks down the architecture of LLMs into simple parts.

โœ… Suitable for beginners.

๐Ÿ›  Completely hands-on.

#PyTorch #LLM #AI #MachineLearning #DeepLearning #Code

โœจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค4
Learning AI doesnโ€™t need another random tutorial rabbit hole. ๐Ÿšซ๐Ÿ‡

AI-Study-Group is a public GitHub learning journal for builders trying to navigate AI resources across books, courses, videos, tools, models, datasets, papers, and notes. ๐Ÿ“š๐Ÿค–

It helps you make your own learning path by collecting the materials the author used while learning AI, with quick-start recommendations up front and sections you can scan by resource type. ๐Ÿ—บ๏ธโœจ

Key features: ๐ŸŒŸ

โ€ข TL;DR starting path โ€“ points to one book, one LLM video, and the Hugging Face Agents Course ๐Ÿ“–๐ŸŽฅ
โ€ข Books section โ€“ lists AI/ML/DL books with short notes on where each one helps ๐Ÿ“š
โ€ข Courses and videos โ€“ collects practical lectures, tutorials, and talks from sources like MIT, NVIDIA, Hugging Face, Karpathy, and 3Blue1Brown ๐ŸŽ“
โ€ข Tools and libraries map โ€“ groups frameworks, platforms, visualization tools, and Python libraries for builders ๐Ÿ› ๏ธ
โ€ข Broader study material โ€“ includes models, model hubs, articles, papers, datasets, and AI notes ๐Ÿ“„

Free public GitHub repo. ๐Ÿ†“

https://github.com/ArturoNereu/AI-Study-Group

#AI #MachineLearning #DeepLearning #GitHub #StudyGroup #TechLearning

โœจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค3
๐Ÿš€ Create an LLM from Scratch!

I came across a great find from Vizuara โ€” a series of 43 lectures that truly delivers on its promise: showing how to build a large language model from scratch. ๐Ÿง โœจ

Most people use ChatGPT.
But only a few actually understand how it works under the hood. โš™๏ธ

This playlist step by step breaks down all the key concepts without overloading with complex explanations.

๐Ÿ“š What you will learn:
โ†’ The architecture of Transformer ๐Ÿ—๏ธ
โ†’ The internal structure of GPT
โ†’ Tokenization and BPE ๐Ÿงฉ
โ†’ Attention mechanisms ๐Ÿ”
โ†’ The process of training an LLM ๐Ÿ“ˆ
โ†’ Full implementations in Python ๐Ÿ

โœ… Suitable for:
โ€ข ML engineers
โ€ข AI enthusiasts
โ€ข Developers entering the GenAI field
โ€ข Anyone who is tired of explaining AI as a "black box" ๐Ÿ•ต๏ธ

If you really want to understand what lies at the heart of models like ChatGPT, Claude, and Gemini โ€” this material is worth watching. ๐Ÿ‘€

๐Ÿ”— Link to the playlist:
https://www.youtube.com/playlist?list=PLPTV0NXA_ZSgsLAr8YCgCwhPIJNNtexWu

#LLM #AI #MachineLearning #Python #GenAI #DeepLearning

โœจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค6
Transformers & LLMs Cheatsheet.pdf
1.4 MB
The only LLM cheat sheet you'll ever need ๐Ÿš€

Covers the main concepts, architectures, and practical applications.

### Basics
- Tokens (tokenization, BPE)
- Embeddings (cosine similarity)
- Attention mechanism (Attention formula, Multi-Head Attention)

### Transformer architecture and its variants
- BERT (models with only an encoder)
- GPT (models with only a decoder)
- T5 (models with an encoder and a decoder)

### Large language models (LLMs)
- Prompting (context length, Chain-of-Thought)
- Pre-training (SFT, PEFT/LoRA)
- Preference tuning (Reward Model, Reinforcement Learning)
- Optimizations (Mixture of Experts, Distillation, Quantization)

### Applications
- LLM-as-a-Judge (LaaJ)
- RAG (Retrieval-Augmented Generation)
- Agents (ReAct)
- Reasoning models (Scaling)

โœจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

#LLM #AI #MachineLearning #DeepLearning #PromptEngineering #Tech
โค6
Stop studying LLM from random articles and videos that only explain individual pieces of the puzzle.

๐Ÿ“š LLM from Scratch โ€” this is a practical course on PyTorch for those who want to understand the entire path of modern LLMs: from the first Transformer block to RLHF.

Instead of endless theory, here we gather a complete model training chain:

๐Ÿ”น Pretraining โ†’ Finetuning โ†’ Alignment in one course
๐Ÿ”น Transformer from scratch: positional embeddings, self-attention, multi-head attention, MLP, residual connections, LayerNorm, and full Transformer blocks
๐Ÿ”น Own training loop without Trainer magic: tokenization, batches, cross-entropy, validation loss, text generation
๐Ÿ”น Modern architecture improvements: RMSNorm, RoPE, SwiGLU, KV Cache, sliding-window attention, and streaming cache
๐Ÿ”น Full section on alignment: SFT, reward models, PPO-style RLHF, and GRPO with an analysis of how it looks in the training loop in practice

https://github.com/vivekkalyanarangan30/llm_from_scratch

#LLM #PyTorch #MachineLearning #DeepLearning #AI #Transformer

โœจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค2
Google has published a free guide on scaling AI models and working with GPUs. ๐Ÿš€

๐Ÿ“˜ How to Scale Your Model
https://jax-ml.github.io/scaling-book/

๐Ÿ“˜ How to Think About GPUs
https://jax-ml.github.io/scaling-book/gpus/

The materials discuss the principles of model scaling, the structure of GPUs, computational limitations, memory bandwidth, parallelism, and other topics that are useful when training and running modern AI models. ๐Ÿ’ก

It's completely free and available online. ๐ŸŒ

#AI #MachineLearning #GPU #Scaling #DeepLearning #Tech

โœจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค1
A large collection of materials on LLM Systems,

โ€ข model training (pre-training, RLHF, fault tolerance, stragglers)
โ€ข inference and serving
โ€ข agent systems
โ€ข edge deployment
โ€ข multimodal models
โ€ข technical reports from major laboratories
โ€ข reviews, benchmarks, and leaderboards
โ€ข courses on MLSys and collections of articles from conferences

https://github.com/AmberLJC/LLMSys-PaperList

#LLMSys #LLM #MachineLearning #AIResearch #DeepLearning #TechReports

โœจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค1
๐ŸŽ“ A Free AI Course for Beginners by Microsoft

For those just getting into artificial intelligence, Microsoft offers a free course.

It runs for 12 weeks and includes 24 lessons with theory, hands-on assignments, labs, and quizzes.

The curriculum covers neural networks and deep learning, computer vision, natural language processing, genetic algorithms, and AI ethics. For practice, it uses the two main ML frameworksโ€”TensorFlow and PyTorch.

Each lesson follows the same structure: first, reading material, then a Jupyter notebook with code, and for some topics, a lab. The course is in English but has been translated into dozens of languages.

โžก๏ธ All materials and links are on GitHub
https://github.com/microsoft/AI-For-Beginners/blob/main/translations/ru/README.md

What's your AI level right now?

โค๏ธ โ€” Advanced user
๐Ÿ”ฅ โ€” Almost zero

#AICourse #Microsoft #DeepLearning #TensorFlow #PyTorch #MachineLearning

โœจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
This media is not supported in your browser
VIEW IN TELEGRAM
๐Ÿ”– Building our own GPT-like model in PyTorch

We've found an excellent repository for those who want to understand how modern LLMs are built under the hood.

Inside โ€” 10 Jupyter notebooks with step-by-step explanations and implementations of key components of language models.

GitHub: https://github.com/analyticalrohit/llms-from-scratch

#PyTorch #LLM #MachineLearning #AI #DeepLearning #DataScience

โœจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A

๐Ÿš€ Level up your AI & Data Science skills with HelloEncyclo โ€” a growing all-in-one platform featuring hands-on courses in LLMs, Deep Learning, MLOps, Data Engineering, and more.
โœ… 13 courses live + 40+ coming soon
๐ŸŽฏ One access, lifetime updates
๐Ÿ”‘ Use code: PRESALE-BOOK-WAVE-2GFG
๐Ÿ‘‰ https://helloencyclo.com/?ref=HUSSEINSHEIKHO
โค3
Exporting the model from PyTorch to the universal ONNX format for independent inference ๐Ÿš€

Deploying PyTorch models in production often requires installing a large framework and relying on a Python environment. The ONNX (Open Neural Network Exchange) format converts the computation graph into an intermediate binary format suitable for running on any device and programming language. We will export the PyTorch neural network and run its inference using the lightweight ONNX Runtime. ๐Ÿ› 

To export and run the neural network, we will install the PyTorch framework, the ONNX library, and the cross-platform ONNX Runtime engine.

pip install torch onnx onnxruntime


The packages for converting and high-performance execution of graphs have been successfully installed. โœ…

We will write a Python script that creates a test PyTorch model, exports it to a .onnx file, and immediately performs a verification of the output.

import torch, torch.nn as nn, onnxruntime as ort, numpy as np

model = nn.Sequential(nn.Linear(10, 5), nn.ReLU())
x = torch.randn(1, 10)
torch.onnx.export(model, x, "model.onnx", input_names=["input"], output_names=["output"])

session = ort.InferenceSession("model.onnx")
res = session.run(None, {"input": x.numpy()})
print("ONNX Output shape:", res[0].shape)


The model graph has been successfully serialized into a binary file, and the runtime performed the prediction without involving PyTorch. ๐Ÿ“ฆ

# verification (checks the correctness and structure of the saved ONNX model)
python3 -c "import onnx; model = onnx.load('model.onnx'); onnx.checker.check_model(model); print('ONNX Model Status: Valid')"


Expected output: ONNX Model Status: Valid

# cleanup (deletes the generated model file and cleans up binaries)
rm -f model.onnx


Converting neural networks to ONNX allows you to decouple inference from Python and run models in C++, Rust, Go, or directly in a web browser. Be sure to specify the names of the input and output tensors when exporting to simplify integration with the service. ๐Ÿ’ป

#PyTorch #ONNX #MachineLearning #DeepLearning #AI #DevOps

โœจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค1
One of the key moments when I truly understood how transformers work: ๐Ÿง โœจ

"Stop thinking of a transformer as a conveyor belt, where each layer transforms the output of the previous one."

"Start thinking of it as a residual flow." ๐ŸŒŠ

Each block in a transformer has a residual connection that adds the input of the block to its output:

x' = f(x) + x


Because of this addition, the attention mechanism or MLP within the layer โ€“ the function f in the formula above โ€“ actually does NOT transform the input. Instead, it calculates the information that needs to be ADDED to the input before passing it to the next block! โž•

Imagine the main part of the transformer as a shared whiteboard. ๐Ÿ“ Each block reads what it needs from it and adds its own notes. All changes are additions.

Furthermore, layers can exchange information over distances. A block in the first layer can write information, and a block in the fifth layer can read it, even though there is no direct connection between them. ๐Ÿ”—

I owe these ideas to an older article by Anthropic about the architecture of transformers:
transformer-circuits.pub/2021/framework

#Transformers #DeepLearning #AI #MachineLearning #NeuralNetworks #Tech

โœจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค3
I thought I understood how GPU loading works until I started writing this guide. ๐Ÿค”

I was constantly confusing three different concepts:

โ€ข The amount of work we are launching.
โ€ข The amount of work that is actually placed on the GPU.
โ€ข The amount of work that is ready to be executed right now.

But these are completely different things. โš ๏ธ

Consider a CUDA kernel with 240 blocks, each containing 256 threads. This results in 61,440 logical threads, or 1920 warps. However, the number of launched threads doesn't tell you how many warps can actually be present on the GPU simultaneously. ๐Ÿงฎ

Blocks are placed on streaming multiprocessors (SMs) based on the available registers, shared memory, and limitations on the number of threads, warps, and blocks.

Even after being placed on an SM, a warp can be waiting for a memory operation to complete, a dependency between arithmetic operations to be resolved, or for synchronization. The scheduler can only select warps that are actually ready to issue instructions for execution. โณ

This changed my approach to analyzing performance metrics. ๐Ÿ“Š

Occupancy is a measure of the ratio of the number of active warps on an SM to the maximum number of warps that the SM can support.

GPU utilization measures something different. In NVML, this metric reflects the percentage of the measurement interval during which at least one CUDA kernel was running.

Therefore, the GPU can show 100% utilization even if the Tensor Cores are not being used to their full potential, the HBM bandwidth is not saturated, and performance is limited by one of the system components. At the same time, a significant portion of the GPU's resources may remain underutilized. ๐Ÿ“‰

Similar misconceptions arise with memory. Registers, shared memory, L1, L2, and HBM are not simply levels of memory that differ in speed. Each has its own areas of accessibility, capacity, management characteristics, and access methods. ๐Ÿ’พ

If a model fits in HBM, it only means that there is enough video memory for it. But it tells you very little about how many bytes need to be transferred, how efficiently memory accesses are combined, how often data is reused, and whether memory is actually limiting the performance of the CUDA kernel.

A good example is FlashAttention. This algorithm calculates the exact attention mechanism, but uses tiling and repeated computations to reduce the amount of data transferred between HBM and the GPU's internal memory. โšก๏ธ

Tensor Cores turned out to be another technology that I previously understood too simplistically.

These are specialized computational units for matrix multiplication operations with accumulation, which play a huge role in AI tasks. However, they do not "execute the model" as a whole. ๐Ÿง 

Reduction operations, indexing, element-wise calculations, synchronization, and data movement still involve other components of the GPU. In addition, launching CUDA kernels also introduces overhead.

Over time, I stopped asking myself: "Why isn't the GPU 100% utilized?" Instead, I started asking a more accurate question: "What is currently limiting the speed of performing useful work?" ๐Ÿค”

Ultimately, all of this turned into a 42-page guide. ๐Ÿ“„

It covers streaming multiprocessors (SMs), warps, and schedulers, the memory hierarchy and latency hiding, Tensor Cores, the distribution of GEMM computations across GPU hardware resources, numerical precision, and performance metrics that are very easy to misinterpret.

https://drive.google.com/file/d/17tyvxr__8vZ6o995GNq6I5PC5JOiv0ql/view

#GPU #CUDA #AI #DeepLearning #PerformanceOptimization #TechGuide

โœจ Join Best TG Channels https://t.iss.one/addlist/0f6vfFbEMdAwODBk

โญ๏ธ Join Our WhatsApp Channel https://whatsapp.com/channel/0029VaC7Weq29753hpcggW2A
โค2๐Ÿ‘2