bojieli/ai-infra-book
《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
Language:Python
Total stars: 2403
#python
#accelerator, #aiinfra, #aiinfrastructure, #book, #datacenternetwork, #deepseek, #distributedsystems, #gpu, #kvcache, #llm, #llminference, #llmserving, #llmtraining, #mixtureofexperts, #performanceengineering

usamahz/cpu-performance-engineering
A reading path for CPU performance engineering, from one instruction to production inference. Primary sources only, with a runnable benchmark for every section.
Language:C
Total stars: 573
#c
#arm, #awesomelist, #benchmarks, #computerarchitecture, #cpu, #edgeai, #inference, #lowlatency, #optimization, #performance, #performanceengineering, #simd, #systemsprogramming, #x86