FareedKhan-dev/kimi-k3-in-c
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
Language:C
Total stars: 3210
#c
#avx2, #c99, #cpuinference, #deeplearning, #fromscratch, #inferenceengine, #kimik3, #linearattention, #llm, #llminference, #machinelearning, #memoryefficient, #mixtureofexperts, #moe, #mxfp4, #quantization, #simd, #systemsprogramming, #transformer, #zerodependencies
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
Language:C
Total stars: 3210
#c
#avx2, #c99, #cpuinference, #deeplearning, #fromscratch, #inferenceengine, #kimik3, #linearattention, #llm, #llminference, #machinelearning, #memoryefficient, #mixtureofexperts, #moe, #mxfp4, #quantization, #simd, #systemsprogramming, #transformer, #zerodependencies