microsoft/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Language: Python
Stars trend:
11 Apr 2023

 5pm ▎ 2

 6pm ▏ 1

 7pm ▎ 2

 8pm ▋ 5

 9pm █▋ 13

10pm ▌ 4

11pm █▊ 14

12 Apr 2023

12am █▊ 14

 1am ██▍ 19

 2am ██▊ 22

 3am ████▉ 39

 4am ██▌ 20

#python
#billionparameters, #compression, #dataparallelism, #deeplearning, #gpu, #inference, #machinelearning, #mixtureofexperts, #modelparallelism, #pipelineparallelism, #pytorch, #trillionparameters, #zero

whitecircle/halo
Halo is an open-source framework built by White Circle for training large language and multimodal models
Language:Python
Total stars: 409
#python
#agent, #asyncrl, #distributedtraining, #finetuning, #grpo, #largelanguagemodels, #llm, #lora, #modelparallelism, #moe, #multimodal, #peft, #posttraining, #pytorch, #qlora, #quantization, #reinforcementlearning, #rlhf, #transformers, #vllm