janhq/nitro
A fast, lightweight, embeddable inference engine to supercharge your apps with local AI. OpenAI-compatible API
Language:C++
Total stars: 362
Stars trend:
6 Jan 2024
1am ▏ +1
2am ██▉ +23
3am █████▎ +42
4am ████▍ +35
5am █▍ +11
6am █▋ +13
7am ▌ +4
8am ▍ +3
9am █▎ +10
10am ▏ +1
11am ▌ +4
12pm ▊ +6
#cplusplus
#accelerated, #ai, #cuda, #gguf, #inferenceengine, #llama, #llama2, #llamacpp, #llm, #llms, #openaiapi, #stablediffusion, #tensorrtllm