zilliztech/GPTCache
GPTCache is a library for creating semantic cache to store responses from LLM queries.
Language: Python
Total stars: 1056
Stars trend:
18 Apr 2023

12am ▏ +1

 1am  +0

 2am ▌ +4

 3am ▏ +1

 4am ▋ +5

 5am ███▋ +29

 6am ████▋ +37

 7am ██▋ +21

 8am ██▍ +19

 9am █▊ +14

10am █▊ +14

11am █▌ +12

#python
#aigc, #autogpt, #cache, #chatapplication, #chatbot, #chatgpt, #chatgptapi, #gpt, #gpt3, #gpt35turbo, #gpt4, #langchain, #llm, #memcache, #milvus, #openai, #openaiapi, #semanticcache, #similaritysearch, #vectorsearch

aqstack/mimir
mimir is a drop-in proxy that caches LLM API responses using semantic similarity, reducing costs and latency for repeated or similar queries.
Language:Go
Total stars: 150
Stars trend:
4 Jan 2026
2pm ▏ +1
3pm +0
4pm +0
5pm +0
6pm +0
7pm +0
8pm +0
9pm ██▌ +20
10pm ███▌ +28
#go
#caching, #costoptimization, #golang, #kubernetes, #llm, #openai, #proxy, #semanticcache