An open API service for producing an overview of a list of open source projects.

awesome-llama: https://github.com/zilliztech/GPTCache

aigc autogpt babyagi chatbot chatgpt chatgpt-api dolly gpt langchain llama llama-index llm memcache milvus openai redis semantic-search similarity-search vector-search

Score: 24.85552999983167

Last synced: about 9 hours ago
JSON representation

Repository metadata:

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.


Owner metadata:


GitHub Events

Total
Last Year

Committers metadata

Last synced: 1 day ago

Total Commits: 510
Total Committers: 44
Avg Commits per committer: 11.591
Development Distribution Score (DDS): 0.612

Commits in past year: 8
Committers in past year: 1
Avg Commits per committer in past year: 8.0
Development Distribution Score (DDS) in past year: 0.0

Name Email Commits
SimFG b****u@z****m 198
Starlord 6****e 53
Jael Gu m****u@z****m 45
shiyu22 s****n@z****m 37
Xiaofan 8****n 34
wxywb x****g@z****m 24
junjiejiangjjj j****g@z****m 15
Bennu y****i@z****m 14
ryjiang j****i@g****m 14
binbin 8****v 11
KY HU k****u@z****m 9
Frank Liu f****k@f****m 7
Anurag Wagh a****g@g****m 6
zhuwenxing w****u@z****m 3
liliu-z 1****z 3
Saba Sturua 4****z 3
Mohammad Mohtashim 4****6 3
Pouyan p****r@g****m 2
ChengZi c****g@z****m 2
Pranay Chandekar p****6@g****m 2
Bryan YW w****n 2
leio10 l****z@f****o 1
vax521 1****8@1****m 1
jacktempo7 1****7 1
Yasin Tatar y****9@g****m 1
Vladimir Orshulevich 3****R 1
TripleChecker 1****m 1
TongTie t****4@g****m 1
Reuben Thomas-Davis r****d@g****m 1
Rayce Rossum r****m@g****m 1
and 14 more...

Issue and Pull Request metadata

Last synced: 1 day ago

Total issues: 148
Total pull requests: 240
Average time to close issues: about 1 month
Average time to close pull requests: 5 days
Total issue authors: 112
Total pull request authors: 66
Average comments per issue: 3.14
Average comments per pull request: 2.66
Merged pull request: 169
Bot issues: 0
Bot pull requests: 0

Past year issues: 6
Past year pull requests: 18
Past year average time to close issues: 2 minutes
Past year average time to close pull requests: about 1 month
Past year issue authors: 6
Past year pull request authors: 13
Past year average comments per issue: 1.0
Past year average comments per pull request: 3.06
Past year merged pull request: 0
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/zilliztech/GPTCache

Top Issue Authors

  • xiaofan-luan (6)
  • SimFG (6)
  • a9raag (4)
  • jiangbossB (3)
  • oussamaJmaaa (3)
  • songsey (3)
  • Songjiadong (3)
  • amrit2cisco (2)
  • kishanios123 (2)
  • mayalinetsky-kryon (2)
  • yuanjie-ai (2)
  • nathangary (2)
  • dequeueing (2)
  • kennethleungty (2)
  • vinvcn (2)

Top Pull Request Authors

  • SimFG (65)
  • jaelgu (19)
  • shiyu22 (14)
  • wxywb (13)
  • Chiiizzzy (11)
  • junjiejiangjjj (9)
  • akashAD98 (6)
  • a9raag (6)
  • ziyi-curiousthing (6)
  • pranaychandekar (4)
  • keenborder786 (4)
  • sky-2002 (4)
  • jupyterjazz (4)
  • triplechecker-com (2)
  • haonan-li (2)

Top Issue Labels

  • good first issue (13)
  • help wanted (9)
  • planned (6)
  • enhancement (5)
  • hacktoberfest (3)
  • need more details (2)
  • next version (2)

Top Pull Request Labels

  • dco-passed (165)
  • approved (118)
  • ci-passed (92)
  • size/L (83)
  • needs-dco (64)
  • lgtm (53)
  • size/M (49)
  • size/XS (46)
  • size/S (31)
  • size/XXL (13)
  • size/XL (10)
  • kind/improvement (1)

Package metadata

nixpkgs-23.11: python311Packages.gptcache

Semantic cache for LLMs and fully integrated with LangChain and llama_index

nixpkgs-23.11: python310Packages.gptcache

Semantic cache for LLMs and fully integrated with LangChain and llama_index

nixpkgs-unstable: python313Packages.gptcache

Semantic cache for LLMs and fully integrated with LangChain and llama_index

nixpkgs-24.11: python311Packages.gptcache

Semantic cache for LLMs and fully integrated with LangChain and llama_index

nixpkgs-24.11: python312Packages.gptcache

Semantic cache for LLMs and fully integrated with LangChain and llama_index

nixpkgs-unstable: python314Packages.gptcache

Semantic cache for LLMs and fully integrated with LangChain and llama_index

nixpkgs-24.05: python312Packages.gptcache

Semantic cache for LLMs and fully integrated with LangChain and llama_index

pypi.org: gptcache

GPTCache, a powerful caching library that can be used to speed up and lower the cost of chat applications that rely on the LLM service. GPTCache works as a memcache for AIGC applications, similar to how Redis works for traditional applications.

proxy.golang.org: github.com/zilliztech/gptcache

  • Homepage:
  • Status: removed
  • Documentation: https://pkg.go.dev/github.com/zilliztech/gptcache#section-documentation
  • Licenses: mit
  • Latest release: v0.0.0-20260922082600-a74ac654473f (published 9 days ago)
  • Last Synced: 2026-09-29T15:03:58.421Z (1 day ago)
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Rankings:
    • Dependent packages count: 4.049%
    • Average: 4.19%
    • Dependent repos count: 4.331%
anaconda.org: gptcache

GPTCache is a powerful caching library that can be used to speed up and lower the cost of chat applications that rely on the LLM service. GPTCache works as a memcache for AIGC applications, similar to how Redis works for traditional applications

  • Homepage: https://zilliz.com/what-is-gptcache
  • Licenses: MIT
  • Latest release: 0.1.44 (published 10 months ago)
  • Last Synced: 2026-04-03T07:25:56.330Z (6 months ago)
  • Versions: 3
  • Dependent Packages: 0
  • Dependent Repositories: 0
  • Downloads: 1,824 Total
  • Rankings:
    • Stargazers count: 15.788%
    • Forks count: 24.643%
    • Average: 34.809%
    • Dependent packages count: 41.36%
    • Dependent repos count: 57.446%
nixpkgs-24.05: python311Packages.gptcache

Semantic cache for LLMs and fully integrated with LangChain and llama_index

proxy.golang.org: github.com/zilliztech/GPTCache


Dependencies

.github/workflows/publish_dev_package.yaml actions
  • actions/checkout master composite
  • actions/setup-python v4 composite
  • pypa/gh-action-pypi-publish master composite
setup.py pypi
.github/workflows/publish_release_package.yaml actions
  • actions/checkout master composite
  • actions/setup-python v4 composite
  • pypa/gh-action-pypi-publish master composite
docs/bootcamp/streamlit/gptcache-streamlit-audio/requirements.txt pypi
  • faiss-cpu *
  • gptcache *
  • pillow *
  • sqlalchemy *
  • streamlit *
  • torch *
  • torchaudio *
  • transformers *
.github/workflows/Nightly_CI_main.yaml actions
  • actions/checkout main composite
  • actions/setup-python v4 composite
  • ankane/pgvector * docker
docs/bootcamp/streamlit/gptcache-streamlit-image/requirements.txt pypi
  • faiss-cpu *
  • gptcache *
  • onnxruntime *
  • pillow *
  • sqlalchemy *
  • streamlit *
  • transformers *
tests/requirements.txt pypi
  • anyio ==3.6.2 test
  • coverage ==7.2.3 test
  • grpcio ==1.53.0 test
  • loguru ==0.5.3 test
  • milvus ==2.2.8 test
  • mock * test
  • pexpect * test
  • protobuf ==3.20.0 test
  • psycopg2-binary * test
  • pymilvus ==2.2.8 test
  • pytest ==7.2.0 test
  • pytest-assume ==2.4.3 test
  • pytest-cov ==4.1.0 test
  • pytest-html ==3.1.1 test
  • pytest-level ==0.1.1 test
  • pytest-loguru ==0.2.0 test
  • pytest-parallel * test
  • pytest-repeat ==0.8.0 test
  • pytest-rerunfailures ==9.1.1 test
  • pytest-sugar ==0.9.5 test
  • pytest-timeout ==1.3.3 test
  • pytest-xdist ==2.5.0 test
  • safetensors * test
  • spacy * test
  • stability-sdk * test
  • torch * test
  • transformers ==4.29.2 test
  • typing_extensions <4.6.0 test
.github/workflows/build_dev_python_package.yaml actions
  • actions/checkout master composite
  • actions/setup-python v4 composite
  • actions/upload-artifact v3 composite
docs/requirements.txt pypi
  • autodoc_pydantic *
  • m2r2 *
  • myst_nb *
  • nbsphinx *
  • pyqt5 <5.13
  • pyqtwebengine <5.13
  • sphinx *
  • sphinx-autobuild *
  • sphinx-panels *
  • sphinx_book_theme *
  • sphinx_copybutton *
  • sphinx_toolbox *
  • urllib3 <2.0
.github/workflows/pylint.yaml actions
  • actions/checkout v3.0.0 composite
  • actions/setup-python v4 composite
.github/workflows/unit_test_main.yaml actions
  • actions/checkout main composite
  • actions/setup-python v4 composite
  • codecov/codecov-action v3.1.0 composite
  • amazon/dynamodb-local 2.0.0 docker
  • ankane/pgvector * docker
  • mongo * docker
  • redis/redis-stack-server * docker
gptcache_server/dockerfiles/Dockerfile docker
  • python 3.8-slim-bullseye build
.github/workflows/publish_release_image.yaml actions
  • actions/checkout master composite
  • azure/docker-login v1 composite
requirements.txt pypi
  • cachetools *
  • numpy *
  • requests *