Data

Tools

Indexes

Applications

Experiments

Summary

An open API service for producing an overview of a list of open source projects.

awesome-llama: https://github.com/Tiiny-AI/PowerInfer

large-language-models llama llm llm-inference local-inference

Score: 15.184658760249192

Last synced: about 8 hours ago
JSON representation

Repository metadata:

High-speed Large Language Model Serving for Local Deployment

Owner metadata:

GitHub Events

Total
Last Year

Committers metadata

Last synced: 2 days ago

Total Commits: 1,590
Total Committers: 400
Avg Commits per committer: 3.975
Development Distribution Score (DDS): 0.748

Commits in past year: 3
Committers in past year: 2
Avg Commits per committer in past year: 1.5
Development Distribution Score (DDS) in past year: 0.333

Name Email Commits
Georgi Gerganov g****v@g****m 401
slaren s****h@g****m 81
Cebtenzzre c****e@g****m 60
Johannes Gäßler j****g@5****e 59
Kawrakow 4****w 49
Holden X h****x@g****m 38
Kerfuffle 4****2 38
Stephan Walter s****n@w****e 32
Pavol Rusnak p****l@r****o 26
Jhen-Jie Hong i****9@g****m 23
Howard Su h****u@g****m 21
anzz1 a****1@l****m 21
Henri Vasserman h****v@h****e 19
DannyDaemonic D****c@g****m 17
Erik Scholz G****y 15
Jeremy Song y****g@s****n 14
xaedes x****s@g****m 11
Evan Jones e****s@g****m 11
M. Yusuf Sarıgöz y****z@g****m 11
Shouzheng Liu l****i@g****m 10
CRD716 c****6@g****m 7
Galunid k****6@g****m 7
Ivan Stepanov i****w@g****m 7
Jiahao Li l****7@1****m 7
comex c****k@g****m 7
goerch j****r@t****e 7
shibe2 s****e@t****o 7
tjohnman t****n 7
Matvey Soloviev b****9@g****m 6
Qingyou Meng m****u@g****m 6
and 370 more...

Issue and Pull Request metadata

Last synced: 22 days ago

Total issues: 2
Total pull requests: 4
Average time to close issues: N/A
Average time to close pull requests: about 2 months
Total issue authors: 2
Total pull request authors: 4
Average comments per issue: 0.5
Average comments per pull request: 0.5
Merged pull request: 1
Bot issues: 0
Bot pull requests: 0

Past year issues: 2
Past year pull requests: 4
Past year average time to close issues: N/A
Past year average time to close pull requests: about 2 months
Past year issue authors: 2
Past year pull request authors: 4
Past year average comments per issue: 0.5
Past year average comments per pull request: 0.5
Past year merged pull request: 1
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/Tiiny-AI/PowerInfer

Top Issue Authors

  • tyoc213 (1)
  • fmotta (1)

Top Pull Request Authors

  • OpenByteDev (1)
  • ZeyuMi (1)
  • bglglzd (1)
  • kmransom56 (1)

Top Issue Labels

  • bug-unconfirmed (1)
  • question (1)

Top Pull Request Labels

Dependencies

.github/workflows/build.yml actions
  • Jimver/cuda-toolkit v0.2.11 composite
  • actions/checkout v1 composite
  • actions/checkout v3 composite
  • actions/download-artifact v3 composite
  • actions/github-script v3 composite
  • actions/upload-artifact v3 composite
  • anzz1/action-create-release v1 composite
.github/workflows/code-coverage.yml actions
  • actions/checkout v3 composite
  • codecov/codecov-action v3 composite
.github/workflows/docker.yml actions
  • actions/checkout v3 composite
  • docker/build-push-action v4 composite
  • docker/login-action v2 composite
  • docker/setup-buildx-action v2 composite
  • docker/setup-qemu-action v2 composite
.github/workflows/editorconfig.yml actions
  • actions/checkout v3 composite
  • editorconfig-checker/action-editorconfig-checker main composite
.github/workflows/gguf-publish.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v2 composite
  • pypa/gh-action-pypi-publish release/v1 composite
.github/workflows/tidy-post.yml actions
  • ZedThree/clang-tidy-review/post v0.13.0 composite
.github/workflows/tidy-review.yml actions
  • ZedThree/clang-tidy-review v0.13.0 composite
  • ZedThree/clang-tidy-review/upload v0.13.0 composite
  • actions/checkout v3 composite
.github/workflows/zig-build.yml actions
  • actions/checkout v3 composite
  • goto-bus-stop/setup-zig v2 composite
gguf-py/pyproject.toml pypi
  • pytest ^5.2 develop
  • numpy >=1.17
  • python >=3.8
powerinfer-py/pyproject.toml pypi
  • cvxopt ==1.3.2
  • torch >=2
requirements.txt pypi
  • numpy >=1.24.4
  • sentencepiece >=0.1.98
  • transformers >=4.33.2
Package.swift swiftpm
examples/batched.swift/Package.swift swiftpm
smallthinker/flake.nix nix
  • flake-parts *
  • nixpkgs nixos-unstable
smallthinker/examples/gguf-hash/deps/rotate-bits/package.json npm
smallthinker/powerinfer/libaz/external/googletest/MODULE.bazel bazel
  • rules_python 1.3.0 development
  • abseil-cpp 20250127.1
  • platforms 0.0.11
  • re2 2024-07-02.bcr.1
smallthinker/requirements/requirements-gguf_editor_gui.txt pypi
  • PySide6 *
  • gguf >=0.17.0
  • numpy *
smallthinker/examples/batched.swift/Package.swift swiftpm
smallthinker/powerinfer/libaz/external/cli11/.github/actions/quick_cmake/action.yml actions
  • jwlawson/actions-setup-cmake v2.0.2 composite
smallthinker/requirements/requirements-convert_hf_to_gguf_update.txt pypi
  • torch *
  • torch >=0.0.0.dev0
smallthinker/requirements/requirements-convert_legacy_llama.txt pypi
  • gguf >=0.1.0
  • numpy *
  • protobuf >=4.21.0,<5.0.0
  • sentencepiece *
  • transformers >=4.45.1,<5.0.0
smallthinker/requirements/requirements-convert_llama_ggml_to_gguf.txt pypi
.devops/llama-cpp.srpm.spec rpm
  • libstdc++ *
smallthinker/powerinfer/libaz/external/fmt/support/bazel/MODULE.bazel bazel
  • platforms 0.0.11
  • rules_cc 0.1.1
smallthinker/powerinfer/libaz/external/cli11/MODULE.bazel bazel
  • catch2 3.5.4 development
smallthinker/examples/gguf-hash/deps/sha1/package.json npm
smallthinker/requirements/requirements-pydantic.txt pypi
  • docstring_parser *
  • pydantic *
  • requests *
smallthinker/examples/llama.android/build.gradle.kts maven
flake.lock nix
  • flake-utils ff7b65b
  • nixpkgs 63678e9
smallthinker/powerinfer/libaz/external/cli11/book/package.json npm
  • gitbook-cli 2.2.0
  • gitbook-plugin-hints ^1.0.2
  • gitbook-plugin-include-codeblock ^3.2.2
  • gitbook-plugin-term ^0.5.1
  • svgexport >=0.4.2
smallthinker/requirements/requirements-compare-llama-bench.txt pypi
  • GitPython *
  • tabulate *
smallthinker/requirements/requirements-convert_lora_to_gguf.txt pypi
smallthinker/requirements/requirements-test-tokenizer-random.txt pypi
  • cffi * test
smallthinker/tools/server/bench/requirements.txt pypi
  • matplotlib *
  • requests *
smallthinker/gguf-py/pyproject.toml pypi
  • pytest ^5.2 develop
  • numpy >=1.17
  • pyside6 ^6.9
  • python >=3.8
  • pyyaml >=5.1
  • sentencepiece >=0.1.98,<=0.2.0
  • tqdm >=4.27
smallthinker/examples/llama.android/llama/build.gradle.kts maven
  • androidx.appcompat:appcompat 1.6.1 implementation
  • androidx.core:core-ktx 1.12.0 implementation
  • com.google.android.material:material 1.11.0 implementation
  • junit:junit 4.13.2 testImplementation
flake.nix nix
  • flake-utils *
  • nixpkgs nixos-unstable
smallthinker/tools/server/tests/requirements.txt pypi
  • aiohttp * test
  • huggingface_hub * test
  • numpy * test
  • openai * test
  • prometheus-client * test
  • pytest * test
  • requests * test
  • wget * test
smallthinker/requirements/requirements-tool_bench.txt pypi
  • aiohttp *
  • huggingface_hub *
  • matplotlib *
  • numpy *
  • openai *
  • pandas *
  • prometheus-client *
  • pytest *
  • requests *
  • seaborn *
  • typer *
  • wget *
smallthinker/requirements.txt pypi
.devops/llama-cpp-cublas.srpm.spec rpm
  • cuda-toolkit *
smallthinker/examples/llama.android/app/build.gradle.kts maven
  • androidx.activity:activity-compose 1.8.2 implementation
  • androidx.compose.material3:material3 * implementation
  • androidx.compose.ui:ui * implementation
  • androidx.compose.ui:ui-graphics * implementation
  • androidx.compose.ui:ui-tooling-preview * implementation
  • androidx.core:core-ktx 1.12.0 implementation
  • androidx.lifecycle:lifecycle-runtime-ktx 2.6.2 implementation
  • junit:junit 4.13.2 testImplementation
smallthinker/flake.lock nix
  • flake-parts 506278e
  • nixpkgs 23e89b7
smallthinker/examples/gguf-hash/deps/sha256/package.json npm
  • jb55/rotate-bits.h 0.1.1
smallthinker/requirements/requirements-all.txt pypi
smallthinker/tools/server/webui/package-lock.json npm
  • 460 dependencies
.devops/llama-cpp-clblast.srpm.spec rpm
  • clblast *
smallthinker/pyproject.toml pypi
  • pytest ^5.2 develop
  • gguf *
  • numpy ^1.25.0
  • protobuf >=4.21.0,<5.0.0
  • python >=3.9
  • sentencepiece >=0.1.98,<=0.2.0
  • torch ^2.2.0
  • transformers >=4.35.2,<5.0.0
smallthinker/tools/server/webui/package.json npm
  • @eslint/js ^9.17.0 development
  • @types/markdown-it ^14.1.2 development
  • @types/node ^22.13.1 development
  • @types/react ^18.3.18 development
  • @types/react-dom ^18.3.5 development
  • @vitejs/plugin-react ^4.3.4 development
  • eslint ^9.17.0 development
  • eslint-plugin-react-hooks ^5.0.0 development
  • eslint-plugin-react-refresh ^0.4.16 development
  • fflate ^0.8.2 development
  • globals ^15.14.0 development
  • prettier ^3.4.2 development
  • sass-embedded ^1.83.4 development
  • typescript ~5.6.2 development
  • typescript-eslint ^8.18.2 development
  • vite ^6.0.5 development
  • @heroicons/react ^2.2.0
  • @sec-ant/readable-stream ^0.6.0
  • @tailwindcss/postcss ^4.1.1
  • @tailwindcss/vite ^4.1.1
  • @vscode/markdown-it-katex ^1.1.1
  • autoprefixer ^10.4.20
  • daisyui ^5.0.12
  • dexie ^4.0.11
  • highlight.js ^11.10.0
  • katex ^0.16.15
  • pdfjs-dist ^5.2.133
  • postcss ^8.4.49
  • react ^18.3.1
  • react-dom ^18.3.1
  • react-dropzone ^14.3.8
  • react-hot-toast ^2.5.2
  • react-markdown ^9.0.3
  • react-router ^7.1.5
  • rehype-highlight ^7.0.2
  • rehype-katex ^7.0.1
  • remark-breaks ^4.0.0
  • remark-gfm ^4.0.0
  • remark-math ^6.0.0
  • tailwindcss ^4.1.1
  • textlinestream ^1.1.1
  • vite-plugin-singlefile ^2.0.3
smallthinker/requirements/requirements-convert_hf_to_gguf.txt pypi
  • torch *
  • torch >=0.0.0.dev0
smallthinker/tools/mtmd/requirements.txt pypi
  • pillow *
  • torch *
  • torchvision *