Data

Tools

Indexes

Applications

Experiments

Summary

An open API service for producing an overview of a list of open source projects.

awesome-llama: https://github.com/alibaba/rtp-llm

gpt inference llama llm llm-serving llmops model-serving

Score: 11.470696230752491

Last synced: about 7 hours ago
JSON representation

Repository metadata:

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Owner metadata:

GitHub Events

Total
Last Year

Committers metadata

Last synced: 8 days ago

Total Commits: 3,999
Total Committers: 83
Avg Commits per committer: 48.181
Development Distribution Score (DDS): 0.193

Commits in past year: 2,013
Committers in past year: 61
Avg Commits per committer in past year: 33.0
Development Distribution Score (DDS) in past year: 0.326

Name Email Commits
rtp-llm r****m@a****a 3228
baowending.bwd b****d@a****m 61
luoli.hn l****n@t****m 50
JackTan25 j****y@g****m 43
luoxi l****q@a****m 41
liukan.lk l****k@a****m 40
wht21 w****t@a****m 38
feifei14119 f****w@a****m 36
wangyin w****x@a****m 28
huzetao.hzt h****t@a****m 24
fanfengfeng.fff f****f@a****m 20
步黎 s****q@a****m 20
xinfei.sxf x****f@a****m 18
jacobwin-ai 1****9@q****m 17
Nancheng-11 y****j@a****m 15
蝉吟 l****d@a****m 14
yanxi.wln y****n@a****m 14
pujingwen.pjw p****w@a****m 14
liaochenzhi.lcz l****z@a****m 14
brucelee.ly b****y@a****m 14
kedi z****f@a****m 13
Zhao An z****n@a****m 12
zhangzhi 1****4@p****n 12
yiyin.zjh y****h@a****m 12
Dragan Mladjenovic D****c@a****m 11
valarLip l****1@a****m 10
塞尘 s****m@t****m 10
凌葭 l****j@a****m 10
Hang Yang h****y@a****m 9
mtgu0705 m****u@a****m 8
and 53 more...

Issue and Pull Request metadata

Last synced: 8 days ago

Total issues: 100
Total pull requests: 165
Average time to close issues: 10 days
Average time to close pull requests: 4 days
Total issue authors: 60
Total pull request authors: 40
Average comments per issue: 1.54
Average comments per pull request: 0.92
Merged pull request: 82
Bot issues: 0
Bot pull requests: 0

Past year issues: 13
Past year pull requests: 99
Past year average time to close issues: about 3 hours
Past year average time to close pull requests: 3 days
Past year issue authors: 11
Past year pull request authors: 29
Past year average comments per issue: 0.08
Past year average comments per pull request: 0.57
Past year merged pull request: 34
Past year bot issues: 0
Past year bot pull requests: 0

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/alibaba/rtp-llm

Top Issue Authors

  • samaritan1998 (21)
  • invisifire (7)
  • frankang (4)
  • Greatpanc (3)
  • liucw2012 (3)
  • cwlseu (3)
  • xinge666 (2)
  • Lzhang-hub (2)
  • skmkt (2)
  • zf761 (2)
  • Vincent131499 (2)
  • FelixZhang7 (1)
  • yato1997 (1)
  • leyiwang (1)
  • supercocoa (1)

Top Pull Request Authors

  • feifei14119 (17)
  • Proton02 (15)
  • wht21 (12)
  • Reyfone (12)
  • jianglan89 (10)
  • wenhuanh (10)
  • LLLLKKKK (9)
  • TianyuLi0 (9)
  • baowendin (8)
  • gujingit (6)
  • wanglining97 (5)
  • BCeZn (5)
  • xiangze-arm (4)
  • MMadhatter (3)
  • Vinkle-hzt (2)

Top Issue Labels

Top Pull Request Labels

  • enhancement (1)

Dependencies

open_source/deps/requirements_torch_gpu.txt pypi
  • Pillow *
  • cpm_kernels *
  • dacite *
  • einops *
  • fastapi ==0.108.0
  • filelock *
  • importlib_metadata *
  • jinja2 *
  • lru-dict *
  • matplotlib *
  • numpy ==1.24.1
  • prettytable *
  • protobuf ==3.20.0
  • psutil *
  • py-spy *
  • pydantic >=2.5.3
  • pynvml *
  • pyodps *
  • safetensors *
  • sentencepiece ==0.1.99
  • sympy *
  • thrift *
  • tiktoken ==0.4.0
  • torchvision ==0.16.0
  • transformers ==4.33.1
  • typing-extensions *
  • uvicorn ==0.21.1
open_source/deps/requirements_torch_gpu_cuda12.txt pypi
  • Pillow *
  • cpm_kernels *
  • dacite *
  • einops *
  • fastapi ==0.108.0
  • filelock *
  • importlib_metadata *
  • jinja2 *
  • lru-dict *
  • matplotlib *
  • numpy ==1.24.1
  • prettytable *
  • protobuf ==3.20.0
  • psutil *
  • py-spy *
  • pydantic >=2.5.3
  • pynvml *
  • pyodps *
  • safetensors *
  • sentencepiece ==0.1.99
  • sympy *
  • thrift *
  • tiktoken ==0.4.0
  • torchvision ==0.16.0
  • transformers ==4.33.1
  • typing-extensions *
  • uvicorn ==0.21.1
open_source/deps/requirements_base.txt pypi
  • Pillow *
  • cpm_kernels *
  • dacite *
  • einops *
  • fastapi ==0.108.0
  • filelock *
  • importlib_metadata *
  • jinja2 *
  • lru-dict *
  • matplotlib *
  • numpy ==1.24.1
  • prettytable *
  • protobuf ==3.20.0
  • psutil *
  • py-spy *
  • pydantic ==2.5.3
  • pynvml *
  • pyodps *
  • safetensors *
  • sentencepiece ==0.1.99
  • sympy *
  • thrift *
  • tiktoken ==0.4.0
  • timm ==0.9.12
  • transformers ==4.33.1
  • typing-extensions *
  • uvicorn ==0.21.1
3rdparty/protobuf/Protobuf.podspec cocoapods
3rdparty/protobuf/kokoro/linux/32-bit/Dockerfile docker
  • 32bit/debian latest build
3rdparty/protobuf/kokoro/linux/64-bit/Dockerfile docker
  • debian latest build
3rdparty/protobuf/kokoro/linux/dockerfile/release/ruby_rake_compiler/Dockerfile docker
  • grpctesting/rake-compiler-dock_53c22085d091183c528303791e7771359f699bcf latest build
3rdparty/protobuf/kokoro/linux/dockerfile/test/cpp_tcmalloc/Dockerfile docker
  • debian jessie build
3rdparty/protobuf/kokoro/linux/dockerfile/test/csharp/Dockerfile docker
  • debian stretch build
3rdparty/protobuf/kokoro/linux/dockerfile/test/javascript/Dockerfile docker
  • ubuntu latest build
3rdparty/protobuf/kokoro/linux/dockerfile/test/php/Dockerfile docker
  • debian jessie build
3rdparty/protobuf/kokoro/linux/dockerfile/test/php_32bit/Dockerfile docker
  • 32bit/debian jessie build
3rdparty/protobuf/kokoro/linux/dockerfile/test/python_jessie/Dockerfile docker
  • debian jessie build
3rdparty/protobuf/kokoro/linux/dockerfile/test/python_stretch/Dockerfile docker
  • debian stretch build
3rdparty/protobuf/kokoro/linux/dockerfile/test/ruby/Dockerfile docker
  • debian jessie build
3rdparty/protobuf/protoc-artifacts/Dockerfile docker
  • centos 6.9 build
3rdparty/protobuf/python/release/wheel/Dockerfile docker
  • quay.io/pypa/manylinux1_x86_64 latest build
3rdparty/protobuf/benchmarks/java/pom.xml maven
  • com.google.caliper:caliper 1.0-beta-2
  • com.google.protobuf:protobuf-java ${protobuf.version} system
3rdparty/protobuf/java/bom/pom.xml maven
3rdparty/protobuf/java/compatibility_tests/v2.5.0/deps/pom.xml maven
  • junit:junit 4.4
  • org.easymock:easymock 2.2
  • org.easymock:easymockclassextension 2.2.1
3rdparty/protobuf/java/compatibility_tests/v2.5.0/more_protos/pom.xml maven
  • com.google.protobuf.compatibility:compatibility-protos 2.5.0
  • com.google.protobuf:protobuf-java ${more_protos.protobuf.version}
3rdparty/protobuf/java/compatibility_tests/v2.5.0/pom.xml maven
3rdparty/protobuf/java/compatibility_tests/v2.5.0/protos/pom.xml maven
  • com.google.protobuf:protobuf-java ${protos.protobuf.version}
3rdparty/protobuf/java/compatibility_tests/v2.5.0/tests/pom.xml maven
  • com.google.protobuf.compatibility:compatibility-more-protos 2.5.0
  • com.google.protobuf.compatibility:compatibility-protos 2.5.0
  • com.google.protobuf:protobuf-java ${tests.protobuf.version}
  • junit:junit 4.4
  • org.easymock:easymock 2.2
  • org.easymock:easymockclassextension 2.2.1
3rdparty/protobuf/java/core/pom.xml maven
  • com.google.guava:guava test
  • junit:junit test
  • org.easymock:easymock test
  • org.easymock:easymockclassextension test
3rdparty/protobuf/java/lite/pom.xml maven
  • com.google.guava:guava test
  • junit:junit test
  • org.easymock:easymock test
  • org.easymock:easymockclassextension test
3rdparty/protobuf/java/pom.xml maven
3rdparty/protobuf/java/util/pom.xml maven
  • com.google.code.gson:gson 2.7
  • com.google.errorprone:error_prone_annotations 2.3.2
  • com.google.guava:guava
  • com.google.protobuf:protobuf-java
  • junit:junit
  • org.easymock:easymock
  • org.easymock:easymockclassextension
  • com.google.guava:guava-testlib test
3rdparty/protobuf/protoc-artifacts/pom.xml maven
3rdparty/protobuf/ruby/pom.xml maven
  • org.jruby:jruby-complete 1.7.13 provided
  • com.fasterxml.jackson.core:jackson-core 2.4.3
  • com.google.protobuf:protobuf-java 3.0.0
3rdparty/protobuf/js/package.json npm
  • glob ~6.0.4 development
  • google-closure-compiler ~20190301.0.0 development
  • google-closure-library ~20190301.0.0 development
  • gulp ~4.0.1 development
  • jasmine ~2.4.1 development
3rdparty/protobuf/csharp/Google.Protobuf.Tools.nuspec nuget
3rdparty/protobuf/csharp/compatibility_tests/v3.0.0/src/Google.Protobuf.Test/Google.Protobuf.Test.csproj nuget
  • NUnit 3.6.1
  • NUnitLite 3.6.1
3rdparty/protobuf/csharp/src/AddressBook/AddressBook.csproj nuget
3rdparty/protobuf/csharp/src/Google.Protobuf/Google.Protobuf.csproj nuget
  • Microsoft.SourceLink.GitHub 1.0.0-beta2-18618-05 development
  • System.Memory 4.5.2
3rdparty/protobuf/csharp/src/Google.Protobuf.Benchmarks/Google.Protobuf.Benchmarks.csproj nuget
  • BenchmarkDotNet 0.11.4
3rdparty/protobuf/csharp/src/Google.Protobuf.Conformance/Google.Protobuf.Conformance.csproj nuget
3rdparty/protobuf/csharp/src/Google.Protobuf.JsonDump/Google.Protobuf.JsonDump.csproj nuget
3rdparty/protobuf/csharp/src/Google.Protobuf.Test/Google.Protobuf.Test.csproj nuget
  • Microsoft.NET.Test.Sdk 15.5.0
  • NUnit 3.9.0
  • NUnit3TestAdapter 3.9.0
3rdparty/protobuf/composer.json packagist
  • phpunit/phpunit >=4.8.0 development
  • php >=5.5.0
3rdparty/protobuf/php/composer.json packagist
  • phpunit/phpunit ^5|^4.8.0 development
  • php >=5.5.0
3rdparty/protobuf/examples/pubspec.yaml pub
  • protobuf
3rdparty/protobuf/python/compatibility_tests/v2.5.0/setup.py pypi
  • setuptools *
  • six >=1.9
3rdparty/protobuf/python/setup.py pypi
  • setuptools *
  • six >=1.9
open_source/deps/requirements_cpu_arm.txt pypi
open_source/deps/requirements_lock_rocm.txt pypi
  • 117 dependencies
open_source/deps/requirements_lock_torch_arm.txt pypi
  • 114 dependencies
open_source/deps/requirements_lock_torch_cpu.txt pypi
  • 117 dependencies
open_source/deps/requirements_lock_torch_gpu.txt pypi
  • 137 dependencies
open_source/deps/requirements_lock_torch_gpu_cuda12.txt pypi
  • 137 dependencies
open_source/deps/requirements_rocm.txt pypi
  • pyrsmi *
open_source/deps/requirements_torch_cpu.txt pypi
3rdparty/protobuf/ruby/Gemfile rubygems
3rdparty/protobuf/ruby/google-protobuf.gemspec rubygems
  • rake-compiler ~> 0.9.5 development
  • rake-compiler-dock ~> 0.6.0 development
  • rubygems-tasks ~> 0.2.4 development
  • test-unit ~> 3.0, >= 3.0.9 development
.github/workflows/CI-request-trigger.yml actions
  • actions/checkout v4 composite
.github/workflows/merge-request-trigger.yml actions
  • actions/checkout v3 composite
rtp_llm/flexlb/flexlb-api/pom.xml maven
  • com.google.code.gson:gson 2.10.1
  • com.taobao.eagleeye:eagleeye-core
  • org.flexlb:flexlb-sync
  • org.springframework.boot:spring-boot-starter-webflux
  • io.projectreactor:reactor-test test
  • org.mockito:mockito-core test
  • org.powermock:powermock-api-mockito2 test
  • org.powermock:powermock-module-junit4 test
  • org.springframework:spring-test test
rtp_llm/flexlb/flexlb-cache/pom.xml maven
  • com.alibaba:fastjson
  • com.github.ben-manes.caffeine:caffeine
  • com.google.guava:guava
  • com.taobao.monitor:kmonitor-client
  • io.micrometer:micrometer-registry-prometheus
  • io.netty:netty-all ${netty.version}
  • org.apache.commons:commons-collections4 4.4
  • org.apache.commons:commons-lang3
  • org.flexlb:flexlb-common
  • org.jctools:jctools-core 3.3.0
  • org.springframework.boot:spring-boot-starter
  • org.springframework.boot:spring-boot-starter-actuator
  • org.springframework.boot:spring-boot-starter-data-redis-reactive
  • org.springframework.boot:spring-boot-starter-web
  • org.springframework.boot:spring-boot-starter-webflux
  • io.projectreactor:reactor-test test
  • junit:junit ${junit.version} test
  • org.mockito:mockito-core test
  • org.springframework.boot:spring-boot-starter-test test
rtp_llm/flexlb/flexlb-common/pom.xml maven
  • commons-collections:commons-collections 3.2.2 compile
  • org.apache.commons:commons-collections4 4.4 compile
  • org.projectlombok:lombok provided
  • com.alibaba:fastjson
  • com.taobao.eagleeye:eagleeye-core
  • com.taobao.monitor:kmonitor-client
  • com.taobao.vipserver:vipserver-client
  • io.netty:netty-transport
  • io.opentelemetry:opentelemetry-exporter-otlp
  • io.opentelemetry:opentelemetry-sdk
  • org.apache.commons:commons-lang3 3.12.0
  • org.projectlombok:lombok
  • org.springframework.boot:spring-boot-starter-webflux
rtp_llm/flexlb/flexlb-grpc/pom.xml maven
  • com.google.guava:guava
  • com.google.protobuf:protobuf-java ${protobuf.version}
  • com.taobao.vipserver:vipserver-client
  • io.grpc:grpc-all
  • io.grpc:grpc-api
  • io.grpc:grpc-census
  • io.grpc:grpc-context
  • io.grpc:grpc-core
  • io.grpc:grpc-netty
  • io.grpc:grpc-protobuf
  • io.grpc:grpc-services
  • io.grpc:grpc-stub
  • org.flexlb:flexlb-cache
  • org.flexlb:flexlb-common
  • io.grpc:grpc-testing ${grpc.version} test
  • junit:junit ${junit.version} test
  • org.mockito:mockito-core 3.12.4 test
rtp_llm/flexlb/flexlb-sync/pom.xml maven
  • org.projectlombok:lombok provided
  • com.alibaba:fastjson
  • com.github.ben-manes.caffeine:caffeine
  • com.taobao.diamond:diamond-client
  • io.opentelemetry:opentelemetry-exporter-otlp
  • io.opentelemetry:opentelemetry-sdk
  • io.projectreactor:reactor-core
  • org.apache.curator:curator-framework
  • org.apache.curator:curator-recipes
  • org.apache.zookeeper:zookeeper
  • org.flexlb:flexlb-cache
  • org.flexlb:flexlb-common
  • org.flexlb:flexlb-grpc
  • org.slf4j:slf4j-api
  • org.springframework.boot:spring-boot-starter-validation
  • org.springframework.boot:spring-boot-starter-webflux
rtp_llm/flexlb/pom.xml maven
  • com.taobao.csp:sentinel-core 3.9.29
  • io.micrometer:micrometer-registry-prometheus 1.11.0
  • org.projectlombok:lombok
  • org.springframework.boot:spring-boot-configuration-processor
  • org.springframework.boot:spring-boot-starter
  • org.springframework.boot:spring-boot-starter-actuator
  • com.github.kstyrc:embedded-redis 0.6 test
  • com.squareup.okhttp3:mockwebserver 4.11.0 test
  • org.springframework.boot:spring-boot-starter-data-redis test
  • org.springframework.boot:spring-boot-starter-test test
docs/requirements.txt pypi
  • gguf >=0.10.0
  • ipykernel *
  • ipywidgets *
  • jupyter_client *
  • markdown >=3.4.0
  • matplotlib *
  • myst-parser *
  • nbconvert *
  • nbsphinx *
  • nbstripout *
  • pandoc *
  • pillow *
  • pydantic *
  • sphinx *
  • sphinx-autobuild *
  • sphinx-book-theme *
  • sphinx-copybutton *
  • sphinx-intl *
  • sphinx-tabs *
  • sphinxcontrib-mermaid *
  • urllib3 <2.0.0
docs/index/package.json npm
  • @types/react ^18.2.15 development
  • @types/react-dom ^18.2.7 development
  • @vitejs/plugin-react ^4.0.3 development
  • vite ^4.4.5 development
  • background-animations ^0.1.7
  • react ^18.2.0
  • react-dom ^18.2.0