awesome-llama: https://github.com/aws-samples/amazon-sagemaker-llama2-response-streaming-recipes

large-language-models large-model-inference llama2 response-streaming sagemaker sagemaker-endpoint text-generation-inference

Score: 3.6635616461296463

Last synced: about 6 hours ago
JSON representation

Repository metadata:

Amazon SageMaker Llama 2 Inference via Response Streaming

• Host: GitHub
• URL: https://github.com/aws-samples/amazon-sagemaker-llama2-response-streaming-recipes
• Owner: aws-samples
• License: mit-0
• Created: 2023-10-11T03:13:25.000Z (over 2 years ago)
• Default Branch: main
• Last Pushed: 2024-06-28T17:24:14.000Z (almost 2 years ago)
• Last Synced: 2025-11-16T06:03:50.371Z (7 months ago)
• Topics: large-language-models, large-model-inference, llama2, response-streaming, sagemaker, sagemaker-endpoint, text-generation-inference
• Language: Jupyter Notebook
• Homepage: https://aws.amazon.com/blogs/machine-learning/inference-llama-2-models-with-real-time-response-streaming-using-amazon-sagemaker/
• Size: 565 KB
• Stars: 13
• Watchers: 2
• Forks: 4
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • Contributing: CONTRIBUTING.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md

---

Owner metadata:

• Name: AWS Samples
• Login: aws-samples
• Email:
• Kind: organization
• Description:
• Website: https://amazon.com/aws
• Location:
• Twitter:
• Company:
• Icon url: https://avatars.githubusercontent.com/u/8931462?v=4
• Repositories: 6789
• Last Synced at: 2025-06-05T08:13:20.294Z
• Profile URL: https://github.com/aws-samples

---

GitHub Events

Total

• Fork event: 1
• Total: 1

Last Year

• Fork event: 1
• Total: 1

---

Committers metadata

Last synced: 7 months ago

Name	Email	Commits
नवुले पवन कुमार राव	1****n	20
Madhur Prashant	1****h	1
Amazon GitHub Automation	5****o	1

---

Issue and Pull Request metadata

Last synced: 10 months ago

More stats: https://issues.ecosyste.ms/repositories/lookup?url=https://github.com/aws-samples/amazon-sagemaker-llama2-response-streaming-recipes

---

---