oriolrius/sagemaker-llm-endpoint

Deploy HuggingFace LLMs on AWS SageMaker with vLLM, OpenAI-compatible API (Lambda + API Gateway), and OpenWebUI chat interface. Default: Qwen2.5-1.5B-Instruct.

15
/ 100
Experimental
No License No Package No Dependents
Maintenance 13 / 25
Adoption 1 / 25
Maturity 1 / 25
Community 0 / 25

How are scores calculated?

Stars

1

Forks

—

Language

Shell

License

—

Category

llm-inference-serving

Last pushed

Mar 25, 2026

Commits (30d)

0

GitHub
LLM Inference Serving · 72 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/oriolrius/sagemaker-llm-endpoint"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

thu-pacman/chitu

High-performance inference framework for large language models, focusing on efficiency,...

85

sophgo/LLM-TPU

Run generative AI models in sophgo BM1684X/BM1688

60

NotPunchnox/rkllama

Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning...

60

Deep-Spark/DeepSparkHub

DeepSparkHub selects hundreds of application algorithms and models, covering various fields of...

56

tomdyson/microllama

The smallest possible LLM API

52

Explore LLM Tools

All categories Trending LLM Tool directory Insights