ray-project/llms-in-prod-workshop-2023

Deploy and Scale LLM-based applications

Archived

/ 100

Experimental

No commits in the last 6 months.

Archived Stale 6m No Package No Dependents

Maintenance 0 / 25

Adoption 7 / 25

Maturity 9 / 25

Community 10 / 25

Stars

Forks

Language

Jupyter Notebook

License

Apache-2.0

Category

Last pushed

Jun 15, 2023

Commits (30d)

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/mlops/ray-project/llms-in-prod-workshop-2023"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

bentoml/BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps,...

nndeploy/nndeploy

一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework

kubeflow/trainer

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

cncf/llm-in-action

🤖 Discover how to apply your LLM app skills on Kubernetes!

SohamGovande/podplex

🦾💻🌐 distributed training & serverless inference at scale on RunPod