xusenlinzy/api-for-open-llm

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

47
/ 100
Emerging

2,468 stars. No commits in the last 6 months.

Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 10 / 25
Maturity 16 / 25
Community 21 / 25

How are scores calculated?

Stars

2,468

Forks

276

Language

Python

License

Apache-2.0

Category

multilingual-llm-adaptation

Last pushed

Sep 26, 2024

Commits (30d)

0

GitHub
Multilingual LLM Adaptation · 91 models

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/xusenlinzy/api-for-open-llm"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

lyogavin/airllm

AirLLM 70B inference with single 4GB GPU

83

shibing624/MedicalGPT

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline....

65

GradientHQ/parallax

Parallax is a distributed model serving framework that lets you build your own AI cluster anywhere

60

CrazyBoyM/llama3-Chinese-chat

Llama3、Llama3.1 中文后训练版仓库 - 微调、魔改版本有趣权重 & 训练、推理、评测、部署教程视频 & 文档。

55

MediaBrain-SJTU/MING

明医 (MING)：中文医疗问诊大模型

49

Explore Transformer Models

All categories Trending Transformer directory Insights