llm-connector and llmserver-rs

llm-connector
52
Established
llmserver-rs
41
Emerging
Maintenance 10/25
Adoption 12/25
Maturity 15/25
Community 15/25
Maintenance 10/25
Adoption 6/25
Maturity 8/25
Community 17/25
Stars: 13
Forks: 4
Downloads: 782
Commits (30d): 0
Language: Rust
License: MIT
Stars: 19
Forks: 8
Downloads: —
Commits (30d): 0
Language: Rust
License: —
No Package No Dependents
No License No Package No Dependents

About llm-connector

lipish/llm-connector

LLM Connector - A unified interface for connecting to various Large Language Model providers

This is a tool for developers who integrate Large Language Models (LLMs) into their applications. It takes your application's prompts and requests and translates them into the specific formats required by different LLM providers like OpenAI or Anthropic, providing a consistent way to interact with various services. Developers use this to streamline connecting their software to different AI models.

API integration backend development software development AI application development LLM orchestration

About llmserver-rs

darkautism/llmserver-rs

A Rust-based, OpenAI-style API server for large language models (LLMs)

This project helps developers and engineers integrate large language models (LLMs) into their applications, particularly on devices powered by the RK3588 chip. It takes raw text or audio input and, using an OpenAI-compatible API, outputs text responses from the LLM or transcriptions from audio. This tool is for those building AI-powered features for applications running on specific hardware.

LLM deployment edge AI application development speech recognition hardware integration

Related comparisons

llm-connector and llm_client llm-connector and llm llm-connector and liter-llm llm-connector and llm-lsp

Scores updated daily from GitHub, PyPI, and npm data. How scores work