Llm Inference Engines Vector Databases

There are 2 llm inference engines tools tracked. 1 score above 50 (established tier). The highest-rated is rapidsai/cuvs at 69/100 with 646 stars. 1 of the top 10 are actively maintained.

Get all 2 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=vector-db&subcategory=llm-inference-engines&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Tool Score Tier
1 rapidsai/cuvs

cuVS - a library for vector search and clustering on the GPU

69
Established
2 Scottcjn/ram-coffers

RAM Coffers: Conditional Memory via NUMA-Distributed Weight Banking - O(1)...

48
Emerging