di37/LLM-Load-Unload-Ollama

This is a simple demonstration to show how to keep an LLM loaded for prolonged time in the memory or unloading the model immediately after inferencing when using it via Ollama.

12
/ 100
Experimental

No commits in the last 6 months.

No License Stale 6m No Package No Dependents
Maintenance 0 / 25
Adoption 5 / 25
Maturity 1 / 25
Community 6 / 25

How are scores calculated?

Stars

13

Forks

1

Language

Jupyter Notebook

License

—

Category

llm-frameworks-libraries

Last pushed

May 04, 2024

Commits (30d)

0

GitHub
Llm Frameworks Libraries · 50 models

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/transformers/di37/LLM-Load-Unload-Ollama"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

NX-AI/xlstm

Official repository of the xLSTM.

70

DashyDashOrg/pandas-llm

Pandas-LLM

56

sinanuozdemir/oreilly-hands-on-gpt-llm

Mastering the Art of Scalable and Efficient AI Model Deployment

52

wxhcore/bumblecore

An LLM training framework built from the ground up, featuring a custom BumbleBee architecture...

49

MiniMax-AI/MiniMax-01

The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model &...

48

Explore Transformer Models

All categories Trending Transformer directory Insights