LlamaFactory and h2o-llmstudio
These two tools are competitors, with LlamaFactory providing a more comprehensive and academically recognized framework for fine-tuning a wider range of models, while H2O LLM Studio offers a user-friendly, no-code GUI primarily for LLM fine-tuning.
About LlamaFactory
hiyouga/LlamaFactory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Supports modular fine-tuning approaches including supervised fine-tuning, reward modeling, and reinforcement learning methods (PPO, DPO, KTO, ORPO), with optimizations like Flash Attention, quantized LoRA, and advanced optimizers (GaLore, BAdam, Muon). Provides both CLI and Gradio web interface for model training and inference, integrating with vLLM/SGLang for OpenAI-compatible API deployment.
About h2o-llmstudio
h2oai/h2o-llmstudio
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
Related comparisons
Scores updated daily from GitHub, PyPI, and npm data. How scores work