llami-team/gpt-torch

Compress the HTML as much as possible for LLM to inference.

/ 100

Experimental

This tool helps prepare web page content for analysis by large language models. It takes raw HTML from any website and outputs a cleaner, more focused version, highlighting the key structural and textual elements. It's designed for anyone who needs to feed web data into AI for tasks like summarization, content extraction, or sentiment analysis.

No commits in the last 6 months.

Use this if you are working with large language models and need to reduce the noise and size of HTML web pages to improve model performance and reduce processing costs.

Not ideal if you need to display or render the HTML, as it extensively modifies the original structure and removes visual elements.

AI-content-preparation web-data-for-LLM text-extraction AI-model-input content-optimization

No License Stale 6m No Package No Dependents

Maintenance 0 / 25

Adoption 8 / 25

Maturity 8 / 25

Community 0 / 25

How are scores calculated?

Stars

Forks

—

Language

—

License

—

Higher-rated alternatives

Lightning-AI/litgpt

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

liangyuwang/Tiny-DeepSpeed

Tiny-DeepSpeed, a minimalistic re-implementation of the DeepSpeed library

catherinesyeh/attention-viz

Visualizing query-key interactions in language + vision transformers (VIS 2023)

microsoft/Text2Grad

🚀 Text2Grad: Converting natural language feedback into gradient signals for precise model...

huangjia2019/llm-gpt

From classic NLP to modern LLMs: building language models step by step. 异步图书：《 GPT图解大模型是怎样构建的》-...

Explore LLM Tools

All categories Trending LLM Tool directory Insights