deBUGger404/Scrape-AI
Scrape-AI is a Python library for intelligent web scraping using LLMs like, OpenAI, Anthropicand Selenium. It dynamically fetches data based on user queries, enabling agent-like scraping with configurable models, modular design, and support for real-time data extraction from dynamic websites.
No commits in the last 6 months.
Stars
6
Forks
3
Language
Python
License
MIT
Last pushed
Sep 08, 2024
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/deBUGger404/Scrape-AI"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
openai/openai-python
The official Python library for the OpenAI API
pydantic/pydantic
Data validation using Python type hints
cohere-ai/cohere-python
Python Library for Accessing the Cohere API
openai/tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
groq/groq-python
The official Python Library for the Groq API