All Perception Tools

Scrapy, a fast high-level web crawling & scraping framework for Python.

🌐 Make websites accessible for AI agents. Automate tasks online with ease.

APIs for browser automation, testing, and bypassing bot-detection.

🕷️ An adaptive Web Scraping framework that handles everything from a single...

🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or...

Python binding for curl-impersonate fork via cffi. A http client that can...

🕵️‍♂️ Collect a dossier on a person by username from 3000+ sites

Crawlee—A web scraping and browser automation library for Node.js to build...

Undetected version of the Playwright testing and automation library.

A simple and unlimited twitter scraper : scrape tweets, likes, retweets,...

The All in One Framework to Build Undefeatable Scrapers

Twitter API Scraper | Without an API key | Twitter Internal API | Free |...

Google Search Results via SERP API pip Python Package

NBA Stats API via Basketball Reference

Crawlee—A web scraping and browser automation library for Python to build...

A JavaScript library for generating random user agents with data that's...

The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots,...

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

Scrapy Extension for monitoring spiders execution.

Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS...

An ergonomic Python HTTP Client with TLS fingerprint

Undetected Python version of the Playwright testing and automation library.

A lightweight API for Pornhub

Broken link checker that crawls websites and validates links. Find broken...

Web scraping Page Objects core library

Python package for scraping real estate property data

🎭 Intelligent browser header & fingerprint generator

The library provides convenient access to the Outscraper API from...

Extract structured data from Shopify websites.

Undetected web-scraping & seamless HTML parsing in Python!

Up-to-date simple useragent faker with real world database

Finviz analysis python library.

Lightweight scraper for Google News

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

A Python 3 interface for working with Geocaching.com website.

procyclingstats scraper

Lighter web automation with Python

n8n node for browser automation using Puppeteer

A simple library to scrape Pinterest images.

100% free and full open-source edge Firecrawl alternative with better links...

Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation...

HTTP client that can impersonate web browsers

modular service framework to move and transform network packets

Go HTTP client with browser-identical TLS/HTTP2 fingerprinting. Bypass bot...

A command-line utility for taking automated screenshots of websites

Apify API client for Python

Scrape Facebook public pages without an API key

A Python-based web scraper for NCAA basketball.

🔥 The open-source no-code platform for web scraping, crawling, search and AI...

MetaData html scraper and parser for Node.js (supports Promises only)

Automate browser based workflows with AI

Automatically archive links to videos, images, and social media content from...

Capmonster.cloud library for Python3

Pydoll is a library for automating chromium-based browsers without a...

An API to scrape American court websites for metadata.

Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

A powerful browser assistant for vibe surfing 一个开源的AI浏览器智能助手

Common utilities for wreq

Lightpanda: the headless browser designed for AI and automation

A python app designed to scrape and process sports betting data directly...

scrape data from Google Maps. Extracts data such as the name, address,...

Core functionality for City Scrapers projects

SEO python scraper to extract data from major searchengine result pages....

Declarative web scraping

A scalable, mature and versatile web crawler based on Apache Storm

❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for...

Scrapes facebook's pages front end with no limitations & provides a feature...

Zyte API integration for Scrapy

Best and simplest tool for website change detection, web page monitoring,...

This Python application is an OSINT (Open Source Intelligence) tool called...

Unofficial Python client for xvideos.com: search, metadata extraction, and...

Web Scraping Framework

Creating Scrapy scrapers via the Django admin interface

Random User-Agent middleware based on fake-useragent

The undetected self-hosted browser automation platform. Powered by Camoufox...

ptt-crawler is a web crawler module designed to scarpe data from Ptt.

Unofficial Python client for xnxx.com: search, metadata extraction, and...

Simple Python library to scrape email addresses from HTML

Give your AI agent eyes to see the entire internet. Read & search Twitter,...

Small Python package to request listings & users from marktplaats.nl

Unleash Metadata Intelligence with MetaDetective. Your Assistant Beyond Metagoofil.

Dynamic page objects for browser end-to-end testing.

High-performance browser automation bridge and multi-instance orchestrator...

Lightweight web scraping toolkit for documents and structured data.

🦊 Anti-detect browser

Unofficial Python client for missav.ws: search, metadata extraction, and...

Scalable Python web scraping scripts for +40 popular domains

The simplest demo of chrome automation by python and selenium in AWS Lambda

a Python API for xhamster.com using web-scraping to provide an easy to use interface

Python Package for scraping NHL Play-by-Play and Shift data

Python SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada,...

Web crawler and scraper based on Scrapy and Playwright's headless browser.

Browser automation framework written in pure JavaScript using official...

Advanced Privacy Browser Core with Unified Fingerprint Defense: Cloudflare,...

extract data from html table

Configures the requests library to randomly select a desktop User-Agent

⛏ A versatile Web scraper for Node.js

a base networking component for EchterAlsFake's Porn APIs

Unofficial Python client for hqporner.com: search, metadata extraction, and...

Automatically download all your favorite anime from AnimePahe