All Perception Tools
10,528 tools ranked by quality score · Page 2 of 106
| # | Tool | Score | Tier |
|---|---|---|---|
| 101 |
Panniantong/Agent-Reach
Give your AI agent eyes to see the entire internet. Read & search Twitter,... |
|
Established |
| 102 |
JuroOravec/crawlee-one
Production-ready web scraping in a single function call. Built on Crawlee. |
|
Established |
| 103 |
EchterAlsFake/missAV_api
Unofficial Python client for missav.ws: search, metadata extraction, and... |
|
Established |
| 104 |
daijro/camoufox
🦊 Anti-detect browser |
|
Established |
| 105 |
john-doherty/selenium-cucumber-js
Browser automation framework written in pure JavaScript using official... |
|
Established |
| 106 |
Hyper-Solutions/hyper-sdk-py
Python SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada,... |
|
Established |
| 107 |
ivan-sincek/scrapy-scraper
Web crawler and scraper based on Scrapy and Playwright's headless browser. |
|
Established |
| 108 |
MarginaliaSearch/MarginaliaSearch
Internet search engine for text-oriented websites. Indexing the small, old... |
|
Established |
| 109 |
EchterAlsFake/xhamster_api
a Python API for xhamster.com using web-scraping to provide an easy to use interface |
|
Established |
| 110 |
City-Bureau/city-scrapers
Scrape, standardize and share public meetings from local government websites |
|
Established |
| 111 |
HarryShomer/Hockey-Scraper
Python Package for scraping NHL Play-by-Play and Shift data |
|
Established |
| 112 |
ArchiveBox/abx-dl
⬇️ A simple all-in-one CLI tool to download EVERYTHING from a URL (like... |
|
Established |
| 113 |
minhlucvan/n8n-nodes-browserless
n8n node to interact with browserless instance |
|
Established |
| 114 |
PhialsBasement/LibreCrawl
Free desktop SEO crawler - open source alternative to Screaming Frog and... |
|
Established |
| 115 |
EchterAlsFake/EPorner_API
Unofficial Python client for EPorner.com: search, metadata extraction, and... |
|
Established |
| 116 |
lorien/awesome-web-scraping
List of libraries, tools and APIs for web scraping and data processing. |
|
Established |
| 117 |
jocmp/mercury-parser
Extract meaningful content from the chaos of a web page |
|
Established |
| 118 |
DavidWittman/requests-random-user-agent
Configures the requests library to randomly select a desktop User-Agent |
|
Established |
| 119 |
nuhmanpk/WebScrapper
Powerful Telegram bot for web scraping and crawling. Fast, easy, and loved... |
|
Established |
| 120 |
snooppr/snoop
Snoop — инструмент разведки на основе открытых данных (OSINT world) |
|
Established |
| 121 |
EchterAlsFake/hqporner_api
Unofficial Python client for hqporner.com: search, metadata extraction, and... |
|
Established |
| 122 |
mawrkus/jason-the-miner
⛏ A versatile Web scraper for Node.js |
|
Established |
| 123 |
yuanxu-li/html-table-extractor
extract data from html table |
|
Established |
| 124 |
httptoolkit/browser-launcher
Detect the browser versions available on your system, and launch them in an... |
|
Established |
| 125 |
haxsysgit/autopahe
Automatically download all your favorite anime from AnimePahe |
|
Established |
| 126 |
sangaline/wayback-machine-scraper
A command-line utility and Scrapy middleware for scraping time series data... |
|
Established |
| 127 |
ispras/web-scraper-chrome-extension
Web data extraction tool implemented as chrome extension |
|
Established |
| 128 |
apify/fingerprint-suite
Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify. |
|
Established |
| 129 |
anilabhadatta/educative.io_scraper
Educative.io Course Downloader developed using Python and Selenium. Refer... |
|
Established |
| 130 |
Norconex/crawlers
Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for... |
|
Established |
| 131 |
daijro/hrequests
🚀 Web scraping for humans |
|
Established |
| 132 |
apify/actor-scraper
House of Apify Scrapers. Generic scraping actors with a simple UI to handle... |
|
Established |
| 133 |
yujiosaka/headless-chrome-crawler
Distributed crawler powered by Headless Chrome |
|
Established |
| 134 |
daniel-hauser/moneyman
Automatically save transactions from all major Israeli banks and credit card... |
|
Established |
| 135 |
clemfromspace/scrapy-puppeteer
Scrapy + Puppeteer |
|
Established |
| 136 |
JettChenT/scan-for-webcams
scan for webcams on the internet |
|
Established |
| 137 |
nice-digital/wdio-cucumber-steps
Shared step definitions for Cucumber JS BDD tests in WebdriverIO |
|
Established |
| 138 |
sangaline/scrapy-wayback-machine
A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine. |
|
Established |
| 139 |
Tomas2D/puppeteer-table-parser
Scrape and parse HTML tables with the Puppeteer table parser. |
|
Established |
| 140 |
spyoungtech/behave-webdriver
Selenium webdriver step library for use with the behave BDD testing framework |
|
Established |
| 141 |
axsddlr/vlrggapi
An Unofficial REST API for vlr.gg, a site for Valorant Pro Esports match... |
|
Established |
| 142 |
digitalmethodsinitiative/4cat
The 4CAT Capture and Analysis Toolkit provides modular data capture &... |
|
Established |
| 143 |
ing-bank/INGenious
INGenious Playwright Studio |
|
Established |
| 144 |
jikan-me/jikan-rest
The REST API for Jikan |
|
Established |
| 145 |
ScriptSmith/socialreaper
Social media scraping / data collection library for Facebook, Twitter,... |
|
Established |
| 146 |
niklak/dom_query
A Flexible Rust Crate for DOM Querying and Manipulation |
|
Established |
| 147 |
apache/nutch
Apache Nutch is an extensible and scalable web crawler |
|
Established |
| 148 |
crawler-commons/crawler-commons
A set of reusable Java components that implement functionality common to any... |
|
Established |
| 149 |
juancarlospaco/faster-than-requests
Faster requests on Python 3 |
|
Established |
| 150 |
maxhumber/gazpacho
🥫 The simple, fast, and modern web scraping library |
|
Established |
| 151 |
BITS-Rohit/CamouChat
CamouChat : A stealth-first Python SDK for cross-platform messaging... |
|
Established |
| 152 |
champmq/TheScrapper
Scrape emails, phone numbers and social media accounts from a website. |
|
Established |
| 153 |
EchterAlsFake/spankbang_api
A Python API for the porn site spankbang.com |
|
Established |
| 154 |
sananth12/ImageScraper
:scissors: High performance, multi-threaded image scraper |
|
Established |
| 155 |
sb0y/warp_beacon
Telegram bot that downloads content from YouTube, Instagram and X (Twitter) |
|
Established |
| 156 |
shaikhsajid1111/twitter-scraper-selenium
Python's package to scrap Twitter's front-end easily |
|
Established |
| 157 |
thisisparker/xword-dl
▞ Command line tool to scrape crosswords from online solvers and save them... |
|
Established |
| 158 |
sqdshguy/wreq-js
HTTP client for Node.js with browser TLS fingerprint impersonation |
|
Established |
| 159 |
OWASP/D4N155
OWASP D4N155 - Intelligent and dynamic wordlist using OSINT |
|
Established |
| 160 |
City-Bureau/city-scrapers-template
Template for creating a City Scrapers project in your area |
|
Established |
| 161 |
daneads/pypatent
Search for and retrieve US Patent and Trademark Office Patent Data |
|
Established |
| 162 |
hmasdev/pyjpboatrace
pyjpboatrace :speedboat: provides you with useful tools for data analysis... |
|
Established |
| 163 |
mov-cli/mov-cli
Watch everything from your terminal. |
|
Established |
| 164 |
hyperbrowserai/examples
Examples for using Hyperbrowser |
|
Established |
| 165 |
crawlab-team/crawlab
Distributed web crawler admin platform for spiders management regardless of... |
|
Established |
| 166 |
skernelx/tavily-key-generator
Multi-service toolkit for Tavily and Firecrawl signup automation, key... |
|
Established |
| 167 |
scrapehero/selectorlib
A library to read a YML file with Xpath or CSS Selectors and extract data... |
|
Established |
| 168 |
brandon93s/html-table-to-json
Generate JSON representations of HTML tables |
|
Established |
| 169 |
ivan-sincek/file-scraper
Scrape files for sensitive information, and generate an interactive HTML... |
|
Established |
| 170 |
brendonboshell/supercrawler
A web crawler. Supercrawler automatically crawls websites. Define custom... |
|
Established |
| 171 |
wael-sudo2/facebook-page-info-scraper
Free Facebook pages MetaData Scraping Library - Unlimited Calls |
|
Established |
| 172 |
Madi-S/Lead-Generation
Python script, which empowers people with no programming background to... |
|
Established |
| 173 |
pavanad/emec-api
API Python para consulta na base de dados oficial do e-MEC |
|
Established |
| 174 |
viu-media/viu
Your browser anime experience from the terminal |
|
Established |
| 175 |
rike422/kirinuki-core
Kirinuki is a library that convert any html to JSON using CSS selectors. |
|
Established |
| 176 |
rebrowser/rebrowser-playwright-python
A drop-in replacement for playwright-python patched with rebrowser-patches.... |
|
Established |
| 177 |
adryfish/fingerprint-chromium
An open source fingerprint browser based on Ungoogled Chromium. 指纹浏览器 隐私浏览器 |
|
Established |
| 178 |
snooppr/shotstars
An advanced tool for checking GitHub repositories, with star statistics,... |
|
Established |
| 179 |
34j/cached-historical-data-fetcher
Python utility for fetching any historical data using caching. Suitable for... |
|
Established |
| 180 |
php-embed/Embed
Get info from any web service or page |
|
Established |
| 181 |
PKHarsimran/website-downloader
Website-downloader is a powerful and versatile Python script designed to... |
|
Established |
| 182 |
AndyTheFactory/newspaper4k
📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles,... |
|
Established |
| 183 |
TheGP/untidetect-tools
List of anti-detect and humanizing tools and browsers, including captcha... |
|
Established |
| 184 |
ryanirl/CraigslistScraper
Simple webscraper for Craigslist. |
|
Established |
| 185 |
lorey/socials
👨👩👦 Python library and CLI to turn URLs into structured social media profiles. |
|
Established |
| 186 |
david96182/ninjemail
Python library for automated email account creation. Create multiple... |
|
Established |
| 187 |
fluquid/extract-social-media
Extract social media links and account names from websites. |
|
Established |
| 188 |
jurismarches/chopper
Chopper is a tool to extract elements from HTML by preserving ancestors and CSS rules |
|
Established |
| 189 |
internetarchive/Zeno
State-of-the-art web crawler 🔱 |
|
Established |
| 190 |
TheQmaks/justapk
Download any APK by package name. 6 sources, automatic fallback, Cloudflare... |
|
Established |
| 191 |
vifreefly/kimuraframework
Write web scrapers in Ruby using a clean, AI-assisted DSL. Kimurai uses AI... |
|
Established |
| 192 |
code4craft/webmagic
A scalable web crawler framework for Java. |
|
Established |
| 193 |
sebastiancarlos/beachpatrol
🏝️ A CLI Tool to Automate Your Everyday Web Browser. |
|
Established |
| 194 |
kastaid/getter
A powerful and customizable Telegram userbot built with Telethon |
|
Established |
| 195 |
Magic-Fish-Labs/Ecole-Directe-Plus
A better EcoleDirecte (unaffiliated): more pleasant, functional, and... |
|
Established |
| 196 |
Prem-ium/Auto-StockTrader
📈 Automate Stock orders for Fidelity, Chase, Vanguard, Schwab, & more across... |
|
Established |
| 197 |
lkuffo/web-scraping
Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium... |
|
Established |
| 198 |
ZoranPandovski/BookingScraper
:earth_americas: :hotel: Scrape Booking.com :hotel: :earth_americas: |
|
Established |
| 199 |
spyboy-productions/omnisci3nt
Omnisci3nt is an open-source web reconnaissance and intelligence tool for... |
|
Established |
| 200 |
lisc-tools/lisc
Literature Scanner: Automated collection & analyses of the scientific literature. |
|
Established |