All Perception Tools

J.A.R.V.I.S: An AI-powered Open Source Intelligence (OSINT) system. It...

⚡ Scrape 1,000 LinkedIn job listings in under a minute with ease. Get fast,...

Python script to scrap deskgram (Deskgram is a desktop version of Instagram)

GroqCrawl is a powerful and user-friendly web crawling and scraping...

This is a tool to bulk download images posted/retweeted from a Twitter...

⚒️ Browser header & fingerprint generator

Auto-updating Nix package for Cursor AI editor with browser automation...

UFC Fights Dataset Collection and Analysis

Open-source web crawler

A web scraper that scrape all the product links, names and prices from...

Asyncio package for scraping major Search Engines, supports pagination and...

An extremely useful tool to download high quality photos from an Airbnb...

This tutorial explains the benefits, pitfalls, and limitations of scraping,...

Cross Platform C# Web crawler framework, headless browser, parallel crawler....

A tool that auto-generates calendar events for Monster Hunter Now by...

This repository will guide you to Automate Python Scripts with GitHub...

DeskIdentity adalah API backend berbasis Django untuk menghasilkan...

小红书数据采集,小红书采集,小红书爬虫,小红书运营,小红书自动化,小红书养号,小红书发布,小红书笔记,小红书评论,小红书数据分析,小红书数据看板,小红书可...

A Vinted monitor to catch the latest items posted and send it to you via discord

:woman: Ruby library for いらすとや

A tool for scraping emails, social media accounts, and much more information...

This is a Python script that downloads all resources (images, scripts,...

:camera: An app to scrap instagram posts and analyze data.

OOP in Python, working with SQL and NOSQL dbs, fetching HTML data

Automated reconnaissance tool for pentest

Scrape data from Instagram without applying for the authenticated API 🎯

Get all the tweets from your favorite twitter accounts.

:card_index: Extract social media profiles and more with regular expressions

Fresh Proxies | Proxied Browser | HTTP/HTTPS/SOCKS4/SOCKS5

The repository containing backend data for the Slack Information Bots for...

Web application hosted on Heroku cloud platform based on web scraping in...

A high-performance HTML5 parser library with CSS selectors and DOM...

Cardmarket Wantlist Wizard 🧙🏼‍♂️🪄 Easily find the sellers with the most...

Scrape and Retrieve FindAGrave memorial page data and save them to an SQL database

Public proxy farm that automatically records and queues suitable proxy...

This program creates a PDF including the original post with graphs of the ...

🕶⏲Watcher for ICBC Web booking

专为跨境电商卖家设计的高效USPS批量物流追踪器。支持数千单号并发查询、代理、防屏蔽，并生成精美Excel报告。Playwright,...

An automated Python bot for checking VFS appointment slots, handling browser...

Generate a network graph of connections from your WhatsApp groups data

Python Scripts and Jupyter Notebooks

Fake news headlines in the Tamil regional language.

Run Python Selenium in GitPod

An open-source framework that allows you to easily monitor your web...

Analysis of GPS interruption data in public domain

HawaiiHub Firecrawl × 火鸟门户 × n8n 的采集与自动化运营仓库

A web crawler for Sina, search and retrieve microblogs that contain certain...

📥 Bot for downloading any media from Instagram, Twitter and videos from...

Download/access photos, videos, stories, story highlights, postlives,...

The most powerful helper class to make human-like actions with Puppeteer

LinkedIn scrapper is advanced search result scrapper script build with...

Wgit enables you to crawl and extract the data you want from the web

Script to fetch webcomics and use them to create ebooks.

A headless browser task/job queue & runner based on Hero (Chrome)

apikey search engine scraping methods

This repository serves as an index for all info the community has gathered...

A simple API for scraping Overwatch stats

Fancaps Downloader

asynchronous Ekşi Sözlük scraper

web spider to scan UR avialbe room and output as csv

GoScrapy: Harnessing Go's power for blazingly fast web scraping, inspired by...

An interface for viewing different problem statements of smart india...

Save web pages as Safari webarchive files from the command line

A web crawling framework implemented in Golang, it is simple to write and...

This is a tiny yet powerful project designed to monitor websites for...

Automated embassy appointment slot monitor with Telegram notifications....

Скрипт для сбора треков из плейлистов Яндекс Музыки через DevTools Console....

🕸️ JavSpider Stack: Comprehensive metadata scraper & local management suite....

Web scraper based on Scrapy to fetch tweets from a list of user accounts

✨ NodeJs crawling & scraping framework heavily inspired by Scrapy

This is a project of build knowledge graph course. The project leverages...

Dataset and scripts for scraping the news articles from popular sources...

DOM Based Content Extraction via Text Density

Sending Emails with Python

Instagram reel and posts downloader

A JailTracker Tracker: monitoring the treatment of people incarcerated in US jails

This program scrapes Amazon to get book data (the ISBN, title, author,...

Nim library for querying HTML using CSS-selectors (like JavaScripts...

A simple web API for acquiring media streams from a couple of service providers

The DSE Company Scraper is a Python program that extracts data from the...

A Kotlin multiplatform HTML5 parsing library

Automated e-commerce orchestrator built with .NET 8, featuring Shopify API...

WebSource Harvester is an educational web-source harvester that crawls a...

Download images from reddit

Plug any machine into Epiral Agent — shell, files, and browser control in one binary

Browser automation, annotation & DOM interaction tool for AI agents....

A Twitter/X scraper built with Playwright for browser automation and OpenAI...

A curated list of awesome puppeteer resources.

A JavaScript Link Crawler you can inject in the browser.

Amazon products scraper with using of rotating proxies and headless Chrome...

The Scripting Engine that Combines Speed, Safety, and Simplicity

Scraps the search results and generates a JSON file to store the...

Lead generation pipeline for finding potential commercial real estate...

A dataset of cat images scraped from Bing.

Python script to scrape Instagram network

A set of NCCU Course scripts

两个文件实现的轻量化浏览器 agent。简单、开源、基于 Playwright

Final Year project, scraping data of e-commerce stores and display in ReactJS app.

Gazzette API with scraped data from Gazzette website.

(test-)framework agnostic utilities to test real styling of (virtual) dom elements