Scraper Perception Tools

There are 8278 scraper tools tracked. 36 score above 70 (verified tier). The highest-rated is scrapy/scrapy at 97/100 with 60,973 stars and 3,013,707 monthly downloads. 7 of the top 10 are actively maintained.

Get all 8278 projects as JSON

curl "https://pt-edge.onrender.com/api/v1/datasets/quality?domain=perception&subcategory=scraper&limit=20"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

# Tool Score Tier
1 scrapy/scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

97
Verified
2 lexiforest/curl_cffi

Python binding for curl-impersonate fork via cffi. A http client that can...

89
Verified
3 soxoj/maigret

🕵️‍♂️ Collect a dossier on a person by username from 3000+ sites

88
Verified
4 Altimis/Scweet

A simple and unlimited twitter scraper : scrape tweets, likes, retweets,...

84
Verified
5 omkarcloud/botasaurus

The All in One Framework to Build Undefeatable Scrapers

84
Verified
6 d60/twikit

Twitter API Scraper | Without an API key | Twitter Internal API | Free |...

83
Verified
7 serpapi/google-search-results-python

Google Search Results via SERP API pip Python Package

82
Verified
8 jaebradley/basketball_reference_web_scraper

NBA Stats API via Basketball Reference

81
Verified
9 scrapy/parsel

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

78
Verified
10 scrapinghub/spidermon

Scrapy Extension for monitoring spiders execution.

77
Verified
11 rushter/selectolax

Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS...

77
Verified
12 0x676e67/wreq-python

An ergonomic Python HTTP Client with TLS fingerprint

77
Verified
13 EchterAlsFake/PHUB

A lightweight API for Pornhub

76
Verified
14 JustinBeckwith/linkinator

Broken link checker that crawls websites and validates links. Find broken...

76
Verified
15 scrapinghub/web-poet

Web scraping Page Objects core library

76
Verified
16 ZacharyHampton/HomeHarvest

Python package for scraping real estate property data

76
Verified
17 outscraper/outscraper-python

The library provides convenient access to the Outscraper API from...

76
Verified
18 ndgigliotti/shopify-spy

Extract structured data from Shopify websites.

75
Verified
19 jpjacobpadilla/Stealth-Requests

Undetected web-scraping & seamless HTML parsing in Python!

75
Verified
20 fake-useragent/fake-useragent

Up-to-date simple useragent faker with real world database

75
Verified
21 lit26/finvizfinance

Finviz analysis python library.

74
Verified
22 lewisdonovan/google-news-scraper

Lightweight scraper for Google News

74
Verified
23 php-curl-class/php-curl-class

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

74
Verified
24 tomasbedrich/pycaching

A Python 3 interface for working with Geocaching.com website.

74
Verified
25 themm1/procyclingstats

procyclingstats scraper

73
Verified
26 iamatulsingh/pinscrape

A simple library to scrape Pinterest images.

72
Verified
27 lumpinif/deepcrawl

100% free and full open-source edge Firecrawl alternative with better links...

72
Verified
28 deedy5/primp

HTTP client that can impersonate web browsers

71
Verified
29 plabayo/rama

modular service framework to move and transform network packets

71
Verified
30 sardanioss/httpcloak

Go HTTP client with browser-identical TLS/HTTP2 fingerprinting. Bypass bot...

71
Verified
31 apify/apify-client-python

Apify API client for Python

71
Verified
32 kevinzg/facebook-scraper

Scrape Facebook public pages without an API key

70
Verified
33 dcstats/CBBpy

A Python-based web scraper for NCAA basketball.

70
Verified
34 wikimedia/html-metadata

MetaData html scraper and parser for Node.js (supports Promises only)

70
Verified
35 bellingcat/auto-archiver

Automatically archive links to videos, images, and social media content from...

70
Verified
36 alperensert/capmonster_python

Capmonster.cloud library for Python3

70
Verified
37 freelawproject/juriscraper

An API to scrape American court websites for metadata.

69
Established
38 scrapy-plugins/scrapy-zyte-smartproxy

Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

69
Established
39 0x676e67/wreq-util

Common utilities for wreq

68
Established
40 gosom/google-maps-scraper

scrape data from Google Maps. Extracts data such as the name, address,...

68
Established
41 City-Bureau/city-scrapers-core

Core functionality for City Scrapers projects

68
Established
42 ecoron/SerpScrap

SEO python scraper to extract data from major searchengine result pages....

68
Established
43 MontFerret/ferret

Declarative web scraping

67
Established
44 apache/stormcrawler

A scalable, mature and versatile web crawler based on Apache Storm

67
Established
45 scrapy-plugins/scrapy-zyte-api

Zyte API integration for Scrapy

67
Established
46 dgtlmoon/changedetection.io

Best and simplest tool for website change detection, web page monitoring,...

67
Established
47 AnonCatalyst/Ominis-OSINT

This Python application is an OSINT (Open Source Intelligence) tool called...

66
Established
48 EchterAlsFake/xvideos_api

Unofficial Python client for xvideos.com: search, metadata extraction, and...

66
Established
49 lorien/grab

Web Scraping Framework

66
Established
50 holgerd77/django-dynamic-scraper

Creating Scrapy scrapers via the Django admin interface

66
Established
51 alecxe/scrapy-fake-useragent

Random User-Agent middleware based on fake-useragent

66
Established
52 WayneChang65/ptt-crawler

ptt-crawler is a web crawler module designed to scarpe data from Ptt.

66
Established
53 EchterAlsFake/xnxx_api

Unofficial Python client for xnxx.com: search, metadata extraction, and...

65
Established
54 kichik/email-scraper

Simple Python library to scrape email addresses from HTML

65
Established
55 jensjeflensje/marktplaats-py

Small Python package to request listings & users from marktplaats.nl

65
Established
56 franckferman/MetaDetective

Unleash Metadata Intelligence with MetaDetective. Your Assistant Beyond Metagoofil.

65
Established
57 alephdata/memorious

Lightweight web scraping toolkit for documents and structured data.

65
Established
58 EchterAlsFake/missAV_api

Unofficial Python client for missav.ws: search, metadata extraction, and...

65
Established
59 scrapfly/scrapfly-scrapers

Scalable Python web scraping scripts for +40 popular domains

64
Established
60 EchterAlsFake/xhamster_api

a Python API for xhamster.com using web-scraping to provide an easy to use interface

64
Established
61 HarryShomer/Hockey-Scraper

Python Package for scraping NHL Play-by-Play and Shift data

64
Established
62 yuanxu-li/html-table-extractor

extract data from html table

63
Established
63 DavidWittman/requests-random-user-agent

Configures the requests library to randomly select a desktop User-Agent

63
Established
64 mawrkus/jason-the-miner

⛏ A versatile Web scraper for Node.js

63
Established
65 EchterAlsFake/eaf_base_api

a base networking component for EchterAlsFake's Porn APIs

63
Established
66 EchterAlsFake/hqporner_api

Unofficial Python client for hqporner.com: search, metadata extraction, and...

63
Established
67 haxsysgit/autopahe

Automatically download all your favorite anime from AnimePahe

63
Established
68 datawhores/OF-Scraper

A completely revamped and redesigned fork, reimagined from scratch based on...

63
Established
69 iiab/iiab

Internet-in-a-Box - Build your own LIBRARY OF ALEXANDRIA with a Raspberry Pi !

63
Established
70 jocmp/mercury-parser

Extract meaningful content from the chaos of a web page

63
Established
71 lorien/awesome-web-scraping

List of libraries, tools and APIs for web scraping and data processing.

63
Established
72 EchterAlsFake/EPorner_API

Unofficial Python client for EPorner.com: search, metadata extraction, and...

63
Established
73 snooppr/snoop

Snoop — инструмент разведки на основе открытых данных (OSINT world)

63
Established
74 sangaline/wayback-machine-scraper

A command-line utility and Scrapy middleware for scraping time series data...

62
Established
75 ispras/web-scraper-chrome-extension

Web data extraction tool implemented as chrome extension

62
Established
76 Norconex/crawlers

Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for...

62
Established
77 nirholas/crypto-vision

The most comprehensive cryptocurrency API. Real-time prices, OHLCV, order...

62
Established
78 webrecorder/browsertrix-crawler

Run a high-fidelity browser-based web archiving crawler in a single Docker container

61
Established
79 jikan-me/jikan-rest

The REST API for Jikan

61
Established
80 apify/actor-scraper

House of Apify Scrapers. Generic scraping actors with a simple UI to handle...

61
Established
81 daniel-hauser/moneyman

Automatically save transactions from all major Israeli banks and credit card...

61
Established
82 apache/nutch

Apache Nutch is an extensible and scalable web crawler

61
Established
83 Lookyloo/lookyloo

Lookyloo is a web interface that allows users to capture a website page and...

61
Established
84 JettChenT/scan-for-webcams

scan for webcams on the internet

61
Established
85 programminghistorian/jekyll

Jekyll-based static site for The Programming Historian

61
Established
86 ScriptSmith/socialreaper

Social media scraping / data collection library for Facebook, Twitter,...

61
Established
87 OWASP/D4N155

OWASP D4N155 - Intelligent and dynamic wordlist using OSINT

60
Established
88 daneads/pypatent

Search for and retrieve US Patent and Trademark Office Patent Data

60
Established
89 champmq/TheScrapper

Scrape emails, phone numbers and social media accounts from a website.

60
Established
90 sb0y/warp_beacon

Telegram bot that downloads content from YouTube, Instagram and X (Twitter)

60
Established
91 EchterAlsFake/spankbang_api

A Python API for the porn site spankbang.com

60
Established
92 sangaline/scrapy-wayback-machine

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

60
Established
93 sananth12/ImageScraper

:scissors: High performance, multi-threaded image scraper

60
Established
94 thisisparker/xword-dl

▞ Command line tool to scrape crosswords from online solvers and save them...

60
Established
95 crawler-commons/crawler-commons

A set of reusable Java components that implement functionality common to any...

60
Established
96 juancarlospaco/faster-than-requests

Faster requests on Python 3

60
Established
97 maxhumber/gazpacho

🥫 The simple, fast, and modern web scraping library

60
Established
98 hmasdev/pyjpboatrace

pyjpboatrace :speedboat: provides you with useful tools for data analysis...

60
Established
99 okfn-brasil/querido-diario

📰 Diários oficiais brasileiros acessíveis a todos | 📰 Brazilian...

60
Established
100 ivan-sincek/file-scraper

Scrape files for sensitive information, and generate an interactive HTML...

59
Established
101 brandon93s/html-table-to-json

Generate JSON representations of HTML tables

59
Established
102 hyperbrowserai/examples

Examples for using Hyperbrowser

59
Established
103 brendonboshell/supercrawler

A web crawler. Supercrawler automatically crawls websites. Define custom...

59
Established
104 crawlab-team/crawlab

Distributed web crawler admin platform for spiders management regardless of...

59
Established
105 scrapehero/selectorlib

A library to read a YML file with Xpath or CSS Selectors and extract data...

59
Established
106 neon-mmd/websurfx

:rocket: An open source alternative to searx which provides a modern-looking...

59
Established
107 mov-cli/mov-cli

Watch everything from your terminal.

59
Established
108 pavanad/emec-api

API Python para consulta na base de dados oficial do e-MEC

58
Established
109 adryfish/fingerprint-chromium

An open source fingerprint browser based on Ungoogled Chromium. 指纹浏览器 隐私浏览器

58
Established
110 jurismarches/chopper

Chopper is a tool to extract elements from HTML by preserving ancestors and CSS rules

58
Established
111 fluquid/extract-social-media

Extract social media links and account names from websites.

58
Established
112 claffin/cloudproxy

Hide your scrapers IP behind the cloud. Provision proxy servers across...

58
Established
113 snooppr/shotstars

An advanced tool for checking GitHub repositories, with star statistics,...

58
Established
114 lorey/socials

👨‍👩‍👦 Python library and CLI to turn URLs into structured social media profiles.

58
Established
115 viu-media/viu

Your browser anime experience from the terminal

58
Established
116 34j/cached-historical-data-fetcher

Python utility for fetching any historical data using caching. Suitable for...

58
Established
117 php-embed/Embed

Get info from any web service or page

58
Established
118 ryanirl/CraigslistScraper

Simple webscraper for Craigslist.

58
Established
119 spyboy-productions/omnisci3nt

Omnisci3nt is an open-source web reconnaissance and intelligence tool for...

57
Established
120 jiusanzhou/flutter_notification_listener

Flutter plugin to listen for and interact with all incoming notifications...

57
Established
121 MarginaliaSearch/MarginaliaSearch

Internet search engine for text-oriented websites. Indexing the small, old...

57
Established
122 Nekmo/proxy-db

Manage free and private proxies on local db for Python Projects

57
Established
123 kastaid/getter

A powerful and customizable Telegram userbot built with Telethon

57
Established
124 rike422/kirinuki-core

Kirinuki is a library that convert any html to JSON using CSS selectors.

57
Established
125 ZoranPandovski/BookingScraper

:earth_americas: :hotel: Scrape Booking.com :hotel: :earth_americas:

57
Established
126 lisc-tools/lisc

Literature Scanner: Automated collection & analyses of the scientific literature.

57
Established
127 ToufiqQureshi/chuscraper

Stealth-native web & Android scraping framework powered by CDP and ADB with...

57
Established
128 City-Bureau/city-scrapers

Scrape, standardize and share public meetings from local government websites

57
Established
129 Magic-Fish-Labs/Ecole-Directe-Plus

A better EcoleDirecte (unaffiliated): more pleasant, functional, and...

57
Established
130 code4craft/webmagic

A scalable web crawler framework for Java.

57
Established
131 PhialsBasement/LibreCrawl

Free desktop SEO crawler - open source alternative to Screaming Frog and...

57
Established
132 nuzulul/telegram-scraper

A simple Telegram channel scraper

56
Established
133 postmodern/spidr

A versatile Ruby web spidering library that can spider a site, multiple...

56
Established
134 devopsgroup-io/siteshooter

:camera: Automate full website screenshots and PDF generation with multiple...

56
Established
135 Virtual-Browser/VirtualBrowser

Free anti fingerprint browser, 指纹浏览器, 隐私浏览器, 防识别浏览器, 反识别浏览器, 防关联浏览器,...

56
Established
136 HexNio/booking_scraper

A booking.com Web Scraper for Data Mining/Harvesting and Automation

56
Established
137 ppizarror/PyMultiDictionary

PyMultiDictionary is a dictionary module that gets meanings, translations,...

56
Established
138 EchterAlsFake/youporn_api

Unofficial Python client for youporn.com: search, metadata extraction, and...

56
Established
139 EnsembleData/ensembledata-python

Python library to scrape social media data via the EnsembleData API.

56
Established
140 TheQmaks/justapk

Download any APK by package name. 6 sources, automatic fallback, Cloudflare...

56
Established
141 Germey/AwesomeWebScraping

List of libraries, tools and APIs for web scraping and data processing.

56
Established
142 gahabeen/jsonframe-cheerio

simple multi-level scraper json input/output for Cheerio

56
Established
143 sparklemotion/mechanize

Mechanize is a ruby library that makes automated web interaction easy.

56
Established
144 hackersandslackers/beautifulsoup-tutorial

:sparkles: :ramen: Scrape webpage metadata using BeautifulSoup.

56
Established
145 FlowerEatsFish/books-com-tw-crawler

books.com.tw crawler 「博客來」資料爬蟲

56
Established
146 sqdshguy/wreq-js

HTTP client for Node.js with browser TLS fingerprint impersonation

56
Established
147 Xonshiz/comic-dl

Comic-dl is a command line tool to download manga and comics from various...

56
Established
148 commoncrawl/news-crawl

News crawling with StormCrawler - stores content as WARC

55
Established
149 gsscoder/facebook-snooper

Scrapes Facebook profile pages using a normal login (without an API key)

55
Established
150 nikulpatel3141/ETF-Scraper

Scrape public ETF and Mutual Fund holdings information

55
Established
151 cumbucadev/cinemaempoa

Site que agrega filmes em cartaz em algumas das diversas salas de cinema de...

55
Established
152 alpkeskin/rota

A high-performance proxy rotation engine with automated IP management and...

55
Established
153 druzsan/justetf-scraping

Scraping the justETF

55
Established
154 joedockrill/jmd_imagescraper

Image scraping library for creating deep learning datasets

55
Established
155 gocolly/colly

Elegant Scraper and Crawler Framework for Golang

55
Established
156 ngongcm/public-api-list

A curated collection of the best free, freemium, and paid APIs for developers.

54
Established
157 saifalisew1508/TelegramAdderTool

An Telegram Mass Members Adding/Scraping Tool Written In Python Using...

54
Established
158 EchterAlsFake/porntrex_api

Unofficial Python client for porntrex.com: search, metadata extraction, and...

54
Established
159 serpapi/google-search-results-java

Google Search Results JAVA API via SerpApi

54
Established
160 alyakhtar/Katastrophe

Command Line Tool to download torrents

54
Established
161 axsddlr/vlrggapi

An Unofficial REST API for vlr.gg, a site for Valorant Pro Esports match...

54
Established
162 wajik45/wajik-anime-api

REST API streaming dan download Anime subtitle Indonesia | sub Indo

54
Established
163 ivbeg/qddate

Quick and dirty date parsing Python library to parse HTML dates really fast

54
Established
164 digitalmethodsinitiative/4cat

The 4CAT Capture and Analysis Toolkit provides modular data capture &...

54
Established
165 deliton/idt

Image Dataset Tool (idt) is a cli tool designed to make the otherwise...

54
Established
166 pzaino/thecrowler

A Content Discovery and Development Platform. Empowering Cybersecurity, AI,...

54
Established
167 Evil0ctal/Douyin_TikTok_Download_API

🚀「Douyin_TikTok_Download_API」是一个开箱即用的高性能异步抖音、快手、TikTok、Bilibili数据爬取工具,支持API调用...

54
Established
168 SoheilKhodayari/JAW

JAW: A Graph-based Security Analysis Framework for Client-side JavaScript

54
Established
169 niklak/dom_query

A Flexible Rust Crate for DOM Querying and Manipulation

54
Established
170 City-Bureau/city-scrapers-template

Template for creating a City Scrapers project in your area

53
Established
171 INNOVINATI/microwler

A micro-framework for asynchronous deep crawls and web scraping with Python

53
Established
172 acoyfellow/unsurf

Turn any website into a typed API

53
Established
173 ScrapeGraphAI/scrapecraft

🤖 AI-powered web scraping editor with visual workflow builder. Build, test &...

53
Established
174 jasonxtn/Argus

The Ultimate Information Gathering Toolkit

53
Established
175 City-Bureau/city-scrapers-cle

City Scrapers project for Cleveland

53
Established
176 OpenIsraeliSupermarkets/israeli-supermarket-scarpers

A python package with client to scrape the israeli supermarkets data

53
Established
177 tidyverse/rvest

Simple web scraping for R

53
Established
178 ramonpaolo/api-b3

API Simples que retorna dados sobre tal ação/empresa da B3

53
Established
179 VIDA-NYU/ache

ACHE is a web crawler for domain-specific search.

53
Established
180 n8nhackers/n8n-nodes-brightdata

Community node to work with Bright Data service for scraping purposes

53
Established
181 html-extract/hext

Domain-specific language for extracting structured data from HTML documents

53
Established
182 outscraper/outscraper-node

The library provides convenient access to the Outscraper API from...

53
Established
183 rayobyte-data/rayobrowse

Stealth Chromium browser for large-scale web scraping.

53
Established
184 platonai/PulsarRPAPro

Fully automated and hands-free, accurately extracting and understanding web...

52
Established
185 jaeyk/comp_thinking_social_science

Computational Thinking for Social Scientists book project

52
Established
186 redco/goose-parser

Universal scraping tool, which allows you to extract data using multiple environments

52
Established
187 jlumbroso/imslp

🎼 The clean and modern way of accessing IMSLP data and scores programmatically. 🎶

52
Established
188 ksanjeev284/reddit-universal-scraper

Universal Reddit Scraper - Works on any Subreddit or User

52
Established
189 Evasionn/price-tracker

a python application to track prices on some online shopping applications

52
Established
190 matheusfelipeog/worldometer

Get live, population, geography, projected, and historical data from around...

52
Established
191 inaridiy/webforai

The best HTML to Markdown library, A esm-native & Useful Utilities with...

52
Established
192 alexcamargos/pyFundamentus

Python Fundamentus is a Python API that allows you to quickly access the...

52
Established
193 DataCrawl-AI/datacrawl

A simple and easy to use web crawler for Python

52
Established
194 p-ranav/saveddit

Bulk Downloader for Reddit

52
Established
195 Bartozzz/crawlerr

A simple and fully customizable web crawler/spider for Node.js with...

52
Established
196 estin/pomp

Screen scraping and web crawling framework

52
Established
197 arman-bd/httpmorph

httpmorph is a drop-in replacement for Python's requests library that uses a...

52
Established
198 outscraper/google-maps-reviews-python

Python SDK that allows fetching Google Maps Reviews from any place. Fetch...

52
Established
199 gosom/scrapemate

Golang Crawling and scraping framework

52
Established
200 theritikchoure/crawlyx

Crawlyx is an open-source command-line interface (CLI) based web crawler...

52
Established
201 Dymerz/RSI-Scraper

Web Scaper for RSI

52
Established
202 Hochfrequenz/ebdamame

Python library to scrape .docx files with "Entscheidungsbaumdiagramm" tables...

52
Established
203 damklis/DataEngineeringProject

Example end to end data engineering project.

51
Established
204 yuchiu/Netflix-Clone

Netflix like full-stack application with SPA client and backend implemented...

51
Established
205 jplusplus/statscraper

A base library for building web scrapers for statistical data, and a helper...

51
Established
206 TrainingByPackt/Data-Wrangling-with-Python

Simplify your ETL processes with these hands-on data sanitation tips,...

51
Established
207 ssssssss-team/spider-flow

新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。

51
Established
208 MorvanZhou/easy-scraping-tutorial

Simple but useful Python web scraping tutorial code.

51
Established
209 AndyTheFactory/newspaper4k

📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles,...

51
Established
210 PKHarsimran/website-downloader

Website-downloader is a powerful and versatile Python script designed to...

51
Established
211 internetarchive/Zeno

State-of-the-art web crawler 🔱

51
Established
212 NikolaiT/GoogleScraper

A Python module to scrape several search engines (like Google, Yandex, Bing,...

51
Established
213 sjdirect/abot

Cross Platform C# web crawler framework built for speed and flexibility....

51
Established
214 Yuvi9587/Kemono-Downloader

Kemono Downloader is a fast, powerful PyQt5 app for archiving content from a...

51
Established
215 USCDataScience/sparkler

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.

51
Established
216 Ryuk-me/Torrent-Api-py

An Unofficial API for 1337x, Piratebay, Nyaasi, Torlock, Torrent Galaxy,...

51
Established
217 outscraper/outscraper-php

The library provides convenient access to the Outscraper API from...

51
Established
218 stabldev/mangareader-api

A Python based web scraping api built with fastapi to get manga contents.

51
Established
219 schasins/helena

A Chrome extension for writing custom web scraping programs and web...

51
Established
220 alechilczenko/kimi

Attack Surface Discovery tool built on a microservice approach, utilizing...

51
Established
221 Kuucheen/KC-Scraper

A powerful open-source proxy scraper

51
Established
222 s0rg/crawley

The unix-way web crawler

51
Established
223 tednaleid/ganda

fast cmd-line app that quickly requests millions of urls and can save/echo...

51
Established
224 adithya-s-k/omniparse

Ingest, parse, and optimize any data format ➡️ from documents to multimedia...

51
Established
225 vprusso/youtube_tutorials

Collection of scripts corresponding to LucidProgramming YouTube tutorials

51
Established
226 istresearch/scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand...

51
Established
227 Yukselcsgn/dynamic_web_scraper

A fully dynamic and extensible e-commerce scraping framework with automatic...

51
Established
228 tuhinpal/imdb-api

Serverless IMDB API powered by Cloudflare Worker

51
Established
229 lobstrio/shadow-useragent

Pick the most common user-agents on the Internet 👻

51
Established
230 zyachel/libremdb

A free & open source IMDb front-end.

51
Established
231 barthofu/nautiljon-scraper

🍙 An unofficial scraping tool for https://nautiljon.com, a french anime and...

51
Established
232 lseffer/stock_screener

Picking stocks through various screening methods. Focus on Northern Europe.

51
Established
233 scrapfly/Antibot-Detector

Real-time detection of anti-bot systems, CAPTCHAs & fingerprinting...

51
Established
234 r2dev2/OneFactorAuth

A tool to bypass 2 factor authentication.

51
Established
235 DBeath/feedsearch-crawler

Crawl sites for RSS, Atom, and JSON feeds.

51
Established
236 spyboy-productions/PhantomCrawler

PhantomCrawler is a Python-based web testing and research tool that...

51
Established
237 covidatlas/coronadatascraper

COVID-19 Coronavirus data scraped from government and curated data sources.

51
Established
238 xianhu/PSpider

简单易用的Python爬虫框架,QQ交流群:597510560

51
Established
239 gildas-lormeau/single-file-cli

CLI tool for saving a faithful copy of a complete web page in a single HTML...

51
Established
240 AlexMathew/scrapple

A framework for creating semi-automatic web content extractors

51
Established
241 je-suis-tm/web-scraping

Detailed web scraping tutorials for dummies with financial data crawlers on...

51
Established
242 Tiago-Lira/scrapyd-mongodb

Library designed to replace the SQLite backend by a MongoDB backend on...

50
Established
243 MBach/LeMondeRssReader

:newspaper: Read RSS feed from LeMonde.fr and display news inside the App

50
Established
244 orsifrancesco/instagram-without-api-node

A simple Node.js code to get unlimited instagram public pictures by every...

50
Established
245 fastai/fastlinkcheck

Check local static links and online links fast and in parallel

50
Established
246 iawia002/Lulu

[Unmaintained] A simple and clean video/music/image downloader 👾

50
Established
247 RuedigerVoigt/exoskeleton

A Python framework to build polite, but tenacious crawlers / scrapers with a...

50
Established
248 MichaelTatarski/fake-http-header

A python package to generate random request fields for a http header.

50
Established
249 coko7/vegapull

👒 One Piece TCG data scraper written in Rust

50
Established
250 2knal/random_proxies

Python package to generate random proxy on the fly!

50
Established
251 FramedStone/SassyNic

Multiple chrome extensions that speed up the tasks within MMU CliC.

50
Established
252 alfremedpal/PandasBasketball

A Python module to scrape data from basketbal-reference.com and convert it...

50
Established
253 MontFerret/worker

Containerized Ferret worker

50
Established
254 Decodo/Decodo

HTTP(S)/SOCKS5 rotating residential proxies - code examples & general information.

50
Established
255 thesp0nge/nightcrawler-mitm

A python program that crawls a website and tries to stress it, polluting...

50
Established
256 yubunus/Uber-Eats-Account-Generator

Generate Uber Eats accounts using IMAP or Hotmail emails using mobile packets

50
Established
257 serpapi/public-roadmap

Public Roadmap for SerpApi, LLC (https://serpapi.com)

50
Established
258 davidteather/everything-web-scraping

Learn everything web scraping with David Teather Codes on YouTube

50
Established
259 apify/actor-whitepaper

This whitepaper describes a new concept for building serverless microapps...

50
Established
260 Anshu78780/ScarperApi

Its a Scarper api that will give you direct movie data in ur local machine...

50
Established
261 chazeon/python-vistopia

看理想 Python 客户端 / 下载器,下载看理想的音频和文稿

50
Established
262 andrelmlins/freesoccer

:soccer: Free API with results from national soccer competitions

50
Established
263 khuyentran1401/top-github-scraper

Scape top GitHub repositories and users based on keywords

50
Established
264 rflechner/ScrapySharp

reborn of https://bitbucket.org/rflechner/scrapysharp

49
Emerging
265 MLArtist/WebScraper

Python-based web crawling script with randomized intervals, user-agent...

49
Emerging
266 apify/apify-sdk-python

The Apify SDK for Python is the official library for creating Apify Actors...

49
Emerging
267 my8100/scrapyd-cluster-on-heroku

Set up free and scalable Scrapyd cluster for distributed web-crawling with...

49
Emerging
268 awolverp/markupever

The fast, most optimal, and correct HTML & XML parsing library for Python...

49
Emerging
269 umbrellaDocumentation/Web-Data-Scraper

Web Data Scraper - no-code internet scraping. Extract and export to CSV,...

49
Emerging
270 buyukakyuz/email-sleuth

Discover and verify professional emails using names + domains

49
Emerging
271 crawlab-team/crawlab-lite

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

49
Emerging
272 rivermont/spidy

The simple, easy to use command line web crawler.

49
Emerging
273 amoudgl/short-jokes-dataset

Python scripts for building 'Short Jokes' dataset, featured on Kaggle

49
Emerging
274 da2vin/Sasila

一个灵活、友好的爬虫框架

49
Emerging
275 infinilabs/crawler

🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)

49
Emerging
276 csu/quora-api

An unofficial API for Quora.

49
Emerging
277 codingforentrepreneurs/Web-Scraping

Learn how to leverage Python's amazing tools to scrape data from other...

49
Emerging
278 elliotxx/zhihu-crawler-people

A simple distributed crawler for zhihu && data analysis

49
Emerging
279 phase3dev/sitemap-extract

Processes XML sitemaps and extracts URLs. Includes features such as support...

49
Emerging
280 asad-haider/spidey

Robust web spider for NodeJS

49
Emerging
281 abo123456789/leek

Distributed task redisqueue(最简单python分布式函数调度框架)

49
Emerging
282 supadata-ai/py

Official Python SDK for the Supadata API.

49
Emerging
283 pim97/scrappey.js

Scrappey.js: A versatile JavaScript wrapper for Scrappey API for solving...

49
Emerging
284 FaustoS88/PinescriptV6-docs-crawler

A Python tool for crawling and processing TradingView's PineScript V6...

49
Emerging
285 d-Rickyy-b/pastepwn

Python framework to scrape Pastebin pastes and analyze them

49
Emerging
286 kyle-n/unofficial-amazon-search

A simple client for searching Amazon

49
Emerging
287 macloo/python-adv-web-apps

Updated python-beginners docs and examples

49
Emerging
288 VolkanSah/Auto-Proxy-Fetcher

Automatically fetch and update proxy lists from multiple sources every 6...

49
Emerging
289 SiddharthSaxena/PyCurrency-Converter

A python library to convert currency using Google Finance.

49
Emerging
290 Jieyab89/OSINT-Cheat-sheet

OSINT cheat sheet, list OSINT tools, wiki, dataset, article, book , red team...

49
Emerging
291 discourselab/scrapai-cli

AI-powered web scraping CLI. Describe what you want, get a ...

49
Emerging
292 AgriciDaniel/google-ai-studio-n8n-google-maps-scraper

A no-code Google Maps lead scraper built with Google AI Studio (Gemini) and...

49
Emerging
293 valayDave/arxiv-miner

arxiv_miner is a toolkit for mining research papers on CS ArXiv.

49
Emerging
294 batuhaniskr/twitter-intelligence

Twitter Intelligence OSINT project performs tracking and analysis of the Twitter

49
Emerging
295 spmedia/Threat-Actor-Usernames-Scrape

A collection of intel and usernames scraped from various cybercrime sources...

49
Emerging
296 N4rr34n6/TikTok-User-Info-Scraper

TikTok User Info Scraper allows you to fetch detailed information about...

49
Emerging
297 mhwgoo/cambridge

Terminal version of Cambridge Dictionary by default. Also supports the...

49
Emerging
298 A3h1nt/Grawler

Grawler is a tool written in PHP which comes with a web interface that...

48
Emerging
299 gicornachini/bolsa

Biblioteca feita em Python com o objetivo de facilitar o acesso a dados de...

48
Emerging
300 flother/htmltab

Command-line utility to convert HTML tables into CSV files

48
Emerging
301 fernandod1/Instagram-to-discord

Monitor instagram user account and automatically post new images to discord...

48
Emerging
302 aditeyaS/8bp-free-gift-collector

8 ball pool free rewards collector

48
Emerging
303 sepandhaghighi/gitfollow

Github follower and following

48
Emerging
304 sdl60660/letterboxd_recommendations

Scraping publicly-accessible Letterboxd data and creating a movie...

48
Emerging
305 zrashwani/arachnid

Crawl all unique internal links found on a given website, and extract SEO...

48
Emerging
306 RomySaputraSihananda/tiktok-comment-scrapper

Get all comments from tiktok video url or id

48
Emerging
307 MontFerret/lab

Test runner for Ferret

48
Emerging
308 AlexandreGazagnes/awdible

Awdible - Just the best free version of audible. Awdible is a free and...

48
Emerging
309 sixem/imageboard-dl

Image downloader for various imageboards and image albums written in Python.

48
Emerging
310 beucismis/limoon

Web scraper base Pythonic API for Ekşi Sözlük

48
Emerging
311 ypspy/dart-scraping

DART 다트 공시 서류 입수 가공

48
Emerging
312 new92/instatools

🧰 A collection of automation tools for Instagram 📱| Written in Python 🐍 |...

48
Emerging
313 oxylabs/amazon-scraper

Free Trial Amazon Scraper API for extracting search, product, offer listing,...

48
Emerging
314 vittoriotriassi/jobs_scraper

Simple job postings scraper for Indeed based on requests and BeautifulSoup

48
Emerging
315 ScriptSmith/reaper

Social media scraping / data collection tool for the Facebook, Twitter,...

48
Emerging
316 elixir-crawly/crawly

Crawly, a high-level web crawling & scraping framework for Elixir.

48
Emerging
317 tasooshi/pukpuk

HTTP discovery and change monitoring tool

48
Emerging
318 ivan-sincek/bot-safe-agents

A library for fetching a list of bot-safe user agents.

48
Emerging
319 abhijeet-reddy/Competitive_Programming_Score_API

API to get user details for competitive coding platforms - Codeforces,...

48
Emerging
320 serp-spider/search-engine-google

:spider: Google client for SERPS

48
Emerging
321 JonasCz/save-for-offline

Android app for saving webpages for offline reading.

48
Emerging
322 Aran404/SpotAPI

A python wrapper for the public & private Spotify API

48
Emerging
323 gitrecon1455/fresh-proxy-list

Free Proxy List Updated every 10 minutes

48
Emerging
324 programminghistorian/ph-submissions

The repository and website hosting the peer review process for new...

48
Emerging
325 scrapfly/typescript-scrapfly

SDK for Scrapfly.io web scraping API

48
Emerging
326 vakhov/fresh-proxy-list

Provides a list of fresh, working proxy servers (HTTP, HTTPS, SOCKS4 &...

47
Emerging
327 City-Bureau/city-scrapers-det

City Scrapers project for Detroit

47
Emerging
328 DavyJonesCodes/PyTweetToolkit

PyTweetToolkit: An intuitive Python library for managing Twitter...

47
Emerging
329 harkerbyte/linux-monster

Ethical Facebook and Gmail bruteforce... Bonus, proxy rotation for every...

47
Emerging
330 blacknon/pydork

Scraping and listing text and image searches on Google, Bing, DuckDuckGo,...

47
Emerging
331 shakirth-anisha/pesu-slide-download-automator

Automates the process of downloading all PESU Academy Slides + helps merge...

47
Emerging
332 pharo-contributions/Soup

A Pharo implementation of beautiful Soup

47
Emerging
333 akvise/trends-checker

Python CLI for Google Trends analysis with advanced rate limiting, cookie...

47
Emerging
334 pavlovtech/WebReaper

Web scraper, crawler and parser in C#. Designed as simple, declarative and...

47
Emerging
335 Krasjet/pdf.tocgen

A CLI toolset to generate table of contents for PDF files automatically.

47
Emerging
336 zyachel/quetre

A libre front-end for Quora

47
Emerging
337 Michele0303/undetected-httpx

Stop getting 403 Forbidden. A specialized httpx-like toolkit for WAF evasion.

47
Emerging
338 ScrapeOps/scrapeops-scrapy-sdk

Scrapy extension that gives you all the scraping monitoring, alerting,...

47
Emerging
339 sloev/spotiflite

Scrapes Spotify and dumps data to a sqlite3 database without auth

47
Emerging
340 Police-Data-Accessibility-Project/scrapers

Code relating to scraping public police data.

47
Emerging
341 Deer-Spangle/faexport

The API for Furaffinity you wish existed

47
Emerging
342 sycanz/schedulr

A chrome extension that transfers timetable from CLiC to Google Calendar.

47
Emerging
343 ArchiveTeam/wget-lua

Wget-AT is a modern Wget with Lua hooks, Zstandard (+dictionary) WARC...

47
Emerging
344 leogregianin/bancocentralbrasil

💵 💰 :brazil: Informações sobre taxas oficiais diárias de Inflação, Selic,...

47
Emerging
345 scrapinghub/scrapy-training

Scrapy Training companion code

47
Emerging
346 bbbbbrie/pastebin-bisque

Download all of a given user's public Pastebin pastes

47
Emerging
347 Insutanto/scrapy-distributed

A series of distributed components for Scrapy. Including RabbitMQ-based...

47
Emerging
348 matheusfelipeog/froxy

Hide your IP with free proxies using Froxy 🔄

47
Emerging
349 MehmetYukselSekeroglu/HiveWebCrawler

Simple Python 3.x Web Crawler, Images, Urls, Emails, Phone numbers

47
Emerging
350 aeleraqi/GoogleNewsScraper

Google News Scraper, a Python notebook designed to extract news articles...

47
Emerging
351 sansan0/bilibili-comment-analyzer

🎯 哔哩哔哩(bilibili)评论区数据可视化分析软件-- up主可用于指导自己的题材选择,明确自己的粉丝群体

47
Emerging
352 floriandiud/facebook-group-members-scraper

Facebook Group Members Extractor. Download Facebook group members in CSV.

47
Emerging
353 kelp/webdown

Download websites and save or view them as markdown, great for feeding into an LLM

47
Emerging
354 cpatrickalves/scraping-ebay

Scraping Ebay's products using Scrapy Web Crawling Framework

47
Emerging
355 poketo/poketo

Node library for scraping manga sites

47
Emerging
356 lablnet/pakweather_scraper

A multi-threaded Pakistan Weather crawler written in JavaScript

47
Emerging
357 crawlcore/qcrawl

qcrawl - fast async web crawling & scraping framework for Python.

47
Emerging
358 Krisseck/Detect-CMS

PHP Library for detecting CMS

47
Emerging
359 Crinibus/scraper

Web scraper for scraping, tracking and visualizing prices of products on...

47
Emerging
360 openstates/billy

legacy backend for Open States

47
Emerging
361 abaykan/CrawlBox

Easy way to brute-force web directory.

47
Emerging
362 peviitor-ro/JobsScrapers

Scraping of the jobs available and adding them all in one place at peviitor.ro

47
Emerging
363 ibnesayeed/linkextractor

A Docker tutorial using a link extraction application example

46
Emerging
364 okkymabruri/news-watch

news-watch: Indonesia's top news websites scraper

46
Emerging
365 the-akira/Python-Web-Scraping

Explorando Técnicas de Web Scraping com Python

46
Emerging
366 otoneko1102/connpass-pickup

https://connpass.com/ のイベントの参加枠のメンバーをランダムに並び替えするツールです。

46
Emerging
367 rkwyu/anime-dl

Anime Downloader 動畫下載 (xgcartoon, yhdm, anime1, agdm, etc)

46
Emerging
368 citation-js/plugin-zotero-translation-server

Citation.js Plugin for Zotero Translation Server instances

46
Emerging
369 Moduland/instatag

Extract Instagram Users from tags (Public , Without API and Login)

46
Emerging
370 Firmfox/Proxify

Proxify is an automated tool that collects and updates fresh SOCKS4, SOCKS5,...

46
Emerging
371 koikiss-dev/jimov_api

This project is an open-source API for retrieving multimedia content such as...

46
Emerging
372 Deepakchawla/Mobile-Phone-Dataset-GSMArena

Python script for creating Mobile Phones Dataset on GSMArena website.

46
Emerging
373 davccavalcante/bet365-api-scraper

This project is a scraper of the Bet365 API to collect data from live...

46
Emerging
374 chipscoco/OceanMonkey

OceanMonkey is a High-Level Distributed Web Crawling and Web Scraping...

46
Emerging
375 jonasjacek/robots.txt

Simple robots.txt template. Keep unwanted robots out (disallow). White lists...

46
Emerging
376 geziyor/geziyor

Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS...

46
Emerging
377 gugarosa/viviner

🍷 Scraps data from Vivino and collects outstanding wine-based meta-data.

46
Emerging
378 citizenlabsgr/elections-api

API for voter registration status and sample ballots in Michigan.

46
Emerging
379 ahmedshahriar/bd-medicine-scraper

Scrapy-Django PostgreSQL integrated API with Proxy IP configuration that...

46
Emerging
380 serp-spider/core

:spider: The PHP SERP Spider - A search engine scraper

46
Emerging
381 online-judge-tools/api-client

API client to develop tools for competitive programming

46
Emerging
382 Benevanio/Jobs_Scraper_Global

Simplifique sua busca por emprego. Todas as oportunidades do mercado...

46
Emerging
383 rhysd/node-github-trend

node.js library for scraping GitHub trending repositories.

46
Emerging
384 stummjr/scrapy-fieldstats

A Scrapy extension to log items coverage when the spider shuts down

46
Emerging
385 aborruso/scrape-cli

Extract HTML elements from the command line using CSS selectors or XPath....

46
Emerging
386 nazuke/SEOMacroscope

SEO Macroscope is a website scanning tool, to check your website for broken...

46
Emerging
387 emibcn/covid

Progressive Web Application that displays extracted data from the official...

46
Emerging
388 atchopba/scraping-jobs

Scraping-jobs helps scrape jobs from major job boards (apec.fr, indeed.fr,...

46
Emerging
389 Cooya/Linkedin-Client

Web scraper for grabing data from Linkedin profiles or company pages...

46
Emerging
390 sushantPatrikar/Amazon-Flipkart-Price-Comparison-Engine

Compares price of the product entered by the user from e-commerce sites...

46
Emerging
391 hhhrrrttt222111/Dorkify

Perform Google Dork search with Dorkify

46
Emerging
392 duyet/awesome-web-scraper

A collection of awesome web scaper, crawler.

46
Emerging
393 nanato12/amazonpy

Amazon scraping library

46
Emerging
394 html2rss/html2rss-configs

📇 A growing collection of html2rss feed configs. Generate configs with the...

46
Emerging
395 tabulapdf/tabula

Tabula is a tool for liberating data tables trapped inside PDF files

46
Emerging
396 BruceDone/awesome-crawler

A collection of awesome web crawler,spider in different languages

46
Emerging
397 crwlrsoft/crawler

Library for Rapid (Web) Crawler and Scraper Development

46
Emerging
398 yaroslaff/nudecrawler

Crawl telegra.ph searching for nudes!

46
Emerging
399 Sparsh1212/gsocanalyzer

A blazingly fast tool to analyze all the selected organizations in Google...

46
Emerging
400 bitmakerla/estela

estela, an elastic web scraping cluster 🕸

46
Emerging
401 TechfaneTechnologies/QtsApp

The Python Library For QtsApp which displays the option chain in near...

45
Emerging
402 antchfx/antch

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

45
Emerging
403 Contest-Hive/__contest-hive-backend

Backend Script that scraps for Contest Hive

45
Emerging
404 bertrandmartel/tableau-scraping

Tableau scraper python library. R and Python scripts to scrape data from Tableau viz

45
Emerging
405 justquick/pdf12step

Generates PDFs meeting guides from sites using the 12 Step Meeting List...

45
Emerging
406 isaacus-dev/open-australian-legal-corpus-creator

The code used to create and update the Open Australian Legal Corpus, the...

45
Emerging
407 kr4ude/onlyfans-scraper

A tool that allows you to scrape media from any Onlyfans account and more

45
Emerging
408 ScrapingAnt/scrapingant-client-python

ScrapingAnt API client for Python.

45
Emerging
409 Xonshiz/anime-dl

Anime-dl is a command-line program to download anime from CrunchyRoll and Funimation.

45
Emerging
410 recommend-games/board-game-scraper

Board game data scraper

45
Emerging
411 ThreeGiantNoobs/chegg-scraper

Download Chegg homework-help questions to self-sufficient HTML files

45
Emerging
412 serpapi/serpapi-javascript

Scrape and parse search engine results using SerpApi.

45
Emerging
413 l4rm4nd/LinkedInDumper

Python 3 script to dump/scrape/extract company employees from LinkedIn API

45
Emerging
414 TurnerSoftware/InfinityCrawler

A simple but powerful web crawler library for .NET

45
Emerging
415 sbmagar13/sharesansar_datascrape

Sharesansar Nepal NEPSE daily share price data scraping with Python. Scrapes...

45
Emerging
416 satyawikananda/rs-bed-covid-indo-api

API ketersediaan rumah sakit dan tempat tidur rumah sakit untuk pasien...

45
Emerging
417 alexwlchan/library-lookup

Finding books that are available in nearby branches of my public lending library

45
Emerging
418 proxymesh/scrapy-proxy-headers

Handle custom proxy headers when making HTTPS requests through proxies in scrapy

45
Emerging
419 Ram-95/Indeed_Job_Scraper

:briefcase: Given the Skill and the Location, this script will scrape the...

45
Emerging
420 madhurimarawat/Web-Scrapper-Functions

Streamlit-based Python web scraper for text, images, and PDFs. User-friendly...

45
Emerging
421 StopMakingThatBigFace/node-wreq

Typescript browser fingerprint bypass library using Rust for native...

45
Emerging
422 psf/requests-html

Pythonic HTML Parsing for Humans™

45
Emerging
423 Agenty/scrapingai

Build web scraping agents using AI to auto-extract the data from websites,...

45
Emerging
424 danielnieto/scrapman

Retrieve real (with Javascript executed) HTML code from an URL, ultra fast...

45
Emerging
425 roshanlam/Spider

Web Crawler built using asynchronous Python and distributed task management...

45
Emerging
426 datawizard1337/ARGUS

ARGUS is an easy-to-use web scraping tool. The program is based on the...

45
Emerging
427 wyu-du/StockForecast

:dart: predict the price trend of individual stocks using deep learning and...

45
Emerging
428 prdpx7/webdict

Fetch definition/meaning of words from dictionary.com and urbandictionary

45
Emerging
429 proxymesh/python-proxy-headers

Handle custom proxy headers when making HTTPS requests in python

45
Emerging
430 sh13y/Facebook-Video-Download-API

Production-ready Facebook Video Downloader API with web interface. Built...

45
Emerging
431 Oscarshu0719/weibo-web-crawler

Weibo web crawler. Download images and videos from specific users.

45
Emerging
432 online-judge-tools/oj

Tools for various online judges. Downloading sample cases, generating...

45
Emerging
433 glad94/infotennis

Python for scraping and processing tennis match data from the ATP Tour website.

45
Emerging
434 cotterell/bibscrap

Semi-automated tools for systematic literature reviews.

45
Emerging
435 ralyodio/humanparser

Parse a human name string into salutation, first name, middle name, last...

45
Emerging
436 antchfx/xquery

Extract data or evaluate value from HTML/XML documents using XPath

45
Emerging
437 devsebastian44/Web-Scraping

Script para la extracción de datos y URL de páginas web.

45
Emerging
438 pakagronglb/reddit-scraper

A powerful Reddit data scraping tool with a user-friendly Streamlit...

45
Emerging
439 itallstartedwithaidea/dealer_email_scraper

A powerful Node.js command-line tool that intelligently scrapes dealership...

45
Emerging
440 MajideND/scraping-reviews-from-googlemaps

This is a simple script with python to scrap Google Maps reviews and ratings.

44
Emerging
441 AlberLC/flanaapis

Set of functions that can be used as an imported library or as an api rest...

44
Emerging
442 wenyalintw/Google-Patents-Scraper

Automatically download all PDF files of searching results & their patent...

44
Emerging
443 JustSxm/Deals-Scraper

Deals Scraper is a Canadian tool to find good deals on websites like...

44
Emerging
444 BHM-Bob/BA_PY

BA_PY: Optimize Your Workflow with Python!

44
Emerging
445 yuvadm/viewstate

ASP.NET View State Decoder

44
Emerging
446 simon987/od-database

Distributed crawler, database and web frontend for public directories indexing

44
Emerging
447 OpenByteDev/SourceScraper

Simple library which helps you to retrieve the source of various video...

44
Emerging
448 mattyes/STM-webscrap-for-HomeAssistant

STM Metro Status is a Python project for residents of the Montreal region...

44
Emerging
449 jfilter/get-wayback-machine

Fetch a URL via the latest Wayback Machine snapshot

44
Emerging
450 sushil-rgb/AmazonMe

Introducing AmazonMe, a Python-based web scraper designed to extract data...

44
Emerging
451 Anish-Agnihotri/tweetdrop

Generate dispersable airdrops from Twitter threads.

44
Emerging
452 x-sk217/image-collector

Download images from Google Image Search

44
Emerging
453 dongweiming/daenerys

Scraping and Web Crawling Framework For Zhihu Live

44
Emerging
454 Kabi10/ratemyemployer

🏢 Modern employer review platform with advanced features: AI-powered...

44
Emerging
455 creekorful/bathyscaphe

Fast, highly configurable, cloud native dark web crawler.

44
Emerging
456 yazan-zoghbi/spido

Web crawler/spider for node.js & nest.js server

44
Emerging
457 cyterat/deepstate-map-data

DeepState Map | Occupied | GeoJSON Multipolygon | Daily update

44
Emerging
458 nedlir/languagepod101-scraper

Python scraper for Language Pods such as Japanesepod101.com :japanese_ogre:...

44
Emerging
459 amalrajan/learncpp-download

Multi-threaded web scraper to download all the tutorials from...

44
Emerging
460 volfpeter/graphscraper

Python 3 graph implementation designed to be turned into a web scraper for...

44
Emerging
461 medialab/artoo

artoo.js - the client-side scraping companion.

44
Emerging
462 vberlier/mcwiki

A scraping library for the Minecraft Wiki.

44
Emerging
463 suntong/cascadia

Go cascadia package command line CSS selector

44
Emerging
464 adamff-dev/spam-call-blocker-app

Open-source app that blocks spam calls. Includes customizable filters for...

44
Emerging
465 andrelmlins/previsao-ondas

🌊 Scraping de previsão de ondas no Brasil

44
Emerging
466 MickeyUK/map-email-scraper

A open source tool for collating publically available contact information...

44
Emerging
467 danclaudiupop/robox

Simple library for exploring/scraping the web or testing a website you’re developing

44
Emerging
468 crwlrsoft/robots-txt

Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping

44
Emerging
469 alex000kim/slack-gpt-bot

GPT4-powered Slack bot that can scrape URL contents

44
Emerging
470 SandyUndefined/Django-Search-Engine

Django Search Engine, Scrape links and text from different search engine as...

44
Emerging
471 saeeddhqan/evine

Interactive CLI Web Crawler

44
Emerging
472 MostafaGalal1/Secpar

Secpar is a Python command-line tool designed to scrape code submissions...

44
Emerging
473 Zane-/imgbot

Download image posts from subreddits.

44
Emerging
474 JSerwatka/Filmweb2Letterboxd

Eksport ocen z Filmweb'u do pliku csv w formacie akceptowanym przez importer...

44
Emerging
475 EKarton/UofT-Timetable-Generator

A web application that generates timetables for university students at the...

44
Emerging
476 scottgriv/python-pdf_web_scraper

🐍 Scrape a web page for PDF files and download them all to your local.

44
Emerging
477 scrapinghub/learn.scrapinghub.com

Scrapinghub Learning Center. Report issues in Jira: Report issues in Jira:...

44
Emerging
478 skytruine/OSpider

开源矢量地理数据获取与预处理工具(POI/AOI/行政区/路网/土地利用)

44
Emerging
479 deep5050/Abosar

অবসর 📚 A collection of short Bengali stories web scraped from various...

44
Emerging
480 fabyr/neageoflymapper

A tiny python program to download aerial photos from nea.geofly.eu

44
Emerging
481 YisusChrist/ososedki_dl

Blazing bulk web scraper for leak sites

44
Emerging
482 pablouser1/TikScraperPHP

Wrapper for TikTok API

44
Emerging
483 vijaykumarpeta/yt-comments-extractor

A modern Python GUI application to batch extract YouTube comments and...

44
Emerging
484 sky9154/MangaDownloader

A desktop application built with PySide6 to automate manga downloading from...

44
Emerging
485 oxylabs/product-integrations

Code examples and general information

44
Emerging
486 Lennolium/simple-useragent

Seamlessly fetch authentic and current user agents with ease.

44
Emerging
487 IamPritamAcharya/Alcademy

Alcademy is a production-grade academic platform for IGIT students that...

43
Emerging
488 hailoc12/docbao

Công cụ quét và phân tích từ khoá các trang báo mạng Việt Nam

43
Emerging
489 zdimension/graphrust

graph viewer

43
Emerging
490 ScrapingBee/scrapy-scrapingbee

JavaScript support and proxy rotation for Scrapy with ScrapingBee.

43
Emerging
491 danieldotnl/ha-multiscrape

Home Assistant custom component for scraping (html, xml or json) multiple...

43
Emerging
492 crawlbase/proxycrawl-python

ProxyCrawl Python library for scraping and crawling

43
Emerging
493 ahmedrangel/instagram-media-scraper

A simple Node.js code to get public information and media from every...

43
Emerging
494 Matthew1906/100DaysOfPython

This repository contains all my notes, exercises, and projects while...

43
Emerging
495 enghamzasalem/SouqScraper

Simple scripts for Level UP your scraping Skills, and source code for Level...

43
Emerging
496 hankehly/netkeiba

A reusable Django app which crawls and imports race data from netkeiba.com

43
Emerging
497 Decodo/SERP-Scraping-API

SERP Scraping API code examples for Python, PHP and Node.js

43
Emerging
498 IliaZenkov/async-pubmed-scraper

PubMed scraper for async search on a list of keywords and concurrent...

43
Emerging
499 hebertcisco/pensador-promise

Frases do Pensador via WebScraping: https://github.com/hebertcisco/pensador-api

43
Emerging
500 carpentries-incubator/lc-webscraping

Introduction to web scraping

43
Emerging
501 transitive-bullshit/scrape-github-trending

Tutorial for web scraping / crawling with Node.js.

43
Emerging
502 get-set-fetch/test-utils

Scraping test definitions for get-set-fetch node.js scraper and browser...

43
Emerging
503 okeefj22/whats-on-tv

TV Guide with a CLI.

43
Emerging
504 reljicd/spring-boot-web-scraper

Simple web scrapping app made using Spring Boot + Thymeleaf + Jsoup + Java 8...

43
Emerging
505 NotLe0n/tMLAPIs

a series of tmodloader apis to help make dynamic websites

43
Emerging
506 Arnie97/chrome-cookiejar

Import your Chrome cookies to a Python CookieJar

43
Emerging
507 justmarkham/trump-lies

Tutorial: Web scraping in Python with Beautiful Soup

43
Emerging
508 athityakumar/tvseries

TV Series is a tool that scrapes Episode Synopsis' of popular TV Series'...

43
Emerging
509 TheWebScrapingClub/AI-Cursor-Scraping-Assistant

A powerful tool that leverages Cursor AI and MCP (Model Context Protocol) to...

43
Emerging
510 techwizrd/MangaFox-Download-Script

A script that lets you download mangas from mangafox.com

43
Emerging
511 VernSG/Komiku-Rest-Api

Manga discovery and reading API built with Cheerio and Express. Uses data from Komiku

43
Emerging
512 nermalcat69/lightweight-tweet-scraper

Scrape Tweets while Scrolling

43
Emerging
513 meetmangukiya/instagram-scraper

Scrape the Instagram frontend. Inspired from twitter-scraper by @kennethreitz.

43
Emerging
514 galihap76/collector

Collector is a OSINT tool and information gathering. This tool can do...

43
Emerging
515 elpideus/tadako

An unofficial AnimeWorld API

43
Emerging
516 ZxZ7/ZFundPredictor

A Fund Price Prediction Framework (LSTM-based, web scraping included) 天天基金网爬虫+基金预测

43
Emerging
517 cyclone-github/spider

Spider - web crawler and local wordlist processor to generate frequency...

43
Emerging
518 dnuzi/code-collection

Free Codes By @Danu'Zz is a public collection of open-source codes, scripts,...

43
Emerging
519 staffanm/ferenda

Transform unstructured document collections to structured Linked Data

43
Emerging
520 JimmyLaurent/lycos

✨All the goodies you'll ever need to scrape the web (NodeJs / Browser)

43
Emerging
521 avilum/smart-url-fuzzer

Explore URLs of domains fast and efficiently using fuzzing techniques

43
Emerging
522 Ken-Chy129/python-music

基于 Python 的桌面音乐软件 | 爬虫搜索、在线播放、下载收藏、热门排行、数据可视化分析,Tkinter GUI + MySQL

43
Emerging
523 antiops/tiktok-trending-data

Scraping the TikTok discovery web API every 15 minutes using Github Actions...

43
Emerging
524 josw123/dart-scraper

한국 금융감독원에서 운영하는 다트(Dart) 시스템을 이용한 기업 재무제표 추출 프로그램

43
Emerging
525 DAILtech/PriceDive

PriceDive: 一个基于 Python 的电商价格追踪神器。自动监控淘宝、京东、拼多多商品价格,揭露“先涨后降”的促销套路。#Python #爬虫...

43
Emerging
526 itielshwartz/asyncio-hn

Python (asyncio) wrapper for hackernews api

43
Emerging
527 LordGhostX/animeX-v2

animeX is a CLI tool for downloading anime directly to your PC

43
Emerging
528 shaheen-syed/pygooglenewsscraper

Get Google News by scraping the search results.

43
Emerging
529 Anonyfox/elixir-scrape

Scrape any website, article or RSS/Atom Feed with ease!

43
Emerging
530 rharish101/dilbert-viewer

A simple comic viewer for Dilbert by Scott Adams

43
Emerging
531 seagatesoft/webdext

Intelligent Web Data Extractor

43
Emerging
532 sarthaknegi/easy_scrape

Scraping made easy

43
Emerging
533 fernandod1/Instagram-downloader

Instagram user's photos and videos downloader. Download all media files from...

43
Emerging
534 AtilioA/web-scraping-for-sentence-mining

⛏️ Scraping the web to automate creation of Anki cards.

43
Emerging
535 erictleung/pixarfilms

:movie_camera: R data package to explore Pixar films, the people, and reception data

43
Emerging
536 remotemerge/xpath-parser

JavaScript utility for extracting data from HTML and XML documents!

43
Emerging
537 outscraper/outscraper-ruby

The library provides convenient access to the Outscraper API from...

43
Emerging
538 aaronlyy/ventus

A Google Dorking Library & Command-Line Interface 🐲

43
Emerging
539 aaryanrr/DownDetector-CLI

CLI Client for DownDetector.com

43
Emerging
540 hooshid/imdb-scraper

Library for retrieving movie, tv series information from imdb.com

43
Emerging
541 edoardottt/gochanges

**[ARCHIVED]** website changes tracker 🔍

43
Emerging
542 DwarfThief/Raspagem-de-dados-para-iniciantes

Raspagem de dados para iniciante usando Scrapy e outras libs básicas

43
Emerging
543 mixa2130/strava

Asynchronous library based on asyncio and aiohttp for web-scraping data from Strava

43
Emerging
544 webmiddle/webmiddle

Node.js framework for modular web scraping and data extraction

43
Emerging
545 HRN-Projects/amazon-captcha-solver

A TensorFlow (Deep Learning - CNN) based solution for tackling captcha when...

43
Emerging
546 adrianhajdin/pricewise

Dive into web scraping and build a Next.js 13 eCommerce price tracker within...

43
Emerging
547 zyocum/reader

Extract clean(er), readable text from web pages via Mercury Web Parser.

43
Emerging
548 scrapy/scrapy-bench

A CLI for benchmarking Scrapy.

43
Emerging
549 MontFerret/cli

Ferret CLI

43
Emerging
550 Keep-Current/web-miner

Crawls sites, to find new content and scrap it

43
Emerging
551 scrapehero-code/amazon-scraper

A simple web scraper to extract Product Data and Pricing from Amazon

43
Emerging
552 AstraBert/scpr

Web scraper CLI and MCP built for human and coding agents

43
Emerging
553 kkrugler/flink-crawler

Continuous scalable web crawler built on top of Flink and crawler-commons

43
Emerging
554 microfisher/Strong-Web-Crawler

基于C#.NET+PhantomJS+Sellenium的高级网络爬虫程序。可执行Javascript代码、触发各类事件、操纵页面Dom结构。

43
Emerging
555 zkqiang/awesome-python-primer

自学入门 Python 优质中文资源索引,包含 书籍 / 文档 / 视频,适用于 爬虫 / Web / 数据分析 / 机器学习 方向

43
Emerging
556 searchformyusername/fastProxy

MultiThreaded Application to Scrape Working Web Proxies

42
Emerging
557 lgaalves/AppliedMathSchoolLectures

Lectures on "crime and political corruption analysis using data mining,...

42
Emerging
558 ahmedshahriar/youtube-comment-scraper

This script will dump youtube video comments to a CSV from youtube video...

42
Emerging
559 Diggernaut/configs

Public, free to use, repository with diggers configs for scraping /...

42
Emerging
560 dojutsu-user/IMDB-Scraper

Scrapy project for scraping data from IMDB with Movie Dataset including...

42
Emerging
561 cycle20/EZCancerTarget

Collect drug compound data based on editable target table and scan various...

42
Emerging
562 OSINT-TECHNOLOGIES/dpulse

DPULSE - Tool for complex approach to domain OSINT

42
Emerging
563 dbeley/rymscraper

Python library to extract data from rateyourmusic.com.

42
Emerging
564 afnx/dream-job

AI-Powered Job Search Tool

42
Emerging
565 brightdata/geo-ai-agent

AI-powered tool to audit and optimize website content by crawling URLs,...

42
Emerging
566 evyatarmeged/Humanoid

Node.js package to bypass CloudFlare's anti-bot JavaScript challenges

42
Emerging
567 pmagtulis/supremecourt-ph-scraper

A scraper for the Philippine Supreme Court website

42
Emerging
568 TiagoDanin/ScraperScript

ScraperScript is a query language for Web Scraping

42
Emerging
569 privacy-tech-lab/gpc-web-crawler

GPC Web Crawler for detecting websites' compliance with GPC privacy...

42
Emerging
570 Decodo/Python-scraper-tutorial

A short introduction to scraping with Python with given steps and an example...

42
Emerging
571 Jose05Code/dmoj-scraper

A Python script to extract and organize solved problems from DMOJ on your...

42
Emerging
572 codingforentrepreneurs/Python-with-Google-Colab-Sheets-Drive

Learn how to use Python to load, adjust, and change data from both Google...

42
Emerging
573 huynlx/Extensions-Viet

Paperback - Vietnamese - Extensions

42
Emerging
574 Poyu123/smart-fund-tracker

A high-performance personal fund tracker focused on providing real-time net...

42
Emerging
575 project-mk-ultra/torrent-tracker-scraper

A UDP torrent tracker scraper library written in Python 3

42
Emerging
576 scrapfly/n8n-nodes-scrapfly

Scrapfly n8n integration

42
Emerging
577 awcook97/Pure-Python-Back-SEO

Back SEO Agencies (Local Client Reporting Made Easy & Open Source)

42
Emerging
578 k0r0pt/Project-Tauro

A Router WiFi key recovery/cracking tool with a twist.

42
Emerging
579 orsifrancesco/instagram-without-api

A simple PHP code to get unlimited instagram public pictures by every user...

42
Emerging
580 0xnu/amazon_scraper

Scrape Amazon product data such as Product Name, Product Images, Number of...

42
Emerging
581 martiinii/UltraStar-CLI

Download any song from biggest database of UltraStar songs for your karaoke party!

42
Emerging
582 Jimut123/jimutmap

API to get enormous amount of high resolution satellite images from...

42
Emerging
583 nicoloboschi/protatoquests

Automatic proxy rotation for anonymous web requests.

42
Emerging
584 PaperBoardOfficial/webserp

Multi-engine web search CLI — queries Google, DuckDuckGo, Brave, Yahoo,...

42
Emerging
585 ukyoda/ogpParser

Open Graph Protocol Parser for Node.js

42
Emerging
586 Tazeg/sample-web-scraping-with-electron

Sample project for web scraping with Electron

42
Emerging
587 Y0oshi/Project-Eyes-On

Project Eyes On is a high-speed, multi-threaded surveillance tool by Y0oshi...

42
Emerging
588 fedecalendino/nintendeals

Library with a set of tools for scraping information about Nintendo games...

42
Emerging
589 miukyo/aniyoi-api

REST API Anime Subtitle Indonesia | Streaming Anime Sub Indo

42
Emerging
590 gidlov/copycat

A PHP Scraping Class

42
Emerging
591 zaneriley/Home-Hunter

Find available property on SUUMO.

42
Emerging
592 Jkanon/webmagician-ui

An admin UI project for a configurable web crawler platform

42
Emerging
593 liranbg/linkedin-learning-downloader

Linkedin Learning videos downloader

42
Emerging
594 jamesturk/spatula

A modern Python library for writing maintainable web scrapers.

42
Emerging
595 roofman2008/Pahe.ph-Scraper

Pahe.ph [Pahe.in] Movies Website Scraper

42
Emerging
596 cpatrickalves/scraping-etsy

A set of Spiders to gather product's data from Etsy Website.

42
Emerging
597 dismantl/CaseHarvester

AWS-based application for scraping the Maryland Judiciary Case Search

42
Emerging
598 jakopako/croncert-config

configuration and github actions for concertcloud.live (fka croncert.ch), a...

42
Emerging
599 crawlee-cloud/crawlee-cloud

Self-hosted, open-source platform for running Apify Actors. Drop-in...

42
Emerging
600 kokokuo/scraper-fourone-jobs

This is a anti-scraping cracker for extracting apply information of one of...

42
Emerging
601 oxffaa/gopher-parse-sitemap

A high effective golang library for parsing big-sized sitemaps and avoiding...

42
Emerging
602 leopardslab/CrawlerX

CrawlerX - Develop Extensible, Distributed, Scalable Crawler System which is...

42
Emerging
603 Zwork101/fodio

A scraping library made to be simple and asynchronous | Docs ->

42
Emerging
604 Notifysolutions/request_curl

user friendly wrapper for pycurl

42
Emerging
605 NISH1001/medium-crawler

A crawler for scraping posts from medium.com

42
Emerging
606 Peter-SB/n8n-ai-instagram-scraper

Self hosted AI workflow for scraping Instagram Reels (audio and...

42
Emerging
607 AprilNEA/XJTLU

This is how to get all the network resources of XJTLU.

42
Emerging
608 ystemsrx/Porn-Novel-Scraper

A script that can be used to capture various porn novels for machine...

42
Emerging
609 ivbeg/lazyscraper

Lazy helper tool to make easier scraping with simple tasks

42
Emerging
610 Decodo/Web-Scraping-API

Web Scraping API code examples for Python, PHP and Node.js

42
Emerging
611 Agreon/game-watch

Overview of game release dates, prices and news

42
Emerging
612 serpapi/serpapi-golang

Official Golang wrapper for SerpApi HTTP endpoints

42
Emerging
613 salvaba94/AutoTor

Simple package to make requests throughout Tor with circuit renewal.

42
Emerging
614 Python-World/Joble

This Platform Search Thousands Of Job Boards In Different Technologies From...

42
Emerging
615 tracking-exposed/trex

youtube & tiktok analysis + youchoose recommendation custmizer. backend,...

42
Emerging
616 outscraper/outscraper-java

The library provides convenient access to the Outscraper API from...

42
Emerging
617 geotribu/ign-fr-opendata-download-ui

Scripts d'extraction des liens open data de l'IGN France pour les présenter...

42
Emerging
618 ket0x4/dave.ai

Overengineered telegram bot that functions as a chatbot

42
Emerging
619 shurco/goClone

🌱 goClone - clone websites in seconds

42
Emerging
620 letr007/CCTVVideoDownloader

一款适用于央视网的网络视频流解析处理工具

42
Emerging
621 J-Lindvig/Fuelprices_DK

Scraping of 5 types of fuel :fuelpump: from 8 different fuelcompanies in...

42
Emerging
622 weicanie/deepwiki-down

Quickly Convert the deepwiki site to markdown files, super fast.

42
Emerging
623 tkattkat/google-search-scraper

TypeScript library for Google search scraping using http requests with proxy...

42
Emerging
624 Hecate2/Ignareo-ISML-auto-voter

Ignareo the Carillon, a web crawler/spider template of ultimate high...

42
Emerging
625 Jefersonalves/fala-parlamentar

Módulo para obtenção dos discursos dos parlamentares via webscraping...

42
Emerging
626 TeamXGroup/AFCON23-Streamlit-Dashboard

Interactive Streamlit Dashborad of Africa Cup of Nations 2023

42
Emerging
627 apify/apify-zapier-integration

Apify integration for Zapier

42
Emerging
628 devblack/curlx

CurlX a basic Curl syntax

42
Emerging
629 matejbasic/PythonScrapyBasicSetup

Basic setup with random user agents and IP addresses for Python Scrapy Framework.

42
Emerging
630 labteral/bluebird

Unofficial Python client for Twitter

42
Emerging
631 irevenko/info-bot

🤖 A Versatile Telegram Bot

42
Emerging
632 xiayouran/Musicer

旨在将网易云、酷狗、QQ、酷我等各音乐平台集于一体

42
Emerging
633 zytedata/spidyquotes

Example site for web scraping tutorials

42
Emerging
634 calebwin/frequent

A utility for crawling websites and building frequency lists of words

41
Emerging
635 AmadeusITGroup/CrawlerBox

CrawlerBox is an automated analysis framework designed for parsing emails...

41
Emerging
636 robalb/ebpf-web-fingerprint

a golang library and webserver for fast TCP & TLS fingerprinting, powered by eBPF

41
Emerging
637 TheKangChen/airtable-scraper

A package used to scrape public Airtables.

41
Emerging
638 sholajegede/convex-bright-data-datasets

Convex component that wraps Bright Data's Datasets API. Trigger async...

41
Emerging
639 zaydodonovan/OpFundAI7

A fully automated Python system for managing YouTube and social media...

41
Emerging
640 Kirscher/ResultAthle

Scraping, visualisation et analyse de résultats d'athlétisme depuis le site...

41
Emerging
641 alexfazio/devdocs-to-llm

Turn any developer documentation into a GPT

41
Emerging
642 leoncvlt/loconotion

📄 Python tool to turn Notion.so pages into lightweight, customizable static websites

41
Emerging
643 roach-php/laravel

Laravel adapter for Roach, the complete web scraping toolkit for PHP.

41
Emerging
644 mazzzystar/Proxy

A simple tool for fetching usable proxies from several websites.

41
Emerging
645 GeoRouv/crawldiff

📜 git log for any website. Track changes with AI-powered summaries. Powered...

41
Emerging
646 naseridev/magnet

Industrial Strength GitHub Repository Scraper

41
Emerging
647 a-luna/vigorish

MLB data web scraper, Python CLI application

41
Emerging
648 capsolver/n8n-nodes-capsolver

The official CapSolver community node for n8n. This node allows you to...

41
Emerging
649 sukhcha-in/dart_web_scraper

Powerful, easy-to-use scraper for web pages and APIs. Chain parsers and...

41
Emerging
650 adblockradio/webradio-metadata

Collection of scraping recipes to get metadata about what is being streamed...

41
Emerging
651 duongducnguyen/proxy-data-saver

A Windows proxy control station that routes only selected domains through...

41
Emerging
652 aantron/lambdasoup

Functional HTML scraping and rewriting with CSS in OCaml

41
Emerging
653 watzon/arachnid

Powerful web scraping framework for Crystal

41
Emerging
654 EdJoPaTo/website-stalker

Track changes on websites via git

41
Emerging
655 Ronchy2000/Visitor-Counter-Cheater

刷网页访问量 CSDN Github 博客 访问数量增加

41
Emerging
656 rookmoot/proxifier

A fast, modern and intelligent proxy rotator perfect for crawling and...

41
Emerging
657 promisingcoder/MetaAdsCollector

Collect ads from Meta Ad Library. No API key required. Reverse-engineers the...

41
Emerging
658 luminati-io/eCommerce-dataset-samples

A collection of multiple e-commerce dataset samples. Each sample contains...

41
Emerging
659 mattkerlogue/google-covid-mobility-scrape

Script for scraping Google's COVID19 Community Mobility Reports [ARCHIVED]

41
Emerging
660 armand1m/papercut

Papercut is a scraping/crawling library for Node.js built on top of JSDOM....

41
Emerging
661 kirillignatyev/wildberries-parser-in-python

WildBerries Parser is a Python script that extracts item information from...

41
Emerging
662 HelloChatterbox/PyWikiHow

scrap wiki how for info

41
Emerging
663 mehmetozkaya/DotnetCrawler

DotnetCrawler is a straightforward, lightweight web crawling/scrapying...

41
Emerging
664 apify/actor-content-checker

You can use this act to monitor any page's content and get a notification...

41
Emerging
665 TiesdeKok/LearnPythonforResearch

This repository provides everything you need to get started with Python for...

41
Emerging
666 RoloEdits/scrapetoon

A tool for scraping information from Webtoons.

41
Emerging
667 DiegoCaraballo/Email-extractor

The main functionality is to extract all the emails from one or several URLs...

41
Emerging
668 zTgx/xplore

Xplore is a scraper for Twitter/X without using API in Rust.

41
Emerging
669 afrontend/dongnelibrary

도서관 책을 빌릴 수 있는지 확인하는 유틸리티

41
Emerging
670 raymelon/tagalog-dictionary-scraper

Builds a Tagalog dictionary by collecting Tagalog words from...

41
Emerging
671 debugtalk/WebCrawler

A web crawler based on requests-html, mainly targets for url validation test.

41
Emerging
672 schoenbergerb/noscrape

This repository is deprecated

41
Emerging
673 prkedia81/jufinance

Python package to access Indian Stock market data. This is for educational...

41
Emerging
674 meysam81/sitemap-harvester

Crawl sitemap of a given website and export metadata of its pages...

41
Emerging
675 speed/newcrawler

Free Web Scraping Tool with Java

41
Emerging
676 umangahuja1/Champ

A Telegram bot combined with python to serve some basic functions like...

41
Emerging
677 s-alexander-s/upwork-scraping

UpWork scraping

41
Emerging
678 ZenRows/scaling-to-distributed-crawling

Repository for the Mastering Web Scraping in Python: Scaling to Distributed...

41
Emerging
679 Ishanoshada/Srilanka-Lottery

Scrape Sri Lanka lottery results from NLB and DLB websites with this Python package

41
Emerging
680 starboi-63/growth-stock-screener

An automated stock screening system which isolates top companies based on...

41
Emerging
681 sahitpj/India-WhatsAppFakeNews-Dataset

WhatsApps related deaths News Articles along with other articles across...

41
Emerging
682 oklabflensburg/open-playgrounds-map

Interaktive webbasierte Karte mit Spielplätzen der Stadt Flensburg

41
Emerging
683 astrosander/cambridge-dictionary-audio

Scrape Cambridge Dictionary pronunciation MP3s in one click

41
Emerging
684 apurvsinghgautam/PastebinScrapy

Threat hunting tool for scraping latest scrapes from Pastebin

41
Emerging
685 ahmedshahriar/depression-tweets-scraper

A Scraper that scrapes '#depression' tweets daily powered by GitHub action...

41
Emerging
686 brightdata/sdk-js

Bright Data's JS SDK, use it to call bright data's scrape and search tools....

41
Emerging
687 mike-gee/webtranspose

Web scraping API for building AI applications.

41
Emerging
688 my8100/scrapyd-cluster-on-heroku-scrapyd-app

How to set up Scrapyd cluster on Heroku

41
Emerging
689 Kuucheen/magpie

Multi-user AIO Proxy Manager

41
Emerging
690 hemanta212/Nepali-news-portal-kbd

Online webapp that scrapes news from different new portals of Nepal and...

41
Emerging
691 YisusChrist/spankbang-dl

A download tool for Spankbang

41
Emerging
692 nicolaiprodromov/nordhell

an easy-to-use & scalable system for managing multiple concurrent VPN...

41
Emerging
693 Decodo/n8n-nodes-decodo

n8n integration with Decodo services, enabling automated web scraping and...

41
Emerging
694 phuocding/master-to-pythonista

A list of awesome beginners-friendly projects.

41
Emerging
695 Disane87/docudigger

Website scraper for getting invoices automagically as pdf (useful for taxes or DMS)

41
Emerging
696 anburocky3/mp3-downloader

Download Thousands of MP3 in single click! Supports Tamil, Telugu, Malayalam & Hindi.

41
Emerging
697 zkqiang/crawler-chrome-extensions

爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer

41
Emerging
698 kuwala-io/kuwala

Kuwala is the no-code data platform for BI analysts and engineers enabling...

41
Emerging
699 darwiish1337/scraper_md

Scalable e-commerce scraper for Amazon, Noon, AliExpress, Jumia, eBay, and...

41
Emerging
700 fernandod1/ProductHunt-scraper

Producthunt.com famous website scraper script. Scrap all offers and save in...

40
Emerging
701 BirdsAreFlyingCameras/WebParse

A web parsing script to extract names, addresses, phone numbers, and emails...

40
Emerging
702 juliensalinas/torrengo

Torrengo is a CLI (command line) program written in Go which concurrently...

40
Emerging
703 danmorse314/hockeyR

Collect and Clean Hockey Stats

40
Emerging
704 bisohns/search-engine-parser

Lightweight package to query popular search engines and scrape for result...

40
Emerging
705 EduardLupu/spotify-artists

world's top 500 artists.

40
Emerging
706 tsurupin/job_search

An app to search startup jobs scraped from websites written in Elixir,...

40
Emerging
707 gpassero/uol-redacoes-xml

O banco de redações da UOL (http://educacao.uol.com.br/bancoderedacoes/) em...

40
Emerging
708 Jemzx211/appents-social-downloader

Chrome browser extension that saves Instagram / X (Twitter) posts locally,...

40
Emerging
709 jmyrberg/finscraper

Web scraping API for Finnish websites

40
Emerging
710 zaidkx37/tubescrape

A fast, lightweight Python toolkit for scraping YouTube without an API key....

40
Emerging
711 gotlougit/midjourney-gallery-downloader

Download Midjourney Showcase images automatically

40
Emerging
712 Laurentvw/scrapher

A web scraper for PHP to easily extract data from web pages

40
Emerging
713 justserpapi/justserpapi-python

Python SDK for JustSerpAPI Google APIs: Google Search, News, Images, Videos,...

40
Emerging
714 N4rr34n6/RobloxUserInfoExtractor

RobloxUserInfoExtractor is a powerful tool designed to retrieve...

40
Emerging
715 krishna-aditi/nlp-sentiment-analysis-on-stock-news-and-price-monitoring

WebApp to bring together Text Summarization and Sentiment Analysis of the...

40
Emerging
716 Florents-Tselai/PyCarGr

PyCarGr - Unofficial car.gr API

40
Emerging
717 joe-habel/YouTube-View-Bot

A rotating proxy solution to bot YouTube views

40
Emerging
718 sudhamjayanthi/upwork-job-scraper

Browsing jobs on upwork is time-consuming!!! How about checking them out...

40
Emerging
719 Denperidge/facebook-event-aggregator

Scrape all upcoming events from specific FB pages, export them to a static...

40
Emerging
720 sholajegede/convex-bright-data

Cache Bright Data SERP and Web Unlocker results in Convex with configurable...

40
Emerging
721 brianmadden/krawler

A web crawling framework written in Kotlin

40
Emerging
722 Murrough-Foley/rs-trafilatura

Fast, accurate web content extraction in Rust. ML page-type classification,...

40
Emerging
723 N4rr34n6/OnionScanner

An enhanced version of the OnionScanner tool for scanning and analyzing...

40
Emerging
724 Bishalsarang/Leetcode-Questions-Scraper

Scrape Algorithm Questions from leetcode and generate html and epub file

40
Emerging
725 amitness/Thar

Mining all surnames used in Nepal.

40
Emerging
726 CNuge/email-report

A modular template for scraping data from the web to send yourself scheduled...

40
Emerging
727 serpapi/serpapi-search-rust

Search results in Rust powered by SerpApi.com

40
Emerging
728 rdlopes/WebHere

HTML scraping for Objective-C.

40
Emerging
729 superryeti/Instagram-Follower-Scraper

Scrapes all the data of followers of any instagram account

40
Emerging
730 armiro/crawlers

A bunch of crawlers for extracting data from various sites (site name is...

40
Emerging
731 claromes/volleystats

🏐 Command-line tool to scrape volleyball statistics from Data Project Web...

40
Emerging
732 scrapehero/zillow_real_estate

Zillow.com Web Scraper written in Python and LXML to extract real estate...

40
Emerging
733 deep5050/jobful-api

A RESTful API to fetch latest job notifications(INDIA only) from various sources.

40
Emerging
734 schedutron/chirps

Twitter bot powering @arichduvet

40
Emerging
735 kurt213/scraper-auto-trader

A web scraper for extracting car ads data from Auto Trader

40
Emerging
736 alfiepoleon/kenya-news-scrapper

It scrapes various kenyan news sites and returns top news from each and a...

40
Emerging
737 MS3B09/Botola-Scout

Interactive Football Scouting Web App for BotolaPro Moroccan League using Streamlit

40
Emerging
738 KillovSky/Trendings

Repositório do módulo scrapper para obtenção de trendings do Twitter.

40
Emerging
739 hermit-crab/ScrapeMate

Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.

40
Emerging
740 qascade/yast

Yet Another Streaming Tool

40
Emerging
741 bagusindrayana/scraping-berita

scraping berita dari beberapa portal berita indonesia

40
Emerging
742 spk/validate-website

Web crawler for checking the validity of your documents.

40
Emerging
743 xandiboo/leaks

Compromised SSH servers and scraped mirror sites leaked scripts intended for...

40
Emerging
744 LeaFrock/SpiderX

A simple web-crawler development framework based on .Net Core.

40
Emerging
745 cityssm/wsib-clearance-check

A tool to programmatically scrape the clearance certificate status from the...

40
Emerging
746 teticio/lambda-scraper

Use AWS Lambda functions as a proxy pool to scrape web pages.

40
Emerging
747 IBMDeveloperUK/Golang-Web-Scraping

Learn how to scrape web content from HTML and see how web scraping differs...

40
Emerging
748 kevinyu0506/researchgate-crawler

A python spider for crawling Research Gate Papers.

40
Emerging
749 lspahija/torchestrator

Spin up Tor containers and then proxy HTTP requests via these Tor instances

40
Emerging
750 MohamedHmini/iww

AI based web-wrapper for web-content-extraction

40
Emerging
751 yields/ant

A web crawler for Go

40
Emerging
752 roach-php/core

The complete web scraping toolkit for PHP.

40
Emerging
753 aazirani/Python-Scraping-to-Database-Sample

Some sample code examples in Python to scrape data from the web and saving...

40
Emerging
754 hooshid/metacritic-scraper

Metacritic scraper for PHP

40
Emerging
755 Changwanseo/GenMine

GenBank Record downloader for taxonomists

40
Emerging
756 ianramzy/stock-news-analysis

📰 Web app built with Flask that given a stock ticker will scrape dozens of...

40
Emerging
757 sharmadhiraj/free-json-datasets

Collection of free JSON data that are scraped and parsed from different websites.

40
Emerging
758 hooshid/rottentomatoes-scraper

Rottentomatoes scraper for PHP

40
Emerging
759 aaronhoffman/WebsiteContactHarvester

Crawl websites for contact information. Extract email, phone, facebook, twitter.

40
Emerging
760 aishmittal/Product-Info-Crawler

Product-Info-Crawler is a python web crawler developed using scrapy...

40
Emerging
761 gupsammy/EzyCopy

Extract web content as clean markdown. CLI tool and Chrome extension.

40
Emerging
762 mattmurray/juno_crawler

Scrapy crawler to collect data on the back catalog of songs listed for sale.

40
Emerging
763 medialab/SearchEnginesBookmarklet

Extract list of results from search engines pages as CSV with a bookmarklet...

40
Emerging
764 bengmoh/AlRahmanMosque-website

A website I made for AlRahman Mosque non-profit organization; automatically...

40
Emerging
765 erseco/python-moodle

Pythonic CLI and library to manage Moodle instances via web sessions

39
Emerging
766 cboyd0319/JobSentinel

Self-hosted job search automation: scrape multiple boards, de-dupe, score to...

39
Emerging
767 GoApiGo/goapigo

Create API based on any html page using cssSelector and annotations

39
Emerging
768 pr0gramista/memes-api

API for scrapping common 🇵🇱 meme sites

39
Emerging
769 codewithnick/searchenginepy

search engine for python (Query and scrape search engines)

39
Emerging
770 CompileInc/hodor

🕷Configuration based html scraper

39
Emerging
771 dheavy/househunterbot

Use Python, Google Spreadsheet, Google Shortener and CALLR API to automate...

39
Emerging
772 novitae/njsparser

🦩 A NextJS data parser, to scrape peacefully

39
Emerging
773 viktor-shcherb/job-seek

Streamlit-based app for job portal scraping

39
Emerging
774 doodad-labs/disposable-email-domains

Automated hourly aggregate of disposable email domains including domains...

39
Emerging
775 Joel-hanson/Iceberg-locations

Current Antarctic large iceberg positions derived from ASCAT and OSCAT-2

39
Emerging
776 LakshyaKhatri/Bookshelf-Reader

An android application that provides information for books kept in a...

39
Emerging
777 strugee/fulldom-server

Proxy-like server that will show you the DOM of a page after JS runs

39
Emerging
778 MontFerret/ferret-server

Advanced declarative web scraping

39
Emerging
779 0xZDH/BridgeKeeper

Scrape, Hunt, and Transform names and usernames

39
Emerging
780 vitorbaptista/google-covid19-mobility-reports

Data extraction of Google's COVID-19 Mobility Reports

39
Emerging
781 pierlauro/playlist2links

This bash script allows to extract video links from a youtube playlist

39
Emerging
782 fufvocdi/Python

This repository contains the python source code, containing more than 40...

39
Emerging
783 hrbrmstr/htmlunit

🕸🧰☕️Tools to Scrape Dynamic Web Content via the 'HtmlUnit' Java Library

39
Emerging
784 lnishan/ChiChew

:notebook_with_decorative_cover: 教育部《重編國語辭典修訂本》 網路爬蟲 :: A live web crawler...

39
Emerging
785 AbstractGeek/comic-scraper

[Python] Scraps comics and manga from various websites and creates cbz files...

39
Emerging
786 Durhamster/TweetScraper

A simple script to scrape a list of accounts or single account from Twitter...

39
Emerging
787 achannarasappa/locust

Distributed web data discovery and collection framework built for serverless

39
Emerging
788 HouariZegai/web-scraping

Code samples of web scraping using Java.

39
Emerging
789 supergillis/crawler-ts

Crawler written in TypeScript using ES6 generators.

39
Emerging
790 DevAdeel/Video-Downloader

This is video downloader app based on JAVA language covering web-scrapping...

39
Emerging
791 prabincankod/rashifal-api

Unofficial Nepali Rashifal API which extracts horoscope predictions from...

39
Emerging
792 bAndie91/tools

all-in collection of productivity scripts, CLI tools, utility libraries,...

39
Emerging
793 spider-rs/spider-example-archiver

Crawl and archive websites in a VSCode-like code viewer. Powered by Spider Cloud.

39
Emerging
794 stl-public-meetings/city-scrapers-stl

Scrape, standardize and share public meetings from local government websites...

39
Emerging
795 leoncvlt/blinkist-scraper

📚 Python tool to download book summaries and audio from Blinkist.com, and...

39
Emerging
796 zioneo/webscrapper

Scrap BTC addresses and balances from bitkeys.work

39
Emerging
797 njraladdin/newspapers-com-scraper

A Node.js scraper for extracting article data from Newspapers.com based on...

39
Emerging
798 nothing-much-coder/viner

Monitor Amazon Vine queues for new items and display them in a browser tab

39
Emerging
799 hxseven/htmlSQL

htmlSQL is a experimental PHP library which allows you to access HTML values...

39
Emerging
800 JarbasAl/audiobooker

Audio Book scrapper

39
Emerging
801 Arman171/WebForensic

WebForensicAnalyzer is an advanced all-in-one tool for web reconnaissance,...

39
Emerging
802 DaniD3v/digiDownload

API to download books from https://digi4school.at

39
Emerging
803 palewire/fed-dot-plot-scraper

Extracting the "dot plot" economic projections posted online by the Federal...

39
Emerging
804 huynlx/MangaMAX

Ứng dụng đọc truyện không có chức năng gì ngoài đọc truyện....

39
Emerging
805 atasoglu/websense

A modular AI-powered web scraper for data pipelines.

39
Emerging
806 mathun3003/sightseeing-muenster

Image Classification Web App for Tourists of the City of Münster.

39
Emerging
807 blacknr51/ScrapiReddit

🔍 Scrape public Reddit listings effortlessly with Scrapi Reddit. Access...

39
Emerging
808 SanjaySunil/email-scraper

Generate thousands of temporary emails within seconds!

39
Emerging
809 fcannizzaro/jsoup-annotations

Jsoup Annotations POJO

39
Emerging
810 kareemsasa3/scraper

A resilient, concurrent web scraper service built in Go, featuring a REST...

39
Emerging
811 toriium/turbocrawler

Scraping and Crawling Micro-Framework written in python

39
Emerging
812 agnosto/fansly-scraper

An all-in-one scraper/downloader for Fansly written in go with the aid of...

39
Emerging
813 madebyarthouse/rental-monitor

Application for scraping, analyzing and visualizing rental listings in Austria

39
Emerging
814 laurentvv/crawl4ai-mcp

Web crawling tool that integrates with AI assistants via the MCP

39
Emerging
815 jakobx0/FerrumWeb

Web crawler: Visits a given webpage and recursively lists all links connected to it.

39
Emerging
816 cldellow/datasette-scraper

Add website scraping abilities to Datasette

39
Emerging
817 kawsarlog/Ultimate-API-List

A massive, auto-updated directory of more than 10,000 public APIs for...

39
Emerging
818 cyber-tao/comments-insight

A Chrome extension that extracts and analyzes comments from any website...

39
Emerging
819 corralm/ted-scraper

🎙️ TED Talks web scraper

39
Emerging
820 digitalmethodsinitiative/dmi-instascraper

A GUI for Instaloader to scrape users and hashtags with on Instagram

39
Emerging
821 silverbirder/chrome-extensions-tiktok-scraping-downloader

This is a Chrome extensions that scrapes and posts Tiktok web pages.

39
Emerging
822 BjornMelin/ai-job-scraper

🕵️‍♂️ Privacy-focused AI job scraper, local storage, and interactive...

39
Emerging
823 DouglasTaylorSupportGroup/EinsteinBot

🤖 A Discord bot that allows you to access solutions to homework problems from Chegg.

39
Emerging
824 morpheusthewhite/jwscraper

A python library for scraping videos from JW Player

39
Emerging
825 KalyanM45/Article-Web-Scraping

This Python script is designed to scrape articles from The Guardian's...

39
Emerging
826 yashpokar/amazon-crawler

Amazon listing pages and detailing pages crawler

39
Emerging
827 Simple-Python-Scrapy-Scrapers/ebay-scrapy-scraper

A powerful eBay scraper built with Scrapy that extracts product listings,...

39
Emerging
828 yousefkotp/Movies-and-Series-Scraper

A console application to scrape a valid watching links for any movie or...

39
Emerging
829 linkpreview/linkpreview

Open Graph, Twitter Card, Oembed preview. Shows visual cards that mimic link...

39
Emerging
830 kiraaziz/mangahook-api

free open source manga api , including fetch all manga , single manga also...

39
Emerging
831 scrapehero-code/amazon-review-scraper

A basic python 3 based web scraper for extracting reviews from Amazon. Built...

39
Emerging
832 dstark5/gnews-scraper

GNewsScraper is a TypeScript package that scrapes article data from Google...

39
Emerging
833 nilfoer/gwaripper

Tool for conveniently downloading audios from r/gonewildaudio and similar subreddits

39
Emerging
834 columnistos/columnistos

Código de @columnistos y sus hermanas

39
Emerging
835 FujiwaraChoki/LeadGen

This program uses a GoLang Google Maps Scraper to scrape Google Maps for...

39
Emerging
836 victorqribeiro/scrap

Scrapping Facebook with JavaScript.

39
Emerging
837 somdeep/Statball

Statball - Football soccer stats analyser from top 5 european leagues with...

39
Emerging
838 digitalcortex/72m-domains-dataset

Dataset with unique registered domains extracted from Common Crawl's...

39
Emerging
839 pippim/mserve

Music Player with CD encoding, lyrics download and synchronizing

39
Emerging
840 opensite-ai/domain_extractor

🔗 Lightweight Ruby library for parsing URLs and extracting domain components...

39
Emerging
841 Anonyfox/magpie-html

Modern web scraping for when you need the good parts, not the markup soup.

39
Emerging
842 ranshaa05/WaifuLabs-Bot

A fully-featured Discord bot that runs https://www.waifuLabs.com within Discord

39
Emerging
843 Tetrax-10/Tamil-dubbed-Movies-and-TV-shows-database

A nodejs script that scrapes IsaiDub website for Tamil dubbed Movies and TV shows

39
Emerging
844 aFunnyStrange/scrapy_cffi

An asyncio-style web scraping framework inspired by Scrapy, powered by...

39
Emerging
845 Ar1sto/RavenHunter

RavenHunter is a tool designed to scrape all available documents ever...

38
Emerging
846 bitmakerla/estela-entrypoint

estela entrypoint for job runner 🕸

38
Emerging
847 serhattsnmz/turtle

Instagram Photo Downloader

38
Emerging
848 the-eater/camp-collective

An incomplete bandcamp python toolset (mainly downloads your collection)

38
Emerging
849 MultiX0/froxy

🕸️ Froxy – A chill open-source web indexing engine built with Go, Node.js,...

38
Emerging
850 serplay/manhwa-downloader

Website allowing scraping manga/manhwa chapters and downloading them into pdf

38
Emerging
851 zydo/topicstreams

Real-time news aggregation system that scrapes Google Search for custom...

38
Emerging
852 iseizuu/umamusume-api

Uma musume Rest API using data scrapper

38
Emerging
853 filp/oversmash

Overwatch API library for player details and career stats

38
Emerging
854 vlourme/yahoo-auction-alert-discord-bot

Get a Discord alert when a new item is posted on Yahoo Auction or Mercari

38
Emerging
855 akshitvjain/restaurant-finder-featureReviews

Build a Flask web application to help users retrieve key restaurant...

38
Emerging
856 jgontrum/aiohttp-scraper

A robust asynchronous web scraping client using aiohttp.

38
Emerging
857 dendrite-systems/dendrite-python-sdk

Tools to build web AI agents that can authenticate, interact with and...

38
Emerging
858 BobJr23/MTGA_Swapper

Edit, Swap, or Export any assets in MTG Arena (Sleeves, Card Art,...

38
Emerging
859 lhotanok/zalando-scraper

Apify actor extracting data from Zalando

38
Emerging
860 jonbiemond/BCIT-Flex

A website for easily navigating BCIT courses and offerings.

38
Emerging
861 refeed/scrapy_facebooker

Collection of scrapy spiders which can scrape posts, images, and so on from...

38
Emerging
862 KazKozDev/llmflow-search

LLMFlow Search agent processes complex queries, deep searches, and...

38
Emerging
863 edamontology/pubfetcher

A Java command-line tool and library to download and store publications with...

38
Emerging
864 Ruy-Araujo/Linkedin-Jobs-Scraper

A Python web scraper using Scrapy to collect job posting information from LinkedIn.

38
Emerging
865 NahomAl/ethiobank_receipts

Fast and reliable Python library to extract and verify payment receipts from...

38
Emerging
866 Darren-Li/Python

Python相关项目

38
Emerging
867 medjahdi/DeepVex

Fast web reconnaissance tool for security professionals - endpoint...

38
Emerging
868 pgomba/MDPI_explorer

A simple package to explore MDPI´s articles by journal. A series of...

38
Emerging
869 brunobastosg/scraping-hidroweb

Scraping dos dados do Portal HidroWeb

38
Emerging
870 Codebotics/VITask

VITask is a Dynamic API server for VTOP with Moodle Integration. This...

38
Emerging
871 iplocate/free-proxy-list

⚡️ Free Verified HTTP, SOCKS5, & SOCKS4 Proxy List ⏰ Updated every 30 minutes

38
Emerging
872 bytewife/substack_scraper

A scraper for Substack article text content

38
Emerging
873 farukalpay/SMS-Sender

A Python program designed to send SMS messages to numbers through websites.

38
Emerging
874 Coder-Srinivas/Ipl-Auction

A MERN Stack Application designed to mimic the IPL Auction and fill the...

38
Emerging
875 mattdeitke/CVPR2019

Displays all the 2019 CVPR Accepted Papers in a way that they are easy to parse.

38
Emerging
876 fridasor/tabscraper

Read tabs from Ultimate Guitar in the terminal

38
Emerging
877 JanaSabuj/ParseMyCF-contest

A personal submission codeforces parser for CF, parsed by individual...

38
Emerging
878 imsteev/grailer

web scraping tool for grailed.com

38
Emerging
879 sfbrigade/data-covid19-sfbayarea

Manual and automated processes of sourcing data for the...

38
Emerging
880 DavideViolante/socialblade-com-api

Unofficial APIs for socialblade.com website.

38
Emerging
881 yusuftaufiq/laravel-books-api

Fully documented & tested Laravel 9 RESTful books API scraped from Gramedia.

38
Emerging
882 wetcork/raiplay-dl

The most advanced raiplay.it downloader

38
Emerging
883 microlinkhq/cloudflare-bot-directory

CloudFlare Radar verified bots directory – 500+ web crawlers and user agents as JSON.

38
Emerging
884 junguler/m3u-audiobooks

collection of 100k+ audio books, radio porgrams, music etc from archive.org...

38
Emerging
885 mihirs16/Coursera-Web-Scraper

A multiprocessing webscraper for Coursera.org to build a dataset for all...

38
Emerging
886 kishan0725/Movie-Recommendation-System-with-Sentiment-Analysis

Content based movie recommendation system with sentiment analysis

38
Emerging
887 MasFana/fana-cumik

FanaCumik is a modern manga aggregator designed to provide a seamless...

38
Emerging
888 Amey-Thakur/OPEN-SOURCE-TECH-LAB

CSL405: Open Source Technology Lab [OSTL] | SE Semester IV | Computer Engineering

38
Emerging
889 Hoshimya-Animation/hoshiiTelegramBot

A Telegram bot that fetches anime details from various APIs, including Jikan...

38
Emerging
890 smcclennon/ous

Scrape users in your Office 365 organisation

38
Emerging
891 hiroshil/MDM_server-fork

HydraX/Abyss downloader. Source Generated with pyinstxtractor+unpyc3....

38
Emerging
892 debsishu/Miyou

An anime discovery, streaming site made with React.js. It uses AniList API...

38
Emerging
893 greengod63/DexScreener-Scraping

When a specific token pair from DEX Screener is given, this script will...

38
Emerging
894 idkidkidkidkidkidkidkidk/gics-sentry-bot

尋找資安女婕思初賽PaGamO哨兵機器人

38
Emerging
895 wlzcaq-crypto/CYBER-CORE-Professional-Telegram-PARSER-Marketing-Tool

Professional Telegram Parser & Automation Tool

38
Emerging
896 theaifutureguy/gmgnai-scraping

This project is an API for the GMGN.AI platform that allows users to view...

38
Emerging
897 shallvhack/Flight-Tracker

Flight Tracker: Real-time flight updates and interactive map for seamless...

38
Emerging
898 oxylabs/web-scraping-tutorials

Web scraping, data parsing and automation tutorials. Suited for both...

38
Emerging
899 e43b/Kemono-and-Coomer-Downloader

The Kemono and Coomer Downloader simplifies downloading posts from Kemono...

38
Emerging
900 J-Lindvig/Pollen_DK

Scraping of pollen count in Denmark

38
Emerging
901 Gabrielcnetto/HLTV-api

Open-source, fast, and scalable API for fetching public HLTV data. Updated...

38
Emerging
902 HMarzban/pipe2time.ir

Web Crawler for Time.ir to Retrive JSON File, jalali, qamari, miladi JSON...

38
Emerging
903 Lich-Corals/ug-scraper-rs

A small crate to simplify tab downloading (scraping) in Rust.

38
Emerging
904 dorisoy/Scrapling

一个自适应Web Scraping框架,能处理从单个请求到大规模爬取的一切需求。 ...

38
Emerging
905 Hrushi11/Yellow-Pages-End-API

This repository contains the code for completely scraping the yellow pages...

38
Emerging
906 D3vd/Reddit_Image_Scraper

Simple program that downloads pictures from a specified subreddit.

38
Emerging
907 spk/maman

Rust Web Crawler saving pages on Redis

38
Emerging
908 stiles/locations

An expanding collection of data scrapers designed to gather location details...

38
Emerging
909 felipemfp/sinonimos

🇧🇷 Find synonyms without leaving your terminal

37
Emerging
910 Hsankesara/Tweets-Scrapper

Get all the tweets from your favorite twitter accounts.

37
Emerging
911 LSIND/advanced-python3

OOP in Python, working with SQL and NOSQL dbs, fetching HTML data

37
Emerging
912 ezzcodeezzlife/scraper-instagram

Scrape data from Instagram without applying for the authenticated API 🎯

37
Emerging
913 jpmondoni/instagram_explorer

:camera: An app to scrap instagram posts and analyze data.

37
Emerging
914 mehmetkahya0/Web-Resource-Downloader

This is a Python script that downloads all resources (images, scripts,...

37
Emerging
915 KanteLabs/supreme-api

NodeJS API wrapper built around https://supremenewyork.com that could be...

37
Emerging
916 bahaeddinmselmi/siteforge-chrome-extension

SiteForge is a **client-side Chrome extension** that takes a live website...

37
Emerging
917 DataHenHQ/till

DataHen Till is a companion tool to your existing web scraper that instantly...

37
Emerging
918 komaksym/UFC-DataLab

UFC Fights Dataset Collection and Analysis

37
Emerging
919 areebbeigh/anime-scraper

[partially working] Scrape and add anime episode stream URLs to uGet (Linux)...

37
Emerging
920 d4n3436/GScraper

A collection of search engine image scrapers (Google Images, DuckDuckGo and Brave)

37
Emerging
921 RozhakLabs/DeskIdentity

DeskIdentity adalah API backend berbasis Django untuk menghasilkan...

37
Emerging
922 crawlzone/crawlzone

Crawlzone is a fast asynchronous internet crawling framework for PHP.

37
Emerging
923 ThatSINEWAVE/Spy.pet-Info

This repository serves as an index for all info the community has gathered...

37
Emerging
924 mostlypanda/Node-js-functionalities

This repository contains very useful restful API's and functionalities in...

37
Emerging
925 ysdragon/ring-html

A high-performance HTML5 parser library with CSS selectors and DOM...

37
Emerging
926 SylvainDe/ComicBookMaker

Script to fetch webcomics and use them to create ebooks.

37
Emerging
927 kamolmachine/social-media-downloader-bot

📥 Bot for downloading any media from Instagram, Twitter and videos from...

37
Emerging
928 ExsoKamabay/Api-scrap

apikey search engine scraping methods

37
Emerging
929 KaidiGuo/keyword_based_Sina_weibo_crawler

A web crawler for Sina, search and retrieve microblogs that contain certain...

37
Emerging
930 siongui/instago

Download/access photos, videos, stories, story highlights, postlives,...

37
Emerging
931 michaeltelford/wgit

Wgit enables you to crawl and extract the data you want from the web

37
Emerging
932 OstinUA/App-Discovery-Parser-AppID-Extractor

🔍 Professional AdTech utility for automated AppID extraction. Scans...

37
Emerging
933 LarvenStein/better-stundenplan

Ein (hoffentlich) nicht ganz so schlechter Client für "virtueller-stundenplan.org"

37
Emerging
934 irasutoya-tools/irasutoya

:woman: Ruby library for いらすとや

37
Emerging
935 steder/spinneret

Spinneret is a web spider and dynamic load generator for testing,...

37
Emerging
936 xin-Easy/yuHai-ui

小红书数据采集,小红书采集,小红书爬虫,小红书运营,小红书自动化,小红书养号,小红书发布,小红书笔记,小红书评论,小红书数据分析,小红书数据看板,小红书可...

37
Emerging
937 floriandiud/instagram-users-scraper

Instagram Scraper. Scrape Instagram followers, following list, and post...

37
Emerging
938 Lookyloo/scraping-tutorial

This tutorial explains the benefits, pitfalls, and limitations of scraping,...

37
Emerging
939 crawlbase/proxycrawl-node

ProxyCrawl Node library for scraping and crawling

37
Emerging
940 gabriel-antonelli/extract-enem-data

Enem data archive and scraper

37
Emerging
941 juftin/yellowstone-camping

Campsite Reservation Cancellation Finder (Yellowstone National Park)

37
Emerging
942 simonsruggi/Airbnb-Free-High-Quality-Photo-Downloader

An extremely useful tool to download high quality photos from an Airbnb...

37
Emerging
943 L1shed/Turbo

Fastest and cheapest distributed residential proxy network.

37
Emerging
944 developer-student-club-thapar/botsFramework

The repository containing backend data for the Slack Information Bots for...

37
Emerging
945 nguyenminhlinh/recon

Automated reconnaissance tool for pentest

37
Emerging
946 yfe404/instagram-scraping

Python script to scrap deskgram (Deskgram is a desktop version of Instagram)

37
Emerging
947 cveira/social-media-scripting-framework

Social Media Scripting Framework

37
Emerging
948 lorey/social-media-profiles-regexs

:card_index: Extract social media profiles and more with regular expressions

37
Emerging
949 kehsihba19/inshorts-api

Built a restful api which fetches news articles from Inshorts app.

37
Emerging
950 AAnirudh07/Fake-News-Headlines-In-Tamil

Fake news headlines in the Tamil regional language.

37
Emerging
951 MikkoParkkola/nab

Ultra-minimal browser engine with HTTP/3, JS support, cookie auth, passkeys,...

37
Emerging
952 sphoneix22/italian_dictionary

Package that helps getting the meaning of italian words.

37
Emerging
953 chriskyfung/InstapaperScraper

Effortlessly scrape Instapaper bookmarks and format them into CSV, JSON, and...

37
Emerging
954 Boomslet/Web_Crawler

Open-source web crawler

37
Emerging
955 fabianrguez/rcdb-api

🎢RCDB non official Rest API created by scrape RCDB website.

37
Emerging
956 sarperavci/kick-unofficial-api

🛡️ Unofficial Kick.com API wrapper with automatic bypass protection.

37
Emerging
957 stelios-c/GPS_analysis

Analysis of GPS interruption data in public domain

37
Emerging
958 dchrostowski/autoproxy

Public proxy farm that automatically records and queues suitable proxy...

37
Emerging
959 jsem-nerad/strava-cz-python

High level API pro interakci s webovou aplikaci Strava.cz udelane v Pythonu

37
Emerging
960 serpapi/clauneck

A tool for scraping emails, social media accounts, and much more information...

37
Emerging
961 OmarElgabry/gunaydin

Your good mornings ☀️

37
Emerging
962 shafro63/fast-vinted-bot

A Vinted monitor to catch the latest items posted and send it to you via discord

37
Emerging
963 hunteryeet/linkedin-jobs-scraper-incredibly-fast

⚡ Scrape 1,000 LinkedIn job listings in under a minute with ease. Get fast,...

37
Emerging
964 Ta0uf19/forgeron

⚒️ Browser header & fingerprint generator

37
Emerging
965 gdsoumya/content_master

Content Master is a content aggregator that collects content from different...

37
Emerging
966 EdmundMartin/search_it

Asyncio package for scraping major Search Engines, supports pagination and...

37
Emerging
967 luckylittle/dzone-refcardz-downloader

Downloads all refcardz from https://dzone.com/refcardz

37
Emerging
968 alexis-brosseau/Ebay-Scraper

Get the average price of a product on eBay or a list of products on sale.

37
Emerging
969 bodasheera/instagram-scraper

A instagram scraper to scrape posts by profile and hashtags . We can scrape...

37
Emerging
970 maxh33/vehicle-auction-ai

AI-powered framework for analyzing salvage and damaged vehicles at Brazilian...

37
Emerging
971 jgravelle/groqcrawl

GroqCrawl is a powerful and user-friendly web crawling and scraping...

37
Emerging
972 Rohak72/Newspaper-Scrape

The official repo for the Newspaper Scrape Project, which uses natural...

37
Emerging
973 tharustack/Hiru-News-API

🇱🇰 Production-ready REST API for Hiru News (hirunews.lk). Real-time Sinhala...

37
Emerging
974 GaffaAI/GaffaPythonExamples

Examples from the Gaffa blog that are built with Python

37
Emerging
975 Poghappy/IhuoniaoN8NFirecralwrules

HawaiiHub Firecrawl × 火鸟门户 × n8n 的采集与自动化运营仓库

37
Emerging
976 joseft65/Skill_Seekers

📚 Transform documentation, GitHub repos, and PDFs into Claude AI skills...

37
Emerging
977 muxik/Mzitu

🍁使用python制作的用于爬取妹子图官网的爬虫程序

37
Emerging
978 Knovour/json-web-crawler

Use JSON to list all elements (with css 3 and jquery selector) that you want...

37
Emerging
979 dc-aichara/DS-ML-Public

Python Scripts and Jupyter Notebooks

37
Emerging
980 tokenmill/crawling-framework

Easily crawl news portals or blog sites using Storm Crawler.

37
Emerging
981 Solihatun1/AI-Cursor-Scraping-Assistant

A powerful tool that leverages Cursor AI and MCP (Model Context Protocol) to...

37
Emerging
982 seriouslysean/monster-hunter-now-events

A tool that auto-generates calendar events for Monster Hunter Now by...

37
Emerging
983 crawlbase/proxycrawl-php

ProxyCrawl PHP library for scraping and crawling websites

37
Emerging
984 austin-weeks/miasma

Trap AI web scrapers in an endless poison pit.

37
Emerging
985 oxylabs/Scraping-Dynamic-JavaScript-Ajax-Websites-With-BeautifulSoup

A guide on how to scrape JavaScript rendered websites with Python and BeautifulSoup.

37
Emerging
986 nikitperiwal/Zomato-Scraper

A script that can scrape restaurant information, menu, and reviews from Zomato.

37
Emerging
987 serpapi/google-maps-pb-decoder

Google Maps pb (i.e., protobuf) parameter decoder.

37
Emerging
988 duskvirkus/dafonts-free

Dafonts Free Dataset and python scripts used to make it

37
Emerging
989 mazz3rr/mtg

Scrape data on MtG decks

37
Emerging
990 The-Gupta/TED-Scraper

Complete Web Scraping of TED.com for Metadata, Transcript, Audio, Video,...

37
Emerging
991 privacy-tech-lab/privacy-pioneer-web-crawler

Web crawler for detecting websites' data collection and sharing practices at scale

37
Emerging
992 dave-hay/linkedin-job-report-creator

This program creates a PDF including the original post with graphs of the ...

37
Emerging
993 hi-tech-AI/marketplace-web-scraping

A Python-based web scraping project designed to extract marketplace data,...

37
Emerging
994 Chmod351/scraper

obtain information from any website, just by using its URL and the target...

37
Emerging
995 bhattbhavesh91/data-extraction-pipeline-python-github-actions

This repository will guide you to Automate Python Scripts with GitHub...

37
Emerging
996 Yigtwxx/J.A.R.V.I.S

J.A.R.V.I.S: An AI-powered Open Source Intelligence (OSINT) system. It...

37
Emerging
997 pirtleshell/scrape-a-grave

Scrape and Retrieve FindAGrave memorial page data and save them to an SQL database

37
Emerging
998 BenSouchet/cw-wizard

Cardmarket Wantlist Wizard 🧙🏼‍♂️🪄 Easily find the sellers with the most...

37
Emerging
999 GoTrained/Scrapy-Craigslist

Web Scraping Craigslist's Engineering Jobs in NY with Scrapy

37
Emerging
1000 rohitthapliyal2000/codechef-rank-comparator

Web application hosted on Heroku cloud platform based on web scraping in...

37
Emerging
1001 naiba/proxy-in-a-box

Automatic proxy pool for web scraping - crawls, validates, and rotates...

37
Emerging
1002 tumugin/lullaby

Idol website event calender crawler backend made with .NET Core MVC + C#

37
Emerging
1003 sunnysai12345/News_Summary

Dataset and scripts for scraping the news articles from popular sources...

36
Emerging
1004 M00N7682/node-curl-impersonate

Node.js HTTP client with browser TLS fingerprint impersonation. The Node.js...

36
Emerging
1005 AtharvaTaras/Cat-Images-Dataset

A dataset of cat images scraped from Bing.

36
Emerging
1006 debakarr/myanimelist-data-set-creator

Collection of some simple python scripts to create https://myanimelist.net/...

36
Emerging
1007 aaparikh/sih2022-interface

An interface for viewing different problem statements of smart india...

36
Emerging
1008 ericsoto-exe/ContactInfoScraper

ContactInfoScraper is a Python-based web scraping tool designed to automate...

36
Emerging
1009 DataSenseiAryan/NLPJenny

This is a Natural Language Processing applications WebApp useful for basic...

36
Emerging
1010 CodeBrauer/commitstrip-downloader

a simple script that downloads all comics from commitstrip.com

36
Emerging
1011 rajanrx/php-scrape

A simple, easy to use, scalable scraping framework written in PHP

36
Emerging
1012 idaniil24/ym-track-collector

Скрипт для сбора треков из плейлистов Яндекс Музыки через DevTools Console....

36
Emerging
1013 GULPF/nimquery

Nim library for querying HTML using CSS-selectors (like JavaScripts...

36
Emerging
1014 kan01234/ur-web-spider

web spider to scan UR avialbe room and output as csv

36
Emerging
1015 lucafluri/price_tracker

Price Tracker app for Android and iOS. Built with Flutter

36
Emerging
1016 MustakAbsarKhan/DSE_COMPANY_SCRAPER_Python

The DSE Company Scraper is a Python program that extracts data from the...

36
Emerging
1017 iboerkan/IbelCodeUrunTakip-Lite

Automated e-commerce orchestrator built with .NET 8, featuring Shopify API...

36
Emerging
1018 supmanyu/InstaScraper

A Simple Scraper for Instagram public accounts' E-mail addresses using...

36
Emerging
1019 kamome283/AngleParse

HTML parsing and processing tool for PowerShell.

36
Emerging
1020 Misterhex/WebCrawler

Just a simple web crawler which return crawled links as IObservable using...

36
Emerging
1021 davidspiegs/tenant-prospecting-pipeline

Lead generation pipeline for finding potential commercial real estate...

36
Emerging
1022 mkearney/rreddit

𝐫⟋ Get Reddit data

36
Emerging
1023 k-ardliyan/idr-exchange-rates

Bun + Elysia API for Indonesian bank exchange rates with resilient...

36
Emerging
1024 oiwn/dom-content-extraction

DOM Based Content Extraction via Text Density

36
Emerging
1025 toannd96/devread

DevRead - ứng dụng tổng hợp kiến thức cho developer

36
Emerging
1026 promisingcoder/GoogleMapsCollector

Extract businesses from Google Maps at scale. No browser needed....

36
Emerging
1027 Cheng-Lin-Li/Market-Trend-Prediction

This is a project of build knowledge graph course. The project leverages...

36
Emerging
1028 eenblam/jtt

A JailTracker Tracker: monitoring the treatment of people incarcerated in US jails

36
Emerging
1029 ankushduacodes/Multithreaded-amazon-scraper

Scraps the search results and generates a JSON file to store the...

36
Emerging
1030 DrewCarlson/KtSoup

A Kotlin multiplatform HTML5 parsing library

36
Emerging
1031 tech-engine/goscrapy

GoScrapy: Harnessing Go's power for blazingly fast web scraping, inspired by...

36
Emerging
1032 M3nny/seaward

🌊 ~ seaward is a grep-like tool for the web.

36
Emerging
1033 hk-raints/javspider_stack

🕸️ JavSpider Stack: Comprehensive metadata scraper & local management suite....

36
Emerging
1034 SuperBruceJia/dynamic-web-crawlering-python

This repo is mainly for dynamic web (Ajax Tech) crawling using Python,...

36
Emerging
1035 uysalibov/eksi_scraper

asynchronous Ekşi Sözlük scraper

36
Emerging
1036 yashkathe/F1-API-JSON

F1-API is a TypeScript-based web scraping API designed to extract...

36
Emerging
1037 skhg/pyleapcard

🚃 Python API for accessing your current card balance and stats for Ireland's...

36
Emerging
1038 nikuscs/olx-tracker

🕵️ Fast Rust CLI for OLX Portugal – browse listings, search thousands of...

36
Emerging
1039 HuberTRoy/Seen

A lightweight crawling/spider framework for everyone(support JavaScript!).:sparkles:

36
Emerging
1040 omss-spec/template

🚀 Ready-to-use template for building OMSS-compliant backends with @omss/framework

36
Emerging
1041 lizongying/go-crawler

A web crawling framework implemented in Golang, it is simple to write and...

36
Emerging
1042 jazzdotdev/jazz

The Scripting Engine that Combines Speed, Safety, and Simplicity

36
Emerging
1043 tkdnel/linkedin-profile-scraper

🔍 Extract LinkedIn profile data swiftly and easily with this user-friendly...

36
Emerging
1044 davrob01/AmazonBestSellerBooksScraper

This program scrapes Amazon to get book data (the ISBN, title, author,...

36
Emerging
1045 realtonkaa/ai-scam-site-detector

Analyze websites for signs of AI-generated content and scam patterns. Checks...

36
Emerging
1046 my8100/scrapyd-cluster-on-heroku-scrapydweb-app-git

How to set up Scrapyd cluster on Heroku

36
Emerging
1047 EchterAlsFake/xfreehd_api

Unofficial Python client for xfreehd.com: search, metadata extraction, and...

36
Emerging
1048 Cirice/Krawler

A complete multi-threaded web-crawler in Python3

36
Emerging
1049 apache/nutch-webapp

Apache Nutch is an extensible and scalable web crawler

36
Emerging
1050 blasferna/people

Api de datos de contribuyentes del Paraguay

36
Emerging
1051 kamjin3086/Crawell

📸 Crawell – 网页图片/正文一键提取、Markdown 转换与批量下载的浏览器扩展,本地化,免费 Crawell browser...

36
Emerging
1052 codegratia/react-node-web-scraper

Final Year project, scraping data of e-commerce stores and display in ReactJS app.

36
Emerging
1053 levysoft/RSS-Finder

This Python script is designed to find RSS or Atom feeds on a given website

36
Emerging
1054 0SliverBullet/Paper-Tunneling

⚡️ A Tool to Mine and Filter Papers with Keyword Matching

36
Emerging
1055 Loubaris/scrapeaw

ScrapeAW is a framework that without API scrape IPs across the world using Shodan

36
Emerging
1056 iiitv/lyrics-crawler

Simple crawler to collect lyrics, written in Python

36
Emerging
1057 andyjjrt/NCCUCourse

A set of NCCU Course scripts

36
Emerging
1058 nikolajlauridsen/PrawWallpaperDownloader

Download images from reddit

36
Emerging
1059 SagarBiswas-MultiHAT/WebSource-Harvester

WebSource Harvester is an educational web-source harvester that crawls a...

36
Emerging
1060 simonw/pge-outages-pre-2024

Tracking PG&E outages

36
Emerging
1061 i701/gazzette-api

Gazzette API with scraped data from Gazzette website.

36
Emerging
1062 alexwlchan/safari-webarchiver

Save web pages as Safari webarchive files from the command line

36
Emerging
1063 ivan-sincek/metagoofeel

Web crawler and downloader based on GNU Wget.

36
Emerging
1064 plkmo/Reviews_Crawlers

Web crawlers (Google reviews, Tripadvisor)

36
Emerging
1065 Matthew17-21/Captcha-Tools

All-in-one Python (And now Go!) module to help solve captchas with...

36
Emerging
1066 GEJ1/web_scraping_freecodecamp

Curso de web scraping con Python creado por Gustavo Juantorena para...

36
Emerging
1067 ab-anand/Scrapping

Mastering the art of scrapping 🎓

36
Emerging
1068 DemonMartin/scrappey-wrapper

An API wrapper for Scrappey.com written in Node.js (cloudflare bypass & solver)

36
Emerging
1069 resulumit/scrp_workshop

Slides for a workshop on automated web scraping with R

36
Emerging
1070 NishanthMuruganantham/ndtv-api

This API will scrap the news content present in the NDTV website will...

36
Emerging
1071 m-patino/fancaps-downloader

Fancaps Downloader

36
Emerging
1072 alexbotello/python-overwatch

A simple API for scraping Overwatch stats

36
Emerging
1073 windsorio/browse

browse is a declerative programming language for web scraping, automation...

36
Emerging
1074 BurnzZ/scrapy-twitter

Web scraper based on Scrapy to fetch tweets from a list of user accounts

36
Emerging
1075 pierreleocadie/ScrapeGram

OSINT tool to scraping data from someone's Instagram account.

36
Emerging
1076 ianramzy/ticker-iq

📈 Stock screener and portfolio analyzer, providing key insights on financial...

36
Emerging
1077 ismoiloffS/EzSolver

Cloudflare Turnstile solver & bypass — Python, real Chrome browser, no paid...

36
Emerging
1078 heckerfr0d/attendance-genie

Never be "late" again ;)

36
Emerging
1079 zhekainside/facebook-pages-details

🔍 Scrape contact details and key information from Facebook pages easily,...

36
Emerging
1080 shivapreetham/nitjsr-hub

A Student hub, real-time plugin based web-application featuring a chat,...

36
Emerging
1081 brahmbeyond/instareel

Instagram reel and posts downloader

36
Emerging
1082 JarbasAl/ai_demos

web scrapping all the demos

35
Emerging
1083 ankitaggarwal011/EmailCrawler

An email crawler written in python.

35
Emerging
1084 nirjharlo/complete-google-seo-scan

WordPress Plugin with inbuilt SEO crawler

35
Emerging
1085 dharun36/webscraping-craw4ai

An intelligent AI-powered web crawler that extracts structured product data...

35
Emerging
1086 HakinCodes/Awesome-Python-Scripts

A curated collection of some :heart_eyes: cool Python scripts.

35
Emerging
1087 Plutone11011/GameReqsAPI

An API to expose Steam games' system requirements. Currently in its first iteration.

35
Emerging
1088 rly0nheart/tarantula

Python web crawler tool

35
Emerging
1089 oxylabs/Python-Web-Scraping-Tutorial

In this Python Web Scraping Tutorial, we will outline everything needed to...

35
Emerging
1090 DCS-training/Summer-School-23-Stream-2-Text-and-Data-Analysis-in-the-Wild

This is the repo associated with the 2023 CDCS Summer School

35
Emerging
1091 Lackoftactics/facebook_data_analyzer

Analyze facebook copy of your data with ruby language. Download zip file...

35
Emerging
1092 bigbluey/Mission-to-Mars

Build a Web Application that Scrapes Various Websites for Data Related to...

35
Emerging
1093 crawlerflow/crawlerflow

Orchestrate web crawlers to create structured datasets from multiple data...

35
Emerging
1094 preeteshjain/vidpy

A Python based customizable script for scraping links to videos hosted on...

35
Emerging
1095 Interactions-HSG/SOAP

SOAP - A Sockpuppet Auditing Tool for Very Large Online Platforms

35
Emerging
1096 sebilune/serverless-trending-api

🌐 Lightweight serverless REST API that scrapes, caches, and returns trending...

35
Emerging
1097 daneski13/linkedin-job-scraper

Scrapes public LinkedIn job postings

35
Emerging
1098 DouglasTaylorSupportGroup/cheinstein.py

🧠 A parsing library for Chegg.com written in Python.

35
Emerging
1099 docchipl/Pobieranie-anime-z-polskich-stron

Siema, jeślisz szukasz gotowego kodu do pobierania linków do cda, mega,...

35
Emerging
1100 ZhekaiJin/Tap-News

Real Time News Scraping and Recommendation System

35
Emerging
1101 nmichlo/mtg-dataset

🧙‍♀️🃏✨ Magic the Gathering image dataset with automatic multithreaded...

35
Emerging
1102 fallaciousreasoning/apracticalguidetoevil

A tool for creating Pandoc compatible markdown files of...

35
Emerging
1103 crawlbase/scrapy-proxycrawl-middleware

Scrapy middleware interface to scrape using ProxyCrawl proxy service

35
Emerging
1104 spoluan/forex-factory-scraper

This script scrapes the Forex Factory calendar for economic events,...

35
Emerging
1105 shirokun20/nhasixapp

Unofficial NHentai, with other provider like KomikTap and Crotpedia

35
Emerging
1106 fuchsia-programming/scrape

When you need those jobs hypersonic 🚀 scrape 🔪

35
Emerging
1107 tracking-exposed/librevent

scrape and republish facebook Events

35
Emerging
1108 rat-software/rat-software

Streamline your search engine research. With the Result Assessment Tool...

35
Emerging
1109 gusta01010/charmaker

An easy-to-use AI Character Creator/Generator from Web Content to SillyTavern Card

35
Emerging
1110 shaheennabi/Production-Ready-LeafLogic-Multi-AI-Agents-Project

🍃 Production-ready: Just upload a photo of any plant or crop, the system...

35
Emerging
1111 weiyu666/Graduation_Design-Distributed_Web_Spider

基于微博用户信息数据的分布式爬虫所做的毕业设计,有一小部分简单的数据分析。这个也是为了纪念大学四年!里面包括了源代码,论文的一稿二稿等等还有查重终稿,UM...

35
Emerging
1112 walterwhite-69/Moviebox-API

🚀 High-performance, asynchronous REST API for MovieBox.ph. Featuring...

35
Emerging
1113 arv-anshul/99acres-scrape

Scrape 99scrape.com with python using curl command and export data as CSV.

35
Emerging
1114 filesite-io/machete_hero

为Ta荐(TaJian.tv)工作的基于Hero的Node.js实现的去中心化爬虫程序,可抓取B站、抖音、快手、西瓜视频播放页、直播页的标题和封面图

35
Emerging
1115 SneezeGUI/DarkMatter

DarkMatter - A high-performance web-security and proxy validation tool

35
Emerging
1116 jaimeadf/discord-scraping

A little project that scrapes the discord web client and stores each...

35
Emerging
1117 whiteroot/SUS

Social Usernames Scraper

35
Emerging
1118 chanronnie/Olympics

Scrape Olympedia data efficiently with Threading Concurrency and analyze it...

35
Emerging
1119 HighnessAtharva/Malazan-Compendium

In this Compendium you will find chapter summaries from each book of the...

35
Emerging
1120 FlashWebIT/cfr-iris-scraper

Live train information: scrape-powered API with JSON endpoints for the...

35
Emerging
1121 internaut/facebook-discussion-tk

A collection of tools to (semi-)automatically collect and analyze data from...

35
Emerging
1122 joaopauloaramuni/python

Repo Python

35
Emerging
1123 rtlee9/SIC-list

List of SIC codes and descriptions from authoritative sources

35
Emerging
1124 besthor/alx-system_engineering-devops

DevOps engineering repository dedicated to creating and maintaining the...

35
Emerging
1125 ericbrasiln/ferramentas_scielo_v2

Esse repositório é parte dos projetos desenvolvidos pelos membros do...

35
Emerging
1126 moltinginstar/addgene-api

An unofficial API for Addgene, the open-source plasmid repository.

35
Emerging
1127 Gradleless/nuxt-data-parser

Parse and traverse the SSR payload NUXT_DATA - Useful for scraping Nuxt.js websites

35
Emerging
1128 oscarcontrerasnavas/NIST-web-book-scraping

Small algorithm for getting Antoine's coefficient to calculate vapor...

35
Emerging
1129 arthur3486/google-play-scraper-kotlin

Library for scraping of the application data from the Google Play Store.

35
Emerging
1130 manga-translator-project/manga-translator

manga translator with support for 100+ languages

35
Emerging
1131 fcannizzaro/ksoup

Kotlin Wrapper for Jsoup

35
Emerging
1132 dhyaneesh/PodcastCoverter

Podcast Scraper and Summarizer is an app designed to help users save time...

35
Emerging
1133 HelloThereMatey/Bootleg_Macro

A simple tool-kit written in python for sourcing and displaying...

35
Emerging
1134 Mb-hunt/WhatsApp-Contact-Extractor

Extract all contacts from any WhatsApp Web group in seconds. Paste a script...

35
Emerging
1135 LoliKillers/xyzapi

npm package scraped from my own web api

35
Emerging
1136 BaristaLabs/skrapr

DotNet Core based declarative web scraping using the Chrome Debugger Protocol

35
Emerging
1137 andre-st/amazon-wishless

The more and longer wishlists you have, the less you look for buying...

35
Emerging
1138 pim97/scrappey-wrapper-python

An API wrapper for Scrappey.com written in Python (cloudflare, datadome...

35
Emerging
1139 naschorr/spotify-scraper

A Python Windows API for getting the artist, song, and album art for the...

35
Emerging
1140 Granitosaurus/parsel-cli

cli for evaluating css and xpath selectors

35
Emerging
1141 amrrs/Scraper-Projects

🕸 List of mini projects that involve web scraping 🕸

35
Emerging
1142 tatey/conformist

Bend CSVs to your will with declarative schemas.

35
Emerging
1143 Kr0ff/Pasta

A PasteBin scrapper that doesnt rely on the PasteBin scrape API

35
Emerging
1144 e43b/Kemono-Downloader

This script allows you to download images from posts on the Kemono website...

35
Emerging
1145 mohdsanadzakirizvi/web-scraping-magic-with-scrapy-and-python

This repository contains my experiments with Scrapy for advanced web...

35
Emerging
1146 chrislicodes/udacity-data-analyst-nanodegree

Repository for the projects needed to complete the Data Analyst Nanodegree.

35
Emerging
1147 maornissan/webcloner-js

A powerful, stealthy website cloner/scraper built with TypeScript that...

35
Emerging
1148 NirmalSilwal/Python

covers python basic to advance topics, practice questions, logical problems...

35
Emerging
1149 bumbeishvili/fb-github-trends

Automatically post Github trends on Facebook page

35
Emerging
1150 rajitbanerjee/amazon-price-tracker

A web scraping project to track the price of an item on Amazon UK.

35
Emerging
1151 angang-li/data_science_notes

Keep learning something new

35
Emerging
1152 Joeri-Abbo/python-credly-scraper

This project is a set of Python scripts designed to crawl and extract data...

35
Emerging
1153 acrobatstick/recipe-scraper

Tiny package to scrap food recipe from the web

35
Emerging
1154 KadekM/scrawler

Scala web crawling and scraping using fs2 streams

35
Emerging
1155 MsnAmiri/DigiKlothes

A dataset of more than 55,000 clothing items in the digikala website and...

35
Emerging
1156 ItzBlinkzy/prntscraper

An effective random image scraper for the website image hosting and sharing...

35
Emerging
1157 luminati-io/bright-data-web-unlocker-nodejs-project

Bright Data Web Unlocker Nodejs boilerplate code

35
Emerging
1158 aleroot/scrapy-scraperapi-proxy

Scrapy middleware interface to a scraper API proxy service

35
Emerging
1159 evyatarmeged/github-trending

Command line tool for fetching GitHub trending repositories

35
Emerging
1160 vineetjc/fetch-amul-topicals

Python script to fetch Amul Topicals (original:...

35
Emerging
1161 osauldmy/scrapy-mongodb-fastapi-apartments

Web scraping of real estates with Scrapy, pydantic, FastAPI, MongoDB and MinIO

35
Emerging
1162 juletx/HackerRank

HackerRank challenge solutions

35
Emerging
1163 luminati-io/TikTok-dataset-samples

A sample dataset of over 1000 TikTok profiles, extracted using the Bright...

35
Emerging
1164 teclone/php-feed-parser

A fully integrated RSS, ATOM and RDF syndication feed parser

35
Emerging
1165 CoderEren/EmailScraper

A Python script that automatically scrapes email addresses found on websites...

35
Emerging
1166 ayeshajadoon/Google-Maps-Scraper-for-Lead-Generation

A Python-based scraper that extracts business leads from Google Maps and...

35
Emerging
1167 ThiagoNelsi/wikipedia-to-document

This project collects Wikipedia articles from a search term entered by the...

35
Emerging
1168 HRN-Projects/common_crawl_with_scrapy

Parsing Huge Web Archive files from Common Crawl data index to fetch any...

35
Emerging
1169 vlourme/go-proxy

A configurable HTTP/HTTPS proxy written in Go with IPv6 and sticky session support

35
Emerging
1170 suyashjawale/InstagramCLI

CLI tool made by reverse engineering Instagram API calls.

35
Emerging
1171 MitchTalmadge/Hawaiian-Word-List

Web scrape of Stephen (Kepano) Trussel's Combined Hawaiian Dictionary for...

35
Emerging
1172 ibrahimpelumi6142/awesome-developer-apis

A comprehensive, curated collection of the best APIs for developers

35
Emerging
1173 oxylabs/ecommerce-category-scraper

AI-Powered E-commerce Category Scraper with AI Studio

35
Emerging
1174 ruggsea/bluesky-firehose-py

A Python library/CLI for collecting and archiving posts from the Bluesky...

35
Emerging
1175 nikuscs/amz-crawler

🛒 Fast Rust CLI to search Amazon products with TLS fingerprint emulation....

35
Emerging
1176 OMarcusCastro/Alugueis_olx

scrapping de imoveis

35
Emerging
1177 maxmindlin/scout-lang

A web crawling programming language

35
Emerging
1178 varshithpilli/watchpup

Watchdog for the weirdness of Vtop

34
Emerging
1179 doublegram/Doublegram-Startup-Telegram-Scraper-Adder

The Professional Telegram Bulk Members Adder & Scraper. More on doublegram.com

34
Emerging
1180 kapilkchaurasia/Data-mining-python-script

It contain various script on web crawling/ data mining of social...

34
Emerging
1181 68publishers/crawler

:spider_web: Awesome scenario based crawler

34
Emerging
1182 vulturno/lurte

🌊 Scraping AEMET

34
Emerging
1183 davidycliao/bisCrawler

An Automation Webcrawler for Extracting Central Bankers' Speeches

34
Emerging
1184 adilsaid64/google-finance-scraper

Scraping Google Finance with BeautifulSoup to create a portfolio tracker....

34
Emerging
1185 Lennolium/simple-header

Seamlessly get authentic and ready-to-use browser headers with ease.

34
Emerging
1186 antilagg/discord-name-checker

snipe for 3L discord username

34
Emerging
1187 Cornayy/dofus-scraper

An open-source Dofus encyclopedia scraper.

34
Emerging
1188 palash25/CoWaPS

CodeWarsProfileScraper. Only meant for practicing scraping.

34
Emerging
1189 wayaai/waya-scrape

Scrape search engines for lists of keywords

34
Emerging
1190 leomaurodesenv/b3-stock-indexes

Scraping the stock market indexes from B3' data (Brazilian Stock Exchange)

34
Emerging
1191 niranjangs4/WebScrapping

Web Scraping using Python Data mining , Data Analyzing & Data Visualization...

34
Emerging
1192 fpollicelli/whatsappScraper

WhatsApp Web Scraper English and Italian supported

34
Emerging
1193 capture0x/GOOGLE-LINK-COLLECTOR

google-scraping ~ link-collector ~ find-links

34
Emerging
1194 enter-a-new-username3/bet365-scraper-demo

Request based Bet365 web scraping without being blocked

34
Emerging
1195 Destroyer-official/Network-Information-Toolkit

🌐 Network Information Toolkit: Your all-in-one Python solution for network...

34
Emerging
1196 powerexploit/Gitgo

:heart_eyes: Gitgo is an command line based scraper for github and gist code...

34
Emerging
1197 tylerburleigh/LinkedInJobsScrapeR

A scraper for LinkedIn Job Ads built with R and Node.js

34
Emerging
1198 JassonCordones/one-piece-character-data-scraper

Spider that downloads the info for each of the individual canon characters...

34
Emerging
1199 ahmedmuqaddas/ESPNCricInfo-BallByBall

Get ESPN CricInfo Ball by Ball data for each match from its page

34
Emerging
1200 stendarr/infk-uebungsscraper-java

get all your exercises with one click

34
Emerging
1201 mjhendrickson/Web-Scraping-with-R

Intro to web scraping Amazon R textbooks with R & rvest.

34
Emerging
1202 wolfika/daily-menu

Scraper utility tool to fetch daily menus.

34
Emerging
1203 pystardust/shup

A POSIX shell script to parse HTML

34
Emerging
1204 nicksherron/proxi

Proxy pool. Finds and checks proxies with rest api for querying results. Can...

34
Emerging
1205 samaybhavsar/google-scraper

This class can retrieve search results from Google.

34
Emerging
1206 gsscoder/pickall

.NET agile and extensible web searching API

34
Emerging
1207 BufferingIO/film2subtitle

A REST API for film2subtitle.com website written in Python and FastAPI ⚡

34
Emerging
1208 Simple-Python-Scrapy-Scrapers/pinterest-scrapy-scraper

Production-ready Pinterest scraper built with Python Scrapy. Extract pins,...

34
Emerging
1209 aarmea/readability-scrape

Retrieve simplified versions of webpages, powered by Mozilla's Readability.js

34
Emerging
1210 CoderEren/email-scraper-website

An email scraper that finds email addresses located on a website. Made with...

34
Emerging
1211 aabele/sadales-tikls-json

Lejuplādē AS "Sadales tīkls" datus JSON formātā.

34
Emerging
1212 UtrechtUniversity/ia-webscraping

An AWS workflow for collecting webpages from the Internet Archive

34
Emerging
1213 hannesdatta/web-scraping.org

Web companion for "Fields of Gold: Scraping Web Data for Marketing Insights"

34
Emerging
1214 AhmedOsamaMath/issuu-downloader

A Python tool for downloading Issuu documents as PDFs and a JavaScript...

34
Emerging
1215 lucas-fs/ScrapingINMET

Conjunto de Scripts para Web Scraping dos dados das estações metereológicas do INMET.

34
Emerging
1216 naqushab/SearchEngineScrapy

Scrape data from Google.com, Bing.com, Baidu.com, Ask.com, Yahoo.com, Yandex.com

34
Emerging
1217 PhilaController/gun-violence-dashboard-data

Python toolkit for preprocessing data for the City Controller's Gun Violence...

34
Emerging
1218 gofornaman/scorey.ai

Scraping, aggregating and assessing technical ability of a candidate based...

34
Emerging
1219 EimanTahir071/Neural-Crawler-Web-Crawler

BFS and DFS BASED Project.A neural network-powered web crawler that...

34
Emerging
1220 Aatricks/EasyReader

Lightweight light novel, pdf, manwha, manga and epub reader with offline AI...

34
Emerging
1221 nichtlegacy/letterboxd-graph

Generates a GitHub-style contribution graph based on your Letterboxd diary....

34
Emerging
1222 andreu-vall/myanimelist-api-scraping

Scraping the MyAnimeList official API for Anime and Mangas, really fast

34
Emerging
1223 sandhan26/Scrapy-projects

This is a collection of some of my web scraping projects in scrapy framework

34
Emerging
1224 Annyfee/spider-js-reverse

精选不同站点的JS逆向实例,内含详细讲解,并辅以知识点概括、加密算法、难度对比与链接跳转。涵盖补环境、扣JS、webpack与瑞数等诸多难点

34
Emerging
1225 absingh31/Tor_Spider

Python project to crawl and scrap the lesser known deep web or one can say...

34
Emerging
1226 noahgift/web_scraping_python

Techniques for Scraping the Web in Python

34
Emerging
1227 siongui/go-facebook-post-parser

web scrape facebook post and extract data

34
Emerging
1228 innermost47/q2bs

Python toolkit for analyzing industrial-scale automated content generation....

34
Emerging
1229 mfrashad/artbreeder-scraper

Image scraping script for Artbreeder

34
Emerging
1230 arbaz7592/Xhs-AIO-Actor-Scraper

📥 Extract posts and metadata from Xiaohongshu effortlessly, streamlining...

34
Emerging
1231 dazld/r11y

CLI tool for extracting URLs as Markdown

34
Emerging
1232 Florents-Tselai/greek-wines-analysis

Scraper, Data and Analysis for "Analyzing 1000+ Greek Wines with Python"

34
Emerging
1233 thoven87/firecrawl-swift-sdk

Firecrawl Swift SDK

34
Emerging
1234 ariear/TikChan

the minimal tik-tok downloader

34
Emerging
1235 Sotrosca/zona-prop-scraper

Scraper de Zonaprop

34
Emerging
1236 yannham/mechaml

OCaml functional web scraping library

34
Emerging
1237 Beking0912/distributed-paper-search-engine

🕷️ [Graduation Project] Scrapy-Redis distributed crawler + Elasticsearch...

34
Emerging
1238 ayush-raj13/WebScrapideo

Text Summarizer, Flipkart Web Scraper and Online Video Downloader

34
Emerging
1239 sachin-bisht/YouTube-Sentiment-Analysis

(UNMAINTAINED)Fetch comments from the given video and determine sentiment...

34
Emerging
1240 FoamoftheSea/mod5project

Developing a long/short equity investment portfolio with Machine Learning...

34
Emerging
1241 Data-on-the-Mind/2017-summer-workshop

Exercises, data, and more for our 2017 summer workshop (funded by the Estes...

34
Emerging
1242 himahuja/pcatxcore

Praedicat's project with IPAM, UCLA under RIPS 2018 to develop automated...

34
Emerging
1243 Cheng-Lin-Li/KnowledgeGraph

This repository for Web Crawling, Information Extraction, and Knowledge...

34
Emerging
1244 outages/bchydro-outages

Track BCHydro Outages via Git history

34
Emerging
1245 pH-7/Crawling-Emails

Very simple bash script to crawl email addresses from a specific website.

34
Emerging
1246 jatiinyadav/web-crawler

Web Crawler using Go Lang and Svelte

34
Emerging
1247 inputsh/automation-scripts

Simple scripts that I'm using to automate the boring things.

34
Emerging
1248 baronet2/FirstCyclingAPI

An unofficial Python API wrapper for firstcycling.com

34
Emerging
1249 MaxValue/Terpene-Profile-Parser-for-Cannabis-Strains

Parser and database to index the terpene profile of different strains of...

34
Emerging
1250 KITFC-dev/litehook

Self-hosted Telegram channel scraper server that monitors channels and sends...

34
Emerging
1251 thisistimothychen/umd-google-cal-schedule-importer

📅 Chrome Extension that imports your UMD class schedule directly into a new...

34
Emerging
1252 Edioff/akamai-analysis

Enterprise Anti-Bot Analysis — Deep technical analysis of Akamai Bot Manager...

34
Emerging
1253 sarikayamehmet/GetOldTweets-R

A project written in R to get old tweets, it bypass some limitations of...

34
Emerging
1254 luminati-io/LinkedIn-dataset-samples

Sample dataset of 1001 LinkedIn companies, extracted via Bright Data API,...

34
Emerging
1255 javaldro/wework-address-scraper

A script that scrapes all current WeWork coworking space locations and...

34
Emerging
1256 dellelce/srcget

Download software (at the moment only the latest *stable*) source

34
Emerging
1257 adarshpheonix2810/high-performance-search-engine-cpp

A high-performance search engine built in C++ featuring inverted indexing,...

34
Emerging
1258 esotericpig/nhkore

🇯🇵📰🗻 NHK News Web (Easy) word frequency (core list) scraper for Japanese...

34
Emerging
1259 ahmedshahriar/burnout-tweets-scraper

A Scraper that scrapes '#burnout' tweets daily powered by GitHub action and...

34
Emerging
1260 jjoeldaniel/genius.py

Python wrapper for Genius API

34
Emerging
1261 trose/ice-locator-mcp

Advanced MCP server for ICE detainee location services with privacy-first analytics

34
Emerging
1262 scrapeway/best-web-scraping-api-benchmarks

what is the best web scraping API service? Research through benchmarks

34
Emerging
1263 vwkd/immersive-chinese-to-anki

Create Anki cards from Immersive Chinese content

34
Emerging
1264 kbishopzz/HTML-to-Figma

A powerful Figma plugin that converts websites to editable Figma designs...

34
Emerging
1265 dariush-g/scraprr

a basic python and rust web scraping library written in rust

34
Emerging
1266 jkreucher/ReicheltAPI

A very simple Python web scraping module for Reichelt Elektronik

34
Emerging
1267 aaronlyy/steamprofile

Gather information about steam profiles using python 🎮

34
Emerging
1268 gonzalezcortes/scraping_news_articles

Python Scripts for Academic Web Scraping of WSJ Articles: Database Setup,...

34
Emerging
1269 thetrekir/Dizibox-Downloader

A Python script to bypass Dizibox protections and download videos.

33
Emerging
1270 mihaicodes/web-crawler

A Web Crawler developed in Python.

33
Emerging
1271 samedog/PHPmvs

PHPmvs is an old tool i wrote to test common web apps and server vulnerabilities

33
Emerging
1272 kelvindecosta/tubby

:house_with_garden: A utility for the Genshin Impact Housing system

33
Emerging
1273 Nayemjaman/bdnews-scraper

Scrapy-Django PostgreSQL integration. Scrapes English news data from...

33
Emerging
1274 jmoseka/astro-tabiri

Web application that provides users with daily horoscope readings through...

33
Emerging
1275 rendicahya/sinta2-scraper

Retrieves information from Sinta (https://sinta.kemdikbud.go.id) via scraping.

33
Emerging
1276 hazel-noack/scribblehub-to-epub

This tool scrapes books from ScribbleHub and converts them into EPUB files...

33
Emerging
1277 kcsoc/society-email-scrape

Scrapes Every Email Address of Every Society in Every University

33
Emerging
1278 MihailCosmin/CyberMonkey

GUI for AutoMonkey that allows you to easily create automations

33
Emerging
1279 stephen-slm/Pyris

A python application to pull Imgur images from the provided Reddit subreddits.

33
Emerging
1280 JohnSell620/sentiment-analysis-goodreads-reviews

Document-level sentiment analysis of book reviews scraped from the Goodreads...

33
Emerging
1281 malwareslayer/bulk-silent-sms

finding if phone number is online, offline, or airplane by sending sms that...

33
Emerging
1282 nasa-jpl-memex/sce

Sparkler Crawl Environment - a packaged, dockerized version of...

33
Emerging
1283 Shahriar-0/Data-Science-Course-Projects-S2024

different data science projects like data scraping, hypothesis testing, data...

33
Emerging
1284 LibreCodeCoop/scielo-scraping

Download all files from SciELO

33
Emerging
1285 alaouimehdi1995/simplified-search-engine

Multithreaded Web Crawler, Scraper, Indexer

33
Emerging
1286 sjmiller8182/tomatopy

Web scraper for rotten tomatoes reviews and info

33
Emerging
1287 abhishek72850/cherry-ua

Advanced search and generate user agent python library

33
Emerging
1288 oceanside-chess/email-scraper

Scrape emails from a website using recursive crawling, the best...

33
Emerging
1289 Arbitrage0/inkantan

A digital signature Flask web app

33
Emerging
1290 felipemfp/liturgia

:church: Tracking the Daily Readings in Portuguese

33
Emerging
1291 hrbrmstr/htmlunitjars

☕️ Java Archive Wrapper Supporting the 'htmlunit' Package

33
Emerging
1292 luminati-io/Amazon-dataset-samples

A sample dataset of over 1,000 Amazon product listings, extracted using the...

33
Emerging
1293 furkanksl/md

A useful drawer for MacOS. chatting, clipboard, webscraping, window...

33
Emerging
1294 TeaByte/proxy-scraper

Scraping from x75 websites asynchronously

33
Emerging
1295 owenauch/NBA-Fantasy-Optimizer

NBA Daily Fantasy Lineup Optimizer for FanDuel Using Python

33
Emerging
1296 NobilityDeviant/ZenDownloader

A new and improved video downloader for WatchCartoonOnline or WCO.

33
Emerging
1297 proxyport/py-proxyport2

Python Proxy Port

33
Emerging
1298 jvilaplana/vademecum-export

Web scraper to export drug data from Vademecum.es into CSV files.

33
Emerging
1299 zan-keith/cherry-pick

A Chrome extension for quick scraping of elements from web pages.

33
Emerging
1300 robertaitch/telegram-story-scraper

A Python script that allows you to automatically scrape and download stories...

33
Emerging
1301 praneethk19/mca-web-scraping

A simple Python script that scrapes and prints the Company and Directors'...

33
Emerging
1302 RozhakLabs/YouLikeInsta

YouLikeInsta: Alat Python untuk eksplorasi pertumbuhan Instagram via...

33
Emerging
1303 dewey/feedbridge

Plugin based RSS feed generator for sites that don't offer any. Serves RSS,...

33
Emerging
1304 3choff/docs-miner

A VSCode extension that generates markdown documentation from web pages and...

33
Emerging
1305 bold-ronin/Lightweight-Agentic-RAG-Service

Agentic RAG service that analyzes startup signals using semantic search +...

33
Emerging
1306 carpentries-incubator/web-scraping-python

Web Scraping with Python

33
Emerging
1307 ravigupta-design/IgnouPercentageCalculator

Percentage Calculator for IGNOU BA/BDP/BCOM programmes.

33
Emerging
1308 dheeraj-rn/bing-search

Python command line application to search queries and dorks on bing.com and...

33
Emerging
1309 PreferredAI/venom

Your preferred open source focused crawler for the deep web.

33
Emerging
1310 farukalamai/yelp-scraper-scrapy-python

Yelp Restaurant data scraping using python, scrapy spider

33
Emerging
1311 xnomas/web-ctf-help

Collection of scripts to help with web based ctfs.

33
Emerging
1312 pkgodara/WebCrawler

Java Web Crawler Program to get all links or images download from websites...

33
Emerging
1313 ctkqiang/Weaver

Weaver 是一个基于 Python 的安全资讯聚合工具,旨在从多个安全资讯网站自动抓取最新的安全新闻,并以图形界面展示给用户,方便安全从业者及时获取行业动态。

33
Emerging
1314 nermalcat69/Discord-Channel-Scraper

Scrape Discord Channels without hitting the Rate Limits

33
Emerging
1315 yuanyuanzijin/dutsso

快速登录大连理工大学统一身份认证系统(SSO)的Python模块,可轻松实现成绩提醒、抢课、玉兰卡信息、个人信息查询等功能。

33
Emerging
1316 little-endian-0x01/TorScrapper

A Scraper made 100% in Python using BeautifulSoup and Tor. It can be used to...

33
Emerging
1317 z3r0x-git/website-scraper

A powerful and easy-to-use tool built with Scrapy and Node.js that allows...

33
Emerging
1318 gyunggyung/Gemini-Claw

An autonomous research and synthesis agent powered by Google Gemini....

33
Emerging
1319 namhaivu173/Stock_Index_App

Stock Index Streamlit App w/ Python

33
Emerging
1320 raprocks/sanfoundry-scraper

A Small Scraping Script written in Python that helps you collect and merge...

33
Emerging
1321 moebiusmania/atmmi-info-api

Node.js webservice that turns the ATM Milano news website in a REST API JSON data.

33
Emerging
1322 coko7/tcb-opus

🤖 A discord bot to get the latest manga chapters from TCB Scans as soon as...

33
Emerging
1323 frkndncr/WebAnalyzer

WebAnalyzer is a versatile tool for comprehensive domain analysis. It...

33
Emerging
1324 boomboompower/tecg

Tracking all active experiments on twitch

33
Emerging
1325 dDevTech/Stock-Market-Predictor

Stock Market Predictor with LSTM network. Web scraping and analyzing tools...

33
Emerging
1326 promptapi/scraper-py

Python package for Prompt API's Scraper API

33
Emerging
1327 kakwa/sytadin-scraper

sytadin traffic info scraper written in perl

33
Emerging
1328 aashishpeepra/whatsapp-live-cricket-bot

This is a whatsapp bot that uses Cricket API to fetch different types of...

33
Emerging
1329 kownet/osint-series

Source codes related to the articles about OSINT. Using social media APIs...

33
Emerging
1330 andorfermichael/tripadvisor-scraper

Scrape the hotel reviews of a whole city on TripAdvisor

33
Emerging
1331 BitingSnakes/silkworm

Async web scraping framework on top of Rust. Works with Free-threaded Python...

33
Emerging
1332 w-henderson/Unlimited-YouTube-Search

🔍 Search YouTube without the YouTube Data API.

33
Emerging
1333 franloza/coches-net-dashboard

Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and...

33
Emerging
1334 TrainingByPackt/Data-Wrangling-with-Python-eLearning

Creating actionable data from raw sources

33
Emerging
1335 piratesvix/piratas-api

Utilize recursos do Piratas API para fazer orçamentos, contratar serviços,...

33
Emerging
1336 realTobby/ImageScraper

Dumps all images from a WebSite.

33
Emerging
1337 SasaKaranovic/DigiKeyFetch

Tiny tool for scraping essential data needed for generating BOM

33
Emerging
1338 harsh4870/Justdail-scrapper

A 100% working Justdial scrapper, Just enter the url and it'll extract...

33
Emerging
1339 RedScrape/free-proxy-server

Python library for fetching proxy lists from the RedScrape API. This library...

33
Emerging
1340 leticiatavaresds/Banco-de-Dados-Spotify

Construção e implementação de um banco de dados relacional com dados de...

33
Emerging
1341 moithepro/InstaToolsAndroid

Instagram GUI Tools using chaquopy and instaloader - PyPI

33
Emerging
1342 nrjdalal/google-parser

HTTP based Google Search Results scraper/parser

33
Emerging
1343 abdipr/jagokata-api

Unofficial JagoKata REST API

33
Emerging
1344 coursegraph/CourseGraph

A lightning-fast search for your UCSC courses

33
Emerging
1345 jiup/gospy

🕷 a flexible web crawler framework

33
Emerging
1346 dinubs/coolqlcool

Nextjs server to query websites with GraphQL

33
Emerging
1347 ZenRows/house-pricing-map

Repository for the "Collecting Data to Map Housing Prices" blogpost with the...

33
Emerging
1348 wiringbits/simple-http-proxy

A very simple http proxy that runs on a Raspberry Pi

33
Emerging
1349 lidimayra/raspagem-de-dados-fatec

:notebook: Minicurso de raspagem de dados web com Python ministrado na...

33
Emerging
1350 ahmedshahriar/bd-ponno

Scrapy Mongodb Djongo integrated API that scrapes popular e-commerce sites...

33
Emerging
1351 traitortots/ArcSpider

Web scraper for local government GIS servers

33
Emerging
1352 TrasparenzAI/trasparenzai.github.io

Documentazione della piattaforma per l'analisi e la consultazione della...

33
Emerging
1353 GoodbyteCo/Letterboxd-Watchlist-Picker

A simple website that gives you a random film off your Letterboxd watchlist...

33
Emerging
1354 Jhotika/appents-social-downloader

Chrome browser extension that saves Instagram / X (Twitter) posts locally,...

33
Emerging
1355 vardecab/flat-finder

Looking for a modern, nicely looking apartment but tired with all these old...

33
Emerging
1356 bharding216/stock-web-scraper

A program that scrapes stock data and displays a plot of the top 10 stocks...

33
Emerging
1357 laggui/image-search-scraper

Dataset builder tool from web image scraping

33
Emerging
1358 hindamosh/InstaData

Instagram Scraping tool without API without user credentials

33
Emerging
1359 JacobK233811/MQuicker

Manga management at its finest. Creating an intuitive, enjoyable, and...

33
Emerging
1360 redcode-labs/UnChain

A tool to find redirection chains in multiple URLs

33
Emerging
1361 gusoliveira21/webscraping-instagram

🤖 Automated jobs on instagram using webscraping!

33
Emerging
1362 TUVIMEN/xvideos-scraper

A bash script for scraping xvideos videos metadata in json

33
Emerging
1363 mkayeterry/recipe-urls

Python :package: to compile recipe URLs from recipe websites.

33
Emerging
1364 mytja-archive/SiteRank-Alexa

This is vanilla Python library for gathering data about websites and domains...

33
Emerging
1365 E-B3rry/fetch-discord-guild-members-selfbot

Python Discord selfbot that fetches and saves guild member data into a .csv...

33
Emerging
1366 CSUF-ACM/course-calendar

A prototype application that syncs weekly CSUF courses to personal Google Calendar.

33
Emerging
1367 myounus96/stock-market-prediction-using-sentiment-analysis

stock market predictions using sentiment analysis, a deep learning...

33
Emerging
1368 ScriptSmith/insta-scrape

Scrape Instagram

33
Emerging
1369 foxt451/actor-quora-scraper

This actor scrapes Quora's API and lets collect questions, answers, upvotes etc.

33
Emerging
1370 xtekky/TikDown

Fast TikTok NO Watermark Video Downloader (username or url)

33
Emerging
1371 methylDragon/news-anaCrawler

Article Dataset Generator for Internet News Sites. Crawls news sites,...

33
Emerging
1372 pmichel31415/mtnt

Code for the collection and analysis of the MTNT dataset

33
Emerging
1373 luminati-io/Pinterest-dataset-samples

Two sample datasets of over 1000 Pinterest profiles and posts, extracted...

33
Emerging
1374 StefanPahlplatz/albert-heijn-calendar-sync

Sync your Albert Heijn schedule with your Google calendar.

33
Emerging
1375 davidteather/proxyproviders

The Unified Python Proxy API with support for BrightData, WebShare, and more.

33
Emerging
1376 iiPythonx/usps

A CLI for tracking packages from USPS.

33
Emerging
1377 AmateurAcademic/Re_cruiter

Find AI jobs with the help of AI! Re:cruiter is a prototyped end-to-end NLP...

33
Emerging
1378 cloudy-sfu/Web-crawler-weibo

The toolbox to collect posts from https://weibo.com

33
Emerging
1379 georgevbsantiago/tcmbadespesas

Web Scraping para coletar os dados das Despesas Municipais (BA) que estão...

33
Emerging
1380 oxylabs/how-to-scrape-google-jobs

Learn how to build your own Google Jobs scraper that simultaneously scrapes...

33
Emerging
1381 stalinsantillan/laravel-soccer-compare

Soccer player management PWA

33
Emerging
1382 alessio-ds/BSCWhalesMonitor

BSC whales monitor and detector written in Python.

33
Emerging
1383 YaleComputerSociety/Yalies-Legacy

👥 The best directory of Yale personnel, with a clean API to match. Used by...

33
Emerging
1384 luminati-io/Airbnb-dataset-samples

A sample dataset of over 1000 Airbnb listings, extracted using the Bright...

33
Emerging
1385 alaakh42/Newspaper-Articles-Daily-Crawler

An implementation to a Scrapy Web Crawler, that crawl article links from...

33
Emerging
1386 3dnsfw/Kemono-Scraper

UPDATED 2026: Kemono / Coomer Scraper / Downloader / Auto-Retry / Compression

33
Emerging
1387 0x06060606/Soteria_Proxy-Scraper

Proxy Scraper Using My Blazing Fast Soteria Proxy API

33
Emerging
1388 douglasgusson/afacinemas-scraper

Ferramenta para raspagem de dados do site da rede Afa Cinemas

33
Emerging
1389 nodemavencom/proxy

High-performance residential and mobile proxy API with ultra-clean IPs for...

33
Emerging
1390 LegendaryEmoji/animekisa-api

An unofficial AnimeKisa REST API project (using fastify, cheerio, axios).

33
Emerging
1391 vmussa/anpocs-scraper

Raspador dos dados dos Encontros Anuais da ANPOCS

33
Emerging
1392 thomasdidion/bitfinex-scraper

A Bitfinex scraping bot that pulls and saves market data into an InfluxDB...

33
Emerging
1393 lightlessdays/Omega-Search

Project Omega is an open source privacy enabled search engine written in...

33
Emerging
1394 MichaelCurrin/water-crisis-scraper

Scrape and explore data related to Cape Town's water crisis (Python3 application)

33
Emerging
1395 octokami/darknet_forum

Scraping darknet forums has been the object of research in the field of...

33
Emerging
1396 whopiyush/lyriks.js

A lyrics scraping api for nodejs

33
Emerging
1397 ohsyln/topgainers-premarket-scanner

Auto-periodic topgainers premarket scanner

33
Emerging
1398 Abhishek1103/EtherSamaj

A JAVA based Decentralised desktop app (Dapp) for Community Work , funding...

33
Emerging
1399 gsidhu/cpcbccr-data-scraper

Scrapes data from CPCB's CCR dashboard.

33
Emerging
1400 bulletinmybeard/price-scout

Track prices across retailers. Privacy-first, runs locally, supports all...

33
Emerging
1401 hqadeer/nba_scrape

An easy-to-use Python utility to scrape basketball data off stats.nba.com.

33
Emerging
1402 TheOregonian/long-term-care-db

Code and data for Kept in the Dark, story in The Oregonian/OregonLive.com

32
Emerging
1403 baba-mandef/investing_telegram_bot

A simple telegram bot for daily economic calendar

32
Emerging
1404 GoodbyteCo/Watchlist-Picker-Backend

Picks a random movie from your Letterboxd watchlist for when you can't...

32
Emerging
1405 lucasjvds/BCG-Gamma-Challenge

We're proud to announce that our team secured the First Prize in the BCG...

32
Emerging
1406 29-75/popular-day-news

네이버 뉴스를 Crawling하고 카카오톡 채널 봇을 통해 확인 할 수있는 서비스를 개발한다.

32
Emerging
1407 heryandp/shopee-product-scrap

Shopee Product&Seller Scrapper

32
Emerging
1408 GetRepliq/Reachify

🤖 An agency outreach automation bot made for SAAS / SMMA Agency owners

32
Emerging
1409 vlOd2/LightshotScraper

The most advanced Lightshot (or prnt.sc) scraper ever!

32
Emerging
1410 vypivshiy/selector_schema_codegen

python-dsl code converter to html parser for web scraping

32
Emerging
1411 italynews/pyansa

Just for fun. Retrieve Ansa.it RSS news

32
Emerging
1412 sayedmahmoud266/gramharvest

A Chrome Extension to Scrap Instagram Posts & Reels from any profile (public...

32
Emerging
1413 pr0PM/mymusic-dl

Download music using web scraping and youtube-dl no API keys required

32
Emerging
1414 sibi361/konkan-railway_live-train-position

Realtime data for trains on India's Konkan Railway

32
Emerging
1415 let4be/crusty-core

A small library for building fast and highly customizable web crawlers

32
Emerging
1416 Li-Pro/Word-Search

A simple word searcher (Oxford Learner's Dictionary + Urban Dictionary +...

32
Emerging
1417 szkf/package-bot

A Discord Parcel Tracking Bot

32
Emerging
1418 ahmedezzeldin93/amazon-crawler

Amazon crawler and scraper bot

32
Emerging
1419 jctissier/Euro2016_TerminalApp

:soccer: Instantly find :trophy:EURO 2016 live-streams & highlights, now a Web App!

32
Emerging
1420 ArvinJA/scrape_discord

Scrape discord channels

32
Emerging
1421 dojutsu-user/GSoC-Data-Analyser

Simple search for organisations participating/participated in the GSoC

32
Emerging
1422 ammarsaber-dev/AcquiFinder

Get acquisitions by scraping titles of crunchbase.

32
Emerging
1423 mrocha98/garimpeiro-olx

Procurando por algo na OLX? Seja avisado do melhor preço!

32
Emerging
1424 romanrosh/airbnb-web-scaper

Airbnb scraper and hotel api for data compare

32
Emerging
1425 w4rryn/WebnovelYoinker

Downloads converts webnovels to Epub or PDF. Supported websites:...

32
Emerging
1426 KeremDlkmn/appstore-profile-scraper

Apple App Store Profile (SCRAPPER) Information Scraper

32
Emerging
1427 BilalAhmadKhanKhattak/LinkxDoxer

LinkxDoxer is a Python script designed to efficiently retrieve all links...

32
Emerging
1428 TheNoiselessNoise/csfd_scraper

Simple scraper for CSFD.cz, a Czech movie database.

32
Emerging
1429 oscarlaaaa/badminton-api

Web scraper + public API for all BWF singles badminton player/match...

32
Emerging
1430 TheTechDivinity/yt-live-chat-to-text

This project reads YouTube live stream messages and stores them in 2 .txt...

32
Emerging
1431 jazibdawre/DatasetCreator

Script for creating a dataset for AI, ML applications

32
Emerging
1432 materight/streamcorn

A simple Android app for scraping streaming websites.

32
Emerging
1433 terremoth/get-dollar-value-py

Simple python script to get dolar value from DolarHoje.com

32
Emerging
1434 aidenesco/connect

Rotating proxy pool usable as a client or HTTPS CONNECT server

32
Emerging
1435 sgalal/lexi-can-crawler

Crawler for Cantonese pronunciation data on Chinese Character Database: With...

32
Emerging
1436 Janith-Nilan/ikman-annex-crawler

An intelligent, serverless web crawler for Ikman.lk, built entirely within...

32
Emerging
1437 varunon9/github-scraper

A nodejs script (using cheerio module) to extract github users information...

32
Emerging
1438 cloudy-sfu/Compare-electricity-plans-NZ

Compare electricity fee based on personal electricity usage history between...

32
Emerging
1439 atchopba/scraping-jobs-web

Scraping-jobs helps scrape jobs from major job boards (apec.fr, indeed.fr,...

32
Emerging
1440 ribeirogab/technology-insights

Program with the aim of using the data from Stack Overflow Insights 2020 and...

32
Emerging
1441 Tech-at-DU/ACS-4210-Strongly-Typed-Languages

💪 Learn and implement the design patterns and best practices that make Go a...

32
Emerging
1442 scrapehero/nasdaq_finance

Nasdaq.com Web Scraper written in Python and LXML to extract summary quote...

32
Emerging
1443 cploutarchou/web-scraping-with-python

A StackOverflow Web Scaper in python and MongoDB

32
Emerging
1444 nikolajlauridsen/WordSearch

What does that word mean?

32
Emerging
1445 rzjosia/adventscrap

Extrait automatiquement des chants (hymnes, louanges, JEM, JEM Kids, DLG,...

32
Emerging
1446 evrenge/ITU-yardimci

İstanbul Teknik Üniversitesi'nin ders seçimini kolaylaştırmak adına yapılmış...

32
Emerging
1447 Jakeroid/blog-article-download-vimeo-video-python

Code related to my post "How to download Vimeo video using Python"

32
Emerging
1448 merfrei/proxy-service

An API to do a smarter use of proxy lists

32
Emerging
1449 Michael-K-Stein/SpotiFile

Spotify scraper

32
Emerging
1450 marksantiago290/KOLscan-leaderboard-scraping

Python-based web scraper that extracts cryptocurrency trader performance...

32
Emerging
1451 sallamy2580/python-web-scrapping

Detailed web scraping tutorials for dummies with financial data crawlers on...

32
Emerging
1452 buildship-ai/LLM-Web-Crawler

Web Scraper and Crawler for LLM Apps and AI Workflows with NoCode / LowCode....

32
Emerging
1453 1220moritz/reverse-twitter-scraper

A request based package for scraping twitter data. No API Key required....

32
Emerging
1454 rjstyles/StackOverflow-Crawler

It is a web crawler which crawls the stackoverfolw website...

32
Emerging
1455 ph-root/proxy-GR

Python-based Massive Proxy Grabber. This bot grabs proxies from public...

32
Emerging
1456 Wittline/data-engineering-challenge-th

Dockerizing a Python Script for Web Scraping and consume the scraped data...

32
Emerging
1457 ricardozacarias/ironhack-labs

The collection of exercises I did during Ironhack's Data Science bootcamp.

32
Emerging
1458 Alankar0416/Justdial-Scrapper

A 100% working Justdial scrapper, Just enter the url and it'll extract...

32
Emerging
1459 Decodo/Scrapy-Middleware

Scrapy Middleware for proxy authentication with Decodo

32
Emerging
1460 gekkedev/LIRN-proquest-ebook-scraper

Automatically downloads entire ebooks from LIRN ProQuest Ebook Central as a...

32
Emerging
1461 yazilimcimekani/wikipedia-scraper

Wikipedia "Today In History" Scraper

32
Emerging
1462 TechfaneTechnologies/user_agent

Get_User_Agent is an easy-to-use rust CLI program and library for extracting...

32
Emerging
1463 shallvhack/The-Hacker-News-Scraper

Automate Hacker News updates. Scrape thehackernews.com and send real-time...

32
Emerging
1464 mrrfv/webArchive

Crawls websites and saves found URLs to a file.

32
Emerging
1465 SouravUpadhyay7/SnifTern.ai

SnifTern.ai is an AI-powered platform that detects fake internship postings...

32
Emerging
1466 SAP-archive/data-intelligence-text-analysis

Web scraping and text analysis using SAP Data Intelligence.

32
Emerging
1467 smtozkn06/Basic-Request-Bot-Web-Traffic-Generator

A comprehensive web traffic generation tool collection with GUI interface...

32
Emerging
1468 gtiwari333/spring-boot-keycloak-angular-quote-app

Spring Boot + Keycloak Backend / Angular Web App

32
Emerging
1469 WebSpiderSuperStar/scrapy_utils

scrapy_utils is configuration template project, Contains the extraction of...

32
Emerging
1470 mounicmadiraju/Webcrawler

💌🏫 Web Crawler , that crawls all the inner links and the process goes on...

32
Emerging
1471 astroclubiitk/NASA-APOD-Discord-Bot

Hello there! I'm your NASA APOD bot. I fetch information from NASA APOD site...

32
Emerging
1472 mefechoel/botex

Obfuscate email addresses and other personal data, so bots can't scrape them 🤖🚫

32
Emerging
1473 KyleAnthonyShepherd/Traffic-Data-Scraping

This code pulls traffic data from the HERE maps service

32
Emerging
1474 FlowExtractAPI/loom-video-scraper

Advanced Loom video scraper with authentication, transcript extraction, and...

32
Emerging
1475 dotandimet/Mojo-UserAgent-Role-Queued

A role for Mojo::UserAgent that processes non-blocking requests in a...

32
Emerging
1476 Awaisali36/Linkedin-Comments-to-the-Lead-Generation

🎯 Automated lead generation system that extracts and enriches LinkedIn post...

32
Emerging
1477 ccuetoh/chilescrapper

A compact scraping library for the major newspapers of Chile

32
Emerging
1478 jeffspahr/bourbontracker

🥃 Cask Watch - Track rare spirits inventory across ABC stores with real-time...

32
Emerging
1479 FlowExtractAPI/metamorph-orchestrator

This Actor demonstrates the Apify metamorph operation by processing multiple...

32
Emerging
1480 levindixon/WebMD

📋 WebMD is a Chrome extension that transforms web pages into Markdown...

32
Emerging
1481 shubhpawar/Web-Crawler-for-Drug-Interaction-Data

Crawling drug-drug interaction data from WebMD.com and Drugs.com.

32
Emerging
1482 outscraper/outscraper-go

The library provides convenient access to the Outscraper API from...

32
Emerging
1483 AVS1508/Parinaam-CBSE-Results-Scraper

Parinaam is a command-line Python application that scrapes and downloads...

32
Emerging
1484 EugeniaVoytik/Car_price_prediction

Predicting the car's price based on its characteristics

32
Emerging
1485 Sandy0002/Web-Application-For-Finance

This is an extension of FINAL YEAR PROJECT in which further features such as...

32
Emerging
1486 ElektroStudios/FHM-Crawler-freehardmusic.com

Crawls download urls of albums from freehardmusic.com website

32
Emerging
1487 FlowExtractAPI/idealista-scraper-api

💰 $0.5 per 1,000 results: Extracts structured property data (price,...

32
Emerging
1488 luminati-io/Google-Maps-dataset-samples

A sample dataset of over 1000 Google Maps businesses, extracted using the...

32
Emerging
1489 Ish3ng0m4/FahamuOSINT

FahamuOSINT Is an Automated OSINT Reconnaissance Tool FahamuOSINT is a...

32
Emerging
1490 korenko-git/obsidian-web-clipper-templates

My collection of Obsidian Web Clipper templates

32
Emerging
1491 alexisadorn/Flatiron-OO-Ruby

Flatiron Full Stack Web Development Curriculum & Labs - Object-Oriented Ruby

32
Emerging
1492 itw-creative-works/social-selectors

SocialSelectors is a dynamically updated library of css selectors for social...

32
Emerging
1493 pratapvardhan/Maharashtra-State-Elections-2014

Maharashtra State Elections - 2014

32
Emerging
1494 Jaguar000212/LOTM-API

Library that scraps data from one of the fandoms of Lord of the Mysteries,...

32
Emerging
1495 FlowExtractAPI/Youtube-Scraper-Pro

Extracts metadata and scripts from all YT content, identifying smart...

32
Emerging
1496 ansegura7/WebScraping_Covid19

Web Scraping project to obtain data on confirmed cases and deaths of...

32
Emerging
1497 JinuLin/Python

一个完整的Python学习体系,从零基础到高级应用。包含10个章节共185个代码实例,涵盖基础语法、面向对象、文件操作、科学计算、数据可视化、网络爬虫等全...

32
Emerging
1498 text-analytics-20/news-sentiment-development

Analyzing the sentiment development of news articles with the topic...

32
Emerging
1499 CamiloMartinezM/site2md

A powerful CLI tool that mirrors entire websites or local directories and...

32
Emerging
1500 gregstoll/rust-scraping

Examples of web scraping in Rust

32
Emerging
1501 krizten/Scraping-Jumia-Ecommerce

Using the Scrapy framework to scrape data consisting of name, brand, rating,...

32
Emerging
1502 pH-7/Emails-Scraper

:ram: Simple PHP Email Grabber to get emails from a txt file containing the...

32
Emerging
1503 automation9417/automation-samples

Using clicknium to automate platforms like Linkedin, twitter, Slack, Youtube...

32
Emerging
1504 Ycmmn/VisionFusion_OCR_QR

🚀 VisionFusion by Yabix — an AI-powered OCR + QR + Web Intelligence suite...

32
Emerging
1505 capuccino26/MacroTrends-Scraping

Web scraping and managing data from MacroTrends

32
Emerging
1506 shanuhalli/Project-Real-Estate-Price-Prediction

Worked on Real Estate Price data analysis by scraping website from...

32
Emerging
1507 fgparamio/api-flight.com

Main API Flight Git Repository

32
Emerging
1508 kbhujbal/go-get-jobs

💼 Go-based job aggregator that scrapes and consolidates software...

32
Emerging
1509 d4tagirl/uruguayan_parliamentary_session_diary

Code for my blog post about text mining uruguayan Parliamentary sessions 🇺🇾

32
Emerging
1510 axsddlr/rpilocator_api

An Unofficial REST API for checking Raspberry Pi 4 availability...

32
Emerging
1511 thaikolja/avherald-scraper

A Python script that extracts the data of avherald.com, which provides...

32
Emerging
1512 SplusEins/sked_parser

Parses Ostfalia sked timetables into JSON for spluseins.de

32
Emerging
1513 pavelkrusek/market-calendar-tool

Market Calendar Tool is a Python package that scrapes economic calendar data...

32
Emerging
1514 kp96/Course-Page-Downloader

Downloads contents of VIT Academics Course Page and organizes them nicely

32
Emerging
1515 pipriles/fb-event-scraper

Recursively scrape facebook events

32
Emerging
1516 Prismadic/tractor-beam

high-efficiency text & file scraper with smart tracking, client/server...

32
Emerging
1517 speckly/Kurokami

Carousell web scraper and monitoring

32
Emerging
1518 cjk268/Insider-Trading-Alerts

Python script for monitoring insider trading activities from CapitolTrades....

32
Emerging
1519 RozhakLabs/Like4Gram

Like4Gram adalah alat berbasis Python untuk mengotomatiskan misi follow di...

32
Emerging
1520 d502e19/scraper

distributed web scraper

32
Emerging
1521 City-Bureau/city-scrapers-akr

City Scrapers project for Akron

32
Emerging
1522 ericbrasiln/resumos-anpuh-cli

Interface de linha de comando para raspar resumos dos Simpósio Nacionais de...

32
Emerging
1523 bangjii/bmkg

BMKG web content scraper, mengambil konten cuaca dan gempa dan menampilkan...

32
Emerging
1524 fulldecent/pro-penetration

Penetration research against NSFW websites

32
Emerging
1525 salmiyounes/movcli

A cli tool to search and watch movies

32
Emerging
1526 rohan-bhautoo/Python-Web-Scraper

A python web scaper to extract content and data from a website.

32
Emerging
1527 imteekay/m2m

Transform a Medium post into a Markdown file

32
Emerging
1528 BentoBox-Project/vanguard-kit

A convenient way to calculate the difference between html files to scrape...

32
Emerging
1529 itslab-kyushu/youtube-comment-scraper

Scraping comments from Youtube.

32
Emerging
1530 tokahuke/lopez

Crawling and scraping the Web for fun and profit

32
Emerging
1531 devsheke/scrapollo

A cli application that scrapes leads off of apollo.io

32
Emerging
1532 comp-strat/scrape_obituaries

Code for scraping obituaries from Legacy.com. 3 steps: scrape URLs &...

32
Emerging
1533 gsidhu/NAS-2021-data

Raw data from NAS 2021 report

32
Emerging
1534 ahmadxgani/flask-restapi

rest api build by flask

32
Emerging
1535 fatihyildizli/FYCrawler

🕷 Custom Web Spider | Frontend: ⚛️ React.js - Backend: ☕️ Java / NodeJS

32
Emerging
1536 Develop-Packt/Web-Scraping-with-Jupyter-Notebooks

Analyze and parse HTML responses, programmatically scrape web data, and...

32
Emerging
1537 AKASH-UWU/Zota-Proxy-Scrapper

A Python tool for scraping and validating proxies from multiple URLs with...

32
Emerging
1538 vik-ma/Price-Performance-Scraper

Full-stack web application that allows the user to calculate the...

32
Emerging
1539 oxylabs/how-to-scrape-google-trends

Learn step-by-step how to scrape Google Trends data and make a result...

32
Emerging
1540 opplieam/FacebookCrawler

A web crawler designed for Facebook pages has been developed utilizing the...

32
Emerging
1541 Ghost0159/hShop-downloader

A python script to download all hShop content

32
Emerging
1542 lorenzoelia/autoscout24_scraping

Python-based web scraping and data analysis tool designed to collect vehicle...

32
Emerging
1543 VMS-Solutions/path-finder-rl

Method For Establishing Database For Global Value Chain For Parts Procurement

32
Emerging
1544 bassel27/Investopedia-Bot

Pick the best stocks and automate Investopedia

32
Emerging
1545 pocesar/actor-shopify-scraper

Automate monitoring prices on the most popular solution for building online...

32
Emerging
1546 KalyanM45/End-to-End-Image-Scraping

Image Scraper Web App is a simple Flask-based web application that enables...

32
Emerging
1547 Ilias1988/Universal-News-Scraper

A robust CLI news scraper and aggregator. Features topic auto-discovery (via...

32
Emerging
1548 ScrapingAnt/scrapingant-client-js

ScrapingAnt API client for JavaScript / Node.js.

32
Emerging
1549 tanukijs/scrape-them-all

🚀 An easy-to-handle Node.js scraper that allow you to scrape them all in a...

32
Emerging
1550 ambrozic/okami

A high-level web scraping framework

32
Emerging
1551 danhilse/web-scraper

A versatile Python-based web scraper that extracts content from single URLs...

32
Emerging
1552 wxkingstar/SuperTables

Select table cells like Excel - select, copy, and analyze table data on any...

32
Emerging
1553 shaikhsajid1111/manga-down

manga_down is a tool to download manga from mangareader and mangapanda

32
Emerging
1554 jy95/YTscheduledVideos2Ical

Extract your scheduled videos publish date to a ical file so that it allows...

32
Emerging
1555 alexleen/scrape-x

Simple .NET library that provides generic web scraping abilities using XPaths.

32
Emerging
1556 nerevu/hdxscraper-world-bank-climate

World Bank Climate Change Data Collector

32
Emerging
1557 akshatvg/LastMinutePPTFrontend

Project which automatically generates crucial business and leisure...

32
Emerging
1558 stargrep/crypto-crawler

simple crypto price crawler with db and alerts

32
Emerging
1559 Gingerbreadfork/Cutlery

Python Script for Copywriters to Gather Data from Competing Content and Find...

31
Emerging
1560 ilinguistics/common_crawl_corpus

Scripts for building a geo-located web corpus using Common Crawl data

31
Emerging
1561 ReaperZ0v/csgo-stats-scraper

A web scraper coded in python for scraping the gaming stats for counter...

31
Emerging
1562 orsifrancesco/sniffagrammers

Node.js and PHP files to automatically downloading pictures from instagram...

31
Emerging
1563 FlowerEatsFish/eslite-com-crawler

eslite.com crawler 「誠品線上」資料爬蟲

31
Emerging
1564 bogdan-viz/fastscrape

A simple web scraper built with python and beautifulfoup.

31
Emerging
1565 itaynir1/Brute-Force

This project is a Python script for conducting a brute-force attack on a...

31
Emerging
1566 sheng1111/Proxy-Hunter

One-stop proxy management and traffic tracking toolkit – fast, intelligent,...

31
Emerging
1567 radzak/rtv-downloader

Wrapper and extension of youtube-dl, that lets you manage downloading...

31
Emerging
1568 Sreyas-Sreelal/pawn-scraper

Web scraping with HTML parsers and querying with CSS selectors in pawn (WIP)

31
Emerging
1569 vypivshiy/scrape-schema

Structuring parsed data into python objects

31
Emerging
1570 realityexpander/FredsRoadtripStoryteller

Hear local historical markers as you travel on your road-trip. 100% Shared...

31
Emerging
1571 GustyCube/spyder

Distributed DNS + HTTP crawler with queueing, deduplication, tracing, and...

31
Emerging
1572 thedatadavis/free-us-proxy

Pulls list of free US proxies from www.us-proxy.org

31
Emerging
1573 ZReC/AnimePaheXtractor

a way to download and backup your anime series

31
Emerging
1574 pjosalgado/collectors-channel-scraper

GitLab mirror repository.

31
Emerging
1575 SirwanAfifi/tesco-clubcards-of-the-day

Tesco ClubCards of the Day is a script developed using Bun to fetch the...

31
Emerging
1576 SGSSSonline/text-analysis

Learning and teaching materials for text analysis course run under the...

31
Emerging
1577 davccavalcante/PrometheusHackerRank

PrometheusHackerRank is a powerful Chrome extension that provides users with...

31
Emerging
1578 datenanfragen/data-imports

Quick-and-dirty scripts to import existing datasets or scrape records from...

31
Emerging
1579 serpapi/nokolexbor

High-performance HTML5 parser for Ruby based on Lexbor, with support for...

31
Emerging
1580 PBenavides/Automated-Valuation-Model-Lima

Automated Valuation Machine Learning Model for Lima House Pricing

31
Emerging
1581 shashank-sharma/MP-Transportation-Analysis

Program to analyze MP Transportation data and comparing

31
Emerging
1582 tuubes/DataTractor

Extract game data from web sources

31
Emerging
1583 throughput-ec/UnacquiredSites

Retrieving site information from journal articles for domain data...

31
Emerging
1584 Pawsanie/Steam_statistics_ETL

This pipeline can be used to collect statistical information about all...

31
Emerging
1585 deep5050/amori-banglabhasha

Collection of Bangladeshi Stories

31
Emerging
1586 Quantum-Codes/JoSAA_2024

Data dump + extraction scripts for scraped data from JIC Report 2024 and...

31
Emerging
1587 rockavoldy/pajak

Scrape kurs pajak dari kementrian keuangan sesuai Keputusan Menteri Keuangan...

31
Emerging
1588 UOSHUB/BackEnd

:desktop_computer: The back-end code for UOS HUB website. All web scraping...

31
Emerging
1589 AstraBert/BioMedicalPapersBot

A Gradio bot to retrieve PubMed papers' title, doi, authors and publication...

31
Emerging
1590 rithwikshetty/gov-opportunity-scraper

Comprehensive Python web scraper for UK Government tender opportunities from...

31
Emerging
1591 shahriar-rahman/Yahoo-Sports-News-Tracker-using-Beautiful-Soup

Parse and Scrape data from Yahoo Sports News.

31
Emerging
1592 victrme/weather.com-scraper

A private equity firm bought The Weather Company, valued at +$1B. What if we...

31
Emerging
1593 niklak/dom_finder

HTML parsing with CSS seletors

31
Emerging
1594 Ombucha/gocomics.py

A basic scraper for GoComics.

31
Emerging
1595 peppapig450/FashionCrawler

FashionCrawler is a versatile Python tool designed for scraping data from...

31
Emerging
1596 eccentricOrange/scholarships-scraping

This project helps you scrape lists of scholarships.

31
Emerging
1597 nuncjo/Delver

Programmatic web browser/crawler in Python. Alternative to Mechanize,...

31
Emerging
1598 a3r0id/lightshot-data-miner

A random idea I had a while back to make a data miner for lightshot. Never...

31
Emerging
1599 gonza7aav/steam-wishlist-exporter

A tool to export the wishlist of a Steam account

31
Emerging
1600 robineco/Wort-des-Tages

Print the word of the day from duden.de

31
Emerging
1601 paulsamuel-w-e/UiPath-Projects

A collection of UiPath automation projects covering web scraping, email...

31
Emerging
1602 hrbrmstr/wayback

:rewind: Tools to Work with the Various Internet Archive Wayback Machine APIs

31
Emerging
1603 lheredias/Luftmensch

Useful PDF-related productivity tool.

31
Emerging
1604 DhrumilShah98/CarsDataPythonScript

Python script to fetch cars data

31
Emerging
1605 SubMaRk/scrapy

Download any Manga Manhwa Manhua from online website with Custom Extension.

31
Emerging
1606 satyawikananda/covid19-simple-api

Simple scraping covid19 data, for fun and for learning purpose

31
Emerging
1607 xcrap-dev/got-scraping-client

Xcrap Got Scraping Client is a package of the Xcrap framework that...

31
Emerging
1608 AngelLM/TennisMatchPredictor

Machine Learning Project to try to predict results of tennis matches.

31
Emerging
1609 lrbrwnn1/HIVE

Django-based web app developed for the UofM Bioinformatics Dept, now in...

31
Emerging
1610 WTSTiNy/DeCryPt

Scrapes: [HTTP, HTTPS, SOCKS4, and SOCKS5] || "Bypasses" and scrapes paid proxies

31
Emerging
1611 isfendi2021/archive-book-liberator

📚 Extract and convert "Borrow Only" books from Internet Archive into PDFs,...

31
Emerging
1612 avrtt/SEO-CTR-optimizer

Digital marketing analytics solution that scrapes websites for SEO factors...

31
Emerging
1613 VETURISRIRAM/SMART-SEARCH-ENGINE

This repository includes implementation of an Intelligent Search Engine from scratch.

31
Emerging
1614 martinthenext/criticalsyncing

Get the different prospective on news

31
Emerging
1615 fernandod1/Aliexpress-telegram

Script to post in your Telegram channel your Aliexpress offers reading them...

31
Emerging
1616 rpradosilva/resume-in

A LinkedIn web scraping to JSON file

31
Emerging
1617 Sunkio/web-crawler_js

A JavaScript/Node.js CLI that crawls websites for internal and external links

31
Emerging
1618 Siraj1munir/DataScienceStuff

My recent work on Data Science and deep learning

31
Emerging
1619 briancurt/linkedin-scraping

Bs4 and urllib3 practice. Returns job duration in months.

31
Emerging
1620 project-nichijou/nichijou.server.spider.bangumi

🧊 Spider for bgm.tv (or its mirror site)

31
Emerging
1621 Yash-Parsana/CrazyCoderServerlessApi

This is backend api of CrazyCoder App which serves realtime data from...

31
Emerging
1622 monk-time/imdb-backup-lists

A simple tool to backup all your lists from IMDb including your watchlist...

31
Emerging
1623 sergioburdisso/solidscraper

Easy to use JQuery-Like API for Web Scraping/Crawling.

31
Emerging
1624 deepa-sarojam/Data-Science

Repository for Data Science projects in Python.

31
Emerging
1625 InterruptorPt/ouvimos-mais-musica-portuguesa

Análise de tabelas de vendas de álbuns e lançamentos discográficos em Portugal

31
Emerging
1626 TelRich/Web_Scraping_Top_Data_Analytics_Firms

DA Project 1: Scraped 153 Top Data Analytics Firms from Goodfirms website....

31
Emerging
1627 sue445/cure_line

LINE TIMELINE scraping tool

31
Emerging
1628 Mitsu66/html-parser

Xpath, regex and CSS Selector parser

31
Emerging
1629 GMDSantana/crivo

A tool for extracting and filtering URLs, IPs, domains, and subdomains from...

31
Emerging
1630 book000/get-manaba

Library for get various information about manaba.

31
Emerging
1631 0x0be/scrapeadvisor

A user-friendly python-based GUI which provides sentiment analysis of users'...

31
Emerging
1632 zaidongy/Spotify-Scraper

Tool to scrape the Spotify web interface to retrieve artist logos

31
Emerging
1633 Alnyz/NewApkPure

Search and download applications from apkpure.com

31
Emerging
1634 touero/pond-loach

Python爬取分析2021年世界五百强的WebApp

31
Emerging
1635 t0ry003/YoutubePlayListDL

A Python tool for easily downloading music from YouTube playlists in MP3...

31
Emerging
1636 Sabyasachi-Seal/AmazonPriceDropAlert

An Amazon Price Drop Alert Bot

31
Emerging
1637 sonirico/wpoke

python library tool to gather wordpress information

31
Emerging
1638 EhsanulHaqueSiam/BDNewsPaperScraper

🕷️ Advanced news scraper for major Bangladeshi newspapers with...

31
Emerging
1639 AgentANAKIN/Google-Web-Scraper

This Python code scrapes Google search results then applies sentiment...

31
Emerging
1640 manhph2211/SAS

Customer Feedbacks :smile:

31
Emerging
1641 SchBenedikt/datamining

Heise (https://heise.de) + Chip (https://chip.de) News Crawler,...

31
Emerging
1642 AKASH-UWU/EDUBOARDBD

EDUBOARDBD is a result scraper that fedemic results from...

31
Emerging
1643 naftalent/mojok_archive

Website archiving project for Mojok.co website, based on scrapping.

31
Emerging
1644 Jaimepas77/AeRForU

Chrome web extension for aceptaelreto.com

31
Emerging
1645 oxylabs/scrape-google-python

In this tutorial, we showcase how to scrape public Google data with Python...

31
Emerging
1646 siongui/goigstorydl

Download Instagram Stories in Go

31
Emerging
1647 Staskaer/anime_crawler

一个基于Requests库的多线程图片爬虫小框架,支持定时启动等配置。目前内置了pixiv.re图片爬取的功能。

31
Emerging
1648 frittlechasm/sitescrape

Simple Bash Script for crawling and scraping

31
Emerging
1649 Rav4s/iFixit-Repairability-Dashboard

Pulls repairability scores for various devices from iFixit, which are then...

31
Emerging
1650 kennethsequeira/impawards-downloader

Low effort Python script to download movie posters from impawards.com

31
Emerging
1651 hamzaskhan/HTTracker-Alternate

A python script that does what HTTrack does. Since this is in script form,...

31
Emerging
1652 5amu/pocbrowser

Scrape websites to find PoCs for CVEs

31
Emerging
1653 oxylabs/backlink-monitoring

Backlink checker is a simple tool, which checks backlink quality, identifies...

31
Emerging
1654 DCS-training/summerschool2024-stream2

Welcome to the repository for all the materials for Stream 2 of the CDCS...

31
Emerging
1655 shivanshsinghal107/StockBot

A python telegram bot to fetch real-time global financial market indices,...

31
Emerging
1656 sapuri/porn-thumbnail-api

API for getting porn thumbnails from a video url

31
Emerging
1657 dogukannulu/aws_end_to_end_streaming_pipeline

An AWS Data Engineering End-to-End Project (Glue, Lambda, Kinesis, Redshift,...

31
Emerging
1658 orsinium-labs/ghstars

⭐️ Collect and render most notable stargazers for your GitHub projects

31
Emerging
1659 6alaile/Football-Odds-AI

Web scraper for Football betting odds for sites based in Tanzania.

31
Emerging
1660 Zadigo/zineb

An advanced web scrapping framework for Python

31
Emerging
1661 orassayag/nodejs-learning-v2

A comprehensive Node.js learning repository demonstrating fundamental to...

31
Emerging
1662 georgevbsantiago/tcmbapessoal

Web Scraping para coletar os dados da Folha de Pessoal dos Municípios (BA)...

31
Emerging
1663 SachaPaquette/Manga

Script to download various Mangas from MangaDex

31
Emerging
1664 bitmakerla/estela-cli

estela Command Line Client 🕸

31
Emerging
1665 mratanusarkar/Dataset-Indian-Companies

Web Scraping "List of companies in India" from AmbitionBox Website using...

31
Emerging
1666 anishalx/protected-pdf-downloader

A script to download view-only protected PDFs from Google Drive by...

31
Emerging
1667 reidemeister94/fantasanremo

A little experiment for predicting the best 5 performers for the 2022...

31
Emerging
1668 codexguy/xSkrape.APIWrapper.REST

Data extraction, identification, and shaping functionality. This repository...

31
Emerging
1669 aoguai/cctv_programs

CCTV 央视网历史节目单数据。

31
Emerging
1670 AaronWChen/MeaLeon

Have a favorite dish but want to try something with similar ingredients but...

31
Emerging
1671 pH-7/GetterMails

GetterMails, Scraper

31
Emerging
1672 turtlemonvh/biblescholar

Tools for multi-translation Bible search over voice apis (currently alexa).

31
Emerging
1673 knourian/Freelancer.com-Category-Scrapping

Scrapping Categories from Freelancer.com Using scrapy with number of project...

31
Emerging
1674 samlanka/TED-Talks-Generator

A character-level multi-layer LSTM to generate TED Talks

31
Emerging
1675 gurjeet29/telegram_members_scrapper

Python Script to scrape members from a selected Telegram group.

31
Emerging
1676 Yokozuna59/ical_maker

A python web scraping project gets specific dates from KFUPM Registrar.

31
Emerging
1677 LoayAhmed304/search-engine

A high-performance search engine that crawls web pages, indexes content,...

31
Emerging
1678 oxylabs/quick-start-guide

Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.

31
Emerging
1679 hvna9/Scraping4Engineering

A Web Scraping application to retrieve and store data from Web sorurces. The...

31
Emerging
1680 Dramatycznie/AO3_Custom_Scraper_with_Sampling

A Python tool for customizable scraping and data extraction from Archive of...

31
Emerging
1681 ashkanfeyzollahi/fortexs

🔍 A web scraper for fetching products from `www.fortex.ir`

31
Emerging
1682 MikaYelovich/mika-scraper

A modular and extensible web scraping toolkit built with TypeScript

31
Emerging
1683 laurabarredaagusti/idealista_data_extraction

Data extraction from Idealista, using their API and web scraping (python)....

31
Emerging
1684 rudrajikadra/Web-Scraping-Amazon-Mens-Fashion-Search-Images-Beautiful-Soup-Python

Using Python and Beautiful Soupe this code is able to download images from...

31
Emerging
1685 conflict-investigations/nzz-maps

Analysis of territorial control data from NZZ.ch

31
Emerging
1686 oxylabs/ai-map-py

AI Map is an AI-powered website mapping tool by Oxylabs AI Studio that uses...

31
Emerging
1687 lancepokaiwang/Golang_Web_Crawling

Web crawling by using Golang.

31
Emerging
1688 Amey-Thakur/COVID19-WEB-SCRAPER

Scraping and visualizing India’s real-time COVID-19 data from the Ministry...

31
Emerging
1689 suewoon/nyt-api-wrapper

🗞A python wrapper for NYT article search API

31
Emerging
1690 djb-gt/resident-advisor-events-scraper

A Python-based web scraper for extracting event data from Resident Advisor...

31
Emerging
1691 bkataru/search-m8

A service that scrapes google and youtube search to transcribe and obtain...

31
Emerging
1692 bertdida/twitter-quote-scraper

A command line tool for scraping quotations on Twitter

31
Emerging
1693 damianmoore/photo-dataset-scraper

Tools to create a labelled dataset of photos for deep learning image classification

31
Emerging
1694 linguabook/linguabook.github.io

Just-in-time scraper of linguistic information from different sources like...

31
Emerging
1695 rohityadav-sas/Notice-Alert-CLI

A Node.js application that fetches, compares, and notifies users about new...

31
Emerging
1696 Luk-kar/Home-Market-Harvester

Home Market Harvester is a Python tool for scraping OLX, otodom rental data,...

31
Emerging
1697 johnvanderton/flysh

HTML web parser powered by jQuery and JSDOM

31
Emerging
1698 Deathwalker9959/http-tunnel

A high-performance HTTP/1.1 and HTTP/2 tunnel proxy with an advanced...

31
Emerging
1699 JirkaZelenka/Sreality

Sreality, Scraping, Analysis, Python

31
Emerging
1700 jakewarren/scrape

A command line scraping utility supporting CSS selectors or XPath

31
Emerging
1701 ZenRows/crawling-from-scratch

Repository for the Mastering Web Scraping in Python: Crawling from Scratch...

31
Emerging
1702 Jebq/Artnet-Scraper

Python tool to scrap images from artnet website

31
Emerging
1703 davccavalcante/ParisArrowFacebookAdminPostReporter

Paris' Arrow Facebook Admin Post Reporter is a powerful Chromium extension...

31
Emerging
1704 kinoute/moviestills

A small CLI app to scrap high-quality movie snapshots from various websites.

31
Emerging
1705 mathun3003/quotes-recommender

Quotes Recommender Project - Part of the Data Integration Course in Winter Term 23/24

31
Emerging
1706 chenmozhijin/mediawikiextractor

一个用于从 MediaWiki 网站中提取数据并保存为json的 Python 脚本。|A Python script for extracting...

31
Emerging
1707 vrikodar/Hacker-News-Scraper

Get A list of all Stories on Hacker News Right in your terminal with one command

31
Emerging
1708 Anzo52/JCrawl

Java web crawler

31
Emerging
1709 edoardottt/amazon_tracker

A simple amazon tracker that sends you an email when prices of your followed...

31
Emerging
1710 gnramsay/trekpedia

WIP: Star Trek TV/Film episode database in JSON format, scraped from web...

31
Emerging
1711 aedorado/CodeChef-Gitter

:books: Save all and update solutions submitted on Codechef to github.

31
Emerging
1712 gkzz/deephotel

scraping TripAdvisor, Booking.com with Scrapy

31
Emerging
1713 AbdulAhadSiddiqui11/Web-Scraper-OU-Results

A webscraper in python for result analysis.

31
Emerging
1714 wangdw495/ecommerce-price-analysis

🛒 电商价格监控分析系统 | E-commerce Price Monitoring & Analysis System - ...

31
Emerging
1715 Zubdata/SERP-Eagle

Google Search Results Scraper written in Python. You can also use proxies in...

31
Emerging
1716 Ishan7390/Web_Scraper

My Simple approach to building web scraper using Beautiful Soup library in Python

31
Emerging
1717 ahmedsajid/td-precious-metals-scraper

Repo for scraping TD precious metals website, tracking price changes

31
Emerging
1718 cy-zheng/pyCreeper

一个用来快速提取网页内容的信息采集(爬虫)框架, 实现了对网页的动态加载与控制。

31
Emerging
1719 cloasdata/geoiter

A simple tool to iterate center coordinates within given boundaries

31
Emerging
1720 teddbug-S/Python-Practical-Projects

A repository full of awesome projects anyone can learn from and also contribute to.

31
Emerging
1721 SurendraTamang/awesome-webscraping-blogs

Curated list of technical blogs and videos on web scraping·

31
Emerging
1722 pcsingh/Predicting-Repo-popularity

This is a machine learning model that can predict the popularity of the...

31
Emerging
1723 TUVIMEN/youporn-scraper

A bash script for scraping youporn videos, channels and pornstars metadata in json

31
Emerging
1724 Incognito-Coder/Instagram-Tools

Little php class for instagram.

31
Emerging
1725 dinostheo/oembedder

Delivers the embedded representation of a URL if one is provided or tries to...

31
Emerging
1726 raczak/build-your-web-scraper-full-js-sosnoob

Scrap a website data & Build your own Database / API for your apps more free...

31
Emerging
1727 cbgaindia/scrapers

A collection of scripts to scrape Indian Budget documents from various sources.

31
Emerging
1728 comiko-app/data-scraper

Data scraping project for Comiko.

31
Emerging
1729 ez-apis/ez-web-scraping

🔐 A minimalist way to retrieve data from websites that require login

31
Emerging
1730 sandunisuru/Lottery-Result-Scraper

This small NodeJS script use as API for getting daily lottery results.

31
Emerging
1731 rodneykeilson/ScrapiReddit

A complete Reddit scraper without API keys, available with every...

31
Emerging
1732 vishvendra01/wallpaperscraper

this python script download all wallpapers from http://simpledesktops.com

31
Emerging
1733 GeiserX/BuscaPaginasBlancas

OSINT tool for extracting contact information from Spanish white pages...

31
Emerging
1734 MayankFawkes/Instagram-Scraper

Instagram Scraper and Downloader

31
Emerging
1735 NeuralFlux/gsoc-organization-filter

A simple program to facilitate your GSoC recon.

31
Emerging
1736 sp34rh34d/WebRunner

Web scraping | Website cloner | Path Traversal Scanner

31
Emerging
1737 kelvinthh/ig-dm-reels-autodownload

A Python script that auto downloads all reels sent to your Instagram DM

31
Emerging
1738 LuisAraujo/API-Tabua-Mare

[Eng] API for obtaining data from the Tide Table, using web scraping....

31
Emerging
1739 thanh309/news-aggregator-g17

OOP project for semester 20232 - HUST

31
Emerging
1740 internaut/webwatch

A minimal and easy to use website monitoring script -- get notified when...

31
Emerging
1741 dbeley/senscritiquescraper

Python library to extract data from senscritique.com.

31
Emerging
1742 oxylabs/how-to-scrape-google-scholar

A guide for extracting titles, authors, and citations from Google Scholar...

31
Emerging
1743 samifriedrich/webscraping_workshop

A Jupyter Notebook-based workshop on web scraping in python

31
Emerging
1744 luisgc93/ibex35_bot

A twitter bot that scrapes financial news articles and retrieves stock prices

31
Emerging
1745 techyhoney/TikTok_Scrapper

Python TikTok scrapper to download videos by username or by hashtag and then...

31
Emerging
1746 Dentrax/xdsl-exporter

xDSL Prometheus Exporter

31
Emerging
1747 gasparian/upwork_parsing

upwork jobs scraper

31
Emerging
1748 sinanazem/tehran-stock-exchange

This project focuses on creating a data pipeline to crawl the watchlist data...

31
Emerging
1749 comp195/JobHunter

Job Hunter | Making job searching easier

31
Emerging
1750 crawlbase/crawlbase-net

A lightweight, fast .NET class that acts as wrapper for Crawlbase API

31
Emerging
1751 hubertlacote/fb-scraping-tools

A unit tested set of tools written in Python to scrape / collect data...

31
Emerging
1752 azraf122312/Telegram_BotScraper

Telegram Group scraper and A Bot to send messages!!!!

31
Emerging
1753 MichaelvanLaar/n8n-nodes-defuddle

n8n community node for extracting main content from webpages using Defuddle library

30
Emerging
1754 xcrap-dev/core

Xcrap Core is the core package of the Xcrap framework for web scraping,...

30
Emerging
1755 Ashad001/MITCrawlerX

Crawler for MIT OCW - organized scraping with batch control, timers, and...

30
Emerging
1756 ArefShojaei/Digikala-scraper

digikala website scraping with NodeJS + API

30
Emerging
1757 hubmapconsortium/asctb-ct-label-mapper

asctb-ct-label-mapper: A package to recommend controlled vocabulary for...

30
Emerging
1758 MrDevel0per/VailProject

A simple Python web scraper that gets lift and run data from any of Vail...

30
Emerging
1759 mannasoumya/youtube-views-scraper

A Simple Node App using Cheerio which scrapes YT views from YT video Link

30
Emerging
1760 nezzzumi/mangalivre-api

API não-oficial do mangá livre feita com Node.js e Express.js.

30
Emerging
1761 zawster/Python-Regex

Regular expressions using re Python module

30
Emerging
1762 Zabuzard/MPLogger

Saves marketprices for items, based on transactions, from the game...

30
Emerging
1763 R4F405/google-maps-scrap-automation

A Python-based desktop GUI for the gosom/google-maps-scraper API. This tool...

30
Emerging
1764 0-harshit-0/Google-Map-Scraper

Effortlessly extract valuable data from Google Maps with precision and speed...

30
Emerging
1765 Julien-cpsn/google-scholar-query

Query Google Scholar data

30
Emerging
1766 Xhtira20/scraped

Scrape web pages in parallel, convert them to clean markdown, and navigate...

30
Emerging
1767 haldunanil-portfolio/cop-scraper

A scraper built using Scrapy+Python that can quickly get a list of mot law...

30
Emerging
1768 aaronginder/web-scrape-football-data

Generates a CSV of all games in the Premier League reported on...

30
Emerging
1769 YarosJ/prestige-of-districts

:mag_right: This application parses sites and retrieves data associated with...

30
Emerging
1770 rohit-yadav/scraping-news-articles

Create a web crawler that goes through the section of a newspaper website...

30
Emerging
1771 Jack-Tilley/webscraping_tools

Tools to make webscraping easier

30
Emerging
1772 pedroalpacheco/aneel

Webscraping de info aneel

30
Emerging
1773 methylDragon/fb_embedded_comment_scraper

A scraper for gathering data from Facebook's embedded comment widgets for...

30
Emerging
1774 Mandalfashion/amazon-reviews-scraper

🛒 Extract detailed product reviews from Amazon using URLs to analyze...

30
Emerging
1775 aaront/puckdb

An async-first hockey data extractor and API

30
Emerging
1776 satwikkansal/tweet_scraper

A CLI based scraper script for Twitter. Supports languages, search query,...

30
Emerging
1777 othreecodes/NewZZ

A news aggregator application

30
Emerging
1778 woinary/scraping_rakuten_point_py

楽天ポイント実績をCSV出力

30
Emerging
1779 arifputra03/BlueS.py

🔍 Sniff Bluetooth Low Energy devices; view details like MAC address and RSSI...

30
Emerging
1780 haiueom/hoyo-code

Scrape all active & expired Hoyoverse games redeem/promotional codes from...

30
Emerging
1781 orassayag/cv-spider-v2

An ASP.NET web app that automates job search email collection by scraping...

30
Emerging
1782 bislai/lab

🐍 Scraping y NLP con Python

30
Emerging
1783 mindisk/amazon-review-scraper

A basic python 3 based web scraper for extracting reviews from Amazon. Built...

30
Emerging
1784 maharjansanisha/Gundruk-Price-Site

Gundruk Price List

30
Emerging
1785 oxylabs/web-scraping-powershell

A comprehensive guide on using PowerShell and PowerHTML for designing...

30
Emerging
1786 orassayag/cv-spider-v3

An ASP.NET Web Forms app that discovers and collects email addresses from...

30
Emerging
1787 jaidevd/iiml_textmining

Repository from the text mining tutorial at IIM-L

30
Emerging
1788 SainagShetty/WolfPal

CSC510 SE Project

30
Emerging
1789 FlowerEatsFish/nbinet-collection-crawler

National Bibliographic Information Network collection crawler「全國圖書書目資訊網」館藏資料爬蟲

30
Emerging
1790 Kamal7734/changedetection-stack

🔍 Monitor website changes effortlessly with a ready-to-use Docker stack for...

30
Emerging
1791 ThomsenDrake/ainews-source-extractor

Extracts all URLs from the most recent AI News issue (from news.smol.ai) and...

30
Emerging
1792 LucaAhumada/broken-link-checker

A robust Node.js tool to crawls websites, detect and report broken links....

30
Emerging
1793 sijiaozhi/wayback-url-finder

🔍 Discover archived URLs from the Wayback Machine with this Chrome...

30
Emerging
1794 erensunar/twitter-v2-keyword-filtering

This project uses the Twitter API v2 and Python to collect tweets from a...

30
Emerging
1795 crowtherln/cognates

Scrapes Wiktionary to find cognates

30
Emerging
1796 smartlixx/GPRD_air_quality_data

This tool scapes the Guangdong-Hong Kong-Macau PRD air quality monitoring...

30
Emerging
1797 talhabalaj/daraz-sentiment

Sentiment analysis of product reviews posted on https://daraz.pk, an online...

30
Emerging
1798 abhinav-bhardwaj/GSoC-Tech-Classifier

Classifies organizations in association with Google Summer of Code based on...

30
Emerging
1799 luccalb/zvg-portal

A Python wrapper for the german foreclosure portal at https://www.zvg-portal.de

30
Emerging
1800 datadesk/hsr-document-analysis

An analysis conducted for the April 27, 2019, story How California’s...

30
Emerging
1801 laztname/samehadaku.sh

link graber for samehadaku.tv

30
Emerging
1802 orassayag/dot-net-spiders

A collection of ASP.NET web crawlers for extracting email addresses from...

30
Emerging
1803 kianelbo/newsKAP

A Persian news search engine

30
Emerging
1804 devmedeiros/nota-fiscal-goiana

Esse projeto apresenta um pipeline de ETL usando os dados da Nota Fiscal...

30
Emerging
1805 himanshumahajan138/PlagX

An automated tool for detecting plagiarism in LeetCode coding contests. It...

30
Emerging
1806 mortizm1988/Scrap_SCAC

This code downloads legal filing from Securities Class Action Clearninghouse...

30
Emerging
1807 sammwyy/SpearCopy

A universal and local phishing toolkit for audit purposes

30
Emerging
1808 Maxr1998/DiskordBot

Discord bot written in Kotlin with Diskord

30
Emerging
1809 Dewrry1895/public-apis

🌐 Explore 306 production-ready REST APIs, designed to enhance your...

30
Emerging
1810 SkyrocketStan/lovikod_litres_promo_scraper_py

Litres promo codes scraper (from lovikod.ru)

30
Emerging
1811 rizkyardhani/airlinequality_scraping

Halo, ini merupakan repository data scraping dari website airlinequality.com...

30
Emerging
1812 ddoroshev/multifetcher

🚀 High-performance server for concurrent fetching from multiple web...

30
Emerging
1813 mikaeldui/HtmlAgilityPack-extensions

Extensions for HtmlAgilityPack.

30
Emerging
1814 sarahcssiqueira/zip-page-extractor

Python-based tool for web scraping and content archiving, extracting HTML,...

30
Emerging
1815 victrme/accuweather-scraper

Accuweather APIs free tier allows 50 calls per day. We can bump that number to 100k !

30
Emerging
1816 Swats1/TikTok-Follow-API

⚡ Access the modern TikTok Android Private API for following users with...

30
Emerging
1817 oxylabs/scraping-real-estate-data-with-python

A guide for extracting public data from Redfin using Python and Oxylabs Web...

30
Emerging
1818 xcrap-dev/axios-client

Xcrap Axios Client is a package of the Xcrap framework that implements an...

30
Emerging
1819 ANDREIII12/AlterLab-SDK

🌐 Scrape any website easily with AlterLab SDKs, designed for seamless...

30
Emerging
1820 toughyear/producthunt-scraper

Basic scripts to scrape ProductHunt data and Analyze it

30
Emerging
1821 MUSA-620-Spring-2017/Course-Materials

Syllabus: MUSA 620 - Data Wrangling and Data Visualization

30
Emerging
1822 meneguinha/Streamlit_youtube_webscrapper

Streamlit App that fetches comments from YouTube channel using YouTube Data API.

30
Emerging
1823 purvanshjoshi/Price-Tracker

🛒 Price Scout: A high-performance real-time price comparison engine for...

30
Emerging
1824 orassayag/event-dates-calendar-ts

A Node.js application to maintain a personalized calendar TXT file by...

30
Emerging
1825 21jaffy/galileoff-OnionScraper

🧅 Streamline data collection and analysis on Tor's .onion sites with...

30
Emerging
1826 RomySaputraSihananda/craw-Pinterest

melakukan web scraping dan mengambil gambar berdasarkan keyword pencarian pinterest.

30
Emerging
1827 MarvNC/pixiv-dump

Automated Pixiv Encyclopedia DB Dumps

30
Emerging
1828 bg-write/candyfloss-flask

Candyfloss - a digital newspaper sharing the best music news and essays...

30
Emerging
1829 n3tn1nja/Telebust

Telegram Bot - Mass Group Adder, Telegram Group Scraper and Mass User Messaging.

30
Emerging
1830 ayaka14732/lihkg-scraper

A Python script for scraping LIHKG

30
Emerging
1831 pywallet-cli/wallet-finder

Find wallet.dat online scraping

30
Emerging
1832 ujjawalsol/cloudflare_bypass

This script allows users to bypass Cloudflare's rate limits by leveraging...

30
Emerging
1833 FavyTeam/Advanced_PHP_Scrapping

Enhanment Scrapping API for six hotel booking website from Expedia.com,...

30
Emerging
1834 natanalmeida03/Sigaa-DiscordBot

discord bot that monitors the availability of vacancies at unb

30
Emerging
1835 adam10603/ChatScraper

A Node.JS command-line tool for quickly searching the chat logs of Twitch VODs.

30
Emerging
1836 santhoshse7en/Alcoholics-Anonymous

Research Project to analyse the knowledge about Alcoholics Anonymous in public

30
Emerging
1837 nikhilkumarsingh/PythonForWeb

Python for web bootcamp teaching material

30
Emerging
1838 SIDDHU123M/Ultimate-Proxy-Scraper

This script scrapes a list of proxies from a user-specified URL. It defines...

30
Emerging
1839 aidenesco/netroutine

Creation and execution of network request routines

30
Emerging
1840 allifizzuddin89/Shopee-Aliexpress-MySQL-Telegram

Web scraping multisite Shopee and Aliexpress

30
Emerging
1841 Eltik/AniSync

Mapping sites to AniList and back.

30
Emerging
1842 middleclicker/WechatScraper

Scrapes your wechat chat history

30
Emerging
1843 AntonioBerna/os-alerts

Simple Web Scraping App for get information from any website

30
Emerging
1844 irfanchahyadi/Scraping-Manga

Scrape manga with python + BeautifulSoup

30
Emerging
1845 stefanodesaraca/Web-Scraping-and-Sentiment-Analysis-with-VADER-and-roBERTa

Web scraping and sentiment analysis using multiprocesses, VADER and...

30
Emerging
1846 GeiserX/AdamPartsFinder

Proof of Concept of a Price Comparison tool for different suppliers

30
Emerging
1847 cimentadaj/dataharvesting

Material for the course 'Data Harvesting' for the masters in computational...

30
Emerging
1848 dimitryzub/google-finance-py

Scripts for scraping Google Finance data in Python. (no longer maintained)

30
Emerging
1849 4ngel2769/rwdl

Fast, recursive downloader for exposed Apache/Nginx directory listings

30
Emerging
1850 SeraphinaGlacia/steam-scraper

A simple, efficient, and visual Steam review data scraper. Scrapes Steam...

30
Emerging
1851 KyleAnthonyShepherd/Electrical-Outage-Data-Scraping

This python code pulls electrical outage data from CenterPoint, an...

30
Emerging
1852 AidaLog/Sitemap-Generator

CLI tool for sitemap generation

30
Emerging
1853 agrawal-priyank/Web-Scraper-Sentiment-Analysis-TripAdvisor

Academic project for Advances in Data Science and Architecture course

30
Emerging
1854 HemantKArya/palert

Palert is a lightweight, powerful desktop app that helps you track product...

30
Emerging
1855 nam4dev/web_scraping_presentation

Web-Scraping Presentation for Pymug community

30
Emerging
1856 book000/get-unipa

Library for get various information about UNIVERSAL PASSPORT.

30
Emerging
1857 iamnotagentleman/PYtureng

PYtureng | A Command line Interface For tureng.com Powered By Python

30
Emerging
1858 susanhsrestha/data-collection-disaster-news-classification

This is the data collection mechanism for the dataset acquisition process of...

30
Emerging
1859 MustakAbsarKhan/stock_watch_py_script

Stock Watch Python Script - A tool for scraping stock data from Dhaka Stock...

30
Emerging
1860 wendirad/facebook-comment-scraper

a Facebook comment scraping tool, facilitating the exploration and analysis...

30
Emerging
1861 ji-mi-alice/reddit-universal-scraper

🤖 Scrape Reddit posts and comments effortlessly with this full-featured...

30
Emerging
1862 eidoriantan/messenger-lyrics

Webhook server for Messenger lyrics

30
Emerging
1863 Connor56/bare-bones

A bare-bones Chrome extension to build and learn from.

30
Emerging
1864 crawlbase/crawlbase-ruby

Fast Crawlbase API crawling library

30
Emerging
1865 poyea/telegram-bot-php

A tiny HKO web scraping Telegram bot written in PHP

30
Emerging
1866 DPCLab/WeiboScrape

Collection of scripts to scrape Weibo and Weiboscope for posts that were...

30
Emerging
1867 20wontons/anfootball

a discord bot that pulls chords and tabs from ultimate-guitar.com (now live!)

30
Emerging
1868 atymri/WebCrawler

WebCrawler is a C# console application that recursively scans a website...

30
Emerging
1869 HERALDEXX/tmdb-movie-scraper

Python scraper to collect movie data from TMDb API. Includes dataset of up...

30
Emerging
1870 amrohan/ChatBot

A is a simple Telegram bot that automatically answers to people when they...

30
Emerging
1871 lbrejon/Web-scraping-jobs

Implementation of jobs recommendation algorithm by web scrapping

30
Emerging
1872 abhisheksarkar30/stock-market-app

An app to track market stock prices and their graph of price variation, etc.

30
Emerging
1873 nikolay-turpitko/structor

Uses EL in Go struct tags to compute struct fields.

30
Emerging
1874 GraveEaterMadison/ShadowProxy

ShadowProxy is an automated Tor proxy setup with built-in IP rotation and...

30
Emerging
1875 fast-crawler/fastcrawler

Modern, fast (high-performance) asynchronous scraping framework based on...

30
Emerging
1876 ramenjuniti/scraping-livedoorNEWS

livedoor NEWS の記事をスクレイピングするやつ

30
Emerging
1877 PrashantPKP/Automated_image_fetcher

A Python Flask web application for automated image extraction and bulk...

30
Emerging
1878 httpanand/Web-html-scraper

Scrap a website's html code with python

30
Emerging
1879 orashar/notify_vaccine

This program check vaccine availability within every 2 minutes and notifies...

30
Emerging
1880 NevascaCode/FundsScraping

🤖Um robô que faz um scraping do site Funds Explorer e os envia por E-mail para você.📨

30
Emerging
1881 dilaouid/FandomScraper-app

WebApp to show the performance of the fandomscraper library

30
Emerging
1882 p3t3r67x0/dasoertliche_scraper

Tiny tool to scrape and fetch address details from dasoertliche.de to...

30
Emerging
1883 schuberty/PLNCrawler

A web crawler focused in the automated creation of datasets for NLP use.

30
Emerging
1884 marcoshsq/Python100DaysOfCode

:snake: :snake: This repository contains the projects developed during the...

30
Emerging
1885 divyanshudhruv/datadiver-ai

🌊 datadiver-ai is the ultimate tool for 📊 web scraping, transforming 🕸️...

30
Emerging
1886 pedroalpacheco/WS_src-video

Exemplo de web scraping que raspa src de video com espera de interação de usuário

30
Emerging
1887 lindsaygelle/labo

Golang package. Labo package fetches the current Nintendo Labo Kits...

30
Emerging
1888 iunary/fakeuseragent

Golang package that provides fake useragent strings for popular web browsers

30
Emerging
1889 nstrydom2/duckduckgo

An unofficial Duckduckgo.com API with performance and simplicity in mind

30
Emerging
1890 crawlbase/crawlbase-python

Fast python library for the Crawlbase API

30
Emerging
1891 QueroSerTech/Garibaldo

Garibaldo é um robô escrito em Python que faz buscas periódicas no Google e...

30
Emerging
1892 itehax/rust-scraping

Web scraping using rust !

30
Emerging
1893 Satellaa/Dotscaper

A tool to scrape Yu-Gi-Oh! Official Card Game card information and prices.

30
Emerging
1894 pratapvardhan/Elections-India-2014

Results related to General Assembly (Lok Sabha) elections 2014 in India.

30
Emerging
1895 Ambitious-Concepts-Labs/LeadGenerationAPI

This API is built for lead generation and provides users with a streamlined...

30
Emerging
1896 mpolatcan/goodreads-scraper

goodreads.com scraper that written in Python with Scrapy framework

30
Emerging
1897 diegotid/family-banking-backend

Backend with REST API and web scraping crontab scripts to fetch personal...

30
Emerging
1898 AlexEidt/uwtools

Python API for University of Washington (UW) Course Catalog and Time...

30
Emerging
1899 ahmedrangel/animeflv-scraper

AnimeFLV Scraper

30
Emerging
1900 kingavatar/lmsScraperGo

A scraper for LMS written in Go

30
Emerging
1901 amotter443/tennis

Using historical tennis statistics to perform prescriptive analytics

30
Emerging
1902 rushikeshamale/song-scraper

This python web scraping script is use to download top 21 Bollywood songs of...

30
Emerging
1903 orassayag/cv-spider-v1-google-api

An ASP.NET Web Forms app for automated web scraping and email extraction...

30
Emerging
1904 yaylinda/nintendo-games-ratings

Dataset and visualizations of Nintendo Games and ratings, scraped from metacritic.com

30
Emerging
1905 utkuufuk/ping-sm

Receive an email or Telegram message as soon as Migros Sanalmarket is...

30
Emerging
1906 mattrasband/drudge_parser

Web Scraper/Parser for the drudge report

30
Emerging
1907 datascisteven/Movie-Analysis-Project

Movie Analysis Project (Phase 1 Project for Flatiron School Data Science Bootcamp)

30
Emerging
1908 orassayag/event-dates-calendar

A Node.js application to create and manage a personalized calendar TXT file...

30
Emerging
1909 Andronovo-bit/Nationso-Trend-Integration

Nationso Trend Integration is a Python project that fetches and saves the...

30
Emerging
1910 Integralist/go-web-crawler

A web crawler built in the Go programming language

30
Emerging
1911 RozhakLabs/InstaSub

InstaSub adalah alat CLI berbasis Python untuk menjalankan misi Traodoisub...

30
Emerging
1912 lucasxlu/CtripPro

a multi-thread web crawler with GUI for ctrip.com written in Java8

30
Emerging
1913 absterjr/WebScraper

Web Scraper to scrape articles from multiple websites at the same time.

30
Emerging
1914 MindPatch/imge

open source tool for downloading images from random websites

30
Emerging
1915 jspa2/netquery

A search engine and web crawler written in Python.

30
Emerging
1916 o-rashad/IbnHayyan-DataMiner

A web data mining tool for pdf files extension crafted with Nokogiri (鋸)...

30
Emerging
1917 iavinashpathak/100-Days-of-ML

Repository for my practice files and notes following CampusX "100 Days of...

30
Emerging
1918 Johnw7789/Elektra-Auto-Checkout

Toolkit to assist in stock checking and checkout automation of various retail sites.

30
Emerging
1919 dense-analysis/dank

Dense Analysis Network Knowledge

30
Emerging
1920 dimitarOnGithub/blogger-scrapper

Tiny package for scrapping (scraping) data from Blogger blog sites via Atom/RSS feed.

30
Emerging
1921 Dtech-Dbug/MemeTem

Meme templates scrapped from : https://imgflip.com/memetemplates

30
Emerging
1922 DanielYatali/WebScraper

Simple Web Scraper. Scrapes Movies from the website Fbox

30
Emerging
1923 FOSS-Egypt/WebGetter

An open-source project which allows you to get any website source code in a...

30
Emerging
1924 barbaracalderon/web-scrapping-with-python

Study notes on Web Scrapping using Python, Beautiful Soup and Requests....

30
Emerging
1925 robbiebusinessacc/WebScraperAPI

This is an API for a web scraper based off of the template_web_scraper...

30
Emerging
1926 xodo2fast4u/poke-aggregator

Built a centralized discovery platform that aggregates 1,600+ fan-made...

30
Emerging
1927 MiguelGalp/odio_oido

**Odio oído** es una herramienta predictiva. Trackeamos el riesgo de...

30
Emerging
1928 imartinezl/newspaper-scraping

Open & free access to subscription-based regional newspaper through RSS +...

30
Emerging
1929 dbrojas/autobet

Soccer outcome modeling and algorithmic betting system

30
Emerging
1930 DarkSkull777/my-proxy

Proxy Checker & Scraper: Your go-to tools for hunting down working proxies...

30
Emerging
1931 Rotzke/seekingalpha

Seeking Alpha team data scraper.

30
Emerging
1932 grabowskiadrian/shopify-products-scraper

This is Shopify products Scraper. The script retrieves data from the...

30
Emerging
1933 zago-crawly/crawly

Framework for creating, configuring, running and monitoring web-crawlers

30
Emerging
1934 matiasinsaurralde/scraper-supermercados

Pequeño programa para realizar scraping de precios de supermercados de Paraguay.

30
Emerging
1935 HirojiSawatari/FindGoods

A web crawler which can get most popular goods in Tmall

30
Emerging
1936 LucasBassetti/crawler-transparencia

Web crawler para coletar dados sobre despesa orçamentária do Portal da Transparência

30
Emerging
1937 ferreiraapfernanda/web-scraping

Anotações e scripts de web scraping, screen scraping, etc

30
Emerging
1938 jesussantana/Data-Science-With-Python-IT-Academy

Learn how to extract value from data by ingesting, transforming, storing,...

30
Emerging
1939 peterstephan/internet-of-transport

The Internet of Transport (IoT) aims to provide a toolkit for analysts, data...

30
Emerging
1940 bkeepers/spiderman

your friendly neighborhood web crawler

30
Emerging
1941 AmanAsanovich/USAAppartments

Scraping a large amount of data from a website using a data stream

30
Emerging
1942 Prasantacharya/Alan-Turing

A Discord webhook that sends leetcode problems.

30
Emerging
1943 cgrimal/darwin

Projet pour générer la page http://clementgrimal.fr/darwin/

30
Emerging
1944 marttasch/dreiFragezeichen_episodePicker

Web app to randomly pick and play 'Die drei Fragezeichen' episodes on your...

30
Emerging
1945 KashmalaJamshaid/Web-scraping-using-python-and-beautifulsoup

This notebook includes data scraping. For this beautifulsoup and selinium is...

30
Emerging
1946 macloo/web-scraper-steps

Stages of a first Python script for scraping

30
Emerging
1947 fabrix-app/spool-scraper

Spool: Webscraper

30
Emerging
1948 lhotanok/zoot-scraper

Apify actor extracting data from Zoot.cz, Zoot.sk and Zoot.ro

30
Emerging
1949 Programmer-RD-AI-Archive/MovieDataScraper

Explore the cinematic universe with our IMDb web scraping project! Dive into...

30
Emerging
1950 supratikchatterjee16/serp_bot

A generic SERP bot, that can be used with just about any search engine.

30
Emerging
1951 Katsute/Baruch-CIS-3120

🎓 Baruch - CIS 3120 - Programming for Analytics

30
Emerging
1952 bryanjsample/get-business-data-from-google-maps

Python web scraping script to extract information from Google Maps.

30
Emerging
1953 cerbero90/lazy-json-pages

📜 Framework-agnostic API scraper to load items from any paginated JSON API...

30
Emerging
1954 Siltaar/doc_crawler.py

Explore a website recursively and download all the wanted documents (PDF, ODT…)

30
Emerging
1955 YusuFBankur/Gemini-Claw

🦾 Enable autonomous research and synthesis with Gemini-Claw, a platform that...

30
Emerging
1956 Ram-95/Python_Applications

:notebook_with_decorative_cover: Python Applications - Tic-Tac-Toe, Flipkart...

30
Emerging
1957 nicolo-rancan/minecraft-items-api

Minecraft items api

30
Emerging
1958 lcsrodriguez/fx

FX high-frequency tick/candle historical data scraping tool

30
Emerging
1959 jknaudt21/Option-Scraper-BlackScholes

Repo for scraping option data required for the Black Scholes model. Data is...

30
Emerging
1960 markvincevarga/arukereso-scraper

Apify-based scraper for Arukereso.hu

30
Emerging
1961 Xnuvers007/wikiscrape

Ini adalah wikiscrape dimana tools atau website ini berguna untuk...

30
Emerging
1962 ledgitbe/krabber

Easy web scraping with AXIOS and JSDOM - this is a mirror of...

30
Emerging
1963 Bituvo/pygrounds

Python web-scraping API for Newgrounds

30
Emerging
1964 jsbmg/rgov

Notifies you when campsites at parks on Recreation.gov become available.

30
Emerging
1965 LukaIgnjatovic/Historical_Weather_Data_Scraping

Script that uses WWO's free API to scrape historical weather data.

30
Emerging
1966 cytadela8/trypophobia

Trypophobia images detector based on deep neural networks and utilities

30
Emerging
1967 thetruefuss/books-scraper

Scrape data of IT ebooks to populate the "hypercube" project database

29
Experimental
1968 renanbirck/gasolina

Raspagem/coleta dos preços de combustíveis em Joinville/SC

29
Experimental
1969 Angie-Delgado/Scraping

scraping to amazon

29
Experimental
1970 xcrap-dev/factory

Xcrap Factory is a set of utilities for dynamically creating instances of...

29
Experimental
1971 Zaraahmad/Search-Engine

It is an offline corpus based search engine aimed at retrieving most...

29
Experimental
1972 gcamerli/flickr_scrapy_bot

Flickr Scrapy Bot 🎩

29
Experimental
1973 1tanwang/NFL-strength-of-schedule

NFL-strength-of-schedule is an automatic calculator of NFL's new season's...

29
Experimental
1974 jlgrego/Web-Scraping-vivareal.com.br

Script do meu projeto de conclusão de curso no MBA em Data Science e...

29
Experimental
1975 Administrative-Assistance/flarecrawl

Crawl and scrape with Cloudflare Browser Rendering using...

29
Experimental
1976 JustaKris/Are-You-Not-Entertained

Machine learning pipeline for predicting movie box office success. Includes...

29
Experimental
1977 lein3000zzz/project-arachne

web-crawler project with kafka queues, redis cache support, neo4j map...

29
Experimental
1978 begejol12/CyberMyLife-Media-Scraper

🖼️ Extract and download images effortlessly from any URL with the...

29
Experimental
1979 afiqiqmal/Esolat-Malaysia

Packagist for E-Waktu Solat in Malaysia. Data from Jakim

29
Experimental
1980 jodevsa/subscene_scraper

Library to download subtitles from subscene.com

29
Experimental
1981 lukluk/scraper-engine

Async Scraper Framework Based Nodejs

29
Experimental
1982 RyanWatern/FHP-Traffic-Incident-Notifier

A real-time notification system that monitors the Florida Highway Patrol...

29
Experimental
1983 zyachel/imdb-popular-movies-scraper

a basic script to scrape data of popular movies across genres from imdb

29
Experimental
1984 sh13y/Ada-LK-Blogger-Automation

Automated news scraper and poster that fetches articles from Ada LK and...

29
Experimental
1985 ReplacementBot/ReplacementBot

Powerful School Subsitutions bot for your Discord Server 📅

29
Experimental
1986 Prog-Jacob/allthings-egypt-cinema

The source code and data behind the comprehesive "Allthings Egypt" movies list.

29
Experimental
1987 VigilantiaFR/SIRETExtractor

Vigilantia SIRET Extractor | automatic scraper | input :{domain names} |...

29
Experimental
1988 fiqrisr/disney-fandom-wiki-crawler

Scrapy project to crawl data from Disney Fandom Wiki

29
Experimental
1989 Aatricks/Novel-Scraper

Lightweight light novel and pdf reader.

29
Experimental
1990 rankrh/MountainProject

Scrapes Mountain Project and helps find the best areas for your climbing preferences

29
Experimental
1991 cordeirossauro/iw-scraper

Web scraper for imovelweb listings

29
Experimental
1992 shawnduong/rufus-botcat

A Discord bot that helps UC Merced students register for their classes by...

29
Experimental
1993 Toemazz/FacebookConversationAnalysis

Generates simple statistics and visualizations about a single Facebook...

29
Experimental
1994 esote/booky

Gather random book data by scraping Goodreads

29
Experimental
1995 peterleiva/subtitle-finder

CLI and library to scan your file system, search and download subtitles in...

29
Experimental
1996 h26k2/pasha-company-data

Source code for scraping company profiles from pasha

29
Experimental
1997 brightdata/amazon-product-analyzer

AI-powered Amazon analytics: Get product insights, deal detection, and...

29
Experimental
1998 kuizuo/x-archive

一个用于归档和浏览 Twitter/X 推文的工具。通过爬虫脚本获取推文数据,并使用现代化的 Web 界面进行浏览和查看。

29
Experimental
1999 corona-hub-germany/corona-lgl-bayern-scraper

🔎 Scrape corona case-data from lgl.bayern.de

29
Experimental
2000 xcrap-dev/image-text-extractor

Xcrap Image Text Extractor is a package of the Xcrap framework that...

29
Experimental
2001 repodevs/tokopedia-scraper

Example Tokopedia Scraper

29
Experimental
2002 AymericBerthoumieu/webScrapingForFinancialAnalysis

Project for the course "Python Programming for Finance" at Master 203 at...

29
Experimental
2003 LastAncientOne/Scrape_Data

Scrape Data from Twitter, Facebook, Yahoo, and other websites

29
Experimental
2004 JamesBird02/youtube-short-generator

Program that scrapes chosen subreddits for video ideas and generates them...

29
Experimental
2005 scrapefulldotcom/crunchbase-scraper

Scrape Crunchbase company data reliably without an account.

29
Experimental
2006 crawlbase/crawlbase-java

A lightweight, java class that acts as wrapper for Crawlbase API

29
Experimental
2007 ImMau14/tscrapingbot-rs

An AI-powered Telegram bot for analyzing web pages, developed in Rust.

29
Experimental
2008 aliasav/Play-Store-Scraper

Scrapes images and description of apps in google play store

29
Experimental
2009 Kisspeace/motherless.com-scraper

motherless.com scraper for delphi

29
Experimental
2010 danghungspkt/AI-Cursor-Scraping-Assistant

🕵️♂️ Generate web scrapers effortlessly with AI-Cursor-Scraping-Assistant,...

29
Experimental
2011 juliareboucasleite/PromoPing

Sistema de monitorização de preços focado no mercado português. Faz scraping...

29
Experimental
2012 ahmed-alnassif/net-spider

Net-Spider is a web scraping tool designed to retrieve the source code for a...

29
Experimental
2013 alexsanjoseph/goodreads-list-properties

Script to find the properties of all the books in a Goodreads list

29
Experimental
2014 martjanz/precios-claros

Precios Claros (http://preciosclaros.gob.ar) scraper / data downloader

29
Experimental
2015 aidenesco/randomua

User-Agent generator

29
Experimental
2016 sevetseh28/instagram-unfollowers-unfollowing

Python scripts for detecting and analysing unfollowers and unfollowing on...

29
Experimental
2017 Horizonik/JobHawk

Web App that enables users to quickly find jobs they're best suited for.

29
Experimental
2018 mirkomantovani/web-search-engine-UIC

CS 582 Information Retrieval at University of Illinois at Chicago....

29
Experimental
2019 xn0tsa/Web2LLM

An advanced Python tool for extracting data from websites, cleaning the...

29
Experimental
2020 KaiDubauskas/phertility

A web app that aims to increase women's access to healthcare by providing...

29
Experimental
2021 nolancacheux/python-scripting-basics

A comprehensive collection of Python scripts and utilities for automation,...

29
Experimental
2022 1goonli/wildspitz-webcam-scraper

Scrape the latest Image from the Wildspitz Roundshot Webcam in Full Quality

29
Experimental
2023 Badhansen/a2oj-online-judge-category-wise-problems-list

Firstly, I like to thank "Ahmed Aly" for making this awesome site. This...

29
Experimental
2024 muemulag/twitter_scraper

Script to collect Twitter reply

29
Experimental
2025 scraper-app/scraperpy

Helping students better manage their books

29
Experimental
2026 AppNinjaMarketing/AppNinja-Marketing-Tools

The Marketing tools (scripts) used for AppNinja

29
Experimental
2027 nerevu/hdxscraper-fts

Collector for the Financial Tracking Service (FTS) API

29
Experimental
2028 clemfromspace/scrapy-algolia-exporter

Directly populate a given Algolia index from a scrapy spider.

29
Experimental
2029 jesussantana/IBM-Skills-Courses

IBM Data Science, Machine Learning & Deep Learning Courses to Increase your...

29
Experimental
2030 Purpl3-Dev/OSINTLAB

This script automates the installation of 50 OSINT tools for reconnaissance...

29
Experimental
2031 xcrap-dev/impit-client

Xcrap Impit Client is a package within the Xcrap framework that implements...

29
Experimental
2032 lucasepe/go-ps4

Search your favorite PS4 games from Playstation Store using the Command Line

29
Experimental
2033 ornato-t/UniTO-book-scrape

A web scraper and PDF generating script for the virtual library of the UniTO...

29
Experimental
2034 meppps/ML-Financial-Analysis-WebApp

Stock Forecasting Web App with Machine Learning 📊

29
Experimental
2035 oxylabs/web-scraping-google-sheets

Guide to Using Google Sheets for Basic Web Scraping

29
Experimental
2036 grknc/Football-Stats-WebScraping

Bu proje, 2022-2023 Premier Lig sezonunun detaylı takım ve oyuncu...

29
Experimental
2037 tlemenestrel/Mining_Food_Supply_Chain_Data

A multi-threaded Web Scraper to mine 1M+ food supply chain data points using...

29
Experimental
2038 lekhmanrus/real-shot-pdf

RealShotPDF is a Chrome extension designed to simplify the process of...

29
Experimental
2039 tekboart/SNA-thesis

Used web scraping and social network analysis (SNA) to analyze research of...

29
Experimental
2040 alishahlakhani/Facebook-comments-exporter-chrome-extension

Use this Chrome extension to extract post comments to .json. It can download...

29
Experimental
2041 MaxineXiong/ACME-Dispatcher-Performer-Invoice-Check-Bot-RPA

This repository hosts a UiPath automation solution with separate Dispatcher...

29
Experimental
2042 CRMLXRMS-Labs/CRM.Services.Scraping

A powerful .NET 8.0 web scraping library with support for static and dynamic...

29
Experimental
2043 ericdaat/webradio-to-spotify

Scraping songs playing on various classic rock radios and upload them to my...

29
Experimental
2044 404notfound-3/ig-profile-scraper

Fetch and save real-time data anonymously from any Instagram profile without...

29
Experimental
2045 ImranR98/AutoLyricize

Automatically find and embed song lyrics.

29
Experimental
2046 AbrahamSanders/WebHawk

WebHawk is a general-purpose scriptless web automation tool designed to get...

29
Experimental
2047 thewhiteninja/tv-rename

A tool to rename your favorites TV shows !

29
Experimental
2048 kinoute/scraper-allocine

Just playing with BeautifulSoup and Python to scrap some movies on Allocine.fr.

29
Experimental
2049 sruti-jain/Airbnb-Data-Analysis-Project

The aim of the project is to optimize the price of new house listing by...

29
Experimental
2050 AlexandrosKyriakakis/Lessons

Web scraping, Probs, Randomized Algorithms and a lot of Coffees...

29
Experimental
2051 skyeon15/CSharp-scraping

Collection of C# scraping works. C# 스크래핑 작업물 모음.

29
Experimental
2052 OYBOLATOFF/WildBerriesParser

[Парсер] Автоматический сбор информации с крупнейшего маркетплейса РФ и...

29
Experimental
2053 david-adewoyin/Car_Price_Analysis_and_Prediction

Data science project for analyzing and estimating regional car prices using...

29
Experimental
2054 oxylabs/web-scraping-php

A tutorial and code samples of web scraping with PHP

29
Experimental
2055 cdw1p/website-crawler-app

This project allowing users to specify the depth of the crawl, the directory...

29
Experimental
2056 thewhiteninja/radioblog-downloader

A tool to download music from radioblogclub.fr

29
Experimental
2057 darsan-in/Job-Crawler

The Job Crawler is an integral component of the Job RAID project, designed...

29
Experimental
2058 circa10a/href-scraper

ruby CLI to scrape hrefs from single webpages

29
Experimental
2059 ahrazarfi/PPDEV

PepCoding PP code files (DEV only)

29
Experimental
2060 Aboodseada1/CEO-Finder

Standalone CLI tool to find company CEO names using SearXNG web search and...

29
Experimental
2061 einkaaf/prss

this project focuses on web scraping and crawling news articles from various...

29
Experimental
2062 oelin/nym

Find synonyms for common words instantly! ✨

29
Experimental
2063 NikosRig/Mimo-Crawler

A web crawler that uses Firefox and js injection to interact with webpages...

29
Experimental
2064 adam-kov/grab-selector

Chrome extension to quickly grab the selector of an element

29
Experimental
2065 Police-Data-Accessibility-Project/github-actions-demo

Demo for scraping on a schedule with GitHub Actions

29
Experimental
2066 earth-app/shovel

🧰 Kotlin Multiplatform Scraping Framework

29
Experimental
2067 Anonyfox/flay-js

Extract structured content from any HTML website

29
Experimental
2068 NitinN77/quora-plus-bypass

A python script to extract answers to any question on Quora (Quora+ included)

29
Experimental
2069 SJDunkelman/read-all-about-it

🗞 Scrape headline & article text data from major US/UK Newspaper sources for...

29
Experimental
2070 05kashyap/mcfinance

PYPI RELEASE 0.1.5: https://pypi.org/project/mcfinance/

29
Experimental
2071 ssokolow/get_user_headers

Python module to retrieve identifying request headers from the user's...

29
Experimental
2072 hayat01sh1da/web-scrapers

This repository contains Python scripts which collect data from websites.

29
Experimental
2073 altescy/mincrawler

A minimal web crawler.

29
Experimental
2074 ShaylanDias/MusicalMessage

A fun app for messing with your friends by texting them lyrics. Uses a...

29
Experimental
2075 YanCotta/AIProspectResearchSystem

An enterprise-grade solution for automated company research and analysis.

29
Experimental
2076 ne0lith/redgif-profile-downloader

Redgif Downloader: A Python script to efficiently download videos from...

29
Experimental
2077 kelu124/Futures

Managing links shared on my substack

29
Experimental
2078 LastHope777/ParcingRatesOfCurrency

Трекер финансовых активов (Курсы валют, криптовалют и акций) с GUI

29
Experimental
2079 ivkos/yuxel

Scrapes news sites, generates random headlines using Markov chains, and...

29
Experimental
2080 etejedaw/caredotcom-fondecyt-node

Web Scraping de datos históricos almacenados en Wayback Machine, sobre los...

29
Experimental
2081 Saleh908/anytext2images

🖼️ Extract images from any text quickly, preview them in a gallery, and...

29
Experimental
2082 vlOd2/ImgurScraper

The most advanced Imgur scraper ever!

29
Experimental
2083 NicolasChagnet/arxiv-scanner-flask

Flask-based application scrapping the latest scientific preprint from...

29
Experimental
2084 inTheRye/zaim-analysis-platform

Analysis platform for scraping data powered by Docker.

29
Experimental
2085 rockcastle/Scrapping-Search-Engine-Results

Scrap from search engines (Google, Bing, DuckDuckGo ) print result

29
Experimental
2086 HubTou/libgh

GitHub scraping tool and library

29
Experimental
2087 gabriel-batistuta/convert-html-to-pdf

Tutorial para uso de Web Scraping e pdfkit para transformar livros em pdf...

29
Experimental
2088 oislen/CatClassifier

A machine learning pipeline for classifying images of cats and dogs.

29
Experimental
2089 Haxor-World/Grabber_Project

Efficient and Comprehensive Automated Multi-API URL Retrieval and CMS Validator.

29
Experimental
2090 ermissa/scrapyd-django-mongodb-setup

Setup project to run Scrapy + Django and save parsed data to MongoDB.

29
Experimental
2091 nerevu/hdxscraper-unhabitat

Collector for UN Habitat's UrbanInfo API

29
Experimental
2092 wynnemlo/scraping_jobsdb

An ETL pipeline that scrapes JobsDB daily and ingests data-related job posting data.

29
Experimental
2093 gcjordi/web_scraper_jgc

Web Scrapìng Apli

29
Experimental
2094 plazarotello/web-scraping

Proyecto de Web Scraping para M2.851 Tipología y Ciclo de Vida del Dato (UOC)

29
Experimental
2095 adbar/coronakorpus

Material zum Aufbau eines deutschsprachigen COVID-19-Webkorpus / Building a...

29
Experimental
2096 titus-chin/rooms-for-rent-in-singapore

The purpose of this project is to create a web app listing affordable rooms...

29
Experimental
2097 schlopp96/GitHubPFPScraper

My rendition of the tutorial listed below.

29
Experimental
2098 martjanz/vizcacha

Web scrapers using Scrapy framework to collect prices from online...

29
Experimental
2099 farhaanaliii/UserAgent

UserAgent is a PHP library that provides methods to generate random...

29
Experimental
2100 claywahlstrom/clay

My personal package for all things Python

29
Experimental
2101 jpsarkar/Android_appcrawl_from_google_play_store

Written in Python using web crawling of google play store to get app category

29
Experimental
2102 mononobi/charma-server

Server side application for Charma, personal movie collection manager.

29
Experimental
2103 GeiserX/search-by-surname

R-based batch search tool for Spanish telephone directories by surname

29
Experimental
2104 ogohogo/tiktok-trending-data-api

Scraping the TikTok Discovery Data API every 1 hour using Github Actions to...

29
Experimental
2105 AndreaBozzo/memedoc

Meme trends analyzer with scraping and supabase SQL

29
Experimental
2106 LegendEvent/Zscaler-Zulu

Automate risk assessments for any URL using the public Zulu Zscaler web...

29
Experimental
2107 Nezteb/scrape-pdf

Given a URL, this scraper will visit every page of that site and download...

29
Experimental
2108 s-vatsal/ML-Capstone-Texas-Data-Analysis

Provides insights on relocating to 2020s hotspot: Texas. Link to project...

29
Experimental
2109 ruwiss/akilli_market_listem

Cursor AI ile hiç kod yazmadan oluşturduğumuz akıllı market listesi...

29
Experimental
2110 sourcepirate/data-style

ninja with a data

29
Experimental
2111 ghost83709/PixThief

🖼️ Scrape images from modern websites effortlessly with PixThief—no setup...

29
Experimental
2112 danmorse314/hockeyR-tweets

Functions to automate the twitter account for the hockeyR package

29
Experimental
2113 prakharjadaun/Exploratory-Data-Analysis-of-IPL-2022

Fetched IPL 2022 data through web-scrapping. & performed data analysis using...

29
Experimental
2114 iboraham/indeed-web-scraping

The project contains UK data science job analysis provided through scraped...

29
Experimental
2115 EdinsonRequena/Track_the_amazon_prices

This algorithm tracks the price of the product you want on Amazon and sends...

29
Experimental
2116 abhishekchandra2522k/scraping-top-github-repos

Scraping GitHub top repositories from topics page.

29
Experimental
2117 DusanStevic/textx-lang-quant

Domain-Specific Language (DSL) for financial time series

29
Experimental
2118 athena15/project_luther

Beating the Zillow Zestimate: Predicting King County Home Prices

29
Experimental
2119 seanfhear/tab-scraper

Interface for downloading guitar tabs from Ultimate Guitar

29
Experimental
2120 gokulkrh/Food-Image-to-Recipe-Converter

A food image to recipe converter for Indian food.

29
Experimental
2121 hominee/dyer

Dyer is designed for reliable, flexible and fast web crawling, providing...

29
Experimental
2122 lorey/socials-api

👨‍👩‍👧‍👦 (Rest) API to extract social media profiles from websites or specific URLs

29
Experimental
2123 adil6572/YP-business-scraper

Yellow Pages Scraper: A Python tool to extract business information from...

29
Experimental
2124 005-bot/monitor

Сервис выполняет периодическое сканирование страницы с актуальными...

29
Experimental
2125 mahmutovichana/Google-Image-Scraper

A Python script for automated image scraping from Google Images, ideal for...

29
Experimental
2126 vicenteparmi/ru-menu-getter

RU Menu Getter and Data Analysis automates fetching daily menus from various...

29
Experimental
2127 hectorLop/SoccerPredictor

System to predict the outcome from soccer matches.

29
Experimental
2128 ahmedmujtaba1/solid-username-checker

Username Checker: Easily verify email validity for domains like @yahoo.com,...

29
Experimental
2129 geekypandey/ACTS-Automated-College-Timetable-Setter

Set college timetable for a week on google calendar,based on the timetable...

29
Experimental
2130 bernardopg/cmmg-calendar

Sincronize o calendário acadêmico do CMMG diretamente com sua Google Agenda...

29
Experimental
2131 pedroalpacheco/EBOOK

Código fonte de projetos criados no ebook

29
Experimental
2132 christian-jaimes/pokemon-data-scraping

Pokémon Data Scraper is a user-friendly Python project that gathers a wide...

29
Experimental
2133 bhattbhavesh91/scrape_wiki_tables

Extract Tables from Wikipedia into an excel file

29
Experimental
2134 jnstockley/web-scraper

Customizable Web Scrapper to get alerts when criteria is met on web sites.

29
Experimental
2135 devtoolcss/devtoolcss

Let's build with devtool-parsed CSS!

29
Experimental
2136 rajputpriyankaa/scrapy-spider-framework

Web scraping with Scrapy

29
Experimental
2137 matco/migroto

Retrieve the mortgage rates of the Migros bank and store them in a Google spreadsheet

29
Experimental
2138 dan-tech-academy/fb-comments-export-extensions

Chrome Extension (MV3) to scrape Facebook post comments and export to CSV. A...

29
Experimental
2139 keyb88/development-toolbox-web-style-extractor

🎨 Extract colors and fonts from any website to create consistent, branded...

29
Experimental
2140 lmmx/campbells

A condensed web scraping library :canned_food:

29
Experimental
2141 scsa385/topicstreams

📰 Stream real-time news updates by scraping Google for topics, bypassing...

29
Experimental
2142 dev-chenxing/jjwxc-crawler

基于Scrapy开发的晋江爬虫,根据书号下载小说非V章节,生成可编辑的Word文档 | A simple tool to scrape and...

29
Experimental
2143 anisha5748/unlimited-kissanime-downloader

📥 Download anime effortlessly from Kissanime with this user-friendly tool,...

29
Experimental
2144 GuyZangi/clash-residential-proxy-parser

🏠 Simplify Clash subscription setups with a smart parser for residential...

29
Experimental
2145 Kazuhards/linkedin-job-scraper

🌐 Scrape fresh LinkedIn job listings effortlessly, delivering structured...

29
Experimental
2146 sethschori/scraping

Python web scraping scripts

29
Experimental
2147 oxylabs/web-scraping-data-parsing-beautiful-soup

Web Scraping and Data Parsing Using Beautiful Soup

29
Experimental
2148 mshojaei77/AdvancedWebScraper

comprehensive web scraping tool designed to empower users with versatile...

29
Experimental
2149 BryanD1406/scrapebadger-python

🐍 Streamline web scraping with the ScrapeBadger Python SDK for quick and...

29
Experimental
2150 VaasuDevanS/google-podcast-downloader

CL tool to download entire google podcast library for the provided URL 🎵

29
Experimental
2151 cloveras/kommune

Henter alt fra postlistene til noen kommuner i Lofoten

29
Experimental
2152 rusq/chromedl

Go library for scraping or downloading files bypassing Cloudflare protection...

29
Experimental
2153 oxylabs/aiohttp-proxy-integration

Python tutorial for implementing Residential Proxies with AIOHTTP

29
Experimental
2154 afif-dev/php-web-scraping

PHP Basic Web Scraping

29
Experimental
2155 CatalystsReachOut/alertify

A chrome extension which will notify users if there is a project of their...

29
Experimental
2156 spartypkp/open-source-legislation

Open-source global legislation data in an SQL knowledge-graph format ideal...

29
Experimental
2157 abdmmar/wiki-img-meta

Get Wikipedia Image Metadata

29
Experimental
2158 cjwinchester/hotdog-contest

Some Python to scrape a list of winners of the annual Nathan's Famous Hot...

29
Experimental
2159 lucidfrontier45/yfscraper

Yahoo Finance (JP) Scraper

29
Experimental
2160 ariel-lindemann/comics_scraper

A simple CLI application for downloading comics.

29
Experimental
2161 neo63900/pesu-slide-download-automator

📥 Automate slide downloads from PESU Academy with this Python script that...

29
Experimental
2162 GoncaloMark/CobWeb-lnx

CobWeb is a Python library for web scraping. The library consists of two...

29
Experimental
2163 JarvisPrestidge/domain-crawler

Simple command line program to crawl a single domain implemented in Go .

29
Experimental
2164 jansen88/ufc-data

Comprehensive dataset for UFC data, compiling match history, fighter stats...

29
Experimental
2165 jwnigel/permaculture

Permaculture design app built on scraped plant databases. Drag-n-drop GUI...

29
Experimental
2166 cchummer/sec-api

Notebooks documenting different endpoints and parsing methods for SEC data

29
Experimental
2167 lucasromualdo/glassdoor-jobs-crawler

Crawler em Python para coletar vagas do Glassdoor e exportar para Excel

29
Experimental
2168 agusnieto77/TweetScraperR

Este paquete proporciona funciones para extraer datos de X/Twitter,...

29
Experimental
2169 gsunit/Extreme-Uber-Eats-Scraping

A robust web-scraping pipeline and scraped data of 1.5M Uber Eats...

29
Experimental
2170 mominalix/bulk-email-generator-using-ChatGPT

This repository shows how to create personalized emails in bulk using Open...

29
Experimental
2171 pedroalpacheco/webscraping-megaSena

Introdução de scraping em resultado da mega-sena

29
Experimental
2172 YashaNajafi/YN_Exchange

Crypto python directory (Open source)

29
Experimental
2173 Samirxz00/Project-Analisis-Sentimen-Review-Film-Mata-Kuliah-Machine-Learning

🎬 Analyze film reviews using various NLP methods, including Machine Learning...

29
Experimental
2174 demodiff/berlin

Versammlungen in Berlin: Konservieren historischer Daten.

29
Experimental
2175 ParasAvkirkar/-Competitive-Coding-Problem-Classifier-and-Recommender

Competitive Coding Problem Classifier and Problem Recommendation

29
Experimental
2176 pritpalxyz/price_compare_crawler

Product price comparison scrapy crawler

29
Experimental
2177 danieldotnl/hass-multiscrape

Home Assistant custom component for scraping multiple values (from a single...

29
Experimental
2178 Genone22/emails_phones_scraping

Extract emails and phone numbers from the list of url addresses

29
Experimental
2179 GeiserX/web-mirror

Mirror any webpage to a local server for offline access

29
Experimental
2180 schne324/moocher

Web content scraper

29
Experimental
2181 koizuka/narou-watcher

「小説家になろう」の新着小説をチェックする

29
Experimental
2182 brandonmlusk/National-Park-Campsite-Finder

Automated campsite availability checker that sends text alerts when...

29
Experimental
2183 programming-concert-programming/setlists

Routines for research, teaching, and general interest in the data science of...

29
Experimental
2184 whompratt/gapp

GPRO Setup and Strategy APP/Calculator

29
Experimental
2185 matheusfillipe/wcofun.cli

Stream and download animes directly from your terminal

29
Experimental
2186 14m1r0nm4n/notesf

📚 Start enhancing your macroeconomic analysis skills with practical training...

29
Experimental
2187 CetiAlphaFive/gao

This package downloads all public GAO reports and returns a cleaned dataset...

29
Experimental
2188 clarius/Web

Official docs site for https://github.com/devlooped/Web

29
Experimental
2189 etejedaw/coremodel-fondecyt-node

Web Scraping de datos para el cálculo de resiliencia comunitaria en...

29
Experimental
2190 Youssef-Alakouche/AmazonScrapingApp

Amazon Product Information Scraping Application

29
Experimental
2191 gitgoub/CYBER-CORE-Professional-Telegram-PARSER-Marketing-Tool

⚡ Parse and analyze Telegram audiences with a fast, secure tool for...

29
Experimental
2192 kilgoretrout1985/site-pages-graph

Site pages into graph for some SEO-analysis.

29
Experimental
2193 gavinmgrant/omitplastic

A full-stack e-commerce affiliate app focusing on reducing plastic...

29
Experimental
2194 oxylabs/custom-parser-instructions

Learn how to build web scrapers using Oxylabs Custom Parser and new...

29
Experimental
2195 AConfusedBoi/ogie

🔮 Extract metadata effortlessly from web pages using ogie, a lightweight...

29
Experimental
2196 elmoallistair/gunadarma-telegram-bot

simple telegram bot as an alternative media for accessing academic...

29
Experimental
2197 lokijygtcb/scrapfly-scrapers-scrappey-wrapper

🕷️ Build efficient web scrapers with this Scrappey wrapper, featuring 46+...

29
Experimental
2198 farfarfun/nltget

网络请求和下载工具包 - 提供高效的网络请求和文件下载功能

29
Experimental
2199 DanielKirshner/Yad2-Car-Finder

Telegram bot for "Yad-2" to track your dream car

29
Experimental
2200 ASJordi/uk-blog-scraping

UK blog web scrapping with GHA

29
Experimental
2201 senoldogann/web-research-stack

A production-ready web scraping and AI-powered research tool with full-stack...

29
Experimental
2202 shishir-t3/Dive_Into-PlayStore

A project involving Web Scraping of App and reviews info from the Google...

29
Experimental
2203 codesnerd/craigslist-ad-scraper

📰 Craigslist ad scraper that extracts, saves & enables searching through ads.

29
Experimental
2204 meetdoshi90/Video-Search-Engine-and-Recommender-System

Video Search Engine & Recommender System using Python and React

29
Experimental
2205 brunodifranco/project-star-jeans-data-engineering

ETL building for an e-commerce Jeans company. Feel free to access the...

29
Experimental
2206 siongui/goigfollow

Get Instagram following and followers in Go

29
Experimental
2207 zedseven/extractbdays

A hacky, messy - but stable - tool written to easily extract animal crossing...

29
Experimental
2208 promptapi/scraper-pkg

NPM package for Prompt API's Scraper API

29
Experimental
2209 frfahim/movie_finder

Web crawler that gives a list of movie with download links from yts.ag...

29
Experimental
2210 ybg345/w3-resource-python

I am determined to improve my basic core skills of python and data science...

29
Experimental
2211 rpthms/wimt

Where is my train? - Find your train's current location

29
Experimental
2212 JarvisPrestidge/nightmare-type-definitions

Typescript type definitions for Nightmare v2.10.0

29
Experimental
2213 kgotsosm/nature-web-scraper

nature.com web scraper written in Python.

29
Experimental
2214 AdiB2002/COVID-19-Research-Data-Collection

To aid with research on COVID-19, I am in the process of writing multiple...

29
Experimental
2215 daimbk/book-search

ReactJs/Flask app to check book availability on online bookstore.

29
Experimental
2216 Ioannis-D/Job-Application-Tracker

Track your job applications. Written in Python

29
Experimental
2217 iliyadindar/pyroxi

High-performance Python proxy library with SOCKS5/HTTP, async, and zero dependencies.

29
Experimental
2218 noumanic/bullbearpk

AI-powered investment advisory platform for Pakistan Stock Exchange with...

29
Experimental
2219 HCDevWorks/http-proxy

Advanced HTTP/HTTPS proxy server in TypeScript, built on proxy-chain....

29
Experimental
2220 fvilers/freeroms-scraping

A simple tool to download files on http://www.freeroms.com

29
Experimental
2221 rajagopal28/simple-web-crawler

Java based web-crawler program which makes use of pool based...

29
Experimental
2222 jasniec/WebsiteParser

Simple library which parses web pages into objects usin attributes

29
Experimental
2223 KwokHing/Network-Analysis-on-MRT-Station

Demo on applying the concept of network analysis on a network of connected...

29
Experimental
2224 Larissamoura22/mlkdocrelease2025

📄 Automate the scraping, merging, and OCR processing of MLK assassination...

29
Experimental
2225 denissimon/medication-reviews-scraper

A scraper that collects a list of medications and reviews on them.

29
Experimental
2226 georgeblck/flachware

A noisy image dataset of contemporary art from flachware.de for...

29
Experimental
2227 aljoni/webgrab

WebGrab is a simple Go library which allows for easy scraping of web pages.

29
Experimental
2228 AndyTheFactory/article-extraction-dataset

Article title, authors, date and body extraction dataset.

29
Experimental
2229 jschriemer/Tennis-Tweets

Twitter bot that tweets ATP & ITF tennis scores by web scraping data

29
Experimental
2230 adamd1985/gettyimages-scraper

A sample to start scraping. Common technical interview from companies who...

29
Experimental
2231 andersonkevin/duplicatedcontentchecker

A Python-based tool for detecting duplicate content across websites,...

29
Experimental
2232 Sufyan123o/Sole-Retriever-Monitor

A Web Monitor that tracks newly added sneaker raffles on the Sole Retriever...

29
Experimental
2233 Sarrablo/TravianApi

Guerrilla Api for Travian

29
Experimental
2234 nirmalben/bible-nabre-json-dataset

Repository containing The Holy Bible NABRE dataset in JSON along with the...

29
Experimental
2235 fernandod1/Telnyx_API_scraper

Query Telnyx free phone numbers by area code and store them locally in Mysql...

29
Experimental
2236 brzvsk/longreader

Telegram Mini App that saves internet articles to read them later

29
Experimental
2237 TonyxSun/PressScraper

A scraper application for crawling press releases of US government agencies...

29
Experimental
2238 zcrawl/zcrawl

An open source web crawling platform

28
Experimental
2239 fedebotu/clone-anonymous-github

Easily download anonymous Github repositories from...

28
Experimental
2240 manthan89-py/Data-Science

This repository contains concepts and project-related Data Science and...

28
Experimental
2241 christopherrobin/nuforc-scraper

TypeScript scraper for NUFORC UFO/UAP sighting data. Collects and normalizes...

28
Experimental
2242 SlapBot/paytm-scraping-offers

Scraping & crawling all of the products (and their coupons, categories, etc)...

28
Experimental
2243 N-O-U-R/PcPartPicker-Scraping

This repository contains a Node.js scraper for educational purposes,...

28
Experimental
2244 thejeshgn/reservoir

Karanataka Reservoir flow details as reported by Karnataka State Natural...

28
Experimental
2245 andreu-vall/myanimelist-jikan-database

Scraping of the MyAnimeList Jikan REST API's internal database (Anime,...

28
Experimental
2246 farhapartex/vocabulary-scrapper

This is a django app for getting the meaning of an English word from command line.

28
Experimental
2247 conflict-investigations/media-search-engine

Search geolocations for (social) media posts in databases like Bellingcat,...

28
Experimental
2248 RedstoneMedia/stud-ip-scraper

A blazingly fast 🚀 library for interacting with Stud.IP 📚 written in Rust 🦀

28
Experimental
2249 EPSOFT/Scrape-ForexFactory

Scrape ForexFactory

28
Experimental
2250 noodleslove/jable-py

An awesome web scraper powered by CloudScraper to collect video data from jable.tv

28
Experimental
2251 Techzy-Programmer/json-trailing-parser

Extract data from complex JSON structures using simple query paths. Designed...

28
Experimental
2252 luminati-io/Amazon-scraper

Extract Amazon data with the #1 Amazon Scraper API, including search...

28
Experimental
2253 meetyan/raise

A simple (and unofficial) GitHub Trending client that lives in your menubar.

28
Experimental
2254 PramodShenoy/AmazoNLP

Sentiment Analysis+Web Scraping=Project!

28
Experimental
2255 helloyork/aiapa

This is a fast and easy Amazon product analysis tool that crawls product...

28
Experimental
2256 federicodiluca/CheckFeed-Bot

A lightweight Telegram bot that fetches news from multiple RSS feeds, stores...

28
Experimental
2257 crawlerlab/aragog

Distributed web scraping framework

28
Experimental
2258 tan-yong-sheng/scraping_quickstart

Here is the list of scraping techniques I used to get the data from websites

28
Experimental
2259 DataHenHQ/useragent

DataHen useragent tool is a Golang package and standalone tool that...

28
Experimental
2260 srinidhinandakumar/big-data-ocr-ner

Applying Optical Character Recogntion, Named Entity Detection, Object...

28
Experimental
2261 xofred/deviantart-gallery-downloader

fetch deviantart's images using mechanize

28
Experimental
2262 BioTomateDE/GM48Scraper

A command line interface for scraping GameMaker data files from the GM48 Game Jam.

28
Experimental
2263 Barbos818/appents-social-downloader

📥 Download Instagram and Twitter posts, including captions, counts, and...

28
Experimental
2264 ialejandro/crowdfunding-real-estate-scrapy

This project is a powerful and extensible scrapy-based crawler designed to...

28
Experimental
2265 AhmedSobhy01/sher-look

A high-performance search engine that crawls, indexes, and ranks web content...

28
Experimental
2266 MarcosWinicyus/web-scraping-investing

Scraping of data of investing.com economic calendar using the Python 3 and...

28
Experimental
2267 scrape-badger/scrapebadger-python

Official Python SDK for ScrapeBadger - Async web scraping APIs for Twitter and more

28
Experimental
2268 TheAhmadOsman/BestCarDeal

:moneybag: Scraping, Visualizing, and Analyzing 1,700,000 Entries of Used...

28
Experimental
2269 MrThanlon/bili-comment

哔哩哔哩(https://www.bilibili.com )读取楼层,发送评论,抢楼,抢沙发

28
Experimental
2270 luminati-io/google-search-api

Two methods to collect real Google SERP data—a free scraper for basic use...

28
Experimental
2271 slvg01/94.06a_immoeliza_data

First part of real estate prediction price project. - Scraping Immoweb...

28
Experimental
2272 imsanjoykb/Data-processing

Scrape Job Portal Data

28
Experimental
2273 jamesbower/Reddit-Scraper

Reddit Scraper is a Python script that utilizies the PRAW Python library to...

28
Experimental
2274 luminati-io/web-scraping-with-pydoll

Use Pydoll to scrape JavaScript-heavy sites, bypass Cloudflare, and scale...

28
Experimental
2275 AndrewKhassapov/website-to-pdf

A web crawler that prints a website to .pdf format

28
Experimental
2276 catlism/catlism.github.io

Companion website for "Corpus Approaches to Language in Social Media" -...

28
Experimental
2277 PPS-22-Scooby/PPS-22-Scooby

Scala application that allows web crawling and web scraping of web pages...

28
Experimental
2278 danp/halifax-meetings

Scraping of Halifax meetings to SQLite

28
Experimental
2279 professorDeveloper/Scraping-Tutorial

Android Website-Scraping

28
Experimental
2280 touero/ctenopharyngodon-idella

Use the MapReduce's Java interface to distributed crawle the data of Chinese...

28
Experimental
2281 aioke/BrowserProxy

Allows to bypass Cloudflare checks

28
Experimental
2282 imamhossain94/dhaka-city-local-bus-json-data

Scrapped JSON data from busroutebd.com

28
Experimental
2283 mvrpl/Scraping-Google-Play-Store

scraping applications data on google play store

28
Experimental
2284 sayyid5416/Links-Extractor

Extract links from any file or the website.

28
Experimental
2285 oxylabs/how-to-scrape-wayfair

A step-by-step tutorial on extracting data from Wayfair’s product pages at...

28
Experimental
2286 FelipeCRamos/Wishlist-Scrape

A simple wishlist scrape using python3, re and urllib

28
Experimental
2287 willtchiu/financeSpiders

Light weight web scraper and crawlers for various financial news sources....

28
Experimental
2288 talaatmagdyx/socials_regex

🪡 Social account detection and extraction in ruby, e.g. for crawling/scraping.

28
Experimental
2289 Azzeccagarbugli/checoloresono

The web application to know which color your region is during COVID19 in Italy

28
Experimental
2290 Esequiel378/proxy_randomizer

This library helps you sfetly crawle apis and web pages

28
Experimental
2291 s-r-e-e-r-a-j/SiteScraper

The Site Scraper Tool is an ethical hacking program developed in Python that...

28
Experimental
2292 leoncvlt/raiplay-dl

⏬ Python downloader for the Italian streaming platform RaiPlay

28
Experimental
2293 JSerwatka/FilmwebExporter

Eksport ocen z Filmweb'u do pliku csv

28
Experimental
2294 expl0itlab/sniffer

A powerful website technology detection tool that identifies CMS platforms,...

28
Experimental
2295 ax-i-om/netflip

Scrape paste sites for sensitive information.

28
Experimental
2296 wangjksjtu/Data-Mining-51Job

Data-mining on 51Job website

28
Experimental
2297 spekulatius/keyword-merge

A helper to compare and identify similar keywords using PHP.

28
Experimental
2298 cesarsiuu2316/proyeccion_elecciones_hn_2025

Sistema que obtiene resultados en tiempo real del CNE Honduras y proyecta el...

28
Experimental
2299 furkandlkdr/telegram-trendyol-bot

Python Telegram bot to track Trendyol product prices, send instant...

28
Experimental
2300 MohamedHmini/tweetsOLAPing

implementing an end-to-end tweets ETL/Analysis pipeline.

28
Experimental
2301 alysivji/reddit-top-posts-scrapy

Scrape top posts from list of subreddits and insert into MongoDB

28
Experimental
2302 IliaMiheev/ipars

Библиотека для работы с файлами во время парсинга

28
Experimental
2303 k-bosko/IPO_bubble

scrape, clean and model IPO data with supervised ML

28
Experimental
2304 zakariaaithssain/CertifLens

Web Scraping, Cleaning, ML Based Imputing, Analysis, and Visualizations of...

28
Experimental
2305 capturr/scraper

All In One API to easily scrape data from any website, without worrying...

28
Experimental
2306 xcrap-dev/transformer

Xcrap Transformer is the data transformation package extracted from the Web...

28
Experimental
2307 Nihad1452/url-extras

🌐 Simplify URL handling with browser-compatible versions of Node.js' URL...

28
Experimental
2308 aswinshenoy/trendulkar

Data Mining and Analysis of Cricketer’s Data

28
Experimental
2309 oinume/lekcije

Follow your favorite teachers in DMM Eikaiwa

28
Experimental
2310 ixboy/web_scraper

An application designed to scrap the web and retrieve information from movie...

28
Experimental
2311 michaelvin1322/scrapWikiArt

This repository contains two scrapers for wikiart.org. One fetches...

28
Experimental
2312 dhilzyi/hianime-with-local-mpv

Python CLI for streaming hianime.to anime in local MPV with Jimaku subtitle...

28
Experimental
2313 KayvanShah1/thomasnet-scraper

Scraping USA Hardware Suppliers Data

28
Experimental
2314 TomiToivio/LaclauGPT-TikTok-Scraper

TikTok scraper used for scraping 2024 European parliament elections....

28
Experimental
2315 ariear/otakudesu-api

UnOfficial Otakudesu API 👀

28
Experimental
2316 mn-cs/successfactors-data-pipeline

Data pipeline project that collects and analyzes profiles of successful...

28
Experimental
2317 Yokozuna59/auto-registrar

A CLI script to check/register courses from KFUPM Banner 9.

28
Experimental
2318 Shadowsomatic798/discourse-saver

Save posts and comments from any Discourse forum to Obsidian, Notion, or...

28
Experimental
2319 imehar/udemy-course-downloader

A basic cli tool for downloading all the enrolled courses from udemy account

28
Experimental
2320 scrape-do/scrapedo-scrapers

Web scraping examples with Scrape.do 😎

28
Experimental
2321 gokerDEV/serp-profiler-kit

A modular pipeline to collect SERP outputs, reconcile scraping artifacts,...

28
Experimental
2322 einnar82/mpl-ph-api

Get the latest MPL-PH Updates from https://ph-mpl.com/

28
Experimental
2323 parakh-gupta/Web_Scraper

Scrapper for magicbricks.com

28
Experimental
2324 Huolix/web-scraping-beautifulsoup

A Python project that scrapes product data using BeautifulSoup

28
Experimental
2325 xrce/lk21

Netflix clone with movies scraped from layarkaca21

28
Experimental
2326 lhehnke/amazon-data

Scraping functions for (1) Amazon customer reviews and (2) product...

28
Experimental
2327 MiraZzle/site-seeker

Minimalist web crawler for building website graphs and extracting link...

28
Experimental
2328 svtcore/telegram-user-comments

Scraping user comments under posts in certain channels and export in CSV format

28
Experimental
2329 anouar1991/resumeio-dl

Download resumes from resume.io as PDF files

28
Experimental
2330 HasData/linkedin-serp-scraper

Python examples for scraping public LinkedIn profiles from Google SERP with...

28
Experimental
2331 ABM025/convex-bright-data

Integrate Bright Data's search and scraping APIs with Convex for reactive...

28
Experimental
2332 PACHAKUTlQ/FreeSERP

Deprecated, original repo still maintained. ~~Fork of...

28
Experimental
2333 alansarkar/Youtube-viewer-Bash-script

Search and watch youtube videos by just runing this simple bash script

28
Experimental
2334 NoteUniv/NoteUniv-Python

:open_file_folder: Python script to fetch PDF data from Seafile and create a...

28
Experimental
2335 FTLam11/fronkin_bandcamp_scraper

Convenient web scraper for Bandcamp

28
Experimental
2336 sapuri/get-pornhub-thumbnail

PornHubの動画URLからサムネイルを抽出するツール

28
Experimental
2337 zehan-alam/Web-Scraping--GSMarena

Web Scraping GSMarena to extract smartphone specs with their ratings

28
Experimental
2338 Holmes-090/Reddit-Bulk-Downloader

Downloads saved Reddit posts

28
Experimental
2339 oxylabs/Rotating-Proxies-With-Python

Learn about how to rotate proxies by using Python.

28
Experimental
2340 aitoss/backup-my-CF

A tool made to backup(save a copy in local disk) all of your succesfully...

28
Experimental
2341 ronak66/GSOC_Data_Extractor

A simple tool created to make life easier for the people applying for GSOC....

28
Experimental
2342 siongui/goigstorylink

Get Links (URL) of Instagram Stories in Go

28
Experimental
2343 mynkpdr/smartprix-scraper

A daily scraper that collects product specifications from Smartprix.com and...

28
Experimental
2344 onlyphantom/pricemate

A simple scraper for departure time and prices from Jakarta to Bandung from Tiket.com

28
Experimental
2345 scrape-badger/scrapebadger-node

Official Node.js SDK for ScrapeBadger - Async web scraping APIs for Twitter and more

28
Experimental
2346 JaroslavKodousek/Teletext

Simple Python script to get current news from teletext, create PDF from it...

28
Experimental
2347 rgpl-xyz/lotto-number-checker

Modern Angular app for checking lottery numbers against real PCSO winning...

28
Experimental
2348 arevi/Pastebin-Scraper

Cross platform Pastebin scraper developed in C# using .Net Core 3.

28
Experimental
2349 psalias2006/github-trending-cli

A simple CLI tool to browse GitHub's trending repositories from your terminal.

28
Experimental
2350 development-toolbox/development-toolbox-web-style-extractor

Extract colors, fonts, and CSS from any website. Generate branded themes...

28
Experimental
2351 Tsai-Adam/Digital_Technologies_and_Value_Creation

Data-driven business analytics projects combining machine learning,...

28
Experimental
2352 Contrevien/scrapgen

ScrapGen is a "Web-Scraping scripts generator"; an interactive tool, making...

28
Experimental
2353 1mb-dev/lobster

Intelligent web stress testing with auto URL discovery. Crawls your app,...

28
Experimental
2354 loganbonsignore/Real-Estate-Data-Mining

Web scraping program using the ETL process to mine real-estate metadata in...

28
Experimental
2355 Niweera/googledict

A Simplified Google Dictionary API

28
Experimental
2356 amrrs/HN_scraper_in_R

Hacker News Front Page Scrapper in R

28
Experimental
2357 ParsaD23/MotoGP-API

MotoGP Api: Library that reads the results of the MotoGP, 500cc, Moto2 and...

27
Experimental
2358 JustHumanz/Go-MultiTor

Multiple tor circuit with golang

27
Experimental
2359 gabrieldim/A1on-WebScraping-Pandas-Data-Science

Learning WebScraping using Pandas in python. - Data Science

27
Experimental
2360 leviobrabo/G1-news-scraping

Web scraping do site G1 News

27
Experimental
2361 shubham17sm/web-scraping-django

A news aggregator app build using django web framework and beautifulsoup...

27
Experimental
2362 palahsu/YouTubeScraper

Scraping YouTube Video Description and Video Likes and Comments and Times...

27
Experimental
2363 DanielHaggstrom/WordpressScraper

WordpressScraper is a lightweight Python utility that downloads a...

27
Experimental
2364 BBC-Data-Unit/libraries

Data used in the story 'Libraries lose a quarter of staff as hundreds close'

27
Experimental
2365 AllanOtieno254/US-Largest-Companies-by-Revenue-Web-Scraping

A Python project for web scraping and analyzing the largest companies in the...

27
Experimental
2366 vaxad/Insightify

Insightify is your go-to platform for real-time price comparison,...

27
Experimental
2367 aedorado/Amazon-Updates

:tada: Never miss the lowest price on amazon again!

27
Experimental
2368 tomkeith/imdb-scraper

Script to scrape IMDb.com for key movie features - including all genres and...

27
Experimental
2369 diardanoraihan/Coursera_Capstone

The IBM Applied Data Science Capstone: The Battle of the Neighborhoods. The...

27
Experimental
2370 papagorgio23/VegasLines

Historical Vegas betting lines for the NBA and NFL

27
Experimental
2371 LordDeveloper/EPhoto360

Create text effects online , Effects online for free, photo frames, make...

27
Experimental
2372 pablo-reyes8/colombian-news-nlp-analysis

End-to-end NLP project with news scraping from major Colombian outlets....

27
Experimental
2373 DevJuanCR/Scraper-InfoJobs-Python

Herramienta de automatización en Python para extraer ofertas de empleo de...

27
Experimental
2374 ufuayk/webscraping

Web scraping script.

27
Experimental
2375 bfaure/StockSpider

Scripts to compile historical stock price data from various online sources.

27
Experimental
2376 PSavvateev/JobScrapingApp_Indeed.com

Web scraper to get information about posted jobs in the US from Indeed.com

27
Experimental
2377 gilito11/casaTevaLeads

CRM inmobiliario con captación automática de leads · Scraping 4 portales ·...

27
Experimental
2378 sarperavci/UAForge

Generate statistically accurate User Agents and Client Hints (Sec-CH-UA)....

27
Experimental
2379 leoncvlt/etf4u

📊 Python tool to scrape real-time information about ETFs from the web and...

27
Experimental
2380 oxylabs/how-to-scrape-amazon-product-data

The process of extracting product data from Amazon using Python, including...

27
Experimental
2381 nainiayoub/scholar-scrap

Extract relevant information of research papers, into a downloadable CSV...

27
Experimental
2382 hrbrmstr/reapr

🕸→ℹ️ Reap Information from Websites

27
Experimental
2383 thomasbase/Pokemon-Widgets

Data analysis pipeline using Python, BeautifulSoup, and Jupyter widgets

27
Experimental
2384 Jagger-01/Building-A-Dashboard-With-Google-Looker-Studio

A comprehensive project using Python, APIs, web scraping, and data...

27
Experimental
2385 EmanuelJoseCandido/COVID-19-ANGOLA

Um app para colecta de dados sobre o COVID-19 em Angola.

27
Experimental
2386 patxijuaristi/website_email_scraper

Simple script to scrape emails from websites.

27
Experimental
2387 wb-08/BK

Finds a fork in the tennis matches betting marathonbet and plusminus

27
Experimental
2388 nassrkhan/Stock-Market-Analyzer

In this project, we take you on a journey through the technologies used to...

27
Experimental
2389 Trones21/JobSearchScrapeAndApply

Scraping job search results using various APIs

27
Experimental
2390 p-karanthaker/puregym-tracker

A simple shell script written to scrape gym activity data from the PureGym...

27
Experimental
2391 breadrock1/SocialNetworkScraper

Web scraping is simply the process of using a social media web scraper to...

27
Experimental
2392 bodhiprice/meta-scraper

A utility for grabbing the meta tags from a web page.

27
Experimental
2393 lastuchiha/ecommerce-scraper

This repository contains a Python script that utilizes Beautiful Soup, a...

27
Experimental
2394 the-markup/investigation-google-search-audit

Materials to reproduce findings in our story, "Google’s Top Search Result?...

27
Experimental
2395 indrarahul/facebook_bot

Python script- It will simply login into your account and update your status.

27
Experimental
2396 weiyu666/NetEaseCloudMusicWebCrawler

用python3.5 mongoDB+base64+json格式+python正则表达式+BeautifulSoup库 写的爬取网易音乐的网络爬虫

27
Experimental
2397 vyrelabs/synapse

Web Crawling/Scraping Framework [WIP: Distributed Architecture]

27
Experimental
2398 Fatherless-costusoil269/ProxyMod

🛠️ Streamline your Minecraft experience by routing server connections...

27
Experimental
2399 elijahondiek/Web-Crawler-for-Google-Scholar

A web crawler for google scholar authors profiles for authors from Coventry...

27
Experimental
2400 oxylabs/webscraping-with-ruby

A tutorial for web scraping with Ruby

27
Experimental
2401 Wyndace/WynScrape

Wyndace's python scraping dev kit

27
Experimental
2402 accessibleapps/html_to_text

Converts HTML to plain text. Preserves structure, handles tables, and can...

27
Experimental
2403 madhug-nadig/ColData

Simple, generic web scraper for text written in python3

27
Experimental
2404 OmBayus/Trendyol-Web-Scraping

Girdiğiniz trendyol linkindeki ürünü eğer farklı satıcılar daha ucuz fiyata...

27
Experimental
2405 skullface/sceneland

🎸 automatically aggregates Cleveland-area concerts in one place

27
Experimental
2406 jonmartin721/review-hound

Aggregate business reviews from TrustPilot, BBB, Yelp & Google Places....

27
Experimental
2407 Sachaaaaaa/Grhoth

it is an osint tool which is used to extract information from your facebook...

27
Experimental
2408 z7r1k3/creeper

Web Crawler and Scraper

27
Experimental
2409 f-rog/PrxGetter

This is an awesome tool to scrape and check proxies

27
Experimental
2410 vitinh0z/AutomacaoVagasEstagio

RPA de monitoramento de vagas em tempo real com Java 21. Inclui Web Scraping...

27
Experimental
2411 louisguitton/disqus-crawler

Crawl DISQUS comments from a blog into a local MongoDB database

27
Experimental
2412 khahnmad/Mediacloud-Scraping

This repository contains a scripts that query MediaCloud for stories and...

27
Experimental
2413 Okroshiashvili/Data-Science-Lab

Data Science Laboratory

27
Experimental
2414 ScraperHub/noon-scraper

Noon.com Search Page and Product Page Scraper. To handle JS rendering and...

27
Experimental
2415 lpil/presentable-soup

Querying, scraping, and parsing of HTML. Good for snapshot testing too!

27
Experimental
2416 janhq/OpenCrawl

🌐 OpenCrawl: An ethical, high-performance web crawler built for scale A...

27
Experimental
2417 HollowWonder/hh-job-tracker

Парсер вакансий HH.ru через официальный API c базой данных, фильтрацией и...

27
Experimental
2418 akiltipu/scrapy-projects

Scrape and Crawled data from several websites and save data in JSON, CSV,...

27
Experimental
2419 TasfiaIslam/django-news-scraper

News Scraper built with Django, Beautiful Soup, News API

27
Experimental
2420 schollz/googleit

Get results from search engines.

27
Experimental
2421 carlos-burelo/monoschinos-api

REST API written in Typescript and Node JS under the concept of Web...

27
Experimental
2422 Bipinoli/Online-Price-Tracker-with-Chrome-Extension

Go to e-commerce site, select the price, hit the extension button, that's...

27
Experimental
2423 natserract/reason-rust-scraper

🦀 Scraping & crawling websites using Rust, and ReasonML

27
Experimental
2424 aymenhmaidiwastaken/seo-article-generator

The most powerful open-source AI-powered SEO article generator. Crawl...

27
Experimental
2425 JoeMancera/formula-fan

Site and API scraping information from the official F1 site. This is for...

27
Experimental
2426 nirantak/wsiwn

What Should I Watch Next? Expert System built using Python/Flask and Prolog.

27
Experimental
2427 ZimCodes/Zeiver

A Scraper, Downloader, & Recorder for static open directories.

27
Experimental
2428 m0n3ef/Scrappp

A Very simple free proxy list scraper.

27
Experimental
2429 pierodellagiustina/immoweb-be-scraper

Simple scraper for immoweb.be

27
Experimental
2430 lsubotic/captcha-solve-scraper

Utilizing Deep Learning with Web Scraping to solve Amazon CAPTCHA and...

27
Experimental
2431 0xNaN/carbonaraextractor

Product specifications extractor driven by a DOM Classifier.

27
Experimental
2432 veiston/Hygieia

Hygieia (Desktop Doctor) is a local, private medical diagnosis AI. Runs with...

27
Experimental
2433 fabriciocovalesci/loterias-caixa-api

API de Resultados das Loterias CAIXA Federal

27
Experimental
2434 Farhad-Shabani/ScreeningMarketData_TSETMC

Scraping selected daily trading data from tsetmc.com (Tehran Stock Exchange)...

27
Experimental
2435 yeahhe365/LLM-Online-Assistant

基于 PyQt5 的网络信息抓取工具,支持 Google/Bing/Baidu 多引擎搜索,自动抓取关键词相关内容并保存至本地 | A...

27
Experimental
2436 kylevogel/cbb-ratings-pipeline

End-to-end Python ETL pipeline that collects NCAA men's basketball rankings...

27
Experimental
2437 akladyous/stock-market-sentiment-analysis

Stock Market Sentiment Analysis

27
Experimental
2438 199-biotechnologies/search-cli

Multi-provider web search CLI for AI agents — Brave, Serper, Exa, Jina,...

27
Experimental
2439 Aidoni0797/Web-Hacking-with-Pythonn

Web-Hacking-with-Python

27
Experimental
2440 1x6/lezhin-downloader

Simple requests based manhwa downloader which uses the Lezhin API.

27
Experimental
2441 outages/aws-outages

Track AWS outages via Git History

27
Experimental
2442 bahaeddinmselmi/ecommerce-product-crawler-gui

A Python-based web crawler to extract product details (name, price,...

27
Experimental
2443 dkhramov/gathering_data

Примеры к книге "Сбор данных в Интернете на языке R".

27
Experimental
2444 tolani007/ScrapingFBREF

Scraping from the incredible FBREF website

27
Experimental
2445 Zzzul/diwa

an unofficial simple API from https://distrowatch.com/

27
Experimental
2446 oxylabs/how-to-scrape-amazon-prices

A code for extracting best-selling items, search results, and currently...

27
Experimental
2447 luisramirezdev/simple-email-scraper

Simple Email Scraper

27
Experimental
2448 KenzoBH/Web-Scraping-and-EDA-iFood

Web Scraping and EDA from iFood website data.

27
Experimental
2449 phamleduy04/ncov-api

API cung cấp thông tin, dữ liệu bệnh nhân về COVID-19!

27
Experimental
2450 dunderrrrrr/telsok

A phone number search engine powered by hamsters 🐹

27
Experimental
2451 AIQSO/aiqso-seo-service

SEO Auditing & Rank Tracking Service - Enterprise SEO intelligence platform

27
Experimental
2452 Ucok23/detiknews_api

Detik News Search Unofficial API

27
Experimental
2453 simon987/Architeuthis

MITM HTTP(S) proxy with integrated load-balancing, rate-limiting and error...

27
Experimental
2454 chirag127/ContentHarvester-Browser-Extension

A sophisticated browser extension for intelligent web content extraction and...

27
Experimental
2455 arukavina/baking-lyrics

Random lyrics generator.

27
Experimental
2456 NoraCodes/Temphael

A Tumblr-scraping text post bot

27
Experimental
2457 OstinUA/Inventory-Auth-Auditor

📋 Chrome extension (MV3) for AdOps teams to bulk-validate ads.txt and...

27
Experimental
2458 aroaxinping/scraper-gasolineras-espana

Weekly scraper of petrol station prices in Spain via MINETUR public API —...

27
Experimental
2459 defgsus/office-schedule-scraper

Scraper for (german) free dates at the public offices

27
Experimental
2460 timoteostewart/benson

Benson turns a list of URLs into mp3s of the contents of each web page -...

27
Experimental
2461 crawlbase/crawlbase-php

A lightweight, dependency free PHP class that acts as wrapper for Crawlbase API

27
Experimental
2462 chenxi-shi/Information-Retrieval

Elasticsearch, MongoDB, Tornado Server, RESTful API, Python, Information...

27
Experimental
2463 EnsembleData/ensembledata-node

Node.js library to scrape social media data via the EnsembleData API.

27
Experimental
2464 cbeaulieu-gt/job-matcher

Job search utility which leverages public Job Scraper APIs and LLM models to...

27
Experimental
2465 xcrap-dev/extractor

Xcrap Parser is a parsing package for the Xcrap framework that handles...

27
Experimental
2466 NeoWzk/alicrawler

a fully functional spider for aliexpress.com

26
Experimental
2467 SaurabhSSB/BookMiner

A pipeline to scrape, extract, and analyze book data from web pages to insights.

26
Experimental
2468 egin10/dapodik_go

Command Line App untuk scraping data sekolah dari web dapodik (Data...

26
Experimental
2469 Anwarvic/GutenbergScrapper

This repo contains a scrapper for the Gutenberg's project website which...

26
Experimental
2470 gonzyui/FillerCheck

Simple browser extension to check if an anime episode is filler or canon.

26
Experimental
2471 Etsdsf8797/grab

🔍 Discover Rust files and entities quickly with this Zellij plugin,...

26
Experimental
2472 Sl0thC0der/container-fansly-downloader

A powerful Fansly content downloader with Docker support, multi-user...

26
Experimental
2473 ermiasgelaye/ETL-Project

In this project, we built a database that demonstrates the changes in...

26
Experimental
2474 prashant64bit/Exploit-Database-Scraper

Web scraping application designed to extract vulnerability and exploit data...

26
Experimental
2475 moh1tnegi/Web-Scraping

Learning web scraping via Python using XML Path language imported through...

26
Experimental
2476 Polodashvili-Iosif/parser-scraper_DNS

Парсер для получения списка игровых ноутбуков с их комплектующими с сайта...

26
Experimental
2477 Momotoculteur/LicencePlateScraper

Système automatique pour constituer un dataset de plaque d'immatriculation...

26
Experimental
2478 arupa444/web-scraping-info-of-authors-though-API-to-automate-the-mailing

This project is a FastAPI-based tool and have solo apps each for automating...

26
Experimental
2479 scrape-hub/koon

Browser-impersonating HTTP client — TLS, HTTP/2, HTTP/3 fingerprint...

26
Experimental
2480 outages/vultr-outages

Track Vultr outages via Git History

26
Experimental
2481 zawster/BeautifulSoup

Practical use-cases are done using the bs4 module.

26
Experimental
2482 Ian-Lusule/Proxies-GUI

​Live and interactive public proxy list with a dashboard UI. Automatically...

26
Experimental
2483 LorennMarque/Google-Maps-Scraper-Fast

Plug & Play python Google Maps Scraper Business Info

26
Experimental
2484 ashburgminion/Aggregodo

📰 Gather and manage your feeds effortlessly with Aggregodo, an advanced...

26
Experimental
2485 symfony/ai-scraper-tool

Scraper AI tool bridge for Symfony applications.

26
Experimental
2486 Peritract/text-analysis

Experiments in text mining and web-scraping

26
Experimental
2487 cuamckuu/JA3ProxySpoofer

Service to bypass Cloudflare TLS fingerptint with JA3 spoofing

26
Experimental
2488 rryley/prolog_web_programming

Prolog implemented Web scraper and data cleaner

26
Experimental
2489 facsimiles/beautifulsoup

🌐 BeautifulSoup: Effortlessly scrape and parse web data with this powerful...

26
Experimental
2490 jeorryb/pgscrape

Python scraper for PG statistics.

26
Experimental
2491 williamd1k0/metacritic-games

Distribution of Metacritic scores for console games.

26
Experimental
2492 jul-MA/python

Python snippet and examples

26
Experimental
2493 madelinekinnaird/instagram-sentiment-tutorial

walks through scraping and analyzing comment text

26
Experimental
2494 BlackSheep0110/OmniCrawler

🕷️ Automate web scraping with OmniCrawler, a powerful tool that builds large...

26
Experimental
2495 mateuszbuda/webscraping-benchmark

Web scraping API benchmark

26
Experimental
2496 joao-svalencar/letsRept

letsRept is an R package to sample reptile species information from The...

26
Experimental
2497 leoncvlt/trading212-pie-sync

🍰 Python tool to automate Trading212 pies allocations by syncing to another...

26
Experimental
2498 carlosplanchon/fakewindowsize

Python module to generate realistic browsers window size.

26
Experimental
2499 CSEC-NITH/impress-writer

A text editor that provides suggestions using web scraping

26
Experimental
2500 rajanand/datasets

Open data.

26
Experimental
2501 innat/Data-Scraping

Information Scraping with Python

26
Experimental
2502 farfarfun/funfake

HTTP请求头生成库 - 生成真实的HTTP请求头,模拟各种浏览器和操作系统

26
Experimental
2503 proxymesh/ruby-proxy-headers

Send and receive custom proxy headers during HTTPS CONNECT tunneling....

26
Experimental
2504 zainmz/Product-Price-Comparison-Bard-API

A simple price comparison application that uses the open-source Unofficial...

26
Experimental
2505 servika/kemono-downloader

A robust Node.js tool for downloading posts and media from kemono.cr...

26
Experimental
2506 cipherc09-blip/threads-connect

GraphQL proxy API for Threads & Instagram data at scale — auto session...

26
Experimental
2507 Redrrx/Mailkit

Mailkit is a light library for email scraping, uses imap_tools and some...

26
Experimental
2508 midas95/langchain-supabase-chatbot

Create a chatgpt chatbot for your website using LangChain, Supabase,...

26
Experimental
2509 ShaikhWarsi/HackathonHunt

A platform to discover and manage hackathons, aggregating events from...

26
Experimental
2510 mr-alarcon/treefy

Treefy is a Python project whose main purpose is to recreate the directory...

26
Experimental
2511 Keerthivasan-Venkitajalam/Agent-Scrivener

Multi-agent research platform with native Kiro IDE integration via Model...

26
Experimental
2512 Suwadith/Winning-Eleven-Scout-Evaluation-and-Analysis-to-Enhance-Football-Player-Recommendations-ML-Flask

A Machine-Learning based Recommendation system for club football personnel...

26
Experimental
2513 chirag127/TorrentScout-qBittorrent-Search-Plugin-Suite

A suite of high-performance Python-based search plugins for qBittorrent,...

26
Experimental
2514 intensoeli1/code-from-screenshot

🖼️ Convert screenshots into editable code with this tool, facilitating easy...

26
Experimental
2515 jond01/xil

Foreign currency exchange data web-scraper from Israeli banks

26
Experimental
2516 hiteshjakhar29/PatternShield

LLM-hybrid dark pattern detector: Chrome extension + Flask backend with...

26
Experimental
2517 dbaio/portsfallout

An easy way to search/query the FreeBSD pkg-fallout archive

26
Experimental
2518 ClaudioMartino/IIIF-Downloader

A lightweight Python 3 downloader for IIIF documents

26
Experimental
2519 OzelTam/onion-crawler

C# based Tor/Onion Web crawler.

26
Experimental
2520 lakshya-sikri-new/DataSnoop

DataSnoop is a lightweight Python-based Reddit scraper that extracts posts,...

26
Experimental
2521 SlapBot/Urban-Dict-Bot

A twitter bot written as an integration to Urban Dictionary allowing fun...

26
Experimental
2522 ngugimuchangi/CourseFinder

A web application to find free online courses.

26
Experimental
2523 delineas/podcast-ranking-web-scraping

#desafíoPython...

26
Experimental
2524 pim97/Antibot-Detector-Extension

Powerful browser extension to identify anti-bot defenses, CAPTCHA services,...

26
Experimental
2525 europanite/pixiv_encyclopedia_viewer_count_history_extractor

An Extraction Tool for Pixiv Encyclopedia Viewer Count History

26
Experimental
2526 fuchsia-programming/scrapers

Scraper Replicants

26
Experimental
2527 danny0926/flight-report

Claude Code skill for searching Google Flights and generating structured...

26
Experimental
2528 OLIVEIRA-3/artigo2023

Uso de Machine Learning para Predição de Volumes em Mananciais

26
Experimental
2529 TaskerIt/BetWaves

Simple betfair python scripts

26
Experimental
2530 hemil26/NFT-Dataset

Includes data about over 250 NFT Collections

26
Experimental
2531 kahngjoonkoh/python-job-scraper

A job scraper that would search for remote jobs

26
Experimental
2532 cubexy/mensa-bar

A MacOS menu bar application that shows the current menu of all STWL cafeterias.

26
Experimental
2533 mathisdt/bibleserver-scraper

MIGRATED TO CODEBERG: repackages content from bibleserver.com

26
Experimental
2534 HasData/python-for-seo

Professional SEO research toolkit with 7 specialized tools for keyword...

26
Experimental
2535 angelsomo/Scrapy-scraper

Scrapy-based forum thread crawler that extracts structured comment data into...

26
Experimental
2536 Ashfinn/Letterboxd-Lifesaver

Letterboxd Lifesaver is a web application that helps users choose movies...

26
Experimental
2537 seang1121/Multi-Lender-Mortgage-Rate-Lookup

One command, 10 lenders, sorted best to worst — stealth-browser mortgage...

26
Experimental
2538 WissemTy/Real-Estate-Price-Prediction

End-to-end ML project: Web scraping (BeautifulSoup), data engineering, and...

26
Experimental
2539 ceoimperiumprojects/imperium-crawl

The most powerful open-source CLI toolkit for web scraping. 28 tools —...

26
Experimental
2540 ShreevathsaGP/MYPPersonalProject

E-commerce web scraper.

26
Experimental
2541 weronikazak/ML-Projects

few Machine Learning and AI themed projects using Python 3.7 and its libraries 💻

26
Experimental
2542 jespimentel/esaj_2_grau

Web Scraping do eSAJ do TJSP (2º Grau)

26
Experimental
2543 takkichii/NETFLIX-SUBTITLE-SCRAPER

Scrape NETFLIX movies' subtitles as playing. For language learning.

26
Experimental
2544 sidharthrajaram/CrystalBall

🔮 Predicting NBA games using statistics (65% accuracy so far)

26
Experimental
2545 snehvora/WPInsight-Automator

It is basically a Wordpress bot which scraps the news data from various site...

26
Experimental
2546 arlieu/stock-monitor

Scrapes stock data into a database and makes available via a GraphQL API/UI

26
Experimental
2547 abdi-ismail/leaguegraphs

A Python tool for scraping and visualising team performances in football.

26
Experimental
2548 leuthier/kabum-scrapy

Web Scrapy Kabum

26
Experimental
2549 mingnhat99/anti-debugger-bypass

A powerful Chrome extension to bypass common anti-debugging scripts and...

26
Experimental
2550 captivus/audible_matchmaker

Code and data for Web Scraping in Excel & Python blog post @ gallon.me

26
Experimental
2551 hab1bovv/notesf

📚 Enhance macroeconomic analysis skills with practical training notes...

26
Experimental
2552 sdl60660/nba_origins

Mapping NBA players by country/state of origin since the start of the league

26
Experimental
2553 MaykolMedrano/Data-Hunters

Este repositorio contiene información sobre contrataciones públicas y...

26
Experimental
2554 wlyastn/Clyder

A Python utility for pulling Discord channel messages and exporting them to...

26
Experimental
2555 its0x08/duckduckgo

A simple DuckDuckGo URL scraper.

26
Experimental
2556 chenyukang1/crawler-go

🚀 A high-performance web crawling framework powerd by Go. Built for speed,...

26
Experimental
2557 OminduDissanayaka/hirunews-scrap

Unofficial Node.js scraper for Hiru News (hirunews.lk) — Breaking, Trending,...

26
Experimental
2558 ZNClub-PA-ML-AI/Scrapy-Spiders

Web Crawling using Scrapy

26
Experimental
2559 JuaanReis/pepeScraper

4chan content scraper

26
Experimental
2560 Tritium-Glass/Twitter-Trend-Summarization-Using-Improved-Word-Frequency

Twitter bot that uses an improved word frequency algorithm based on gradient...

26
Experimental
2561 hiroshikuze/feedSheet-gas

Spreadsheet-driven RSS generator using Google Apps Script. Scrape web...

26
Experimental
2562 alirezaeftekhari/search-engines-web-scraping

A simple search engine web scraper contains Google, Bing and Yahoo

26
Experimental
2563 zdx123z/BilibiliRelationMap

👥 Visualize and manage your Bilibili social connections with this modern...

26
Experimental
2564 rugk/neotaste_scraper

A scraper for NeoTaste that can scrape current deals.

26
Experimental
2565 koprjaa/vocative-generator

Asynchronous high-performance batch processor for generating Czech vocatives...

26
Experimental
2566 alisa-yar/Source-Code-Viewer

Online Source Code Viewer (get HTML source code from URL)

26
Experimental
2567 SwaggyClancy/hse-economics-3year-coursework-price-scraping

Анализ розничных цен на продукты питания в сетях «Пятёрочка» и «Магнит»...

26
Experimental
2568 zaidkx37/flipkart-scraper

A full-stack web scraper for Flipkart products with Python FastAPI backend...

26
Experimental
2569 cotoami/cotoami-scraper

Cotoami Scraper is a Chrome Extension that scrapes web pages to generate...

26
Experimental
2570 Cmalf-Labs/CryptoBar

CryptoBar is a lightweight and user-friendly macOS menu bar application for...

26
Experimental
2571 maxgfr/web-watcher

A lightweight Bash script that watches APIs and websites for changes, with...

26
Experimental
2572 tejas0908/EasyScraper

Scrape Websites without coding

26
Experimental
2573 temoto/heroshi

Heroshi – open source web crawler.

26
Experimental
2574 Rachit-Pal/GogoAnimeFrontend

Anime Streaming, Discovery API made with Cheerio and Express. Uses data from...

26
Experimental
2575 sgalal/lshk-word-list-crawler

Crawler for Cantonese pronunciation data on LSHK Jyutping Word List (香港語言學學會粵拼詞表)

26
Experimental
2576 Mamdouh66/Extracty

Extract structured data from any unstructured web page

26
Experimental
2577 Gwiazdka09/bot

FootStats – bot do analizy meczów piłkarskich z AI (Groq), scrapingiem...

26
Experimental
2578 faruuhan/scraping-jkt48-website

REST API from scraping data JKT48 website

26
Experimental
2579 Centauryyy25/starlink-admin-toolkit

A Chrome Extension toolkit for interacting with the Starlink Admin...

26
Experimental
2580 antiufo/Shaman.Scraping

A C# library for reading/writing WARC files and scraping websites.

26
Experimental
2581 kkkwbm/Discord_Vinted_Bot

High-speed Vinted web scraper with instant Discord notifications via webhooks.

26
Experimental
2582 oxylabs/curl-with-python

Master cURL in Python by using the PycURL library. Learn to send GET and...

26
Experimental
2583 divyar2630/Amazon-apparel-Image-Classification-and-Product-Recommendation

Classify Amazon apparel products and make recommendations based on images,...

26
Experimental
2584 jmrchelani/scrap-this-web

API to scrap HTML CSS and JS of a website

26
Experimental
2585 R-K-H/vogue-runway-scraper

This application was built to help scrape the fashion looks from different shows.

26
Experimental
2586 aitji/SGS-HTML

this is a simple Node.js tool to log in to the old SGS system (used by some...

26
Experimental
2587 leodubosclard/WorldOfScans

World Of Scans is a free Online & Mobile application allowing users to read...

26
Experimental
2588 guoqi228/amazon_reviews_app_flask

A Flask web application to scrape and analysis Amazon Reviews

26
Experimental
2589 xarantolus/jsonextract

Go package for finding and extracting any JavaScript object (not just JSON)...

26
Experimental
2590 ChrisMuir/MMA-Data-Scrape

Scrape and clean MMA/UFC data using R and rvest

26
Experimental
2591 adheesanu121/notesf

📊 Explore practical training notes for macroeconomic analysts, bridging the...

26
Experimental
2592 t-webber/html-filter

A rust crate to parse and filter some HTML

26
Experimental
2593 pritpalxyz/souq

Scrapy Crawler for souq Website

26
Experimental
2594 sadafnazari/Linkedin_job_analysis

LinkedIn job scraping and analysis

26
Experimental
2595 Anlinnazateth/usd-converter-backend

Node.js REST API that scrapes real-time USD exchange rates for BRL and ARS...

26
Experimental
2596 gvolpe/hll-algorithm-sample

HLL Algorithm and Web Scraping sample

26
Experimental
2597 luminati-io/web-scraping-with-mcp

Example MCP server and instructions for connecting Anthropic LLMs to...

26
Experimental
2598 duardor968/Anime_downloader

Anime Downloader para Windows y Linux usando datos de AnimeAV1.com con...

26
Experimental
2599 arclabs561/webpipe

Local search/fetch/extract plumbing, exposed as an MCP stdio server

26
Experimental
2600 Arunikha/pixiv_encyclopedia_viewer_count_history_extractor

📊 Extract viewer count history from Pixiv Encyclopedia for analysis and...

26
Experimental
2601 AdamKhalif8254/Hirestack

HireStack is designed for IT professionals seeking their next career...

25
Experimental
2602 teauxfu/gg-scrape

scrape a LoL build, runes, and skills from the web

25
Experimental
2603 Freddywhest/fdy

fdy-scraping is a versatile HTTP client designed for scraping API and making...

25
Experimental
2604 ashwinpn/Advanced-Python

Python for Machine Learning/AI/DS, Game Theory and Convex Optimization using...

25
Experimental
2605 ZenRows/zenrows-mcp

Official ZenRows MCP integration

25
Experimental
2606 JakobAIOdev/Vintrack-Vinted-Monitor

Real-time Vinted monitor with instant Discord alerts, proxy rotation & a...

25
Experimental
2607 MoinDalvs/Assignment_Web_Scraping_Emotion_Mining

Extract reviews of any product from ecommerce website like amazon

25
Experimental
2608 roboticist8/astrology_data

Astrology Data Scraped and saved in JSON file for research purposes.

25
Experimental
2609 AmirhosseinRHT/Persian-Privacy-Monitor

Analyzes Persian websites’ data practices by crawling cookies and using LLMs...

25
Experimental
2610 h8rt3rmin8r/wpspider

WPSpider is a standalone command-line tool designed to crawl WordPress...

25
Experimental
2611 gosirys/Parsers

Various parsers written over the years.

25
Experimental
2612 Fir666as/auctions-scraper

📊 Scrape and filter foreclosure and tax deed auction data from multiple real...

25
Experimental
2613 alexfazio/firecrawl-quickstarts

A collection of cookbooks to help developers get started quickly with the...

25
Experimental
2614 aqilwahid/Crawling-Data-From-Tokopedia

Repositori ini berisi proyek web scraping atau crawling data dari situs...

25
Experimental
2615 slyautomation/astar_pathfinding_node_networks

This project extracts the canvas data on https://www.osrsmap.net/ and...

25
Experimental
2616 aezizhu/CES-2026-Exhibitor-Database

CES 2026 comprehensive exhibitor information including company details,...

25
Experimental
2617 Diegiwg/youtube-info

An API for the ytdl-core NPM package, with a simple web client

25
Experimental
2618 MaxineXiong/Web-Scraping-RPA

This repository contains an RPA robot that was designed to scrap up to 500...

25
Experimental
2619 shufinskiy/scraping_-_analyze_movie_rating

Collecting data about movies using web-scraping. A comparison of the rating...

25
Experimental
2620 skymagi-d/book-beautifulsoup

Basic Example for Learning Web Scraping using Beautiful Soup

25
Experimental
2621 kt946/pricewise-nextjs13-yt-jsm

An ecommerce price checker that easily lets users track the prices of Amazon...

25
Experimental
2622 UFV-INGINF/BookHunt

Web application that compares book prices across multiple stores using...

25
Experimental
2623 Santa-Clara-Imaginarium-Lab/student-research-lab-reddit-comment-scraper

For Dr. David Jeong's Research Lab - Summer 2021

25
Experimental
2624 hush2/sitealyzer

SiteAlyzer uncovers the 'technologies' used on websites.

25
Experimental
2625 uixss/MASSACRE-TG

Telegram report automatize | sessions | scraping web | smtp

25
Experimental
2626 odinglyn0/PasteBin-Eneum

Enumerate new Pastebin posts and push them to Kafka for later scraping

25
Experimental
2627 Pointergeist/PHC-mouse-movement-gen

Generator for Human mouse/ cursor trajectory motion data based on...

25
Experimental
2628 octospacc/Aggregodo

Work-in-progress advanced web-based feed aggregator, focused on public use...

25
Experimental
2629 OstinUA/Ads.txt-App-ads.txt-line-Valid-checker

📋 Chrome extension (MV3) for AdOps teams to bulk-validate ads.txt and...

25
Experimental
2630 jaydorsey/elixir_scraper

Elixir/Hound web scraper example

25
Experimental
2631 imabhishekkumar/SIST-API

API to fetch data from Sathyabama University website using webscraping

25
Experimental
2632 richardsondev/pse-outages

Tracking Puget Sound Energy outage history since March 2021

25
Experimental
2633 k0sseK/local-lead-prospector

Automated B2B lead generation tool and mini-CRM for webdev & local SEO...

25
Experimental
2634 omar-elmaria/fiverr_scraper

This repo contains a Python script that crawls gig information from the...

25
Experimental
2635 Freator/Homework_DoubanSpider

Python课程作业:爬虫爬取豆瓣图书信息

25
Experimental
2636 sharifloo-net/amazon-scraper

Lightweight Amazon price tracker — CLI, SQLite price history, CSV reports,...

25
Experimental
2637 mateuszbuda/instagram-scraping-fish

A tutorial for scraping Instagram profile information and posts using...

25
Experimental
2638 rajsagare14/WhatsappWebAutomation

Automate Whatsapp to schedule messages using web scrapping and Automation

25
Experimental
2639 razvy942/Anime-streaming-app

Anime Video Streaming

25
Experimental
2640 KirillTomenko/ux-website-analyzer

🎨 Автоматический UX-анализатор веб-сайтов с использованием AI (GPT-4o)

25
Experimental
2641 sarvagyakrcs/cf-scraper

A powerful, lightweight web scraping API built with...

25
Experimental
2642 ryderdamen/Google-Cloud-Functions-PhantomJS-Scraper

A PhantomJS Scraper function for Google Cloud Functions

25
Experimental
2643 thetiip/mghrib-news-engine

Python-based news aggregator for Moroccan media sources. FastAPI backend...

25
Experimental
2644 lengoctam449-cloud/backlink-finder

backlink discovery, SEO, link-building

25
Experimental
2645 FutureSystems2023/World-Athletics-data-collection

Medal Projection Scraping - Athletics (World Athletics)

25
Experimental
2646 paulbradshaw/scraping

Resources on scraping

25
Experimental
2647 edellingham/site-snagger

A colorful website downloader with a clean UI that downloads complete...

25
Experimental
2648 oxylabs/automate-competitors-benchmark-analysis

A tutorial for automating competitors’ & benchmark analysis using Python

25
Experimental
2649 LidiaKovac/tuo-padre-be

Tuo Padre, la piattaforma che ti aiuta a trovare le offerte migliori nei...

25
Experimental
2650 mtecnic/ctx

CTX (Context Transfer Format) — universal interchange format for LLM web...

25
Experimental
2651 L40S38/DetectiveConan-Database

名探偵コナン編纂室のページから登場キャラなどのデータを取得する

25
Experimental
2652 fckveza/create-proxy

HTTP / HTTPS Proxy

25
Experimental
2653 CrawlHQ/respondo

Lightweight Python library for web scraping, text extraction & AI-powered...

25
Experimental
2654 danishashko/amazon-data-analysis

Amazon product data analysis with Python & Jupyter. Includes cleaning,...

25
Experimental
2655 mileswwatkins/lookout_hunter

Find availability on Recreation.gov to camp in decommissioned fire-lookout towers

25
Experimental
2656 ren-zi-fa/funime

FunimeDesu adalah platform untuk streaming dan mengunduh anime dengan...

25
Experimental
2657 GeorgievFilip/ClassifiedScraper

A universal scraper mainly intended for classifieds-type websites. Scrape...

25
Experimental
2658 KevinHCH/vitellus

Complete backend system for European procurement intelligence that...

25
Experimental
2659 AhmedMohamedAbdelaty/EGP-ExchangeRates-TelegramBot

A Telegram bot providing real-time Egyptian Pound exchange rates, gold...

25
Experimental
2660 tariqshaban/sports-data-scraper

A web scraping tool conducted on a sports website, utilizing Python

25
Experimental
2661 ThatNotEasy/Cr4wler

Automated URLs Web Crawler

25
Experimental
2662 CharlieAlex/Sports-Betting-Freerider

蒐集玩運彩網站主推榜的比賽預測,協助進行分析。

25
Experimental
2663 proxyport/crawlee-proxyport

Proxy Port provider for Crawlee

25
Experimental
2664 omerhalid/Amazon-Price-Tracker

Track the price for the product you would like to buy and receive an email...

25
Experimental
2665 cbrintnall/shorter.recipes

A website dedicated to making recipes from any website easy to read.

25
Experimental
2666 Dolcruz/Heidelberg-Events

Auto-aggregated event listing for Heidelberg -- scrapes 4 local sources...

25
Experimental
2667 yusuftotic/pyside6-library-manager

A modern desktop library manager with ISBN barcode scanning, automatic book...

25
Experimental
2668 kianbehjati/Silent-Snake

A CLI based web crawler inspired by Screaming Frog Seo

25
Experimental
2669 bodrovis-learning/ScrapingBee-Load-Site-Data-Model-Training

How to scrape all text from a website for LLM training

25
Experimental
2670 nick-ulle/2017.04-python-workshop

(April 2017) DSI Python Workshop, Part 2

25
Experimental
2671 nolancacheux/linkedin-opentowork-scraper

Search LinkedIn profiles and filter by Open to Work status. Export to Google Sheets.

25
Experimental
2672 ElhamKhan859/Ultimate-Torrent-Scrapper-Public

Ultimate Torrent Scraper is a powerful and comprehensive torrent search...

25
Experimental
2673 alpha-drm/dmstk-downloader

Herramienta CLI que permite descargar cursos para acceso offline.

25
Experimental
2674 browser-act/browseract-workflow

Open-source BrowserAct + n8n workflow library for web automation. ...

25
Experimental
2675 julius383/PageSieve

A web scraping browser extension through a sidebar UI

25
Experimental
2676 lennonay/Prospect_scraper

Daily scraper for player stats in the WHL

25
Experimental
2677 PedroChaparro/PI202202-alako-data

This repository contains all the files related to project's data collection,...

25
Experimental
2678 DerrickMm/java-webscraping

How to scrape data from a website using java

25
Experimental
2679 jkenley/glance-cli

AI-powered web reader for your terminal – Fetch, extract, and summarize...

25
Experimental
2680 ScaleLeap/zine-not-amazon-scraper

How to Scrape Amazon Search Results

25
Experimental
2681 w00fx/PastebinScraper

Scraper made for downloading stuffs from pastebin.

25
Experimental
2682 N4rr34n6/TikPorn-User-Information-Scraper

TikPorn User Information Scraper allows you to retrieve user information...

25
Experimental
2683 Mahdi-Haqiqat/AI-Research-Agent

A powerful command-line research assistant that uses AI to search,...

25
Experimental
2684 ahmedbesbes/scraping-tutorial

code for data scraping Youtube tutorial

25
Experimental
2685 SbstnErhrdt/sitecrawl

Production-ready Go CLI + agent skill for domain-scoped crawling with Chrome...

25
Experimental
2686 isabellabenabaye/community-project

📊📺 Charts and dataset of IMDb ratings of all 110 Community (2009 - 2015) episodes

25
Experimental
2687 ArkaitzUlibarri/ewrc-results

Scraping of ewrc-results.com

25
Experimental
2688 sundowndev/hetical-forensic

Agrégateur pour l'intranet de @ecolehetic. Récupère et formalise les données...

25
Experimental
2689 gonzalopezgil/archi-scraper

An ArchiMate Web Report to XML Converter

25
Experimental
2690 DBuret/mcp-searxng-bridge

network-ready (sse) MCP server bridge. Search and Fetch web pages for AI...

25
Experimental
2691 geoffmyers/webpage-archiver

Chrome extension to archive webpages as PDF, PNG, HTML, and Markdown — all...

25
Experimental
2692 SadikinAraf/imperium-crawl

Extract, crawl, and scrape web data efficiently with a powerful open-source...

25
Experimental
2693 PyAmirAli/Generator-account-tikvpn

Generate a free tikvpn account

25
Experimental
2694 carlosqsilva/newsletter-scraper

A web scraper that extract curated content from newsletter, making a great...

25
Experimental
2695 NicholasBurgo/SiteInsite

Full-stack website intelligence platform - crawls sites and generates SEO,...

25
Experimental
2696 Tahaa-Dev/crawn

A CLI utility for web scraping and crawling built in Rust

25
Experimental
2697 sidward35/letterboxd-justwatch

Scans your Letterboxd watchlist and shows you where you can watch those...

25
Experimental
2698 fafilia/web_scraping

This document contains the process of scraping data from Bukalapak website...

25
Experimental
2699 Cmatrix1/Tele-Profile-Changer-WebScrap

This is a script to change the Telegram profile at the specified time. This...

25
Experimental
2700 kokseen1/Yoku

A minimal Yahoo! Auctions scraper.

25
Experimental
2701 seang1121/Fishing-Report-Analyzer

7 free APIs, 9 spots ranked, one Go/No-Go score — zero-dependency fishing...

25
Experimental
2702 GeiserX/Wayback-Archive

Download complete websites from the Wayback Machine with full asset...

25
Experimental
2703 ParhamPishro/Convert-English-Images-to-Farsi

Conver English Quote Image to Farsi | تبدیل تصاویر نقل قول انگلیسی به فارسی

25
Experimental
2704 MohamedWElteir/grades-checker

A tool I made to help me automate my grades checking process of my university.

25
Experimental
2705 haithamaouati/untaken

Check if TikTok usernames are taken or untaken

25
Experimental
2706 DrankRock/CMScrape

A simple python CardMarket price scraper.

25
Experimental
2707 humayun-ahmad/web-scraping

A comprehensive collection of beginner to intermediate web scraping scripts...

25
Experimental
2708 Murrough-Foley/web-content-extraction-benchmark

WCXB: Web Content Extraction Benchmark — 2,008 pages, 7 page types, 1,613...

25
Experimental
2709 haseebpyd/Python-Web-Scraping

All my Data Extraction projects from different clients are here.

25
Experimental
2710 valka465/similarity_analyzer

This is a simple, free tool built using HasData’s SERP API to analyze the...

25
Experimental
2711 rivaquiroga/datapalooza-2024-webscraping

Materiales del taller sobre web scraping con Python para Datapalooza 2024

25
Experimental
2712 zhidali2333/justapk

Download any Android APK by package name using six sources with automatic...

25
Experimental
2713 kiroviro/pharmacy-to-shopify

Web scraper and product importer for pharmacy e-commerce data to Shopify....

25
Experimental
2714 akashahmed11/data-scraping

📊 Collect historical intraday minute-level data for major Indian stock...

25
Experimental
2715 ironcladgeek/TSE-Scraper

Web scraper for collecting stock market data from Tehran Securities Exchange...

25
Experimental
2716 watrall/charm-market-intelligence-engine

Cultural resource and heritage management automated market intelligence...

25
Experimental
2717 Linguini2004/SneakerBot

Using Scrapy to scrape both www.depop.com and www.stockx.com.

25
Experimental
2718 AmmarAhm3d/anime-list-parser

a parser i wrote for anime titles from...

25
Experimental
2719 Gabryxx7/AI_Dating

What to do when you end up single during a pandemic in 2020? Create an AI to...

25
Experimental
2720 delnouty/bidabi-clone-adapt-create

Dépôt pédagogique du cours "Big Data and Business Intelligence (BIDABI)". Ce...

25
Experimental
2721 anthony-rgs/artemis

Artemis is a music scraper for Spotify, Apple Music, and Deezer. It extracts...

25
Experimental
2722 lcspu/Archive.org-Book-Downloader

Archive.org advanced book downloader (support for normal and loanable books)

25
Experimental
2723 carol-caires/receitas-web-scrapper

API que busca receitas no site Tudo Gostoso

25
Experimental
2724 brianpark12/Gemini-AI-Article-Summarizer

A fast Python based article and document summarizer powered by Google Gemini...

25
Experimental
2725 manoj-vkumar/Scrape_IndiaBix_QA

Scrape a question and answer from IndiaBix website using Python

25
Experimental
2726 gurjeet29/telegram_members_adder

Python Script to add members scraped from a given Telegram group stored in a...

25
Experimental
2727 datastory-org/ep-election-turnout

Collecting voter turnout data for the European Parliament elections

25
Experimental
2728 Affan828/Antibot-Detector-Extension

🔍 Detect anti-bot measures on any website, including CAPTCHAs and...

25
Experimental
2729 leorolland/sortir.in

Your local {films, events, activities...} search engine 🧭

25
Experimental
2730 Reynadi531/vaksincovid19-api

API VAKSIN COVID-19 INDONESIA ( Scrapping Website Kemenkes )

25
Experimental
2731 rehan-nasir/etsy-sales-scraper

A python program that scrapes an Etsy URL and displays all sellers and their...

25
Experimental
2732 scrapeless-ai/sdk-node

SDK to access Scrapeless API directly from Node.js. We handle Proxies,...

25
Experimental
2733 Web3-Serializer/French-eState-Scrapper

Modular scraper for French real estate listings from major platforms like Le...

25
Experimental
2734 iqbaleff214/linkedin-job-scraper-python

LinkedIn Job Scraper with a Text-Based User Interface (TUI) is a...

25
Experimental
2735 zulfikriyahya/scraping-dikdasmen

Scraping data sekolah dari situs resmi Direktorat Jenderal Pendidikan Dasar...

25
Experimental
2736 IvanildoBatista/Data-science

Projetos de análise de dados em Python de aprendizado supervisionado...

25
Experimental
2737 hpi23/mensa

HPI script sources for various mensa scraping activities

25
Experimental
2738 RozhakDev/WhatsAppGroupMemberExporter

Client-side script to export WhatsApp group member data (name, phone number,...

25
Experimental
2739 bug-ops/scrape-rs

🦀 High-performance HTML parsing library. Rust core with native bindings for...

25
Experimental
2740 octarect/xtract

A Declarative XPath-based XML/HTML Unmarshaler for Go using struct tags.

25
Experimental
2741 blakebrandon-hub/Content-Aggregator

A Django-based web application that collects and displays articles from...

25
Experimental
2742 Vineetpandey0/Claude-Context-Preserver

Chrome extension to extract and export Claude.ai chat history as structured...

25
Experimental
2743 hmignon/P2_BooksToScrape

Scraping BooksToScrape (P2 OC D-A Python) : Utiliser les bases de Python...

25
Experimental
2744 HC-ONLINE/CiberWebScan

Hybrid tool for passive reconnaissance and attack surface analysis in web...

25
Experimental
2745 nolancacheux/webscrapping_clubs

Web scraping toolkit for extracting and analyzing club/organization data

25
Experimental
2746 Thordata/google-news-scraper-python

📰 Real-time Google News Scraper for Python. Extract headlines, sources,...

25
Experimental
2747 frederik-uni/docker-cloudflare-bypasser

A simple api that runs within a container that returns user-agent and cookies

25
Experimental
2748 lukisanjaya/scaping-simple-ci

Simple scraping data menggunakan CodeIgniter dan library DOM Parser

24
Experimental
2749 yashpokar/xpath-generator

Dynamic xpath building

24
Experimental
2750 incogiscool/marketing-report

This tool allows developers to have quick access to the TikTok popular...

24
Experimental
2751 gabriel-rch/tapology-network

Tapology Network is a data science project that scrapes MMA fighter data...

24
Experimental
2752 ilovedevs/awesome-web-crawler

List of best web crawlers to extract data from the web. Find web crawling...

24
Experimental
2753 mark-lvl/googleplay_crawler

Using scrapy library to crawl in Google Play and scrap apps information.

24
Experimental
2754 sirvan3tr/Python-AutoTraderWebScraper

Python web scraping code example.

24
Experimental
2755 hisashi-ito/pr-scraper

press (news) release scraper for specific company

24
Experimental
2756 rahulapjs/SemanticFeed

SemanticFeed is a full-stack news aggregator built with FastAPI and...

24
Experimental
2757 datamade/car-scraper

💲Make spreadsheets out of Chicago Association of REALTORS® reports

24
Experimental
2758 Polodashvili-Iosif/parser-scraper_eldorado

Парсер для получения списка игровых ноутбуков с их комплектующими с сайта...

24
Experimental
2759 Thordata/instagram-scraper-python

Extract Instagram posts, profiles, reels, and comments at scale. Powered by...

24
Experimental
2760 HasData/extract-emails-from-google-search

Extract public emails from Google Search snippets with Python and the...

24
Experimental
2761 luminati-io/parsing-xml-with-python

Parse XML in Python using ElementTree, lxml, SAX, and more for efficient...

24
Experimental
2762 jeho-lee/visual-webpage-section-detection

Dataset, Models, and Demo for Visual Section Detection on Web Pages

24
Experimental
2763 cognifyapi/google-trends-api

Google Trends API from CognifyAPI is a data-retrieval tool engineered for...

24
Experimental
2764 sc4rfurry/Neo-ProxyNinja

A flask Web-Application that Fetches free proxies (HTTP/HTTPS/Socks4) from...

24
Experimental
2765 fiskryeziu/anime-api

hianime-api is a Node.js-based API that scrapes data from hianime.to,...

24
Experimental
2766 ayuxy027/Sortfree

Sort Smarter, Not Harder – AI-Driven Data Sorting & Filtering for Every Web Page.

24
Experimental
2767 rnhdev/gtraffic-scraper

Scratch the results of Google traffic images of cities, regions, etc.

24
Experimental
2768 harmindersinghnijjar/fb-marketplace-smartproxy-scraper

A Python-based web scraping tool designed for extracting vehicle listings...

24
Experimental
2769 bodrovis-learning/scrapegraph-ai-tutorial

Scrapegraph AI Tutorial; Scrape websites easily with LLaMA AI

24
Experimental
2770 ScraperHub/crawlbase-cyberweek-deals-2025

Get 15% OFF on 5 powerful products during Crawlbase Cyberweek 2025. Includes...

24
Experimental
2771 meysam81/trawl

Free, privacy-first alternative to Hunter.io — extract, validate, and export...

24
Experimental
2772 yusufcinarci/Web-Scraping-Projects

In these project files, I will host the web scraping examples that I will...

24
Experimental
2773 supriyd/Scraping-Lion-Air-Reviews-on-TripAdvisor-with-R

Cara mudah untuk mendapatkan data ulasan pelanggan secara keseluruhan yang...

24
Experimental
2774 mrmtwoj/ACYBER-Wayback-Machine-Downloader

A powerful Python tool for downloading historical files (PDF, JPG, PNG, CSS,...

24
Experimental
2775 Jackmt9/mnemonic-maker-backend

A web scraping application that generates acrostic mnemonic devices by...

24
Experimental
2776 WZBSocialScienceCenter/mdb-twitter-network

Twitter network of members of the 19th German Bundestag

24
Experimental
2777 Riemann-def/linkedin-job-finder

Bot avanzado para buscar y analizar empleos en LinkedIn con inteligencia...

24
Experimental
2778 pkipsy/news-lens

Filtering Political Bias in American News Media

24
Experimental
2779 shauryashekhar/webScrapper

WebScraping project for Independent Study at UW Madison - Spring 2020 & Fall 2020

24
Experimental
2780 K-Rdlbrgr/datascience4everybody

This repository combines Lectures and Exercises from the Data Science 4...

24
Experimental
2781 soumik12345/Manga-Scraper

A simple tool to download Manga and create Chapter-wise PDFs easier to read

24
Experimental
2782 keyhankamyar/ProxyRotator

Async V2ray (VMESS) proxy rotation library for Python. Auto-update...

24
Experimental
2783 MaxySpark/Song-Playlist-Downloader-NodeJS

Download Song Or Your Own Playlist

24
Experimental
2784 AhmedMohamedAbdelaty/Sanfoundry-To-PDF

A Chrome extension designed to help students and educators easily convert...

24
Experimental
2785 SIDDHU123M/Streaming-URL-FInder

This Python script scrapes a webpage for video URLs using BeautifulSoup. It...

24
Experimental
2786 2MuchC0ff33/elvis

A POSIX shell-based web scraper that generates daily call lists of...

24
Experimental
2787 whydejmayannmm/rednote-xiaohongshu-user-posts-scraper

Xiaohongshu user posts scraper tool

24
Experimental
2788 data-tamer/crawlerWhipAI

Datatamer.ai crawling

24
Experimental
2789 duyet/Crawler-DKXT-DH-2015

Crawler thống kê danh sách thí sinh đăng kí xét tuyển DH 2015 vào các trường.

24
Experimental
2790 raymondoyondi/Search-Engine

This project demonstrates building a custom search engine using Python and...

24
Experimental
2791 bhaveshgawri/bitsy

chatbot for BITSAT and BITS

24
Experimental
2792 jguida941/playground

Python learning playground - web scraper (CLI + PyQt6 GUI), algorithms, data...

24
Experimental
2793 xAsmodeus/Web-Scraping-Pipeline

A web scraping model that gathers names, emails and links from wine...

24
Experimental
2794 wagdev1919/BulkPhonenumberVerifier

Multiprocessing Bulk Phone number Verifier

24
Experimental
2795 luxuriant777/linkchecker

Link Checker: a command-line tool written in Go for checking for broken...

24
Experimental
2796 sidward35/centrist-bot

Balanced as all things should be.

24
Experimental
2797 MrAhmedElkady/goscraping

Production-grade HTTP scraping for Go with stable transports, version-aware...

24
Experimental
2798 Pangolin-spg/amazon-scrape-api

Powerful E-commerce Scraping API for Amazon, Walmart, Shopify, eBay & more....

24
Experimental
2799 jhamadhav/link-preview

Scrapping through the endless sea of web, it provides link previews to all.

24
Experimental
2800 mk-ehe/perfumehub-api

Perfumehub API with e-mail sending on Render

24
Experimental
2801 forbiddenlink/competitor-stalker

Competitive analysis tool for tracking competitor websites, features, and...

24
Experimental
2802 arrrrrmin/lanz-mining

A data project to explore media participation in German talk shows of public...

24
Experimental
2803 moaaztaha/Faceapp-Gender-Swap-Detection

Detecting fake photos generated by FACEAPP gender swap feature using Deep Learning.

24
Experimental
2804 kenziebottoms/artograph

An app to geographically visualize and organize tattoo artist information.

24
Experimental
2805 luckylittle/most-frequently-used-keywords-in-devops-jobs-au

What are the most frequently used keywords in DevOps & Solution Architect...

24
Experimental
2806 GiacomoGuaresi/FAInder

App mobile open source per esplorare i beni del Fondo Ambiente Italiano su...

24
Experimental
2807 Runnin-N-Gunnin/GeckoFXAdBlockFilters

AdBlock for GeckoFX WebBrowser. Custom keyword/domain support + EasyList,...

24
Experimental
2808 jcarterlab/NewsMonitor

A Python pipeline for monitoring news sources and using LLMs to detect...

24
Experimental
2809 luminati-io/web-unlocker-api

Web Unlocker is a powerful scraping API that bypasses sophisticated anti-bot...

24
Experimental
2810 mwanjajoel/social-media-scraper

Jupyter Notebooks demonstrating scraping data from social media sites....

24
Experimental
2811 NikelausM/book-scraper

A python application for web scraping the book catalogue website,...

24
Experimental
2812 sidharthrajaram/scrapers

Simple tutorials for web scraping in Python

24
Experimental
2813 anishgowda21/RIT-sis-scraper

A api built using fastapi to scrape student info from RIT website

24
Experimental
2814 luminati-io/hcaptcha-solver

Solve hCaptchas with Bright Data's advanced AI-driven CAPTCHA Solver,...

24
Experimental
2815 wp-i/comment-vision-claw

抖音热评智能抓取与分析工具

24
Experimental
2816 GDGVIT/ScrapeDroid

An effective android library that can be used for web scraping by supplying...

24
Experimental
2817 christianmoya/FilmAnalysis

This group project analyzes movie data in the box office and award shows,...

24
Experimental
2818 itsferdiardiansa/ECommerce-Stats

Rufieltics is an open-source analytics platform designed to provide...

24
Experimental
2819 riyanimam/georgia-legislation-webcrawler

🍑 The georgia-legislation-webcrawler project is a tool designed to extract...

24
Experimental
2820 luminati-io/serp-api

An enterprise-grade Bright Data SERP API for large-scale, real-time search...

24
Experimental
2821 MUSA-620-Spring-2018/MUSA-620-Week-6

Web scraping 1

24
Experimental
2822 BrandedTamarasu-glitch/Job-Radar

Desktop GUI + CLI job search tool — searches Dice, HN Hiring, RemoteOK, WWR,...

24
Experimental
2823 Zeletochoy/strinks

Beer Cost-Performance Monitoring

24
Experimental
2824 akshatprogrammer/Web-Scrapping

This is a quick introduction to WebScrapping

24
Experimental
2825 frankwillard/NBA-Web-Scraper-And-ANN

Scraped historical NBA advanced stats, visualized it, and developed a model...

24
Experimental
2826 Alfinpratamaa/mangap

Mangapp is the best place to read manga, manhwa, and manhua in Indonesian....

24
Experimental
2827 prakharchoudhary/fun_with_python

My adventures with python!!

24
Experimental
2828 maestro-ai-stack/maestro-fetch

Fetch everything, for agents. Universal data acquisition with smart routing.

24
Experimental
2829 tejasa97/django-craigslist

A Craigslist clone with a neater frontend

24
Experimental
2830 sourovroy/web-scraping-using-php

Scrap web HTML using PHP

24
Experimental
2831 mcp-tool-shop-org/websketch-extension

Chrome extension to capture web pages as WebSketch IR.

24
Experimental
2832 Jobbernaut/jobbernaut-extract

Browser extension to extract job postings with a single keystroke. Press...

24
Experimental
2833 lobstrio/lobstrio-docs

Official API documentation site for lobstr.io — web scraping automation...

24
Experimental
2834 Afilimax/core

Este é o pacote core da Afilimax, ele é responsável por carregar nossas...

24
Experimental
2835 hummat/deal-finder

Minimal Python scraper/notifier for Kleinanzeigen that emails and...

24
Experimental
2836 AstonishedLiker/france-ioi-bot

A bot that tries to complete all the tasks on the France-IOI platform

24
Experimental
2837 christophknabe/akka-crawl

Webpage Crawler as Demonstration for Usage of Akka Actors, Akka HTTP client,...

24
Experimental
2838 someshsingh22/FlaiReddit-MIDAS

A Webapp deployed on Heroku which detects the 'flair' tags of a Reddit Post...

24
Experimental
2839 easonlai/yahoo_news_searching_and_text_analytics

This is a demo repo to demonstrate how to use Python Requests and Beautiful...

24
Experimental
2840 rarants/web-scraping-em-python-pet-redacao

Realizando web scraping utilizando Python e as bibliotecas Requests, Pandas...

24
Experimental
2841 Mahdi-hasan-shuvo/twitter-data-scraper-python

Python Twitter scraper using Requests 🐍. Extract tweets by keywords,...

24
Experimental
2842 akaTatago/BPFetcher

Python-based web scraper for automated book price extraction. Processes book...

24
Experimental
2843 aiborra11/crypto-scraper

Scraping tool to automatically collect tick data from the Bitmex Orderbook,...

24
Experimental
2844 hilbigan/mlscraper-rust

Scrape structured data from HTML documents automatically

24
Experimental
2845 scrapehero/yelp-search

Code to search for business listings on yelp.com

24
Experimental
2846 Open-Agent-Utilities/bot-compliance-middleware

Universal middleware to prevent IP blacklisting and handle "Suspicious...

24
Experimental
2847 mclevey/GESIS_2020_Fundamentals

Workshop materials for McLevey and Anderson's workshop in the 49th GESIS...

24
Experimental
2848 djb-gt/yc-scraper

YC Company Scraper is a Python script that fetches information about Y...

24
Experimental
2849 RonnyFalconeri/CrawlingSpider

A simple web crawler inside a docker container using Apache Nutch 1 and Solr.

24
Experimental
2850 Shruti-Sawant-22/Webscrapping-Donald-Trump-lies

In this project I scraped the data from a static web page using the requests...

24
Experimental
2851 eveskew/rap_album_sentiment_analysis

Sentiment analysis on rap albums in R

24
Experimental
2852 mert-byrktr/Scrape-EPL-Data

Scrape English Premier League data from fbref and save it as csv for future works.

24
Experimental
2853 AymaneLk/Web-Scraping-Job-Postings

Web scraping Job Postings - wuzzuf.net

24
Experimental
2854 TheoSourget/Public_Medical_Datasets_References

Pipeline to detect dataset presence in research papers

24
Experimental
2855 openfacto/Telegram_Archive_Scraper

A simple python script to parse a Telegram archive

24
Experimental
2856 kenych/java-web-crawler

This is pretty basic example of web page crawling in java and is not fully...

24
Experimental
2857 lunosat/YouRestTube

Rest Api of youtube

24
Experimental
2858 Vardioratai/Github-Scout

🔭 GitHub repository intelligence spider — crawls the GraphQL API to discover...

24
Experimental
2859 amafjarkasi/go-phantomjs

A robust and easy-to-use Golang client library for the PhantomJsCloud API.

24
Experimental
2860 orchestra-mcp/plugin-bridge-firecrawl

Firecrawl web scraping bridge — crawl, scrape, and extract structured data...

24
Experimental
2861 eleussaj/cloudflare-bot-directory

🤖 Discover 500+ verified bots and web crawlers from CloudFlare Radar for...

24
Experimental
2862 davidcockson-compliance/job-radar

Full-stack job discovery and pipeline tracker with multi-source parsing and...

24
Experimental
2863 NickCirv/clone-any-app

Reverse-engineer web apps into deployable codebases. URL-to-codebase cloning...

24
Experimental
2864 Leandro2101xD/creator-fusion-youtube-analyzer

🎬 Analyze YouTube creators with unique metrics to determine brand...

24
Experimental
2865 kithuto/auto_proxy_vpn

On-demand proxies and VPNs across multiple cloud providers — from a single...

24
Experimental
2866 worldbank/Firms-Web-Scraping

The aim of this project is to scrape metadata of business firms given only...

24
Experimental
2867 Juhibhojani/Airline-Reviews-

Python file for scrapping airline reviews

24
Experimental
2868 srijitravi94/Search-Engine

Implementation of different Information Retrieval Systems to evaluate and...

24
Experimental
2869 ojd2/web-crawl

Simple bespoke Python web crawler

24
Experimental
2870 TechGeekMe/MSRIT-Results

Web app for MSRIT results.

24
Experimental
2871 placintaalexandru/come-fly-with-me

🛬 An automated solution to scrape data from various flight companies using...

24
Experimental
2872 DrStef/Applied_Data_Science_Capstone_SpaceX_IBM

Data Science Project: SpaceX Falcon 9 First Stage Landing Prediction.

24
Experimental
2873 mdibaiee/web-scraper

simple web scraping: extract texts and links as CSV, and save images of...

24
Experimental
2874 quangtrung01/public-apis

🌍 Discover and access a curated list of public APIs to enhance your...

24
Experimental
2875 Kgurses52/IscrapeMDB

🎬 Extract detailed IMDb data effortlessly with IscrapeMDB, a robust tool for...

24
Experimental
2876 elton2024br/instanotLM

Extensão Chrome que extrai dados completos de perfis públicos do Instagram e...

24
Experimental
2877 wname121/spa-crawler

🕷️ Crawl and mirror modern SPAs with optional login, capturing dynamic...

24
Experimental
2878 Henr1ko/PixThief

Stealthy .NET 8 console tool that crawls pages or whole domains and...

24
Experimental
2879 vindarel/cl-torrents

Searching torrents on popular trackers - CLI, readline, GUI, web client....

24
Experimental
2880 xrce/jasmine

Just Another Search Module In-case-of Nearly Everything

24
Experimental
2881 CrazyCoder76/everand-downloader

This is everand book downloader

24
Experimental
2882 InvisibleSymbol/etherscan-labels

ye

24
Experimental
2883 darhnoel/markql

A SQL-style query engine for HTML that makes extraction and filtering...

24
Experimental
2884 n4ss4u/InstaMOU

InstaMOU is an OSINT oriented tool designed to extract publicly accessible...

24
Experimental
2885 trickerer01/kemono-ripper

kemono.cr downloader with external links support

24
Experimental
2886 clement-cvll/PortfolioOptimizer-PREVI-OPTIONS

Portfolio optimizer for PREVI-OPTIONS assurance vie

24
Experimental
2887 nzrsky/useragent-generator

High-performance User-Agent generator for Go. Zero-alloc bots, auto-updated...

24
Experimental
2888 Harvey-AU/hover

Check sites for broken links, slow pages, while warming cache.

24
Experimental
2889 mohamedelalfy27/argus

👁️ Enhance AI agent performance with Argus, the open-source tool for...

24
Experimental
2890 0xDarkMatter/flarecrawl

Flarecrawl CLI — Cloudflare Browser Rendering alternative to Firecrawl,...

24
Experimental
2891 omss-spec/framework

🛠️ Official TypeScript framework for building OMSS-compliant streaming backends

24
Experimental
2892 TzurSoffer/spotipyFree

spotipy replacement without using the official api

24
Experimental
2893 lamia-lang/lamia

Write your prompts once. Run them forever. Lamia guarantees the output. No...

24
Experimental
2894 OstinUA/App-Finder-100k

🔍 Streamlit tool for discovering low-to-mid install Android apps on Google...

24
Experimental
2895 LessUp/bookmarks-cleaner

Smart Bookmark Cleanup & Classification: Rules + ML + Optional LLM, Dedup &...

24
Experimental
2896 cognifyapi/google-images-api

Scrape Google Images to JSON automatically using Google Images API.

24
Experimental
2897 dhsunsbzueyd/social-media-downloader

📥 Download content from 700+ social media platforms using this efficient...

24
Experimental
2898 GeiserX/media-download

Downloads all media files from any web page into a folder schema

24
Experimental
2899 d-oliveros/nest

High-level, robust framework for web scraping in Node.js

24
Experimental
2900 Moshe-ship/safha

Arabic Web Scraper for ML — scrape, clean, detect dialect, export...

24
Experimental
2901 jasont7/restaurants-map

A web app mapping Yelp restaurant data with Google Maps API.

24
Experimental
2902 ezekotenilocit/super-crawler

A fast super-crawler implementation for web scraping.

24
Experimental
2903 scrapehero-code/google_maps_scraper

A simple webscraper to extract basic details like Title, phone no., review...

24
Experimental
2904 NenshaM/webhash-monitor

A Python tool to monitor websites and detect content changes automatically.

24
Experimental
2905 BilkentHai/nyt-puzzle-scraper

Scrapes NY Times Mini Crosswords puzzle everyday through AWS Lambda & its cron.

24
Experimental
2906 npaun/minervaclient

A CLI client for Minerva course registration

24
Experimental
2907 chataize/rabbit-hole

C# library for scraping text content from websites.

24
Experimental
2908 damadjan/html-shrinker

Simple Python helper library that can significantly reduce LLM input tokens...

24
Experimental
2909 ricardo-mattoss/Brazilian-Soccer-Data

Scraping and updating of data from the championships that Brazilian soccer...

24
Experimental
2910 jjonescz/awe

AI-based web extractor

24
Experimental
2911 Firdavs-coder/free-templates-uz

To Find free codes of static websites automatically.

24
Experimental
2912 omidcodes/wiley-open-access-pdf-downloader

Download Open-Access PDFs from Wiley Online Library using SRU queries -...

24
Experimental
2913 yousefkotp/local-leads-finder

Local Leads Finder helps you uncover nearby business prospects in minutes,...

24
Experimental
2914 Starvinci/LLM-Tinder-Bot

LLM-based Tinder bot with message-count–driven conversation rules, adaptive...

24
Experimental
2915 cchummer/earningswhispers

Scrape and sort EarningsWhispers data

24
Experimental
2916 TrinTragula/SharpScraper

A pastebin scraper written in c#, using MongoDB to store findings.

24
Experimental
2917 ndleah/currency-converter

💱 A program that will perform currency conversion using data fetched from an...

24
Experimental
2918 mcmontseny/scraper-100-cims-feec

Scraper per obtenir tota la informació sobre totes muntanyes del repte dels...

24
Experimental
2919 adzo261/Codechef-Activity-Notifier

A python script to notify recent submission of a desired user on Codechef

24
Experimental
2920 abhinavwalia95/stackoverflow_documentation_PDF

Scrape and convert Stackoverflow documentation to formatted and printable PDF

24
Experimental
2921 fuad-ibrahimzade/sports-bettor

Betting bot web scrapps tipico.de and bets on over/under strategy at specific times.

24
Experimental
2922 KKonaNN/Whorepress

💨 SUPER SONIC WORDPRESS CHECKER

24
Experimental
2923 zachcarlson/TeslaWebScraper

Web scraper to collect Tesla Supercharger locations. Final project for DSCI 511.

24
Experimental
2924 JizhiziLi/all-kinds-crawling-tools

This repository provides all kinds of crawling tools, e.g. image-crawler,...

24
Experimental
2925 hktalent/scrapysite

ScrapySite,go Web Crawler(spider), scraping,intelligence gathering

24
Experimental
2926 thesushilsharma/Zodiac

This is a simple horoscope API built with Next.js, providing endpoints to...

24
Experimental
2927 Omar-Hydrah/turjuman

An English-Russian dictionary, created with Python and Java. A desktop qt...

24
Experimental
2928 bradklassen/Official_World_Golf_Ranking_Scraper

Python web-scraping program to obtain data for every tournament played by...

24
Experimental
2929 theodoremoreland/OrderDashboard

A dashboard for visualizing DoorDash order history and scripts to get order...

24
Experimental
2930 arindam-modak/web-scraping

web scraping using python. Scrap valuable amd important data from top...

24
Experimental
2931 danielacraciun/scrape-rec

Real estate data gathering and notification

24
Experimental
2932 deividi86/techstack-scanner

Detect every technology behind any website — frameworks, CMS, analytics,...

24
Experimental
2933 GigaHertzLegacy-SpiderX/Py_Web_Scrape

A handy Web Scraping tool using python

24
Experimental
2934 TnYtCoder/NetCrawl

Powerful website crawler for directory discovery, API enumeration, and...

24
Experimental
2935 condran999/Hotel-Review-Sentiment-Analysis

Hotel-Review-Sentiment-Analysis

23
Experimental
2936 asanakoy/web-crawler

Web-Crawler for simple.wikipedia.org on C++

23
Experimental
2937 Arghya721/crypto-data-scrapper

Crypto Data API is a RESTful API that provides access to cryptocurrency...

23
Experimental
2938 padraicbc/h5p

CSS + XPath engines in Go

23
Experimental
2939 ashleycheng/house-price-etl-pipeline

Building house price data pipelines with Apache Beam and Spark on GCP

23
Experimental
2940 umihico/kindle-highlights

Share highlights that have been inspiring you in github pages

23
Experimental
2941 THEFZNKHAN/price-tracker

Scrape Product Details from Amazon Website.

23
Experimental
2942 Alfa-Q/rlgpy

Rocket League Garage API in Python

23
Experimental
2943 SamuraiPolix/brainyquote.com-quotes-scraper

Scraping quotes from brainyquote.com

23
Experimental
2944 peteb206/canadians-in-college-baseball

Web scraper for Canadian Baseball Network

23
Experimental
2945 isabelfaulds/Produce-Price-Predictions

Web scraping and forecasting prices on 20 years of data

23
Experimental
2946 konradcz2001/KinooTV-Extension

A Manifest V3 Chrome Extension integrating a third-party VOD service with...

23
Experimental
2947 mhenrique94/jobscouter

🔍 Jobscouter: Job Matching sem ruído. Coleta vagas (RemoteOK, Remotar) →...

23
Experimental
2948 yinggreat/public-data-collection-lab

公开数据采集实验室:页面解析、API 清洗、结构化导出与合规教学案例

23
Experimental
2949 shanvel-katesh/company-linkedin-info-extractor

Free Company Linkedin Info Scraper 90+ Success

23
Experimental
2950 scAB1001/search-engine-tool

A tool to crawl https://quotes.toscrape.com. Features include: creating an...

23
Experimental
2951 ThePathsOfSaga/ForexRetailSentimentAnalysis

Forex Retail Sentiment Analysis is a tool to scrape data from Myfxbook's...

23
Experimental
2952 EnzoItaliano/images-downloader-for-yupoo-extension

A specialized Chrome Extension to download high-resolution images from Yupoo...

23
Experimental
2953 mariajosemv/ETL-for-news-websites

♻️ Pipeline for Extract, Transform and Load articles from news websites into...

23
Experimental
2954 ekamwalia/competitve_coder_bot

Telegram bot to stay updated with upcoming contests on competitive coding...

23
Experimental
2955 gignus79/Bandi-AI-Assistant

Bandi AI Assistant è una webapp che analizza bandi di finanziamento da...

23
Experimental
2956 BhaveshV23/SkillCraft-Internship-Tasks

Python internship projects from SkillCraft Technology – GUI apps, Sudoku...

23
Experimental
2957 CharlesBinard/BonPlan

Deal-finding platform for LeBonCoin — event-driven Bun monorepo

23
Experimental
2958 pinkpixel-dev/sugarstitch

A local-first scraper for fiber arts pattern sites with a CLI and simple...

23
Experimental
2959 TechBeme/resolvejuizado

Sistema automatizado de agregação e publicação de notícias dos Procons...

23
Experimental
2960 dennissergeev/atmosscibot

[Inactive] Twitter bot that generates word clouds of new open access...

23
Experimental
2961 flulemon/sneakpeek

Sneakpeek is a framework that helps to quickly and conviniently develop...

23
Experimental
2962 omtekyav/cinemind-ai

Production-ready Multi-Source RAG platform synthesizing insights from IMDb,...

23
Experimental
2963 fonkyju/simple-scraping-python

A simple basic project for web scraping

23
Experimental
2964 parnika-sa/Google-Maps-Lead-Scraper-Pro

🚀 Extract business leads from Google Maps automatically - 100+ results per...

23
Experimental
2965 GuilleDiaz7/Automatic-Web-Scraping-of-A-Local-Cinema

Using GitHub Actions to automate the web scraping of a Burgos cinema...

23
Experimental
2966 abriggs914/Coding_Practice

A long-running collection of programming experiments, small projects, and...

23
Experimental
2967 shashank-556/Mfinance

Python module to scrape financial data from moneycontrol

23
Experimental
2968 parshva45/Web-Crawler

Implementation of my own web crawler and performing focused crawling.

23
Experimental
2969 ataozarslan/House_Price_Prediction

This repository includes a web scraping application, EDA analysis and...

23
Experimental
2970 andreyfesunov/rianewsdashboard

RIA news dashboard

23
Experimental
2971 algovoid/EtherCollect

CLI tool to get wallet funding in JSON/CSV from supplied wallet list

23
Experimental
2972 alonecandies/golwarc

All-in-One crawlers for Golang

23
Experimental
2973 el3mentry/EasyGramFetch

An automated service running on a Virtual Machine that can be used to...

23
Experimental
2974 Devyanshu/githubble

Analyze your Github account like never before.

23
Experimental
2975 briatte/swd

Two-day workshop on scraping legislative data, organised by URFIST Bordeaux in 2018.

23
Experimental
2976 samirettali/pastebin-scraper

A Pastebin scraper that uses scraping APIs

23
Experimental
2977 MartinCastroAlvarez/html2vec

Algorithm that converts an HTML to a vectorized object suitable for neural networks.

23
Experimental
2978 DenimEvert/camoufox-capsolver

Seamlessly integrate Camoufox (anti-detect browser) with CapSolver (CAPTCHA...

23
Experimental
2979 rkkwan/disaster-rapid-alert

NLP Sentiment Analysis on Twitter posts to detect natural disasters...

23
Experimental
2980 NakulSachdeva/T20-Data-Analysis

A Power BI report to identify top 11 players for a T20 cricket team.

23
Experimental
2981 okkymabruri/putusan

Web Scraping Putusan di Web Mahkamah Agung Indonesia

23
Experimental
2982 TheODDYSEY/Shop-Sense

A Next.js 14-powered Price 💸Tracking Platform easily track product prices,...

23
Experimental
2983 GINK03/multi-ip-scraping

aws-gcp-squid-config-dotfile

23
Experimental
2984 Ave-Wat/TwitterNetworkAnalysis

This project examines how populists target their constituencies on social...

23
Experimental
2985 meinder-a/proxyguard

Modern, async-first replacement for Scrapoxy. High-performance HTTP CONNECT...

23
Experimental
2986 MichAdebayo/new-is-always-better

A predictive analytics tool that forecasts box office performance to aid...

23
Experimental
2987 gipsh/miradetodo-scrapper

extract links from miradetodo.co

23
Experimental
2988 muhammadarnaldo/web-scraping-maktabah-shamela

This project is a web scraping script written in Python. Made to scrape...

23
Experimental
2989 Beking0912/weibo_comment_mooc

⭐️ [Course Project] Mobile Weibo Comment Spider

23
Experimental
2990 Sandreke/Data-Analysis-of-SP500-Stock-Features

This project consists of web scraping features of S&P 500 companies like...

23
Experimental
2991 tanjeffreyz/planit

Assignment tracker for students that automatically compiles due dates into...

23
Experimental
2992 hunj/tsa-passenger-throughput

A mini web scraping + data visualization project for number of travelers per...

23
Experimental
2993 tilburgsciencehub/legal-situation-of-web-scraping

Learn how to evaluate the legality of web scraping for your research

23
Experimental
2994 titouanlegourrierec/SpotThePlace

A bot to scrape google streetview and a CNN to classify countries.

23
Experimental
2995 its-sarin/ebay-listing-scraper

Small tool to quickly scrape ebay listings based on a search query and...

23
Experimental
2996 angelcafe/DonTorrent

PWA moderna para explorar DonTorrent con backend PHP/.NET, Service Worker,...

23
Experimental
2997 konradcz2001/Update-Tracker

Automated software update tracker built with JavaFX. Users can define custom...

23
Experimental
2998 ubccsss/exams

This uses webscraping and machine learning to automatically find past...

23
Experimental
2999 sandipkunwar23/Nepal-EV-Price-Prediction-

Exploratory analysis and price prediction of electric four-wheeler vehicles...

23
Experimental
3000 Theminijohn/quora-scraper

Quora Question Scraper - Find & Export relevant Questions 10x faster

23
Experimental
3001 candepelliza/Scraping-Uber-Eats-London

Scraping restaurant data from Uber Eats London website in Python with BeautifulSoup

23
Experimental
3002 zeus2198/Web-scraper-for-SA-MP-search-result

PHP script to login into SA-MP forum and scrape out search results

23
Experimental
3003 luminati-io/bright-data-with-mage-ai

Mage AI pipeline: scrape Amazon products & reviews with Bright Data APIs,...

23
Experimental
3004 Thordata/how-to-scrape-google-trends

Step-by-step tutorial for scraping Google Trends with the Thordata Python...

23
Experimental
3005 aboueleyes/cms-downloader-refined

a tiny script that automates downloading files from guc cms website

23
Experimental
3006 0xall3x/DeepOsint

Massive OSINT aggregation tool for deep intelligence gathering from multiple...

23
Experimental
3007 SH1ROdev/SHIROMU

Legendary osint software

23
Experimental
3008 hardikchheda13/Web-Data-Extraction-and-Analysis

Scrapped reviews of 500 Restaurants from yelp and Tripadvisor each. And...

23
Experimental
3009 Kyrela/TweetsMediaExtractor

extracts videos behind an external links from search results on Twitter

23
Experimental
3010 jakeoeding/lexicon

Quick script to grab the definition or synonyms of a given word

23
Experimental
3011 fantasy-toolz/mlb-predictions

Predictions for the outcome of MLB games.

23
Experimental
3012 aTh1ef/ai-debate-agents

Verify claims using AI agents that debate using scraped evidence and local...

23
Experimental
3013 Joffreybvn/bot-scrape-zimmo

A Scrapping Bot written in Python, to scrape data from real estate website...

23
Experimental
3014 rohitthapliyal2000/Web-Scraping

Learning web scraping via Python using XML Path language imported through...

23
Experimental
3015 TechBeme/kickstarter

Professional data collection, enrichment, and analytics platform for 8,000+...

23
Experimental
3016 wlyastn/reddit-comment-harvester

A lightweight Python tool that exports Reddit thread or comment-tree data...

23
Experimental
3017 narkhedesam/python-sample

Best Rotating Proxy & Scraping API Alternative

23
Experimental
3018 ysfzkn/trendyol-scraper

A web scraper bot with specific e-commerce website in Turkey.

23
Experimental
3019 straxico/insta-get-bio

get bio of all followers of a instagram user

23
Experimental
3020 lnenad/newser

Newser is a simple utility to generate a pdf with you favorite news articles

23
Experimental
3021 SufficientDaikon/harvesthub

🌾 Adaptive product scraping platform — extract data from any e-commerce site...

23
Experimental
3022 VipinindKumar/Web-scraping-price

A Web Scraping program to scrap Laptop prices and their specifications

23
Experimental
3023 altuseo/seoo

SERP Similarity Tool for SEOs using Streamlit

23
Experimental
3024 el-sh200/mongard-easy-download

Script to download from mongard.ir easily.

23
Experimental
3025 pradipchaudhary/JavaScript-Web-Scraping

A repository dedicated to exploring and implementing web scraping techniques...

23
Experimental
3026 alexandersotoc/supermarket-web-scrapping

Scrapping data from https://www.plazavea.com.pe website

23
Experimental
3027 thecloer/crawler-himym

How I met your mother script PDF generator for learning English

23
Experimental
3028 silburt/git-screened

Automating Github Repository Assessment.

23
Experimental
3029 dweinstein/node-itunes-rss

Overengineered iTunes rss feed lister https://rss.itunes.apple.com/

23
Experimental
3030 Cooya/Social-Network-Scraper

CLI tool for scraping Instagram, Youtube & Facebook (freelance mission)

23
Experimental
3031 milosmladenovic5/football_clubs_logo_scraper

Scraping logos of world football clubs from wikipedia

23
Experimental
3032 adrz/movie-posters-convnet

Unsupervised clustering of movie posters with features extracted from...

23
Experimental
3033 missiontoscale/bluesky-scraper

This is a work of art that enables you to scrape data off BlueSky.

23
Experimental
3034 cumbof/galaxy-scraper-extension

Chrome extension that automatically scrape and send data from a webpage to...

23
Experimental
3035 timhealz/SIF_scrape

Scraper to pull spreads and scores for NCAA college football games

23
Experimental
3036 hsiaoping-zhang/ARWU-web-crawler

2021 Shanghai Ranking - [ Global Ranking of Academic Subjects ] ranking crawler

23
Experimental
3037 Frog-Front/web-crawler

A Library for web crawling websites harvesting URLs of embedded links and images

23
Experimental
3038 johnwmillr/SharkTank

Analysis of Shark Tank deals 🦈💰

23
Experimental
3039 hotrush/stealer

Async website scrapper tool like scrapy built with reactphp.

23
Experimental
3040 tskhirtladze/CoARA-Signatories

This project is a data visualization app built using Streamlit that scrapes...

23
Experimental
3041 LoliKillers/simple-rest-api

Simple Rest Api Scraping

23
Experimental
3042 vladimircuriel/inmo-insight

Data-driven analysis of the real estate market (Santiago, Dominican...

23
Experimental
3043 ad3rinto/data-science-rune

12 Hour tutorial on fundamentals of data science

23
Experimental
3044 kathleengraham/visualizing-global-data-with-leaflet-js

Interactive Visualizations of Global Trends

23
Experimental
3045 marcusle02/google-flights-etl

End-to-end data engineering pipeline for tracking daily changes in flight prices

23
Experimental
3046 Carlosp31/Everydai

Final project

23
Experimental
3047 hansputera/beranicerdas-api

Just an API Wrapper for https://beranicerdas.sekolahkukeren.id (unofficial)

23
Experimental
3048 hazavi/aniways

Local Anime streaming app. Built with (Animepahe scraper + Jikan API)...

23
Experimental
3049 Madi-S/Multiprocessing-Asynchronous-Web-Scraping

A simple example of asynchronous web scraping with multiprocessing Pool....

23
Experimental
3050 raoalok/imagescrape

Google Image Scrape : Local HDD

23
Experimental
3051 jalfr3d/calories-flask-webapp

OOP exercise of python. The webapp calculate the needed calories using the...

23
Experimental
3052 abhish-one/Market-Structure-Analysis

This repository contains code for Clustering analysis and Correspondence...

23
Experimental
3053 aknsubbu/News_Scraper_and_Display

Automated news aggregator combining Python web scraping with a Next.js...

23
Experimental
3054 namle133/shopping_online_scrape

Shopping Online Crawl Data (supported Tiki, Shopee, Lazada, Amazon)

23
Experimental
3055 3twla-Girls/Videogame-Sales-on-Steam-Prediction

This project analyzes Steam game data to identify key factors driving sales...

23
Experimental
3056 threnjen/boardgamegeek

BoardGameGeek Recommender System is a start-to-finish project, from sourcing...

23
Experimental
3057 GreatDrake/ImageDownloader

download images from web page

23
Experimental
3058 datos-solidarios/rastreo-apartamentos-turisticos-irregulares

Descarga y geolocalizacion de apartamentos turísticos en la Comunidad Valenciana

23
Experimental
3059 futuresea713/multiprocess-scraping

multiprocess-scraping

23
Experimental
3060 seang1121/OpenClaw-Mortgage-Interest-Rates-Report

Daily mortgage rate reports delivered to Discord — 10 lenders + 2...

23
Experimental
3061 Blaise-Telfer/amazon-web-scraper

Python program that asks for a keyword, scrapes up to 20 Amazon result pages...

23
Experimental
3062 tashapiro/drag-race

Project dedicated to collecting, organizing, and analyzing information about...

23
Experimental
3063 VoxCore84/tor-army

Massively parallel async web scraper through Tor — 230K pages/hr peak, 1.2M...

23
Experimental
3064 BoogieMonsta/butterscout

Open Source Search & Extraction API for LLM Agents

23
Experimental
3065 zaidkx37/shopscout

Scrape any Shopify store - products, collections, pages & metadata from the...

23
Experimental
3066 alwaysstrive2024/SiteScout

SiteScout灵嗅 A Precision Multi-Site Search & LLM-Powered Resource Refinement Agent.

23
Experimental
3067 danielsebesta/vyz-novinky

Python skript pro neustále aktualizovanou sadu otázek o aktuálním dění do...

23
Experimental
3068 denisecase/nlp-05-web-documents

Structured EVTL pipeline for reliable extraction and transformation of data...

23
Experimental
3069 shanvel-katesh/email-verifier-free

Free Open Source Email Verifier Bounce Free

23
Experimental
3070 FromSunNews/twitscraper

Twitter/X API wrapper with no API key required.

23
Experimental
3071 sherinann/easywiki

A web scraping project in python3, a command line interface for wikipedia.

23
Experimental
3072 Traven-B/mymodern

Crystal app lists checked-out and ready-hold books at multiple library...

23
Experimental
3073 Urpagin/doujinstyle-scraper

Ethically scrapes doujinstyle.com

23
Experimental
3074 rexdivakar/llmparser

Turn any website into clean, structured content that language models can...

23
Experimental
3075 AbdirahmanNomad/webclone

Clone any website in seconds. Perfect for learning web development,...

23
Experimental
3076 SonnyTaylor/scrape-daddy

Extract anything from any website. One click. Browser extension for grabbing...

23
Experimental
3077 luminati-io/curl-user-agent

Customize and rotate the User-Agent header in cURL for more effective web...

23
Experimental
3078 gavinx17/HLTV-Scraper

This scrapes data from HLTV.org and returns back top players and team stats...

23
Experimental
3079 protti/ScraperFantacalcio

Tool Fantacalcistico per la valutazione oggettiva dei giocatori acquistati o...

23
Experimental
3080 victorkjung/scrapling-dashboard

This project is a UI wrapper around Scrapling by Karim Shoair (D4Vinci)....

23
Experimental
3081 hrbrmstr/scala-splash

Scala interface to the ScrapingHub Splash API

23
Experimental
3082 johnbumgarner/newshound

This Python package can be used to systematically extract multiple data...

23
Experimental
3083 felixjhoffmann/SustainableTourism

Code and data to produce figures and replicate web-crawling and classifier...

23
Experimental
3084 naisarg53/WebSearchEngine

The assignment is creating a Web search engine that incorporates concepts...

23
Experimental
3085 pandrei7/cptest

A tool for testing competitive programming solutions quickly and easily.

23
Experimental
3086 EPguitars/events-parsing-archive

It's a simple scraper for events which returns parsed info in json through api call

23
Experimental
3087 JulienCorb/Smoothixir

an example on how to do web scraping using Elixir.

23
Experimental
3088 srdanirz/rebelnotify

Repositorio de Rebel Notify. Primer cookgroup de Chile, QEPD.

23
Experimental
3089 carl24tech/xtr-studios-sdk

The Official SDK for XTR Studios

23
Experimental
3090 rusgurik/Projects

Data analysis projects (web scraping, EDA)

23
Experimental
3091 arhcoder/Curso-creando-bots-de-Twitter

🐦 Material from the course taught at the XVI Congress of Basic Sciences of...

23
Experimental
3092 kane-thornwyrd/nexis

Stream enhancer with widgets and data

23
Experimental
3093 AkshatBhat/find-companies-using-ashby-job-boards

Discovery system for finding and verifying companies that use Ashby-hosted...

23
Experimental
3094 cedendahlkim/nordcrawl

LLM-ready batch crawling for Nordic company data

23
Experimental
3095 Infinitode/PyWebScrapr

An open-source Python web scraping tool. Supports both image scraping and...

23
Experimental
3096 judaicalink/rdf_generator

A library to generate rdf files in turtle format for Judaicalink.

23
Experimental
3097 aditya-datahub/quotes-web-scraper

Automated web scraping project to extract quotes, authors, and tags from a...

23
Experimental
3098 Ninso112/RathausRot

RathausRot ist ein Matrix-Bot, der Ratsinformationssysteme automatisch...

23
Experimental
3099 Shannon-Goddard/grow_data

Comprehensive cannabis strain database with 2,793+ strains scraped from...

23
Experimental
3100 only-dpp/web-data-pipeline

Pipeline automatizado que busca notícias de tecnologia, organiza os artigos...

23
Experimental
3101 anidok/News-Feed-Scraper

A small working prototype of centralized newsfeed system.

23
Experimental
3102 akinshchikov/astronomy-olympiad-archive

Astronomy Olympiad Archive: reproducible Python pipeline and metadata index...

23
Experimental
3103 Al0ne-collab/bypass-host-request.github.io

site requests, web scraping etc. Bypass cookies for sites that do not allow...

23
Experimental
3104 zaidkx37/wpscrape

Scrape any WordPress/WooCommerce store - products, categories & metadata...

23
Experimental
3105 fuadaghazada/Que-Base-SDP

Senior Design Project

23
Experimental
3106 h0lg/FOMOcal

Discover, sync and share event listings from your favorite local venues.

23
Experimental
3107 ToKu404/pethouse

Capstone Project SIB Batch 2

23
Experimental
3108 jinalp60/WebSearchEngine

A web-search-engine developed harnessing Java with features such as...

23
Experimental
3109 digoIS/RADLattes

Web Scraping para extração de dados das páginas do currículo Lattes para...

23
Experimental
3110 QuartzUnit/snapgrab

URL to screenshot with metadata. Python MCP server. Claude Vision optimized.

23
Experimental
3111 PeterDulworth/company-insights-webapp

written for nesh. utility to pull in insights about different stocks. using...

23
Experimental
3112 gustavoSoriano/Web-Crawler-Nodejs

Constução de um Web Crawler em nodejs para pesquisas no google

23
Experimental
3113 gladchinda/scotch-scraping-node

Simple app for scraping author profiles and tutorials from Scotch.io -...

23
Experimental
3114 iosifache/AIMB

Website for analysing real estates from Bucharest, created as a project for...

23
Experimental
3115 gastonbecerra/ojsr

R package to crawl and scrape OJS (open journal system)

23
Experimental
3116 kabelsea/go-scrapy

Web crawling and scraping framework for Golang

23
Experimental
3117 Tinatojo/spotiso

Spotify musics downloader

23
Experimental
3118 freelinerd/animex

A sleek, high-performance anime streaming app built with Flutter.

23
Experimental
3119 Turbo31150/ai-freelance-automation

AI Freelance Automation — Codeur.com scanner, auto-proposals, LinkedIn...

23
Experimental
3120 lombardo-luca/LePrAn

Letterboxd Profile Analyzer (LePrAn) is a simple tool to see statistics...

23
Experimental
3121 QuartzUnit/diffgrab

Web page change tracking + structured diffs — markgrab + snapgrab...

23
Experimental
3122 sachelsout/scraping-google-maps-reviews

This repository shows how to scrape Google Maps' places reviews data using...

23
Experimental
3123 kadiryaren/-TorChangeIP

Tor IP Changer for Linux and MacOS!

23
Experimental
3124 Ismailhachimi/Image-Scraper

A Simple Google/Instagram Images Scraper.

23
Experimental
3125 mosiahr/free_proxy

Scraping the free proxy list and use sqlalchemy to save it to the database.

23
Experimental
3126 estnafinema0/Github-Trends-Aggregator

A real-time GitHub trends aggregator that collects and visualizes popular...

23
Experimental
3127 Zakaria-laktati/crash-1xbet-monitoring

🎰 Real-time monitoring system for 1xBet Crash game with WebSocket scraping,...

23
Experimental
3128 mrkoubek/Marathon-results-analysis

Prague Marathon results scraped from the official website RunCzech.com from...

23
Experimental
3129 MadgicDev/python-ninja-linking

Scrap websites that allow posting free do-follow backlinks using Scrapy

23
Experimental
3130 oxylabs/how-to-make-web-scraping-faster

How to Make Web Scraping Faster - Python Tutorial

23
Experimental
3131 Yuree000/hot-repo-radar

Snapshot GitHub Trending daily/weekly/monthly, diff rank changes, and...

23
Experimental
3132 juanmerino89/data-job-market-analysis-project

Análisis completo del mercado laboral a través de datos abiertos, scraping y...

23
Experimental
3133 nishchal-kansara/telegram_movie_download_bot

This project demonstrates how to integrate web scraping, Telegram Bot API,...

23
Experimental
3134 TomOstt/JobIntel

AI-powered job market intelligence. Multi-source scraping, Claude AI...

23
Experimental
3135 yashmanne/NBA_player_performance

Exploration of NBA Player Performance & Salary

23
Experimental
3136 umbertocollodel/Text_mining_IMF

Create a new term-frequency database from scraped IMF documents and study...

23
Experimental
3137 LuiFeAn/netflix-web-api

API web para mineração de dados de filmes e séries disponíveis na plataforma Netflix

23
Experimental
3138 alaminedione/web-link-scraper

An ultra-fast web link scraping tool developed in Go, allowing recursive...

23
Experimental
3139 proxyport/ts-proxyport

Node.js Proxy Port

23
Experimental
3140 KrunalValvi/Fastapi-Dev-Tools

🛠️ FastAPI utility suite with 6 developer tools - QR codes, markdown, regex...

23
Experimental
3141 Edioff/oreillyauto-scraper

Browserless scraper for O'Reilly Auto Parts — Bypasses Akamai Bot Manager v2...

23
Experimental
3142 im-dpaul/Wikipedia-Scraper

Scrape Wikipedia data based on user-input topic using Python. Extracts...

23
Experimental
3143 toolen/covid-leningrad-region

A project for collecting and displaying the dynamics of COVID incidence in...

23
Experimental
3144 armsp/covid-vaccine-tracker

Dataset of the use and authorization of covid vaccines.

23
Experimental
3145 vyap2000/Data-Science-Projects-General-Assembly

Repository for my projects in General Assembly - Data Science Immersive

23
Experimental
3146 mrtoronto/Erooms_law

Eroom's Law

23
Experimental
3147 renanstn/olx-scrap-de-produtos

[DEPRECADO] Bot Telegram feito para facilitar a vida de quem busca...

23
Experimental
3148 Seyedhosseinzadeh/WS_TM

Weather web scraping and Time series model to predict temperature, humidity...

23
Experimental
3149 ahmadsalamifar/OmniCrawler

An advanced, auto-pilot web scraping framework for building clean text...

23
Experimental
3150 amartya-dev/music-recommender

A music recommendation system

23
Experimental
3151 MadgicDev/openclassrooms-pdf

Scrape OpenClassrooms courses to PDF

23
Experimental
3152 Maheidem/zero-cost-ai-scraper

🚀 Complete self-hosted AI web scraping stack with ZERO external API costs!...

23
Experimental
3153 aissa-laribi/bs4-in-lambda

Use Beautiful Soup in AWS Lambda with Python Runtimes

23
Experimental
3154 TonioBay/Precios_canasta_basica_cdmx

Funciones para extraer datos de la canasta básica de un PDF de gobierno.

23
Experimental
3155 incubated-geek-cc/WebScraper

A Node.js express server setup to create a web scraping api where web...

23
Experimental
3156 luminati-io/web-scraping-with-regex

Scrape websites in Python using regex, parse HTML effectively, and handle...

23
Experimental
3157 AAA0109/Amazon-KDP-Royalty

Chrome Extension which fetches Amazon KDP Royalties Report

23
Experimental
3158 gorlovka/proxyrequest

Bypass cloudflare protection, scrape website, proxy for parsing websites

23
Experimental
3159 trungkak/ez-crawl

A auto crawler for deep listing websites lke StackOverflow, Amazon,...

23
Experimental
3160 octobug1/webscrape-tutorial

A basic tutorial to web scraping using python for beginners

23
Experimental
3161 akashgiricse/ScriptsUsingPython

Simple scripts using python3 🐍. Reference for these scripts is the awesome...

23
Experimental
3162 LeoArtaza/Scraper-Argenprop

Scraping de Argenprop periódico, usando Beautiful Soup en Python, y...

23
Experimental
3163 yuyatinnefeld/prometheus

📕 Learning Guide 📕 | Prometheus and PCA (Prometheus Certified Associate)

23
Experimental
3164 adithya-ananth/Covid-Cases

Find the number of active Covid 19 cases in your country

23
Experimental
3165 memb3r/ontotool

Simple, but useful OSINT tool with elements of web-scraping

23
Experimental
3166 yauyao/yauLineBot

linebot 含網路爬蟲功能

23
Experimental
3167 clementjuventin/Redbubble-automatisation-bot

Upload automatisation for RedBubble

23
Experimental
3168 rokon12/webcrawler

A simple java implementation of a web crawler.

23
Experimental
3169 DWoyda/dinsey-movie-web-scraper

Disney movie web scraper with OMDb API enrichment

23
Experimental
3170 musama318/Covid19-Grouped-bar-graph

Grouped Bar Graph of Covid-19 cases

23
Experimental
3171 omerahat/E-Commerce-Websites-Scrapper

Python script allows you to extract data from e-commerce websites by...

23
Experimental
3172 tfkhdyt/kbbi-bot

Bot KBBI yang menggunakan metode web scraping

23
Experimental
3173 smenendez19/scraper_meli

Programa que realiza scraping de páginas web de búsquedas de Mercado Libre y...

23
Experimental
3174 Sakthe-Balan/DiscoveryDino

Discovery Dino is a powerful tool designed to simplify the process of...

23
Experimental
3175 nvalis/MappingYoutube

Generate a visual map of youtube by using channel relations.

23
Experimental
3176 eddmann/bincal

Subscribe to UK council bin collections in your calendar. Scrapes council...

23
Experimental
3177 Ethical-Hack-King/Amazon-Scraper

Scrap images from Amazon using PHP cURL

23
Experimental
3178 sanketmaneDS/Text_Mining

This repository contains introductory notebooks for text mining and web scrapping.

23
Experimental
3179 davydmaker/liga-price-extension

Extensão Chrome para buscar preços de cartas em todas as lojas da Liga...

23
Experimental
3180 gurjeet29/Email-scrapper

An Email scrapper to extract all the emails from the given website and store...

23
Experimental
3181 tommanzur/scraper_boletin_oficial

Este proyecto utiliza Python y BeautifulSoup para realizar web scraping en...

23
Experimental
3182 shahriar-rahman/Scraping-Quotes-using-Beautiful-Soup

A simple, clean script for scraping and storing web-scraping data for...

23
Experimental
3183 mathealgou/autovideo

Programatic content generation with Python.

23
Experimental
3184 rshriharripriya/School_Recommendation_System

Applied clustering algorithms to a dataset of 250 Phoenix area schools, to...

23
Experimental
3185 TusharNair04/stock-price-api

🚀 Stock Price API with AI-powered scraping - FastAPI REST endpoints for...

23
Experimental
3186 denisecase/nlp-06-nlp-pipeline

Structured EVTAL pipeline for extracting, cleaning, and analyzing HTML web...

23
Experimental
3187 luminati-io/llama-3-web-scraping

Use LLaMA 3 and Python to extract structured data from websites like Amazon,...

23
Experimental
3188 kuuhaku86/data-scraping-tokopedia

Repository for web scraping article at Medium

23
Experimental
3189 DachuanZhang-FutureFood/IFoodCloud

Analysis of public opinion on food safety in Greater China with big data and...

23
Experimental
3190 sakti2k6/Cars2Go

Python/Flask based web application showing used car information. Employs a...

23
Experimental
3191 suaviloquence/scrapelect

Declarative web scraping DSL with CSS-inspired syntax

23
Experimental
3192 marouenes/imdb-rating-classifier

Application that scrapes data from IMDB and adjusts ratings based on some rules.

22
Experimental
3193 jbetgevergiz/dealhawk

Self-hosted price monitoring and Telegram alert tool. Track any product on...

22
Experimental
3194 imfdlh/h8dsft_ngc_p0

Contains nongraded challenge during FTDS Batch 001-Phase 0 at Hacktiv8

22
Experimental
3195 SagarPaul007/movie-downloader

download movies with one command

22
Experimental
3196 Nasdneb/company_ai_music

Automated AI-powered system for generating custom company songs. Combines...

22
Experimental
3197 AbreuHD/KuhakuAPI

KuhakuAPI is a web scraping-based API designed to provide users with access...

22
Experimental
3198 javizuurc/NewsHub

NewsHub es el proyecto del módulo de proyecto para el ciclo de Desarrollo de...

22
Experimental
3199 0xAkanee/otaku-scraper

Belajar Web Scraping Menggunakan Python

22
Experimental
3200 nateify/article-to-md

Convert an article or web page to Markdown

22
Experimental
3201 adrianogil/datamining-playground

Datamining playground

22
Experimental
3202 muhannadX7/reddit-scraper-lite

📊 Extract Reddit posts, comments, and user data quickly and easily without...

22
Experimental
3203 alex-benoit/github-languages

Tiny little ruby on rails website that crawls though your public github...

22
Experimental
3204 Zeshanabdullah/unlimited-national-geographic-image-and-photo-downloader

Download unlimited, high-quality National Geographic images and photos for...

22
Experimental
3205 comsavvy/Punch-scraping-engine

Scraping the top Punch news

22
Experimental
3206 BriLeighk/Tech-Catalyst

Track A, Headstarter Fellowship - The Tech Catalyst, aiming to empower CS...

22
Experimental
3207 Makhuta/homeassistant-honeygain_scrapper

Scrapper for HoneyGain

22
Experimental
3208 hansputera/nekopoi-scrape

Scraping nekopoi menggunakan bahasa Python

22
Experimental
3209 CH-RAFAY/British-Airways-Internship

British Airways internship, focusing on leveraging data to enhance...

22
Experimental
3210 marinakiseleva/wiki-scraper

This web crawler uses Scrapy py to crawl Wikipedia. It prints the page...

22
Experimental
3211 leroyanders/acrticle-scrapper

This Python-based repository hosts a sophisticated service designed for...

22
Experimental
3212 JohnnyBannanis/howlongtobeat-py-api

REST Python Flask API using howlongtobeatpy library plus aditional scraping

22
Experimental
3213 vishalzanzrukia/java-web-crawler

This is open source web crawler example based on Java technologies

22
Experimental
3214 bing0o/SpFire

web crawler & spider using python | this script is stupid, gonna try to...

22
Experimental
3215 zavbala/trendin.dev

Get your daily trends.

22
Experimental
3216 Duff89/yandex_music_parser

Парсер чарта (топ-100) лучших песен из сайта ЯндексМузыка

22
Experimental
3217 barrettotte/Manga-Downloader

Simple manga downloader for mangareader.net using BeautifulSoup4 and...

22
Experimental
3218 fzachariah/Gluster-Dashboard

Created a dashboard for the analytics of Redhat’s open source community...

22
Experimental
3219 vini7148/vsit_hack

hackvsit submition

22
Experimental
3220 gkao123/Hotel-Web-Scraper

Web scraper for hotels.com, expedia.com

22
Experimental
3221 odynvolk/web-snake

A simple web crawler in Python that crawls and returns the urls.

22
Experimental
3222 arynas/sinta-scrap

Script untuk mengambil data publikasi dari Sinta

22
Experimental
3223 CascadingLabs/VoidCrawl

Stealth CDP Driver with Rust Core && Python Bindings

22
Experimental
3224 digvijaytaunk/TubeScraper

Flask based YouTube scraper application. Downloads latest videos from the...

22
Experimental
3225 Xquik-dev/x-twitter-scraper-typescript

Official TypeScript/Node.js SDK for the X Twitter Scraper API — tweet...

22
Experimental
3226 HilmiAlawi/IG-Comment-Extractor

Extract comments from Instagram posts (Reels, Feed) and merge them into a...

22
Experimental
3227 Marco90v/ScrapingDolarBs

Scraping Web del precio del dolar en bolívares, script para usar en polybar,...

22
Experimental
3228 shahpari2kht/python-learning-path

Structured Python learning exercises and projects for beginners to advanced levels.

22
Experimental
3229 cs-fedy/musixmatch-database

I'm scraping songs lyrics from musixmatch, and I want to store them in a...

22
Experimental
3230 MattJeanLouis/scrap_web

C'est un projet de web scraping qui utilise Streamlit, BeautifulSoup, et...

22
Experimental
3231 soneryavuz-dev/finviz-quant-scorer

A high-performance Python tool that scrapes Finviz & Yahoo Finance data to...

22
Experimental
3232 vonj/scraping

Real life example of news site scraper. Download articles matching key ...

22
Experimental
3233 RapierCraft/AlterLab-SDK

Official Python & Node.js SDKs for AlterLab Web Scraping API. Bypass...

22
Experimental
3234 Kitecatik/scraping-quotes.toscrape.com

In this project, I demonstrated the skills of parsing static website. Also...

22
Experimental
3235 lucasdotvin/imd-bolsas-bot

Bot de alimentação do IMD Bolsas no Telegram e Twittter. Seu objetivo é...

22
Experimental
3236 ikibir/Pytagram

Instagram Full Profile Scraper is an app for download all the post in a profile

22
Experimental
3237 gaesa/senluo-scraper

A specialized web image scraper designed for educational purposes.

22
Experimental
3238 nhoxbypass/py-web-crawler

A simple web crawler made by Python 3.6.0, no more framework needed

22
Experimental
3239 rezkyfm/SEUS-SCRIPT

SEUS SCRIPT (Simple yEt USeful SCRIPTS)

22
Experimental
3240 ProxyHatCom/python-sdk

The official Python SDK for the ProxyHat residential proxy API. Sync & async...

22
Experimental
3241 logeshkannan19/DropShipping-AI-Agent

AI-powered Dropshipping Agent that automates product research, competitor...

22
Experimental
3242 hacksumn/skiptracer

OSINT passive recon scraping framework — Python 3, modernized and actively maintained

22
Experimental
3243 crawlbase/proxycrawl-ruby

ProxyCrawl API ruby gem for scraping and crawling

22
Experimental
3244 outages/shaw-outages

Track Shaw Outages via Git history

22
Experimental
3245 Decodo/Scrapy

Scrapy proxy authentication example for Decodo

22
Experimental
3246 Tyler-Edwards-E/Chess.com-Project

Chess.com web scraper, data analysis, and database examples

22
Experimental
3247 A3onn/mapptth

A simple to use multi-threaded web-crawler written in C with libcURL and Lexbor.

22
Experimental
3248 RafaelKarcz/CryptoAPI

A Python project to collect and visualize cryptocurrency data using the...

22
Experimental
3249 bitmakerla/estela-queue-adapter

Queue adapter for estela 🕸️

22
Experimental
3250 mehdi149/browse-anything-quickstart

🤖 Ready-to-run Python examples for Browse Anything API. Automate web...

22
Experimental
3251 dueyfinster/lambda-scraper

An AWS Lambda function to scrape a website and send information gleamed to slack

22
Experimental
3252 Bogzx/AutoFtmoCalendar

A Python script that automatically scrapes FTMO trading updates and adds ...

22
Experimental
3253 sinanazem/web-crawling-numbeo

This project involves scraping cost of living data from the Numbeo website,...

22
Experimental
3254 Zeshanabdullah/unlimited-fine-art-america-image-and-photo-downloader

Download unlimited Fine Art America images and photos effortlessly with our...

22
Experimental
3255 boreec/github-repo-downloader

Downloads all the public repositories of GitHub users and organizations...

22
Experimental
3256 Zeshanabdullah/unlimited-envira-gallery-image-and-photo-downloader

Download unlimited images and photos from Envira Gallery for free, with no...

22
Experimental
3257 rohitthapliyal2000/Amazon-Mobile-Sentiment-Analysis

Opinion mining of Mobile reviews on Amazon platform

22
Experimental
3258 N-LMH/python-automation-toolkit

一键解决日常重复工作 - 让 Python 为你打工!实用的 Python 自动化工具集,包含文件处理、Excel 处理、网页自动化、图片处理等功能。

22
Experimental
3259 briancohan/lecture-webscraping

Repository for PyRVA Web Scraping Lecture Feb 12, 2020

22
Experimental
3260 vanquan805/woocommerce-scraper

The best scraping solution for WooCommerce

22
Experimental
3261 techwiththisguy/twt-site-audit

CLI-based SEO & site quality audit tool for developers and consultants....

22
Experimental
3262 Asbuga/usedcars_scraper

A Scrapy-based web crawler designed to extract vehicle specifications from...

22
Experimental
3263 cosmoduende/r-analisis-exploratorio-tv-series-imdb

Análisis y visualización de Datos con R de algunas de las tv series más...

22
Experimental
3264 dome317/job-search-pipeline

Autonomous job search pipeline: multi-platform scraping, AI scoring,...

22
Experimental
3265 Alanxyz/HorariosFeos

Generador de jornadas laborales unu

22
Experimental
3266 Subrata-Rudra/github_scrapper_API

This is a simple flask api for getting someone's GitHub profile details such...

22
Experimental
3267 HOAIVU8924/kickstarter-python-campaign-text-scraper

📊 Scrape detailed text from Kickstarter campaigns with this Python tool,...

22
Experimental
3268 sarkhanj/Web-Scraping-Letterboxd

A Scrapy app which produces a JSON file of your Letterboxd diary with all...

22
Experimental
3269 ujeebu/ujeebu-node

Ujeebu's Node.js SDK

22
Experimental
3270 Te130246/respectaso

Enable private, self-hosted ASO keyword research for iOS apps with no API...

22
Experimental
3271 StrategFirst/BingWall

Scrap and save the bing wallpaper of the day for every nation

22
Experimental
3272 AnthonyRAFFY/scrappey_proxy

Drop-in replacement for FlareSolverr using Scrappey.com to bypass Cloudflare...

22
Experimental
3273 sinouw/ai-opportunity-intelligence

Agentic lead-research assistant — LLM-powered strategy, tool-using discovery...

22
Experimental
3274 Silvestre17/ATPPlayersAnalysis.Sweden_AppliedProject.inDataScience_I

🎾 Applied Data Science project analyzing ATP tennis data for matches in...

22
Experimental
3275 stankly-movida/pydoll-capsolver

使用 Pydoll (基于 CDP) 和 CapSolver 实现隐形网络自动化。通过拟人化交互和 AI 驱动的验证码解决方案,绕过...

22
Experimental
3276 elgels/Stock-Data-Extraction-APIs-Web-Scraping

Collected and analyzed financial data using APIs and web scraping, with data...

22
Experimental
3277 Hongtao-Lin/Car-Info

Extract, analyze & visualize users' comments on cars

22
Experimental
3278 theaifutureguy/Ecommerce-Scraping-API

A powerful tool that enables developers to extract comprehensive product...

22
Experimental
3279 ggteixeira/corpus-cleaner

Linguistic tool (made by a linguist, for linguists) that scraps corpora,...

22
Experimental
3280 sultaniman/dust

Archive web pages with all relevant assets or save as a single file HTML

22
Experimental
3281 clayy-esc/Web-Crawling-and-Scraping-with-Scrapy__Job-Data-Extraction-from-OnlineJobsPH

Web Crawling & Scraping with Scrapy: Job Data Extraction from OnlineJobsPH

22
Experimental
3282 Bia104/CeurDataAnalytics

Project for the Technology for Big Data Management course for my Master's...

22
Experimental
3283 jibson1536/Eco-commerce-recommender

A hybrid recommendation system using NLP (Zero-Shot Classification) to rank...

22
Experimental
3284 bormaxi8080/linkedin2md

This repository illustrates a scheme for building a simple resume/profile...

22
Experimental
3285 mdbytes/BargainBuyClub

A full-stack web application utilizing Java Spring Data REST and React...

22
Experimental
3286 FluidInference/mlx-mdx

Website, pdfs, images, documents to Markdown. Powered by MLX models....

22
Experimental
3287 brooks-code/bookmark-harvester

Bookmark content extractor: fast, concurrent Go tool to parse bookmarks,...

22
Experimental
3288 wf34/geniusbooklet

Convert Genius.com lyrics & annotations to printable PDFs

22
Experimental
3289 TerranKartikTellus/Web-Scraping

All about scraping domains from the 'World Wide Web'

22
Experimental
3290 anujkap/VIT_Hack

Challenges for VIT Hack

22
Experimental
3291 citronalco/website2ics

Perl scripts to scrape event information from several web sites and outout...

22
Experimental
3292 TSiustis/HistoryNET

Application to scrape data from Wikipedia about important events on all days...

22
Experimental
3293 justalever/supstacker_demo

Supplement sharing app

22
Experimental
3294 aleksa-radojicic/second_hand_car_price_prediction

Second-Hand Car Prices Prediction using Machine Learning Algorithms in...

22
Experimental
3295 Vitry543/python-for-data-science-and-machine-learning-essential-training-part-1

This is the repository for the LinkedIn Learning course Python for Data...

22
Experimental
3296 Zeshanabdullah/unlimited-google-sheet-image-downloder

Download unlimited images from Google Sheets effortlessly, without...

22
Experimental
3297 Valdes10U/early-talent-identification-football

Football scouting analytics project using FIFA attributes and Transfermarkt...

22
Experimental
3298 outhsics/ai-seo-mass-engine

AI-driven SEO site matrix system for automated content generation and...

22
Experimental
3299 faizancodes/Job-Listing-Scraper

Speed up your job application process with python! Gain access to hundreds...

22
Experimental
3300 Atrolide/MotoScraper

MotoScraper is a powerful Discord chat bot designed to scrape data from car...

22
Experimental
3301 ahnafnafee/doi-paper-scraper

Scrape academic papers by DOI and convert to Markdown with images. Supports...

22
Experimental
3302 Vipul1705/amazon-price-tracker-using-web-scraping

This Django Project help you to track the prices of your favourite amazon product.

22
Experimental
3303 mapmeld/scraping-by-in-nodejs

Tutorial for jQuery users to learn NodeJS by writing a scraper module

22
Experimental
3304 bissim/adbis

Academic project for data integration course held by Prof. G. Costagliola

22
Experimental
3305 Zeshanabdullah/unlimited-pixieset-image-and-photo-downloader

Download unlimited images and photos from Pixieset for free, with no...

22
Experimental
3306 muhrizqiardi/tokped_scraper

Script sederhana untuk mengambil/meng-scrape nama-nama barang beserta harga...

22
Experimental
3307 sakmus/SeoSoftware

This short program will help you to analyze your web page. Currently, this...

22
Experimental
3308 divided099/MovieOkeAI

Revival project for MovieBot.

22
Experimental
3309 Veutexus/scraper-webUI

A very simple Python web scraper with web UI.

22
Experimental
3310 Ramcharan747/careerscout

Open-source engine that maps every company's hiring infrastructure....

22
Experimental
3311 fantasy-toolz/batting-order

MLB batting order logs and analysis.

22
Experimental
3312 JSLEEKR/scrapling-go

Adaptive web scraping with smart element tracking — Go reimplementation of Scrapling

22
Experimental
3313 nusretzinkli/AiNewsPulse

AI-Powered News Intelligence Platform built with .NET 9, N-Layer...

22
Experimental
3314 EDV4023/Expert-Export

This website attempts to solve the uneven development of wealthy and poor...

22
Experimental
3315 gummo0091/amazon-scraper-python-2022

A command-line Python program for scraping products from Amazon.

22
Experimental
3316 spireuz/php-laravel-packages

Collection of packages to use in projects

22
Experimental
3317 mohammad-mghn/dev-tab

WEB TAB makes it easy for you to stay up-to-date with the latest developer...

22
Experimental
3318 DataOtto/scrapebit-sdk

Official Node.js SDK for Scrapebit - AI-powered web scraping API

22
Experimental
3319 kamaldalakoti/LinkedIn-Connections-Emails-List-

LinkedIn-Connections-Emails-List Scraper

22
Experimental
3320 Aayush-1525/bookmark-analyzer

🔍 Analyze unstructured bookmark titles and descriptions into structured tags...

22
Experimental
3321 imYashChaudhary2/upes-class-auto-joiner

Chrome extension to auto-join UPES iCampus online classes on Microsoft Teams.

22
Experimental
3322 Citedy/skills

Curated collection of Claude Code skills by Citedy — AI-powered SEO content...

22
Experimental
3323 dhsosa98/ts-binance-p2p-scraper

This is a simple binance p2p scraper project that send notifications by email

22
Experimental
3324 rrrr022/universal-crawler-template

Production-proven async web crawler with 1+ TB scale. Bring your own...

22
Experimental
3325 Cr1ator/shikimory_activity

🔔 Telegram bot for tracking Shikimori.one activity - anime watch history,...

22
Experimental
3326 freelancerwebro/web-scraping-instant

Playing with basics of Web Scraping in PHP.

22
Experimental
3327 uts58/DSE-Scraper

Python scraper optimized to fetch DSE data using just 6.5 MB of RAM,...

22
Experimental
3328 malialtunsoy/CrosswordSolver

Solves The New York Times 5x5 Mini Crossword Puzzle with the help of...

22
Experimental
3329 gkoniaris/spb-unofficial-wrapper

Unofficial NodeJS wrapper for the ScrapingBee API

22
Experimental
3330 solzange/reddit-signal

Your own AI-curated Reddit feed for any topic. Self-hosted on Cloudflare +...

22
Experimental
3331 Sid-149/Python-for-Everybody-Specialization-Coursera

This repository contains the materials & solutions to "Python for...

22
Experimental
3332 gusttx/sophie-bot

A multi-purpose Discord bot written in Rust

22
Experimental
3333 jonscheiding/mueller-report-ebook

Reflowable e-book version of the 2019 Special Counsel investigation report

22
Experimental
3334 reginanka/AI-Universal-Summarizer

High-speed Telegram bot powered by FastAPI & Cerebras AI. Instantly...

22
Experimental
3335 probeo-io/anyserp

Unified SERP API router. 11 providers — Serper, SerpAPI, Google CSE, Bing,...

22
Experimental
3336 ProxyHatCom/node-sdk

The official Node.js/TypeScript SDK for the ProxyHat residential proxy API....

22
Experimental
3337 DobroslavRadosavljevic/ogie

Lightweight, production-ready OpenGraph and metadata extraction for Node.js

22
Experimental
3338 NacreousDawn596/schoolapp.js

A JavaScript library designed to make interacting with the SchoolApp...

22
Experimental
3339 jigargor/gentle-stream

AI-powered good news feed with a broadsheet newspaper UI. Three-agent LLM...

22
Experimental
3340 GeraldYa/Media-Hub-Pro

A comprehensive media asset manager built with Python & SQLite. Features...

22
Experimental
3341 helmitae/newscrux

Aggregates AI news, filters by relevance, and sends structured multilingual...

22
Experimental
3342 kpg-anon/4chmg2

🍀Multi-imageboard media aggregator

22
Experimental
3343 Kirtannjoshi/images-search

A clean and simple image search engine built with HTML, CSS, and JavaScript....

22
Experimental
3344 nickdcox/nlp-sentiment-coronavirus

Project: Have Reviews of Yankee Candle Products Been Impacted by the...

22
Experimental
3345 NEPENTHESWEB/nepenthes-py

The first anti-AI tarpit. Rewritten in Python. Traps LLM crawlers in an...

22
Experimental
3346 akshaysharmajs/Fake-News-Detection

A machine learning model to detect whether a news article is fake or real using NLP.

22
Experimental
3347 ChanMeng666/douban-elite-scraper

【Stars are like virtual high-fives - come on, don't leave us hanging!⭐️】A...

22
Experimental
3348 8chanAnon/Kraker-Local-Proxy-Server

A local proxy server based on Node.js for use with desktop web browsers....

22
Experimental
3349 capt-marbles/firecrawl

Web scraping and crawling with Firecrawl API - markdown conversion,...

22
Experimental
3350 ujeebu/ujeebu-python

A Python library to interact with Ujeebu APIs

22
Experimental
3351 goofygary/yc-startup-scraper

🚀 Scrape Y Combinator's startup directory easily with this Python tool,...

22
Experimental
3352 Xquik-dev/x-twitter-scraper-cli

Official CLI for the X Twitter Scraper API — tweet search, user lookup,...

22
Experimental
3353 czuameni/velos-web-scraper

Python desktop tool for extracting business listings from Google Maps,...

22
Experimental
3354 AnnaOG/zh_scraper

Python function that scrapes Av and standard deviation values from the...

22
Experimental
3355 jacobwgillespie/halfstaff

:us: Is the US flag at half-staff?

22
Experimental
3356 the-red-shield/vsco-scraper

Download all images from public VSCO profiles. Handles infinite scroll,...

22
Experimental
3357 vishakha-b18/Text-Analysis-and-Web-Scraping

Applications of NLP like Topic Modeling, Sentiment Analysis, Word Cloud...

22
Experimental
3358 LuciferForge/python-web-scraper

Web scraper with zero dependencies — CSS selectors, JSON/CSV output, crawl...

22
Experimental
3359 krober/bapcs-stock-checker

Reddit price and stock checker bot - replies with useful info, and saves...

22
Experimental
3360 sunil-dhaka/amazon-cli

Amazon.in in your terminal -- search products, compare prices, view details,...

22
Experimental
3361 ctkqiang/LianJiaScraper

这是一个基于Spring...

22
Experimental
3362 umerkhan95/shopextract

Extract, compare, and monitor product data from any e-commerce store....

22
Experimental
3363 a-sinkevich/book2anki

AI-powered flashcard generator — convert books (EPUB/PDF), web articles, and...

22
Experimental
3364 juanluisrto/SvenskaScraper

A script to quickly scrap translations from swedish dictionaries (Lexin and SAOL)

22
Experimental
3365 syedissambukhari/Alibaba-scrapper-using-NodeJs

A react web application for Alibaba product scrapping

22
Experimental
3366 sipe90/lunch-scraper-ui

Lunch scraper UI

22
Experimental
3367 DalyaLami/Mars_News_Scraping

Web-scrape and data analyse using both automated browsing with Splinter and...

22
Experimental
3368 BNNagaraj/blazecrawl

🔥 The Web Scraping API That Doesn't Rip You Off — Turn any website into...

22
Experimental
3369 bryanlusse/HousePrices__Webscraper

Web scraper that creates a dataset of house data from www.funda.nl

22
Experimental
3370 afspies/homehunt

🏡 Intelligent property search CLI with hybrid scraping across Rightmove &...

22
Experimental
3371 rvaughan/weather-data

Weather data for Cardiff.

22
Experimental
3372 abishek-dev-max/Web-Crawler

This repository contains a web crawler implemented in Node.js with Jest as...

22
Experimental
3373 matthewfortier/DAT-210-Baseball-Project

Data Science project attempting to predict current baseball players future...

22
Experimental
3374 probeo-io/anyserp-py

Unified SERP API router for Python. 11 providers — Serper, SerpAPI, Google...

22
Experimental
3375 F-Depi/database-atletica-italiana

Tutti i risultati dell'Atletica Italiana dal 2005 ad oggi

22
Experimental
3376 Z786ZA/facebook-posts-scraper

extract facebook posts data efficiently

22
Experimental
3377 simonplmak-cloud/hkex-filing-scraper

Scrape and ingest HKEx (Hong Kong Stock Exchange) regulatory filings into...

22
Experimental
3378 samuelklam/web-scraper

Web scraping with Cheerio + Request and Phantom + Casper

22
Experimental
3379 deathbycaptcha/deathbycaptcha-api-client-go

deathbycaptcha Go api client

22
Experimental
3380 aakashH242/otel-api-scraper

A config-driven service that scrapes SaaS and internal HTTP APIs and turns...

22
Experimental
3381 vikaspattathe/Web-Scraping-Flipkart

Web scraping an online shopping site in India (Flipkart) using BeautifulSoup...

22
Experimental
3382 andausman/google_maps_places_scraper

A fast Google Maps scraper that works for ANY location worldwide

22
Experimental
3383 deuxksy/zzizily-gluttony-go

예약 자동화 도구 (go-rod 기반)

22
Experimental
3384 dgp336/onepiece-card-manager

🃏 Full-stack web application to manage and explore One Piece TCG cards.Built...

22
Experimental
3385 kyng-cytro/Screen-Time-Bot

Telegram bot to get Movies and TV-Shows updates

22
Experimental
3386 rafainsights/Seascraper

A simple and efficient HTML scraper built in Rust, designed for easy...

22
Experimental
3387 Sampad-Hegde/PublicTvKannadaLive

python program that make web scraping https://publictv.in/live and play the...

22
Experimental
3388 outages/slack-outages

Slack Outages

22
Experimental
3389 Deadpool2000/wpinfo

WPInfo is a lightweight Python library that extracts publicly available...

22
Experimental
3390 adamlevoy/stylesync-cli

Extract design systems and UI kits from live websites using AI

22
Experimental
3391 Xquik-dev/terraform-provider-x-twitter-scraper

Official Terraform provider for the X Twitter Scraper API — manage X data...

22
Experimental
3392 stankly-movida/agno-capsolver

基于 Agno 与 CapSolver 的自主多智能体验证码自动化解决方案。隐私优先、高性能的 AI 智能体,助力无缝网页自动化。

22
Experimental
3393 prokulski/sejm_viii_kadencji

Pobieranie danych o indywidualnych wynikach głosowania w Sejmie VIII...

22
Experimental
3394 Jigisha-p/Automated-Financial-News-Scraping-and-Structured-Data-Conversion

This project automates the extraction of unstructured financial news from...

22
Experimental
3395 fikriaf/Fetch-MCP-Server

A Model Context Protocol server that provides web content fetching capabilities

22
Experimental
3396 dahlinomine/prediction-backfill-py

Tool to download and clean historical data from major markets

22
Experimental
3397 sunyam/NewsClassifier

Classify news articles

22
Experimental
3398 MukundaKatta/triton

Triton — Competitor Monitor. Real-time competitor price and content monitoring

22
Experimental
3399 headsrooms/scrape-your-music

Scraping rateyourmusic.com

22
Experimental
3400 Clarisse78/RinaCommuBot

A Discord bot that tracks Rinaorc staff changes, updates a message...

22
Experimental
3401 shreya1m/JustWatch-Web-Scrapping-

This project extracts movie and TV show data from JustWatch using Python,...

22
Experimental
3402 elanatee/quotifai

web app that uses image recognition + web scraping to find quotes relevant...

22
Experimental
3403 the-vishal/DLL-Client

DLL files downloader client

22
Experimental
3404 josfranmc/JGutenbergDownload

This software allows you to download books from the Gutenberg project repositories.

22
Experimental
3405 peterrichards-lr/lcp-svc-update

Liferay Services Updater - Automated CLI tool to update Liferay Cloud...

22
Experimental
3406 jorislimonier/judo-score

Deciding on score from judo fight videos.

22
Experimental
3407 ISTE-VESIT-ORG/Machinera-2020

This is an AI Series where we will cover Machine Learning and Deep Learning...

22
Experimental
3408 DT-Foss/crawlflare

Don't block scrapers. Poison their data.

22
Experimental
3409 juliensalinas/go_concurrent_scraping

Basic concurrent web scraper in Go

22
Experimental
3410 yalonw/Summarization

a team project about text summarization

22
Experimental
3411 johnazedo/financial-scraper

Get data of stocks and funds that compose the Brazilian stock market.

22
Experimental
3412 iluxonchik/webscraping-with-python-book

Web Scraping With Python book code

22
Experimental
3413 Runnin-N-Gunnin/GeckoFXInterceptRequestCaptureResponse

[GeckoFX/Firefox]: Shows how to Intercept request(s), capture response(s),...

22
Experimental
3414 AlphafromZion/wolfbrowser

🐺 Stealth browser toolkit — CDP-based, anti-detection, human-like...

22
Experimental
3415 joshlavroff/CherryBlossom

Toolkit for automating the buying and selling of designer clothes from Yahoo...

22
Experimental
3416 gxcsoccer/wechat-article-crawler

抓取微信公众号文章,导出结构化数据和 Markdown,自动下载图片绕过防盗链 | Claude Code skill for crawling...

22
Experimental
3417 tsadarsh/switter

Scrap Twitter (bookmarks for now)

22
Experimental
3418 MukundaKatta/makara

Makara — Web Intelligence Platform. Web intelligence platform

22
Experimental
3419 the-akira/FlaskExperimentos

Experimentos diversos com Flask: exemplos, tutoriais e pequenos apps.

22
Experimental
3420 TASALO-TEAM/taso-api

API REST para tasas de cambio en Cuba. Agrega datos de ElToque, CADECA, BCC...

22
Experimental
3421 obsidianplusplus/5E_Play_CS-GO

Python工具,分析你在5EPlay的CS:GO比赛数据。抓取、分析、筛选并导出。 | Python tool to analyze your...

22
Experimental
3422 mikayelgr/corsa

CORSA is a Python tool for scraping, cleaning, and analyzing AUA course data...

22
Experimental
3423 tauseedzaman/cool-python-projects

putting my hand on some cool automation projects.

22
Experimental
3424 ernestyu/clawutils

A small toolbox of CLI utilities and helpers around OpenClaw.

22
Experimental
3425 SKBro05/Yellow-Pages-Business-Scraper-Worldwide

🔍 Extract global business leads from Yellow Pages, collecting essential data...

22
Experimental
3426 AndresEduardoRA/cli-el-importador-de-vehiculos

Delivered a custom platform that centralizes prospects, clients, vehicle...

22
Experimental
3427 DrAdrianDC/RAG_pipelines

Production-ready data ingestion pipelines for RAG systems. Web scraping, PDF...

22
Experimental
3428 alekdev0/Betting-app

This is web app to get a information from multi betting websites

22
Experimental
3429 shahpari2kht/python-projects

My Python projects: learning exercises & practical applications in Data Science.

22
Experimental
3430 SagarBiswas-MultiHAT/Email-Harvester

Email Harvester; a production-ready CLI that finds publicly visible business...

22
Experimental
3431 fr0ziii/crawlflare

🔥 Clawlflare is a CLI for the Cloudflare Browser Rendering API: extract...

22
Experimental
3432 BBC-Data-Unit/prisons-children-coronavirus

Coronavirus: Prisoners' children 'forgotten' during pandemic

22
Experimental
3433 tasnimtalha09/movie-box-office-forecaster

Machine learning model for predicting first-week box office revenue using...

22
Experimental
3434 000xE/WebGallery

Save your favourite web media!

22
Experimental
3435 FredericoSRamos/EasyMart

A supermarket price comparison app that scrapes product data from multiple...

22
Experimental
3436 RozhakDev/MapsReviewExtractorAPI

REST API for extracting and serving Google Maps reviews using Node.js,...

22
Experimental
3437 maheshpaulj/Manga-Scraper

Manga Scraping Tool made in python, It fetches the manga page from the...

22
Experimental
3438 saagpatel/PageDiffBookmark

Chrome extension that bookmarks web pages and notifies you when their content changes

22
Experimental
3439 ibernabel/platzi-actual-course-duration-calculator

⏱️ Extensión de Chrome que calcula la duración REAL de los cursos de Platzi...

22
Experimental
3440 PB2204/Covid-19

This Is A Web Scraping Projects With Covid-19 Data From 2 Very Popular &...

22
Experimental
3441 dvgamerr/etl-cinema-scraper

🎬 Lightning-fast movie scraper for Thailand's major cinema chains (Major...

22
Experimental
3442 AdviseU-Project/AdviseU-Lib-Scrapers

A collection of libraries used to prepare/model data for use in AdviseU

22
Experimental
3443 berntpopp/table-harvester

Effortlessly extract data from HTML tables and convert them into structured...

22
Experimental
3444 Berkayzeren/siftly-ai

Smart Shopping & Review Analyzer Chrome Extension. Seamlessly summarize and...

22
Experimental
3445 dhanush290707/codechef-scraper

CodeChef profile scraper with bulk Excel processing, live dashboard, and...

22
Experimental
3446 Xquik-dev/x-twitter-scraper-go

Official Go SDK for the X Twitter Scraper API — tweet search, user lookup,...

22
Experimental
3447 probeo-io/anyserp-go

Unified SERP API router for Go. 11 providers — Serper, SerpAPI, Google CSE,...

22
Experimental
3448 Sleywill/snapapi-java

Official Java SDK for SnapAPI — Screenshot, Scrape, Extract, Analyze, Video...

22
Experimental
3449 Zeshanabdullah/unlimited-pixiv-gif-downloader

Download unlimited Pixiv GIFs for free without watermarks or registration...

22
Experimental
3450 GaffaAI/Docs

Documentation for the Gaffa web automation API docs

22
Experimental
3451 fredfrom/n8n-nodes-context-dev

n8n community node for the Context.dev API — web scraping, brand...

22
Experimental
3452 rvaughan/air-quality-data

Air quality data for Cardiff.

22
Experimental
3453 Zeshanabdullah/unlimited-google-doc-image-downloader

Download unlimited images from Google Docs for free with no watermarks and...

22
Experimental
3454 apifyforge/acquisition-target-screener

Acquisition target screening tool that runs 16 data sources in parallel to...

22
Experimental
3455 apifyforge/actor-portfolio-analytics

Get a complete, data-driven overview of your entire Apify actor portfolio in...

22
Experimental
3456 Mustkeem324/Issuu-PDF-Downloader

This script is designed to download PDF documents from Issuu using its API....

22
Experimental
3457 Panos-IT/Email-Scraper

A Python script for extracting email addresses from web pages. Utilizing web...

22
Experimental
3458 m0-k1/Scrapping-drugs-dot-com

Scrape each of the Natural Product Present on drugs.com

22
Experimental
3459 mikael-kumsa/Telegram-Bulk-Message

Telegram Bulk Message and member scraper

22
Experimental
3460 oskardevs/example-webscraper

Minimal FastAPI web scraping boilerplate with API and CLI support.

22
Experimental
3461 samybit/freelance-lead-scraper

An automated microservice pipeline that scrapes web data, processes it with...

22
Experimental
3462 platonai/pulsar-auto-mining

Extract almost every fields from a set of webpages using machine learning...

22
Experimental
3463 PabloGC1908/scrapper-admision-sm

Script para recopilacion de datos de los postulantes en los procesos de...

22
Experimental
3464 totallynotdavid/perexchange

Fetch PEN-USD exchange rates from multiple Peruvian exchange houses.

22
Experimental
3465 pmdredd/fo4_component_scraper

Small python CLI tool for getting the IDs of Fallout 4 crafting components

22
Experimental
3466 antoninfaure/occupancy-epfl

Backend of Occupancy FLEP, an interface of edu.epfl.ch useful for finding...

22
Experimental
3467 Sammeeey/gelbe-seiten-crawler

Scrapy Project to crawl https://www.gelbeseiten.de/

22
Experimental
3468 akhilam512/amFOSS-Tasks

amFOSS Tasks

22
Experimental
3469 Zeshanabdullah/unlimited-shutterstock-music-downloader

Download unlimited Shutterstock music effortlessly and without watermarks,...

22
Experimental
3470 shawntiyoyo/barchart-news-scraper

📈 Scrape structured financial news from Barchart to gain insights, track...

22
Experimental
3471 nicapos/SGX-data-project

A Python script for scraping Singapore Exchange (SGX) derivatives data.

22
Experimental
3472 WasifAsad/Bangla-News-Text-Analysis

Text analysis, word frequency visualization, and topic modeling on Bangla...

22
Experimental
3473 Zeshanabdullah/unlimited-streamable-image-and-photo-downloader

Download unlimited high-quality images and photos securely with our free, no...

22
Experimental
3474 Sol-Zeta/buscator

A metasearch engine to find a flight at the best price.

22
Experimental
3475 MukundaKatta/matsya

Matsya — AI Web Crawler. AI-powered web crawler

22
Experimental
3476 mrepol742/web-surface-scan

A lightweight developer-focused tool for analyzing a website’s technology...

22
Experimental
3477 kalidazem/simple-ubereats-web-scraper

Ubereats menu scraper that uses nodejs

22
Experimental
3478 daman87/douyin-api

📊 Access Douyin data easily with this Python SDK, simplifying API...

22
Experimental
3479 diegojromerolopez/isidorus-web-scraper

A simple scraper on AWS services

22
Experimental
3480 hakancangunerli/bist-scraper

daily bist scraper, for testing

22
Experimental
3481 filipovskis/fuel_price_bot

⛽A telegram bot for tracking fuel prices in Latvia

22
Experimental
3482 ChanMeng666/douban-review-scraper

【One star = One happy developer doing a little dance 💃⭐️】A robust Python...

22
Experimental
3483 dungtran209/Review-Mining-for-Amazon-App-on-Google-CH-Play

Scrape Reviews about Amazon Shopping App on Google CH Play and Perform Topic...

22
Experimental
3484 Siirsalvador/MoodleCrawler

Java web crawler to download files from Covenant University Moodle platform

22
Experimental
3485 Cyber-Gwen/Website-Subpage-Scraper

This Python script scrapes internal links on a webpage. It prompts for a...

22
Experimental
3486 luminati-io/ISP-Proxies

Reliable, high-speed ISP proxies with 700K+ static residential IPs for...

22
Experimental
3487 10elements/crawler

a crawler using python threading for fun

22
Experimental
3488 RpDp-git/WG-gesucht-Bot-w-ChatGPT

A scraping and messaging bot for wg-gesucht.de. To help find accommodation...

22
Experimental
3489 tystan/pbs-scrape

Python script to web scrape the PBS item code descriptions

22
Experimental
3490 oxylabs/how-to-scrape-google-finance

Use Web Scraper API to extract data from Google Finance, including stock...

22
Experimental
3491 Brayoo37/espn-football-news-scraper

⚽ Scrape structured football news, scores, and insights from ESPN for...

22
Experimental
3492 dio229338-design/Google-Scholar-Bibtex-Copy

Enhance Google Scholar by showing BibTeX entries inline and enabling...

22
Experimental
3493 Frenzycore/scrapers

List of scrapers, possibly complete, possibly not, just scraping (: (4:29)

22
Experimental
3494 b0o/apple-autofill-domains

Apple's allowed autofill domains

22
Experimental
3495 origamiofficial/rclone-http-updater

A Python script that updates rclone HTTP Remote configuration file...

22
Experimental
3496 guvenonur/airtime

IMDB airtime crawler and notifier for TV shows

22
Experimental
3497 oxylabs/how-to-scrape-indeed

A tutorial for collecting job postings from Indeed using Python and Oxylabs...

22
Experimental
3498 davidteather/scrape-crossfit-gyms

Scrapes crossfit gym data

22
Experimental
3499 imjakedaniels/thebachelor

Analyzing The Bachelor's Season Ratings and Finding the WORST bachelor

22
Experimental
3500 interlinker0325/Linkedin-scraping-extension

Linkedin scraping with chrome extension

22
Experimental
3501 clapsheep/wardrobe

웹스크래핑을 통한 나만의 옷장 서비스

22
Experimental
3502 osmn-byhn/htmlparser

Unified HTML/CSS/JS extractor that inlines styles and resolves script...

22
Experimental
3503 Crabsticksalad/youcom-web-search

you.com web search, deep research, and content extraction for OpenClaw. Free...

22
Experimental
3504 sagarmk/elastic-python-jobs-crawler

Built a web crawler using elastic search along with beautiful soup on indeed

22
Experimental
3505 Clats97/InfoHarvest

A simple contact info scraping tool written in Python and available as an...

22
Experimental
3506 douglasnavarro/sp-subway-scraper

🚆This web scraper builds a dataset for São Paulo subway operation status

22
Experimental
3507 wenyalintw/Job-Scraper-Bot

幫朋友做好玩的Telegram機器人,已部署到Heroku

22
Experimental
3508 jsericksk/StackOverflow-TelegramBot

Simple Telegram bot that responds with list of results obtained from Google.

22
Experimental
3509 dsheiko/wwwgrep

command line tool (web-crawler) for searching text in entire website.

22
Experimental
3510 LaMenteOcupada/Python-Scrapper-playlist

Proyecto WebScraper con python y beautifulsoup, para la playlist del canal...

22
Experimental
3511 philparzer/twitter-thread-analysis

🧵 analyzing Twitter threads and their impact on engagement

22
Experimental
3512 Sreelal727/dom-inspector-plus

Chrome extension for extracting UI components as AI-ready prompts. Hover,...

22
Experimental
3513 haath/Goirate

[DEPRECATED] Pillaging the seven seas for torrents, pieces of eight and other bounty.

22
Experimental
3514 antoniocoratelli/web-clipper

Easily download the main content of a web page in html, markdown, and/or...

22
Experimental
3515 corbettamarco/13ft

Self-hosted paywall and ad bypasser. Fork of 13ft with PWA support, Android...

22
Experimental
3516 ronaldgosso/topscrape

Declarative, resilient, and typed web scraping. Define what you want —...

22
Experimental
3517 renanstn/buscador-de-boardgames

Bot que compara preços de boardgames anunciados no Ludopedia e notifica caso...

22
Experimental
3518 brianamaral/covid-news

A data engineering personal project for applying some of my skills

22
Experimental
3519 FatemeFouladkar/Django-and-Amazon-Scraper-Integration

The integration of Scrapy and Django to scrape phone products from Amazon.com

22
Experimental
3520 ujeebu/ujeebu-scrapy

A Python library that acts as a middleware for Scrapy, a popular web...

22
Experimental
3521 pvh95/dl_reddit_meme

Reddit memes' popularity prediction using ML/DL techniques

22
Experimental
3522 antonreshetov/insta-scraper

Promise-based javascript instagram scraper on client

22
Experimental
3523 Fontihate/Youtube-Shorts-IA-Transcriber

Herramienta automatizada en Python para scrapear datos de YouTube Shorts y...

22
Experimental
3524 ClemensRau1337/hfv-vereine-scraper-openapi

Scraper + JSON-API für HFV-Vereine mit strukturierter Anschrift und Cache.

22
Experimental
3525 VincenzoImp/GSoC-2026-explorer

A better way to explore Google Summer of Code 2026. All 185 organizations...

22
Experimental
3526 apoapostolov/bulgarian-appliance-price-scraper

Bulgarian appliance scraper for Technomarket, Technopolis, and Zora....

22
Experimental
3527 AxelBilla/StayUpToDate

Keep yourself up-to-date on a given topic's news using Reddit!

22
Experimental
3528 Coroxx/WebAnalyst

A simple tool to get information about the html code and js code of a web page

22
Experimental
3529 oxylabs/python-script-service-guide

A guide on running a Python script as a service on Windows & Linux.

22
Experimental
3530 isaiasfeerreira/cna-oab-attorney-data-scraper

📊 Scrape attorney data from the OAB CNA Directory with this Python tool,...

22
Experimental
3531 Dipankar-source/Student-HelpDesk-ChatBot

BrainuBot 🚀 is an AI-powered assistant developed for 🎓 Brainware University....

22
Experimental
3532 alexE-895/simple-web-scraper

Example Python web scraping script

22
Experimental
3533 therealMrFunGuy/feed-forge

Turn any website into an RSS/JSON feed via API + MCP server

22
Experimental
3534 curiousnihilist/IMDB-Scraping-Project

This aim of this project was to scrape the information about Top 250 rated...

22
Experimental
3535 juniorxsound/DTW-2018

Detourning The Web class in ITP, NYU, 2018

22
Experimental
3536 mwilchek/Python-Web-Scraping

Web Scraping to Attempt to Identify Sex Trafficking

22
Experimental
3537 safa-yesilyurt/web-scraping-spring-react

Kocaeli University yaz-lab-1 full stack project

22
Experimental
3538 muhinja2002-svg/directory-harvester-etl

A production-grade ETL pipeline for automated lead generation. Features...

22
Experimental
3539 jmello04/price-monitor

API REST para monitoramento automatico de precos em e-commerces com alertas...

22
Experimental
3540 NithishProgrammer/ebay-intelligence-api

An asynchronous Python API designed to navigate the complex DOM structure of...

22
Experimental
3541 cytwyatt/cloudflare-browser-rendering-skill

OpenClaw skill for Cloudflare Browser Rendering markdown extraction and...

22
Experimental
3542 farhaanaliii/pyrua

Professional Random User-Agent Generator for Python

22
Experimental
3543 andrei-ameliugin/ai-web-scraper-llm

AI web scraper API that extracts structured data from websites using...

22
Experimental
3544 yaaaaam1/chinese-news-text-mining-python-with-web-scraping

Example of Chinese Text Mining in Pandas Dataframe

22
Experimental
3545 bad-antics/darkweb-ops

🌑 Dark web operations toolkit | Tor hidden services, .onion | NullSec...

22
Experimental
3546 harrysan/scrapshopee

Scrap Shopee with username and product name

22
Experimental
3547 yaroslav2901/OE_OUTAGE_DATA

Репозиторій містить JSON-дані про відключення електроенергії та згенеровані...

21
Experimental
3548 N0vachr0n0/Courses_Alert

Tool to look for free Courses and alert you !

21
Experimental
3549 ShiniDev/shopee-product-scraper

A php web scraper using panther.

21
Experimental
3550 ArthurCRodrigues/mvc-appointment-finder

CLI tool to monitor and notify available appointments at New Jersey MVC...

21
Experimental
3551 Sklyvan/ScrapingUPF

Repositorio de la aplicación que permite transferir los horarios de la...

21
Experimental
3552 BaseMax/StackoverflowCrawler

A web crawler which crawls the stackoverflow website.

21
Experimental
3553 haleemyousef/FollowAnalyser

Discover who really is your friend on social media, and get rid of parasites...

21
Experimental
3554 adrian-dip/quora-scraper

An up-to-date scraper for Quora topics and questions (works in 2023)

21
Experimental
3555 ercanse/flight-track

Flight tracking based on Flightradar24 data

21
Experimental
3556 berksudan/Sentiment-Analysis-on-E-Commerce

Crawled Amazon E-Commerce Website, analyzed & visualized intents of...

21
Experimental
3557 ramitbratabiswas/my-karaoke-playlist

fetches lyrics for a chosen spotify playlist or your top songs

21
Experimental
3558 BBC-Data-Unit/mps-registers-of-interest

Give MPs deadline on hiring relatives, campaigners urge

21
Experimental
3559 AjaxxIsHere/JobHuntingSucks-A-python-tech-job-webscraper

A robust, modular web scraping system to aggregate tech jobs in the UAE from...

21
Experimental
3560 armanchinai/scrapegoat

Query-first Python web scraping toolkit that lets you extract data from...

21
Experimental
3561 Miller898/full-tiktok-api-scraper

TikTok data extraction tool

21
Experimental
3562 rohit1kumar/internsync

A Python web scraper to scrape internships from Internshala, with the option...

21
Experimental
3563 Salmaishak/Web-Scrapping-Using-Beautiful-Soup

Web Scraping information from TripAdvisor for hotels, restaurants, and...

21
Experimental
3564 raissonsouto/pijama2json

A script that scraps data about UFCG courses offered from a PDF and turns into JSON.

21
Experimental
3565 HegdeChaitra/twitter_news_data

Scraping tweets and articles from news twitter handles. Can be used for...

21
Experimental
3566 omgitsbenhayes/247_rating_scraper

Scrapy based web-scraper for the 247 recruiting classes

21
Experimental
3567 hinha/sometor

sometor (Sosial Media Monitoring) API Gateway

21
Experimental
3568 quiKieSamus/scrape-bcv

deno package for scraping exchange values posted on the bcv's official main website

21
Experimental
3569 louisiaegerv/scrape

Web scraping over 15,000 items from multiple pages and saving all the object...

21
Experimental
3570 faizahmp/Semantic-Analysis-TikTok-User-Comments-Againts-IKN

GEMASTIK XVI Competition - Data Mining Division - Team Galaxy

21
Experimental
3571 anmolagarwal999/Domain-specific-data-collection-from-structured-and-unstructured-sources

Data collection (scraping+dynamic crawling) for domain "Computer Scientists"...

21
Experimental
3572 tinytinydev/HappyToiletSocialAnalysis

Social Analytics project for School to Analyse Happy Toilet using Social Media

21
Experimental
3573 Bayoslav/Hunt-scraper

Freelancer.com web scraper for Hunt

21
Experimental
3574 Galal-pic/Talented-recruitment-and-skills-analysis-system

The project's goal is to help job seekers understand the basic...

21
Experimental
3575 ahmetguldas/.Net-Form-Website-Mail-Scraping

scraping email from simple websites

21
Experimental
3576 jakeoeding/tldr-summary-generator

Summarize web articles

21
Experimental
3577 Fahd-Bin-Ashfaq/Python-Programming-full-course

This repository is designed to provide a comprehensive guide to Python...

21
Experimental
3578 Poudlardo/Allocine2Letterboxd

Importer ses listes de films d'Allociné vers Letterboxd

21
Experimental
3579 Guilherme-B/manifold

Manifold is a plug-and-play end-to-end real estate asset tracker, from web...

21
Experimental
3580 PreferredAI/venom-tutorial

A tutorial based on your preferred open source focused crawler for the deep web.

21
Experimental
3581 maxgio92/krawler

A crawler for kernel releases distributed by the major Linux distributions.

21
Experimental
3582 SakuraPuare/Bilibili-Emoji-Downloader

哔哩哔哩表情包批量下载器 | Batch downloader for Bilibili emoji and sticker packs

21
Experimental
3583 sheikhartin/google-scholar-scraper

Export the articles and reports from Google Scholar easily! (The spider...

21
Experimental
3584 gui25/CodeHarvest

CodeHarvest is a command-line tool for extracting and visualizing the...

21
Experimental
3585 dsc8x/node-scraper

Scraping websites made easy! A minimalistic yet powerful tool for collecting...

21
Experimental
3586 MuriloRoque/globo_play_scraper

When the App is executed, the user is prompted to type keywords. Then the...

21
Experimental
3587 Phantom-fs/Python-for-Everybody-py4e

PYTHON FOR EVERYBODY (py4e) Coursera SPECIALIZATION by UNIVERSITY OF MICHIGAN

21
Experimental
3588 GINK03/bookmeter-recommender

python3 bookmeter scraping tools

21
Experimental
3589 GoekhanDev/free-proxy-list

A regularly updated list of free, publicly available HTTP, HTTPS, and SOCKS...

21
Experimental
3590 joshuaDeal/search-sasquatch

A FOSS TF-IDF internet search engine.

21
Experimental
3591 ErnestAroozoo/MemeStocks.net

MemeStocks.net is a Python web app that tracks the historical popularity of...

21
Experimental
3592 hibi221b/git-spy

command-line tool to efficiently collect github repository

21
Experimental
3593 proxio-net/amazon-product-scraper

🛒 Lightweight Amazon product scraper with proxy support - Search, ASIN...

21
Experimental
3594 javapuppteernodejs/bypass-cloudflare-turnstile-crawl4ai

Learn how to integrate Crawl4AI with CapSolver to automatically solve...

21
Experimental
3595 LmiLaugh/facebook-url-to-id

Extract Facebook ID and metadata

21
Experimental
3596 biruhtesfaye/bol.com-site-scraper

A program that receives a search term and scrapes the resulting products...

21
Experimental
3597 ZENALC/jobScraper

Retrieves jobs from GitHub jobs and StackOverFlow, then displays then in a GUI.

21
Experimental
3598 lebrancconvas/Web-Automation-Utilities

Utility Tools for Web Automation.

21
Experimental
3599 J-Ack0/horse-racing-ml

End-to-end horse racing prediction system — XGBoost classifier, Kelly...

21
Experimental
3600 panakour/pkscraper

Extract structured data from the web

21
Experimental
3601 mtsprznto/Automatizaciones

Este repositorio contiene una colección de proyectos de automatización y...

21
Experimental
3602 Bilalkamal/EU-CTR-Scraper-v2

🥼 Scraper for EU Clinical Trials Register, extracting trial data into JSON...

21
Experimental
3603 HritikShukla02/booking-scraper

This web scraper is designed to extract comprehensive information about...

21
Experimental
3604 serhaturtis/TOOL-LibgenScraper

A little script to download books and articles from libgen.

21
Experimental
3605 Subrata-Rudra/leetcode-scrapper-API

This is a simple flask api for getting someone's LeetCode profile details...

21
Experimental
3606 maggike/Web-scraper-beautifulsoup4-python3

Buy the best cheapest product! The current python script looks for the...

21
Experimental
3607 natkaida/scripts

Парсинг, скрапинг, системные скрипты на Python

21
Experimental
3608 tomdexp/MiscPythonSocialMediaScrapping

Python files and scripts to extract data from different socials media and...

21
Experimental
3609 Imraneouelfaquir98/Web-Scrapping-Covid-19

Desktop application for extracting Coronavirus statistics from the...

21
Experimental
3610 sunlightpolicy/fedwebanalysis

Web analysis tool for Sunlight Foundation Web Integrity Project

21
Experimental
3611 albertferreira2020/Scraping-Invest-Site

Creating a webscraping from investsite.com.br

21
Experimental
3612 caullird/proj632_polyadvisor

🪧 Polyadvisor is a Nodejs program which aims to retrieve data from...

21
Experimental
3613 DeepanNarayanaMoorthy/Effect-of-COVID-19-pandemic-on-E-commerce

This is a pretty basic notebook made using machine learning techniques on...

21
Experimental
3614 ytoren/ProtocolGifts

Analysis of data from the "Protocol Gift Util" in the US department of state...

21
Experimental
3615 kocak-id/doronime-id

Get anime detail from doronime.id

21
Experimental
3616 Sachimugu/Net_Naija

Webscraping and exploratory data analysis of Netnaija Uploads.

21
Experimental
3617 NeilZhang1012/Web-Scrapping-and-Text-Mining-on-Social-Media-in-Fashion-Industry

Web Scrapping and Text Mining on Social Media Data (Twitter) in Fashion Industry

21
Experimental
3618 lucaspmatos/web-scraping-flutter

A small application to explore the web scraping technique in Flutter

21
Experimental
3619 DCS-training/web-scraping-R-2024

A workshop covering the basics of collecting data from the Internet using...

21
Experimental
3620 julianflowers/myScrapers

Functions to extract web data from PHE sites

21
Experimental
3621 Sjoerdbijlsb/Thesis-project-price-premiums

This project focuses on exploring product recommendations within the realm...

21
Experimental
3622 luminati-io/zillow-scraper

A Zillow scraper offering a free tool for small-scale data collection and an...

21
Experimental
3623 NiravJoshi33/antibot-bypass-server

A FastAPI server wraps different anti-bot bypass solutions like brightdata...

21
Experimental
3624 hadamrd/BinScrapper

Banks infos scraper

21
Experimental
3625 Virgo-Alpha/linkedin_resume_builder

Resume Builder

21
Experimental
3626 welli7ngton/Intensivao-Python

Repositório para o curso de python com 4 projetos, ministrados por Lira do...

21
Experimental
3627 dzhang32/biotech_web_scrape

Web scraping biotech company information

21
Experimental
3628 AshuAhlawat/malProfiler

a GUI(using PyQT) that scrapes the details for the name provided in the...

21
Experimental
3629 SohamSarfare/Drydock

This is a trial python project which tries to help out my favourite naval...

21
Experimental
3630 langphil/irish_ships_generator

A script that parses a CSV and creates strings that are written to a .txt file.

21
Experimental
3631 JerinFrancisA/Scrapy-99acres

A crawler for 99acres website. Does a crawl of Banglore region section of...

21
Experimental
3632 RollingHillsAnalytics/MTA-extraction

Python script to extract subway turnstile data files from the New York MTA website.

21
Experimental
3633 vaxad/GithubApi

GitHub Scraper is designed to scrape information about GitHub repositories...

21
Experimental
3634 adityamhaske/Business-Location-Recommendation-System

IBM Coursera Data Science - Applied Data Science(Capstone Project)

21
Experimental
3635 ota0912/Vaccine-Procurement-Predictor

A Vaccine Procurement Predictor which predicts the requirement for...

21
Experimental
3636 Ankit-Kumar-Saini/Applications-of-Data-Science

Programming assignments to demonstrate the Applications of Data Science....

21
Experimental
3637 chadbot0x/apiforchads-mcp

MCP server for AI agents — real-time crypto prices, Polymarket CLOB, AI...

21
Experimental
3638 ncryptsion/rsnipe

Scrape Roblox staff with potential Twitter account from a Roblox fandom.

21
Experimental
3639 Muthu-Mkode/spotify-chart-extractor

A Python micro-tool utilizing BeautifulSoup4 to extract and serialize weekly...

21
Experimental
3640 Emirzonee/E-Com-Price-Spy

Automated e-commerce price tracker built with Python. Features robust web...

21
Experimental
3641 ujeebu/ujeebu-langchain-py

LangChain integration for Ujeebu web scraping and content extraction APIs

21
Experimental
3642 SaptaZ/PDALife-Scraper-API

A high-performance asynchronous API built with FastAPI to scrape application...

21
Experimental
3643 therealtplum/usme-scraper

A resilient crawler + analyzer for US Mineral Exchange listings with a simple CLI.

21
Experimental
3644 gtrevisan/picama

Piattaforma Integrata Concorsi Atenei Magicamente Automatizzata

21
Experimental
3645 Sanjays2402/New-web-scraper

🔍 Web scraper tool for extracting data from websites

21
Experimental
3646 vwkd/netto-angebote-scrape

Scrape local offers for Netto stores

21
Experimental
3647 kunzaatko/bib-scraper

A CLI tool for automating the scraping of scholarly articles from Google...

21
Experimental
3648 Perufitlife/google-maps-lead-generator

Scripts and tools to extract business leads from Google Maps. Free API...

21
Experimental
3649 fallaciousreasoning/nz-mountains

A list of mountains in NZ, scraped from https://climbnz.org.nz

21
Experimental
3650 droopboop/upwork-job-feed-apify

Extract Upwork job posts without login or cookies. Only 2 parameters...

21
Experimental
3651 zipporah-cohen/menstruation-language

Data science project to investigate the presence of gendered language in...

21
Experimental
3652 apps4research/App-Search-Project

Collection of Python scripts to search for specific apps, scrape and clean...

21
Experimental
3653 f-kuzey-edes-huyal/steam-sale-optimizer

An MLOps pipeline for optimizing game discount strategies using Steam...

21
Experimental
3654 ludndev/ludndev

Software Engineer & DevSecOps

21
Experimental
3655 ferhatgec/rep

Fegeya Rep, CLI-based, colorized GitHub repository reader?

21
Experimental
3656 dglttr/scrawler

A Python package for Systematic Web Scraping and Crawling

21
Experimental
3657 spider-rs/spider-example-diff-monitor

Track website content changes over time with visual diffs. Powered by Spider Cloud.

21
Experimental
3658 nadvotsky/google-docs-exchange-feed

A web scraping script for Google Sheets via Apps Script that retrieves the...

21
Experimental
3659 spider-rs/spider-example-link-graph

Visualize internal link structure as an interactive force-directed graph....

21
Experimental
3660 spider-rs/spider-example-perf-runner

Analyze page sizes, resources, and web performance metrics. Powered by Spider Cloud.

21
Experimental
3661 samidii/ACYBER-Wayback-Machine-Downloader

📥 Download historical files from the Internet Archive Wayback Machine with...

21
Experimental
3662 spider-rs/spider-example-sitemap-generator

Generate visual sitemaps and export as XML. Powered by Spider Cloud.

21
Experimental
3663 yokesh-ks/clean-mark

Turn any website into clean Markdown - Extract noise-free, structured...

21
Experimental
3664 OleksandrZadvornyi/ternopil-light-bot

A Node.js Telegram bot that tracks electricity outage schedules for Ternopil...

21
Experimental
3665 willygoid/fofa-grabber

A powerful Golang tool to fetch and export FOFA.info search results via API...

21
Experimental
3666 mdugan8186/steam-sale-scraper

Scrapes Steam “Specials” page to collect discounted games, exports...

21
Experimental
3667 Talecodes/personal-finance-dashboard

💰 Track your money effortlessly with this React-based personal finance...

21
Experimental
3668 LuanRT/playstore-scraper

🏷️ A simple and fast way to get search results and more from Google Play Store.

21
Experimental
3669 vinibrsl/internet-affordability

🌍 Did you know that internet costs >20% of the average income in some countries?

21
Experimental
3670 DPModsPro/hianime-api

​🚀 Ultimate HiAnime API: A high-speed, comprehensive RESTful API to scrape...

21
Experimental
3671 eliasailenei/PortableISO

A all in one tool that helps you get Windows remotely by saving you time and...

21
Experimental
3672 SkyWox/lottery

A site that monitors your lottery tickets for winners

21
Experimental
3673 realaryann/concurjob

CLI app to concurrently scrape job boards to apply straight from your cmdline

21
Experimental
3674 dead8309/ai-rag-crawler

AI pipeline built with the honc and workers-ai. vector embeddings, web...

21
Experimental
3675 jonathanhefner/grubby

Fail-fast web scraping

21
Experimental
3676 boxxello/Udemy-Auto

Udemy business - all quizzes solver

21
Experimental
3677 jtiala/wpdl

⬇️ Scrape pages, posts, images and other data from a WordPress instance.

21
Experimental
3678 quippy-dev/socksflareprox

SOCKS + HTTP proxying via Cloudflare Workers with local SOCKS tunnels and...

21
Experimental
3679 Jaricapa-holberton/proyecto1

A public repository where I upload projects to practice topics freely.

21
Experimental
3680 barbara-wachek/web_scraping_repo

Skrypty utworzone w ramach projektu „Bibliografia polskiej internetowej...

21
Experimental
3681 Anuar-boop/web-scraper

CLI web scraping tool with CSS-like selectors, crawling, and data...

21
Experimental
3682 Amar4750/Comick-Io-Manga-Zip-Cbz-Downloader-Scraper

📥 Download manga chapters from Comick.io effortlessly as ZIP or CBZ files...

21
Experimental
3683 LandWhale2/TD-Spider

Via Text Density Simple Web Crawler With Go

21
Experimental
3684 stefanocudini/node-fetch-dom

Magic utility that extract javascript global variables from a remote html page.

21
Experimental
3685 Dionakra/arenavision-scraper

Little ArenaVision Scraper to get the sports events

21
Experimental
3686 UniStudents/Saffron

A fairly intuitive & powerful framework that enables you to collect & save...

21
Experimental
3687 its-my-data/doubak

豆备 (Doubak) - 豆瓣 (Douban.com) 命令行版备份工具,备份完整页面镜像,Golang实现。

21
Experimental
3688 yusufesatt/trendyol-category-scraper

It takes the URL of a product category on Trendyol as input, then pulls the...

21
Experimental
3689 Xiddoc/Taboo

A LinkedIn scraper on steroids. Many people might accidentally leak...

21
Experimental
3690 rgligora/email-web-scraper

Python script designed to scrape emails from websites. It takes a target URL...

21
Experimental
3691 Arthelon/PyCast3

Search for and download your favourite podcasts

21
Experimental
3692 maulanaahmadarif/archive-your-ig

Download all instagram image and video post

21
Experimental
3693 TorSpider/TorSpider

An index which uses 'spiders' to crawl and explore every discoverable hidden...

21
Experimental
3694 ggg84/pyscrapeporn

Scraping tool to download porn images from various sources

21
Experimental
3695 casualwriter/powerpage-web-crawler

a portable, lightweight web crawler using Powerpage.

21
Experimental
3696 vaxad/DealDex

A Web/App Platform that scrapes product data from well- known e-commerce...

21
Experimental
3697 marinoffDev/SteamGifts-Automated

A Chrome extension for SteamGifts that lets you track and auto-enter...

21
Experimental
3698 TUVIMEN/xhamster-scraper

A bash script for scraping xhamster metadata of pages in json

21
Experimental
3699 rjbma/curry-digger

Scraping the web: experiments with functional programming in javascript

21
Experimental
3700 franckferman/Scraping-Deputes-France

Script pour scraper les député·e·s français (Nom, Région, Email, Groupe,...

21
Experimental
3701 luminati-io/Zillow-dataset-samples

A sample dataset of over 1000 Zillow listings, extracted using the Bright...

21
Experimental
3702 VictoKu1/Social-Network-Analyzer

Social Network Analyzer is a Flask-powered app that combines AI-driven...

21
Experimental
3703 luminati-io/Twitter-X-dataset-samples

A sample dataset of over 1000 Twitter (X) posts, extracted using the Bright...

21
Experimental
3704 jv-nogueira/socialCleaner

Deixa de seguir os perfis e exporta em CSV

21
Experimental
3705 danitrod/gignore

A command line tool to generate gitignore template files

21
Experimental
3706 DevArqf/API-Header-Spoofer

Practical examples of how header spoofing works. Shows you the tricks...

21
Experimental
3707 GihanIT/Multi-Site-Movie-Scraper

🎬 A modern Python desktop app for scraping Sinhala subtitle websites. Search...

21
Experimental
3708 Pa55w0rd/ScrollSnap

专业的滚动区域截图工具 | Professional scrollable region screenshot tool

21
Experimental
3709 chinese-lost-media/cctv_programs

CCTV 央视网历史节目单数据 | China Media Group ( CCTV) Historical Program Data

21
Experimental
3710 Pryodon/Web-Spider-Linux-shell-script

Generate a list of file links you can feed to wget for easy downloading!...

21
Experimental
3711 aaron-george/amazon-review-scraper

Scrapes all the reviews for multiple products listed on Amazon

21
Experimental
3712 mariajosemv/Extraordinary-Humans

👩🏻‍🚀 A webpage to show the most exotic human that have won an Guinness World...

21
Experimental
3713 rfaturriza/get-data-cpns-to-csv-2024

Data Scraper for SSCASN

21
Experimental
3714 sunny250984/craigslist

Scrap craigslist data from website(https://sandiego.craigslist.org/) every...

21
Experimental
3715 IamBikramPurkait/NewsDown-Telegram-Bot

NewsDown is a Newspaper Downloader Telegram Bot

21
Experimental
3716 Jack-Christopher/UNSA-Enrollment-Checker

UNSA Enrollment Checker 🕵️‍♂️🔄 - Your Automated Enrollment Spy! Never miss a...

21
Experimental
3717 tesserakh/lawyers-society

Canadian portal for lawyers and paralegals - directory scraping

21
Experimental
3718 mantleCurve/rabbitmq-celery-beautifulsoup

Distributed scraping with rabbitmq, celery and beautifulsoup

21
Experimental
3719 liamhbyrne/Premier-League-Predictions-with-Deep-Learning

Deep Learning Football Prediction Model. Achieved 56% mean outcome accuracy...

21
Experimental
3720 madhurchhajed/Emails-Extractor

Scrape emails from an existing email address on the basis of their subject...

21
Experimental
3721 aguunu/fing-watch

A movie recommendation platform powered by the Gorse recommender system...

21
Experimental
3722 soufianesejjari/Data-scraping-and-Analysis-LinkedIn-Profiles-Students

LinkedIn data analysis of ENSIAS students, using web scraping, JSON, Python...

21
Experimental
3723 giancarllotorres/whats-next-for-twitter

An overview of the audience's expectations and the forthcoming steps for...

21
Experimental
3724 Aish-p/WebScraperAPI

WebScraperAPI is a powerful web application that transforms any website into...

21
Experimental
3725 Fortissible/Genshin-Discord-Bot

Discord bot project about genshin utils for mats farming, damage or other...

21
Experimental
3726 slopezpereyra/puppy-adopter

A program that automatically downloads images from a customizable list of...

21
Experimental
3727 subhamX/news_scrapper

This script displays latest news along with short description. The news are...

21
Experimental
3728 harshsri2208/news_scraping

A simple python application to get top news headlines

21
Experimental
3729 Victornguli/Skraped

A CLI tool for scraping Kenyan job boards for tech jobs and saving them in a...

21
Experimental
3730 TheSYNcoder/A2oj

This repository contains the code to scrape problems from the category...

21
Experimental
3731 GrayHat12/compiler

=

21
Experimental
3732 LimaLucas96/Detector-de-fake-news

Fake news detection system using web scraping and similarity.

21
Experimental
3733 ykamat/hockey-webscraper

Web scraper project involving parsing HTML data from a hockey players...

21
Experimental
3734 ashbuen/Web-scraping-Online-Store

An established connection to MongoDB was used to web scrape the...

21
Experimental
3735 izwarirsyad/Tj_Took

🛠️ Enhance your productivity with Tj_Took, a lightweight Telegram bot...

21
Experimental
3736 Aidoni0797/DDAYNO

A Python script for parsing and analyzing news articles

21
Experimental
3737 Samndathe/BieniciScraper

🏠 Scrape real estate listings from Bienici.com, extracting key property data...

21
Experimental
3738 makeuseofcode/Instagram-Data-Extractor-Python

This repository contains code to scrape the Instagram data using Python.

21
Experimental
3739 ScherbAlex/HH_Data

Job market data collection and storage tool based on hh.ru vacancies parsing.

21
Experimental
3740 AnandBinuArjun/jobguard-uk

JOBGUARD-UK is an automated cyber-intelligence system that actively hunts...

21
Experimental
3741 DAXXTEAM/zikzakzik

🔒 Ultra stealth HTTP library for Python - Hide requests in decoy traffic |...

21
Experimental
3742 moizahmad418/company-employees-scraper

👥 Scrape complete employee data from any company and turn public information...

21
Experimental
3743 ashu1436/amazon-scraper

🛍️ Scrape product data from Amazon for accurate price comparisons and...

21
Experimental
3744 kabita10/Instagram-Posts-dataset-samples

📷 Explore a dataset of 7,730 Instagram posts, extracted using the Bright...

21
Experimental
3745 Danielh002/price-drop-bot

Automated monitoring tool that tracks online product prices and notifies...

21
Experimental
3746 whodinner/ghost-job-detector

detects possibly ghost and scam jobs. advanced algo to track them further.

21
Experimental
3747 cesarleaz/daily-word

This is a repository to get the daily word through web scraping

21
Experimental
3748 kokiito0926/channeling

2chのスレッドなどをJSON形式で取得することができるコマンドラインのツールです。

21
Experimental
3749 nkorobkov/vk-dump

Yet another GitHub repository with scripts for downloading vk message...

21
Experimental
3750 abdallah21838/facebook-marketplace-listing-poster-automation

📦 Automate Facebook Marketplace listings with structured inventory feeds,...

21
Experimental
3751 ikashmiri/social-media-automation-tools-framework

🤖 Streamline social media workflows with a structured framework that...

21
Experimental
3752 KENNEDY7774/social-media-scraping-apis

📊 Collect and analyze data from social media platforms using flexible APIs...

21
Experimental
3753 npanuhin/NetSchool-PTHS

Mirror website of the "NetSchool" electronic diary (PTHS edition)

21
Experimental
3754 spider-rs/spider-example-seo-auditor

Audit SEO elements like titles, meta tags, and headings. Powered by Spider Cloud.

21
Experimental
3755 Aditya310101/Sentiment-Analysis-Reddit

Gathered data and Performed Sentiment Analysis on Reddit content using Python

21
Experimental
3756 jbax1899/cdp-richmond-indiana

Browse recent Richmond and Wayne County public meetings, with video playback...

21
Experimental
3757 burhan-arifm/jeketi-scraper

web scraper berjalan di runtime Deno dan menggunakan bahasa Typescript

21
Experimental
3758 wfgsss/made-in-china-scraper-example

Scrape B2B product data from Made-in-China.com - prices, MOQ, supplier info,...

21
Experimental
3759 imharris24/HeadHunt

The terminal-first SEO metadata hunter. Scrape, structure, and visualize...

21
Experimental
3760 nguyend1en/WebTextScraper

A powerful hybrid Tampermonkey script designed to extract and decrypt hidden...

21
Experimental
3761 pim97/scrappey-wrapper-go

Using Scrappey with Go

21
Experimental
3762 Iqrar99/WW-VO-Downloader

A small script to download all voice-over from characters in Wuthering Waves

21
Experimental
3763 Ali5onbol/dab-downloader

🎵 Download high-quality FLAC music files with rich metadata using the DAB...

21
Experimental
3764 Ken-Chy129/shoes

全栈球鞋价格监控平台 | 聚合 KickScrew、StockX、得物多平台数据,定时价格抓取、比价分析、Excel 导出,Spring Boot + React

21
Experimental
3765 lucici1021/wikipedia-research-assistant

Fraud & anti-fraud Wikipedia research assistant: scraping pipeline +...

21
Experimental
3766 jlongway-web/Web-scraping-NC-vs-SC-Population

A web scraping project comparing population growth in North Carolina and...

21
Experimental
3767 IsaacEx/weather-impact-rideshare

Inteligencia de datos para Zuber Chicago: Análisis de competitividad y...

21
Experimental
3768 ashokvarmamatta/PKMSpawn

PkmSpawn — Pokemon GO Spawn Tracker 🐲 Android app that scrapes 10+ worldwide...

21
Experimental
3769 Moscarde/Junior_Zone

Vagas Jr. atualizadas diariamente. Telegram e Planilha Online

21
Experimental
3770 mech0ctopus/scrape-mcmaster

Scrape 3D models from McMaster-Carr

21
Experimental
3771 Nawras448/zapret-bf

🚀 Protect your online privacy with Zapret-BF, a simple tool to bypass...

21
Experimental
3772 nikvaid1/wikihow-article-scraper

🛠️ Scrape WikiHow articles for structured guides and metadata, simplifying...

21
Experimental
3773 Zeshanabdullah/unlimited-google-slides-image-downloader

Download unlimited images from Google Slides for free, without watermarks or...

21
Experimental
3774 Menam17/huispedia-scraper

🏠 Extract comprehensive property listings from huispedia.nl with this...

21
Experimental
3775 0237h/code4rena-scraper

Scraping Code4rena contest audits reports for stats, fun (and profit ?)

21
Experimental
3776 Mechaspirit1/Yet-Another-Web-Scraper

A CLI based web scraping tool written in Python

21
Experimental
3777 ChangyWen/PolitiFact-scraping

PolitiFact Scarper

21
Experimental
3778 jwoglom/postfetch

Download Washington Post newspaper PDFs

21
Experimental
3779 danp/scraperlite

Scrape text and HTML based on CSS selectors and save contents to a SQLite database.

21
Experimental
3780 mhwgoo/fake_user_agent

Randomly generate a valid useragent for faking a browser.

21
Experimental
3781 luisligunas/pinoy-dictionary-scraper

Generates a Filipino dictionary with Tagalog, Cebuano, Hiligaynon, and...

21
Experimental
3782 cikay/kurmanjiscraping

Scrape Kurdish Kurmanji pages

21
Experimental
3783 minyeamer/gourmaid

Advanced restaurant search service

21
Experimental
3784 mzubairtahir/amazon-search-result-scraper

A scraper that scrapes products from the search results of Amazon

21
Experimental
3785 MohammedAHO/Spoiler-Free-Movie-Recommender

The aim of this project is to find whether a review contains any information...

21
Experimental
3786 Abdulrahman-Elsmmany/docscrape

Scrape any documentation site to Markdown in seconds

21
Experimental
3787 jsvelu/DjangoWebScraper

A webscraper for FlipKart product Listing Using Django And BeautifulSoup4....

21
Experimental
3788 DamianBisewski/tweenspector

TweeNspector is a Twitter analyzer written in Python. It enables searching...

21
Experimental
3789 atxtechbro/GlassdoorWebScraping

"Scraping Glassdoor: A GraphQL Journey" is an advanced data harvesting tool...

21
Experimental
3790 forhadsidhu/Wiki-Movies-Crawler

API for showing the crawled wiki movies content and list of movies

21
Experimental
3791 thoth2357/OweYoruba

Scripts That Scrapes twitter for yoruba language proverbs and it...

21
Experimental
3792 ash2shukla/moodleDown

A batch downloader for moodle, Downloads all notes and other material...

21
Experimental
3793 subratamal/node-pool-impl

Classified Website Scraper

21
Experimental
3794 mwasikz/amazon-scraper

Amazon Product Information and Search Query API

21
Experimental
3795 madinamarat/machine_learning_projects

🤖 ML projects: titanic Kaggle competition, predicting bikes demand, Text...

21
Experimental
3796 Kaleidosport/Workshop-Python

🪄 [BeCode - Workshop] Kicking off our mates Python journey.

21
Experimental
3797 Nicola-Loi/rental-apartments-scraper

Serverless GCP pipeline that scrapes Italian rental listings, stores them in...

21
Experimental
3798 ericma-portfolio/crypto-webscraper

End-to-end crypto data pipeline — CoinMarketCap → S3 → Airflow → Redshift

21
Experimental
3799 oriac-gimeno/Web-Scraping-Models

Web scraping tool built with Streamlit and BeautifulSoup. Demonstrates data...

21
Experimental
3800 capt-marbles/phantombuster

Control PhantomBuster automation agents via API - LinkedIn scraping, Twitter...

21
Experimental
3801 aakcay5656/interpol-notice-tracker

dockerized Interpol red notice pipeline with RabbitMQ, PostgreSQL, and FastAPI UI

21
Experimental
3802 gunjanjaswal/BetterDocs-Scraper

Python web scraper for BetterDocs documentation sites. Auto-discovers...

21
Experimental
3803 karthiklad/httpx-with-proxy

🌐 Use HTTPX with various types of proxies, including authenticated,...

21
Experimental
3804 RichieFernando00/cdiscount-product-details-scraper

🛍️ Scrape structured product details from Cdiscount easily, collecting...

21
Experimental
3805 dbeniamin/Music-Time-Machine

Music Time Machine 🎵 A Python GUI application that creates Spotify playlists...

21
Experimental
3806 BlessedSiden1234/Artificial-Intelligence-For-Social-Impact

Artificial Intelligence for Social Impact is a research-focused project that...

21
Experimental
3807 ayinedjimi/DatasetForge

Automated Dataset Creation & Publishing Pipeline - Scrape, clean, transform,...

21
Experimental
3808 martinnav164/HomeHarvest

Python package for scraping real estate property data

21
Experimental
3809 Incorcadi/page-diff-monitor

Profile-driven scraping pipeline (HTTP/Browser) with JSONL/SQLite storage...

21
Experimental
3810 Ian-Louw/crawlvox

Web crawler and content extraction CLI for personal and educational use....

21
Experimental
3811 Patrick564/go-versions-scrap

List all Golang version from https://go.dev page

21
Experimental
3812 NicolasChirazawa/MyAnimeList-Scraper

🔧 Um webscraper de dados para o site MyAnimeList (MAL)

21
Experimental
3813 raza-h/gold-price-monitor

AurumPulse: Node.js cron job that scrapes gold prices periodically, stores...

21
Experimental
3814 Geremia/HathiTrust

Scrape pages from full-view HathiTrust books

21
Experimental
3815 TUVIMEN/pornhub-scraper

A bash script for scraping pornhub in json

21
Experimental
3816 NickG1978/awesome-web-crawler

🕷️ Discover and use popular web crawlers across various programming...

21
Experimental
3817 spider-rs/spider-example-content-translator

Convert web content between HTML, markdown, and plain text. Powered by Spider Cloud.

21
Experimental
3818 spider-rs/spider-example-dead-link-checker

Crawl websites and find broken or dead links. Powered by Spider Cloud.

21
Experimental
3819 dyc8282/ai-seo-analyzer

AI-powered SEO analyzer - crawl any webpage and get a scored audit (0-100)...

21
Experimental
3820 spider-rs/spider-example-a11y-checker

Audit websites for accessibility issues and WCAG compliance. Powered by Spider Cloud.

21
Experimental
3821 ItsOrv/balad-scraper

افزونه کروم برای اسکرپینگ بلد

21
Experimental
3822 rishabhmanu/Web-Scrapping

A Web-Scrapping script

21
Experimental
3823 unl-statistics/stat351

Repository for Stat 351 - Advanced Computing II: Data Management and...

21
Experimental
3824 h26k2/dynamic-scraping

A simple demo that elaborates how dynamic scraping works

21
Experimental
3825 almalki90/eastern-tenders

🏛️ نظام ذكي لجمع وعرض المناقصات والترسيات في المنطقة الشرقية | Smart system...

21
Experimental
3826 misoboy/inventory-watcher

Go daemon that monitors inventory on Korean e-commerce sites with Telegram alerts

21
Experimental
3827 yesdeepakmittal/data-scripts-for-data-science

Collect Data using Web Scrapping & API

21
Experimental
3828 justIliane/blazehttp

⚡ High-performance HTTP/1.1 + HTTP/2 server & client for Go — faster than...

21
Experimental
3829 eSlider/go-proxy

Go library for fetching free HTTP/SOCKS4/SOCKS5 proxy lists from ProxyScrape API

21
Experimental
3830 hey0wing/Parallel_TedTalk

Web scraping for parallel corpus on TedTalk

21
Experimental
3831 ChandanShakya/goldmandu

View Gold and Silver Price in Kathmandu

21
Experimental
3832 crystalnguyyen/lululemon-reddit-sentiment-scraper

Sentiment analysis of 600 r/lululemon Reddit posts to explore whether post...

21
Experimental
3833 Siva-S-05/webscraping

Python web scraper for eBay product listings using BeautifulSoup and Pandas

21
Experimental
3834 RozaAbolghasemi/paginated-api-scraper-python

Scalable and resumable Python scraper for extracting large datasets from...

21
Experimental
3835 nfue17/Tesla

Python data analysis project comparing Tesla and GameStop stock price...

21
Experimental
3836 JasperValdez/hiring-cafe

Build and customize a Next.js-based hiring platform with API routes for...

21
Experimental
3837 ktarrant/equibase_scraper

Scrapes data from Equibase and collects it into pandas DataFrames

21
Experimental
3838 rukshn/dm-feeds

An RSS feed for websites with broken or unavailable RSS feeds

21
Experimental
3839 andrenormanlang/typescript-next.js-comic-books-platform-fullstack-web-app

A comic book platform 📚🌐 built with TypeScript and Next.js. The project...

21
Experimental
3840 aligea/scrapingweb

Scraping content of famous website

21
Experimental
3841 Nurna-Her/Coincine

Spin your friends letterboxd watchlists and find what to watch next.

21
Experimental
3842 maekke/vaccination_data

COVID19 vaccination data from Cantons of Switzerland and Principality of...

21
Experimental
3843 mkearney/wibble

Web Data Frames

21
Experimental
3844 beatrizmilz/noticiasgov

Raspagem de dados de portais de noticias governamentais

21
Experimental
3845 mrzzy/providence

Personal Finance Data Pipeline & Dashboard

21
Experimental
3846 victorl2/itauscraper

Scraper para obter dados de contas correntes: extratos, cartões e...

21
Experimental
3847 neysofu/qetesh

Web scraper to train profanity detectors. NSFW!

21
Experimental
3848 palahsu/ScraperImages

Simple Web Images Scraper From Websites!

21
Experimental
3849 bazzi24/Crawl_NewsStock_From_Cafef

Crawl news about stock from 'https://cafef.vn/thi-truong-chung-khoan.chn'

21
Experimental
3850 GabrielMesquitaOliveira/EasyCrawler

Multi-threaded Java web crawler library with flexible search strategies and...

21
Experimental
3851 iamphduc/tdt-chatbot

A messenger chatbot sends timetable and score scraped from TDTU Student Portal.

21
Experimental
3852 Puter-Apps/scraper

A simple app to scrape data from websites using CSS selectors.

21
Experimental
3853 devlocalhost/pylyrical_api

pylyrical_api - lyrics API scraping from genius.com

21
Experimental
3854 ricardocastanho/scrapify

A flexible and decoupled Go package for scraping paginated pages. It...

21
Experimental
3855 MYTE21/Anime.Quest

Data collection and analysis to discover fascinating information about anime.

21
Experimental
3856 darshanmore2911/website-scraper-pro

🕷️ Intelligent website scraper with search, analysis, and export features...

21
Experimental
3857 ZealJared/gifGrabber

Collect, caption, categorize, and re-host GIFs for your own library.

21
Experimental
3858 dedemenezes/legacy_api

A RESTful API for Harry Potter

21
Experimental
3859 MaxBWiseman/Event-Hoarder-Project3

My project3 for code institute. Scrape event data as you search and perform...

21
Experimental
3860 UOSCS/Olympic_Athletes

Scraping data of past Olympic athletes

21
Experimental
3861 ayoubakh/topic-detection

A topic detection project

21
Experimental
3862 pauladj/UFO-dataset-scraper

Scraping UFO sightings website to create a dataset

21
Experimental
3863 weavermonkey/Sentiment-Analysis-Roger-Ebert-Reviews

Predict how Roger Ebert would rate a movie

21
Experimental
3864 JassonCordones/products-scraper

Descarga la informacion del sistema de dominicano de informacion de precios...

21
Experimental
3865 360-info/training-datajournalism

https://360-info.github.io/training-datajournalism

21
Experimental
3866 alexisadorn/BestFriendFinder-cli-app

CLI Data Gem Project that retrieves info about adoptable dogs and cats

21
Experimental
3867 lmuffato/Project-tech-news-Trybe

Projeto tech news - Projeto avaliativo da Trybe do Bloco 34 - Redes e...

21
Experimental
3868 rikkeuldbaek/network_analysis_SocCult

Network analysis on twitter echo-chambers with polarised opinions about...

21
Experimental
3869 arthurdouillard/MoviesPopularity

An app that rates movies according to its comments, incremental learning is...

21
Experimental
3870 MUDev1994/Track-Web-Mood

Track Web-Mood is an analytic dashboard app that provides clients with...

21
Experimental
3871 MattMoradi/HTML_ScraperPro

An HTML Downloader Client For Scraping HTML Code From Websites

21
Experimental
3872 developer-sumit/web-groper-python

WebGroper is a Python class designed to recursively scrape and download...

21
Experimental
3873 8140171224/Weather-forcast-script

create in csv file script in python language py , pip, pip3,

21
Experimental
3874 noveroa/djangoRESTful

Exploring django, basic python functions, restful services and web scraping...

21
Experimental
3875 cecilialee/indeed-scraper

Scrape Data Scientist job data from indeed.hk

21
Experimental
3876 cristina-faessler/news_scraping_thesis

A Tool for Gathering German News Articles and Generation of a ready-to-use...

21
Experimental
3877 mstephen19/apify-global-store

Easily access, manage, and manipulate a global state/multiple global states...

21
Experimental
3878 yashkathe/Football-API

Get all the data for the top 5 European football leagues which includes...

21
Experimental
3879 riccardogiorato/web-scrapers-evals

Trying to find the best web scraper to allow LLM to access any web page

21
Experimental
3880 MrAyush/thesaurus-synonyms-scraper

Thesaurus synonyms scraper for multiple words

21
Experimental
3881 HoByMedia/StockX-Listings-Scraper

📊 Extract product listings from StockX, including prices and details, for...

21
Experimental
3882 SouRitra01/Wining-Space-Race

IBM Data Science Capstone Project from Coursera

21
Experimental
3883 alemosie/hot_peppers

Fun side project exploring hot peppers throughout the world 🌶️

21
Experimental
3884 angelaarredondo/Ironhack-Final-Project

Sentiment Analysis on L'oreal Cosmetics

21
Experimental
3885 Binnette/scraped-data

Data scraped from differents websites

21
Experimental
3886 PrShivashish/Profiled-2.0---AI-Career-Architect

An end-to-end AI-powered career intelligence system that matches candidates...

21
Experimental
3887 Magnus0969/Refract

Refract is an intelligent, agentic AI assistant designed to support...

21
Experimental
3888 hawkxdev/scrapy_parser_pep

Асинхронный парсер PEP на базе Scrapy

21
Experimental
3889 Timmatt-Lee/high-score-ani-fetcher

Fetches, caches, and tracks high-scoring anime (Score ≥ 4.8, Episodes ≥ 10)...

21
Experimental
3890 samybit/lead-gen-tool

Production-ready SaaS tool for automated e-commerce data extraction. Built...

21
Experimental
3891 Moham-Ram/Gab-People-Search-Scraper

🔍 Fetch public user profiles from Gab.com with ease, collecting essential...

21
Experimental
3892 shawqisherif/find-sitemap-from-url

🔍 Discover sitemap URLs quickly from any website for efficient SEO research,...

21
Experimental
3893 davorg/towerbridge

When is Tower Bridge lifting?

21
Experimental
3894 aluiziolira/async-patterns

High-performance async HTTP patterns for Python: circuit breaker with...

21
Experimental
3895 DenimEvert/pydoll-capsolver

Undetectable web automation with Pydoll (CDP-based) and CapSolver. Bypass...

21
Experimental
3896 naham6/cex-scout

A Python-based automation tool designed to extract, process and summarize...

21
Experimental
3897 Eduard289/repo-butacavip

Proyecto modular de investigación y desarrollo para Kodi en ph3

21
Experimental
3898 InformationRetrieval-Organization/movie-actor-ranking

Movie Actor Ranking System

21
Experimental
3899 cemlyn007/flathunt

Unofficial tool for assisting in property searching on Rightmove.

21
Experimental
3900 MathisVerstrepen/letterboxd-jellyfin

Import your Letterboxd watchlist into Jellyfin and Radarr

21
Experimental
3901 philcyh/pixurebyte

📸 Capture and analyze websites quickly and privately with Pixurebyte, an...

21
Experimental
3902 mivan50/NBA_Stats_API

NBA stats API | Web Scraping Basketball Reference

21
Experimental
3903 gabrielwong159/evs

Electricity Vending System for SUTD Hostel Aircon

21
Experimental
3904 spider-rs/spider-example-knowledge-base

Build a searchable knowledge base from crawled websites. Powered by Spider Cloud.

21
Experimental
3905 Arkapravo-Ghosh/qwiklabs-tools

Faciliator Tools for Qwiklabs

21
Experimental
3906 HatsuSumi/Image-Hawk

🦅 A powerful browser extension for intelligent image capture and format...

21
Experimental
3907 MickyKee/scrapepilot

AI-powered web scraping dashboard with analytics and scheduled runs

21
Experimental
3908 ujeebu/ujeebu-n8n

n8n community node for the Ujeebu API. Scrape web pages, extract article...

21
Experimental
3909 mikaelvesavuori/reader

Reader-friendly Cloudflare Worker for safer, cleaner web reading.

21
Experimental
3910 henglyrepo/Taobao-Image-Downloader

A Chrome/Firefox browser extension that captures and downloads...

21
Experimental
3911 WiwiAI/marketplace-news-parser

Node.js parser for marketplace news (RSS/HTML) with keyword filtering and...

21
Experimental
3912 wfgsss/dhgate-scraper-example

Scrape product data from DHgate.com - prices, suppliers, ratings, and more....

21
Experimental
3913 Pavan910/Python

Content-based movie recommendation system (deployed), web scraping pipeline,...

21
Experimental
3914 le0-star/searxng-docker-tavily-adapter

🔍 Use SearXNG with a Tavily-compatible API for private searches, no keys...

21
Experimental
3915 TULO09/Lefties-Product-Info-Actor-scraper

🛍️ Scrape product info from Lefties.com, turning it into structured data to...

21
Experimental
3916 juanfrilla/wavefinder

Scraping windguru to interpret when there are good conditions to surf

21
Experimental
3917 rishijha/sitemap-harvester

🗺️ Harvest URLs and metadata from website sitemaps efficiently with this...

21
Experimental
3918 mahdi5050/data-science-project

🍷 Predict wine quality using machine learning with this Jupyter Notebook,...

21
Experimental
3919 spider-rs/spider-example-content-extractor

Extract structured content, images, and links from websites. Powered by Spider Cloud.

21
Experimental
3920 axelmitschidev/scraper-immo

🕷️ Web scraper pour les annonces immobilières françaises

21
Experimental
3921 abuazzam/SholatScrape

Web Scraping Jadwal Sholat

21
Experimental
3922 alvinmurimi/jumia

Data analysis on smartphones listed on jumia.co.ke

21
Experimental
3923 CastixGitHub/uochitoki-website

www.fiscerprais.com/uochi/ https://castixgithub.github.io/uochitoki-website/

21
Experimental
3924 ErosNicolino/tech-challenge-books-api

API RESTful em Flask para consulta de livros, com scraping automatizado.

21
Experimental
3925 zoilomora/xiaomi-mi-fit-data-export

Export data from Xiaomi Mi Fit in the most automated way possible

21
Experimental
3926 OzelTam/OnionCrawler

Tool to crawl .onion websites. Console & Web UI

21
Experimental
3927 johannesuhl/mapprocessor

A python-based pipeline to query the USGS Historical Topographic Map...

21
Experimental
3928 paritoshtripathi935/Flipkart_Scraper

This is a scraper designed to extract product information from Flipkart, an...

21
Experimental
3929 ValdePerryJunior/AI-english-learning-assistant-using-Vite-React

This is created using Vite+React

21
Experimental
3930 okonb/recover-youtube-playlists

Recover your playlists removed by YouTube's community guidelines bots

20
Experimental
3931 tomas-sexenian/QuoteScraper

Fully functional web scraper to prove I know how to scrape and properly...

20
Experimental
3932 ezzhood/LinkCollector

LinkCollector is web-crawler which collects links of given host recursively

20
Experimental
3933 Akimyou/onigiri_jp_dict

饭团日语词典 是 Alfred 3 的一个 Workflow,用于快速查询日语单词( 日 -> 中 ),查询结果除基本信息外,还包含读音与例句等。

20
Experimental
3934 LF3551/Apple-Music-Playlist-Scraper

Python script for scraping song data from Apple Music's "Today's Hits" playlist.

20
Experimental
3935 professorDeveloper/Soplay

SoMovie which you can watch movies in uzbek language

20
Experimental
3936 tunhacker/pararius-scraper

🏠 Scrape rental listings from pararius.com, extracting detailed property...

20
Experimental
3937 cedoor/scraper

:tractor: Simple desktop scraper app.

20
Experimental
3938 igorkosta/crossfit-wod

Random WOD from https://crossfit.com/. Available here:...

20
Experimental
3939 crawlbase/proxycrawl-java

ProxyCrawl Java library for scraping and crawling

20
Experimental
3940 zdimension/ade-scraper

Scrapes entries from ADE Planning (ADE Web Direct Planning system) to...

20
Experimental
3941 oxylabs/automated-web-scraper-autoscraper

This tutorial shows how to automate your web scraping processes using...

20
Experimental
3942 Decodo/amazon-price-scraping-google-sheets

🛒 Scrape Amazon product prices and sync them automatically with Google...

20
Experimental
3943 saadk555/WildDork

A python program which can be used for specific data retrieval from google searches

20
Experimental
3944 YStorm5/scrape

Library to scrape data from a website.

20
Experimental
3945 duskvirkus/scraping-scripts

A collection of web scraping scripts I've made for collecting images off the...

20
Experimental
3946 Solrikk/DataDigger

DataDigger is a powerful and intuitive web application designed to extract...

20
Experimental
3947 ignaciolinari/FairFare

A ride-hailing price comparison app that aggregates fare estimates from...

20
Experimental
3948 fortunatoman/Real-Estate-AI

AI-powered real estate GPT that provides property insights, market analysis,...

20
Experimental
3949 ManuUBA/EMBI-Argentine-API

This repository provides scripts to automate web scraping of the current...

20
Experimental
3950 luminati-io/Shein-dataset-samples

A sample dataset of over 1000 Shein products, extracted using the Bright...

20
Experimental
3951 ausdavoud/unif

Automated University Notification

20
Experimental
3952 pim97/scrapfly-scrapers-scrappey-wrapper

A wrapper for the more cheaper alternative - scrappey - for scraping 40+ sites

20
Experimental
3953 AleksaMCode/university-notices-email-notifier

Dynamic website scraper and email notifier.

20
Experimental
3954 hazadus/readwise-links

Репо сохраняет все ссылки, highlights и заметки из Readwise Reader в...

20
Experimental
3955 sinanazem/web-crawling-jobinja

This project is a web scraper designed to extract information from the...

20
Experimental
3956 cikay/kurdish_scrapy

A Scrapy package based web scraper for collecting Kurdish text data from...

20
Experimental
3957 dmathijs/email-scraper

Email scraper is the JS version of 'https://github.com/kichik/email-scraper'

20
Experimental
3958 noppakorn/ddc-dashboard-scraping

Scraping Thailand COVID-19 data from the DDC's tableau dashboard

20
Experimental
3959 LloydJI/R-project-Crypto-Stock-Return-Data-Calculating-Returns-Uncorrelated-Clusters

This project involves scraping cryptocurrency and stock price data in R....

20
Experimental
3960 CosmicHorrorDev/pubproxpy

An easy to use Python wrapper for pubproxy.com

20
Experimental
3961 Windfarer/biu

biubiubiu~~ I'm a tiny web crawler framework

20
Experimental
3962 pChitral/University-at-Buffalo-Faculty-Web-Scraper

A Python web scraping tool to extract data from a faculty directory website....

20
Experimental
3963 vladimanaev/web-spider

web crawler allowing full page render crawl using HtmlUnit

20
Experimental
3964 Ian-Lin8239/javdb_magnet

JavDB 磁力鏈接專用工具 - 自動獲取有碼月榜影片的磁力鏈接,支持智能過濾和多格式導出

20
Experimental
3965 hrbrmstr/drill-html-tools

Apache Drill UDFs for retrieving and working with HTML text

20
Experimental
3966 uma-oo/Aljazeera-Scraper

The project is about scraping articles from aljazeera.com by asking the user...

20
Experimental
3967 lsubotic/aspx-page-scrape

Scraping an .aspx website using bs4 and requests only.

20
Experimental
3968 RomySaputraSihananda/kafka-ES-DataPrakiraanCuaca

Simulasi transmisi data hasil crawling dari DataPrakiraanCuaca menggunakan...

20
Experimental
3969 dori-dev/news-reader

Advanced news reader website using django and celery.

20
Experimental
3970 WhiteeRabbit/dork-seeker

Simple Automatizated Google dorker script written in python

20
Experimental
3971 Aboodseada1/Email-Finder

A Python script to find potential email addresses associated with a company...

20
Experimental
3972 PSarapata/Moto_Crawler

My CodersLab final project, car-selling-portal web scraper with...

20
Experimental
3973 Concrete18/Steam-Library-Tracker

Steam Library Tracker made easy by keeping up with what you have played and...

20
Experimental
3974 MichaelYochpaz/DWScraper

A Python web-scraper for downloading DigitalWhisper issues and articles.

20
Experimental
3975 ihsansencan/FR-Gouv-Domains-Analyzer

🔍 Analyseur des Domaines du Gouvernement Français • Outil complet pour...

20
Experimental
3976 duyndh98/MangaProject

A Manga Crawler and Viewer Project (truyentranh.net)

20
Experimental
3977 nonioAlber/facebook-pages-details

Facebook page contact info scraper with low resource usage

20
Experimental
3978 PedroTejon/Job-Search-Assistant

A Django application developed to assist people looking for a job, joining...

20
Experimental
3979 orestesgaolin/rns-statystyki

Statystyki odtworzeń Radia Nowy Świat

20
Experimental
3980 Mediashare/scraper

:dizzy: Scrapes the information from the targeted page and provides a DomCrawler.

20
Experimental
3981 MCStreetguy/Crawler

An advanced web-crawler written in PHP.

20
Experimental
3982 steven-mercatante/soup

A command line web scraper that lists Hale and Hearty soups

20
Experimental
3983 amrnima/BrokenLinkFinder

A simple yet powerful Python CLI tool for technical SEO audits. Find and fix...

20
Experimental
3984 marcelo-m7/Scrappers

A Python script for downloading all images from a specified Instagram profile.

20
Experimental
3985 yusufesatt/kariyernet-jobpost-scraper

This project collects the link, title, company, location and experience...

20
Experimental
3986 paulnamalomba/MSE-GenAI-Agent

Automated scraping and analysis pipeline for Malawi Stock Exchange financial...

20
Experimental
3987 jaqubowsky/jobZ

Fullstack AI-powered job matching platform. Scrapes Polish job portals,...

20
Experimental
3988 elabandari/edsc

A dashboard for detecting business fraud.

20
Experimental
3989 ImMau14/TScrapingBot

Mi bot de Telegram para web scraping | My web scraping Telegram bot

20
Experimental
3990 Dhuvie/DashCode

A full-stack analytics platform for competitive programmers. Track...

20
Experimental
3991 miketvo/rime-ime-han-nom-data

Han Nom Telex schema and dictionary data for Rime Weasel/Squirrel IME https://rime.im

20
Experimental
3992 mtralka/YB-Tracking-GPS-Scraper

Scrape nautical route data from YB Tracking Marine GPS Units

20
Experimental
3993 mzkwcim/pyswimrankings

Python client for scraping and parsing swimming data from swimrankings.net

20
Experimental
3994 ClassicalClemi/python-hltv-scraper

A simple and open-source HLTV.org web scraper built with Camoufox and...

20
Experimental
3995 harivonyR/Leboncoin_scraping

Leboncoin_Scraping is a Python project designed to extract classified ads...

20
Experimental
3996 galile0ff/galileoff-WebScraper

Go ile yazılmış, HTML çekme, screenshot alma, gömülü linkleri çekme ve...

20
Experimental
3997 yomazini/RedScraperPro

RedScraperPro: a Powerful OpenSource Cross-Platform & Feature-Rich (CLI)...

20
Experimental
3998 galile0ff/galileoff-OnionScraper

Go ile yazılmış, .onion uzantılı sitelerden HTML çekme, screenshot alma,...

20
Experimental
3999 Ezeg0r/cses-telegram-bot

A Telegram bot for tracking CSES problem-solving progress using Python,...

20
Experimental
4000 vickyfriss/Football-analytics

Exploring football and other sports through data. Includes analyses of match...

20
Experimental
4001 joybiswas007/rutracker-api

Unofficial RuTracker API written in Node.js.

20
Experimental
4002 Data-Wrangling-with-JavaScript/Chapter-4

Code examples for Chapter 4 of Data Wrangling with JavaScript

20
Experimental
4003 VexMare/Kook_Dy_Down

🤖 基于Kook平台的智能抖音视频下载机器人 | 自动检测抖音链接,下载视频和封面图片到Kook | 支持多链接备用、随机请求头、智能去重 |...

20
Experimental
4004 darren7753/vidio_google_play_store_reviews

Analyzing Google Play Store reviews of the Indonesian streaming platform...

20
Experimental
4005 schalkneethling/linklens

Accepts a URL, returns the title, description and SocialShare image

20
Experimental
4006 StadynR/metacritic-reviews-dataset

A comprehensive dataset of Metacritic reviews, curated and formatted, with...

20
Experimental
4007 VolkanSah/Python-XPath-Tutorial

XPath is a query language used for selecting nodes in an XML or HTML...

20
Experimental
4008 KasumiL5x/hltb-scraper

A web spider that crawls HowLongToBeat to extract game and completion time data.

20
Experimental
4009 modbender/manga-extractor

A simple manga extractor. Extracts any comic info, chapter list and chapter...

20
Experimental
4010 nberlette/f1

Automated image scraper powered by Deno KV and GitHub Actions. Scrapes a...

20
Experimental
4011 rbwtech/easy-to-you-automation

Quickly and easily decrypt ioncube encoded PHP scripts. works using...

20
Experimental
4012 pierridotite/ArbitrageOdds

A Python project designed to scrape football match odds from OddsPortal and...

20
Experimental
4013 Tiarait/Universal-Bot

Telegram Bot – multi-language bot for math calculations, media downloads,...

20
Experimental
4014 matthewnau/testudo

Search and get notified for openings in course sections.

20
Experimental
4015 chanderbhanswami/texas-data-scraper

A comprehensive, production-ready toolkit for scraping and processing data...

20
Experimental
4016 eeriemyxi/novi

A dictionary for your terminal.

20
Experimental
4017 parvvaresh/PriceScraperCLI

simple Go CLI app that scrapes live prices

20
Experimental
4018 MortalityWatch/apify

Scraper layer for browser-only mortality data sources

20
Experimental
4019 Sacode/firecrawl-simple-mcp

MCP server for Firecrawl Simple — a web scraping and site mapping tool...

20
Experimental
4020 yuna0x0/playboard-crawler

Playboard YouTube Super Chat Statistics Crawler

20
Experimental
4021 artdgn/jobs-ranker

Jobs-ads relevance learner, ranker, deduplicator, and scraper. Webapp or...

20
Experimental
4022 sukanyabag/Statistical-Analysis-of-My-Medium-Articles

This repository contains an exploratory data analysis of my writer data at...

20
Experimental
4023 car-mrazomor/Note-Scraper

💎 Scraper for scraping data from https://www.notebooksbilliger.de/

20
Experimental
4024 Jyuukun/PS5-Alerts

Get a notification when a PS5 is available dude !

20
Experimental
4025 thomas-touhey/visyerres_sgdf_woob

Modules Woob pour l'intranet et autres sites Scouts et Guides de France (SGDF).

20
Experimental
4026 nguyentruongnam123/how-to-scrape-fiverr-in-nodejs

Extract Fiverr listing data in Node.js by using an Apify actor without...

20
Experimental
4027 lakshman-chaudhary/torrscrapper

web scrapper designed to extract magnets for various types of media, such as...

20
Experimental
4028 haandol/claudecrawl

ClaudeCrawl is clone of FireCrawl's web scraping feature

20
Experimental
4029 Quesys-tech/manaba-scraping

This is a script that scrape assignments which haven't been submitted, and...

20
Experimental
4030 Mithurn/instagram-profile-webscraper

A full-stack web application that scrapes data from public Instagram...

20
Experimental
4031 fcfmclub/data

Datos normalizados de la FCFM - Universidad de Chile.

20
Experimental
4032 Kimdonghyeon7645/Crawling-Book

🧾🔍 끝내주는 크롤링&메크로 스크립트를 작성하는 방법 (with Python)

20
Experimental
4033 hmmhmmhm/pattern-grab

🤛🏻 Regular Expression Data Grabber

20
Experimental
4034 security-analyzer/core

🕵️ The core packages of security analyzer web crawler

20
Experimental
4035 covertchannelblog/alterego

Adversarial HTTP proxy for replicating real browser TLS and HTTP fingerprints

20
Experimental
4036 Dashstrom/Disboard-searcher

Script for get some discord server on disboard with keyword

20
Experimental
4037 JingBing-GHT/Universal-Web-Scraper-GUI

带有GUI界面的Python网页爬虫工具,支持批量数据采集和Excel导出。适合数据挖掘、竞品分析和市场研究。

20
Experimental
4038 peterdalle/mechanicalnews

Web server app that crawls and saves news articles, provides article API for research

20
Experimental
4039 thekaushalk/music-transcriber-app

Containerized Flask web app for musicians to separate and transcribe stems...

20
Experimental
4040 lblb23/auto-content-reddit-telegram

Example of autoposting content (only pictures) from subreddit "Instagramreality"

20
Experimental
4041 re4/latest-useragents

Latest UserAgents Dumped Various Devices / Platforms

20
Experimental
4042 shivamsaraswat/webxcrawler

WebXCrawler is a fast static crawler to crawl a website and get all the links.

20
Experimental
4043 prateek2211/musiload-go

Download songs from any music website

20
Experimental
4044 encodeous/dirtyproxy

A quick and dirty proxy scraper.

20
Experimental
4045 0MeMo07/Web-Crawler

Web Crawler with Python

20
Experimental
4046 rioagungpurnomo/pyscraping

PyScraping is a universal web-scraping util for Python, built with...

20
Experimental
4047 medecau/scrapedict

Scrape HTML to dictionaries

20
Experimental
4048 scrape-do/node-client

Scrape.do's official http client for node.js

20
Experimental
4049 luminati-io/Indeed-dataset-samples

A sample dataset of over 1000 Indeed job listings, extracted using the...

20
Experimental
4050 chess-king-dot/facebook-scraper

Scrape Facebook public pages without an API key

20
Experimental
4051 le-quentin/free-stock-tickers

Freely fetch live stock data by scraping web pages

20
Experimental
4052 uyar/piculet

Extract data from HTML, XML or JSON documents using XPath or JMESPath.

20
Experimental
4053 proxyport/scrapy-proxyport

Proxy Port integration with Scrapy framework.

20
Experimental
4054 saifrehman100/web-scraping-automation-pipeline

Automated e-commerce price tracking system with web scraping, email alerts,...

20
Experimental
4055 samgozman/rvp

🦀 Remote Value Parser - CLI tool for parsing string values from static web...

20
Experimental
4056 leoz0214/Parkrun-Data-Scraper

Scrape the historical summary table for a particular Parkrun event and...

20
Experimental
4057 DescobertasDigitais/Maya

Maya é uma ferramenta em Python que gera dados de pessoas totalmente...

20
Experimental
4058 sasmithx/FlaskDataMateX

FlaskDataMateX is a Python Flask-based web application designed to manage...

20
Experimental
4059 RomySaputraSihananda/instagram-comment-scrapper

Get all comments from instagram post url or id

20
Experimental
4060 shivamparikh/partisan

An analysis of the partisan behavior for the U.S. House of Representatives...

20
Experimental
4061 ciroduro01/Programacion_con_Python

Portafolio de Proyectos: "Programación con Python" | 'Programming with...

20
Experimental
4062 Vipul999ujawane/PING

Professor INformation Gatherer (PING)

20
Experimental
4063 dannguyen/scrape-senate-financial-disclosures

looking at U.S. Senators' disclosures, including how to parse and track them

20
Experimental
4064 yusufesatt/semantic-analysis-of-product-reviews

By entering the URL of a product on Trendyol and the number of comments the...

20
Experimental
4065 riodevnet/elephscraper

ElephScraper is a lightweight and PHP-native web scraping toolkit built...

20
Experimental
4066 Prosdo-com/Quantum-Driven-Cloudflare-WAF-Rule-Framework-QDRF-

Cloudflare WAF rule management and behavioral security against scraping

20
Experimental
4067 ganevdev/actor-webdesignernews-scraper

Scraper for www.webdesignernews.com, using Apify.

20
Experimental
4068 bal-r/Stock_Data_Scraper

Fast and multi threaded stock data scraper written in Java using HTMLUnit...

20
Experimental
4069 jamesbcook/peepingJim

A take on peepingTom in GO

20
Experimental
4070 Jacobzwj/telegeo

A python package for scraping Telegram data based on geolocation

20
Experimental
4071 phpscrapers/netflix

Unofficial API crawler to get Netflix viewing history.

20
Experimental
4072 baruchiro/delete-tweets

Automatically delete all your Twitter (Circle) tweets

20
Experimental
4073 u82jm9/backend

Small Backend Java project to support React Frontend

20
Experimental
4074 s-c-wang/memorizingVocabularyUsingForgettingCurve

A Python program helps you to memorize words based on the psychologist...

20
Experimental
4075 teomores/epl-oracle

Predicting EPL results improving the betting odds.

20
Experimental
4076 MaxwellMetzner/Amazon-Bestseller-Extractor

Instantly extract Best Sellers Rank categories and links from any Amazon...

20
Experimental
4077 LironOhana/nba-allstar-prediction-scraper

B.Sc. project — NBA All-Star prediction with automated data collection...

20
Experimental
4078 KathanS/ai-agenttools

Semantic Kernel plugins for AI agents: File I/O, Excel, Word, PowerPoint,...

20
Experimental
4079 lhotanok/erasmus-plus-organisation-scraper

Search organisations from Erasmus+ and European Solidarity Corps programmes....

20
Experimental
4080 rooneyrulz/agentic-job-finder

AI-powered job search API using FastAPI, LangGraph agents & Groq LLM....

20
Experimental
4081 Vaciuum/Statistico

AI-powered research system that extracts statistics from web content with...

20
Experimental
4082 BBC-Data-Unit/music-festivals

Festivals dominated by male acts, study shows, as Glastonbury begins

20
Experimental
4083 ScrapingBee/costco-scraper

Costco Scraper API for extracting product data, pricing, and category...

20
Experimental
4084 Igomigo/SmartPickr

🛍️🧠🔎⚖️ SmartPickr is a decision-making engine for smarter shopping. it helps...

20
Experimental
4085 CodeWithBehnam/x-extractor-extension

A powerful Chrome extension to extract post data from X.com with analytics,...

20
Experimental
4086 nestorchurin/proxy-list

A fully automated Python-based proxy scraper and checker. Provides fresh...

20
Experimental
4087 Alperencode/DergiPark-Project

DergiPark - Web Scraping Project

20
Experimental
4088 jkerai1/GeneratePasswordListFromWebsite

Scrape website for Top Keywords then produce word associations

20
Experimental
4089 jaredkrinke/link_checker

Link checker and web crawler for Deno

20
Experimental
4090 OoriData/WebScout

Web Scout is a tool for monitoring & summarizing web content, iterating over...

20
Experimental
4091 theycallmemac/dcurooms

A command line tool used to display room information and book and request rooms.

20
Experimental
4092 zakattack9/stockup

A React application utilizing APIs and web scraping for gathering news and...

20
Experimental
4093 giulio-derasmo/Information-Retrieval-over-MyAnimeList

Web scraping of the site MyAnimeList in order to build a search engine on...

20
Experimental
4094 dfamonteiro/FEUP-exams-website

The FEUP exams website no one asked for

20
Experimental
4095 belsman/Ruby-Capstone

This project entails building a program that crawls daily data about...

20
Experimental
4096 engelgatus/onlinejobs-scraper

Automated job scraper for OnlineJobs.ph with Discord notifications and...

20
Experimental
4097 oxylabs/curl-post-requests

Learn how to send POST requests with cURL.

20
Experimental
4098 arthur3486/born2crawl

A highly performant and versatile crawling engine, designed with scalability...

20
Experimental
4099 theDeepanshuMourya/Ikea-WebScraping-Classification

A repository to perform data collection of images using web scraping...

20
Experimental
4100 rkwyu/sport-betting-data

Web Scrapper for Sport Betting Data, such as Horse Race & Football Odds from...

20
Experimental
4101 luminati-io/Facebook-dataset-samples

A sample dataset of over 1000 Facebook posts, extracted using the Bright...

20
Experimental
4102 lenoarditrryh/scraping

The Ultimate Guide to Web Scraping APIs in 2025

20
Experimental
4103 evomi/residential-proxies-instructions

Code Integrations for our Swiss Quality Residential Proxies in multiple...

20
Experimental
4104 luminati-io/Google-Maps-Scraper

Extract Google Maps data, including reviews, ratings, photos, and more, with...

20
Experimental
4105 DenimEvert/botasaurus-capsolver

A robust Python solution using Botasaurus and CapSolver to automatically...

20
Experimental
4106 willzma/BuzzPlan

A scheduling app for Georgia Tech with some advanced tools

20
Experimental
4107 spekulatius/phpscraper-keyword-scraping-example

Simple example of a few ways to extract keywords from a website

20
Experimental
4108 Adamouization/Formula1-Crash-Stats

:car: :collision: :car: Flask web application parsing F1 DNF stats from...

20
Experimental
4109 ohhsodead/FTP-Crawler

Basic file crawler written for fun.

20
Experimental
4110 rossriserose/colly

Elegant Scraper and Crawler Framework for Golang

20
Experimental
4111 metabypass/captcha-solver-ruby

Metabypass | Ruby-based easy implementation for solving any type of captcha...

20
Experimental
4112 andredarcie/best-games-of-all-time-data-based

🏆 Definite Best Games Of All Time Data Based by multiple sources

20
Experimental
4113 gumob/ImageExtract

A Swift library to allows you to extract the size of an image without downloading.

20
Experimental
4114 GuechtouliAnis/Football-Data-Scraping

A Jupyter Notebook project to scrape detailed football data from FBref,...

20
Experimental
4115 my8100/scrapyd-cluster-on-heroku-scrapydweb-app

How to set up Scrapyd cluster on Heroku

20
Experimental
4116 sai15235/web-scraping-project-on-covid--19

Built a Python web scraper to extract COVID-19 data, clean it using pandas,...

20
Experimental
4117 ashkan0201/QR-Code-Portfolio

A modern, interactive QR Code portfolio page for Ashkan Norouzi. Showcases...

20
Experimental
4118 Gulkhan0987/cruisemapper-ships-scraper

cruise ship data extraction tool

20
Experimental
4119 bibhu342/Web-Extractor-Pro

Python-powered web data extraction tool — Scrape → Clean → Export with...

20
Experimental
4120 ALIM-dd/TikTok-Full-API-Pro

TikTok Full API Pro 2026 — 自动化工具 / Auto Like / Auto Follow / Video Download...

20
Experimental
4121 ShafiqSadat/KankorRobot

Afghanistan Kankor Results Robot

20
Experimental
4122 JomolJudit/stock-data-analysis

Extracting, processing, and visualizing historical stock & revenue data...

20
Experimental
4123 Durhamster/Sports_Teams_Data_Scrape

A python script for scraping historical team standings data from...

20
Experimental
4124 roofman2008/AdvancedSouqScrapper

The Most Advanced Souq Scrapper on The Web

20
Experimental
4125 bachig26/porn-cli

A cli tool to browse and watch porn.

20
Experimental
4126 gayanukabulegoda/Web-Scraping-Starter-Kit

Repository designed to help freshers easily grasp the basics of web...

20
Experimental
4127 Efflexion/efflexion-tools

A curated toolkit of scripts, models and dashboards turning raw data into...

20
Experimental
4128 PetrosIbrah/Data-Retrieval

Web Scraping articles and creating Search Engines

20
Experimental
4129 filesite-io/herounion

Open source web scraper union. 一个开源的去中心化网络爬虫联盟,旨在建立一个爬虫、机器共享的联盟。

20
Experimental
4130 RomySaputraSihananda/craw-kompas

crawling and scrapping data from the kompas news website

20
Experimental
4131 Reaper2403/Social-Intelligence-Pipeline

A production-grade, modular ETL pipeline that extracts high-signal Reddit...

20
Experimental
4132 JackDanHollister/UkTop100Scrape

This project scrapes data for every top 100 weekly singles and albums from...

20
Experimental
4133 daserhabene/snu-sugang-accum-ui

서울대학교 수강신청 과목 목록을 누적 수집하고 CSV로 내보내는 Chrome 콘텐츠 스크립트 (과목 개요 수집 지원). ...

20
Experimental
4134 KenzoBH/Regress-Twitter-Bot

A bot on Twitter that posts predictions on the financial market everyday.

20
Experimental
4135 Fizzsh/CamHunt

An extensive IP Camera scraping tool with country, state and city selection...

20
Experimental
4136 execuxion/execuxion

No-code/low-code visual workflow builder for social media automation, data...

20
Experimental
4137 data-f0undry/WooCommerce-Website-Scraper

Free WooCommerce Scraper (Python). Extract Payment Method, Products, Prices,...

20
Experimental
4138 TUVIMEN/tube8-scraper

A bash script for archiving tube8 pages in json

19
Experimental
4139 jacekciesielski/grpc-web-scraper

A grpc-web scraper

19
Experimental
4140 jollyboss123/tcg_my-server

server for TCG.MY

19
Experimental
4141 Flexvent/AioProx

🔍 Fetch and manage asynchronous HTTP/SOCKS proxies in Python, with testing...

19
Experimental
4142 Ucok23/glsl-script

A lightweight, declarative WebGL2 micro-framework for modern browsers. It...

19
Experimental
4143 futureprogrammer360/Python-Web-Scraping-Snippets

🌐 Collection of Sublime Text snippets for web scraping in Python

19
Experimental
4144 AKrekhovetskyi/tech-trend-stat

Analyzer of technology statistics based on job descriptions.

19
Experimental
4145 hideaki-kawahara/scrapy-source

Sample code for scraping with Python Scrapy.

19
Experimental
4146 jingjue/simple-distributed-crawler

第四届青训营大数据基础班6806队的简易分布式爬虫系统

19
Experimental
4147 ThePredictiveDev/Search-Reddit-Term-Based-Scraper

Advanced Reddit mention tracker with FastAPI+Gradio, async pipeline, ML...

19
Experimental
4148 Capybasilisk/SFF-Scraper

Script for scraping the Internet Speculative Fiction Database and building...

19
Experimental
4149 prodseanb/cryptocheck

Keep track of the latest cryptocurrency data with CryptoCheck.

19
Experimental
4150 NijatZeynalov/Scraper-Chatbot

Scraper chatbot which answer more than a half bilion questions.

19
Experimental
4151 airscholar/PunchScraper

A News Web scraper Using Python

19
Experimental
4152 al-matty/telegram-merch-bot

a Python-based Telegram bot that sends out an infographic with some...

19
Experimental
4153 bazuker/browserbro

Turn any website into an API with BrowserBro.

19
Experimental
4154 3nws/beako-bot

Discord bot to save myself a couple clicks.

19
Experimental
4155 AkberJag/flipKsrapt

A python based data mining tool for extracting information from Flipkart

19
Experimental
4156 luminati-io/ZoomInfo-dataset-samples

A sample dataset of over 1000 ZoomInfo companies, extracted using the Bright...

19
Experimental
4157 Friztutu/hh.ru_scraper

✎📓Parser of vacancies on hh.ru

19
Experimental
4158 spekulatius/phpscraper-keyword-length-distribution-example

Example to demonstration the parsing of keywords as well as the simple...

19
Experimental
4159 Ian-Gabaraev/psstorereader

The New PlayStation Store API wrapper

19
Experimental
4160 covuworie/nobel-physics-prizes

Predicting Nobel Physics Prize winners. Final project for Harvard CS109a...

19
Experimental
4161 fabyr/bayernatlas-heightmapper

Small C# application to download heightmaps from geoportal.bayern.de/bayernatlas/

19
Experimental
4162 armanyazdi/car-price-estimator-swing

An Iranian used car price estimator written in Java Swing.️

19
Experimental
4163 CanXploit/StealthScrape

StealthScrape is a powerful and efficient file-scraping tool designed to...

19
Experimental
4164 mike4ai/FootballResults

Using python scrapy and prettytable to create a program that gives you the...

19
Experimental
4165 skyhancloud/aol-takip

AOL Takip is a simple Node.js application that periodically checks for new...

19
Experimental
4166 MadhavPruthi/Email-Scraping-from-publication

Given DOI of a publication, web app can dynamically pull out all the...

19
Experimental
4167 gorkemozkan/koeri-scraper

An application for scraping, filtering, and reporting earthquake data from...

19
Experimental
4168 jonathanprocter/byok-web-scraper

A standalone web application for secure web scraping using Claude AI. Zero...

19
Experimental
4169 MattMoony/t0m

Tellonym scraper and information gathering tool. Might be useful for getting...

19
Experimental
4170 harishartanto/detikcom-scraper

A Python-based CLI program for scraping news content from Detikcom news...

19
Experimental
4171 rohityadav-sas/IOE-IOM-Notice-Alert-Bot

IOE-IOM Notice Alert Bot is a Node.js Telegram bot that fetches and delivers...

19
Experimental
4172 jurkovicmartin/Recipes-Project

Wrapper for recipes from web.

19
Experimental
4173 bhattbhavesh91/amazon-ratings-reviews-scrapper-python

A simple Python web scraper to extract Reviews & Ratings from Amazon's...

19
Experimental
4174 fernandod1/Lottery-numbers-scraper

Script to scrap lottery numbers from Lottomatica Italia website and inserts...

19
Experimental
4175 Debajyoti0-0/TriNetra

TriNetra is a fast web recon tool that uncovers hidden endpoints, API keys,...

19
Experimental
4176 JonaszPotoniec/telegramRedditBot

This is a telegram bot for sending photos from reddit

19
Experimental
4177 bit97/onthisday

Python library for scraping the web for events that happened on current day,...

19
Experimental
4178 bednarjosef/neuroguessr

Neuroguessr is a 430M parameter visual transformer model fine-tuned on 1.2M...

19
Experimental
4179 bku941025-arch/xkcd-web-scraper

Python CLI web scraper that downloads XKCD comics

19
Experimental
4180 amorehead/realtor-estate-py

A Python web scraper written to help collect probate real estate data in an...

19
Experimental
4181 GuilhermeLossio/Tech-Challange-FIAP-1

RESTful API built with Flask and SQLite for scraping and serving book data...

19
Experimental
4182 cpatrickalves/scraping-findadentist

This projects contains a set of scripts to scraping Dentists data from...

19
Experimental
4183 Andrew-Costa-10114/disord_bot_echo

It is a discord_echo_bot is made by me using Javascript.

19
Experimental
4184 RayaanKhanGH/Transcendence-T1

Transcendence-T1 is an advanced cyber intelligence OSINT (Open Source...

19
Experimental
4185 pza007/wfrp_4_npc_generator

WARHAMMER Fantasy Roleplay 4th edition - NPC Generator

19
Experimental
4186 mmaguero/guarani-tweets

Download guarani-dominant tweets

19
Experimental
4187 mfakca/Car-Price-Prediction

tasit.com sitesi üzerinden satılan arabaların verilerinin toplanarak....

19
Experimental
4188 TheLastGimbus/APiS-Scraper

Python web scraper for getting Polish political parties support percentage!

19
Experimental
4189 rodrigotesone1997/Scrapper_Sueldos_Municipales

Código para scrappear la pagina de Rosario, descargar su contenido y...

19
Experimental
4190 ohaswin/weheartpy

A fast, reliable API wrapper for weheartit.com

19
Experimental
4191 Simple-Python-Scrapy-Scrapers/google-scrapy-scraper

Advanced Google Search, News, and Images Scraper built with Python Scrapy...

19
Experimental
4192 DKeAlvaro/UFC-Scraper-ML

Scraping UFC data and building predictive models

19
Experimental
4193 andrianllmm/tgl-dictionary-parser

Parser for a Tagalog dictionary website

19
Experimental
4194 caleblawrence/garland-tx-police-activity

Downloads, parses, and plots the Garland, TX police incident report PDF,...

19
Experimental
4195 rasmuskampmann1998/Market-Intelligence-Dashboard

market-intelligence-dashboard AI-powered Python system for collecting,...

19
Experimental
4196 clj0020/python-web-crawler

Python Web Crawler implementing Iterative Deepening Depth Search

19
Experimental
4197 Simple-Python-Scrapy-Scrapers/youtube-scrapy-scraper

Professional YouTube data scraper built with Scrapy framework. Extract video...

19
Experimental
4198 Ian-Lusule/ReconX

ReconX is a comprehensive, fast, and modular Python-based tool designed for...

19
Experimental
4199 hrbrmstr/madhttr

🎩Tidy Helper Methods for Many Types of Unkempt Internet Metadata and Content

19
Experimental
4200 darideveloper/europeanstartups-scraper

Python scraper for extract data from the page europeanstartups, using...

19
Experimental
4201 mik-sklyar/chrome-automato

Проект для автоматизации работы браузера Google Chrome с использованием...

19
Experimental
4202 jhonverde/validez-cpe-sunat

Verificar declaración de comprobantes electrónicos (CPEs) en SUNAT

19
Experimental
4203 Skarian/foodiefinder

A Rust-powered desktop app using Tauri and Next.js to fetch, scrape, and...

19
Experimental
4204 KurKigal/Stock-Price-Predictor

A Python web application that scrapes historical stock data from Yahoo...

19
Experimental
4205 bmarwell/ffb.depot.client

Ein Java-Client für FFB-Depots. Features: Stammdaten und Depotbestände...

19
Experimental
4206 riteshporiya/gsmarena-device-scraper

An Express.js-based web scraping tool for extracting structured and...

19
Experimental
4207 code3743/sira-auth

SIRA Auth – Node.js service for authenticating Univalle students and...

19
Experimental
4208 jormunrod/CryptoExtract

CryptoExtract is a web application designed as a final project for the...

19
Experimental
4209 megamillions/Image-Site-Downloader

Takes a search term then crawls through your favorite image site to download...

19
Experimental
4210 amajji/Web-Scraping-with-Scrapy-

This project aims to scrap a US government website using the Scrapy framework

19
Experimental
4211 Xinzhang-Chen/tos-crawl

ToS-Crawl is a stealth-enabled crawler that extracts and recursively...

19
Experimental
4212 maxbarsukov/korol-i-shut-lyrics-parser

🍯💀 Allows you to collect all the lyrics of your favorite band

19
Experimental
4213 lvliangxiong/scirob-paper-download

A web crawler capable of downloading all academic papers on Science Robotics...

19
Experimental
4214 hrbrmstr/crux

Identify the Crux of an Article

19
Experimental
4215 Mostafa-wael/Exploring-the-Landscape-of-the-Egyptian-Software-Market

A Data-driven Approach. Our story begins with a quest for knowledge. The...

19
Experimental
4216 Spaames/babelio-scraping-api

[Flask] Scraping API - Retrieves book information from the babelio website

19
Experimental
4217 filipe-braiman/spacex-falcon9-landing-prediction

A notebook‑driven data science pipeline that collects, cleans, analyzes, and...

19
Experimental
4218 JCLOH98/subreddit-scraper

A web scraper for extracting and analyzing data from subreddits.

19
Experimental
4219 santteegt/facebook-scraper

Forked from https://github.com/jcontini/facebook-scraper and improved for...

19
Experimental
4220 YoussefBechara/ForexFactory.com-News-Scraper

A web scraping tool that extracts economic calendar data from...

19
Experimental
4221 ThunderMikey/super-dumper

covert order items from supermarkets to CSV

19
Experimental
4222 affeswajdi/uniqlo

👕 Discover a simple tool to manage and organize your Uniqlo wardrobe...

19
Experimental
4223 sorzkode/nde_study

An analysis of near-death experiences (NDEs) scraped from https://iands.org/

19
Experimental
4224 GenjiKuto/canadiantire-ca-scraper

Extract products, prices, and ratings

19
Experimental
4225 HackfutSec/EnvSpy

EnvSpy: Uncover and extract hidden .env files with ease – your ultimate tool...

19
Experimental
4226 jrbgit/crypto-analytics

AI-powered crypto analytics: automated data collection, web scraping, and...

19
Experimental
4227 DtCarrot/sg-food-ml

This script is used to scrap images from the Internet to classify 5 common...

19
Experimental
4228 ksu-is/Foodrecipe-scraper-1

This is a scrape program, designed to deliver ideas for what to make for dinner.

19
Experimental
4229 andrewgcodes/bio2csv

scrape biorxiv in one line of code.

19
Experimental
4230 mrizwan47/serp-outreach-finder

A simple CLI tool to search for 'Write for us' opportunities based on a...

19
Experimental
4231 JoshuaMarkle/sandwich

An assignment management tool that "sandwiches" assignments into a single calendar

19
Experimental
4232 ly0va/space-app

App for NASA Space App Hackathon 2018

19
Experimental
4233 gautam132002/yellow-page-scraper-it

Extract business data from Pagine Gialle (https://www.paginegialle.it/)...

19
Experimental
4234 zachpinto/walmart-proximity

This project explores the proximity of populations to Walmart locations,...

19
Experimental
4235 medanisjbara/autoemploi-fsm

A script that automates the tedious process finding where you pass your exam...

19
Experimental
4236 filipe-braiman/stock-data-extraction-visualization

A financial data pipeline that extracts stock prices and revenue data for...

19
Experimental
4237 erhangundogan/spider

Spider crawling the web

19
Experimental
4238 eliapuertas/Extraccion_de_concordanciasCORDE

Este código sirve para exportar concordancias desde el CORDE (corpus...

19
Experimental
4239 Kyagara/archiver

Idea of archiving a website/app by just using it.

19
Experimental
4240 mikeym88/Store-Information-Crawler

A Python scrapy project that crawls the websites of several organizations...

19
Experimental
4241 HoangHao1009/hbookrecommender

Book recommendation webapp

19
Experimental
4242 scrape-badger/n8n-nodes-scrapebadger

n8n community node for ScrapeBadger - Twitter/X scraping API

19
Experimental
4243 haripatel07/ai-threat-summarizer

AI Threat Summarizer is a Python-based cybersecurity tool that scrapes news...

19
Experimental
4244 myselfshravan/reconnect-msrit

Reconnect MSRIT API: A serverless Flask API deployed on Vercel that aims to...

19
Experimental
4245 bednarjosef/streetview-scrape

A general streeview image scraping tool made for mass exporting panoramas...

19
Experimental
4246 jedinyp/czech-laws

Python package to scrape all legal documents from www.e-sbirka.cz....

19
Experimental
4247 coberculidae/AA-Teste-MileageFinderAA-

✈️ Retrieve flight data and mileage info from American Airlines pages,...

19
Experimental
4248 JudeTe/ptt-image-crawler

Web crawling module used to crawl images from PTT

19
Experimental
4249 Jill09166/google-search

google search real-time results

19
Experimental
4250 azurespheredev/scrapliz

A little web scraping chrome extension

19
Experimental
4251 amrohendawi/spacy_wikipedia_kg_generator

This tool scrapes wikipedia for a target article, then uses spacy to...

19
Experimental
4252 ndabdulsalaam/WeRateDogs_twitter_analysis

The primary focus of this project revolves around proficient data wrangling...

19
Experimental
4253 jonasfluegge/Amazon-Web-Scraper

Amazon Web Scraper to buy products from Amazon at the best prices. 💸

19
Experimental
4254 jeffbrennan/jpmdb

personalized movie database

19
Experimental
4255 popcord/kinkoid-scraper

a python scraper for kinkoid games

19
Experimental
4256 andrezzahfreire/ProjetoInter3

Projeto de Web Scrapping de dados futebolísticos

19
Experimental
4257 LeoRigasaki/Anime-dataset

A collection of anime data from MyAnimeList, Anilist and Jikan

19
Experimental
4258 myselfsandip/web-scraper

Web scraping application built with Next.js, designed to extract, analyze,...

19
Experimental
4259 gramistella/repost_rusty

repost_rusty is an automation tool developed in Rust, designed to simplify...

19
Experimental
4260 nicksherron/prox

A fast cli tool for finding and testing proxies from the web. Inspired by...

19
Experimental
4261 pietrovismara/scavenger

Scrape and take screenshots of dynamic and static webpages

19
Experimental
4262 JarvisPrestidge/hacker-news-scraper

Simple command line application to scrape a user specified number of Hacker...

19
Experimental
4263 Mogady/FAQs-automatic-scraper

Automatic Scraping project for extracting FAQ and Help center articles

19
Experimental
4264 samuros/red-saldo-api

Microservicio creado con Node y Express para obtener datos de varios...

19
Experimental
4265 f213/scrapyc

CLI and client library for scrapyd. Done right.

19
Experimental
4266 ppoliani/bet365-bookmarklet

A Chrome extension that shows bet aggregates

19
Experimental
4267 RubensGJ/AgroSmartAPI

API auxiliar do projeto AgroSmart, responsavel pela coleta de cotação de...

19
Experimental
4268 rsanjabi/short-term-rentals-warehouse

Pipeline, warehouse, and visualization tools for investigating the impact of...

19
Experimental
4269 djego/ecommerce-peru-scrap-cli

Ecommerce Perú Scrap CLI is a project open source that extract products data...

19
Experimental
4270 aldnav/comicthread

Get random comics from multiple sources (XKCD, Commitstrip, ...)

19
Experimental
4271 ehan03/yale-senior-thesis

Signal mining for UFC betting

19
Experimental
4272 PiyushDeshmukh/camgor

Visualization tool for the Geographical Distribution of contributors

19
Experimental
4273 DouglasVolcato/brazilian-stock-market-analysis

Brazilian stocks analysis focused in dividend yield, diversification and...

19
Experimental
4274 triangle-motelti/web-scraper

Web Scraper is a compact Python tool for fetching web pages and extracting...

19
Experimental
4275 umitkaanusta/smol-elt

a smol elt (not etl) pipeline for smol tasks

19
Experimental
4276 ignaciolinari/sputnik-SR

Sistema experimental para recolectar datos públicos de Sputnik y generar...

19
Experimental
4277 regulad/nefarium-classic

nefarium provides an API similar to OAuth for websites that do not support...

19
Experimental
4278 fdhliakbar/IR-Lab

Repository Praktikum Sistem Temu Balik Informasi (Information Retrieval) -...

19
Experimental
4279 Euronymou5/Address-Scrapper

Un simple web scrapping de direcciones, útil para el uso de bins, métodos de...

19
Experimental
4280 igorantun/news-scraper

📰 Scraper for Brazilian newspapers Estadão, Folha de S.Paulo, g1 and VEJA

19
Experimental
4281 kartikv-04/beyondchats

Node.js utility to search and fetch blog article links using Google Search...

19
Experimental
4282 MusfiqDehan/NewsHub

📚A multi-functional Bangla and English News Aggregator web app using Django

19
Experimental
4283 jerry08/AnimeDl

⚡️An API for downloading or streaming your favorite anime.

19
Experimental
4284 JamesCarter526/C-mo-Resolver-Captchas-ImageToText-Usando-una-Extensi-n-de-Chrome

Esta guía explica cómo configurar la extensión y cómo utilizar los modos...

19
Experimental
4285 negativenagesh/Web-scraping-BeautifulSoup

FIDE TOP 100 PLAYERS JUNE 2024

19
Experimental
4286 jewels86/Tourmaline

A comprehensive and efficient web enumeration toolkit.

19
Experimental
4287 diannejardinez/web-scraping-challenge

Web scraping using Jupyter Notebook, BeautifulSoup, Pandas, and...

19
Experimental
4288 javapuppteernodejs/bypass-recaptcha-v2-crawl4ai

A comprehensive guide for developers on integrating CapSolver with Crawl4AI...

19
Experimental
4289 vlivashkin/tg-user-scanner

Extracts the usernames (and other available user info) of participants from...

19
Experimental
4290 mathiramilo/pg-curricula

Este proyecto busca ayudar a los estudiantes de ingeniería a planificar su...

19
Experimental
4291 promptapi/scraper-go

Golang wrapper for Prompt API's Scraper API

19
Experimental
4292 papkvnq/on3-recruit-scraper

📊 Scrape detailed college football recruiting data from On3 and other...

19
Experimental
4293 jonathas/daily-menu-offers

What are my favourite pubs/restaurants serving today?

19
Experimental
4294 otuva/EksiDumper

Verilen eksi sozluk kullanicisina ait tum entryleri bir csv dosyasina...

19
Experimental
4295 UBC-LFS/lfs-course-directory

This app pulls courses from the course directory with a front-end to display...

19
Experimental
4296 akumathedyn123/cpp-url-collector

This C++ program crawls websites, extracts links from their HTML content,...

19
Experimental
4297 angel-boschdom/matlab-seo-tool

Search engine optimization tool in MATLAB

19
Experimental
4298 fernaerell/Web-Crawling-To-TXT

A simple web crawling application that can browse URLs, extract text...

19
Experimental
4299 Nxve/AutoMudae

Userscript for Tampermonkey that automates the use of Mudae bot in Discord

19
Experimental
4300 devlocalhost/ampy

ampy - an apkmirror scraper in python

19
Experimental
4301 newsify/ret

BS4 web interface

19
Experimental
4302 ZenRows/zenrows-go-sdk

ZenRows® SDK for effective scraping in the Go programming language

19
Experimental
4303 mkochanowski/Wroflats

User-friendly client designed for browsing real estates with dynamically...

19
Experimental
4304 SimoneFelici/Newspy

A new way to read news articles online!

19
Experimental
4305 D3vd/Image_Colorizer

Python program that adds color to monochromatic images. Well optimized for...

19
Experimental
4306 theroyalwhee0/brik

Brik HTML Parser

19
Experimental
4307 ranbot-ai/product-hunt

Automatically fetch daily Product Hunt products and export them to CSV...

19
Experimental
4308 daabr/chrome-vision

Advanced cross-platform web automation with a convenient Go API

19
Experimental
4309 neeraj-gs/CoverMe-AI-Chrome-Extension

An AI Integrated Chrome extension that generates the best cover letter by...

19
Experimental
4310 ahmedmohamedabdelsalam/webscraper_suite

A Python Web Scraping & Automation Suite for collecting data from static and...

19
Experimental
4311 Connor56/bare-bones-collector

A bare-bones data collection chrome extension.

19
Experimental
4312 uschtwill/re-employment-kraken

re-employment-kraken scrapes (job) sites, remembers what it saw and notifies...

19
Experimental
4313 Sandy0002/Final-Year-Project

This is a web application that gives stock value predictions based on preferences.

19
Experimental
4314 blaisewf/repo2txt

A tool to clone GitHub repositories, document their directory structure, and...

19
Experimental
4315 aymenhmaidiwastaken/SEO-Optimiser

Self-contained SEO analysis tool with a web dashboard. Crawl any website,...

19
Experimental
4316 AiGptCode/OSINT

⭐ Project Review: OSINT Data Collection Tool ⭐ This project provides a...

19
Experimental
4317 Ian-Lusule/SQLi-Scanner

A Python-based SQL Injection scanner for identifying vulnerabilities in web...

19
Experimental
4318 anshu-krishna/HTML-Scraper

A PHP class to simplify data extraction from HTML.

19
Experimental
4319 RomySaputraSihananda/craw-DataPrakiraanCuaca

crawling and scrapping weather data from BMKG website

19
Experimental
4320 rxavier/norm-volume-uy

Web scraping to obtain laws and decrees approved by the Uruguayan government

19
Experimental
4321 yfgeek/SNSTools

社工必备工具箱 Social engineering tools for SNS websites

19
Experimental
4322 manucabral/fifa-ranking

pyfifa | A easy-to-use wrapper lib for fetching fifa ranking and more

19
Experimental
4323 Garima-sharma814/Web-Scraper

Simple Web scraping app to scrape all the Indian Presidents (Name and...

19
Experimental
4324 themaximalist/scrape.js

Web Scraping Library for Node.js

19
Experimental
4325 huyszn/supreme-products-scraper

Web scraper that scrapes all products and their price, description, color,...

19
Experimental
4326 256hax/swiftui-web-scraping-tool

Web Scraping Tool for iOS App with SwiftUI and CoreData.

19
Experimental
4327 eshansurendra/universal-link-finder

Chrome extension that cuts through web clutter to find specific links....

19
Experimental
4328 nonioAlber/google-news-scraper

google news real-time monitoring

19
Experimental
4329 CSFelix/anime-data-scrapper

⛏️ Web Scrapper of MyAnimeList data using Jikan API ⛏️

19
Experimental
4330 ashutoshvarma/music-util

Python module for retrieving song information and download details by web...

19
Experimental
4331 pratham0203/news-popularity-model

This model has a regression and classification model which uses a datasheet...

19
Experimental
4332 asier-gutierrez/saferch

Communication network virus/phishing/... spread simulation analysis focused...

19
Experimental
4333 UPOLSearch/UPOL-Search-Engine

Search engine for upol.cz domain, topic of Master thesis on Department of...

19
Experimental
4334 mannasoumya/instapy_pubprofiles

Download Instagram Photos and Videos given Link to Posts

19
Experimental
4335 tanzeelgcuf/Facebook-Profile-Scraping

Facebook profile images and friend list profile scraping script working with...

19
Experimental
4336 mishadoff/priceous

Scrapping prices from Ukrainian online whisky shops

19
Experimental
4337 Prog-Jacob/course-registration-extension

Avoid the hassle of schedule conflicts, customize your schedule, and...

19
Experimental
4338 Vacansee/data

Stores all data used on the Vacansee app

19
Experimental
4339 smallest87/TokoScraper

​Perbaiki hasil pencarian Tokopedia yang tidak relevan. Ekstensi ini...

19
Experimental
4340 pravodev/python-cuaca

Perintah CLI untuk melihat Prakiran Cuaca

19
Experimental
4341 Halima24-tech/judge-it

🚀 Execute user-submitted code securely with MyJudge, a scalable,...

19
Experimental
4342 jensoto/MPS-DataAnalytics

Academic portfolio of course work for my Master's in Data Analytics.

19
Experimental
4343 TimTosi/mcrawler

[Go] - Web Crawler with composable pipeline.

19
Experimental
4344 WebOlivia/kr-abcgrandstage-scraper

grandstage catalog data scraper

19
Experimental
4345 yusuzech/web-scraping-projects

List of my scraping projects

19
Experimental
4346 ZenRows/youtube-video-viral

Repository for the "How Do YouTube Videos Go Viral" blogpost with the final code.

19
Experimental
4347 jacobsteves/Crawlperl

A web crawler made with Perl. Great for grabbing or searching for data off...

19
Experimental
4348 abhhis/Scraper

Scrapping travel website using CasperJs

19
Experimental
4349 kitthiphatn/Social-Monitor-scape

Social media monitoring and analytics platform with real-time data scraping...

19
Experimental
4350 Ian-Lusule/XSS-Scanner

A Python tool for detecting XSS vulnerabilities in web applications....

19
Experimental
4351 CodeChefVIT/Lyricer

Add lyrics of a song to YouTube description above everything else (can be a...

19
Experimental
4352 Jkanon/webmagician

A configurable crawler platorm

19
Experimental
4353 amy-gil/dubizzle-list-search-scraper

Dubizzle property listing scraper

19
Experimental
4354 sistemasaguila/cotizaciones-set

Api de cotizaciones basados en los datos publicados por la Dirección...

19
Experimental
4355 LefevreGregoire/meteo-scraping-lamp

Mini-projet LAMP en PHP : récupération et affichage de données météo avec...

19
Experimental
4356 chrisdelgadox/bcv-api

BCV API

19
Experimental
4357 othreecodes/Poorly-Drawn-API

Unofficial API for poorlydrawnlines.com

19
Experimental
4358 antiufo/Shaman.Dokan.Warc

Mounts WARC files on Windows

19
Experimental
4359 lopezrbn/car-price-checker-webapp

Reflex-based webapp that lets users estimate used car prices by interacting...

19
Experimental
4360 rezamobaraki/goodreads-peewee-python

simple project on command-line | goodreads.com

19
Experimental
4361 Eboubaker/JSONFinder

a library that can find json values in a mixed text or html documents, can...

19
Experimental
4362 nyamadori/juknife

[UNDER DEVELOPING] A Ruby library for Web scraping. It allows to describe...

19
Experimental
4363 moiztravadi/scrap_mojo_stocks

Get all stock ratings from marketsmojo

19
Experimental
4364 allanreda/SEO-Keyword-Cannibalization-Detector

Python script for detecting possible keyword cannibalization

19
Experimental
4365 HaiyueZhang/Luyan-Logistic-Optimization

Research on Optimization Models and Vehicle routing problem. Mentored by...

19
Experimental
4366 smallest87/LPSE-Table-Scraper

Ekstensi Chrome untuk scraping data tender LPSE Indonesia. Menggunakan Side...

19
Experimental
4367 motacola/figma-scraper

FigmaSnap - Capture Figma prototypes in seconds. Automated screenshot...

19
Experimental
4368 avidito/swifind

Web scraping scripting language and toolset.

19
Experimental
4369 PhillipUg/github-scraper

A Github Scraping Tool developed in Ruby

19
Experimental
4370 giuseppesalvi/website-screenshot-and-code-getter

Tool to extract easily screenshots and html code from websites

19
Experimental
4371 JasonAnx/Kalpurnia

Scrapy-based web crawler and search engine

19
Experimental
4372 xavigs/breaks-analyzer

Web scraper that extracts all daily tennis matches, and analyse them to...

19
Experimental
4373 rwbe/web-scraping-tutorial

Projeto educacional de web scraping em TypeScript

19
Experimental
4374 Oscarshu0719/instagram-web-crawler

Instagram web crawler. Download images and videos from specific users....

19
Experimental
4375 koniz-dev/llm-podcast-engine

AI-powered podcast generation engine that scrapes content from URLs,...

19
Experimental
4376 martigso/stortingscrape

Scrape and structure raw data from the Norwegian parliament's API.

19
Experimental
4377 H4RR1SON/proxywar

High-performance forward proxy server built with Pingora. Load balances...

19
Experimental
4378 Go-phie/scalic

Engine for searching and retrieving music links

19
Experimental
4379 crwlrsoft/laravel-crawler

Laravel adapter for the crwlr/crawler package.

19
Experimental
4380 dchan3/thoughtfulsoup

dchan3's thoughtful extension of BS4

19
Experimental
4381 ArfaNada/web_summarizer

A Python-based tool that scrapes textual content from a webpage and...

19
Experimental
4382 EkoEdyP/CLIs-Applications

CLI INTERACTIVE + WORKER + CONCURRENCY + SCRAPING

19
Experimental
4383 N4rr34n6/OnionDomainExtractor

OnionDomainExtractor is a Python script designed to automate the process of...

19
Experimental
4384 pinheirolucas/anime_filler

https://animefillerlist.com sample app

19
Experimental
4385 JonasSouza871/Christmas_Songs_Spotify_Analysis

Analysis and forecasting of Christmas songs on Spotify (2017-2025). Data...

19
Experimental
4386 BlamerX/Air-Quality-Index-Prediction-Website

A Flask-based web application that predicts the Air Quality Index (AQI) in...

19
Experimental
4387 deepakdeo/NASA-ADS-metadata-retriever

Retrieves metadata (such as title, url, citation count, pub year, abstract,...

19
Experimental
4388 Firefly55lm/footballers_performances

Sentiment analysis and topic modelling about Premier League footballers (2023)

19
Experimental
4389 YGGverse/Yo

Micro Web Crawler in PHP & Manticore

19
Experimental
4390 WZBSocialScienceCenter/tm_corona

A small showcase for topic modeling with the tmtoolkit Python package. I use...

19
Experimental
4391 josephburkhart/TRAC-Collation

A tool for collating immigration data from the Transactional Records Access...

19
Experimental
4392 OpenSUTD/evs-notifications

EVS notifications for SUTD hostel

19
Experimental
4393 sauravhiremath/NSE-Value-Update

Update Daily FIIs, DIIs and NIFTY Data

19
Experimental
4394 iamitkrp/CLI_DOWNLOADER

CLI - downloader is a terminal tool that you can use to download your...

19
Experimental
4395 andrewguenthner/oo_oam

OpenOakland Oakland Art Murmur collaboration

19
Experimental
4396 tim5go/linkedin-crawler

Linkedin public profile parser in JS

19
Experimental
4397 AtaaEddin/WebsiteProductsAsJson-ChatGPT

Extract a list of products of any website using ChatGPT Functions.

19
Experimental
4398 ryyos/CNN-scraping.PY

CNN Website Scraping Using Python

19
Experimental
4399 SiddharthDhirde/PythonLearning

A Self-Guide to Python

19
Experimental
4400 littlepenguin89106/goodreads_review_summarizer

A tool to collect and summarize Goodreads book reviews, extracting key...

19
Experimental
4401 sejalkoli/British-Airways-Web-Scraping

Data science virtual internship program by British Airways through Forage!

19
Experimental
4402 JPAntonisse/nox-spellenzolder-rating

Extract boardgames scoring from Nox Youtube Videos.

19
Experimental
4403 sylv/imdb-api

A library that scrapes IMDb for title data.

19
Experimental
4404 kadnan/yelp-scraper-go

A simple web scraper for Yelp written in Go language.

19
Experimental
4405 shinosaki/simple-scraping

Simple implementation for scraping website on Cloudflare Workers with HTMLRewriter

19
Experimental
4406 palewire/reuters-jobs

A bot that posts job openings at Reuters News

19
Experimental
4407 Aran404/Spotify-Playlist-Parser

An easy to use GUI to parse Spotify playlists fast and efficiently.

19
Experimental
4408 LuccaHellriegel/four-clojure-to-roam

Import all the 4clojure problems into RoamResearch by importing one of the...

19
Experimental
4409 ThePyProgrammer/shabdkosh

Scrape Hindi Quotes from shabdkosh.com

19
Experimental
4410 ygp4ph/GolDigger

Un crawler web récursif, rapide et efficace

19
Experimental
4411 monk-time/icm-dead-video-links

A tool to find dead video links in comments on icheckmovies.com.

19
Experimental
4412 nvzard/SpoilerAlert

Stay up to date with your favorite TV Show's upcoming latest releases.

19
Experimental
4413 auribuo/hsr-alert-bot

A Discord bot for alerting users when new Honkai: Star Rail redeem codes drop

19
Experimental
4414 ct-martin/edge-oembed

Cloudflare Worker for edge/serverless oEmbed Provider

19
Experimental
4415 robcharlwood/spider-man

Your friendly neighbourhood web crawler

19
Experimental
4416 Atia-Farha/HTML-Fetcher-Script

A Python script that allows users to fetch and optionally save the HTML...

19
Experimental
4417 calinvasileandrei/stylish

A simple style app that allows you to categorize items from different online...

19
Experimental
4418 acostasg/analysisCryptocurrency

Practice project UOC. Data science project about cryptocurrencies and stock indexs.

19
Experimental
4419 noah-art3mis/judex

Extração automatizada de dados do portal do STF

19
Experimental
4420 Valkryst/RSS_News_Scraper

A script for building a local database of news articles by crawling RSS...

19
Experimental
4421 galiarmero/yahoo-login

Gobble up an authenticated Yahoo session by mechanizing the login process

19
Experimental
4422 lfhohmann/wunderground-pws

Multiple Wunderground PWS web scraping without API key

19
Experimental
4423 ajskateboarder/memewizard

One good source for all things memes

19
Experimental
4424 RomySaputraSihananda/craw-TheMoscowTimes

scraping pada situs berita TheMoscowTimes

19
Experimental
4425 mayaradaher/scraping-SIGBM

Baixa dados diários das barragens do SIGBM

19
Experimental
4426 grigorassorin/car-price-prediction

End-to-end ML pipeline to recommend the best used car deals in Turkey

19
Experimental
4427 dmitriiweb/article-scraper-mcp

MCP to get an article text from an URL

19
Experimental
4428 jjpaulo2/minecraft-versions-scraper

🌐 Este projeto contém scripts de raspagem de dados que extraem dados de...

19
Experimental
4429 rhalbersma/scrape

Educational exercises in web scraping

19
Experimental
4430 achique-luisdan/web-scraping-amiibo

Web Scraping🚀 para extraer automáticamente la lista de personajes amiibo♥️...

19
Experimental
4431 kensdy/OSINT-Steam

Script to obtain information from a Steam profile, capable of extracting the...

19
Experimental
4432 emredkyc/price_tracker

Dive into web scraping and build a Next.js 14 eCommerce price tracker within...

19
Experimental
4433 HaidaQuant/Python-WebScraper

Python script that uses the Beautiful Soup library to scrape data from a...

19
Experimental
4434 chicklightning/dnd-bot

Dungeons & Dragons Discord bot for rolling die and searching for rules stuff.

19
Experimental
4435 dengaertig/SmartApply

A C# console app that uses HtmlAgilityPack and XPath to scrape job listings,...

19
Experimental
4436 jlumbroso/basic-git-scraper-template

🔬 Starter template for automating web scrapers using GitHub Actions...

19
Experimental
4437 Nnadivictory25/website-to-markdown

A website to markdown converter over https and CLI built (vibecoded) with Go

19
Experimental
4438 WLLR9505/vsco-js

VSCO image downloader

19
Experimental
4439 Nadim147c/go-tree

📦 A Go package for traversing 🌲tree like deeply nested data.

19
Experimental
4440 root-yash/Hotstar-Disney-Plus-Scraper

Hotstar Disney + movie and tv show web Scraper made using pyppeteer, request...

19
Experimental
4441 tomytjandra/text-mining-corona-articles

Text Mining for Indonesian Online News Articles About Corona

19
Experimental
4442 sinanazem/listing-provider

A listing service is a database of a company that is collected from real...

19
Experimental
4443 lucasxlu/CVLH

Open Source Deep Learning Serving System with Web Interface Written in Java

19
Experimental
4444 dindicoelho/scraper-etico

Ethical web scraping library for public price monitoring with automatic...

19
Experimental
4445 datograde/overpaint

Data quality monitoring for Postgres

19
Experimental
4446 acidvegas/httpz

Hyper-fast HTTP Scraping Tool

19
Experimental
4447 PeterOlayemi/web_scraper

A simple BBC News headline scraper developed as part of the Codveda...

19
Experimental
4448 cfassoni/b3ajustes

A small scraper that fetches "ajustes do pregão" from BMF Bovespa and...

19
Experimental
4449 labgua/AISearchImage

Intelligent Search Engine Of Services Image-Based

19
Experimental
4450 kishanmodi/magnetscrapper

A telegram bot which Gives You the magnet link of any torrent you want to...

19
Experimental
4451 fs23yayan/submission-pemda

ETL Pipeline for scraping, transforming, and loading fashion product data...

19
Experimental
4452 msterhuj/TelegramScraperDump

Index Message from your telegram account and find juicy content in it.

19
Experimental
4453 star-inc/butterfly

The World-Wide-Web crawler for Apache Solr.

19
Experimental
4454 saifrehman100/propinsight-ai

AI-powered property intelligence platform. Enter any US address to get...

19
Experimental
4455 AmiyoKm/bangla_buzz

Bangladesh News Trend and Sentiment Analysis

19
Experimental
4456 luminati-io/Shopee-dataset-samples

A sample dataset of over 1000 Shopee products, extracted using the Bright...

19
Experimental
4457 sudoliyang/wg-proxy-farm

Deploy multiple isolated HTTP proxies with WireGuard in Docker — ideal for...

19
Experimental
4458 khaouitiabdelhakim/LyricsAI

LyricsAI is a powerful and easy-to-use library for Android developers that...

19
Experimental
4459 nedhmn/streeteasy-scraper

StreetEasy data scraper built as a Dockerized monorepo with uv workspaces....

18
Experimental
4460 emirbaycan/scrap_semrush

Python tool to extract and automate keyword, page, and SEO data collection...

18
Experimental
4461 taggedzi/tzMCP

Media Capture Proxy - A safe and easy-to-use media capture tool that filters...

18
Experimental
4462 scortier/GCP_LeaderBoard

Enrolled student in 30 days of Google Cloud Challenge of NITS can check...

18
Experimental
4463 luminati-io/Target-dataset-samples

A sample dataset of over 1000 target products, extracted using the Bright...

18
Experimental
4464 AdemCE-eng/Content_Inspiration

A Streamlit-based Python app that scrapes and locally summarizes articles...

18
Experimental
4465 shubhamp1/GitHub_discussion_scraper

web scraping tool which scrape discussions from GitHub based on a specified...

18
Experimental
4466 lucifertrj/MangaPi

Download Manga Chapter Wise. A GUI application created using Python Tkinter,...

18
Experimental
4467 lucacicada/Scrape.NET

⚡ A flexible .NET scraping library, with a powerful exceptions system.

18
Experimental
4468 lincprog/CAASES

CAASES is a web crawler for extracting website accessibility information...

18
Experimental
4469 PR-Desai2226/Web-Scraping

Web Scraping & Text Data Collecting and Curating for Maithili Language. Also...

18
Experimental
4470 ksteensig/ConfettiSpaghetti

Automatic generation of YouTube compilation videos from subreddits

18
Experimental
4471 pierstoyanov/prices_tracker

flask app with scraper and viber bot

18
Experimental
4472 gacheiro/uri-com-cuscuz

Um app para monitorar as soluções dos alunos no URI Online Judge

18
Experimental
4473 yin-se/CareersGraph

LinkedIn career path analysis web application with ethical scraping, graph...

18
Experimental
4474 hoxhaeris/get_muitiple

Get and process multiple resources from web, using asyncio (aiohttp) to...

18
Experimental
4475 terokarvinen/hoto

Extract HTML tags and metadata, optionally rename files. Supports MAFF as...

18
Experimental
4476 TK17250/Uniqlo-WebScraping

Uniqlo Web Scraping version 1.0.0

18
Experimental
4477 SemenovY/scrapy_parser_pep

Парсер документов PEP на базе фреймворка Scrapy, собирающий данные о PEP с...

18
Experimental
4478 rodrigosf672/braceros-pycon2025

This repo was created as material for a talk at PyCon US 2025, exploring how...

18
Experimental
4479 BernardMoy/Job-Tracker

A website prototype for entry level job seekers

18
Experimental
4480 gastonstat/simpsons-transcripts

Scraping The Simpsons Transcripts with R

18
Experimental
4481 RelentlessDiscipline/Web-Scraping-Text-Analysis-Project

Sentiment Analysis, WallStreetBets, Religion, Ethics, and Philosophy

18
Experimental
4482 clsandoval/herald-scraper-bot

Dota 2 herald-rank match scraper for building game analysis datasets

18
Experimental
4483 Michael-Matta1/datasets-acquisition

Centralized collection of my datasets, and data acquisition methodologies I...

18
Experimental
4484 hearot/telegram_me

A simple scraper for getting information from t.me links.

18
Experimental
4485 LonecastSystems/FBD-downloader

Excel sheet downloader for football-bet-data (Dashboard for now)

18
Experimental
4486 JuliusNixi/jCOT

A Python script to download/update COT data and run simple search queries.

18
Experimental
4487 talkwaqar/github-trending-dashboard

🚀 Real-time GitHub trending dashboard with 25+ languages, cross-column...

18
Experimental
4488 MaceChettiyadan/wikidata

compsci project

18
Experimental
4489 AnonCatalyst/ProxyModule

ProxyModule is a powerful and easy-to-use tool for scraping and validating...

18
Experimental
4490 darideveloper/indeed-jobs-scraper

Extract general jobs data from computrabajo.com in specific location and...

18
Experimental
4491 nick-peter-marcus/popculture-platform-sentiment-analysis

Analyze Sentiment of Postings on a Pop Culture Entertainment Website

18
Experimental
4492 lyqht/sg-bill-org-scraper

Web scraper to get Singapore Billing Organisations

18
Experimental
4493 frascu/hospital-result-checker

A web scraper to check the test result published by Miulli Hospital.

18
Experimental
4494 Brikwerk/cvpr-explorer

A simple set of Python scripts that can be used to download and explore CVPR...

18
Experimental
4495 CentreForDigitalHumanities/DHScrapers

A unified interface for scrapers for Digital Humanities resources

18
Experimental
4496 cenkcorapci/go-parse-url

A simple go web service that parses a given url to return useful meta data

18
Experimental
4497 quiet-ocean/autoscraper

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

18
Experimental
4498 orion512/baskref

BaskRef is a tool to scrape basketball Data from the web.

18
Experimental
4499 jatanjay/CorpusGenius

A robust way to generate corpus and other meta data for the specified artist...

18
Experimental
4500 juanfrilla/caletacaballo_availability

Check when my apartment is available scraping airbnb and booking (no browser needed)

18
Experimental
4501 nlkguy/Apache-Status

Python Script for scraping Apache Server Status page if present , find...

18
Experimental
4502 SinaRaoufi/Cryptocurrency-Alert

Simple web scraping to set alerts for cryptocurrency prices :alarm_clock:

18
Experimental
4503 nfriend/snow-day-notifier

A small Lambda function that scrapes PEI's public schools website and sends...

18
Experimental
4504 c0j0s/my-toolkit-collection

A repo for personal toolkits.

18
Experimental
4505 avtomatik/statcan-metadata-scraper

STATCAN Web Scraper

18
Experimental
4506 umjammer/vavi-util-screenscraping

✂ Screen scraping utility for Java using annotations

18
Experimental
4507 jpsxlr8/Web_Scraping

Scraping HTML elements from a webpage.

18
Experimental
4508 Zabuzard/SongCrawler

Crawles all song files available on 'http://downloads.khinsider.com/'....

18
Experimental
4509 thebongy/Sof-Results

A program to bruteforce theolympiad results from http://sofworld.org

18
Experimental
4510 tom-ina/aws-amazon-product-research-pipeline

Serverless Amazon product research automation system using AWS Step...

18
Experimental
4511 norbertosanchezdichi/TIL

Today I learned...

18
Experimental
4512 hirano00o/acctf

銀行や証券会社をスクレイピングして入出金履歴、株や投信の保有数や取得価額、現在価格を取得するライブラリ

18
Experimental
4513 espiondev/playlist-builder

Another side project

18
Experimental
4514 RobotStudio/bors

A highly flexible and versatile service integration framework.

18
Experimental
4515 nobleknightt/contests-cli

Get schedule of coding contests from various coding platforms in your terminal.

18
Experimental
4516 edserranoc/Scripting-with-Python-and-SQL-for-Data-Engineering

Scripting with Python and SQL for Data Engineering Course Course - Duke University

18
Experimental
4517 yogendratamang48/parse_utils

Easy html/json parser for webscraping

18
Experimental
4518 lucasplus10/extrator-chat-telegram

Um simples extrator de textos dos chats do Telegram

18
Experimental
4519 letha11/manga-api

Manga API bahasa Indonesia

18
Experimental
4520 itsh3sam/JobSearch

An open-source project to search, scrap pages and return job position as Json result.

18
Experimental
4521 NicolasBizzozzero/Skyblog-Archiving

Archive skyrock.com blogs in a readable HTML format.

18
Experimental
4522 ghufr/igracias-survey-automation

Tired filling survey on iGracias? this script might be the solution for that.

18
Experimental
4523 Abdur-Rafay-AR/domain-market-analyzer

A Python-based scraper and analyzer for Australian suburb real estate data...

18
Experimental
4524 megamillions/Scheduled-Web-Comic-Downloader

Checks website of web comic, and downloads image if website was updated...

18
Experimental
4525 LearnCodingEasy/Web_Scraping

Web Scraping

18
Experimental
4526 davccavalcante/ParisArrowFacebookPost

Paris' Arrow Facebook Post is a powerful Chrome extension designed to...

18
Experimental
4527 nattila1/Google-Sheet---Website-Scraper

Free web scraper using Google Sheets and Apps Script

18
Experimental
4528 saiful-islam-rupom/global-military-firepower-2025-web-scraping-to-dashboard-building

This project involves scraping data from the Global Firepower website to...

18
Experimental
4529 azeez-d3v/Store-Locator

A comprehensive Streamlit-based web application for fetching, analyzing, and...

18
Experimental
4530 sergiovzambelli/scraper-reddit-free-plan

Efficient Reddit scraper built with Python, utilizing the official API to...

18
Experimental
4531 aquib-sh/ImageScrapper

scrape and download 35 images with one key press... !

18
Experimental
4532 Harsh-Avinash/Fampay-In-Depth-Analysis

A data-first report on Fam (formerly Fampay) (publicly available data)

18
Experimental
4533 leodd/nian-crawler

A web crawler for api.nian.so

18
Experimental
4534 Arnie97/woman

(Yet another) Command line client for https://explainshell.com

18
Experimental
4535 m5n/wwwsave

Save a local copy of a single Web page or a complete site!

18
Experimental
4536 Squirrelcoding/parking-meter

A geospatial analysis project to analyze the use of parking lots using...

18
Experimental
4537 dhruvldrp9/WebScrapper-PyPI

WebScraper-Plus is a powerful and flexible Python library for extracting...

18
Experimental
4538 jimstratus/forum-extractor

A comprehensive Python tool for extracting, processing, and analyzing RPG...

18
Experimental
4539 marcuwynu23/globe-wifi-router-info

Commandline Tool for getting information from local WIFI web server GLOBEATHOME

18
Experimental
4540 axsddlr/hits_daily_double_api

An Unofficial REST API for Hits Daily Double

18
Experimental
4541 veraivan/movies-scraper

Get real links to download movies or series.

18
Experimental
4542 trixxmanaty/extract-urls-to-file

This project contains a Python script to extract all unique absolute URLs...

18
Experimental
4543 anthonymjimenez/quicklist

Create a shopping wishlist seamlessly

18
Experimental
4544 RubenRosalia/manganotifier

Currently a personal Japanese stripbook notifier

18
Experimental
4545 AutoPyloter/youtube-subtitle-fetcher

Bu YouTube altyazı çekici modülü, RAG (Retrieval-Augmented Generation)...

18
Experimental
4546 MyArtverse-Project/toyhouse-crawler

A toyhou.se scraper written in Python to get character and profile data

18
Experimental
4547 lhotanok/fler-marketplace-scraper

Extracts products from sellers at Fler.cz

18
Experimental
4548 hanzopgp/LOLAnalysis

League Of Legends game data engineering, analysis, visualization and machine...

18
Experimental
4549 alefabris/hackathon-network-analysis-statistics-department

Hackathon from University of Padua: Network Analysis of the Statistics...

18
Experimental
4550 manish-9245/Web-Scraping-Basic

Basic python program to display profile picture for any given github user name

18
Experimental
4551 Develop-Packt/Extracting-and-Analyzing-Web-Data

Collect data by scraping web pages, then analyze your findings. Learn how to...

18
Experimental
4552 carolinadatascience/webscraping-workshop

Learn how to harness the power of web scraping to gather data from any...

18
Experimental
4553 riodevnet/snakyscraper

SnakyScraper is a lightweight and Pythonic web scraping toolkit built on top...

18
Experimental
4554 DinhHuy2010/beautifulsoup

beautifulsoup mirror from https://git.launchpad.net/~leonardr/beautifulsoup...

18
Experimental
4555 tiaplagata/capstone-project

My final Data Science project at Flatiron School! Using Natural Language...

18
Experimental
4556 Simple-Python-Scrapy-Scrapers/g2-scrapy-scraper

G2.com scraper with anti-bot detection, proxy rotation, and clean data...

18
Experimental
4557 ldilley/gogstash

:video_game: A Gog.com downloader

18
Experimental
4558 espretto/pagepro

client-side web-spider for seo-analysis

18
Experimental
4559 farihaNaqvi/Amazon-Scraping-With-Python

Scraping Amazon product details in Python using BeautifulSoup library which...

18
Experimental
4560 Metanome/neuro-cohort-bot

A modular Python Telegram bot that aggregates, cleans, categorizes, and...

18
Experimental
4561 Sieep-Coding/web-crawler

A simple web crawler implemented in Go.

18
Experimental
4562 randomthought/ScripScrap

A simple fast concurrent CLI web scraper written in haskell

18
Experimental
4563 dkvc/gpkgstatus

Get Current Package Status from Fedora Updates System

18
Experimental
4564 AnbarTop/TV-Series-Data-Analysis

An Exploratory Data Analysis (EDA) of popular TV series, analyzing trends in...

18
Experimental
4565 N0W3N/pr0x-tube

automated process of scraping, processing and reuploading data from tube sites

18
Experimental
4566 Tembero11/SafkaArchiver

Archives the Juhannuskukkula Safka menu & allows it to be queried from an API.

18
Experimental
4567 gabriel-logan/buscasubs

C program used to search for subdomains on a specific website. Programa em C...

18
Experimental
4568 RidwanSharkar/Pharmacological-Compound-Classifier

⌬ Predictive Modeling of Pharmacological Activites

18
Experimental
4569 wilkerHop/orbital-orion

Chrome Extension (Manifest V3) for scraping WhatsApp Web via React Fiber...

18
Experimental
4570 bcerf/Projet-Python

projet Python 2A ENSAE

18
Experimental
4571 hansalemaos/a_pandas_ex_bs4df

One line web scraping by combining pandas and BeautifulSoup4

18
Experimental
4572 codassassin/web-crawler-v2.0

This is an advanced version of the previously released version of web-crawler

18
Experimental
4573 asad-haider/spidey-redis

Distributed Web Scraping Tool Powered by Spidey and Redis

18
Experimental
4574 Zabuzard/Wrawler

Crawls all event threads on 'https://www.gruppe-w.de'. Creates a database...

18
Experimental
4575 Bill13579/java-web-crawler

Java Web Crawler Tutorial

18
Experimental
4576 CSwebD/web-scraping-an-article

A Python web scraper that extracts course information (headline, summary,...

18
Experimental
4577 madza91/About.me-Scraping

Very simple web scraping tool for About.me profiles

18
Experimental
4578 jharemza/workday_scraper

Python script for scraping Workday-based job listings and logging results to Notion.

18
Experimental
4579 RubenMaestre/PcFutsal

PC FUTSAL — A Real-World Data & Analytics Platform for Amateur Futsal

18
Experimental
4580 sherifcodeur/scrapybabyname

scraping using JSDOM library in NodeJS and Express . Scraping a website with...

18
Experimental
4581 AsifKamboh-COM/cors-proxy-server

A simple Node.js-based CORS Proxy Server to bypass CORS restrictions and...

18
Experimental
4582 zhupingqi/RuiJi.Scrapy

a typescript chrome scrapy.

18
Experimental
4583 dorbalazs/rendszerszkriptek

rendszerszkriptek, amiket használok

18
Experimental
4584 ptrks/websudoku_cpp

Scraper for generating valid sudoku puzzles along with solutions from websudoku.

18
Experimental
4585 SirWerto/Travian-Collector

Easy tool for download every public info of Travian in a parallel way

18
Experimental
4586 JerinFrancisA/Cricketeer

A Flutter application in which Stats and Information about cricket players...

18
Experimental
4587 SWE-team7/budgettrackr

Educated Purchasing Tool

18
Experimental
4588 kkkwbm/Discord_Olx_Bot

Automated Discord bot to track new listings on OLX.pl. Supports search query...

18
Experimental
4589 skywalkerSam/Python-101

introduction to Python 3

18
Experimental
4590 itzmeanjan/vb_noticeboard

A simple Dart wrapper for fetching, parsing and extracting notices from...

18
Experimental
4591 shahriar-rahman/Lyrics-Scraping

Crawler programmed to navigate the website, parse, and scrape relevant...

18
Experimental
4592 Mark10111/Amz-scrape

This Amazon Web Scraper script is designed to extract product information...

18
Experimental
4593 leoguilen/search-engine-microservices-with-redis-stack

Search engine system for articles using redis technology stack. This project...

18
Experimental
4594 GoranTopic/spider_jar

🫙🕷️ Webscrawling at scale 🕷️🫙

18
Experimental
4595 neurons-me/this.url

The this.url class is designed to fetch and parse URL data, returning an...

18
Experimental
4596 nlitsme/4chantool

Commandline tool for investigating 4chan discussions.

18
Experimental
4597 ruicsh/fletcher

HTTP request library, focused on web scraping

18
Experimental
4598 ComputerScienceWarrior/job_search

A CLI application using Nokogiri , open-uri and httparty for web scraping...

18
Experimental
4599 gun-py/SEC-filling-Analyzer-for-SaaS-Companies

IIT Dhanbad @InterIIT 10.0 | Bronze Medal Solution | Digital Alpha’s

18
Experimental
4600 KDominikk00/HLTVScraper

HLTVScraper is a web scraper and RESTful API built with Spring Boot that...

18
Experimental
4601 vmandic/tris-web-crawler

Tris is a simple NodeJS web crawler tool to help you collect links from...

18
Experimental
4602 partiallywritten/vrawler

Helper functions for web scraping in V (vlang)

18
Experimental
4603 DhruvAwasthi/Scraping-Amazon

Given the URL of a product available on amazon.in, it extracts all the...

18
Experimental
4604 dhruvv1402/Bug-Bounty-Hunter

A highly automated and modular bug bounty reconnaissance toolkit integrating...

18
Experimental
4605 alizat/bggscraper

Scripts for scraping all sorts of (publicly accessible) board games data...

18
Experimental
4606 Zummation/IQNewsClip-Web-Scraper

A high performance multi-threaded web-scraper using python and beautifulsoup

18
Experimental
4607 ryyos/InstaHarvest

Instagram Image Scraping

18
Experimental
4608 Saurabh13042004/imo

A comprehensive product aggregation and review analysis platform that...

18
Experimental
4609 hsadler/scrapers_scrapers_scrapers

A collection of web scrapers

18
Experimental
4610 dev-chenxing/jjwxc-scraper

A Python script to scrape publicly available novel and chapter data from...

18
Experimental
4611 atxtechbro/flightradar24

Advanced Python application leveraging the power of APIs and the pandas...

18
Experimental
4612 adler-sudo/oregon_wildfire_dashboard

A dashboard for visualization of Oregon Wildfire Data from 1961-2019

18
Experimental
4613 v3xlrm1nOwo1/AnimeSongsLyrics

Anime Songs Lyrics

18
Experimental
4614 SimonLarsen/bandcampr

R package for scraping data from Bandcamp

18
Experimental
4615 Matt0550/Eurostreaming-telegramBot

An unofficial Telegram BOT and Mini App for Eurostreaming website.

18
Experimental
4616 zfael/scrape-it-all

Modular web scraper for Node.JS

18
Experimental
4617 toufique-imam/KUET-Teachers-Web-Scrapper

KUET Teacher Data Scrapper from KUET Website

18
Experimental
4618 PyDataBH/data-scraping-letrasmus

Just a small experiment using data scraping at letras.mus.br

18
Experimental
4619 Al-shwaib/Phishing-Data-Scraper

This project is a scraper for collecting phishing data from trusted sources...

18
Experimental
4620 hatzka-nezumi/nsndswap

Scrapes a few web pages and outputs graphs

18
Experimental
4621 pedrosantos867/moodle-downloader

A Moodle downloader tool that downloads course contents such as pdfs, word...

18
Experimental
4622 cyterat/tg-scraper

Telegram Channel Posts Scraper | Application

18
Experimental
4623 Ysn4Irix/larousse

A command line interface to get french :fr: word definitions & synonymes...

18
Experimental
4624 girorme/multisearcher

Open source scan which uses some engines to find web sites with the use of...

18
Experimental
4625 nightawks/scrapper

Python Scripts for scrapping ERP.

18
Experimental
4626 lexmartinez/facebook-noise-filter

:fishing_pole_and_fish: A Facebook content filter desktop app. Filters the...

18
Experimental
4627 ekindeveli/lyrics-plugin-for-spotify

Lyrics Plugin for Spotify

18
Experimental
4628 sagarbabalsure/Live-Cricket

I have extracted live score of all cricket matches by web scraping of crickbuzz.

18
Experimental
4629 lilgallon/EzAPI

A compilation of useful and simple python APIs : Progress bar, Web scraping,...

18
Experimental
4630 swingcake/data_prep_for_conglomerate

This contains the scripts we developed to ease data prepping.

18
Experimental
4631 coopr-ai/social-media-url-extractor

A Python module and CLI tool for extracting social media URLs from web...

18
Experimental
4632 allanreda/N-grams-Analysis-for-Internal-Linking

N-grams analysis for identifying internal linking opportunities for SEO

18
Experimental
4633 erikayi/twittwit

This repository includes all necessary files needed for scraping Tweets.

18
Experimental
4634 book000/pixiv-novel-checker

Search for novels on Pixiv and notify Discord of new novels.

18
Experimental
4635 MaxBubblegum47/VictoriaCinemaTelegramBot

Telegram bot that checks for movies in my favourite local theater

18
Experimental
4636 jevogel/scrape-links-to-new-page

Scrapes a collection of source pages for a set of possible URL paths, tests...

18
Experimental
4637 psycho-baller/open-seat-notifier

Automated the process of looking for research participation opportunities by...

18
Experimental
4638 IsmaelMousa/WDFAP

Tool that enables you to fetch, clean, prepare, label, and upload articles...

18
Experimental
4639 Zahid-IND/FormAI-Gemini

FormAI is a smart browser extension that uses Google's Gemini API to...

18
Experimental
4640 artifishvr/DiscordMembers

Tracks a discord server's member count without a bot.

18
Experimental
4641 zenklinov/tweepy

This Python script demonstrates how to scrape recent tweets from Twitter...

18
Experimental
4642 FRReinert/QueryOEM

Retrieve information about workstations, servers and laptops from OEM

18
Experimental
4643 Ancient-Scapes/scraping-pinterest-images

Pinterestをスクレイピングして画像をローカルに持ってくるやつ 正直いまはDOM構造変わってたりするから動かないと思う

18
Experimental
4644 JeffersonSimplicio/scraping-favorite-anime

A aplicação Favorite Anime Scraping, faz a raspagem do HTML de sites de...

18
Experimental
4645 rexshijaku/Lotor

The Albanian Web Crawler

18
Experimental
4646 shahriar-rahman/Scraping-Unlisted-Zone-Shares

Scraping and storing financial data using Scrapy and Sqlite3.

18
Experimental
4647 yusuzech/web-scraping-examples

Working examples of web scraping codes on scraping sandbox toscrape.com.

18
Experimental
4648 sheldonsebastian/Capital-Bikeshare

Predicted bike demand in D.C. based on multiple features with 93% accuracy.

18
Experimental
4649 lucasboinet/scrape-flow

Workflow builder for web scraping (includes AI features)

18
Experimental
4650 hdarjus/WU-MyLearn-Download

Download all assignments/checkboxes etc that belong to parallel courses...

18
Experimental
4651 CarolynOlsen/py-scrape-youtube-audio

Scrape audio from YouTube videos, analyze audio

18
Experimental
4652 ChanceMark/site-scrape

This project is a web scraper for extracting school test results from the...

18
Experimental
4653 luminati-io/Walmart-dataset-samples

A sample dataset of over 1000 Walmart products, extracted using the Bright...

18
Experimental
4654 ItaiShek/zoomUrls

Get course recordings from moodle (for HIT students)

18
Experimental
4655 sborms/futsalfriend

Your digital futsal companion: find a friendly opponent, look for a team to...

18
Experimental
4656 Gullumluvl/wikipedia2phylo

Convert html phylogenetic trees from a wikipedia article into a standard...

18
Experimental
4657 T145/anipop

Short script to download the current season of anime from HorribleSubs

18
Experimental
4658 LazyDart/Ceneo-Scrape

Ceneo Review Scraper for balanced sentiment analysis across product categories.

18
Experimental
4659 wadoodislam/Pixol

This is a simple console application to download and back up the photos from...

18
Experimental
4660 kimble125/B2B_App_Project

Data pipeline & dashboard for B2B business matching (The Peak) + ...

18
Experimental
4661 TechBeme/cnpq

🎓 Ferramenta automatizada para baixar currículos Lattes do CNPq com bypass...

18
Experimental
4662 HiroItozzz/trail-condition-portal

登山道の危険情報を公的機関から自動収集・統合表示するWebサービス

18
Experimental
4663 alyrezo/digikala-exif-scraper

A script that collects exif (metadata) photos sent by buyers in DigiKala.com

18
Experimental
4664 brunowinter8192/searxng-mcp

Web search and URL scraping MCP server for Claude Code — SearXNG integration...

18
Experimental
4665 recluse-rs/recluse

A web crawler framework for Rust

18
Experimental
4666 sfkbstnc/bbc-rss-scraper

Simple RSS scraper for BBC News feeds using Python.

18
Experimental
4667 686f6c61/linkedIN-Scraper

Script interactivo en español para buscar ofertas de trabajo de LinkedIn...

18
Experimental
4668 aiwebautomation/anytext2images

Any blob of text → Extract the images → Preview & download = Fast

18
Experimental
4669 juliaulziisaikhan/vogue-scraper

Vogue Fashion Images Scraper

18
Experimental
4670 crawlora/typescript-sdk

Typescript sdk for crawlora

18
Experimental
4671 avoloshko/WebCrawler

WebCrawler is a simple Java based framework which scans websites...

18
Experimental
4672 shine-jayakumar/Rubber-Price-Telegram-Bot

Telegram bot to get current rubber price in India

18
Experimental
4673 KORINZ/nhk-news-scraper-js

🗞️ This repository contains a set of JavaScript functions that can be used...

18
Experimental
4674 prak112/data4wildlife

Instagram scraping algorithm for collecting json and images to identify...

18
Experimental
4675 Loubaris/Data-Immo

This project scrapes real estate listings from multiple property sale...

18
Experimental
4676 raspi/scrapy-finlex

Scrapy for finlex

18
Experimental
4677 halworsen/emnestigen

Graph course dependencies for courses at NTNU/NUST

18
Experimental
4678 Hsins/GSheet_TFDA-Licenses-Data-Search

🕸️ Fetch license data from TFDA (Taiwan Food and Drug Administration)...

18
Experimental
4679 danem/ocrtools

Tools for pdf scraping with OCR

18
Experimental
4680 RiegelGestr/multiplex_mobility_italy_municipalities

Multiplex Mobility Italy at municipality level and SIR Metapopulation simulation

18
Experimental
4681 Samuele95/WebCat

Automated discovery and classification of websites content through...

18
Experimental
4682 AntoData/HomosexualityHistoryCurrentStatus

In this project we use folium, pandas and webscraping using requests and...

18
Experimental
4683 thomasnynas12/travel-hunt

A travel planner based on React and Django Frameworks.

18
Experimental
4684 fernandod1/Yahoo-finance-scraper

This python script scraps "Open" and "Previous Close" values from any...

18
Experimental
4685 davccavalcante/TiresiasHackerRank

TiresiasHackerRank is a powerful Chrome extension that provides users with...

18
Experimental
4686 malek-harbaoui/pythonScrapy

Educational web scraping project using Python Scrapy to practice crawling...

18
Experimental
4687 BreadyBred/codewars-rank-fetcher

This Python GUI application simplifies the process of fetching and storing...

18
Experimental
4688 FawziElNaggar/londonrelocation_Scrapping

using Python and Scrapy framework in Rentola and thus we are providing the...

18
Experimental
4689 ClasicRando/web_rest_scraper

Single page static web application to scrape data from an ArcGIS REST service

18
Experimental
4690 social-media-censorship/makhno

https://foundation.mozilla.org/en/blog/new-tool-makhno-will-expose-geographic...

18
Experimental
4691 adw3r/proxy_parser

A high-performance, asynchronous proxy scraper and validator that discovers...

18
Experimental
4692 SMR-H/market-price-bot

🤖 Market Price Bot – A Telegram bot that scrapes real-time asset prices from...

18
Experimental
4693 rabbittx/Digikala-Crawler

Digikala Crawlerیک خزنده وب قدرتمند برای جمع‌آوری و تحلیل داده‌های دیجی‌کالا...

18
Experimental
4694 0001001010/manga-scraper

Efficient manga downloader built with Python/Scrapy. Features series/chapter...

18
Experimental
4695 wh0th3h3llam1/wallpaper-scraping

This Script can scrape the wallpapers from wallpaperswide.com.

18
Experimental
4696 n0x3u5/history-scraper

Scrapes the history of a website using the Wayback Machine when provided a...

18
Experimental
4697 TheLauro/strategic-matchup-finder

A Full-Stack League of Legends strategic matchup analyzer built with Java,...

18
Experimental
4698 SD7Campeon/Yelp-Sentiment-Analysis-with-Python-BS4-and-LLM

A scalable pipeline for automated extraction, preprocessing, and sentiment...

18
Experimental
4699 brej-29/Logicmojo-AIML-Assignment-WebScrapperApp

A Python command-line web scraping app with an interactive menu to extract...

18
Experimental
4700 Ckrielle/liblove

Give python libraries some love

18
Experimental
4701 dmarks84/Coursework_Project_Banks-Web-Scraping-SQL

Project for IBM Data Engineering & Python course on ETL & Big Data --...

18
Experimental
4702 Manuelkila/Data-curation

This is a task for Hamoye stage E Internship on Data curation, with focus on...

18
Experimental
4703 SebastianLiando/khinsider_sdk

SDK for video game music from Khinsider

18
Experimental
4704 based-jace/fara-the-film-bot

A Twitter bot that uses numerous APIs to recommend films, scrapes Wikipedia...

18
Experimental
4705 shawnduong/UCM-RegE

UC Merced Registration Eye: a Python script that helps students get the...

18
Experimental
4706 aneeshpatne/news_room

Automated News Snippets

18
Experimental
4707 shiruken/birdwatch-data

Automated scraping of Birdwatch data

18
Experimental
4708 Redrrx/WikimediaScrap

This is a Python script that can be used to scrape large amounts of images...

18
Experimental
4709 rhanyele/mercadolivre-scraping-kafka

O projeto é uma aplicação desenvolvida em Python que realiza o scraping de...

18
Experimental
4710 hyddeos/Books-Stats-From-Goodreads

Displays book-stats based on the CSV-file from GoodReads.com

18
Experimental
4711 james-see/veil

the uncollectible website

18
Experimental
4712 DEmodoriGatsuO/minisoup-html-parser

A lightweight HTML parsing library inspired by Beautiful Soup, providing...

18
Experimental
4713 henczi/scia

[WIP] An easy-to-use web-scraper, that helps you find the real value in an...

18
Experimental
4714 aleinin/eldin

New front end for eldin data

18
Experimental
4715 saidaspen/politescraper

Polite scraping of the web

18
Experimental
4716 chunky2808/SPOJ_history

History of submission of a user in SPOJ

18
Experimental
4717 TheLovinator1/wutheringwaves

Automated scraper for Wuthering Waves game news and announcements with RSS...

18
Experimental
4718 nerevu/hdxscraper-fao

FAO Food Aid Shipments and Food Security Data Collector

18
Experimental
4719 pulsgarney/garden

Garden is a straightforward asynchronous task management library for Python

18
Experimental
4720 emericauger/michelin

Restaurants étoilés du guide Michelin

18
Experimental
4721 leonstirk/job_bot

Scripts to automate job application process via seek.co.nz. Produces...

18
Experimental
4722 douglasgusson/afacinemas-js

A web scraper library for AFA Cinemas

18
Experimental
4723 yougis/scraping-poi-osm-googlemap

Capture and structuring of POIs from OSM and Google Maps, loading into...

18
Experimental
4724 walter-lead/BadNewsFilter

Ignorance is bliss, filter out bad news on BBC news website.

18
Experimental
4725 SubMaRk/mangascrapy

Download Manga, Manhwa, Manhua from any online website.

18
Experimental
4726 FernandoJAZ/Sunrise_Moonrise

Extraer datos de la salida y puesta del sol y los datos lunares diarios en la web

18
Experimental
4727 Op27/HumanitarianJobs-Extractor-Plus

HumanitarianJobs-Extractor-Plus is an advanced Python script that automates...

18
Experimental
4728 danielbaraniak/Sprinters

Competance project

18
Experimental
4729 ClashLuke/ModCrawl

Modular crawling for data targets. Non-recursive.

18
Experimental
4730 icarojerry/inep-scrapper

Scrapper para baixar os arquivos de Microdados do INEP

18
Experimental
4731 andrewhryn/DA_Indeed_Job_Scraping_Canada

🐍 🇨🇦 Scrapes job listings from Indeed to extract data analyst positions in...

18
Experimental
4732 DahlitzFlorian/scrape-github-orgs-article-snippets

Supporting material for the "How To Scrape The GitHub Organizations You...

18
Experimental
4733 leoz0214/MK8DX-Records-Analysis

Scrape, analyse and export data of 150cc and 200cc world records for the 96...

18
Experimental
4734 020d/bhprices

Simple web scraper in Python to see pricing for Blackhat 2017 courses

18
Experimental
4735 kuronosu/deguvon-old

(No development) Mobile application and api server for anime streaming

18
Experimental
4736 msalembsk/pipecraft

Modern Python ETL library with decorator-based API. Makes data extraction...

18
Experimental
4737 lidimayra/raspagem-slides

Slides da palestra Raspagem de Dados Web com Python

18
Experimental
4738 mo0haned/CSV-combiner

Since we had to generate many CSV or spreadsheet files. this tool is to...

18
Experimental
4739 notsopreety/nepali-news-scraper

Nepali News Scraper is a Node.js package that allows you to effortlessly...

18
Experimental
4740 elifirinci/olympic-visual-analysis

This repository contains a Python application that scrapes and visualizes...

18
Experimental
4741 K4rBie/medium2kindle

Script for sending Medium.com articles to Your Kindle device

18
Experimental
4742 n-roth12/fantasy-rankings-scraper

A Python package for scraping fantasy football draft rankings across...

18
Experimental
4743 antikorps/ninja_scrapers

MVP de una plataforma de aprendizaje de scraping. Abierto a colaboraciones...

18
Experimental
4744 lgou2w/OptifineCrawler

Minecraft Optifine.net Web Crawler Tool

18
Experimental
4745 RafaelDamiani/olx-web-scraper

A Python project to do Web Scraping in OLX

18
Experimental
4746 heydido/ReviewsFromFlipkart

A Python project to scrape reviews of a product from Flipkart/Amazon.

18
Experimental
4747 jackrosenthal/csmdirsearch

Search the Mines directory

18
Experimental
4748 malkiii/youtube-summarizer

An AI-powered tool that summarizes any YouTube video that enables captions,...

18
Experimental
4749 nakabonne/netsurfer

netsurfer is a very lightweight scraping framework

18
Experimental
4750 teohsinyee/facebook-page-scraper

Scrap Facebook page data for personal use

18
Experimental
4751 l1ght14/Covid-Data-Tracker-

COVID-19 Data Tracker is a Python app that scrapes real-time COVID data from...

18
Experimental
4752 sanjibroy360/Imdb-movie-search

A simple web interface that displays a list of movies. Here I crawled the...

18
Experimental
4753 ScrapeRouter/awesome-scraping

The definitive list of the latest libraries, tools, APIs and providers for...

18
Experimental
4754 Exyss/BloodlineSeeker

Imperial roman dynasties Scraper and Graphical Explorer

18
Experimental
4755 klauswarzecha/beauty-friseur

Collect business data from two German beauty portals with a minimum of requests

18
Experimental
4756 crypter70/SINTA-Scraper

A web scraper program to extract university data and publication scores on...

18
Experimental
4757 GeorgeVasiliadis/Scrap11888

A simple data scraping utility, used to extract data from 11888.gr

18
Experimental
4758 umikoio/thm-iframe-parser

Ingest profile data from TryHackMe's public iframe and convert it to JSON

18
Experimental
4759 ekindeveli/reddit-saved-post-sorter

a script that categorizes the Saved Posts of a Reddit user and produces a...

18
Experimental
4760 marcusmcb/npchatbot

A music discovery app and playlist generation tool for streamers on Twitch

18
Experimental
4761 TonyGrif/pdf-finder

A Python program to locate links to PDFs found within a webpage from the command line

18
Experimental
4762 mohamedfhafah/crous-monitor

CROUS Marseille Housing Monitor - Real-time notifications for student housing

18
Experimental
4763 alinacherkas/ua-energy-news-analytics

A Python project with a Quarto dashboard to collect and analyse news from UA...

18
Experimental
4764 KyleAnthonyShepherd/Lightning-Data-Scraping

This code pulls Lightning Strike data from the National Interagency Fire...

18
Experimental
4765 k9mil/eagle

🦅 A simple, fast, and fun CLI-based application which functions as a helper...

18
Experimental
4766 LevBernstein/steamDegreesOfSeparation

Algorithm to measure the degrees of separation between a user and the top of...

18
Experimental
4767 ionathomas/BuyAdvisor

The ICDE-BuyAdvisor website is a user-friendly solution to help the buyers...

18
Experimental
4768 TzurS11/batoto.js

Scrape data from bato.to

18
Experimental
4769 MorganFellDEV/HowMuchIsAFreddo

An AWS project, discovering the prices of Freddo's at various UK...

18
Experimental
4770 sanxlop/tfm_etsit

DEVELOPMENT OF A FOOD IMAGE CLASSIFICATION SYSTEM BASED ON TRANSFER LEARNING...

18
Experimental
4771 DanteSc03/Web-Scraping-Trabajo-2

This project is a Python-based web scraper and data analyzer that extracts...

18
Experimental
4772 avrtt/wildberries-parsers

Python scripts for parsing Wildberries, the largest Russian online retailer

18
Experimental
4773 skupriienko/Google-first-page-links

A python script for collecting links from the Google's first page

18
Experimental
4774 brandonabela/Malta-Property-Analysis

Ranking real estate investment opportunities in Malta using multi-threaded...

18
Experimental
4775 AndreaBozzo/Ares-Claude-Skill

Claude Code Skill for Ares

18
Experimental
4776 AdemCE-eng/Bookscraper

📚 A Python tool to scrape book titles and prices by category from Books to...

18
Experimental
4777 Durden7/ai-skills

🤖 Enhance AI capabilities with a collection of modular skills for...

18
Experimental
4778 spidersouris/llm_masc_gen

Code and data for the Man Made Language Models? Evaluating LLMs’...

18
Experimental
4779 ojengwa/gfe

Web scrapy with Flask, BS4, RQ on Heroku

18
Experimental
4780 TUVIMEN/hclips-scraper

A bash script for archiving hclips videos and users metadata in json

18
Experimental
4781 leewr9/crawlquest

Smart crawling request utility for Python.

18
Experimental
4782 mikoim/japanization-tools

日本語化情報コミュニティのアレ

18
Experimental
4783 Jack-du-ubc/news-reader

Python web-scraping application on latest news with Flask

18
Experimental
4784 Carson-Lam/WikigrapheR

Web scraper and grapher for Wikipedia.

18
Experimental
4785 rebrowser/siriusxm-dataset

SiriusXM channel database: 400+ channels with numbers, genres, categories,...

18
Experimental
4786 AlphaBs/NaverCafeClient

네이버 카페 글 목록 크롤링을 위한 닷넷 라이브러리

18
Experimental
4787 egao1980/cl-sitemaps

sitemap.xml parser for Common Lisp

18
Experimental
4788 samirsaliba/letterboxd-watchlist-picker

Python GUI application to randomly select a movie from two watchlists, given...

18
Experimental
4789 gautam132002/maxbhi-product-scraper

Powerful tool to extract data from Maxbhi.com, scrap over 1.4 million...

18
Experimental
4790 camara94/crawlers

Web scraping is the process of using bots to extract content and data from a...

18
Experimental
4791 SkyBlackHub/Diz-Scraping

A PHP kit for sending a request and receiving a response over HTTP using the...

18
Experimental
4792 xpl0ited1/githubGrep

This tool will allow you to search for any code on a specific repository or...

18
Experimental
4793 Stavroulaast/supplements-vitamins

EDA of supplements and vitamins products scraped from a Greek online pharmacy

18
Experimental
4794 ibrahimceyisakar/content-sentiment-analysis

Python project for making sentiment analysis on SM comments

18
Experimental
4795 Noby1Shin0b1/BRI-Surveillance-Analysis

Python Web Scraping and Data Visualization Project. Highlighting the...

18
Experimental
4796 masterT/ctftime-scraper

Scraper for https://ctftime.org/

18
Experimental
4797 Fnpsz/netflix-clone

🎬 Build a Netflix clone with user authentication, movie browsing, and a...

18
Experimental
4798 jonathanrao99/Book-scraping

A super cool web scraper that extracts book data from books.toscrape.com...

18
Experimental
4799 Kayunangka/claude-skill

🔍 Enhance code searches with ast-grep, finding patterns in your code...

18
Experimental
4800 alopatindev/find-telegram-bot

Search Telegram Bots with another Telegram Bot

18
Experimental
4801 extendi/peposo

Simple Instagram client side scraper, tasty like a peposo :P

18
Experimental
4802 avrtt/training-scraper

A Python tool for training neural network models using web scraping

18
Experimental
4803 SebastianSchmidl/CommentSearchEngine

A crawler and search engine for comments on Washington Post articles

18
Experimental
4804 patriciof3/social_listening_platform

Social Listening App

18
Experimental
4805 harootune/scrapy_dynamic_spiders

Dynamically generate spider subclasses based on existing spiders, including...

18
Experimental
4806 stevennooijen/stairwaytotravel-backend

Stairway to Travel offers personalised travel recommendations that help you...

18
Experimental
4807 TheJoin95/gimme-recipe

A simple web app to get fresh new recipes, cocktail and food / wine...

18
Experimental
4808 bear102/user-agents

A collection of real User Agents

18
Experimental
4809 Mamiss61eew/qiaomu-youtube-script

📝 Streamline YouTube with a simple script to copy all comments directly,...

18
Experimental
4810 NouroGhoul/rfetcher

rfetcher is a powerful Python CLI tool for scraping and categorizing Reddit...

18
Experimental
4811 AmjadKudsi/OpenAI-Whisper

Implementing and understanding OpenAI Whisper

18
Experimental
4812 KevinGao97/AmazonPriceTracker_Python-

Amazon price tracking script, written in Python 3.6.

18
Experimental
4813 leyuskckiran1510/youtubepet

Code to scrape the celeb Instagram Feed and upload it to YouTube with proper...

18
Experimental
4814 ab9il/Webscrapers

Scripts used for gathering and analyzing data from the web.

18
Experimental
4815 hrugved06/web-scraping-html

This repository will have the code and explanation to how to scrap a HTML website.

18
Experimental
4816 t-goulart/Access-VBA

🗄️ Automações robustas em VBA para Microsoft Access. Inclui rotinas de Web...

18
Experimental
4817 lheintzmann1/gog-games-unofficial-client

An unofficial client for searching and downloading GOG games through...

18
Experimental
4818 jirpo9/wyscout-scraper

Professional web scraper that extracts complete football analytics...

18
Experimental
4819 trinib/Subreddit-Memes

😹 Display latest random meme from any subreddit memes thread

18
Experimental
4820 Lu7474/habr-freelance-parser

Python-парсер заданий с Habr Freelance с поддержкой пагинации, фильтров и ...

18
Experimental
4821 boxpositron/email-scrape

Email web scraping script

18
Experimental
4822 willbraun/racquet-rivals-scripts

Scripts used to scrape tennis match results from the web and update my...

18
Experimental
4823 sade6h/fararu-news-crawler

🕷️ A robust, multi-threaded Python crawler for Fararu.com news, packaged...

18
Experimental
4824 KBavis/scrape-and-score

Neural network–driven predictions of NFL fantasy football points, leveraging...

18
Experimental
4825 shadilytn/Autonomy

This Google Colab notebook demonstrates a complete workflow for extracting...

18
Experimental
4826 awesomeratt1/pubmed-articles-scraper-pay-per-results

🔍 Retrieve and customize PubMed articles effortlessly using keywords,...

18
Experimental
4827 hacherlj/mordecais-realm

Projects Jordan Hacherl has completed for Data Science certification courses...

18
Experimental
4828 poxju/KRMarketMonitor

A real-time monitoring tool for Korean stocks. Tracks price changes,...

18
Experimental
4829 jaguzmana/economics-news-scraper

A Python-based Economic News Scraper that uses a configurable NewsScraper...

18
Experimental
4830 prbpedro/tcc_puc

Trabalho de Conclusão de Curso da Pós-graduação Lato Sensu em Ciência de...

18
Experimental
4831 xmas7/django-dynamic-scraper

Django Dynamic Scraper (DDS) is an app for Django which builds on top of the...

18
Experimental
4832 karolow/instatools

A Python package to facilitate acquisition and preprocessing of data from...

18
Experimental
4833 EmanueleRsp/BGG-BGA-Scraping

BoardGameGeeks and BoardGameArena scraping.

18
Experimental
4834 kingabzpro/agentic-market-research-olostep

An agentic market research project powered by Olostep + OpenAI Agents SDK.

18
Experimental
4835 moritztim/ZiviDisConnect

Bessere User Experience für ZiviConnect, Offline

18
Experimental
4836 andreiwahyu/tweetdelete

Clean up your tweet and retweet without API from twitter 🔥.

18
Experimental
4837 dotdesh71/Website-URL-Scanner

Website URL Scanner is a simple command-line tool that allows you to scan a...

18
Experimental
4838 cja5553/ChangeDotOrgScraper

Scrapes online petition data from change.org

18
Experimental
4839 acavalin/rrss

RSS feed reader with web interface and SQLite data storage

18
Experimental
4840 profile-icons/git-stats

Outdated. Upgrades coming soon! Generate regularly updated visualizations of...

18
Experimental
4841 nerevu/hdxscraper-acled

ACLED Realtime Data Collector

18
Experimental
4842 andylehti/Bulk-Subreddit-Fetch

Bulk subreddit fetcher to check subreddit name, subscribers, over18,...

18
Experimental
4843 JimovTeam/AnimeMonitor

AnimeMonitor is a program that monitors the new anime chapters that have...

18
Experimental
4844 bifeldy/crawler_worker

FansubID Crawler

18
Experimental
4845 mxchinegod/swan_scrape

High-efficiency text & file scraper with smart tracking for building...

18
Experimental
4846 Ashrockzzz2003/Cricket_Best_11_Prediction

This project is an attempt to use regression to predict the best XI players...

18
Experimental
4847 bartekk2908/R6_patch_notes_phrases_analysis

Analysis of specified phrases at Rainbow Six: Siege patch notes pages.

18
Experimental
4848 jlobos/fbg-videos

Get last videos of Facebook Group

18
Experimental
4849 elky84/lol-crawler

Notification from LOL friend game start & end.

18
Experimental
4850 naveengerold/news_Scraper

This a scraper which can be used to scrap data from News websites.

18
Experimental
4851 AnbarTop/Video-Game-Price-Analysis

A data engineering project to create a dataset for analyzing the economic...

18
Experimental
4852 EZDAMIR/Google-Form-Auto-Spammmer

Script to spam google form(Does not work with multiple page forms)

18
Experimental
4853 Seao/scrapper

Simple javascript web scrapper

18
Experimental
4854 mavicompanion/scholar-sphere-scraper

This project provides a comprehensive solution for extracting and managing...

18
Experimental
4855 pfmeisner/board-game-predictor

Predicting highly rated board games using data scraped from BoardGameGeek

18
Experimental
4856 abel3t/web_crawler

Web Crawler

18
Experimental
4857 melclx/realtor-properties-scraper

🏡 Scrape and enrich Realtor property data effortlessly, turning location...

18
Experimental
4858 calinvasileandrei/stylish-backend

Backend for the stylish application made with flask. Implements a Website->...

18
Experimental
4859 Remarkable-Solutions/AntiCaptchaApi.Net.Examples

Practical examples demonstrating how to integrate and use the...

18
Experimental
4860 sudo-boo/minion-grid

A web-scraping system using multiple agent scripts coordinated by a central...

18
Experimental
4861 Mefamex/python-profile-follower-chain

Kullanıcıların takipçi ve takip edilenlerini analiz eden bir Python...

18
Experimental
4862 jmayalag/covid19-scrape

Covid-19 py scraper

18
Experimental
4863 JPCRibeiro/PromoTech

E-commerce de venda de eletrônicos e eletrodomésticos feito com Vue.js e Flask Api

18
Experimental
4864 Youchien/webcrawler-developer-roadmap

Skill Roadmap to becoming a WebCrawler developer
爬虫工程师 知识图谱

18
Experimental
4865 MayankFawkes/Pinterest_Scrapper

Scrape Pinterest Images

18
Experimental
4866 hydrargyrum/img-lurker

Scrape a web page and downloads images (even if they are on other linked pages)

18
Experimental
4867 ritikkr/procompare

compare the product with different online store and buy the best one

18
Experimental
4868 AraignPirate/corona

A command-line tool to get Stats Update about the coronavirus pandemic....

18
Experimental
4869 david-torres/skrapa

A web scraping utility powered by configuration scripts, no coding required!

18
Experimental
4870 bernardofs/inss-gps-bot

Automates the generation of payment slips for the Brazilian Social Welfare (INSS)

18
Experimental
4871 mbemvieira/anp-back-end

NodeJS back-end API for web scraping data from Brazilian's ANP

18
Experimental
4872 Kheldin/IBM-Data-Science-Certification

IBM Data Science Certificate | Capstone project — predicting SpaceX Falcon 9...

18
Experimental
4873 nicolapreda/110-Tidings

🚀🏠 Bot Telegram realizzato in Python, con la funzione di inoltrare in chat...

18
Experimental
4874 jerem1e/wg_gesucht_telegram_bot

Telegram bot that notifies you when there is a new entry on wg-gesucht

18
Experimental
4875 pi-sigma/nous-aggregator

Content aggregator that collects metadata about news articles

18
Experimental
4876 pratham-jaiswal/job-scraper

Job Compatibility Finder - Job Scraper

18
Experimental
4877 hadiiskaargar/yleads

YLeads — Yelp business leads scraper with Fusion API (safe, captcha-free) +...

18
Experimental
4878 kernelism/scrapy-medium-repository

A simple scrapy project to scrape images from...

18
Experimental
4879 rebrowser/stubhub-dataset

StubHub secondary ticket market data: event listings with section, row,...

18
Experimental
4880 AaravMalani/webscraper

Scrape the web using SQLite and requests_html!

18
Experimental
4881 Tinu-thampi13/Quote-App

The Quote App is a handy tool for users to access a diverse collection of...

18
Experimental
4882 soareseric/myanimelist-web-scraping-using-python

We will analyze the website MyAnimeList using Requests, and BeautifulSoup...

18
Experimental
4883 mfakca/Web-Scraping-Uygulamas-

Yemek Sitesinden çekmiş olduğum yorumlar ve puanları Makine Öğrenmesi ile...

18
Experimental
4884 meet59patel/GSoC_Org_Frequency

Scraped data for previously selected organizations in GSoC, in spreadsheets

18
Experimental
4885 R40835/file-type-detection-by-byte-blocks

Deep Learning for file type Identification in Digital Forensics. We use the...

18
Experimental
4886 kluhan/kraken

Kraken is a generic, mid-scale web crawler specifically built to crawl...

18
Experimental
4887 SebasRod23/AprendizajeAutomaticoPracticas

Prácticas realizadas para la materia de Aprendizaje Automático

18
Experimental
4888 cquark7/apod_scraper

Scrapes all images from APOD website

18
Experimental
4889 prathameshbhalekar/GuitAR-scrapping

GuitAR is an web app which projects the chords for any song from our wide...

18
Experimental
4890 Mochadet/hatier-hachette-scrapping

Petit script qui permet de télécharger les manuels d'Hatier et Hachette...

18
Experimental
4891 ItamarAlves/searchincommunity

Busca bio no Instagram

18
Experimental
4892 EPSOFT/ForexFactory

Forex Factory Scraping

18
Experimental
4893 markmelnic/carsen-desktop

A python dashboard app for scraping and tracking cars for sale on websites...

18
Experimental
4894 EllAchE/discord_site_monitor

Scrapes webpages in (almost) any web format, then sends discord...

18
Experimental
4895 ArtTucker/mission_to_mars

Web scraping with python, Flask, and MongoDB

18
Experimental
4896 arnabroy734/laptop_price_prediction

Predict price of laptops based on configuration

18
Experimental
4897 algorime/AlgoCrawl

AlgoCrawl: Dual-depth web crawler for static & dynamic websites built for...

18
Experimental
4898 avirathtib/scrapeneatly

A powerful and lightweight web scraping library with LLM extraction...

18
Experimental
4899 enriquecallejascastro/anagrama_scraping

Web scraping of Anagrama Editorial

18
Experimental
4900 GabrieleDiCorato/quant-estate

Web scraping project analyzing the Italian real estate market - developed as...

18
Experimental
4901 madhurimarawat/CSVTU-GPT

This repository hosts the CSVTU GPT app, a Streamlit-based interactive...

18
Experimental
4902 alexkorol/twitter-mj-collector

Browser-based console tool to collect publicly-posted style reference codes...

18
Experimental
4903 FelixLuciano/elements-of-web-scraping

Course activities on text analysis from unstructured sources and the web

18
Experimental
4904 Pawel-Parma/dademoiselle

Web scraper for Phantom of the Night Genshin Impact web event

18
Experimental
4905 maryamzaman30/Heart-Failure-Analysis

CM2015 Programming with Data Midterm - University of London

18
Experimental
4906 junioralive/spycli

A cli tool to browse and watch Movies/Shows/Anime/K-Drama/C-Drama/MORE...

18
Experimental
4907 N4rr34n6/DomainCheck

Domain Check allows you to verify and log responses from various domains...

18
Experimental
4908 nate2211/ChatProject

Prompt based chat project mix and match processing blocks and scraping utility.

18
Experimental
4909 SB121211/PhishLink3r

A command based tool for basic validation of untrusted links

18
Experimental
4910 RyosukeDTomita/satelite-dl

Using python3 beautifulsoup, download satelite-images.

18
Experimental
4911 SaifsCode/Cards--The-Open-Source-RSS-Feeder

Cards is an html based web scraping cli-tool that pulls RSS feeds from...

18
Experimental
4912 avishekdas539/scrapeStackOverFlow

Scrape StackOverFlow to get question and answers for deep learning and other...

18
Experimental
4913 darredo1/mlkdocrelease2025

Automated Python script for downloading, merging, and OCRing MLK...

18
Experimental
4914 lindsaygelle/amiibo

Golang package. Amiibo provides a simple SDK to build an application that...

18
Experimental
4915 Ian-Lusule/WebScraper

A powerful and robust Python web scraper designed for extracting data from...

18
Experimental
4916 ABAlosaimi/Falcon-Scraper-

web scraping service that allows users to fetch, parse, and clean HTML...

18
Experimental
4917 zgalaz/property-finding-helpers

Package providing an easy way of parsing property offers (with user-specific...

17
Experimental
4918 limagabri/Football-Data-Scraper

This is a Python script to scrape historical football data from the...

17
Experimental
4919 Gemeto/SpainHouses

Crawler, analyzer and visualizer for real state offers in Spain.

17
Experimental
4920 chnkvn/financial-reports

A personal project tinvolving scraping/data filtering/data visualization to...

17
Experimental
4921 githubstevemas/PyScraper

A script that performs web scraping using Beautiful Soup (bs4), enabling the...

17
Experimental
4922 githubstevemas/scrape-and-hire

Use your CV to match it with job postings scraped from job board

17
Experimental
4923 JoanixX/political_data_peru

Proyecto enfocado en la recolección, normalización y análisis de datos...

17
Experimental
4924 marcub/amazon-product-scraper

Amazon Product Scraper is a full-stack application that allows users to...

17
Experimental
4925 fruitTheory/tab-scraper

Tool to save images from browser tabs

17
Experimental
4926 sreevardhanreddi/product-tracker-app

Track product prices across multiple online stores from a single dashboard....

17
Experimental
4927 danp/calmmap

Mapping Halifax Traffic Calming Requests

17
Experimental
4928 latsku/telescraper

Telegram channel scraper/downloader

17
Experimental
4929 jgroeschen/KFoSs-PC

A Python project to track grocery prices over time

17
Experimental
4930 riodev99/pyscraping

PyScraping is a universal web-scraping util for Python, built with...

17
Experimental
4931 EngqvistLab/brenparse

A library for parsing out data from the BRENDA database html files

17
Experimental
4932 jiro4989/coc

いらなくなったので開発中止

17
Experimental
4933 DerickAnjos/web_scraping

Study: Web Scraping - Extracting data from web pages.

17
Experimental
4934 aaditkapoor/YoutubeVideoFetcher

A Kotlin class to fetch YouTube Video Links using a search query.

17
Experimental
4935 malbertzard/euler-scraper

A small tool because im too lazy to open a browser

17
Experimental
4936 OrHostezky/winning-space-race-with-data-science

An end-to-end data science project, completed as the capstone project for...

17
Experimental
4937 Samuelson777/Weather-Data-Scraper

Simple Python script to fetch current weather data for any city using the...

17
Experimental
4938 eguiraud/nagbot

A telegram bot to nag your friends

17
Experimental
4939 mahmudulmashrafe/Web_Scraping_and_Data_Pipeline_Development_with_Python_Docker_Airflow_and_MongoDB

Web Scraping and Data Pipeline Development with Python, Docker, Airflow, and MongoDB

17
Experimental
4940 kingosazechris/conference-email-scraper

A powerful, multi-threaded web scraper for collecting academic conference...

17
Experimental
4941 thecount2a/webhelperextension

Automate your browser!

17
Experimental
4942 murilobsd/cptec

:sunny: Go library for parsing the INPE/CPTEC weather data :umbrella:

17
Experimental
4943 AleksandrVSokolov/clinicaltrialsgov

An R package to parse clinicaltrials.gov

17
Experimental
4944 EmiLithium/Cheng-Yu-Chinese-idioms

A growing dataframe of Chinese idioms, their meanings, and translations.

17
Experimental
4945 hadidadashzade/web-scraper-cli

A simple CLI tool to scrape remote job listings from remoteok.com using Python.

17
Experimental
4946 ArcSelf/getting-news

Search, scrape, summarize, and export news to .docx — AI-powered CLI for...

17
Experimental
4947 land0r/aoe4-strategy-builder

A Python script that scrapes the Age of Wonders 4 Wiki from...

17
Experimental
4948 Samuelson777/Basic-Web-Scraper

A simple Python web scraper that extracts article titles from a specified...

17
Experimental
4949 Alekslew/AI-Thinking-Module

AI-Thinking-Module: Simulates thought by analyzing and narrating real-time...

17
Experimental
4950 Mr-Ndi/KigaliKit

Automated job scraper for Opportunity Rwanda — built with Python, Airtable,...

17
Experimental
4951 Magicrafter13/ai-tag-search

Web Scraper/Search Engine that only stores tags about webpages rather than...

17
Experimental
4952 karan3691/dataset-builder

A complete Python pipeline that automates the creation of structured...

17
Experimental
4953 JuanP-G/AerForU-web

Web de la extensión AeRForU para Acepta el Reto

17
Experimental
4954 C0MPL3XDEV/newsletter-ai

AI-powered tech newsletter for developers and cybersecurity enthusiasts....

17
Experimental
4955 Odisseu93/imdb-series-scraper

IMDb Series Scraper is a Python script designed to scrape episode data from...

17
Experimental
4956 C0MPL3XDEV/newsletter-ai-backend

AI-powered tech newsletter for developers and cybersecurity enthusiasts....

17
Experimental
4957 MaksymSW/muzlock

TelegramBot

17
Experimental
4958 Stavroulaast/digital-methods-manosphere

Discourse analysis of neoliberal market logic and masculinity narratives in...

17
Experimental
4959 j341nono/daily-wisdom-API

A FastAPI-based wisdom quotes API with web scraping capabilities. Get random...

17
Experimental
4960 Erik0810/BullBearRadar

Installable desktop app that performs web scraping, sentiment analysis and...

17
Experimental
4961 marouaneMJH/InternTrack

An internship tracking and automation platform that helps job seekers find,...

17
Experimental
4962 brooks-code/dataset-merge-inspector

missingMap: visualise and compare missing fields across multiple dataset...

17
Experimental
4963 stiles/prisons

Modular web scraper for federal and state prisons data with geocoding, cloud...

17
Experimental
4964 pre-eth/hammerpy

Auction price guessing game written in Python that also lets users keep...

17
Experimental
4965 mohamed8905/finance-project

applying web scraping and VIZ and MongoDB to save output. using streamlit

17
Experimental
4966 vonsteer/spiderchef

Low Code Recipe-based Web Scraping Framework

17
Experimental
4967 caltechlibrary/holdit

Generate a printable "on hold" book list from the Caltech TIND server

17
Experimental
4968 MentalGravity101/U-scrape

The YouTube Data Scraping GUI fetches trending video data using the YouTube...

17
Experimental
4969 benwebber/texting-robots-py

Python binding for the Texting Robots robots.txt parser

17
Experimental
4970 Trafexofive/SimpleCrawler-MK4

Production-ready microservices web crawling platform with FastAPI,...

17
Experimental
4971 GdevAlves/lootprice

Um comparador de preços de jogos para PC em lojas confiáveis que utiliza...

17
Experimental
4972 thinhwritesbugs/data-visualization

Assignments in Data Visualization class at Stockton University

17
Experimental
4973 nronzel/jobsifter

Grabs job listings from job boards and exports to CSV.

17
Experimental
4974 imageboardsnet/Foroum.org

A webscraper for jvlike forums

17
Experimental
4975 ManiAm/ollama-remote-models

ollama-remote-models is a tool that scrapes the Ollama website to extract...

17
Experimental
4976 DescobertasDigitais/WebScraping

Coleção de scraping usando Python.

17
Experimental
4977 rafael-acerqueira/scraper-report-platform

Django-powered platform for automated web data collection, price monitoring,...

17
Experimental
4978 Nycollasss/YoutubeTagsScraper

Um web scraping simples que pega tags dos videos am alta do youtube, ainda...

17
Experimental
4979 bendavidsteel/carcinologer

Scraper for moltbook.com - the social network for AI agents

17
Experimental
4980 Cuadernin/Search-Bar-Scrap

Código Python que hace webscrapping al buscador de google de forma masiva...

17
Experimental
4981 hansalemaos/site2hdd

Download sites with public proxies - threading

17
Experimental
4982 okaryo/BookMeterRecordScraping

An application that generates reading records in JSON format from BookMeter.

17
Experimental
4983 GrandLay-e/eyrein-products

Finalité : télécharger les fiches méthode et fiche sécurtité des produits de...

17
Experimental
4984 ritunjaym/automated-grant-discovery

Intelligent web scraping system for automated grant discovery from 800+...

17
Experimental
4985 jofaval/album-scraper

Modularized python script for webscraping of images. Download an Album of...

17
Experimental
4986 omarsolieman/SocialGiveAwayDataAnalysis

This project involved cleaning, analyzing, and processing data from an...

17
Experimental
4987 lucaducceschi/instructacorpus

How to scrape text data for specific NLP purposes from Instructables.com

17
Experimental
4988 maximedrn/vinted-bot

Work-in-progress scraping service for the Vinted platform, intended to...

17
Experimental
4989 MaxineXiong/ACME-Work-Items-RPA

This repository contains a robust UiPath automation solution that utilises...

17
Experimental
4990 KangboLu/UC-Davis-CS-Exams-Analysis

:chart_with_upwards_trend: Regression and Classification with UC Davis...

17
Experimental
4991 ujex256/ScratchTrend

(めっちゃ初心者の頃に作ったやつ)ScratchTrend: Get Popular Projects from scratch

17
Experimental
4992 ThomasJanssen-tech/Web-Scraping-with-Python-and-Beautifulsoup

Web Scraping with Python and BeautifulSoup: the most straightforward...

17
Experimental
4993 FelipeWoo/image-web-scrapper

The Image Web Scraper is a Python script that allows you to collect all the...

17
Experimental
4994 tollsimy/MoodleScraper

A simple python script that allows fast download of videos and files of any...

17
Experimental
4995 Fripixel/mercadolivre-link-de-afiliados

API geradora de link de afiliados Mercado Livre

17
Experimental
4996 theveryhim/Web-scraping-and-Statistical-Tests

Crawling web for data and perform statistical tests to verify judgments

17
Experimental
4997 Alamito/WebScraping-NodeJS

Repositório dedicado a implementação de um algoritmo de Web Scraping para...

17
Experimental
4998 YeemBoi/bc-ferries-graphql

BC Ferries GraphQL API & scraper

17
Experimental
4999 Alanxyz/amino2md

Script para descargar blogs de Amino en formato Markdown.

17
Experimental
5000 michaelsproul/tpg-analyser

Scraper for TPG mobile usage data.

17
Experimental
5001 krisluczka/scrapium.h

Simple, light and fast C++ webscraping library.

17
Experimental
5002 ResupinePuma/SUS

Simple Universal Scraper for parsing reddit, telegram or rss links

17
Experimental
5003 VianaArthur/youtube-scrapper

Buscando informações de canais no YouTube com Python.

17
Experimental
5004 veeqtoh/linkedin-jobs-scraper

This is a Flask application that scrapes job listings from LinkedIn using...

17
Experimental
5005 alimghmi/starbyfaceapi

https://starbyface.com Scraper. ETHICAL CAUTION: DON'T STRESS THEIR SERVERS

17
Experimental
5006 Mikael-UofA/PartiCourtsConsole

PartiCourts is a project visualizing the partisanship of U.S. District and...

17
Experimental
5007 rohitravirane/ytscraper

YTScraper is a command line tool

17
Experimental
5008 cabredev/pl-list

Script para listar los últimos cursos lanzados de la plataforma.

17
Experimental
5009 nikolasrieble/AndroidApp_GermanCitizenship

Learning Kotlin and Android: A Quiz App to practice for the German Citizenship Test

17
Experimental
5010 jamestiotio/pns

SUTD ISTD 2021 50.034 Introduction to Probability & Statistics 1D Project

17
Experimental
5011 abilogos/digikala-blackfriday-scrap

This Project is for digikala.com scrapping challenge of 2021 blackfriday...

17
Experimental
5012 DivyanshTiwari20/Divtt

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

17
Experimental
5013 Bernardo-MG/darksouls-wiki-scrapper

Scrapper to get data from the Dark Souls wiki

17
Experimental
5014 ownport/scrapets

scrapets: scraping snippets

17
Experimental
5015 pjsier/thinkgisdump

Command line tool for scraping GeoJSON from ThinkGIS sites

17
Experimental
5016 PadoVia/GTFSFixerAI

AI Detour Analyzer for updating GTFS data

17
Experimental
5017 ceodoe/4c-dl

Download and monitor media content from 4chan threads

17
Experimental
5018 ivangrana/jsXtractor

JavaScript File Extractor & Wordlist Generator

17
Experimental
5019 simplonco/rails-scraping-mechanize

Rails app with Mechanize ready for web scraping

17
Experimental
5020 Ninja-21-dev/python-batch-api-calls-with-excel

Read data from an excel file and send many requests with data at a time and...

17
Experimental
5021 diegossl/ibovespa-web-scraping

It collects data from the Ibovespa of data on average performance of stock...

17
Experimental
5022 gsidhu/udise-district-dump

Scrapes the UDISE+ dashboard

17
Experimental
5023 nint8835-archive/SchoolTracker

A framework for tracking the status of schools in the NLESD.

17
Experimental
5024 David-M-GitHub/HyperWebScraper

A high-performance multi-threaded web scraper built with Java,...

17
Experimental
5025 68publishers/crawler-client-php

:spider_web: PHP Client for https://github.com/68publishers/crawler

17
Experimental
5026 Kunstenpunt/bandcamp_belgium

Een scraper om Bandcamp releases te vinden van artiesten/labels in België

17
Experimental
5027 jeankassio/Sioner-Metadata-Extractor

Sioner Metadata Extractor uses Chromedriver to extract metadata from...

17
Experimental
5028 Vedant-Baldwa/Times-of-India-Headlines-scraping

Python-based web scraper that extracts the latest news headlines from the...

17
Experimental
5029 murilorrr/Hoteis-WebScraping

Projeto de raspagem de dados de hotéis, para facilitar planejamento de viagem

17
Experimental
5030 vbalalian/roman_coins_data_pipeline

ELT pipeline used for learning the fundamentals of data engineering.

17
Experimental
5031 chankeypathak/goodreads-quotes

Get the popular and recent quotes from goodreads.com

17
Experimental
5032 ryanrishi/loudness-wars

A closer look at dynamic compression over the past 50 years

17
Experimental
5033 DAguirreAg/Financial-news-collectors

A financial news collector and aggregator service that not only collects the...

17
Experimental
5034 krishnavpai/Sentiment-Analysis-Word-Cloud-and-Topic-Modelling-on-customer-reviews-of-FMCG-products-in-India

This project aims to analyze consumer sentiment towards (FMCG) company...

17
Experimental
5035 magotte92/busy-spider

A simple crawler to gather mail of local buisnesses via google. The spider...

17
Experimental
5036 rafabelokurows/data-analyst-job-skills

Insights on skills and salaries using real data (scraped from Linkedin) -...

17
Experimental
5037 umaxiaotian/OpenScrape

OpenScrape is a Python library for scraping data from various services!

17
Experimental
5038 machinia/scraper-factory

Scraping library to retrieve data from useful pages, such as Amazon wishlists

17
Experimental
5039 waltervix/dom_sc_downloader

Realiza download automático de documentos publicados no Diário Oficial dos...

17
Experimental
5040 IGGG/adventar-bot

ADVENTAR をスクレイピングして更新を Slack に通知する Bot

17
Experimental
5041 razuswe/scrapingBBCnewsheadline

This is a implementation of web scraping by BeautifulSoup to scrap the most...

17
Experimental
5042 nornan01/FanficDownloader

FanficDownloader is a Telegram bot that allows users to download fanfiction...

17
Experimental
5043 DamiyanVC/Analyzing-Information-diffusion-in-Ego-centric-Twitter-Network

A social media analysis tool to get the most impactful users from the...

17
Experimental
5044 gscbravo/scred

Simple web scraper for Reddit

17
Experimental
5045 JonasDoesThings/github-contributions

A library for fetching a GitHub user's contribution graph.

17
Experimental
5046 gusandrioli/go-sherdog

Go wrapper for Sherdog.com

17
Experimental
5047 charlesxjyang/Alexandria

An automated scraper and graphing tool for academic researchers

17
Experimental
5048 bcskda/abituz

Заготовка агрегатора данных об абитуриентах вузов

17
Experimental
5049 katekyy/kittykat

An on-demand rotating HTTP/s proxy.

17
Experimental
5050 RamonCintas/AdrenalineStreamAPI

⚡ O projeto AdrenalineStream API é uma API em JavaScript/NodeJS implementada...

17
Experimental
5051 acuas/YouOffScraper

A scraper which downloads uploaded videos from an YouTube channel.

17
Experimental
5052 ymfpfp/soupjs

JavaScript library for simple web scraping.

17
Experimental
5053 mike4ai/google-search-results-nodejs

Scrape and parse Google search results in Node.JS

17
Experimental
5054 simgeilaydameric/web-scraping-case-study

This Python code includes web scraping, MongoDB database interaction, and...

17
Experimental
5055 jyn514/GradeForge

Courses available from my.sc.edu

17
Experimental
5056 mhmdrazn/Jakarta-Gov-Election-Dataset

Jakarta governor election 2024 TikTok campaign comments dataset on 3...

17
Experimental
5057 Dai1678/LeagueCall

League of Legendsについての色々な情報を伝えてくれる、 Google Assistant アプリ

17
Experimental
5058 streanger/unsplash-get

unsplash srape tool

17
Experimental
5059 calibro/chemical-wiki

Establishing and stabilizing knowledge of psychedelics and designer drugs on...

17
Experimental
5060 srivathsashreyas/browser-fetch

A package which allows a user to initiate a fetch call in the browser and...

17
Experimental
5061 firdausmntp/mber

Repository ini dibuat untuk keperluan pembelajaran web scraping. Website ini...

17
Experimental
5062 noalino/boursorama-finance-go

A scraper to get assets historical data from the boursorama website.

17
Experimental
5063 ryu-i-engineer/GetPayments_withGAS

GASを使った支払い情報などを取得するスクリプト集(公開用)

17
Experimental
5064 fpbrault/allmusic-scraper

A simple album scraper for allmusic.com, written in node.js.

17
Experimental
5065 xSyki/page-dumper

A very simple web system for crawling and scraping websites, where we...

17
Experimental
5066 RitsuProject/Zenith

🪐 Github Action responsible for webscraping the index of r/AnimeThemes

17
Experimental
5067 matmatromero/hit_songs

Analyzing the Characteristics Top 100 Songs of 2010 - 2019 Using Spotify and...

17
Experimental
5068 NubPlayz/Goodreads-Buddy

It automatically fetches and displays ratings and stats from Google Play...

17
Experimental
5069 q-m/rest-scrapyd

Ruby client for the Scrapyd REST API

17
Experimental
5070 vlourme/sneakers-discord-bot

👟 Discord Bot that allow querying sneakers and fashion items information

17
Experimental
5071 The-Sad-Zewalian/Knows-Nothing-Bot

This was an attempt to create a GPT-2 Chatbot that knows lifehacks. But it...

17
Experimental
5072 zautumnz/scrapingnode

the tiniest little command-line scraper, with just one dependency.

17
Experimental
5073 zautumnz/scrapegh

[DEPRECATED] cli github scraper

17
Experimental
5074 edjw/pypagerest

A Python wrapper for Page.REST – an HTTP API you can use to extract content...

17
Experimental
5075 jacaranda-analytics/fraser_gehrig

Scrape AFL data from afltables.com. Get around Fraser Gehrig.

17
Experimental
5076 ujex256/Old_ScratchTrend

Get Scratch Trend

17
Experimental
5077 AnakTeka/fetches-twitter-media-bot

Fetches media from Twitter on this exact date years ago.

17
Experimental
5078 haner0834/kmshweb

A modern replacement for the official website of Kang Ming High School.

17
Experimental
5079 AlexR1712/quotes-scrapeit

Get quotes in spanish via web scrapping

17
Experimental
5080 aadityachapagain/DotaCalc

Dota 2 webapp can be used to calculate the winning and losing chance in...

17
Experimental
5081 Edmon02/css-class-remover

A lightweight Chrome extension that automatically removes specific CSS...

17
Experimental
5082 Tezcatlipoca0000/Ayudante

It's mainly a program for a store to manage the products data

17
Experimental
5083 open-source-uc/siding-navigator

Wrapper para autenticarse en el SIDING y navegar a través de sus URLs más comunes.

17
Experimental
5084 matt-wisdom/lyric_info

Find song information(s) from its lyrics snippet

17
Experimental
5085 shambu09/txns-crawler

Crawl bscscan.com for new transactions. Uses multiprocessing for efficiency.

17
Experimental
5086 atharv96k/fake-news-detection

🛡️ TruthLens: An AI-powered fact-verification platform built with React and...

17
Experimental
5087 shellshock1911/Sky-Scrape

Tool that scrapes aviation data from USDOT based on custom user queries,...

17
Experimental
5088 Vastyen/scrap-script

Basic scraping script

17
Experimental
5089 Restuta/iv-download-top-npm-packages

Downloads Top N most dependent upon packages from NPM

17
Experimental
5090 JohnKhor/MangaStream-Downloader

A Python script to download manga from MangaStream.

17
Experimental
5091 Dhanya-Abhirami/Twitter-Sentiment-Analysis

Analyzing tweets on GST Bill for Sentiment Classification

17
Experimental
5092 rodp63/yasl

Domain-specific language for web scraping

17
Experimental
5093 heriswn/Scraping

Scraping Website for Education

17
Experimental
5094 drbuche/Scrapy_Magic_The_Gathering

Scrapy + Power BI = Magic: The Gathering!

17
Experimental
5095 erma0x/price-streamer

stream EURUSD price from truefx.com and visualize it with matplotlib

17
Experimental
5096 renanalencar/FESN_DNE_API

API que realiza consulta de Documento Nacional do Estudante (DNE) emitido...

17
Experimental
5097 makeuseofcode/Get-Weather-Data-Python

Learn how to find real-time weather data using web scraping and APIs in Python.

17
Experimental
5098 caioreis29974/news-scraper-api

A powerful REST API built with Node.js and Express to scrape, unify, and...

17
Experimental
5099 pekasen/instaxtractor

Instant. Extrakt.

17
Experimental
5100 Bixente-san/TweetExtractor

🤖 A Python/JavaScript tool for automated tweet extraction and analysis....

17
Experimental
5101 DALM1/ScrapingPython

USE FOR PERSONAL PURPOSE ONLY

17
Experimental
5102 RuneDD/SiteUpdateNotifier

Get easily notified when a website of your choice makes changes at a...

17
Experimental
5103 T3kan0/Web_Scrapper

Web_Scrapper was written to download and organise CVs, Transcripts and ID...

17
Experimental
5104 sayakpaul/Scraping-DataCamp-Courses-and-Projects

Contains code to scrape the names of DataCamp courses and projects and...

17
Experimental
5105 ZohaibCodez/books-to-scrape-dataset

📚 Public dataset of 1000 books scraped from Books to Scrape using Python,...

17
Experimental
5106 kinginka/tunefind_scraper

Tunefind Scraper

17
Experimental
5107 skyl1n3py/telegram-bot-scraper

Work in progress ...

17
Experimental
5108 mirekjames/twint-zero-research

Clone of twint-zero, edited for academic research purposes by Mirek Stolee.

17
Experimental
5109 bacv/square-log

A nifty tool for collecting and tracking all your cherished activities from...

17
Experimental
5110 darbyjack/PhotoScraper

Fun little project to scrape XenForo profile pictures

17
Experimental
5111 vinhowe/studyspots

PHP page that provides a list of unscheduled BYU classrooms for the rest of...

17
Experimental
5112 wtchristiansen/reddit_scraper

A Shiny app for scraping (via RedditExtractoR) and analyzing Reddit text...

17
Experimental
5113 HenriHTTP/scrapinpy.py

O Scrapinpy.py é uma ferramenta projetada para extrair informações...

17
Experimental
5114 wiktorpiela/election-polls-monitoring

The app based on web scraping background

17
Experimental
5115 yoshitan240801/other

Pythonを使ったWebスクレイピング、統計処理、Jupyter Notebook整形ツールなどの小規模ユーティリティ集

17
Experimental
5116 deypadma2020/DataAnalysis-MLAlgo

Practice repository for data analysis, feature engineering, statistics, web...

17
Experimental
5117 rsyamil/info-retrieval

Information Retrieval and Web Search Engines graduate course

17
Experimental
5118 AHMerrill/Unstructured-Data-1

NLP analysis of car brand discussions: web scraping, Zipf's law, lift...

17
Experimental
5119 Kevin-2099/Scraping-de-titulares-de-noticias-de-El-Pais

Web scraping práctico con Python: extracción de titulares de noticias desde...

17
Experimental
5120 Lunardragn/SimpleSpider

Simple web spider for grabbing embedded images in a site

17
Experimental
5121 dejan3dejan/finbert_sentiment_analysis

An NLP-driven tool for financial news sentiment analysis. Features automated...

17
Experimental
5122 alvarolozano/dgt-test-downloader

API para descargar simulacros de examen de conducir de la DGT

17
Experimental
5123 aayes89/TecnoTV

Handle Channel lists of m3u8 extracted from TecnoTV

17
Experimental
5124 Temirln/Scrapping-Crypto-News-and-Summarize-them

The project should analyze the news page of the coin, the name of which was...

17
Experimental
5125 rebrowser/seatgeek-dataset

SeatGeek ticket marketplace data: events with taxonomy and schedule status,...

17
Experimental
5126 ankushbhatia2/wikipedia_disease_classifier

An LDA based classifier and details extractor for diseases from wikipedia articles.

17
Experimental
5127 eeriemyxi/wiktionary-cli

A fast command-line interface to search words at Wiktionary.

17
Experimental
5128 meysamraz/scraping-and-advanced-nlp-analysis-on-IMDB-TLOU-reviews

In this project, I scraped IMDB reviews of popular HBO series "The Last of...

17
Experimental
5129 rafaelgreca/numbeo-scraper

In order to save time when searching for information about the quality of...

17
Experimental
5130 protostork/sitePingDiff

Python URL scraper that alerts you with an email when websites have changed...

17
Experimental
5131 moralless/greed

Sensitive information extractor

17
Experimental
5132 pierrelefevre/at_se

åt.se is an AI generated summary of the current news feed in Sweden

17
Experimental
5133 pujan/lotto

Scraper lotto.pl

17
Experimental
5134 AnupKumarPanwar/amazondata

A python package to get amazon product and search data in json form. The...

17
Experimental
5135 fcomitani/miniW2V

minimal word2vec implementation in PyTorch with papers abstract scraping tools

17
Experimental
5136 pelekh-o/lez-consumption

Monitoring of electricity consumption by households over time. The data is...

17
Experimental
5137 juanpablovs/web-scraping-malta-tech-mt

A quick web scraping script that will get you the contact details of all...

17
Experimental
5138 The-Sad-Zewalian/Spark-The-League

Doing Some analysis on League of Legends Matches using Pyspark framework.

17
Experimental
5139 ferxohn/document_segmentation

Document Segmentation project in Python.

17
Experimental
5140 srivastavaanurag79/Web-Music-Player

This website scrapes through different free music websites and allows users...

17
Experimental
5141 maradotwebp/RA-Reader

:arrow_down: A Program created to scrap website data from pmg.ages.at, the...

17
Experimental
5142 ProgrammingKiddo/WikiPyGraph

Programa distribuido en Python (con la api pika para RabbitMQ) de creación...

17
Experimental
5143 MJRAnalytics/Web-Scrapers

This is a repository for some of the various types of web-scrapers I have...

17
Experimental
5144 keosariel/Github-repo-info-API

Gets github repo's basic information

17
Experimental
5145 kucingbasah737/node-rapiddns-io-scrapper

Node.js module to scrape and extract result from rapiddns.io

17
Experimental
5146 HlibSamodin11/RugbyScraper_Project

Terminal app for live rugby standings and results. Built with Python + Rich.

17
Experimental
5147 olahepelto/alko-scraper

This simple python script scrapes the alko website for product availability....

17
Experimental
5148 PerpetualSmile/python-web-scraping

learning python scraping

17
Experimental
5149 Akalanka47000/scrapher

A simple Golang web scraper to find some useful metadata about your favourite site

17
Experimental
5150 bivex/tongue_twisters

A Go-based application suite featuring a web scraper for tongue twisters and...

17
Experimental
5151 tuna-f1sh/bristol-choking

Scrapes air pollution data from the Bristol Air Quality website and displays...

17
Experimental
5152 w1cee/crypto_bot

Get the price of the crypto-coin.

17
Experimental
5153 jamestiotio/amigos

SUTD Class of 2022 Teammate Retention Rate Study

17
Experimental
5154 piopy/m3u8-to-html

m3u8 parser

17
Experimental
5155 Vivek-Kolhe/Inshorts-API

Unofficial Inshorts API written in Ruby and Sinatra.

17
Experimental
5156 Mobiwn/Com-Eng-Archive

A simple, user-friendly archive of the now-unavailable website, recreated...

17
Experimental
5157 FranGarcia94/Weather-Python

:sunny: :cloud: Three different ways to get the weather with python :snake:

17
Experimental
5158 sushruta19/bookscraper

Web scraping project built using Scrapy

17
Experimental
5159 ArseniyShchepetnov/wayback-machine-newspapers

Internet Archive web scraping for information bubbles analysis

17
Experimental
5160 0x596173736972/Crypto-Arbitrage-Detector

Crypto arbitrage opportunity finder just for fun, the execution of the...

17
Experimental
5161 andriyor/amalgama-pq

Amalgama lyrics scraping

17
Experimental
5162 FadlyRizqy/Simple-SERP-Scraping-Tool

A simple Google SERP Scraping Tool using SERP API using node.js in Windows OS.

17
Experimental
5163 mhav/geizhals_topten

Scraping the top 10 products from https://www.geizhals.at

17
Experimental
5164 codarkle/CoolGitManager

Who is the true manager of Git NeoNyx?

17
Experimental
5165 ExplorerMunchkin/web-scraping-in-R-HEREDITAS

R Web Scraping/Crawling project that downloads articles from the Hereditas Journal.

17
Experimental
5166 khajaphysist/docs4llm

A simple python script to crawl docs and combine them into a single markdown...

17
Experimental
5167 machinia/fake-proxy

Library that finds public proxies

17
Experimental
5168 Haimonmon/faux-finder

The Fake News identifier is a tool that determines whether a particular news...

17
Experimental
5169 soumith2105/vasvscrapper

A python package for the-vasv-deets project to extract information from vce.ac.in

17
Experimental
5170 Cynnexis/zephyr

Zephyr is a dictionary for LSF.

17
Experimental
5171 Aniket-Dev-IT/Price-Monitor-System

🏷️ Price Monitoring & Analytics Platform - Intelligent e-commerce price...

17
Experimental
5172 rebrowser/autotrader-dataset

AutoTrader car listings database: new, used & CPO vehicles with make, model,...

17
Experimental
5173 LvcidPsyche/webreaper

WebReaper — Ultimate web scraper. Async crawler + stealth mode + security...

17
Experimental
5174 theveryhim/Web-data-crawling

Crawling web for specific topics papers

17
Experimental
5175 Apexal/lector

A super simple Moodle web scraper for my school's Moodle site.

17
Experimental
5176 juandfr/Web-Scraping_ML

Técnica de web scraping/raspagem de dados feito no site do mercado livre.

17
Experimental
5177 FranRguezCer/scrapping-nlp-job-offers

Web scraping + NLP to analyze job offers from Tecnoempleo, comparing keyword...

17
Experimental
5178 fcschmidt/scraping-facebook-friends

Extract Friends List from Public Profile

17
Experimental
5179 ScraperHub/how-to-crawl-apple-app-store-data

How to Crawl Apple App Store Data Without Getting Blocked

17
Experimental
5180 mitakeck/tagoquery

tagoquery : simple goquery wrapper

17
Experimental
5181 Satyamkumarnavneet/Analyticsvidhya-SmartSearch

A smart search system that helps users find free courses on Analytics Vidhya...

17
Experimental
5182 LuisHenrique01/amazon-monitoring-django

Um monitor de preços da amazon usando Django e Django Rest Framework

17
Experimental
5183 opportus/web-scraper

A web scraper taking as arguments a list of URLs and a list of XPath queries...

17
Experimental
5184 vic-lsh/imdb-analytics

Distributed website scraping and analysis system

17
Experimental
5185 wandern-bot/vanguard-fund-analyzer

⚙️ Web scraping + data viz project | Full pipeline from collection to...

17
Experimental
5186 oliverpk2000/tweet-grab

python script that scrapes tweets

17
Experimental
5187 SolangeUG/webscraper

A web scraping project in Python using Scrapy, an open source and...

17
Experimental
5188 sandunwira/js-web-scraping

Web Scraping with JavaScript using DuckDuckGo Search

17
Experimental
5189 saivarshith2000/hacker_news_cli

Command Line tool for reading hacker news

17
Experimental
5190 firdausmntp/opensinta

🎓 Platform visualisasi data SINTA Indonesia untuk pembelajaran web...

17
Experimental
5191 harshit-sh/foot-fixtures

Prints league fixtures for clubs

17
Experimental
5192 akshgpt7/gitscrape

Get the profile details of any github user, just by entering their username.

17
Experimental
5193 DiilaNa/Python-for-Data_Science

This repository contains how to preprocess data, web scraping using requests...

17
Experimental
5194 kalbhor/InstaScrape

:camera: Image & data scraper for Instagram

17
Experimental
5195 AntoData/CoronavirusWebScraper

Web scraper that gets information about the corona virus spread from...

17
Experimental
5196 chidimo/pywebber

Web development tools written in python

17
Experimental
5197 4mr0m3r0/web-scraping

Web Scraping Demo

17
Experimental
5198 WillPiledriver/rapgod

python html scraper that generates FIRE MIXTAPES

17
Experimental
5199 iw3r6y/acara-scraper

📊 🔍 Scrapes data from ACARA's official price guide.

17
Experimental
5200 Glooring/RedditScraperBot

Telegram bot for tracking Reddit user posts and receiving notifications for...

17
Experimental
5201 choppystick/py-sudoku-solver

Python implementation of a Sudoku solver using Linear Programming (LP). The...

17
Experimental
5202 yamiOnEstrogen/moderate

A versatile collection of scripts designed for automating moderation tasks.

17
Experimental
5203 AndreLuque/Investment-Web-Scraping

Data Recollection & Analysis in Financial Markets

17
Experimental
5204 Fruitful-DevTools/pyrus

Pyrus is a comprehensive Python toolkit library that provides developers...

17
Experimental
5205 FKarl/grade_notification_uulm

This script pulls grades from campusonline.uni-ulm.de and notifies users via...

17
Experimental
5206 LJSkinner/Constituency-Electoral-Results-Checker-CLI

Pull constituency seat data from Electoral Calculus and display it in the...

17
Experimental
5207 sujeet-bhalerao/clustering-with-arxiv

Clustering department faculty into research areas using the arxiv API

17
Experimental
5208 crypter70/LTMPT-Scraper

A web scraper program to extract data on the top 1000 schools based on UTBK...

17
Experimental
5209 erfangolpour/SmartClient

A Python script to analyze web servers by sending HTTP/HTTPS requests and...

17
Experimental
5210 GraysonWills/CouponClipper

Coupon clipping automation tool

17
Experimental
5211 Chubek/potpourri

Parallelized web scraping library

17
Experimental
5212 VishalShenoy2002/Github-Tool

A Github Tool which helps people extract repositories and see issues in github

17
Experimental
5213 srakhe/olympics

Olympics: Analysis and Prediction.

17
Experimental
5214 CharlieAlex/Menu-Please

隨機搜尋附近任一家餐廳餐單的 Line 機器人。

17
Experimental
5215 nikitperiwal/MAL-Scraper

A script that can scrape top anime list, their details, reviews, and user...

17
Experimental
5216 Maxence-Labesse/Find-Job-Offers

job offers collecting app

17
Experimental
5217 BenGOsborn/Web-Scrapers

A collection of my web scraping projects.

17
Experimental
5218 gedoensmanagement/google-books

Python script to download color images of public domain books on Google Books.

17
Experimental
5219 Denise-Pro/Iniciacao-Cientifica-I

Projeto de Web Scraping e análise de dados (currículos lattes cadastrados no...

17
Experimental
5220 Dittonal/vscode-extends

在 VS Code 状态栏实时显示金价与市场行情的扩展插件。VS Code extension to display real-time gold...

17
Experimental
5221 anavgupta/scrapping_scripts

A Collection of various website scraping scipts

17
Experimental
5222 saiprasanth-m/COVID-19-India-Report-Visualisation

COVID-19-India status update can be checked here

17
Experimental
5223 CrackedP0t/ErrantBot

A Reddit bot for extracting and posting art

17
Experimental
5224 mkos/krk-poll

Air pollution data scraping and analysis for Krakow, Poland

17
Experimental
5225 k0ssmann/BigBlueCapture

Automated and scheduled recording of BigBlueButton sessions

17
Experimental
5226 lucasdotvin/palestra-web-scraping-para-cacar-pontos-na-escola

Conteúdo pda palestra "Web Scraping para Caçar Pontos na Escola".

17
Experimental
5227 Niaev/link_tracking

A simple Python script tool and package that uses web crawling concepts to...

17
Experimental
5228 MrFlyingToasterman/currentbc

A small Python3 script to parse the current bitcoin stand in euros.

17
Experimental
5229 anuragjoshi3519/Delhi-University-ScoreCard-Fetcher

Delhi University ScoreCard PDF fetcher

17
Experimental
5230 bainmatt/datopy

Assorted tools for data modeling, ETL, and web scraping.

17
Experimental
5231 ArturMiguel/coronavirus-api

[Scraper] API para consulta de dados sobre o coronavírus (COVID-19) em...

17
Experimental
5232 Sparsh-Kumar/finsight

A TypeScript/Node.js library to fetch comprehensive stock-related...

17
Experimental
5233 mohammednudman/play-supported-devices

Typed and optimized local cache of Google’s supported Android devices list,...

17
Experimental
5234 wakfi/scraper-node

Easily scrape any webpage in NodeJS

17
Experimental
5235 zyx898/ProxyManager

The ProxyManager module provides an efficient solution to manage and utilize...

17
Experimental
5236 tirtharajsinha/virtual-assistant

Virtual assistance/chatbot using python.

17
Experimental
5237 MoonPointer-Byte/MoonMusic

python爬虫,爬取QQ音乐,网易云,酷狗的音乐资源听歌下载,爬取需要的图片,用户名获取多社交平台关联用户

17
Experimental
5238 JustFerdy/T20-World-Cup-Analytics

📊 Analyze T20 World Cup match data with a Flask backend and a simple...

17
Experimental
5239 PaoloDalena/film_analysis

Analysis of my tastes on films (under development)

17
Experimental
5240 jama5262/react-link-previewer

This is a react app that displays a visual preview and brief description of...

17
Experimental
5241 kenttonino/sw-wikipedia-scraper

A CLI tool that scrapes Wikipedia information.

17
Experimental
5242 keltia/fetiche-go

**STOPPED** Web pages monitoring daemon w/ CLI interface (WWW to come) **...

17
Experimental
5243 Almost-Inc/scrapey-cli

Scrapey CLI is a lightweight, modular command-line tool built in Go for web...

17
Experimental
5244 akash-kumarrr/GrabL

Async HTTP client in Rust — GET & POST requests using reqwest + tokio

17
Experimental
5245 YagmurCemGul/book-scraper

Python script that scrapes book titles and prices from books.toscrape.com...

17
Experimental
5246 prateek-code-22/NASA-Scrapped-data

In this repository I have used six different NASA-APIs to extract data and...

17
Experimental
5247 umbertocangelosi/webscrap_booking

A webscraping project, using beautifulsoup and a lot of patience :)

17
Experimental
5248 threnjen/Movie_Studio_Recommendations

Movie Studio Recommendations is an early project with in-depth data analysis...

17
Experimental
5249 ChahiriAbderrahmane/CarPricePredictor

🚗 Cars Exploration & Price Prediction | Analyzing Cars.com Listings

17
Experimental
5250 rudrajoshi2481/WebPageHarvester

A robust and polite web scraping tool designed to recursively download all...

17
Experimental
5251 TerminalWarlord/PriceLens

Pricelens is a hobby projects that scrapes tech products and their prices...

17
Experimental
5252 issamsisbane/mawaqit-discord-notify

Mawaqit is a Node.js project. Its purpose is to scrape data from the MAWAQIT...

17
Experimental
5253 ty70/news-summary-translator

Automatically fetches, translates, and summarizes world news from Yahoo!...

17
Experimental
5254 YambwaImwaka/zambia

A python data scrapper for legally scrapping different Zambian data from...

17
Experimental
5255 kurtnettle/bubt-routinepy

An unofficial Python wrapper of the BUBT Routine API + a robust web scraper...

17
Experimental
5256 jeshan1111/python-web-scraper

A Python program that scrapes quotes from a website and prints them in the terminal.

17
Experimental
5257 mychiffonn/hanzii-scraper

Scrape Chinese vocab on hanzii.net for LinguaCafe

17
Experimental
5258 danlikendy/articles_project

Article parser for Habr, Proglib, and vc.ru that extracts main content,...

17
Experimental
5259 Op27/NewsAutoAnalysisUKR

NewsAutoAnalysisUKR scrapes, analyzes, and summarizes Ukraine War news...

17
Experimental
5260 djinn-technologies/VisageSearch

VisageSearch is a Python-based tool that allows users to scrape photographs...

17
Experimental
5261 jakk-er/ScrapEZ

ScrapEZ is a web scraping tool that allows you to extract links and data...

17
Experimental
5262 DrKenReid/DeadLinkScraper

A short Python script built in Google colab for iteratively searching...

17
Experimental
5263 4l3j0Ok/BCRA-Scraper-API

REST API de los bancos disponibles en el BCRA.

17
Experimental
5264 michael-abdo/vendor-intelligence-tool

Web-based tool for extracting and analyzing client/customer information from...

17
Experimental
5265 Hibiki-Mizoue/web_scrape_quotes

Quotes to Scrape から名言を取得し、CSV/Excelに出力するWebスクレイピングツール

17
Experimental
5266 nabinkhair42/web-sense

Agentic search pipeline with local LLM synthesis

17
Experimental
5267 vwkd/metabo-scrape

Scrape products from Metabo

17
Experimental
5268 RobeSantoro/Monet-Painting-Scraper

Python script that scrapes Wikimedia Monet's page and downloads all the...

17
Experimental
5269 prodigeris/ai-job-hunter

AI-powered tool for automated job hunting.

17
Experimental
5270 jimbob88/darksky_scraper

A python written module for scraping the Forcast from Dark Sky

17
Experimental
5271 rebrowser/copart-dataset

Copart salvage auction data: vehicle listings with damage types, title...

17
Experimental
5272 RadouaneElarfaoui/anime3rb_scraper

A Python scraper for Anime3rb to fetch and organize anime content.

17
Experimental
5273 pedrovernetti/filmow-to-csv

Tool to export Filmow lists and users (watchlist/favorites/watched data) to...

17
Experimental
5274 filip-stepien/scraper-cen

Prosty scraper cen produktów.

17
Experimental
5275 ftrifoglio/ecom-scraper-demo

Simple application to scrape products data from an e-commerce website.

17
Experimental
5276 ShubhamChoulkar/Codeforces-Analyser

The Codeforces Analyser is a desktop tool that scrapes top solutions based...

17
Experimental
5277 Luxenonbeterris/currency-exchange-bot

A multilingual Telegram bot for currency exchange rates, conversions, and...

17
Experimental
5278 Eaglemann/Tagesschau-Crawler-Flask

This is a web scraping and article versioning application built with Flask,...

17
Experimental
5279 zaidkx37/Agency

A Python tool that automatically collects information about real estate...

17
Experimental
5280 Bist0uille/prospection_seo

B2B lead generation pipeline — SIREN database, SEO audit, prospect scoring

17
Experimental
5281 up9t/indonesia-area

All Indonesia area with postal code available in CSV and JSON format.

17
Experimental
5282 odinglyn0/Proxy-Managment-DynamoDB

Scrape proxies from public services like Geonode and store proxies in DynamoDB

17
Experimental
5283 arv-anshul/hockey

Scrape hockey data using scrapy with pydantic validation. Data available on...

17
Experimental
5284 darideveloper/couponscorpion-notifier

Check the new courses from the page couponscorpion.com/courses and send a...

17
Experimental
5285 Kyostenas/siiau_consultas_api

API para obtener todo tipo de información estructurada de siiau

17
Experimental
5286 MYTE21/Red.Blue.States

Scraping a static Wikipedia page, "Red states and blue states," to collect...

17
Experimental
5287 vwkd/subaru-community-scrape

Scrape thread from Subaru Community forum

17
Experimental
5288 MrCaptain27/LianJiaScraper

这是一个基于Spring...

17
Experimental
5289 RuchirChawdhry/Jupyter-Notebooks

🗒 🐍 A collection of my jupyter notebooks on all things python.

17
Experimental
5290 makism/find-a-ps5

Some simple Airflow pipelines to check and notify for PS5 availability.

17
Experimental
5291 urre/chock.press

Having fun with Swedish evening news.

17
Experimental
5292 PedroL22/MyAnimeList-Web-Scraping-with-BeautifulSoup

A Web Scraper created with Python and Beautiful Soup.

17
Experimental
5293 krauss/brazfoot_cli

Brazillian Football Web Scrapper CLI written in Python

17
Experimental
5294 octocatblain/Webscraper

Web scraping is the practice of extracting content and data from a website...

17
Experimental
5295 MukundAabha/Data_Science_With_Python

This repository contains data science & machine learning operations using python.

17
Experimental
5296 AshvikMishra/trackSwap

Python script to scrape an Amazon Music public playlist, clean the data, and...

17
Experimental
5297 monk-time/tspdt-next-1k

An attempt to figure out the order of the movies ranked 1001-2000 on TSPDT...

17
Experimental
5298 fled-dev/Tracebound

Tracebound is a highly optimized, asynchronous web scanner designed to...

17
Experimental
5299 constantgillet/pugcrawl

Pugcrawl is a lightweight and easy-to-use crawler that extracts data from...

17
Experimental
5300 vwkd/ortovox-scrape

Scrape products from Ortovox

17
Experimental
5301 jezweb/n8n-nodes-firecrawl-tool

n8n community node for Firecrawl v2 API - Web scraping, crawling, and data...

17
Experimental
5302 matheusfelipeog/google-doodles

Mapeie e faça download dos Doodles do Google.

17
Experimental
5303 hybtli/CVE-Report-Generator

CVE-Info-Report-Generator

17
Experimental
5304 emillvl/insta-not-following-back

Instagram Follower/Following Analyzer — a client-side JavaScript tool that...

17
Experimental
5305 nexvou/scripts

A powerful, scalable, and production-ready coupons scraping system for major...

17
Experimental
5306 sanalzio/tranimeizle-arama

Tranimeizle sitesinde anime araması yapan basit bir REST API servisi.

17
Experimental
5307 emadflash/scrapying-comics

scrap readcomiconline.li for comic info

17
Experimental
5308 chemark/rssos

🚀 Universal RSS Generator - Generate RSS feeds from any website without...

17
Experimental
5309 drewvlaz/grade-checker-script

Web scrapes grades and emails updates

17
Experimental
5310 nichmorgan/Cloud-Prices-Crawler

Crawler to track cloud hosting prices

17
Experimental
5311 UOSHUB/Schedule

An old demo of the re-designed schedule in UOS HUB website

17
Experimental
5312 anavgupta/Mailinator_Alternate_Domains

Create a file that contains the alternate domains of the Mailinator Website...

17
Experimental
5313 nav727/MLProjects

Learning materials, code, and data for machine learning projects.

17
Experimental
5314 gbenejam/NonStopGymOccupancyBot

Simple bot to check in real-time the occupancy of NonStop Gyms

17
Experimental
5315 lulurun/web-data-miner

Nodejs library automatically extract data from html

17
Experimental
5316 backdevs/scrapeninja-go

A Go client for ScrapeNinja - https://scrapeninja.net

17
Experimental
5317 LeivSuaxy/pytoque

Small library to get currency costs from Eltoque

17
Experimental
5318 githubstevemas/Cine-Fetch

Fetch information for the films in your video library using themoviedb.org API

17
Experimental
5319 mapace22/DE-Zuber-Taxi-Market-Analytics-SQL

A comprehensive study of Chicago's taxi market for Zuber. Integrates Web...

17
Experimental
5320 MathGeneze/Intensivao-Python

Repositório com projetos em Python abordando temas como Automação de...

17
Experimental
5321 kapilraghuwanshi/web-scrapping-app

Simple web scrapping solution for auto login into any website using your...

17
Experimental
5322 ioboi/obloc-data

Scrape guest counter of O'BLOC 🧗‍♀️

17
Experimental
5323 aj4abinjacob/Google-Maps-Review-Scraper

Scrape google maps reviews

17
Experimental
5324 Temirln/Web-Scrapping-Cryptocurrencies

Web Scrapping Cryptocurrencies using Python programming language and requests library

17
Experimental
5325 general-labs/News-and-Weather

News and weather feed based on Serverless NodeJs 10 (AWS stack).

17
Experimental
5326 Pastorsin/casares-news

ReactJS app that shows the lastest news of the city of Carlos Casares and...

17
Experimental
5327 asecco/espn-cbb-247-recruits

A simple browser script for passionate CBB fans to access 247Sports HS...

17
Experimental
5328 KonH/PuzzleEnglish-Dictionary-Exporter

A Tampermonkey userscript that exports PuzzleEnglish dictionary words and...

17
Experimental
5329 Ismail-Benali/InfoMagnet-X

InfoMagnet-X

17
Experimental
5330 cityssm/wsib-clearance-check-csv-cli

A command line tool to retrieve clearance certificates from the WSIB website.

17
Experimental
5331 riodevnet/nodescraper

NodeScraper is a fast and flexible Node.js web scraping toolkit built using...

17
Experimental
5332 stonegold546/gradcafe-school-admission-results

Web app that scrapes the gradcafe admissions results page and returns some...

17
Experimental
5333 filming/melodic

Melodic is a client for fetching lyrical discographies of music artists.

17
Experimental
5334 dimrizo/news_to_sms_hf_pipeline

This is a Python project where news/blogs posts are scrapped from a website...

17
Experimental
5335 motazsaad/article-info-extractor

Extract title, date, text from web articles.

17
Experimental
5336 BlaizerBrumo/Google-Form-AutoFiller

Node.js tool that automates the process of filling and submitting Google...

17
Experimental
5337 Souvic/mtweepy

Fastest scraping using multiple apps and user tokens for Twitter API!

17
Experimental
5338 hansengianto/instagramscrape

Instagram Profile & Post Information Scraper

17
Experimental
5339 H4wk507/MonkeyTypeBot

A simple typing bot for https://monkeytype.com

17
Experimental
5340 Rafixyz007/zillow-agent-data-pipeline

Zillow Agent Data Collector & Normalizer

17
Experimental
5341 albertainstian/car_webscaper_data_ai_ml

CLI that finds a target make/model on Craigslist; HTML+RSS fallback; saves...

17
Experimental
5342 unSoto/MarketScope

The project is a software application designed for the automatic collection...

17
Experimental
5343 MLlAlonso/FormScraper

Herramienta automatizada diseñada para facilitar la extracción estructurada...

17
Experimental
5344 arlovy/ScrapingMELI

Extraccion y carga de datos de inmuebles en venta de MercadoLibre dentro de...

17
Experimental
5345 AFOEK/WSGCC

This is web scraping project, it will provide character card images, wish...

17
Experimental
5346 ZUR1C4T0/scraper-flv

Un web scraper para el sitio web AnimeFLV para extraer información sobre los animes.

17
Experimental
5347 wkuratana/tinyscraper

A Python package designed to help with scraping post data from imageboards...

17
Experimental
5348 hansalemaos/browser2requests

A class for capturing network requests in a browser and converting them to a...

17
Experimental
5349 Lastaapps/suz-aktuality-bot

Discord bot that scrapes news from SUZ CTU news website and posts then to...

17
Experimental
5350 poxju/FiCo

FiCo – Find&Compare is a lightweight Single Page Application (SPA) that...

17
Experimental
5351 Coryson/osm-mla-finder

Python script to locate institutions employing Medical Laboratory Assistants...

17
Experimental
5352 Pharmyx/Retro-Vault

An app for searching and favoriting retro items across platforms like eBay.

17
Experimental
5353 Timdpr/bloodsheet-updater

Automatically updates Quantum Force's 'Bloodsheet' tool with data from gpro.net.

17
Experimental
5354 nmmar/itewiki-scraper

Itewiki company details web scraper

17
Experimental
5355 AbreuHD/Bidehan

Bidehan is a lightweight and efficient .NET library designed for scraping...

17
Experimental
5356 promptapi/scraper-cli

CLI Tool for Prompt API's Scraper API, works for macOS, linux and windows :)

17
Experimental
5357 nickmitchko/TorScraper

Web scraping using tor daemons.

17
Experimental
5358 irgidev/nlp-gojek-app-review-scraper

A tool to scrape Gojek app reviews from the Google Play Store. This project...

17
Experimental
5359 pixelflowxyz/f1-decisions

A Python script to download all F1 documents from the FIA decisions page

17
Experimental
5360 AyQWERTY/WarThunder-Tanks-Scraper

Specs scraper for War Thunder tanks from official wiki website

17
Experimental
5361 aleenprd/bilka2go-scraper

A scraper for https://www.bilkatogo.dk/

17
Experimental
5362 ilyazub/scraping-web-applications

Scraping of Web Applications book

17
Experimental
5363 Galitan-dev/nationsglory.py

A python library that retrieves information from nationsglory.fr, just for you!

17
Experimental
5364 IlyasMakari/pagination-detector

A lightweight TypeScript library for detecting pagination structure in web...

17
Experimental
5365 jonaskahn/user-agents

A lightweight Kotlin library to generate random user-agents for JVM...

17
Experimental
5366 saadHajari/Scraping-Job-Vacancies-From-the-reed.co.uk

This project is a web scraper for extracting job listings and vacancies from...

17
Experimental
5367 DerickAnjos/world_cup_prediction

2022 FIFA World Cup (Qatar) prediction, using Multinomial Logistic Regression.

17
Experimental
5368 alessandro1802/page-recommender-system

Recommender system of Wikipedia articles based on the history of previously...

17
Experimental
5369 mubtasimfuad/Google_Map_Scrapper

Scrapping google map data with Silenium and Beautifulsoup

17
Experimental
5370 cfragiadakis/Roget-Thesaurus-Classification

Analysis of Roget's Thesaurus lexicon, using web scraping and machine...

17
Experimental
5371 Aniket-Dev-IT/python-automation-scripts

🤖 Collection of useful Python automation scripts for developers and system...

17
Experimental
5372 n1sym/KingHalo

中央競馬に出走する母父キングヘイローの競走馬を一覧にしたページ

17
Experimental
5373 50-Course/medline

The homebase of everything healthcare - Get to know the latest trends in...

17
Experimental
5374 uzlss/bbs_scraping

BBS - Big Blue & Stupid company scraping project

17
Experimental
5375 abhayvikramnayak98/CricketDataIngest

Data Ingestion Project on Cricket World Cups 2011-19.

17
Experimental
5376 soroushsohrabi/digistyle-scraper

A simple Python scraper for Digistyle that collects product data and exports...

17
Experimental
5377 NDDimension/AI-Web-Scraper

An intelligent web scraper that extracts and processes web data using...

17
Experimental
5378 Kevin-2099/price-tracker-books

Un script en Python para extraer el precio diario de un libro de la web...

17
Experimental
5379 lanavirsen/yh-monitor

Python tool that monitors Swedish YH late-application programs with CSV...

17
Experimental
5380 surajkumar00a2/personal-portfolio-projects

Portfolio of data engineering projects: ETL pipelines, web scraping, data...

17
Experimental
5381 Simple-Python-Scrapy-Scrapers/appstore-reviews-scrapy-scraper

Apple Store Reviews Scraper - A powerful, production-ready Scrapy spider...

17
Experimental
5382 aalyth/vct-wigo

Wikipedia web crawler and summarizer project for VCT (ВОТ) class.

17
Experimental
5383 olicastrol/CSGO-Match-Tracker

A data science project that scrapes and analyses CS:GO Major tournament data...

17
Experimental
5384 Dsantra92/Andha-Kanoon

Scraper for Indian Law articles

17
Experimental
5385 imamjabar/scraper-kemenperin

A Python-based web scraper for extracting company information from the...

17
Experimental
5386 jsun-dot/DramaNite

A command-line tool designed to seamlessly stream Asian TV shows and movies...

17
Experimental
5387 ninetynin/slcm_notifs

A bot which scrapes the mit manipal's slcm notifications and uploads them as...

17
Experimental
5388 talhapythoneer/kijiji-scraper

It's a Scrapy(Python) based script to scrape Kijiji is a Canadian and...

17
Experimental
5389 nerevu/hdxscraper-undp-climate

UNDP Climate Change Data Collector

17
Experimental
5390 myke11j/instagram-profile-analyzer

Scraper for Instagram profile using casperjs and nodejs. Front-end is in React

17
Experimental
5391 dr-Faust-ux/Crypto-News-Parser

A Python script that collects the latest news about cryptocurrencies from...

17
Experimental
5392 Delta-Datalab/property-scraper

Property scraper - Extracts diverse property details from a real estate...

17
Experimental
5393 kelynst/wiki_scraper

Python | Web Scraping | Data Extraction | BeautifulSoup | CSV Automation

17
Experimental
5394 Neeraj-Chaurasiya/Web-scraping-books

Multi-page web scraper for books.toscrape.com using Python, BeautifulSoup,...

17
Experimental
5395 step2-technology/ga-llm-search

GA-LLM-Search combines Genetic Algorithms (GA) and Large Language Models...

17
Experimental
5396 trueegorletov/analabit-webui

UI for the missing anal for abits

17
Experimental
5397 IsaacAlves7/etl

🎂 It's a repository of ETL/ELT (Extract, Transform, Load).

17
Experimental
5398 AbdulRahmanAlsakkaDitAkkad/web-scraping-beautifulsoup

A Python project that scrapes product data using BeautifulSoup

17
Experimental
5399 jshinm/web-scrapper

Web Scrapper used to extract NeuroData github repo stats

17
Experimental
5400 IanZhang123/Universal-Scraper

🧑💻 Scrape data effortlessly with Universal Scraper, an AI-driven SaaS tool...

17
Experimental
5401 TheBlueEngineer/Serene-1.0

This project is composed of a data scraper for Reddit, a data filter for...

17
Experimental
5402 cpatrickalves/scraping-examples

This repository contains severals Jupyter Notebooks with Web Scraping...

17
Experimental
5403 Mahirshadid/bikroy.com_data_science

From data web scraping to analysis, I'll do everything on this project.

17
Experimental
5404 hakkd/predictFPL

Fantasy Premier League player stats analysis and performance prediction...

17
Experimental
5405 andrewguenthner/artmap

Code for a deployed Heroku app that scraped LocalWiki to provide info on...

17
Experimental
5406 petersammuel/ETL--MongoDB-YouTube

Large amount of data with diferent formats such (csv, xml, json, raw), goal...

17
Experimental
5407 Shahriar-0/Web-Scrapers

some small web scrappers I wrote for some random projects.

17
Experimental
5408 CodeDotJS/urlist

A Python script that extracts URLs from a text file containing a list of websites.

17
Experimental
5409 Marlup/Expected-news

Extract news from hundreds digital media, create summarizations and...

17
Experimental
5410 Devwarlt/tcc-nadio-pontes

Código fonte utilizado no projeto SisBIN - Sistema de Boletins Integrado...

17
Experimental
5411 yoic1239/edmonton-restaurant-eda

End-to-end data pipeline analyzing Edmonton restaurant trends using Google...

17
Experimental
5412 Siddharthsuresh92/YouTube-viral-trends-COVID

An analysis of trending videos across the world during a pandemic

17
Experimental
5413 Himel-Sarder/Web-Scraping-IT-Jobs-dataset

This project is a Python-based web scraping tool that collects job listings...

17
Experimental
5414 ankur-nikam/amazon_price_tracker

app built using streamlit to track amazon product prices

17
Experimental
5415 tvdaal/animal-classification

Classifying Big Five animals from web-scraped images with a convolutional...

17
Experimental
5416 zer-far/roulette

Efficient random user-agent and referrer generator.

17
Experimental
5417 siongui/goigmedia

Get links of Instagram user media (photos and videos) in Go.

17
Experimental
5418 felipeh3005/Web-Page-Downloader-CLI

Production-ready Node.js CLI that downloads web pages with local assets,...

17
Experimental
5419 devoidx/price-tracker

Track prices on shopping sites and view changes over time

17
Experimental
5420 ahmedshahriar/daraz-scraper

Daraz scraper

17
Experimental
5421 FrederickRoman/etymology-predictor

This is an etymology prediction RNN model that uses data scraped from Wiktionary.

17
Experimental
5422 lorenzo774/devto-news

Web scraping tool written in python

17
Experimental
5423 rayhanadev/Amazon-CLI

Get Amazon Information from the comfort of your CLI.

17
Experimental
5424 Smile040501/Search-Engine

A search engine that takes keyword queries as input and retrieves a ranked...

17
Experimental
5425 AliAtaollahi/Data-Science-Course-Projects

Various data science projects, including data scraping, hypothesis testing,...

17
Experimental
5426 falsepopsky/junodownload-scrapper

junodownload scrapper for new and coming soon releases

17
Experimental
5427 AlexandrosKyriakakis/MarketDataset

Web Scrapping to fill our fake Database.

17
Experimental
5428 rxavier/bot-comentarista

Twitter bot that mimics an El País user.

17
Experimental
5429 willy-r/jovem-padawan

Um programa para monitorar novas ofertas em...

17
Experimental
5430 giuliano-macedo/siscad.py

Modulo para extrair informações do siscad

17
Experimental
5431 megamillions/Link-Verification

Checks that all links at URL are valid, and print any problematic links with...

17
Experimental
5432 Gianmarc0Dev/UAAPI

im trying to create an amazon api to use with python

17
Experimental
5433 llgava/minecraft-marketplace-web-scraping

A Web Scraping to collect information on all items for sale on the Minecraft...

17
Experimental
5434 stanleyclaudius/job-scraper

Web scraping using Python to extract job data from Indeed

17
Experimental
5435 andylvua/QuestionsParser

A Python package for parsing questions from pdf files.

17
Experimental
5436 SotongDJ/CFP2

CuttleFish Podcast Player

17
Experimental
5437 dearkafka/checker

🔥 Blazingly simple any website scrape, compare with db, notify in Telegram 🔥

17
Experimental
5438 camilamaia/crawl4us

[WIP] A Python web crawler looking wildly for tables 🕵️‍♀️

17
Experimental
5439 mzubairtahir/ebay-search-result-scraper

It is a python scraper scraping search results from 'ebay.com' website

17
Experimental
5440 max-efort/scraple

Simplify the process of web scraping

17
Experimental
5441 sakshamssr/Finance-API

Web Scraping Bonds Details.

17
Experimental
5442 MengLi00Julia/auto-podcast-downloader-and-transcriber

Using BeautifulSoup for automatically web scraping and AssemblyAI API for...

17
Experimental
5443 WilliamTuominiemi/headline-scraper

Web scraper which gets the 1000 latest headlines with a link and a date for...

17
Experimental
5444 DefinetlyNotAI/Youtube_Downloader

Super basic youtube downloader

17
Experimental
5445 mananapr/reddit_india_pipeline

Pipeline that scrapes data from r/india subreddit and finalizes data for the...

17
Experimental
5446 AhmedOsamaMath/instagram-giveaway-bot

A Python script that automates posting comments on an Instagram post for a...

17
Experimental
5447 aidiss/slant-scraper

Scrapy project for scraping www.slant.co.

17
Experimental
5448 Francesco-Sovrano/Swiss-G2C-User-Guide-Analysis

Extensive analysis of user guides in Swiss government-to-citizen software,...

17
Experimental
5449 LSIND/Kaggle-Users-Get-Info-Tutorial

Scraping Kaggle Users pages, transform data and put into database

17
Experimental
5450 bright-data-de/US-Lawyers-Directory-dataset-samples

Erkunden Sie Details zu US-Anwälten für die juristische Recherche über die...

17
Experimental
5451 ck-earlyrepos/Equibase-Data

A well-organized project that was doomed from the start. Do not use this...

17
Experimental
5452 jonathanhefner/ryoba

Nokogiri utility methods

17
Experimental
5453 emppu-dev/google-scout

Flask web application where you can perform Google searches with more...

17
Experimental
5454 TomiToivio/data-aktivismin-opas

Kansalaisyhteiskunnan opas tekoälyn aikakauteen.

17
Experimental
5455 slysz/wn2pdf

Web Novel 2 PDF

17
Experimental
5456 rithunkp/Whatsapp-PDFDownloader

Python tool that automatically extracts and downloads all PDF documents from...

17
Experimental
5457 Niranjan-stat/Analysis-of-Top-Billionaires-Data

A data analysis project scraping and analyzing data about top 500...

17
Experimental
5458 juanitadevelopment/linkre

Smart Link Collection Tool - Chrome Extension

17
Experimental
5459 rebrowser/shopee-dataset

Shopee marketplace data: product listings with variant-level pricing,...

17
Experimental
5460 prateek-code-22/News-WebApp

A web application which uses flask framework and python to fetch the daily...

17
Experimental
5461 rashidazarang/airtable-clipper

Turn any website into structured Airtable data with one click. Built for...

17
Experimental
5462 spig95/review-tracker

A Django project to scrape reviews and show the average evolution over time.

17
Experimental
5463 Matti88/suggestscraper

A Python library inspired by Autoscraper. It scrapes data by providing an...

17
Experimental
5464 justadreamer/SkyScraper

HTML scraping for iOS via XSLT transformations. wrapping libxslt.

17
Experimental
5465 matsubara0507/haskell-advent-calendar

Posts of Haskell Advent Calendar in Japan

17
Experimental
5466 ispyhumanfly/prowler

Query the web, extract data from the results, and transform that data into a...

17
Experimental
5467 reconSuave/discord-invites

A list of 20k discord invites.

17
Experimental
5468 sam-math/tensorcar

Data science app for car price prediction. Includes web scraping, data...

17
Experimental
5469 divyansh1195/Python-Bootcamp-2020

Python Bootcamp 2020 Notebooks and Assignments

17
Experimental
5470 ranieri-unimi/wailord

Network analysis 🫱🏽‍🫲🏻 of compatibility between Pokémons 🐉 from battle logs

17
Experimental
5471 ahermida/Goberon

Villanova Course Indexing CLI. Rewrite of Oberon...

17
Experimental
5472 Everlag/preordain-backend

backend for preorda.in

17
Experimental
5473 bitliner/scrapy-chan

Scraping made easy.

17
Experimental
5474 SazumiVicky/proxy

Sazumi Proxy is your go-to destination for accessing the web with freedom...

17
Experimental
5475 Ayobamidele/Request_100

Get's media searches and requests.

17
Experimental
5476 brasilemdados/Olho-Cidadao

A solução integra diversas fontes oficiais, como Câmara dos Deputados,...

17
Experimental
5477 saehun/slack-status.ts

A nodeJS package which can retrieve slack status via HTTP with zero dependency

17
Experimental
5478 fffelix-jan/emailsanta-py

Python library to "send a letter to Santa" using emailsanta.com and receive...

17
Experimental
5479 karlicoss/spinboard

Python bindings for Pinboard search

17
Experimental
5480 0adri3n/akiraJobFinder

Un outil pour trouver un travail! [Uniquement utilisable en France pour l'instant]

17
Experimental
5481 quarckster/exportastic

Semi automatic script to export your activities from runtastic.com to gpx, kml or tcx

17
Experimental
5482 GaryOma/yats

Yet Another Twitter Scraper

17
Experimental
5483 DhrumilShah98/CityCompaniesDataPythonScript

Python script to fetch companies data

17
Experimental
5484 dushyantRathore/Football-Client

A Command line interface for Hackers who love football.

17
Experimental
5485 XecusM/alibaba-scrapping

Scrapping the first page items details maximum for any list of items and...

17
Experimental
5486 omaestres/UOC-TCVD-PRACTICA1

Dataset de las noticias de los dos principales diarios Españoles con...

17
Experimental
5487 maharajbrahma/library

Web Library scraping functioning for CIT Kokrajhar Library

17
Experimental
5488 Parassharmaa/NewsME

Python Script to scrap the news headlines from news-websites. (Accuracy 88%)

17
Experimental
5489 jfilter/tweets-with-images

Get all tweets with images from a given Twitter user

17
Experimental
5490 slauzinho/farmacia.py

Python script to scrape PAI website

17
Experimental
5491 wisnuprama/pyscrap

Srap scrap scrap! Let's scrap a person's LinkedIn profile.

17
Experimental
5492 Rai-Sama/Virtual_Assistant

Voice Recognition based Virtual Assistant in python

17
Experimental
5493 maturner5/turtlescrape

turtlescrape is a very simple project to turn web scraping from multiple...

17
Experimental
5494 allendema/beauty_reichelt

Scrapes reichelt.de for products. With BeautifulSoup.

17
Experimental
5495 palaganaskurl/jobstreet-scraper

JobStreet Scraper

17
Experimental
5496 Freeloot/Exif-Scraping-Tool

EST is a CLI based script that allows you to retrieve and store exif data of...

17
Experimental
5497 geotribu/stats-twitter-geotribu

Scripts de scrap de données Twitter sur GeoTribu, ainsi que de...

17
Experimental
5498 Amal-Saber/Web-Scraping-Project

python code for doing web scraping and getting some data.

17
Experimental
5499 MuseosAbiertos/docx2csv

Parses .docx files to extract VRA Core artwork information

17
Experimental
5500 PrinceEGY/LinkedIn-Job-Scraper

A tool for scraping public available jobs from LinkedIn

17
Experimental
5501 blackhatinside/Btech_PyDoSc

Python Reconnaisance using Google Dorks and Web Scraping

17
Experimental
5502 nbilbo/climatempo

Verificar a temperatura de cidades.

17
Experimental
5503 joliegrace/E-hentai-downloader

A simple script for scrap & download e-hentai gallery

17
Experimental
5504 n0nuser/vandyck-tormes-api

Get today movies in Cines Van Dyck

17
Experimental
5505 amirhoseinsb/virgool-posts-short-link

Two scripts for extract the link of all user posts on the Virgool site

17
Experimental
5506 carlosrocha-dev/Controlnet-Downloader-Model

Este diretório contém o Controlnet-Downloader-Models v0.0.1, um script...

17
Experimental
5507 Qyfashae/Extract_Off_Data

Extract Data from offline file. Ex: Emails, Phone Numbers, Links etc.

17
Experimental
5508 gevendra115/Instagram-Follower-Scraper

Scrapes all the data of followers of any instagram account

17
Experimental
5509 hansalemaos/lxml2pandas

lxml to pandas for fast web scraping

17
Experimental
5510 marianocanonero/scraper-for-sec-adv-forms

Python Module for scraping SEC ADV Forms from https://adviserinfo.sec.gov

17
Experimental
5511 hbvj99/scrape_yellowpage

Python scripts that harvest data from yellow pages; includes source-code and...

16
Experimental
5512 Bartwel27/httScrap

A simple web scraping tool built with Python, using BeautifulSoup and...

16
Experimental
5513 neeel99/igreelscrape

Still in Progress: Download Instagram reels effortlessly, simplifying the...

16
Experimental
5514 hugramirez/cryptocalculator

Cryptocaculator es una web funcional basada en el práctico framework flask,...

16
Experimental
5515 suke0828/download_amazon_image

PythonでAmazonからASINもしくはISBNを使って画像をダウンロードする

16
Experimental
5516 ChxGuillaume/tech-products-notifier

Tech Products Notifier on Telegram

16
Experimental
5517 sasalatart/siding-navigator

Wrapper para autenticarse en el SIDING y navegar a través de sus URLs más comunes.

16
Experimental
5518 Omarleel/Social-Media-Fetcher

Descarga masiva de imagenes/videos de redes sociales conocidas

16
Experimental
5519 Arp-1/web-scrapping-demo-extension

A small and simple extension to fetch data from a website

16
Experimental
5520 t1h0/imdb-portfolio-analysis

What are the main topics in all TV shows / movies, artists on IMDB are...

16
Experimental
5521 FlowExtractAPI/propertyfinder-scraper

Extract property listings from PropertyFinder across the UAE, Saudi Arabia,...

16
Experimental
5522 OnerInce/etl-tsl_events

etl pipeline for turkish football events

16
Experimental
5523 syntheticjohn/predict_movie_revenue

Predict domestic gross revenue of movies before release using web scraping...

16
Experimental
5524 GLorenzo679/MODS203-Project

My solutions for "MODS203-Data analysis in economics" project, a.y....

16
Experimental
5525 toludaree/classified-ads-scraper

Scrape ads from ClassifiedAds.com

16
Experimental
5526 dale-lakes/goctftime

Go backend which scrapes CTF Time and stores contents in Firestore database

16
Experimental
5527 gal07/scrapping-referensi-data-kemdikbud-go-id

This code scrapp data from https://referensi.data.kemdikbud.go.id to get...

16
Experimental
5528 scraping-in-go/sig-worker

Workers pull work from queues and carry out of the work

16
Experimental
5529 Sinha-Ujjawal/Brokerslink-Partners-RShiny

Shiny APP for scraping Brokerslink Partners

16
Experimental
5530 PrynsTag/rewards-for-justice-scrapy

This is a Scrapy spider that crawls the Rewards for Justice website:...

16
Experimental
5531 v1k1nghawk/evenacci

Fun Ways to Obtain Even Fibonacci Numbers

16
Experimental
5532 threeninesfine/looking-glass

Live poker cardroom analytics in SEA, WA

16
Experimental
5533 YogiOnBioinformatics/Principles-of-Data-Science

Work done for University of Pittsburgh course "Principles of Data Science"...

16
Experimental
5534 rmrt1n/chess_analysis_project

Webscraping and analysing games of Hikaru Nakamura

16
Experimental
5535 saeed0x1/jsping

jsping scrapes urls containing javascript files 📂 from provided domain names...

16
Experimental
5536 MSandeep96/LibgenMobi

Mobile app for Libgen

16
Experimental
5537 Mague/WebScrapingRadios

Araña para obtener stream de radios así como la información de estas

16
Experimental
5538 akisonlyforu/Website-Rot-Link-Tester

A Rot Link Tester for Websites which scans all the Links in a website and...

16
Experimental
5539 Glitchero/fb-data-downloader

Java software to download conversations from facebook pages.

16
Experimental
5540 sguzman/Scalaggravator

A UCSB GOLD miner applying lessons learned in UCSB GOLD Miner here

16
Experimental
5541 vislupus/wikidata-scraper

Web scraper from wikipedia.org category to table with data from wikidata.

16
Experimental
5542 simonusher/pkp_network_science

A railway connections (Polskie Koleje Państwowe) network scraper with simple...

16
Experimental
5543 yangkev/MaizePageContacts

Script for pulling contact info off of MaizePages

16
Experimental
5544 lubnaonline228/Hotels-and-properties-in-bangladesh

Summarizes data about hotels and properties of Bangladesh from Booking.com

16
Experimental
5545 sam-k/alum-candidates

Finding all political candidates who are alums of a particular school

16
Experimental
5546 Rohankaf/Rottweiler

ROTTWEILER automates dark web search and AI-driven intelligence analysis over Tor.

16
Experimental
5547 nerevu/hdxscraper-hdro

Collector for the UN Human Development Report Office (HDRO) API

16
Experimental
5548 arthurbz/f1_data_scraping

Scraping F1 data from the official site using Python and BeautifulSoup

16
Experimental
5549 gh4rib/Scraping_coinmarketcap.com

Scraping the all of the currencies of the Coinmarketcap.com

16
Experimental
5550 ramenaru/scrypte

🛠️ scrypte is a lightweight CLI's for detecting web vulnerabilities.

16
Experimental
5551 ChampionBuffalo1/OverflowScraper

Web Scraper for extracting MathJax expressions from...

16
Experimental
5552 mikoim/steam-jp-finder

[discontinued] Japanese supported game finder for Steam.

16
Experimental
5553 pedjamitrovic/real-estate-data-mining

Real estate price prediction project.

16
Experimental
5554 dujs3933/projects

jackie's data stuff with python & r

16
Experimental
5555 OHMORIYUSUKE/animeapp-db

Anime Libraryのデータ保存レポジトリ

16
Experimental
5556 atomicul/edus-report

CLI tool to exctract data from the edus.ro platform.

16
Experimental
5557 1B05H1N/ai-fuzzer

AI-powered web application fuzzer that crawls sites and generates advanced...

16
Experimental
5558 neuroarcane/GBCML1

Python web scraping assignment using Requests and BeautifulSoup, with...

16
Experimental
5559 diegoripley/docker-jupyter-geospatial-datascience

Jupyter notebook for geospatial data, geocoding, and scraping

16
Experimental
5560 Denny-Lin/ai-crawlflow

An AI-ready modular C/C++ web crawler framework with a pluggable pipeline...

16
Experimental
5561 Peppe289/City_News_Bot

Bot Telegram for pooling information from ajax request to my City WebSite

16
Experimental
5562 theonmd/facebook-ads-scraping

Facebook ads scraping bot, for further analysis of ads text or pictures.

16
Experimental
5563 nazif96/Car-price

Car price prediction

16
Experimental
5564 dashnak90/Lyrics-Classification

Text classification model on song lyrics

16
Experimental
5565 antoninfaure/epfl-miam

Automated menu scraping, analysis, and network visualization for EPFL campus menus

16
Experimental
5566 b00731976/MAL_Chapter_Rating_Scraper

This program is a combination of 3 scrapers that go through MyAnimeList...

16
Experimental
5567 c05m4r/scraping_precio_miel

Python | Pandas | BeautifulSoup | Schedule

16
Experimental
5568 r0b0tt/covid19-scraper

Covid-19 disease data scraper.

16
Experimental
5569 AkanshDivker/GitScrape

Flexible and efficient Python program to query for GitHub repositories,...

16
Experimental
5570 Chhavimohitkar65/Document-Retrieval_QueryMorphAi

This project implements a Document Retrieval System that integrates...

16
Experimental
5571 Enigmage/pluck

A simple python command-line tool to fetch and display meaning, synonyms and...

16
Experimental
5572 DahlitzFlorian/R-web-scraper

A small web scraper to get the latest articles of a given topic from Techcrunch.com

16
Experimental
5573 kotstot6/FactCheckClassifier

Building a fact-checked article classifier with a Naive Bayes-esque method

16
Experimental
5574 TechnicPotato/SYNCHack2020

SYNCS Hackathon 2020 Product.

16
Experimental
5575 QualityDU/duscr

the Dziennik Ustaw SCRaper

16
Experimental
5576 cforgaci/mint2324Q3U

Workshop on web scraping and topic modeling using R

16
Experimental
5577 HayatiYrtgl/scrapy_amazon_project

Scrapy bot to crawl amazon website

16
Experimental
5578 andylvua/OOP_Middle

Web scraper API. OOP Midterm Task

16
Experimental
5579 bright-jp/Bluesky-Posts-dataset-samples

Bright Data API を使ったソーシャルメディア分析向けの Bluesky 投稿サンプル。

16
Experimental
5580 eeriemyxi/povi

A dictionary for your terminal. Rewrite of Novi in Nim.

16
Experimental
5581 kallewesterling/twittersheep

Remember TwitterSheep.com and how it used to work? This is a simple Python...

16
Experimental
5582 mrguseinov-python/web-scrapers

Scraping and parsing store names from the Galeria website.

16
Experimental
5583 GNUWeeb/worldometers_scraper

Scraper Worldometer written in PHP.

16
Experimental
5584 mariamabdelati/lego_big_data

Simple R program to scrape Lego data from brickset.com

16
Experimental
5585 0nyr/journals2data

A python library for automatic text scraping of online newspaper websites....

16
Experimental
5586 Semigroup/MagicCrawler

C# tool for scraping and browsing artofmtg.com in an efficient and user-friendly way.

16
Experimental
5587 bilalhameed248/News-Website-NWSFD

CodeIgniter Based News Website - Sep 2020 - Aug 2021

16
Experimental
5588 Adamkillander96/radio-label-scraper

Scrape the swedish radio channel P4 for some reason 📻🎶

16
Experimental
5589 xcrap-dev/xcrap-python

A modern, declarative, and modular web scraping framework for Python.

16
Experimental
5590 rauanisanfelice/ws-freemusicarchive

:musical_note: :headphones: Web Scraping Free Music Archive

16
Experimental
5591 redneb/islink

haskell library that can check if an HTML element is a link

16
Experimental
5592 mileswwatkins/wmata_rush_hour_promise

Scrape daily data regarding WMATA's Rush Hour Promise program

16
Experimental
5593 5x/TweetsDataAnalytics

Twitter data analysis in R language.

16
Experimental
5594 AndreLuque/Stock-Analysis

Searches and Analyzes Stocks and determines the potential with established...

16
Experimental
5595 JoaoHenrique12/naruto_fandom_scraping

Scraping info from naruto fandom (pt-BR) and store it into a postgresql.

16
Experimental
5596 gpaddis/browze

A scraping-oriented browser-like wrapper around HTTParty written in Ruby.

16
Experimental
5597 syamdev/Scrapy-Projects

Source code for my Scrapy projects

16
Experimental
5598 reubenjohn/CarResearch

Automates some of the car researching process in the US market

16
Experimental
5599 phpscrapers/interfaces

A set of interfaces to define functionality for common scrapers.

16
Experimental
5600 haku-data/AnissB.github.io

Portfolio projects

16
Experimental
5601 Ancient-Scapes/scraping-sample

スクレイピングコードサンプル Elixir(HTTPoison+Floki) Node(axios/puppteer)

16
Experimental
5602 rijun/fhdo-display-news

Forward FH Dortmund display news

16
Experimental
5603 HayatiYrtgl/wiki_art_crap

Asynchronous web scraper for downloading painting images.

16
Experimental
5604 andrebalen/mineNugget

python script to mine relevant data from potential clients

16
Experimental
5605 toludaree/project-upwork

Build my web scraping portfolio with Upwork jobs

16
Experimental
5606 randomecho/git-minimal

Display a minimal maxim by The Minimalists after each git commit.

16
Experimental
5607 bitkeks/hn-vis

Visualization of the Hacker News frontpage with Python and R.

16
Experimental
5608 eray-yuztyurk/ibm-spacex-project

End-to-end SpaceX launch analysis project: collect and clean launch data via...

16
Experimental
5609 HEZARTECH/data-mining

A data mining / scraping repository for our TDDI Model. (hezartech.ai)

16
Experimental
5610 suyashphatak23/Imdb-Rating-Scraper

Web Scraping of Imdb website for top rated movies, TV shows & Oscar winning...

16
Experimental
5611 baltazarparra/scraping

Estudando extração de dados com NodeJs.

16
Experimental
5612 stivenramireza/nutibara-web-scraping

Web Scraping of the most popular real estate agencies in the Medellín,...

16
Experimental
5613 schrapert/framework

Non-blocking PHP crawler/spider

16
Experimental
5614 weirdyang/tripadvisor-singapore-zoo

python script to scrape reviews from tripadvisor. perform sentiment analysis...

16
Experimental
5615 mihikabairathi/PyPI-Package-Prediction

Time-series regression model built on release dates of all PyPI Packages

16
Experimental
5616 plqualls/web-scraping-challenge

The objective is to create a web application that scrapes various websites...

16
Experimental
5617 DimK19/smogon-scraper

Python 3 script to collect and display data published by Pokemon Showdown,...

16
Experimental
5618 JoshuaOndieki/careerbuilderjobs

Automated web scraping for CareerBuilder jobs.

16
Experimental
5619 itfidele/Afrikalyrics-API

An unofficial API for AfriLyrics written in Python 3

16
Experimental
5620 itssudhanshu/SRM_Evarsity_Result

This Repository is an unofficial API for SRM Evarsity Result which is Online...

16
Experimental
5621 LimJY03/WebScraping

This repository contains a collection of web scraping projects along with...

16
Experimental
5622 renan-almeidaa/Coletando-307-sequencias-de-DNA-com-Web-Scraping

Prática de Web Scrapping com tags HTML

16
Experimental
5623 book000/ConoHaInfoCrawler

Crawl the ConoHa Control Panel Information and notify to Discord of new information.

16
Experimental
5624 benbesthof/BestAndRest

Discovering methods of obtaining data on the open internet.

16
Experimental
5625 MarionJelimo/web-scraping-bird-images-using-beautifulsoup

This project is a step-by-step guide on how to scrape information, including...

16
Experimental
5626 krowpu/scrapod-node

Capybara Webkit scraping server

16
Experimental
5627 krowpu/scrapod-server

Long-living Capybara Webkit process for web scraping

16
Experimental
5628 Dramarr/Dramarr.Scrapers

✂️ Scrapers library that fetch doramas' information from different sources

16
Experimental
5629 OpenCOVID19-Senegal/scraping-cartosantesen

Extraction données situation du Covid-19 au Sénégal_Desktop

16
Experimental
5630 lexndru/hap-utils

A set of utilities for Hap! to automate scraping processes

16
Experimental
5631 danydacosta/TransArcServer

[Abandonné] Services webs de l'application mobile TransArc

16
Experimental
5632 tanjalustrek/Property-Cost-in-Cape-Town

In this repository, I've utilized data from Property24 to build multiple...

16
Experimental
5633 thaychansy/html-web-scraping

Full web-scraping and data analysis project extracting information via...

16
Experimental
5634 xavierigor/synonym-api

An API for searching word synonyms. Only available in pt-BR.

16
Experimental
5635 chomiczdawid/stock-fundamental-analysis

Fundamental analysis of a stock in Python

16
Experimental
5636 rafa8626/scrapers

A collection of PHP scrapers that gather decision data from free legal courts in US

16
Experimental
5637 5hyn3/SmartPhonePriceChecker

This is a Android App that made by flutter.

16
Experimental
5638 samisayed0611/FIFA-World-Cup-Group-Stage-Prediction

Developed a prediction model for the 2018 FIFA World Cup Russia™ group stage...

16
Experimental
5639 vdj-vasudevan/Web-scraping

Web Scraping - Extracting Data From a Gaming Site using Beautifulsoap...

16
Experimental
5640 miputra/Notification

Web change notification for windows (Scraping)

16
Experimental
5641 sandrewTx08/Gearbest_Scraper

Seeks catalog ads from Gearbest web page, scraping catalogs information then...

16
Experimental
5642 DataKind-BLR/QuestAlliance

DKBLR with collaboration with Quest Alliance. Blue collar job related stuff.

16
Experimental
5643 Durhamster/Reddit2Excel

A simple tool to scrape a list of keywords from Reddit into a neatly...

16
Experimental
5644 andrejkurusiov/python-jetbrains-academy

Python concepts, packages and techniques. All coding done myself; tasks and...

16
Experimental
5645 dsrao711/ScrapingJobsPortal

Web scraping Jobs portal Indeed using Scrapy

16
Experimental
5646 Aayush2492/Cal-Hob-bot

A discord bot that serves you Calvin and Hobbes comic strip from...

16
Experimental
5647 darideveloper/SNIIM-Extractor

Bot for extract data from page www.economia-sniim.gob.mx, with CLI and GUI

16
Experimental
5648 m-star18/SUUMO-AI

Using machine learning to find properties

16
Experimental
5649 iyxan23/ums-scraper-5000

🦊📚📥 a firefox extension that scrapes UMS materials with ease

16
Experimental
5650 rodrigotesone1997/Notis_Personalizadas

Bot para mandarme mensajes cada vez que Joni Viale publique su editorial.

16
Experimental
5651 arielbello/containers

Just an easy reference for my docker containers

16
Experimental
5652 njpeterson438/capstone_project

Capstone Project for Certificate in Data Engineering

16
Experimental
5653 DarkCode-Archive/Web-Scrapers

Web Scraping Scripts in PhP and Bash

16
Experimental
5654 Ekhel/sipd-scraper-tools

Tools Scraping Data dari SIPD Kemendagri

16
Experimental
5655 DEVOLOPER-1/Search-Results-linkage-Analyzer

A project for analyzing and visualizing connections between your query...

16
Experimental
5656 olgarozhdestvina/Mastering-Coding

Small projects using Python (and sometimes JS)

16
Experimental
5657 TheodoreLefrancois/clash_royale_tracker

This personal project use ViteJs Vue3 Typescript

16
Experimental
5658 JohnnyFoulds/scrape-indeed

Scrape Job Postings from https://www.indeed.co.za using UiPath RPA.

16
Experimental
5659 baduker/sketchyfetchy

The Comically Poor Scraper for Poorly Drawn Lines

16
Experimental
5660 cauamp/YahooFinanceScrapAPI

O objetivo deste projeto é realizar web scraping do Yahoo Finance para...

16
Experimental
5661 ratul16/Scam-flooder

This Python script generates random usernames and passwords and sends them...

16
Experimental
5662 ronan-deshays/power-automate-desktop-utility-flows

A set of "ready to import" Power Automate Desktop flow templates, useful for...

16
Experimental
5663 kalessin/sequential-parser

Utility for parsing structured text with text patterns

16
Experimental
5664 toihirhalim/detect-covid-fake-news-server

Django graphQL server for sentiment analysis and Covid fake news detection

16
Experimental
5665 jjoej15/letterboxd-recs

Web app that uses web scraping to give film recommendations using an SVD...

16
Experimental
5666 arachnio/arachnio4j

Arachnio client library for Java 11+

16
Experimental
5667 dents0/BooksData

Scraping an online bookstore and creating an SQLite database with its data.

16
Experimental
5668 cpatrickalves/scraping-gsamart

Scraping GSAMART products from testmart.com using Scrapy Web Crawling Framework

16
Experimental
5669 nhiramoto/LocStat

A Web Scraper that reports the statistics of source code lines from Git repositories.

16
Experimental
5670 Ahabdel/Amazon-Web-Scraper

Amazon Web Scraper to scrape pricing adjustments and provide updates on a...

16
Experimental
5671 yusin99/Python-Trading-Scraper-for-Binance

In this repository, you can find a python web scraper. The scraper will send...

16
Experimental
5672 dents0/QuotesGame

A game based on quotes parsed with Requests and Beautiful Soup modules.

16
Experimental
5673 SarthakRana/Web-Scraping-in-Python3

This repo contains tutorials for scraping web pages - from simple html files...

16
Experimental
5674 afaneca/AFA-Score-Android

Android frontend for AFA Score Scraper API

16
Experimental
5675 rakin406/trendy

Check if github repo is trending

16
Experimental
5676 Hasanul-Bari/python

Examples of python codes.

16
Experimental
5677 mohammadzainabbas/VA-Lab

👨🏻‍💻 Lab Work for Visual Analysis (VA) ✨

16
Experimental
5678 Vladislav-Tsekov/WebScraperV1

I'm working on developing a web scraper using C# and the HtmlAgilityPack...

16
Experimental
5679 JuanDArdilaG/matches-pal-reminder

Matches Pal Reminder (MPR) is a simple server that executes a script to...

16
Experimental
5680 cuihaosabrina/Emergence_Popularity_Sina_Weibo

This repository consists of codes to crawl Sina Weibo and data used in the...

16
Experimental
5681 siongui/goiguserid

Get id of Instagram user in Go

16
Experimental
5682 franklinmoy3/the-gas-app-db

Public dataset of gas prices utilizing git tags to keep history

16
Experimental
5683 andylvua/OOP_Lab13

Visitor & Proxy Lab

16
Experimental
5684 MarcossIC/web-scraper-example

This repository has an example of a code that works like Web Scrapper, in...

16
Experimental
5685 repylot/GithubScrapper

GitHub Scrapper for RePylot is a web scraper for GitHub that generates...

16
Experimental
5686 dents0/IMDb-Top-Rated-Series

Scraping IMDb top rated TV shows and saving data into an Excel-file

16
Experimental
5687 zgalaz/job-finding-helpers

Package providing an easy way of parsing job offers (with user-specific...

16
Experimental
5688 cabustillo13/Revivir-Imagenes

Dar color a imágenes en blanco y negro de épocas de antaño con ayuda de Deep...

16
Experimental
5689 RafaelKarcz/ArticleScraper

A Python web scraping tool that retrieves articles from a specified webpage,...

16
Experimental
5690 yamanori99/lancers-page-scraping

ランサーズにログインして特定の作業一覧ページを読み取り、そのページのテーブルから作業者 (ランサー)...

16
Experimental
5691 fuyarde/isbn-scrapper

📚 Tool for scrapping book data using ISBN on Google Books

16
Experimental
5692 marcos-vcs/mundo-hoje-web-scraping

This project does the web scraping of the IBGE (Brazilian Institute of...

16
Experimental
5693 AmanAsanovich/DataScraping

Some data scraping code in Java

16
Experimental
5694 ridiculouswaffle/mail-harvester

A Clojure program that can scrape emails and links from any web page!

16
Experimental
5695 letha11/sia-app

Unofficial SIA Mercubuana App

16
Experimental
5696 yingtu35/dead-link-hunter

A Web Scraper written in Go that helps you find all dead links in your website

16
Experimental
5697 lit26/Financial_Web_Scraping

Web scraping financial information

16
Experimental
5698 RobertJGabriel/golang-link-scraper

I like Golang but dont get to write much in work so made a simple web...

16
Experimental
5699 baronsmv/musiclists

Download, filter and transform data from music review aggregator websites.

16
Experimental
5700 T-13/StudentFoodScraper

Restaurant data scraper for students in Slovenia

16
Experimental
5701 ar8372/linkifile

Empowering Effortless Data Linking

16
Experimental
5702 msancor/Bayesian-Football

Repository for Final Project of the Statistical Methods for Data Science...

16
Experimental
5703 animikhaich/VTU-Result-Downloader

A GUI App to Download Results from VTU's Website

16
Experimental
5704 aosousa/go-hltb-lookup

CMD Tool to look up game play time data through scraping the How Long to...

16
Experimental
5705 markhuge/hrefs

A golang library for extracting URIs from HTML elements

16
Experimental
5706 ProfASEM/world-data-analysis

This is the Analysis of world's population, languages, economy..etc

16
Experimental
5707 meatyite/python-steimatzky

A Python library used to Scrape data from steimatzky.co.il

16
Experimental
5708 megamillions/Command-Line-Emailer

Takes an email address as destination and string, then emails string to...

16
Experimental
5709 ujjwalgulecha/Fun-with-Python

Web Scraping and Posting on Fb using Python

16
Experimental
5710 bocadilloproject/raspador

⛏ A concurrent web scraping service made with Bocadillo

16
Experimental
5711 senaps/scrapy-ipinfo

scrapy ipinfo test concept

16
Experimental
5712 KumarUniverse/stat-analysis-on-eclipse-refactoring-bugs

A statistical analysis performed on eclipse refactoring bugs.

16
Experimental
5713 Manu-sh/http_normalizer_parts

http url normalization utilities for web crawlers

16
Experimental
5714 Rajat4445/Steam-Project

Steam is the ultimate destination for playing, discussing, and creating...

16
Experimental
5715 nebil/scrape-exchange

:frog: To scrape from Stack Exchange

16
Experimental
5716 nestrada2/dunkhead

Nike Dunk SB Sneaker Aggregation Web Application

16
Experimental
5717 ONowakowski/polish-cars-stats

Polish cars stats is a project of web dashboard showing statistics about car...

16
Experimental
5718 wazana-dev/youtube-scrapper

Buscando informações de canais no YouTube com Python.

16
Experimental
5719 jakobzmrzlikar/trg-dela

Data analysis of student job offers.

16
Experimental
5720 Amna-A/GA-Scheduler

:hourglass: Class Schedueler

16
Experimental
5721 timbatt/hockey-player-stats

Program that scrapes stats on hockey players from hockeyreferance.com

16
Experimental
5722 5amyak/College-Scraper

Simple web scraping application.

16
Experimental
5723 dmichalis/bgg_scraper

A python web crawler that retrieves board games from BoardGameGeek and their...

16
Experimental
5724 LibrariesHacked/news-librarydata

Displaying library news stories and changes from Public Libraries News

16
Experimental
5725 converseai-extensions/WebScraper

This is a sample plugin that can scrape a given URL or a given HTML string.

16
Experimental
5726 crowtherln/name_translations

Scrapes Wikipedia to find translations of people's given names

16
Experimental
5727 krystlepalace/genius-lyrics-bot

Telegram bot in inline mode that can search and send songs lyrics from genius.com

16
Experimental
5728 L0L1P0P1/qbc8-basketball-reference

Data Scraping and Analysis project for Quera Data Analysis Bootcamp (qbc8) by Group4

16
Experimental
5729 viktor-akusoff/GalleryThief

Simple python package for scraping images from different search engines by prompt.

16
Experimental
5730 camara94/crawlSpider

Scrapy nous donne accès à deux classes principales de spiders, le spiders...

16
Experimental
5731 lucasthaynan/servidores-camara-maceio

Repositório do programa de web scraping do site da Câmara Municipal de...

16
Experimental
5732 aaditkapoor/What-To-Dine

"Freshman 15" is an expression commonly used in the United States that...

16
Experimental
5733 an-anurag/wallpaper-downloader

A wallpaper downloader for santabanta.com

16
Experimental
5734 Janca/fking-spaghetti

A bulk thumbnail downloader to scrape thumbnail images from Getty Images

16
Experimental
5735 FreddyPinto/cuspide-bookstore-scraping

Web scraping a la página de Cúspide Libros para obtener el listado de los...

16
Experimental
5736 bayhaqy/News-Dashboard

Dashboard for Scrapping from Google News Library and Create Sentiment Analysis

16
Experimental
5737 jaisharx/py-scripts

py-Scripts is a collections of many different medium to small python scripts...

16
Experimental
5738 AnisTaluqdar/Vehicle-Recognizer

A robust vehicle recognition system capable of classifying 28 different...

16
Experimental
5739 west-wind/FIRST.org-Scraper

FIRST.org Incident Response teams' contact information scraper

16
Experimental
5740 Saikumar-bali/news_website

Telugu News App aggregates news from 20+ Indian sources, automatically...

16
Experimental
5741 Muyoouu/google-scraper

Web scraping script for Google's search results page, built using Python and Scrapy.

16
Experimental
5742 8g6-new/BibFromText

Given a list of reference papers serrated by new lines , the program will...

16
Experimental
5743 brunomontezano/continentesBR

🌍 Scrape data from countries and capitals through Wikipedia, BrasilEscola...

16
Experimental
5744 diogenisAl/pyWebScraping

Web Scraping with Python

16
Experimental
5745 akarindt/linkedin-auto-connect

Auto connect & follow people on Linkedin

16
Experimental
5746 BrunoFay/Shoes-shop-Nextjs

Shoes ecommerce made with NextJs, MongoDB, Tailwind + web Scrapping (Python)

16
Experimental
5747 RuchirChawdhry/canada-dli

Scraping Canada's Designated Learning Institution list

16
Experimental
5748 rmmbear/tweet-archiver

abandoned and broken

16
Experimental
5749 brunomontezano/CFPr

Scrapes Data from Brazilian Federal Council of Psychology. Small R package...

16
Experimental
5750 eeriemyxi/jobox

Pick a random video off YouTube from your favorite creators.

16
Experimental
5751 VitorFirmino/ot_notifier

Multi-server Open Tibia monitor with Discord webhook alerts for guild...

16
Experimental
5752 CsatiZoltan/VeloToulouse

Extract data from your VeloToulouse account

16
Experimental
5753 powerexploit/Corona-Assistant

Command line Speech recognition Tool as Covid data analyzer

16
Experimental
5754 renzdxtr/Coursera-Course-Data-Scraper-for-Google-Sheets

This script provides an efficient solution for collecting Coursera course...

16
Experimental
5755 MarkMP1/AutoMonkeyType

A typing bot for the popular typing website, https://monkeytype.com/

16
Experimental
5756 rfaleiro/R-OcorrenciasPoliciais-em-SaoPaulo

Análise de dados de segurança pública de São Paulo (2016-2025). Utiliza web...

16
Experimental
5757 Kingson4Wu/data_killer

👀👀Some data crawling and analysis since personal interest.

16
Experimental
5758 meysamraz/graph-analysis-and-relationship-extraction-from-Dark-tv-series

In this project, I scraped characters biographies of Dark series produced...

16
Experimental
5759 M3hd1M/glowing-spoon

Bankin Challenge Engineering : Web Scrapping...

16
Experimental
5760 mtwn105/memer-telegram-bot

Memer Telegram Bot - Search & Create memes!

16
Experimental
5761 amamic1803/Media-Scraper

A simple tool for downloading media files from websites

16
Experimental
5762 MaximosMK/Scraping-the-Movie-Rating-s

using python to scrape the IMDB Movies ratings

16
Experimental
5763 caradecuy22/GSoC-2026-explorer

Explore and access project ideas from all Google Summer of Code 2026...

16
Experimental
5764 Kadajett/Nodan-Scraper

Nodan Scraper - The scraper for the modern web.

16
Experimental
5765 Mega-Barrel/Hacklytics-Hackathon

The shift in the focus of student athlete recruitment from a...

16
Experimental
5766 MatyilaSango/gw-weather-api-v2

A global weather API that can get the data of any location all over the world.

16
Experimental
5767 lucioamor/shill-o-tron-3000

Chrome extension to detect and flag potential shilling on Reddit by...

16
Experimental
5768 KevsterAmp/texts-website-scraper

A scrapy project designed to extract useful information inside websites

16
Experimental
5769 russellsteadman/netscrape

A Node.js framework for creating good bots

16
Experimental
5770 KwameKai4/aisearchezmoney

Come home. Stop letting everyone waste your time. Just this All-In-One AI...

16
Experimental
5771 cassianoczz/Python_Projects

Repositorio contem projetos construidos em Python

16
Experimental
5772 evris99/amazon-etsy-review-scraper

A simple GUI program to download product reviews from Amazon or Etsy and...

16
Experimental
5773 Sharkofwitch/DailyBrief

A web scraper for collecting and storing important news headlines.

16
Experimental
5774 mpanelo/nflfantaspy

Scraper for NFL Fantasy Football Public Leagues

16
Experimental
5775 aditeyaS/trendinggg

What's trending today?

16
Experimental
5776 selmanbey/guess_game

browser-based, hangman-style word guessing game

16
Experimental
5777 sejaldua/sports-analytics

Project work from COMP152: Sports Analytics | Tufts University Spring 2021

16
Experimental
5778 faisal-fida/ChatBabu-ReverseEngineered

This project aims to reverse-engineer the ChatBabu website by scraping its...

16
Experimental
5779 gitananun/py-wiki-image-scraping

Wikipedia Article Images scraping

16
Experimental
5780 rafaumeu/linkedin-fetcher

A modern LinkedIn profile scraping service built with TypeScript and Fastify

16
Experimental
5781 yashkathe/Anime-quotes-web-scraper

Scraping anime quotes for an API to be built

16
Experimental
5782 MillanUka/NZX-Graphs

A python script, that scrapes data from the New Zealand Exchange to gather...

16
Experimental
5783 mahmoudai1/web-scraping

A program that scraps products from a website and export the data into CSV...

16
Experimental
5784 KUB4W16/pyfetch

Information tool like screenfetch for Python3

16
Experimental
5785 smellycloud/chart_to_playlist_api

This Python API retrieves Billboard chart songs from any specified date and...

16
Experimental
5786 leomsfreitas/PushNotifyWebhookDiscord

Personal project developed for integration with the Discord webhook for...

16
Experimental
5787 NidalChateur/OC_P2_SCRAPING

ETL (Extract, Transform, Load), scraping

16
Experimental
5788 rfdzan/hosutory

get songs from osu profiles, and query through them in GUI

16
Experimental
5789 cnoret/book_recommender

Streamlit-based application that provides personalized book recommendations...

16
Experimental
5790 Toriomg/uc3m-nia-aula-global-scrapper

Get a .csv file with a list with NIAs, names and emails of a class. As a...

16
Experimental
5791 jyeungtin/NextDoorScraping

A simple and plug-and-play NextDoor scraper

16
Experimental
5792 Cyanex1702/Image_Scrapping_Toolkit

ImageSensei: A versatile image scraping toolkit that removes duplicates,...

16
Experimental
5793 hydrargyrum/billarchive

Download your bills automatically - mirror of...

16
Experimental
5794 wrzadkow/CafeteriaBot

A Telegram bot to rate dishes in my institute cafeteria. Also features...

16
Experimental
5795 Celeo/Tildes_scraping

A project that scrapes off of Tildes

16
Experimental
5796 anotender/generic-scraper

Generic scraper is a library that gives a possibility to scrap the HTML...

16
Experimental
5797 farfarfun/funproxy

代理池管理工具 - 提供代理服务器的管理和使用功能

16
Experimental
5798 RoyalMamba/ApplePieCrawler

This repository contains a Python script (objects.py) for web image crawling...

16
Experimental
5799 eric-ycw/whotalksthemost

A script that finds out how much characters talk in movies

16
Experimental
5800 glpaparelli/candyland

A framework for mangas/comics download through web scraping

16
Experimental
5801 ArisPan/web-scraping

A place for all my web scraping projects and scripts.

16
Experimental
5802 ardwiinoo/bs4-scraping

Repo ini digunakan untuk belajar BeautifulSoup

16
Experimental
5803 Paulinakhew/terminal_trader

💻 Terminal Trader is a web trading game that runs in your terminal where you...

16
Experimental
5804 Mo-Shakib/Web-scraping-with-Python

Web scraping projects using Python

16
Experimental
5805 sebbekarlsson/DOMEventListener

🔄 Subscribe on DOM elements in Python

16
Experimental
5806 doubleSlashde/scrapy-exercise

Static website scraping excercise with Scrapy

16
Experimental
5807 geoffhouy/zoinks

A multi-function Discord bot for my personal server

16
Experimental
5808 soficis/image-scraper-multitool

A powerful, multi-engine image scraping tool (CLI & GUI) for Bing, Google...

16
Experimental
5809 romaroman/visulast

Telegram bot for visualization of user's last.fm library

16
Experimental
5810 Hedrax/NetworkGraphI

A Twitter Scrapping tool and Network Analysis project to analyze a...

16
Experimental
5811 jwasserstein/taxes

Create a list of vehicles and real estate owned by registered voters in...

16
Experimental
5812 someaditya/tedtalks-hien-corpus

A Hindi English Parallel Corpus generator from TED Talks using Beautiful Soup

16
Experimental
5813 Shefali-Upadhyaya/buy-advisor

The ICDE-BuyAdvisor website is a user-friendly solution to help the buyers...

16
Experimental
5814 OliverWisn/crawler_logging

The simple web crawler with the logging.

16
Experimental
5815 kubikvid/weather-this-day

Get and see weather this day in your city

16
Experimental
5816 filipszaulity/specificproxy

🌐 Specify egress IPs for HTTP proxy requests on machines with multiple IPv6...

16
Experimental
5817 jonathas/pixmania-parser

:computer: Parsing a product from Pixmania's website

16
Experimental
5818 GrabzIt/GrabzIt.IntraProxy

The IntraProxy is a proxy that allows intranet and localhost websites to be...

16
Experimental
5819 janakhpon/PersonalAssistant

Pyassistant is a python project uses (Text To Speech) and web scraping...

16
Experimental
5820 daniyalb/Student-Housing-Finder

A python web scrapring program which helps assist students in finding...

16
Experimental
5821 sappyduckie/discord5050

Recursive search algorithm that generates and validates Discord media links...

16
Experimental
5822 megamillions/2048-Game

Bot that plays the 2048 game, sliding tiles together to reach the high...

16
Experimental
5823 ductnn/animscra

Fucking scrape data social network

16
Experimental
5824 99z/elizabeth

Persona{3, 4} shadow / request information extractor

16
Experimental
5825 cizodevahm/YouTube-Video-Scraping

This project demonstrates how to scrape YouTube video information and...

16
Experimental
5826 MrFlynn/snowball

Java-based web scraper created for our information retrieval class.

16
Experimental
5827 tonymushah/favicon-picker

A library for getting favicon from websites

16
Experimental
5828 frostyfeet909/Wodify-Training

Scrape and Predict attendance for wodify classes

16
Experimental
5829 ahmadmujtaba770/web-Scrapper

🌐 Create a Java-based web scraper to extract data from websites, learn web...

16
Experimental
5830 JAlbarrn/TCV_P1_WebScraping

Práctica 1. Tipología y Ciclo de Vida de los Datos. Caso práctico de Web...

16
Experimental
5831 Srokit/table-collector

Collect numeric html tables from internet into a csv dataset

16
Experimental
5832 Marcel0024/FundaScraper

Docker image for monitoring housing listings from Funda and getting notified...

16
Experimental
5833 vandavey/rfc-search

Python application for web scraping RFC specifications

16
Experimental
5834 joemull/web_scraping_demo

A demo of using web scraping to enrich metadata in the context of library publishing

16
Experimental
5835 hereisSwapnil/Library-Genesis-Telegram-Bot

A Python based Telegram bot that searches Library Genesis and returns clean,...

16
Experimental
5836 jefersonjlima/botscraper

BotScraper is a web crawling, used to crawl Brazilian contests websites

16
Experimental
5837 TanmayArya-1p/UrbanDictApi

Unofficial API for the popular website- 'Urban Dictionary'.

16
Experimental
5838 ivanlonel/scrapy_playground

Simple Scrapy project for experimenting with multiple crawlers sharing a...

16
Experimental
5839 srgautam01/Weather

Web scraping using Python/BeautifulSoup4 to find the current temperature of...

16
Experimental
5840 aasthaj28/ai-for-social-good

Using natural language processing to analyze the sentiments of people and...

16
Experimental
5841 marinimau/subito-it_query_to_pdf

Given one or more Subito.it car research url, generate pdf(s) containing the...

16
Experimental
5842 alejandrohdo/download_feeds_facebook

Descarga de feeds de facebook por fan page

16
Experimental
5843 awhite121/ut-wbb-instagram-engagement

End-to-end Instagram engagement analysis for UT Women's Basketball — web...

16
Experimental
5844 JellyJoe198/menu-scraper

Extract relevant data from online food menu. Proof of concept, currently borked.

16
Experimental
5845 jad-nasreddine/ytdown

A python module to download youtube videos by crawling over link content

16
Experimental
5846 anatolykoptev/go-stealth

Generic anti-ban toolkit for Go: TLS fingerprinting, proxy rotation, rate...

16
Experimental
5847 PeanutButterRat/apple-to-spotfiy-playlist-converter

Simple web application that allows a user to convert an Apple Music playlist...

16
Experimental
5848 mercymutuku/Web-Scraping-with-Python

Scrape for data from three Kenyan technology webpages; PigiaMe, MyJobMag and KenyaJob

16
Experimental
5849 putukrisna6/progjar-all

Index repo tugas 2-5 mata kuliah Pemrograman Jaringan

16
Experimental
5850 Jzbonner/webscrape-py

Introduction to Web Scraping via Python, Beatiful Soup and NodeJS

16
Experimental
5851 jhonshua/Exchange-Rates-API-Express

Access accurate exchange rate data with ExchangeRatesAPI.

16
Experimental
5852 VPSLabCloud/VPSLab-Free-Proxy-List

Free proxy list updated every 15 minutes | HTTP, HTTPS, SOCKS4, SOCKS5,...

16
Experimental
5853 thenocturnalguy/sxccampusing-discord-bot

A discord bot implemented using Python, Discord.py, and BeautifulSoup to...

16
Experimental
5854 aahan-charak24/Steam-Scraper

A steam scraper python utility. Currently only supports fetching of latest products

16
Experimental
5855 Niangmohamed/APIs-Web-Scraping-in-Python

This repository contains notebooks on APIs and Web Scrapping in Python.

16
Experimental
5856 lpardey/manga-app

Terminal and desktop app designed to scrape, download, compress and organize...

16
Experimental
5857 HemaliPatel3/RangMitra

🌸 RangMitra – AI-Powered Indian Traditional Art Generator 🎨: RangMitra is...

16
Experimental
5858 hereisSwapnil/Covid-19-Telegram-Bot

An archived Telegram bot built during the COVID-19 pandemic that scraped...

16
Experimental
5859 atanughosh01/PY4E_Coursera

This repository contains all slides, books, and source codes (as solutions...

16
Experimental
5860 samirarman/brazil-death-data

Data on the death certificates issued in Brazil from 2015 and 2020 and the...

16
Experimental
5861 abcjamesjordan/twitter_corporate_profiling

Automated Twitter tweet analysis for any Twitter handle. Aimed at analyzing...

16
Experimental
5862 rancid-stalker/G-SORTER

Chrome extension to filter Facebook Marketplace listings — finds new sellers...

16
Experimental
5863 egao1980/cl-robots

Simple robots.txt reader

16
Experimental
5864 dev-KC20/ocr-p.2

how to scrap with bs4 - educational training project

16
Experimental
5865 frank-chris/ScrapingTwitterPostsOnPolitics

Scraping Twitter posts on Indian politics. An assignment for CS 613 (Natural...

16
Experimental
5866 RafaelKarcz/AmazonWebScraper

A Python-based Amazon web scraper that monitors product prices, stores the...

16
Experimental
5867 Marfullsen/books-scraper

Scraping al sitio books.ToScrape.com y generar CSV con los datos recopilados.

16
Experimental
5868 dim5/climate-article-analysis

A software package to collect and analyze articles about climate change....

16
Experimental
5869 JMARyA/scrape

tool to scrape websites and turn their data into JSON

16
Experimental
5870 saksham-jain177/Data-Analysis

A collection of data analysis and machine learning projects across various...

16
Experimental
5871 douglasgusson/http-info-bot

Chatbot para consulta de informações de códigos HTTP

16
Experimental
5872 msancor/ADM-HW3

Python project for the Algorithmic Methods of Data Science class for the...

16
Experimental
5873 nikukyugamer/amazomania

by this gem, you can get product sales data of amazon.co.jp, for example,...

16
Experimental
5874 Tipologia-y-Ciclo-de-Vida-de-los-Datos/Practica1-Web_Scraping

Web Scraping de la web Expatistan

16
Experimental
5875 omotuno/amazon_web_scraper

amazon web scraper

16
Experimental
5876 rhazra-003/Google_Weather_Scraper

This is a basic Google Weather Scraper, made for practice purpose. This...

16
Experimental
5877 GuilhermeSenna/banco-de-dados-2-scrape-w-Python-CRUD-MYSQL-

Database discipline 2 work involving data mining, data analysis and plotting...

16
Experimental
5878 anishsheth05/XKCD-Bot

Discord bot that randomly references XKCD comic strips.

16
Experimental
5879 Astreak/All_Bout_iMaGe

Unsplash data (image) scraping and image-filtering(Feature Detection)

16
Experimental
5880 maxbolger/CDS-5950-Capstone

A repo for my computational data science capstone project: A WNBA shot...

16
Experimental
5881 Apothemia/IEU-Semester-Grades-Test

Constructing an id/name/gpa table of last 5 semesters' IEU students with...

16
Experimental
5882 khyatigupta369/Moonlit_Cinema

It is a Moonlight themed Movie Recommender System based on Content Filtering...

16
Experimental
5883 tiendq/lego-part-loader

Scrape LEGO part information from Brickset based on a part list and store...

16
Experimental
5884 itzCozi/Open-AI-Wiki-Scraper

A Wiki-page scraper for students and devs. (Includes Open-AI CLI)

16
Experimental
5885 jakubkottnauer/html-extraction

Modular tool for automatic HTML data extraction (Masters thesis)

16
Experimental
5886 bozoh/dataprev

Acompanhamento do processo seletivo da dataprev 2016

16
Experimental
5887 rflechner/ScrapingExamples

Scrapysharp examples

16
Experimental
5888 Denise-Pro/Monitoria_AWS_GLUE_-webAnalytics

Através da API aws coleto e analiso dados para garantir um bom funcionamento...

16
Experimental
5889 krowpu/scrapod-monitor

Scrapod monitoring dashboard Rack application

16
Experimental
5890 shaquille-galimba/mondex

A CLI app using plain old Ruby that lists Monster Hunter bosses and shows...

16
Experimental
5891 Lea-MM/ETL-Project

An automated system that compiles and transforms the list of the top 10...

16
Experimental
5892 Vikr-182/Project-NixViolate

A regulatory violations tracker including crawling and natural language...

16
Experimental
5893 pseudo-r/Public-Zillow-API

Unofficial Zillow API documentation — reverse-engineered endpoints for...

16
Experimental
5894 benztranwot/benz-blog-scraping

A web scraping project using Beautiful Soup.

16
Experimental
5895 ZhengLinLei/betScrape-ES

Spanish lotteries and bets historial of results API

16
Experimental
5896 flxhq/tabula.docker

Tabula is a tool for liberating data tables trapped inside PDF files

16
Experimental
5897 siddharth2016/Scraping-Exercises

This Repository features various web scraping exercises dealing in important...

16
Experimental
5898 jvretamero/map-data

Transform data, the easy way

16
Experimental
5899 hossainlab/WebScraping

Web Scraping using Python for Data Collection

16
Experimental
5900 mmmmlemon/vinyloid-tg-bot

Телеграм-бот для поиска музыки на виниле в Интернете, прототип

16
Experimental
5901 prateekmaj21/WebScraping-Chatbot

Interactive chatbot that parses online recipes and guides users through...

16
Experimental
5902 Wei1234c/Taichung_City_Bus_Timer

Taichung City Bus Timer, using MicroPython, with 7-segments as display interface.

16
Experimental
5903 thisago/scraper

Simple (but not finished) tools to scrap sites

16
Experimental
5904 TabassumTanzim/Restaurant_Recommendation

Suggesting restaurants based on customer's preferences

16
Experimental
5905 leodenglovescode/powerschool_class_notification

Powerschool Class Notification is a little python program to notify you...

16
Experimental
5906 JackNUMBER/tesla-stores-osm-challenge

Scrap Tesla stores from Tesla website to create a Maproulette challenge to...

16
Experimental
5907 allendema/ScoreSoup

Football results in your Terminal. Fast.

16
Experimental
5908 diegoalbert27/search-products

Scrapper web hecho en php para buscar productos en ebay y listarlos en archivo csv

16
Experimental
5909 012e/scrape-thpt

Scrape điểm thi thpt quốc gia

16
Experimental
5910 lookthisisaddy/FrutshApp

An android app to check the status about the freshness of a fruit. Basically...

16
Experimental
5911 zyocum/scrape_fcc_ecfs

Scrape Federal Communications Commssion (FCC) Electronic Comments Filing...

16
Experimental
5912 bright-kr/Properati-Real-Estate-dataset-samples

부동산 시장 분석을 위해 Bright Data API를 통해 부동산 매물을 탐색하세요.

16
Experimental
5913 Karishmagupta05/Airbnb-Data-Scraping-and-Analysis

This project involves web scraping Airbnb listings using Python and...

16
Experimental
5914 ExplorerMunchkin/web-scraping-imdb-top250-python

Web Scraping IMDB Top 250 page in Python using BeautifulSoup.

16
Experimental
5915 mymindwentblvnk/stock-information-scraper

A Python script to extract stock information from different websites.

16
Experimental
5916 jpdiazpardo/irp_calculator

Python web-crawler used to retrieve and process information needed to...

16
Experimental
5917 dakidarts/amazon-scraper-software

Effortlessly extract comprehensive product data from Amazon with our...

16
Experimental
5918 SVDouble/vk-ml-toolbox

A Python tool for scraping and analyzing data from VK, demonstrating data...

16
Experimental
5919 hendrapaiton/gofundme

GoFundMe: #1 Fundraising Platform for Crowdfunding (Web Scraping Portfolio)

16
Experimental
5920 plgs2005/CrawlerLaravel7x

This project is based on a study for Crawler WEB functional base, any...

16
Experimental
5921 MWilliamson1247/Stats-Weekly-Research

Python code for Statistics Weekly that aids in research of topics. The...

16
Experimental
5922 abderrahmaneib/SearchEnginePY

Search Engine into articles scraped from Wikipedia

16
Experimental
5923 PaulRosset/InstAgolia

From Instagram data to Algolia search ⬅️➖➡️

16
Experimental
5924 zeyadissa/Rpublic

Rpublic is a simple package designed to support data extraction and...

16
Experimental
5925 MaxineXiong/Music-Events-Web-Scraper

A web scraping program built to extract attribute data on music events from...

16
Experimental
5926 MaxineXiong/ACME-Vendor-Check-Bot-RPA

This repository contains a robust UiPath automation solution utilising the...

16
Experimental
5927 test2a/impresa-cx-automation

repo to collect ways to automate logging in and extracting data from your...

16
Experimental
5928 MatheusMMonteiro/scrappingGitHub

Buscando informações de um usuário do GitHub

16
Experimental
5929 rrmn/crowdr

Scrape g2crowd reviews with R

16
Experimental
5930 r-parvulescu/gender_judiciary

Scripts for collecting, cleaning, and analysing employment rolls of Romanian...

16
Experimental
5931 Asmaa-Mohamd/facebook-reporting-tool

📊 Streamline Facebook reporting with this tool, enabling efficient creation...

16
Experimental
5932 PJI01-Aricanduva-01/cantareira

Projeto Integrador IV - 7º SEMESTRE

16
Experimental
5933 DCS-training/WebScrapingROctober2023

This intermediate course will teach you how to scrape user-generated content...

16
Experimental
5934 tarek-hassan-FE/Google-Play-Scraper

This is an R script to scrap details about some apps from the google play store

16
Experimental
5935 maxineauma/usage-scraper

Smogon Usage Statistics scraper for my other project, tokeimon.

16
Experimental
5936 MarcinGrabowski/investing-com-scraper

Investing.com calendar scraping

16
Experimental
5937 terawan014/bilibili-fav-duration

Browser extension to calculate total duration of Bilibili favorite lists.

16
Experimental
5938 raphaelts3/js-crawler

Basic JS Crawler Structure

16
Experimental
5939 borgesenioc/ethical-linkedin-profile-extractor

A simple and efficient node web app that extracts public Linkedin profile...

16
Experimental
5940 itslab-kyushu/youtube-comment-crawler

Crawling Youtube comments

16
Experimental
5941 staciax/tipme

A python scraper for tipme.

16
Experimental
5942 wilterson/quotes

API to get quotes scraped from quotes.toscrape.com

16
Experimental
5943 marvint24/web-scraping-rest-api

A simple REST API for scraping data from a static website

16
Experimental
5944 dheerajt10/masala-monitor-api

Masala Monitor

16
Experimental
5945 miteshgupta07/Wikipedia-Scraper

A Python-based Wikipedia scraper that extracts and processes content from...

16
Experimental
5946 arnaudstiegler/NLP_blizzard_forum

NLP experiments on Blizzard forum comments

16
Experimental
5947 joggee-fr/mma-ref-parser

Tool parsing mixed martial arts online articles to build Wikipedia.fr references

16
Experimental
5948 lalBi94/scrapper-fandom

Scraping data from most of the wikis on fandom.com.

16
Experimental
5949 velocitatem/garlic

🧄🧛 protect your website from being scraped by bots.

16
Experimental
5950 laradeus/jornaldausp_saude

Criei esse repositório para inserir o raspador que criei especialmente para...

16
Experimental
5951 CLoaKY233/SurrealDB-ML-toolkit

SurrealDB ML Toolkit: A collection of Rust and Python scripts demonstrating...

16
Experimental
5952 khaledalam/instagrammer

NodeJS NPM package: scrap IG profile media, comments and more.

16
Experimental
5953 amrithaw15/cultural-advice-bias

Analyzing geographic and cultural bias in AI therapy advice. Interactive...

16
Experimental
5954 tombh/laoup-website

Showcasing Laoshu's Language Level Ups

16
Experimental
5955 svetter/scrapia

Scraping and visualizing data about available rooms in JUFA Hotel Bregenz

16
Experimental
5956 TouradBaba/web_scraping

This repository contains a Python tool for scraping, storing, and...

16
Experimental
5957 Kaniz-Fatema-Nabila/Movie-Genre-Classifier

Classify movie genre from its summary.

16
Experimental
5958 vulnerable9/lynkscrapr

Lynkscrapr is a tool for scraping weblinks from websites.

16
Experimental
5959 leyuskckiran1510/pythoncodes

random codes 😪

16
Experimental
5960 krauss/prox_crapper

A command-line app to extract proxy information written in Python

16
Experimental
5961 antoninfaure/graphsociatif

Force Graph of the associative network at EPFL

16
Experimental
5962 Toothless5143/Crawlly

A basic python web crawler to crawl different endpoints from a provided URL.

16
Experimental
5963 rpcide/api-codeforces

Unofficial Codeforces API

16
Experimental
5964 Adiprogrammer7/Disney_movies_dataset_creation

Collecting data from Wikipedia and OMDB, plus some data polishing for the...

16
Experimental
5965 AyFait/Cmc_Scrape_Top10_HeatMap_TreeMap

A better visual representation of the CMC top10 gainers in a 24h interval

16
Experimental
5966 tairasu/image_scraper

A python script for downloading max resolution images from any website.

16
Experimental
5967 priyanshu09102003/codepilot-AI_CLOUD_IDE

CodePilot is an AI-powered IDE with intelligent code suggestions, in-browser...

16
Experimental
5968 gabinete-compartilhado-acredito/capturaAWS

Data capturing system in Amazon's AWS

16
Experimental
5969 Gdahuks/housing_price_prediction

House pricing prediction ML pipeline. Scrapes data, stores in Azure, uses...

16
Experimental
5970 freinold/open311-media-scrape

Scraping all media uploads of open311 providers in Germany

16
Experimental
5971 Projet-saline/Easy-Contests

Scrapper + REST API for music contest for the Saline Project made at Hetic

16
Experimental
5972 marcelohfonseca/educadados

Este é um repositório para estudos sobre os dados da educação no Brasil. O...

16
Experimental
5973 Jolycky/DA-AWDashboard

Welcome to the Adventure Works and IMDb Dashboard! This interactive...

16
Experimental
5974 rajkunamaneni/Web-Scraper

Python Web Scraper that uses MySQL

16
Experimental
5975 GrayHat12/Grawler

A web based Crawler that takes two inputs(search item, number of sites to...

16
Experimental
5976 Vi-n1/AnalisePrecosKabum

Scraping no site Kabum em busca de dados sobre placas de vídeo.

16
Experimental
5977 fsabuhi/BumperAZ

BumperAZ is a Python script that scrapes car ads from the turbo.az website...

16
Experimental
5978 iwatkot/paysysmirbot

This telegram bot using beautifulsoup4 to scrap the exchange rates from the...

16
Experimental
5979 AbdulrahmanAlmuzaini/visitsaudi-scraper-python

This Python script is designed to scrape JSON responses from VisitSaudi's...

16
Experimental
5980 juanaviladev/google-popular-times

🔎 ⏳ A simple library for extracting popular times from a google search

16
Experimental
5981 cedricbatailler/lemondeapi

Code for a small API to get data from lemonde.fr written in R. Contains a...

16
Experimental
5982 Hernanatn/Medios_ARG

Librería de Python para realizar 'scrapping' de Medios Argentinos.

16
Experimental
5983 jregistr/laker-parser

Small program to scrape and sanitize scheduling data.

16
Experimental
5984 marufc36/Worlds-Best-Cs-Scientist-

Analyzing and visualizing the rankings of computer science researchers from...

16
Experimental
5985 HukovychB/Cheap-Flights-Telegram-Bot

Telegram ChatBot searching for cheap flights.

16
Experimental
5986 dhavalsavalia/readitforme-scrapper

A python script to download book summaries and audio from readitfor.me, and...

16
Experimental
5987 RobinPourtaud/ani-grab

An API that allows you to search animes, episodes, and retrieve the HLS stream link.

16
Experimental
5988 intellltech/nm

Info of Items Sellers Scraping app

16
Experimental
5989 joeycumines/har-extractor

Command har-extractor is a streaming HAR file parser that writes contents to disk.

16
Experimental
5990 sunsided/esc2024

Exploratory Data Analysis on the ESC 2024 results

16
Experimental
5991 ShiraazMoollatjie/offerzendata

A remote server friendly way to scrape company profile data from offerzen.

16
Experimental
5992 Cecile-Hirschauer/ecom-notifier

Price Tracking System

16
Experimental
5993 MuhammadRaheelNaseem/Video-Frames-Extractor

Quickly extract frames of all the videos inside a directory with...

16
Experimental
5994 santagar/web-scraping-solution

A basic sample web scraping demonstrating how to build a microservices architecture.

16
Experimental
5995 sarthakpranesh/ParallelSoup

A library that utilizes BeautifulSoup to provide multi-threaded scrapping,...

16
Experimental
5996 Noras2001/Parsing_using_Scrapy

Web scraping using Scrapy

16
Experimental
5997 lhotanok/erasmus-plus-project-scraper

Searches Erasmus+ projects from: https://erasmus-plus.ec.europa.eu/projects/search

16
Experimental
5998 juangesino/kamernet-crawler

Crawler for extracting data from Kamernet

16
Experimental
5999 TheFerry10/bluescraper

A Python web scraping tool that simplifies content extraction using...

16
Experimental
6000 jdobonb/unipropic

A CLI app that automatically puts a profile image in all your accounts.

16
Experimental
6001 Andrew95496/hypergraze

DATA FOR ALL!

16
Experimental
6002 lfern/downdocauto

Scraping whatsapp media

16
Experimental
6003 Haimonmon/detective-matchy-the-reviewer

Using regular expressions and an algorithm to determine if a user's review...

16
Experimental
6004 BrunoAraujo84/Analise-Acoes-Americanas

Scripts Python para análise de ações americanas, incluindo dividendos e...

16
Experimental
6005 sten626/sideboard-scraper

Script for analyzing cards played in sideboards in MTGO deck dumps.

16
Experimental
6006 Narvo-Intelligence/narvo_news

Narvo is a precision-engineered news broadcast platform that transforms...

16
Experimental
6007 DevprojectEkla/WebScraping

My first steps in web scraping using bs4 (BeautifulSoup) library on python....

16
Experimental
6008 freerangeandy/ff-reality

Compare projected fantasy football rankings with actual results

16
Experimental
6009 CripterHack/business-address-scrapper

Python+Scrapy - Distributed scraping system with cache for business...

16
Experimental
6010 abuadan/Forum-Scraper

A Very Ugly immplentation of a forum scraper using Scrapy the first spider...

16
Experimental
6011 haripatel07/BritishAirways_VirtualExperience

Data science projects from the British Airways Virtual Experience Program...

16
Experimental
6012 Aleksandir/Book-store-scraper

A Python script that scrapes books.toscrape.com and saves the book data to a...

16
Experimental
6013 pokatomnik/kriper

Kriper.net mobile app

16
Experimental
6014 ste316/scrape_script

A collection of Scraping scripts

16
Experimental
6015 valeria-gonzalez/cookmateAPI

Flask API designed to execute a recipe web scraper and manage Google...

16
Experimental
6016 tennisonchan/cat-claws

A cat's best tool for scraping any furnitures 🐱

16
Experimental
6017 noobshubham/College-Events-API

an API for providing CMRIT college events in response

16
Experimental
6018 AbdallahBaddour/GoogleReverseImageSearchApp

Google Reverse Image Search Application with Ionic

16
Experimental
6019 luizmellodev/ScrapingNews

Automated script that navigates the World Wide Web in a methodical and...

16
Experimental
6020 StevenAdema/goodreads-wrapped

A year in books summary for your activity on GoodReads.

16
Experimental
6021 DamiyanVC/Crawl-iMDB-website-to-create-indian-movie-celebrities-database

Crawl-imDB-website-to-create-database-of-indian-movie-artists

16
Experimental
6022 SurendraTamang/linkedin-companies-scraper

Scrape company profiles from LinkedIn using Python

16
Experimental
6023 pankush9096/Web_Scraping_BS4

Web scraping using python Beautiful Soup and Request library

16
Experimental
6024 revolexGeek/toScrapeBS4

Utilization of all toscrape.com sandbox data collection methods.

16
Experimental
6025 IvanGarL/web-scraper

NodeJS server that enables scraping websites using a basic user authentication

16
Experimental
6026 dragonman164/Used-Cars-Price-Prediction

A simple model to predict prices of used cars

16
Experimental
6027 JakAnalizowacDanePL/Zadania

Zadania do artykułów na blogu JakAnalizowacDane.pl

16
Experimental
6028 Egsagon/turboself

API for the TurboSelf web application.

16
Experimental
6029 sakhezech/cardscraper

Webscraping tool for generating Anki packages.

16
Experimental
6030 Saurabhkg03/Amazon-reviews-extract

Amazon reviews extract/scrape by using BeautifulSoup, Splash JS, Docker, Python.

16
Experimental
6031 mrx04programmer/zupperlink

ZupperLink es una herramienta de código abierto diseñada para acortar URLs y...

16
Experimental
6032 7mran/Amazon-Price-Monitor

A simple Python script to monitor the prices of Amazon products

16
Experimental
6033 Magnus0969/Wikipedia-Web-Scraping

A web scraping project that extracts text, tables, and links from Wikipedia...

16
Experimental
6034 funnymonke0/simple-isef-scraper

a simple automatically updating web scraper for the ISEF database.

16
Experimental
6035 StefanHeng/ted-summary-scrapper

Scrape TED talks transcripts for those with summaries

16
Experimental
6036 UzBCoder0221/Automated-Emaktab

Automated Emaktab login performer. Tries to login emaktab using redirect method.

16
Experimental
6037 ranindunethmina/Web-Scrapping

Repository designed to help freshers easily grasp the basics of web...

16
Experimental
6038 mbuthimungai/howtoshopforfree_scraper

This scrapper scrapes https://www.howtoshopforfree.net/ webpage deals. Then...

16
Experimental
6039 m3mentomor1/BBC_News_Headline_Scraper

This is a simple web scraper that uses the Beautiful Soup library to...

16
Experimental
6040 thehackersbrain/linkparser

A Toom for Grabbing or Scrapping all URLs from a targeted URL or domain.

16
Experimental
6041 charlesaraujo/web-scraper

web scraper with node

16
Experimental
6042 szapp/GansDataEngineering

Data engineering project demonstrating a fully automated pipeline of web...

16
Experimental
6043 manuemmanuel/Insta-Profile-Downloader

This Python script allows you to download the profile image of any Instagram...

16
Experimental
6044 ellie991/TV-series-analysis

TV SERIES ANALYSIS - THE BIG BANG THEORY vs THE VAMPIRE DIARIES

16
Experimental
6045 esnanta/analysis-sentiment-mypertamina

Analisis ini bertujuan mengetahui sentimen menggunakan klasifikasi teks...

16
Experimental
6046 pryazhnikov/pytextutils

Utility functions for text processing using Python

16
Experimental
6047 DopamineAddict7/youtube-search-api

🔍 Streamline YouTube content search with a powerful API that provides...

16
Experimental
6048 amoghmadan/Python-Scrapy-Example

Python Scraping with Scrapy Example.

16
Experimental
6049 skica-dev/xodexothon

Scrape all valid coupons from Xodexo.

16
Experimental
6050 winiar93/scrapy-data-collect

scrapy commodore 64 offers

16
Experimental
6051 shivamacs/scrapjango

A web crawling utility that gets you the links at one place.

16
Experimental
6052 syukriyansyah-ipb/youtube_comment_scrapper

Youtube Comment Scrapping

16
Experimental
6053 acsor/URL-Inspector

Javascript-free URL inspector implementation using Django and Scrapy.

16
Experimental
6054 jedelacarrera/products_mvp

Scrap supermarket prices and display the cheapest ones

16
Experimental
6055 jmcph4/skovo

Simple Python time series library

16
Experimental
6056 coffee-and-debugging/Bharatpur-Metropolitan-Authorities-Contact-Crawler

Web scraper that collects contact details of Bharatpur Metropolitan...

16
Experimental
6057 redoper1/covid-who-sprinklr

Apify.com actor for scraping data from website https://covid19.who.int/

16
Experimental
6058 oscar-castellanos/HackUDC25

ClothingCompare is a React web application that helps users find a suitable...

16
Experimental
6059 ikoide/crow

Using NLP to derive market sentiment from user generated content.

16
Experimental
6060 CedricFauth/Thesis-Watcher-Informatik-Uni-Hannover

Get an overview of available thesis topics!

16
Experimental
6061 SamirWagle/Nepse-All-Scraper

Nepse Scraper. Automated in GitHub Actions. Open Source

16
Experimental
6062 xransum/site-scanner

Website scanner for gathering information and reconnaissance on a target site

16
Experimental
6063 spike1236/aiofetch

Collection of different tools for async web scraping

16
Experimental
6064 arachnio/arachnio4py

Arachnio client library for Python 3.10+

16
Experimental
6065 CLoaKY233/WebScraper

This project offers two powerful web scraping tools for Amazon India: a...

16
Experimental
6066 AlbertGallegoJimenez/Bonpreu-scraper

Este repositorio contiene el código para realizar web scraping sobre la...

16
Experimental
6067 Lich-Corals/coral-chords

Download and sync tabs and chords from Ultimate Guitar with Spotify

16
Experimental
6068 JerboaBurrow/GetImagesFromWikiMediaWithAttributions

Extract images form a query to Wikimedia, with attributions

16
Experimental
6069 dossma/scrape-AICA

extract members data of Aerospace Industries Association of Canada

16
Experimental
6070 iolar/mizuno-ru-sales-bot

Web-scraping script + Telegram bot

16
Experimental
6071 afnanenayet/academic-pinetable

A revamp of the Dartmouth academic timetable. Designed to be intuitive and...

16
Experimental
6072 jmcph4/marketdb-import-tools

Scripts for importing data from various sources into MarketDB

16
Experimental
6073 kjanjua26/Beaver

Beaver is a utility that automatically edits your .bib files with new papers...

16
Experimental
6074 bright-kr/Pitchbook-Companies-dataset-samples

투자 인사이트를 위해 Bright Data API를 통해 회사 데이터를 탐색하세요.

16
Experimental
6075 ChiragAgg5k/finscraper

scraping and processing sec edgar financial data and training fastercnn...

16
Experimental
6076 JsebastianCK/mdtscraper

MiraDeTodo - Web Scraper

16
Experimental
6077 stephankaag/cookie-monster

Automate the process of fetching valid cookies and analyzing additional...

16
Experimental
6078 MichaelCurrin/save-the-pages

Create local HTML snapshots of given URLs

16
Experimental
6079 raywhite/pico-dom

Functional markup manipulation.

16
Experimental
6080 oliverpk2000/PL-exchange-rates

perl script that scrapes currency exchange rates

16
Experimental
6081 Thordata/how-to-bypass-amazon-captcha-when-scraping

Step‑by‑step 2026 guide on how to bypass Amazon CAPTCHA when scraping: free...

16
Experimental
6082 9dl/RobotsSniffer

Tool to analyze and parse website robots.txt for crawler rules.

16
Experimental
6083 1B05H1N/python-practice

Explore algorithms with practical examples: recursion, breadth-first search,...

16
Experimental
6084 1B05H1N/site-checker

Comprehensive site and DNS checker tool for validating host reachability,...

16
Experimental
6085 cjwinchester/samebirthday

Python duder to grab/format Wikipedia table of #samebirthday

16
Experimental
6086 jersson/longest-github-contribution

An easy web way to check what was your longest contribution on GitHub

16
Experimental
6087 Rahul8991/EVNews

API model for extracting updated news on Electric Vehicles

16
Experimental
6088 willsbit/sipwhisky_scraper

Scraper do de marcas, preços e links de whisky.

16
Experimental
6089 limkhashing/Arabic-Bible-Scraping

Simple Python data processing that scrap data from Excel and pass to Firestore

16
Experimental
6090 itsnaks/pylipsum

Library for generating Lorem Ipsum in python

16
Experimental
6091 rum-people/backend-svc

Backend for the Analytics Service.

16
Experimental
6092 dueyfinster/head2rss

Parse News Websites Trending Headlines to RSS Feeds

16
Experimental
6093 zyocum/scrape_wikinews

Python script for scraping Wikinews articles

16
Experimental
6094 Amit4218/netcli

An cli appliction that allows user to search & watch movies through their terminal

16
Experimental
6095 ivan-brko/Gamayun

Application intended to ease data collection processes

16
Experimental
6096 darielson-albarado/Social-Media-Automation-Prototype-Nodejs

English: Social Media Automation and Advanced Webscraping Prototype....

16
Experimental
6097 CarterPape/NewsBot

A bot that runs journalistic tasks, such as web scraping

16
Experimental
6098 kabirnayeem99/islam_qa_scraper_go

IslamQA scraper written in Go.

16
Experimental
6099 jiandahao/goscrapy

A web crawling and scraping framework for golang.

16
Experimental
6100 sunil-dhaka/ncert-books-downloader

Automatically download NCERT textbooks class-wise from the official portal

16
Experimental
6101 emull8r/Website-Analyzer

A Java-based offline web scraper that produces an Excel file as output.

16
Experimental
6102 ronderins/NYCLI-0

Scraping Gem

16
Experimental
6103 magpols/amazon_30_best_selling_toys_api

To find the first 30 most popular toys selling on Amazon.

16
Experimental
6104 lfhohmann/gcp-weather-and-forecast-scraper

This is a scraper for current weather data from Wunderground Personal...

16
Experimental
6105 jessmed/PTC

Proyectos para la asignatura Programación Técnica y Científica(UGR)

16
Experimental
6106 debdutgoswami/makaut-result-parser

Easy way of extracting results of MAKAUT students

16
Experimental
6107 soyFelixBarros/Scraper

🕷 Raspar una web y obtener su contenido.

16
Experimental
6108 Rotvig/LightWebNetScraper

Lightweight .NET web scraper

16
Experimental
6109 ghh145218-a11y/Lightweight-Agentic-RAG-Service

Analyze startup signals with a lightweight RAG service using semantic search...

16
Experimental
6110 vishvdeep007/scraping

python web scraping script using beautifulsoup4 library

16
Experimental
6111 IRHM/sbond-got-vac-now-he-sad

Mainly a counter until your vac ban is hidden from prying eyes!

16
Experimental
6112 mthomason/collect

Example shows how to batch create a Drudge Report type site using Open AI's...

16
Experimental
6113 yavuzCodiin/Web_Scraping_VCoin_w_Scrapy-Pandas

Scraping the data from Vcoins with Scrapy and cleaning, analyzing the...

16
Experimental
6114 Erkmik/best-python-html-parsers

The top Python HTML parsers for web scraping, including Beautiful Soup,...

16
Experimental
6115 gavalle94/Flights-dataset

Analysis of a dataset of flights, using the SparkSQL framework and extra web...

16
Experimental
6116 sarbosarcar/EduPy

A Flask-based web application aimed at recommending undergraduate courses in Europe

16
Experimental
6117 1Developpeur/UserAgent-Generator

Powerful Python3 library that generates realistic User-Agent strings for...

16
Experimental
6118 g-brrzzn/PerformanceInflation

An automated data science and web scraping pipeline that measures the real...

16
Experimental
6119 marvinkome/nigerian_state_and_lga

This crawls Wikipedia and extract the states and local governments area in Nigeria

16
Experimental
6120 FranciscoImanolSuarez/Web-scraping-Python

Web Scraping creado en Python

16
Experimental
6121 korosuke613/miyadai-oshirase-twitter-bot

WIP

16
Experimental
6122 buemura/stock-scrape-service

stock-scrape-service

16
Experimental
6123 cak/foot

Foot is a library that fetches a list of URLs and silly walks through each...

16
Experimental
6124 DataCritica/escritoras-latinas

Web scrapping of data from Latin American women writers and network graph...

16
Experimental
6125 6bita/NEWSPARSER

DIGITAL MEDIA SPORTS NEWS WEB SCRAPER FOR FOOTBALL SQUAD @OficialCAP

16
Experimental
6126 jeremyboyd/MTB_results

A Shiny web app that displays results from Idaho Interscholastic Cycling...

16
Experimental
6127 bgelov/powershell-web-parsing

Parsing web sites and JSON data files with Powershell. Wikipedia, Aviasales,...

16
Experimental
6128 Kipprotor/Keiba-Profile

A typescript module that searches for and retrieves racehorse information...

16
Experimental
6129 jersson/web-scraping-intro

Simple class library to make web scraping using python

16
Experimental
6130 lfhohmann/wunderground-pws_aws-lambda

A serverless API that scrapes Wunderground PWS pages hosted on AWS Lambda

16
Experimental
6131 creativereason/christmasmusic

Scraping Christmas music from radio station's public websites.

16
Experimental
6132 quepas/matlab-builtins

Scraper for retrieving names of the matlab's built in functions and classes.

16
Experimental
6133 jiseeeh/filler-hunter

anime filler scraper for me to use when i want to watch anime and skip fillers

16
Experimental
6134 parasmehta/berlin_rents_analysis

Analysis and Visualization of Rental Listing Prices in Berlin.

16
Experimental
6135 rlossec/Web-scraping

Scrapping avec Python

16
Experimental
6136 Daste745/hot-shot-bot

Discord webhook bot for notifying about x-kom promotions

16
Experimental
6137 Erdragh/Werkswelt-Scraper

scrapes info about food from the page of the mensa

16
Experimental
6138 zdub0is/tree-crawling_web_scraper

This small program will start at the base url of W3Schools and grab every...

16
Experimental
6139 refk32/freeg

Simple scraper for limited free games

16
Experimental
6140 Thordata/how-to-scrape-google-images-with-python

> How to scrape Google Images with Python (2026) – free requests +...

16
Experimental
6141 rizmulya/quotesScrapy

Scraping quotes data from API and login with Scrapy.

16
Experimental
6142 plissonf/DeepPlay

DeepPlay explores athlete records in the world of competitive freediving

16
Experimental
6143 gonza7aav/scraping-passenger-list

A bundle of web scraping script that harvest information about ships,...

16
Experimental
6144 MisterSoandSo/Python-Gmail-Extractor

Demo Project. Extract data from specifc senders

16
Experimental
6145 moises-herrera/stock-market-web-scraper

Reusable stock web scraper built with TypeScript

16
Experimental
6146 jithinanievarghese/flipkart_scraper_scrapy

Scrapy spider to scrape the product details of e-commerce website flipkart.com

16
Experimental
6147 stonegold546/the_galit_files

A web-scraper for scraping data MRT data

16
Experimental
6148 ConcurrentHashMap/toilettenpapieralarm.de

The code behind my #stayhome project 🧻🔥 Toilettenpapieralarm.de.

16
Experimental
6149 sahibul-nf/aceh-dictionary-api

Aceh language dictionary API created using Golang

16
Experimental
6150 hcloenne/Tablehockey

End-to-end data science project for table hockey: scraping match data,...

16
Experimental
6151 juic3b0x/data-scraper-project

This is a simple Python project that demonstrates how to scrape promo codes...

16
Experimental
6152 bitoverflow-in/scrape-site-face

scrape a given site for images and extract faces into separate files from...

16
Experimental
6153 hrbrmstr/cruxjars

Java Archive Wrapper Supporting the 'crux' Package

16
Experimental
6154 cristiadu/bcbid-oppanalysis

Parser and Analyzer for BCBID Opportunities (https://www.bcbid.gov.bc.ca)

16
Experimental
6155 khalidelboray/DATA

Data collected from the web

16
Experimental
6156 marcluettecke/rent_data_germany

This repository represents a side project to visualize economic factors and...

16
Experimental
6157 TheoG123511/upload_scraping

Video downloader for upload player

16
Experimental
6158 kaykayehnn/DedolesPriceScraper

Homework #3 for https://github.com/nikolayvpavlov/Lectures-TPL-2021/

16
Experimental
6159 winterhazel/sigaa-for-kotlin

API não oficial para a leitura otimizada de dados do SIGAA.

16
Experimental
6160 fariyanishraq/wiki-short

an opensource app that scrapes wikipedia using python and beautifulsoup4

16
Experimental
6161 streanger/sigma-to-elastic-rules

wrapper for uncoder.io for sigma rules convertion

16
Experimental
6162 danangfirs/indoquake

A Latest Earthquake Detection Package Taken Based on BMKG | Meteorological,...

16
Experimental
6163 rossGardiner/prof-scaper

Haskell coursework as completed for the Functional Programming 4 Course at...

16
Experimental
6164 256hax/rururu

Simple web scraping tool by Ruby

16
Experimental
6165 joeperri95/media-scraper

Scrape files from imgur and reddit

16
Experimental
6166 AekarinOngart/Theory-of-Computation

01076121 THEORY OF COMPUTATION

16
Experimental
6167 TUR1ACUS/Table-Web-Scraping

Web Scraping and Data Extraction Scripts.

16
Experimental
6168 walieed122/Instagram-Follower-Count-Public-Profile-Data-Scraper

A Python tool for retrieving exact Instagram follower counts and other...

16
Experimental
6169 djankies/docs-scraper

Python-based web scraper that recursively crawls documentation websites and...

16
Experimental
6170 SINGHxTUSHAR/Flipkart_web_scrapper

This Project scrap the information for the reviews of different item on the...

16
Experimental
6171 waqassahmed03/alvord-polk-scraper

This is a Rust tool that scrapes product information from Alvord Polk website.

16
Experimental
6172 alanhasn/my_cybersec_lib

A simple cybersecurity library For Scan The network and Target easily...

16
Experimental
6173 FancySnacks/mediascraper

Scrape images, videos and sound from webpages and HTML files.

16
Experimental
6174 CarterSnich/unofficial-goalkicker-api

An unofficial API for fetching and dowloading books from GoalKicker.com...

16
Experimental
6175 hunter-meloche/ebay-scraper

An AWS Lambda web scraper for analyzing item listings on eBay written in Python.

16
Experimental
6176 Thordata/thordata-mcp-server

> Official Thordata MCP server that connects AI agents to real-time web...

16
Experimental
6177 internetofwater/gleaner

Crawl remote JSON-LD and structured data and save it to an S3 Bucket

16
Experimental
6178 Matt0550/EurostreamingAPI-scraping

An unofficial REST API for Eurostreaming website, with a WebApp to search...

16
Experimental
6179 onlynayan/FDR-Investment-in-Banks

Bank-report intelligence platform for FDR investment: extraction scoring,...

16
Experimental
6180 City-Bureau/scrapy-sentry-errors

Scrapy extension that logs errors to Sentry.

16
Experimental
6181 pedrooaugusto/spoj-scraping

Scrap for br.spoj.com

16
Experimental
6182 ubeydgur/job-posting-scraper

Scraping job postings from the website with BeautifulSoup.

16
Experimental
6183 escalopa/itis-tables

An API for itis schedule and courses (Made by students for students)

16
Experimental
6184 dasdachs/wd-1-scraping-exercise

Educational project

16
Experimental
6185 Witaly3/github_scraping

A crawler for crawling github repositories using python and the scrapy framework

16
Experimental
6186 artifice-project/artifice-scraper

You Are What You See

16
Experimental
6187 lkellar/mySchoolDiningLegacy

Downloads menu from MySchoolDining and prints it

16
Experimental
6188 berkingurcan/discord-qa-scrapper

discord qa scrapper for zkApp Umstad Project

16
Experimental
6189 DrOncogene/scraping

Website scraping with python (bs4 and scrapy with scrapy-splash)

16
Experimental
6190 sw4k/scrape-web

A quick and dirty tool, written in python, for scraping a website.

16
Experimental
6191 glopezv95/python-bs4-quotes

A web-scraping project to retrieve quotes (text and author) for each of the...

16
Experimental
6192 bogdan-sikorsky/webrider_async

WebRiderAsync is an asynchronous utility designed for simple and easy...

16
Experimental
6193 creatorpanda/syphon

HTML comments harvester.

16
Experimental
6194 muhfalihr/PyGDTelebot

PyGDTelebot is a versatile Telegram bot meticulously crafted in Python...

16
Experimental
6195 PythonicXwarraich/InstagramUrlsScraper

A web scraper to extract Instagram URLs for cafes, restaurants, and bars in USA

16
Experimental
6196 grenadieren/web-scraper

Quickly scrape data from a website

16
Experimental
6197 clemsims/moodlescrap

A cool scrapping tool for Moodle. Always wanted that cool "Download all...

16
Experimental
6198 waqassahmed03/Vonovia

This is a Python tool that automates the process of sending inquiry emails...

16
Experimental
6199 vlad-lubenskyi/devtools-detector-demo

A simple demo that uses source maps to detect when dev tools are opened.

16
Experimental
6200 jac08h/NextSoccerDerby

Website to display dates for upcoming soccer derby matches.

16
Experimental
6201 hajekjiri/lenovo-outlet-scraper

A scraper that fetches laptop deals from the Lenovo US Outlet.

16
Experimental
6202 thiagoraniery/Monitor-Infra

Monitoramento diário e síntese estratégica semanal automatizados.

16
Experimental
6203 DewXIT/osint-feed

Config-driven news harvester for Node.js. Pulls articles from RSS feeds and...

16
Experimental
6204 hupe1980/scrapyrunner

A Python library to run Scrapy spiders directly from your code.

16
Experimental
6205 renanmachad/search-contestado.

Ferramenta de pesquisa para catalogar lugares sagrados da região do...

16
Experimental
6206 Darkelf2024/Darkelf-CLI-Research-Suite

Darkelf Research Suite is a powerful command‑line research toolkit designed...

16
Experimental
6207 abhinavsuraj/webscraping

Scrape Information from Ranking Websites

16
Experimental
6208 ssilvavvagner-bit/tjpi-data-pipeline

Pipeline de engenharia de dados para extração, transformação e carga (ETL)...

16
Experimental
6209 jgarabedian/scrape-hacker

Scrape Hacker News to provide the most relevant news stories in a text file

16
Experimental
6210 SkStash/FlashFeedAIBot

FlashFeedAIBot is a Telegram bot that delivers summarized news content based...

16
Experimental
6211 liam234e23432/IR_CF

🛡️ Discover a smart IP scanner for Cloudflare, optimized for seamless...

16
Experimental
6212 ryoichi-obara/kokusaibus-scraper

Web scraper for http://www.kokusaibus.com/blsys/loca

16
Experimental
6213 b00731976/SCP_Wiki_NLP_Exploration

This project is a 2-part program that will: 1/Scrap the SCP Wiki for data....

16
Experimental
6214 danibcorr/wattpad-mate

📚 A tool to explore Wattpad, gather insights, and engage with users for...

16
Experimental
6215 Mothraa/ETL-MarketAnalysis-webscraping

OC project 2

16
Experimental
6216 Arkapravo-Ghosh/icd10-scrapper

A Simple Web Scrapper that collects ICD 10 Medical Codes from the...

16
Experimental
6217 TheJakov/newsTracker

Višeagentni sustav za praćenje novosti

16
Experimental
6218 prathamkandari/Comment_Analysis_Using_Python

In this Project I've done the Comment Analysis of YouTube for the...

16
Experimental
6219 NiceDayZc/FacebookCodec

Reverse-engineered Facebook BitMap Codec implementation in Python. Generates...

16
Experimental
6220 vsmutok/ProxyForFree

ProxyForFree is a simple and efficient tool for testing and using free proxy...

16
Experimental
6221 Jim-by/scrape_analysis_books

Scraping book data from the website books.toscrape.com and performing...

16
Experimental
6222 mikoim/beggar-bot

乞食ボットの詰め合わせ

16
Experimental
6223 Xx1S8xX/PC-Part-Consolidator-Lebanon

A web scraper using JSoup that compiles a list of all the PC parts in...

16
Experimental
6224 amitbisht511/web-scraping-beautiful-soup

This Repository Just Grab the 10 days weather report of delhi india and...

16
Experimental
6225 MarioInf-Master-CompuerScience-UCM/Gestion_datosInformacion

Repositorio de trabajo de la asignatura "Sistemas de gestión de datos y de...

16
Experimental
6226 jaxke/ibc

Front end for BBC iPlayer

16
Experimental
6227 pn11/photozou-tag-downloader

フォト蔵にアップロードした画像をタグごとにダウンロードする

16
Experimental
6228 stephancill/github-trending-api

Trending page on GitHub served as REST API

16
Experimental
6229 FLAVIO3333/ProxyForFree

🆓 Set up multiple free proxy servers effortlessly with Proton VPN and...

16
Experimental
6230 maacpiash/Prospect

👨🏽‍💻 📝 Read the latest posts from popular coding blogs at one place

16
Experimental
6231 nestorchurin/Gromada-RSS-Bot-Better-Edition

Telegram bot for processing RSS feeds with enhanced parsing functionality.

16
Experimental
6232 ossdaiict/Intranet_Sync

Python Script to scrape and synchronize entire directories from Intranet

16
Experimental
6233 anishjoshi1999/FacebookPage-HamroKhabar

HamroKhabar - Facebook Page

16
Experimental
6234 marcuth/xcrap

Xcrap is a Web Scraping framework for JavaScript, designed to facilitate the...

16
Experimental
6235 palakollusrimanikanta/Python_Programming

Python Programming for Data science and Machine Learning

16
Experimental
6236 ounziw/ounziw_ogp_display

指定したURLのhtmlデータからOGP情報を取得して、ホームページにタイトル・画像・概要を表示する

16
Experimental
6237 ruhulaminparvez/Web-Scraper

Web scraping is the process of using bots to extract content and data from a website.

16
Experimental
6238 T99/la-z-boy-furniture-api-js

Access the La-Z-Boy Furniture API in order to scrape collections of...

16
Experimental
6239 Foss-Labs-BR/extrator-chat-telegram

Um simples extrator de textos dos chats do Telegram

16
Experimental
6240 clamytoe/pryce

Script for searching for items on ebay and barnes and noble

16
Experimental
6241 utkarsh512/cdscraper

Scraping profile metadata from Create Debate

16
Experimental
6242 rifatrakib/eco-friendly-crawler

A web crawler built with Scrapy to crawl a website and scrape necessary data

16
Experimental
6243 v01dedknight/KemSU-helper-bot

This repository is my attempt to hone my parsing skills by combining them...

16
Experimental
6244 Ninoko/MovieScraper

Web scraper of movies, actors, directors and more

16
Experimental
6245 jameelkaisar/NIT-Result-Bot

NIT Result Bot created using pytesseract, opencv, beautifulsoup and...

16
Experimental
6246 qubitstream/oe1_get

Downloads, converts and tags broadcasts of Austria's Ö1 radio station

16
Experimental
6247 makhskham/Stocrates

An educational AI-powered financial literacy platform that teaches beginners...

16
Experimental
6248 cerivitos/fifa-scrape

Transfer history of all FIFA players

16
Experimental
6249 boomboompower/twitch-knowledgebase

Tracking when the twitch knowledgebase is updated.

16
Experimental
6250 hongyuewang/stock-market-scraper

A program that scrapes data about the largest companies on the US Stock...

16
Experimental
6251 arwin4/who-is-going-to-win

Remix app that aggregates US presidential election forecasts

16
Experimental
6252 armanyazdi/car-price-estimator-ruby

An Iranian used car price estimator written in Ruby.

16
Experimental
6253 kandeelai22/wuzzuf-job-scraper

Web scraper for Python jobs from Wuzzuf using BeautifulSoup

16
Experimental
6254 khaledsoudy-1/Quote-Scraper

A Python-based tool that extracts quotes and their authors from the web,...

16
Experimental
6255 BubbsTheSupreme/ChanDump

A web scraper written with Python 3 to download images from a 4chan thread

16
Experimental
6256 gsidhu/cpr-web-scraping

Scrapes data from a bunch of websites.

16
Experimental
6257 dmarks84/Coursework_Project_Sentiment-Analysis

Project for University of Michigan Python Programming Specialization -- Read...

16
Experimental
6258 MauricioVazquezM/A_WebScraper_Example

Repository of an example of a web scraper designed to collect data from a website

16
Experimental
6259 pranjal-barnwal/lenskart-scrap

Lenskart scraping repository connected with Azure

16
Experimental
6260 shivanshsinghal107/COVID-19-India-Dataset

This repository contains the code to web-scrap India's COVID-19 data from...

16
Experimental
6261 MisterSoandSo/Bulk-Image-Scrapper

Bulk Image Scrapper for Personal Use.

16
Experimental
6262 gustavosilverio/my-mangas-scraper

This is the front-end project with python that obtains the manga and saves...

16
Experimental
6263 EnriqManComp/Github-Profile-Scraper-Streamlit

In this project, a web application was developed utilizing Streamlit for the...

16
Experimental
6264 Mothraa/ETL-MarketAnalysis-webscraping-POO

OC project 2 refactoring (POO version not yet completed)

16
Experimental
6265 DiTo97/proxy-rotation

automatic free proxy rotation

16
Experimental
6266 smhussain5/Politico-NLP-Python

Terminal application using natural language processing and web-scraping via...

16
Experimental
6267 TravelXML/FLIPKART-PRODUCT-PRICE-SCRAPPING

Flipkart Price Scraping

16
Experimental
6268 angelsc75/La-Rasquetia

Solución para hacer web-scraping de contactos de empresas de forma...

16
Experimental
6269 spider-rs/n8n-nodes-spider

Spider n8n community node — crawl, scrape, and extract structured data from...

16
Experimental
6270 Pradeepg2445/web-spider

It's a simple web page spider that can perform crawling, indexing, and...

16
Experimental
6271 sdelquin/tenempleo

Job offers notifications pulled from tenempleo.com

16
Experimental
6272 bramireza/Meme-Scraper-API

This project is an API that scrapes random memes from a website and serves...

16
Experimental
6273 Dramarr/Dramarr.Services

🖥️ All the services used for Dramarr that includes scraping and downloading shows

16
Experimental
6274 RomanGW/lukki

Completely free code for a webcrawling bot.

16
Experimental
6275 imesut/f42

Patent Analysis for F42 Ammunition and Blasting" Technologies

16
Experimental
6276 Jeremiaszmacura/scrape-words-web-app

Simple application using MongoDB database, Python with matplotlib, bs4....

16
Experimental
6277 YertleTurtleGit/citations-by-hindex

Do Scientists Directly or Indirectly Cite other Scientists by Reputation?

16
Experimental
6278 rishav-karanjit/WatchMen-keep-track-of-your-shopping-list

Desktop app that keeps track of items in shopping list and alerts when the...

16
Experimental
6279 DiTo97/saferequests

A drop-in replacement for requests with automatic proxy rotation for web...

16
Experimental
6280 kurtnettle/bubt-faculty-scraper

A CLI tool to scrape faculty information from the BUBT websites

16
Experimental
6281 charakamihiranga/NewsScraper

A web scraping application that collects news articles, stores them in...

16
Experimental
6282 IngeniJon/reddit-phone-number-scraper

📞 Scrape publicly available phone numbers from Reddit profiles and posts,...

16
Experimental
6283 charyan/hacker-news-daily

Hacker News - Daily Scraper

16
Experimental
6284 Spring-0/crackmes.one-web-scraper

crackmes.one webscraper built using Scrapy

16
Experimental
6285 SakuraPuare/Bilibili_comment

三体 哔哩哔哩动漫版 评论区数据

16
Experimental
6286 thefilesareinthecomputer/web_scraping_research_agent

Competitive market data aggregation tool for restaurant, hospitality, or...

16
Experimental
6287 maciekmm/hackathon-t2tc-jakpelnosprawny-backend

:cloud: 2nd place winning Travel To The Cloud Hackathon Backend Solution....

16
Experimental
6288 NathanKong06/Goodreads-Dashboard

Streamlit-based dashboard that provides insights into Goodreads reading data...

16
Experimental
6289 ChenlongXu/Statista

This is a trial project for web scraping "chart of the day" section of the...

16
Experimental
6290 nithishr/meetup_scraping

Talk for PyData meetup in Munich

16
Experimental
6291 AvichalS/Analytical-Debate-Messi-vs-Ronaldo

Using data scraped from the web to analyze footballers' performance with the...

16
Experimental
6292 NickCirv/competitor-price-monitor

Track competitor pricing pages and detect changes. Sends automated change alerts.

16
Experimental
6293 Hridoy-31/Python-Programming-University-of-Michigan

Python for Everybody Specialization - University of Michigan - Coursera

16
Experimental
6294 resonatehq-examples/example-bluesky-scraper-ts

A recursive, distributed bluesky scraper

16
Experimental
6295 dmarcosl/scrapy-playground

Example project using Scrapy

16
Experimental
6296 Aayush9808/Coding-Platform-Analyzer

Automated competitive programming profile analyzer aggregating stats from...

16
Experimental
6297 ch0c0l8ra1n/listenToThis

A website that creates a youtube playlist of all the current videos in a sub reddit.

16
Experimental
6298 blazingvx/AsianGamesMedalStandingsAPI

The Medal Standings API is a Flask web application that scrapes and serves...

16
Experimental
6299 EPguitars/gpt-company-search-engine

This is a search engine based on openai api and scraping modules with api...

16
Experimental
6300 aalexborges/github-status

Site made with Next.js framework, where you can see the status of GitHub services.

16
Experimental
6301 darideveloper/previred-bot

Bot for download files from...

16
Experimental
6302 open-edu-data/university-scraper

University Website Scrapers

16
Experimental
6303 Giuseppe-Bonifati/GamesForYou

Web Scraping: GamesForYou will choose a random game for PS5 or X box Series...

16
Experimental
6304 laravieira/Scraping

Simple Web Scraping Framework, based on Curl and str* functions.

16
Experimental
6305 darkddev/simple-go-parser

Simple parser api server for google, amazon, walmart pages

16
Experimental
6306 Satyam4229/Top-Rated-Movies

The Python script provided is an example of web scraping using BeautifulSoup...

16
Experimental
6307 Jevil36239/Grabber_Project

Efficient and Comprehensive Automated Multi-API URL Retrieval and CMS Validator.

16
Experimental
6308 liebki/MMOGANet

This mmoga scraper allows you to scrape products with their data of mmoga.de

16
Experimental
6309 da1rren/Recipehs

WIP A set of services to scrap websites for recipes and store them in elastic search

16
Experimental
6310 bsteen/is-it-on-hfqpdb

Check if active Harbor Freight coupons have been uploaded to HFQPDB

16
Experimental
6311 tkerbe2/forecast-scraper

A really simple web scraper that will grab data from weather.gov and present...

16
Experimental
6312 kyza0d/class-scraper

Web scraper that extracts data from a web page and generates a JSON table...

16
Experimental
6313 zarazinsfuss/scrapit

Simple web scraper script to mirror locally a given web page.

16
Experimental
6314 FlowExtractAPI/skool-map-scraper

🗺️ Extract member locations & full profiles from any Skool community map GPS...

16
Experimental
6315 m-nanda/ETL-Pipeline

ETL Pipeline use-case with the batching-processing method

16
Experimental
6316 jameelkaisar/NIT-Notifications-Bot

NIT Notifications Bot created using beautifulsoup

16
Experimental
6317 AzLeCurieux/8INF309---Stage-projet-I

Promotion Intelligence and Gastronomy Analytics System (PIGAS)

16
Experimental
6318 dafmontenegro/web-scraping-text-modeler

El proyecto es una propuesta de modelamiento del idioma español por medio de...

16
Experimental
6319 bartoszstepien01/Chrobry-Zast-pstwa

A Messenger bot which notifies of substitutions

16
Experimental
6320 abdnh/getting-to-philosophy

Finds a path between any Wikipedia article to the Philosophy article

16
Experimental
6321 kcsodetz/devpost-user-info-scraper

A web scraper that, given a valid Devpost username, displays the number of...

16
Experimental
6322 bceyhann/Python-Web-Scrapping-Script-With-MySql-Database

This script is made for scrap exploit names and the links that contains...

16
Experimental
6323 kz4killua/understat

Tools for scraping data from understat.com

16
Experimental
6324 walter-lead/whowroteit

An experiment in poetry classification with deep learning

16
Experimental
6325 melvinchia3636/MCS

A site aimed to help other players like me find Minecraft servers that are...

16
Experimental
6326 omeraslandev/realtime-realestate-market-analyzer

My web scraping application that extracts the title deeds and prices of...

16
Experimental
6327 dossma/scrape-Deutsche-Schulen

extract data on german international schools

16
Experimental
6328 TheBugFather/PyWordlist-Toolset

Multi-mode wordlist generation tool supporting binaries, text files, PDF's,...

16
Experimental
6329 erenulas/GetProductPriceFromWebsite

Gets the chosen product's prices from www.sanalmarket.com.tr, and writes...

16
Experimental
6330 IvanCruzFraguela/ComprobacionListasB

Scrapping de página que compara si una lista de personas ha cambiado

16
Experimental
6331 fxierh/Python-py4everybody

UMich's Python for everybody Specialization on Coursera.

16
Experimental
6332 Miha22/books_lover_async

All internet books in your hands. Asyncio web scrapper. 360MB and 29 hours...

16
Experimental
6333 vwkd/elopage-scrape

Script to scrape elopage courses

16
Experimental
6334 marinaoliveira96/web-scraping-python

Web Scraping com Python e Flask

16
Experimental
6335 AnupamKhosla/crimeWiki

Wikipedea of major criminals, criminal organizations and crime evets....

16
Experimental
6336 tgll/datamining_twitterXmongodb

Data Mining of tweets withe MongoDB and Twitter API

16
Experimental
6337 blessingogunyinka/critter

twitter front-end / twitter clone built using React

16
Experimental
6338 amraoui-mo7amed/bayt-job-hunter

A Python CLI tool that automates job searches on Bayt.com

16
Experimental
6339 chethan25/tv-series-file-renamer

A media management tool to rename tv series files.

16
Experimental
6340 p3l1/cdio2mongo

Consume results from changedetection.io watches and save them into a MongoDB

16
Experimental
6341 raghavshahhh/lead-genrater

Fully Automated Lead Generation Bot

16
Experimental
6342 richardsondev/rmp-outages

Tracking Rocky Mountain Power outages in Utah, Idaho, and Wyoming

16
Experimental
6343 ethannguyen2k/psy-automation

From a table file containing clinic's name and websites, a python module can...

16
Experimental
6344 anatolykoptev/go-twitter

Twitter/X scraping library for Go with anti-ban, account pool, xtid, and...

16
Experimental
6345 nikhilsrajan/instagram-scraper

Python3 scripts to scrape information off Instagram.

16
Experimental
6346 varunsingh29/CiteMePy

A python script that given a wikipedia article as URL, finds all the lines...

16
Experimental
6347 karakays/vatan

Track product prices in vatan

16
Experimental
6348 bailus/freeviewnz-icon-download

A small python script that downloads the channel icon images from the online...

16
Experimental
6349 GrigorisLionis/foodprices

R Package for downloading wholesale food prices from Athens central food market

16
Experimental
6350 moises35/graph-glean

Herramienta que obtiene los metadatos de OpenGraph de una página web y asi...

16
Experimental
6351 jorgefz/thesaurus

Python tool to fetch synonyms for a word from thesaurus.com

16
Experimental
6352 Crocmagnon/downloader-go

Download your invoices, bank statements, etc.

16
Experimental
6353 rxchit/mal-reviews

Scripts for web scraping MAL into a SQL database

16
Experimental
6354 NickTurenne/UFC_Data_Scraper

A Web Scraper that extracts fighter information from matchups for the next...

16
Experimental
6355 varun-s22/Product_Analyser

Simple tool, which fetches data of a product from the vendor, analyses it,...

16
Experimental
6356 toprakware/hyperskill-projects

This is the repository of my completed Hyperskill (prev. JetBrains Academy) projects.

16
Experimental
6357 murali44/Wknd

Weekend flight finder

16
Experimental
6358 Cornayy/zero-two

A TypeScript Discord bot for querying Dofus characters by Ankama nickname.

16
Experimental
6359 hamolicious/Steam-Achievements-Scanner

A scanner that will let you narrow down your achievements by letting you...

16
Experimental
6360 pedrosfaria2/economic_events

A simple web scrapping app for economic events.

16
Experimental
6361 gonzalezgbr/covid-monitor-sde

📉🦠 Web app that collects data about the COVID-19 pandemic in the province of...

16
Experimental
6362 MedRachy/Dayleez

DayLeez is a mobile application designed to help users explore and navigate...

16
Experimental
6363 davekolian/Warframe-Scraper

Simple application for using the Warframe Market API and using web-scraping...

16
Experimental
6364 sebaiturravaldes/scrapers.cl

scrapers

16
Experimental
6365 Tinashe984life/NY-Times-Crawler

A web crawler that extracts articles from the New York Times website and...

16
Experimental
6366 Matthew-Beckett/ync-scraper

A web scraper that scrapes Your Next Car Ltd for BMWs with M Performance...

16
Experimental
6367 sir-go/rkn-revizor-reports

rkn-revizor reports maker

16
Experimental
6368 koenderks/CirrusMaximus

Cirrus Maximus is an extension for your web browser that enables scraping...

16
Experimental
6369 renanbs/website-downloader

A simple website downloader.

16
Experimental
6370 corralm/fantasy-basketball-scraper

:basketball: Fantasy basketball scripts

16
Experimental
6371 theTardigrade/golang-cachedPageDownloader

Go package to download webpages, or access previously cached versions of them.

16
Experimental
6372 Code-Quang/Linkedin-Scraping

I scraped the specific company follower's url, name, education and so on.

16
Experimental
6373 ganeshmukesh123/web-scraping

Simple demonstration of python web-scraping using BueatifulSoup

16
Experimental
6374 leon3110l/link-ripper

scrapes the links from various sites

16
Experimental
6375 gopireddy99/Web_scarping_Examples

Web Scraping on Real time Examples using URL's

16
Experimental
6376 zq99/SP500_constituents_scraper

Script to extract the S&P 500 constituents list from wikipedia

16
Experimental
6377 FelipeCRamos/rctech-selection

A repository to host code from a challange given by RCTech

16
Experimental
6378 0xIntelTech/steam-scraping-application

Info of Items Sellers Scraping app

16
Experimental
6379 darideveloper/sms-scraper

Get SMS from page: receive-smss.com

16
Experimental
6380 letsmakecakes/spotify-playlist-maker

A Spotify client app for generating playlists based current billboard charts

16
Experimental
6381 koivunen/opintoscraper

Applicant data scraping for Opintopolku

16
Experimental
6382 MindPatch/imageflip-rs

imageflip-parser crate :crab:

16
Experimental
6383 davidpasch1/crawlframej

Simple crawl framework for a focused web-crawler in Java.

16
Experimental
6384 felix-steiner/gas-price-tracker

The Gas Price Tracker is a simple Java application, which periodically...

16
Experimental
6385 Stephen-X/XKCD-Search

A simple search engine for xkcd, a webcomic of romance, sarcasm, math, and language.

16
Experimental
6386 NxT-Solutions/MonsterIndex

Track Monster Energy deals in one place: live best prices, price history,...

16
Experimental
6387 vwkd/kartra-scrape

Script to scrape kartra courses

16
Experimental
6388 trong0dn/bs4-web-scraper

A simple web scraper using Python with BeautifulSoup library to generate a...

16
Experimental
6389 Endy02/fu_scrapper

NBA Stats Scrapper

16
Experimental
6390 KumarM0han/Youtube-Scraper

A script to scrap information like channels produced in a search result,...

16
Experimental
6391 pedrovernetti/github-scraper

Endlessly scrapes GitHub repo pages, given a seed user, collecting source...

16
Experimental
6392 matthewarmand/arsenal-america-pub-scraper

Automated extraction of Arsenal America pubs list for export.

16
Experimental
6393 Onome-Joseph/Web-Scrapping

This project is a Python-based web scraper that extracts product details...

16
Experimental
6394 animikhaich/VSEPIA

A Python App to Determine the weight of the contents of a container by...

16
Experimental
6395 sreejeet/internshala-deepsearch

A slightly improved search and retrieval for internshala internships.

16
Experimental
6396 Magnus0969/Image-Scraper

A Python-based web scraper that extracts and downloads images from websites...

16
Experimental
6397 speg03/shishakai

Gather schedules for movie preview events

16
Experimental
6398 axbecher/Supply_Status_Checker

A python script for web scraping to check if a product exists on a website...

16
Experimental
6399 clwillhuang/Aviation-Wiki-Data

A work-in-progress collection of Python scripts which extract data about...

16
Experimental
6400 mattravenhall/FifaTracker

Match tracker for the 2018 Fifa World Cup, designed for sweepstakes

16
Experimental
6401 darideveloper/computrabajo-jobs-scraper

Extract general jobs data from computrabajo.com in specific location and...

16
Experimental
6402 abdullahashfaqvirk/Earth-Engine-Data-Scraper

A Python based web scraper designed to extract and organize dataset metadata...

16
Experimental
6403 lilianmarey/Scrap_autoreflex

Scraping features from a car offers website

16
Experimental
6404 iqbalsarosh/-Phoenix-Gran-and-order

Demo repository to setup granularity for CG Phoenix repos

16
Experimental
6405 mnokno/SpaceCadets

Welcome to the SpaceCadets repository! This repository contains seven...

16
Experimental
6406 rainermensing/GDLive-Explorer

A BeautifulSoup scraper with attached Streamlit Dashboard to visualize...

16
Experimental
6407 sagarsangwan/student-portal

Provides a portal for searching and downloading study materials for various...

16
Experimental
6408 krutikkkkkkkkk/pnrStatus-API

Check ticket information using PNR number

16
Experimental
6409 dpan331/Skr0utz_scraper

An easy-to-use python script to scrap data from Skr0utz.gr along with a...

16
Experimental
6410 jrnewton/holliston-real-estate-sales

Web scraping real estate sales numbers for the town of Holliston MA

16
Experimental
6411 miteshgupta07/Book-Store-Scraper

An automated book store scraper that collects data on book titles, authors,...

16
Experimental
6412 nagataaaas/terraplen

Easy and Useful Amazon Scraper for Python

16
Experimental
6413 nanato12/pokemon-stats

スクレイピングでポケモンの種族値を取得する

16
Experimental
6414 PatrickSpieker/uwccs

Tool which scrapes all the UW courses and their relationships into JSON

16
Experimental
6415 promptapi/scraper_rb

Ruby package for Prompt API's Scraper API

16
Experimental
6416 LuisSevillano/scraping-examples

A couple of scraping examples in Python

16
Experimental
6417 lynnsh/web-scraping-simple

PHP Web Scraping

16
Experimental
6418 pabvald/uva-faqs

Extracting and processing of the frequently asked questions (FAQs) from the...

16
Experimental
6419 umairqadir97/Django_Web_Crawler

A Web Crawler implemented as WEB APPLICATION using Python/Django

16
Experimental
6420 PreetKothari/IBM-Data_Science_Capstone_SpaceX

In this project, we predicted if the SpaceX's Falcon 9 first stage will land...

16
Experimental
6421 TotallyNotAHaxxer/google-scraper

using the google news import we can scrape google

16
Experimental
6422 LucasRGoes/scrapedia

Scrapedia is a scraper specifically designed to extract Brazilian soccer...

16
Experimental
6423 drkameleon/scrub.rb

Automated Web Scraper in Ruby

16
Experimental
6424 fouad-d/pyScraper

Script for scarping items using BeautifulSoup and Python3 you need to...

16
Experimental
6425 squeaky-godzilla/vltava-scraper

Script that scrapes Vltava Rozhlas page and downloads the mp3 files

16
Experimental
6426 dmarks84/Coursework_Capstone_SpaceX_Predictions

Final Project for IBM Data Science Professional Certificate -- Applied all...

16
Experimental
6427 heykush/grabpdf

Grab all kind of pdf from a good site

16
Experimental
6428 y2bd/beat-scraper-v3

A web scraper for Score Saber written in Haskell

16
Experimental
6429 blrobin2/aggr-haskell

A translation of the JSON-building part of aggr in Haskell

16
Experimental
6430 Catalina2820/Inteligencia-de-negocios

This repository contains materials and resources for the Business...

16
Experimental
6431 lurodrigo/parlamento

Dados do parlamento português

16
Experimental
6432 erictleung/sports-popularity-in-usa

:basketball: Analysis of sports popularity in the USA

16
Experimental
6433 simonneedham/instructor-scanner

Scans FI Booking page for instructor availability

16
Experimental
6434 akisonlyforu/BlogtoMP3

GUI Application built with python to convert Online Blog Post to MP3 and TXT

16
Experimental
6435 David-Lor/pysgapi

A Python "API" for the Steamgifts website

16
Experimental
6436 haseebelahi/4chan-scrape-to-db

Scrapes a specific board on 4chan and dumps the board threads and comments...

16
Experimental
6437 azambd/movie-script-downloader

Download Movie Scripts from The Daily Script website [...

16
Experimental
6438 Chromadream/instiz

A Python3-only library for iChart K-Pop chart scores. CURRENTLY BROKEN.

16
Experimental
6439 pipriles/maki

Chrome Extension web scraping tool

16
Experimental
6440 Muhlex/notiflat

Get notified of new real estate advertisements.

16
Experimental
6441 andresilveirah/screpe

A recipe based scraper. Turn HTML into JSON with ease.

16
Experimental
6442 Rising-Stars-by-Sunshine/Stats_201_AlbertLi

Analyzing sentiments in r/wallstreetbets using existing models. Hypothesis:...

16
Experimental
6443 prathmeshlonkar10/British-Airways-Data-Science-Virtual-Internship-Project

Data science Virtual internship (Job Simulation) program by British Airways...

16
Experimental
6444 naoland/advent20201220

Qiitaアドベントカレンダー用の記事

16
Experimental
6445 NadimSalameh/Text-Classification

In this project, we will build a text classification model on song lyrics....

16
Experimental
6446 tengjuilin/best-photo-spider

A web spider to scrap photo for Best Educational Organization (Best...

16
Experimental
6447 PierreMrt/amazon_sentiment_analysis

Sentiment analysis based on Amazon reviews - predicting negative and...

16
Experimental
6448 armneto/artist2wordcloud

Making nifty wordclouds and also getting banned from azlyrics

16
Experimental
6449 tducret/precisionmapper-python

Python package to communicate with precisionmapper.com

16
Experimental
6450 manjurulhoque/python-twitter-scraper

Twitter Scraper

16
Experimental
6451 GermanPaul12/Automated-Poetries-For-Each-Day-Via-Mail

Automated poetry/poems via e-mail through using python3 and github workflows

16
Experimental
6452 ArisPan/episode-shuffle

A Command Prompt and GUI application to randomly generate episodes from a...

16
Experimental
6453 Hrushi11/Yellow-pages-restaurants-api

This repository contains the code for scraping the yellow pages website to...

16
Experimental
6454 lsimek/chess-async-scrape

Custom-made asynchronous scraper and crawler for a chess website

16
Experimental
6455 Eric-Mendes/treinadores-serie-a

Estudo focado nas relações entre os técnicos da série A e os times, montando...

16
Experimental
6456 zaekyo/downloadify

Python script to download spotify playlists

16
Experimental
6457 Harshvardhan1999/The-Movie-Cinema

Content-Based Recommender System recommends movies similar to the movie user...

16
Experimental
6458 TotallyNotAHaxxer/Twitter-HELZZ

Twitter miner using the twint library

16
Experimental
6459 nerevu/hdxscraper-who

WHO Global Health Observatory Data Collector

16
Experimental
6460 naagaraa/hunterPHP

tools web scaraping untuk judul pada beberapa website ( google scholar,...

16
Experimental
6461 antonykamp/facebook-post-etl

An etl to extract facebook posts from an account, filter it and save it as txt files.

16
Experimental
6462 gnatykdm/webscrapper

A Python script to download files from a website recursively based on...

16
Experimental
6463 OAkyildiz/dataset_tools

An image scraper module to collect images with the given query.

16
Experimental
6464 afroll/parsing

Python parsing utilities and experiments

16
Experimental
6465 ashutosh139/Web-Scrapping

Scraping out useful and important data from various websites by using Python

16
Experimental
6466 sohaib-arafat/university-general-scraper

This repository houses a collection of web scrapers dedicated to extracting...

16
Experimental
6467 NotTheStallion/EVE-Online_deals_finder-web-scraping-

This repository will have different deal finders for EVE Online, offering...

16
Experimental
6468 MihirBindal/Data-analysis-on-pokemon-dataset

This repo incudes the code for pokemon data analysis

16
Experimental
6469 deniz-ozcan/ScrapApp

There are 2 websites in it. One of which is a comparison site where notebook...

16
Experimental
6470 kaushal07wick/FinSight

AI-powered analysis and vector search capabilities for JP Morgan Chase & Co....

16
Experimental
6471 NijatZeynalov/Opening-New-Restaurant-in-Baku

Opening a New Restaurant in Baku, Azerbaijan

16
Experimental
6472 openoakland/artmap

Code for a deployed Heroku app that scraped LocalWiki to provide info on...

16
Experimental
6473 mikolasan/yaplakal-scraper

Site scraping on django to display content with "better" design

16
Experimental
6474 DROMZEE/scraping

Multiples projets de scraping

16
Experimental
6475 devgioele/recursive-image-scraper

A web scraper that downloads images recursively

16
Experimental
6476 asamirr/Youtube-CSV-Data

Python scripts that retrieve a specific channel's data using Youtube Data...

16
Experimental
6477 Kizu-API/Covid19-Simple-Api

Simple scraping covid19 data, for fun and for learning purpose

16
Experimental
6478 bitan005/Soju-Scraper

Soju-Scraper is a webscraping program with Python to webscrape details and...

16
Experimental
6479 johnalbert-dot-py/JScrapeON

Web Scraping using JSON

16
Experimental
6480 SkyWors/BruteInfiniteCraft

A simple program to bruteforce InfiniteCraft's API

16
Experimental
6481 Fylipp/lotsoftext

📚 Download lots of text

16
Experimental
6482 mHasanMalik/Q-audio-downloader

This scrapper allows you to download last 26 mp3 files of all Qaris from...

16
Experimental
6483 charlesaraujo/node-ts-scrapper

A web scraping api for throne of glass characters

16
Experimental
6484 travisgk/jplookup

jplookup is a Python tool designed to look up Japanese words on Wiktionary...

16
Experimental
6485 dmitryplaunovs/unique-words-on-slack

Scraping and calculating the most distinguishing words of your teammates...

16
Experimental
6486 csirmaz/beautifulsoup_semantic_text

Replacement for BeautifulSoup's get_text() that takes into account...

16
Experimental
6487 DevanshDaxini/Sports-EV-Bot

Multi-sport prop betting engine. XGBoost models + FanDuel odds + PrizePicks...

16
Experimental
6488 joao-coimbra/web-scraping-receitas

web scraping for UNIP homework, teste em uma página web

16
Experimental
6489 helderberto/unsplash-scraper

🤖 Web scrapper for Unsplash with NodeJS

16
Experimental
6490 Piero24/PS5-avability-bot

A Telegram bot to detect when the PS5 is available in one of the italian...

16
Experimental
6491 PScoriae/PCPartsTool-Scraper

Node.js PC part data and pricing scraper for the PCPartsTool project

16
Experimental
6492 RLado/ActivityMirror

Mirror your work account's contribution graph in your personal profile

16
Experimental
6493 Radu-Raicea/Scraping-Scripts

Collection of personal scraping scripts

16
Experimental
6494 LeaoEduardo/job-keywords-extractor

Return ranked keywords of a job position using TF-IDF.

16
Experimental
6495 JothaM123/lynkscrapr

Lynkscrapr is a tool for scraping weblinks from websites.

16
Experimental
6496 MostaqueBillah/qs-ranking-university-2024-data-scraper

Data Analytics of QS World Ranking 2024

16
Experimental
6497 shambu09/novel-crawler

A novel reader(with crawling) application for windows, built using PyQt5.

16
Experimental
6498 shuyttr/FutureLearnCourseNetwork

📲 Web scrape of all courses offered by Future Learn, along with details...

16
Experimental
6499 metro-source/whois_ve

Programatically check .ve domains availability

16
Experimental
6500 willalveslima/Tech_Challenge_2

Projeto de pipeline B3 para o Tech Challnege Fase 2 da FIAP

16
Experimental
6501 deeraj44/NYC-Vegan-Restaurants

Scraped, analyzed, and cleaned restaurant datasets to extract business...

16
Experimental
6502 donghangwu/Real-Time-Stock-Price-Monitor

Web Scraping tool for Stock Prices, Visualized with Matplotlib animation

16
Experimental
6503 A-Ahmed-I/Scraping

Web scraping tools and techniques for data extraction.

16
Experimental
6504 CalJaDav/Yahoo-FX-Scraper

This is a simple script that will scrape recent daily exchange rate data...

16
Experimental
6505 kwven/immobot

multilingual WhatsApp chatbot designed to help users find real estate...

16
Experimental
6506 Ahmed101Mohammed/scraping-products

This project is a scraping project with python. to scrap JLood products.

16
Experimental
6507 searchs/in-few-steps

A collection of quick steps to start using a technology or application e.g....

16
Experimental
6508 8Altair/Quotes_web_scraping

This is a Python program that scrapes quotes from a website using...

16
Experimental
6509 charlesl46/lemonde

A python lib to access lemonde newspaper

16
Experimental
6510 ammar0xff/Mbedly

A Full-Featured Video Downloader Supports Many Sites And Makes A Video From...

16
Experimental
6511 nebipeker/Shopify-Data-Scraper

This repository contains a Python application for scraping data from Shopify...

16
Experimental
6512 themisAnagno/daily_wiki

Application that scrapes the Featured articles by Wikipedia and chooses one...

16
Experimental
6513 romangoempire/map-of-internet

Explore the connections of the internet and visualize them in Obsidian

16
Experimental
6514 VinayEdula/UmbrellaReminder

A Python package which scrapes weather data from google and sends umbrella...

16
Experimental
6515 Samuele1818/super-scraper

Web site scraper tool

16
Experimental
6516 bruno-leal/gmail-scraper

Tools to scrape data from Gmail mailbox.

16
Experimental
6517 eng-fayyadsalahat/SnapMultiMedia

A Desktop Application to Download Files , video from YouTube and Social...

16
Experimental
6518 Richard1984/infordat-scraper

Web Scraper per i dati storici sui ribassi.

16
Experimental
6519 docchipl/shinden-description

Prosty moduł do pobierania opis ze strony shinden

16
Experimental
6520 yaroslav-vorobyov/2ip.ru

Отлов текущего статуса IP с 2ip.ru для облегчения прохождения регистрации

16
Experimental
6521 SokKanaTorajd/flask-socmed-scraping

Flask Web App to scrape Instagram and Facebook in unofficial way.

16
Experimental
6522 Diggernaut/diggernaut-meta-lang-docs

Diggernaut meta language documentation

16
Experimental
6523 AlejandroGonzalR/sources-scraping-server

Node.js application that scrapes resources from a given website link.

16
Experimental
6524 0xPuddi/Gab-Aggregator

Aggregate from gab, to telegram, it has a semi-persistent db used cache seen...

16
Experimental
6525 jy02140251/html-to-markdown

Convert HTML to clean Markdown. Handles tables, code blocks, images. Perfect...

15
Experimental
6526 EAT-SSU/Food-Crawling

숭실대 학생식당, 도담식당, 기숙사식당 스크래퍼

15
Experimental
6527 piotrv1001/how-to-scrape-bloomberg-news-in-nodejs

Example: scrape Bloomberg category news using the Apify actor in Node.js

15
Experimental
6528 piotrv1001/how-to-scrape-fiverr-in-nodejs

Example showing how to scrape Fiverr listings in Node.js using the Apify actor

15
Experimental
6529 piotrv1001/olx-scraper-nodejs-example

Node.js example showing how to scrape OLX listings using the Apify OLX...

15
Experimental
6530 piotrv1001/how-to-scrape-we-work-remotely-nodejs

Node.js example showing how to scrape We Work Remotely job listings using...

15
Experimental
6531 mammadovziya/rss-gen

Generate customizable RSS feeds from any website. The ultimate feed...

15
Experimental
6532 AdarsHH30/FindCheap

Compare Price across multiple E-Commerce 🛒

15
Experimental
6533 Panda1847/keyhunter-framework

Hybrid web crawler and API key exposure detection framework for...

15
Experimental
6534 kevmongare/hisense-price-tracker

Live Hisense TV price comparison dashboard scraping Jumia & Kilimall Kenya...

15
Experimental
6535 NiviDevs/nptel-scraper

Webapp to determine NPTEL scores

15
Experimental
6536 david-lai-jpg/design-system-extractor-skill

Claude Code skill that extracts design systems from live websites. Uses...

15
Experimental
6537 caseyjkey/Python-Automation-Toolkit

Web scraping tools

15
Experimental
6538 shakeeb-sa/meta-scraper-react-js

Easily bulk scrape meta titles and descriptions from a list of URLs. Paste...

15
Experimental
6539 Hashaam101/google-maps-easy-scrape

Browser Extension to Scrape Google Maps Search results - Tailored for...

15
Experimental
6540 hyuntaepark-gh/JFK-Airport-Web-Scraping

Web scraping and analysis of JFK Airport flight data to explore airline and...

15
Experimental
6541 MESLEKDAA/go-web-scraper

A CTI reconnaissance tool that captures HTML source code and full-page...

15
Experimental
6542 alexisuaguilaru/WebScraping_CIAFactbook

Web scrapping of "The World Factbook" from CIA Website and data analysis of...

15
Experimental
6543 pranphy/ShabdaSankalak

इन्टरनेटबाट शब्दहरू खोजेर त्यसलाई सँगाल्ने काम

15
Experimental
6544 retea-se/pag

På G i Globenområdet

15
Experimental
6545 Vedant24v/job-alert-bot

Scrapes Internshala daily and sends new internship alerts to Telegram

15
Experimental
6546 Zebaro24/Zebaro24

🧑‍💻 Personal GitHub profile page with info, stats, and pinned projects....

15
Experimental
6547 hafidaso/Morocco-Tech-Job-Market-Tracker

A full-stack data intelligence platform that scrapes, analyzes, and...

15
Experimental
6548 bright-kr/Google-Maps-Scraper

최고의 Google Maps Scraper API로 리뷰, 평점, 사진 등 Google Maps データ를 추출합니다. 지금 무료 체험을 시작하세요!

15
Experimental
6549 BhushanLagare7/recall

Recall is an AI-powered knowledge base tool that helps you discover, import,...

15
Experimental
6550 KrishBharadwaj5678/InstaSnoop

InstaSnoop enables you to deep dive into Instagram profiles, offering a...

15
Experimental
6551 sourmilka/APIFlow

Real-time API discovery & analysis tool for any website. Captures REST...

15
Experimental
6552 gratedcheesefamilytoxotidae729/skool-map-scraper

Extract member locations and profiles from Skool community maps for easy...

15
Experimental
6553 alphoder/AxonPremium

AI-powered social media automation platform with lead hunting, AR product...

15
Experimental
6554 harshitcore/website-aware-chatbot

AI chatbot that interacts with websites using web scraping and ChatGPT API...

15
Experimental
6555 XiaoYiWeio/trend-tap

📡 Real-time trending topics aggregator — 7 platforms, zero API keys, zero...

15
Experimental
6556 Reeliks/radio.pnv.life

Source code of a radio station with my favorite music and brief breaking news.

15
Experimental
6557 takcy1z-cyber/flex-dev-tools

3 Python developer tools. Zero dependencies. Web Scraper, Site Monitor, API Builder.

15
Experimental
6558 QUZ22/Amazon-Mattress-Crawler

A professional-grade toolkit for Amazon market intelligence, featuring...

15
Experimental
6559 shakeeb-sa/guestbook-extractor-extension

A Chrome extension that automates scrolling through guest books, downloads...

15
Experimental
6560 ShxradJadhav/Assignment-Data-Engineering-Intern

End-to-end Data Engineering pipeline for job market intelligence using web...

15
Experimental
6561 spider-rs/spider-google-sheets

Google Sheets add-on for web scraping, AI extraction, and search powered by...

15
Experimental
6562 tahsinulmohsin/giggly-automation

A fully automated backend pipeline monitoring 8 e-commerce sources....

15
Experimental
6563 piotrv1001/ziprecruiter-scraper-nodejs-example

Node.js example showing how to scrape ZipRecruiter job listings using the...

15
Experimental
6564 itsanwar/proxy-scraper-ak

A fast and lightweight proxy scraper that collects free HTTP, HTTPS, SOCKS4,...

15
Experimental
6565 piotrv1001/how-to-scrape-company-career-pages-nodejs

Example showing how to scrape company career pages in Node.js using the...

15
Experimental
6566 piotrv1001/how-to-scrape-aliexpress-in-nodejs

Node.js example showing how to scrape AliExpress product listings using the...

15
Experimental
6567 piotrv1001/bbb-scraper-nodejs-example

Node.js example showing how to scrape BBB (Better Business Bureau) business...

15
Experimental
6568 YYoudi/veilleur-tesla

Un bot Python automatisé pour surveiller le site de véhicules d'occasion de Tesla

15
Experimental
6569 harshfolio/brand-logo-hunter

Automated brand logo collection system using AI-powered domain discovery and...

15
Experimental
6570 fchavonet/python-gshock_database

This project is an application designed to explore and make data about Casio...

15
Experimental
6571 PareekshithPalat/SCRAPPY-WebScrapper

A lightweight Python web scraper that extracts pickup lines from multiple...

15
Experimental
6572 sktsakibur25/Image-Classifier-for-Common-Fish-Species-of-Bangladesh

This project implements a deep learning-based image classifier to identify...

15
Experimental
6573 0xAdafang/Book_Scrap

scraping de livre issue de https://books.toscrape.com/index.html

15
Experimental
6574 0xheartcode/book2pdf

Create PDFs from online documentation

15
Experimental
6575 lxgicstudios/reddit-fetch

Reddit data extraction CLI. Posts, comments, users. JSON/CSV export.

15
Experimental
6576 sasikanth6076/Amazon-Web-Scrapper-Project-Using-Python

Python web scraping project to extract Amazon product details like title &...

15
Experimental
6577 SlashScreen/rate-your-genres

A musicbee plugin for automatically pulling album genres from rateyourmusic.com.

15
Experimental
6578 aleksa2105/stipendija-notifier

Automatski scraper koji prati stranice sa stipendijama i šalje mail kada se...

15
Experimental
6579 ddahon/workfromearth

Jobs directly from careers' pages of hand-curated remote first companies.

15
Experimental
6580 piotrv1001/how-to-scrape-just-join-it-nodejs

Example showing how to scrape Just Join IT job listings in Node.js using the...

15
Experimental
6581 piotrv1001/how-to-scrape-dice-com-jobs-in-nodejs

Node.js example showing how to scrape Dice.com job listings using the Apify...

15
Experimental
6582 RaizianOfficial/raizian-ai-lead-engine

💸 AI-powered lead engine that finds, qualifies, and delivers high-converting...

15
Experimental
6583 the-ai-entrepreneur-ai-hub/threads-scraper

Threads by Meta Scraper - Posts & Profiles, No Login. Scrape posts,...

15
Experimental
6584 piotrv1001/how-to-scrape-weibo-in-nodejs

Node.js example showing how to scrape Weibo posts using the Apify Weibo Scraper actor

15
Experimental
6585 4mbrus/Hungarian-News-Scrape

Repo for scraping popular hungarian news outlets

15
Experimental
6586 arixnetwork/ECSPY

ECSPY v2.0

15
Experimental
6587 Sohail-Basha/online-course-pricing-eda-analysis

Data analysis project exploring the relationship between online course...

15
Experimental
6588 Abn0rmality/FlowerSpace

a very detailed plant themed social media, onlineshop and weblog. WIP.

15
Experimental
6589 danyijia/LinkedIn-Job-Scrape

A fully automated, customizable job hunting bot that scrapes LinkedIn jobs,...

15
Experimental
6590 kireinashima/Booking.com-ETL-Analysis

Python-based data analysis project using web scraping and ETL techniques to...

15
Experimental
6591 Eli-Parker/UniversityOfUtahCalendarGenerator

A .NET program which scrapes calendar date info from the UoU's class...

15
Experimental
6592 piotrv1001/how-to-scrape-alibaba-listings-nodejs

Node.js example showing how to scrape Alibaba product listings using the...

15
Experimental
6593 piotrv1001/how-to-scrape-viator-in-nodejs

Node.js example showing how to scrape Viator tour listings using the Apify...

15
Experimental
6594 piotrv1001/how-to-find-linkedin-decision-makers-nodejs

Node.js example: find LinkedIn decision makers (CEO, CTO, VP) at target...

15
Experimental
6595 piotrv1001/cryptopanic-scraper-nodejs-example

Node.js example showing how to scrape CryptoPanic news using an Apify actor

15
Experimental
6596 piotrv1001/how-to-scrape-mercari-nodejs

How to scrape Mercari listings in Node.js using the Apify Mercari Listings...

15
Experimental
6597 onurerkoc-dev/seo-toolkit-platform

A professional Full-Stack SEO Analysis Platform providing actionable...

15
Experimental
6598 piotrv1001/clutch-scraper-nodejs-example

Node.js example: how to scrape Clutch.co listings using the Apify Clutch...

15
Experimental
6599 piotrv1001/how-to-scrape-linkedin-job-details-nodejs

Node.js example showing how to scrape LinkedIn job details using the Apify...

15
Experimental
6600 Fedia/bbb

Browser Bot Bookmarklet

15
Experimental
6601 remaldev/shaheen-proxy

smart reverse proxy that manages and routes internet traffic through...

15
Experimental
6602 JulWebana/alternance-data-engineer

Outil de veille automatique des offres d'alternance Data Engineer en France....

15
Experimental
6603 amorr42/tcdd-ticket-monitor

TCDD train ticket availability monitor with SMS notifications via Twilio

15
Experimental
6604 RcFarah/GolggWebScraper

Projeto criado para facilitar a remoção de dados necessários para meu...

15
Experimental
6605 piotrv1001/how-to-scrape-poshmark-listings-nodejs

Node.js example showing how to scrape Poshmark listings using the Apify...

15
Experimental
6606 Leenah-alborsh/gaza-aid-news-api-backend

A backend REST API built with Node.js and Express that scrapes Gaza...

15
Experimental
6607 HasData/tiktok-scraping

Collection of Python and Node.js scripts for scraping TikTok data, including...

15
Experimental
6608 crawlee-cloud/awesome-web-scraping

A curated list of web scraping tools, libraries, and resources.

15
Experimental
6609 MrCaar/GoogleMapsScraper

Google Maps işletme ve konum sayfalarındaki kullanıcı yorumlarını otomatik...

15
Experimental
6610 tobsol/price-tracker

A full-stack web application that tracks and monitors running shoe prices in...

15
Experimental
6611 Thordata/how-to-scrape-amazon-product-data-for-free

Free, hands-on guide to scraping Amazon product data with Python (requests +...

15
Experimental
6612 jbrunclik/kaktus-promo

Monitor for Kaktus mobile operator credit-doubling promotions

15
Experimental
6613 cupidthatbtc/web-crawler-aoty

LEGACY (needs fixes)

15
Experimental
6614 zzmlb/ai-news-bot

AI 资讯自动聚合系统 — 25+ 数据源、千问大模型智能过滤、钉钉推送、Web 仪表盘 & AI 助手,一键部署 | Automated AI...

15
Experimental
6615 oxylabs/news-scraping

A tutorial for scraping news

15
Experimental
6616 SheepTester-forks/webreg-data

UCSD course data scraped from WebReg

15
Experimental
6617 Desync-ai/desync_ai_tools_examples

Github for desync_search api that contains tools. Tools are most requested...

15
Experimental
6618 DoubleGhosty/DataVortex

DataVortex est un logiciel conçu pour automatiser le téléchargement et le...

15
Experimental
6619 tal7aouy/competitor-intel

🤖 Competitive Intelligence AI Agent

15
Experimental
6620 gandli/ciggies-crawler

Web crawler for ciggies.app — Extract Chinese tobacco product data and specifications

15
Experimental
6621 BottleNeck2021/Insta-BruteForce-with-ProxyScraper

A high-performance Instagram brute-force & proxy management suite with a...

15
Experimental
6622 WasamiKirua/mangadex-hydra

A Mangadex retrival and packaging system

15
Experimental
6623 CNSeniorious000/python-readability

Python wrapper for @mozilla/readability

15
Experimental
6624 MaximeGuinard/Autocomplete-Scraper

⭕ A scrapper that automatically completes forms.

15
Experimental
6625 OpenAnalystInc/10x-Research-Skill

Interactive content research, creation, web scraping, and AI image...

15
Experimental
6626 jinsoowhang/world-cup-tickets

FIFA 2026 World Cup ticket investment tracker

15
Experimental
6627 the-ai-entrepreneur-ai-hub/awesome-web-scraping-tools

A curated list of the best web scraping tools, APIs, and services for...

15
Experimental
6628 gromaxbro/Xyron-Lead-Finder

Lead finder tool that extracts business data (phone, email, website,...

15
Experimental
6629 ViralChameleon1/job_scraper_project

Python web scraping pipeline that extracts job listings using BeautifulSoup...

15
Experimental
6630 jtgrooms/Collegiate_Distance_Traveled_Time_Rested_Analysis

Understanding the Effects of Distance Traveled and Time Rested on College...

14
Experimental
6631 TsofnatMaman/PropertyMonitoringDashboard

A system for monitoring property inspection activity from LAHD, designed to...

14
Experimental
6632 kami4ka/willhaben-scraper

A Python scraper for willhaben.at Austrian marketplace using ScrapingAnt API

14
Experimental
6633 kami4ka/football-ticket-net-scraper

Python scraper for FootballTicketNet.com football match listings using...

14
Experimental
6634 gunnarr/stockholm-concerts

Live music and concert listings from 49 Stockholm venues. Scrapers → JSON →...

14
Experimental
6635 shuicici/stackoverflow-scraper

Extract Stack Overflow questions, answers, code snippets, tags, votes. Built...

14
Experimental
6636 the-ai-entrepreneur-ai-hub/google-maps-leads-scraper

Google Maps Lead Scraper - Extract Business Leads with Website Audit Score...

14
Experimental
6637 blordeus/ai-content-analyzer

Python pipeline that scrapes competitor blogs, analyzes content gaps, and...

14
Experimental
6638 iliya-ahmadi/car-price-tool

Simple car price extraction tool for Divar marketplace built with Python & Streamlit.

14
Experimental
6639 CodeBalch25/Download-Publications-fro-Pubmed-

Automated toolkit for searching, downloading, and analyzing research...

14
Experimental
6640 scrapellm/chatgpt-scraper

Scrape real ChatGPT UI responses at scale, including sources, citations, and...

14
Experimental
6641 FlowExtractAPI/universal-downloader

Download any type of file (videos, executables, images, PDFs, etc.) with...

14
Experimental
6642 korkinolegip/happypc-configurator

Fullstack веб-конфигуратор сборок ПК — автопарсинг цен, PDF-генерация КП,...

14
Experimental
6643 justincordova/cspathfinder

Find and compare the top Computer Science programs across US colleges.

14
Experimental
6644 armin-talic/Evolution-of-Mainstream-Music-Billboard-Hot-100

Tracking the evolution of mainstream music (1960-2025). This project scrapes...

14
Experimental
6645 elkingarcia11/lottery-data-scraper-gcp

A Python application that scrapes lottery data (Powerball and Mega...

14
Experimental
6646 osamuelvieira/crawler-seo-scraping

Crawler desenvolvido no formato de Webscraping para extrair informações...

14
Experimental
6647 tunnox-net/snapapi

📸 Free Screenshot, PDF, QR Code & Meta Extraction API. 10 free requests/day....

14
Experimental
6648 aycaaktas/Scrapy-data-extraction-pipeline

Containerized Scrapy data extraction pipeline that ingests JSON data,...

14
Experimental
6649 Traven-B/myasync

Ruby app lists checked-out and ready-hold books at multiple library...

14
Experimental
6650 lachezarat/ai-launch-monitor

Evidence-first FastAPI monitoring product for AI vendor changes with...

14
Experimental
6651 nsourlos/hugging_face_model_deployer

Automated agentic system built to automatically deploy models from...

14
Experimental
6652 OnurHaniffa/ivory-ai-showcase

Ivory AI — Full-stack AI-powered virtual receptionist SaaS for local businesses

14
Experimental
6653 utsapoddar/job_application_automation

Automated job application pipeline: scrapes job boards, tailors resumes with...

14
Experimental
6654 bora-7/tdk-12-kindle

Güncel Türkçe Sözlük'ün 12. baskısı, JSON ve MOBI formatında.

14
Experimental
6655 shaurya-ps/attendance-monitoring-system

A smart attendance monitoring system that helps students track attendance...

14
Experimental
6656 EnginKarahan/feed-scraper

Automatically detects articles on any webpage and generates RSS feeds...

14
Experimental
6657 shuicici/craigslist-scraper

Extract Craigslist classifieds, prices, locations, images. Built on Apify.

14
Experimental
6658 shuicici/instagram-scraper

Scrape Instagram posts, captions, hashtags, likes, follower counts. Built on Apify.

14
Experimental
6659 travis8artley/data-pipeline-v3

ETL pipeline repo for ingestion, transform validation, and load...

14
Experimental
6660 injectionmethod/Tsun

Web Crawler For Usernames, Idea Based Off Of Sherlock But Made In C#

14
Experimental
6661 redscarfx/Booking-com-Hotel-Analysis

Exploratory Data Analysis: Projet d'analyse des offres d’hébergement de...

14
Experimental
6662 aRmanNM/JobFinder

Search among famous Persian job sites

14
Experimental
6663 oxylabs/scraping-ecommerce-websites

A guide to scraping e-commerce websites by overcoming bot protection and CAPTCHAs.

14
Experimental
6664 mageri9/tarot_parser

Parser for collecting tarot card meanings (78 cards, upright and reversed)...

14
Experimental
6665 HashCitrine/scrap

Scrapping for my learning

14
Experimental
6666 duranalberto/MLScraper

Search new products and decrease prices in MercadoLibre, Amazon MX,...

14
Experimental
6667 Shelikeit69/Shit-Mountain

A masterpiece of chaotic Python scripts tracking Mizuno MIJ prices across...

14
Experimental
6668 khammonds530-max/climate-bias

Analyzing how political partisanship language and the degree of factual...

14
Experimental
6669 TylerLericos1202/HandsOn---AI-Matchmaking-for-Volunteers

An AI-Powered Matchmaking App for Volunteers

14
Experimental
6670 IgnazioDS/price-monitor

Multi-site e-commerce price monitoring with threshold alerts and CSV reporting

14
Experimental
6671 Turarr/Krisha.kz-Astana-Real-Estate-Dataset

📊 Dataset of real estate of city Astana, Kazakhstan📍 . It contains 5003 rows...

14
Experimental
6672 evomi/datacenter-proxies-instructions

Code Integrations for our Swiss Quality Datacenter Proxies in multiple...

14
Experimental
6673 An0n-00/nanoo

Nanoo TV download util

14
Experimental
6674 OliverPiano/extrateto

Expose and analyze Brazilian judiciary salaries exceeding constitutional...

14
Experimental
6675 biagio-scaglia/vinted-hunter

Multi-marketplace research and monitoring platform with visual OCR search,...

14
Experimental
6676 enesmertcetin/google-maps-scraper

RapidAPI-based Google Maps business listing scraper with grid scanning.

14
Experimental
6677 masiama/libri-crawler

Metadata engine for the Libri

14
Experimental
6678 lstcyr25/Book-Web-Scrapper-Python

Python web scraper that extracts book data from a website and stores it in a...

14
Experimental
6679 oguzcankaraman/GMapHunter

High-performance Google Maps scraper using Grid Search algorithm & Docker....

14
Experimental
6680 shuicici/news-scraper

Extract headlines, articles, sources, dates from major news outlets. Built on Apify.

14
Experimental
6681 ndcorder/firescraper

Tauri desktop app that turns URLs into clean markdown and JSON

14
Experimental
6682 Anjor99/Web_Novel_Scraper

Production-ready bot that scrapes web novels, generates PDFs, and delivers...

14
Experimental
6683 shuicici/g2-software-scraper

Scrape G2 software products, categories, pricing, ratings, reviews. Built on Apify.

14
Experimental
6684 MateuszBodek/car-data-analysis

A data scraping a data analysis project involving cars

14
Experimental
6685 vwkd/fielmann-scrape

Scrape products from Fielmann

14
Experimental
6686 AmaLS367/booking-offers-parser

Django-based scraper that collects padel court booking slots from multiple...

14
Experimental
6687 darkzOGx/open-sales-researcher

Autonomous AI-powered company research tool for B2B sales. Scrapes websites,...

14
Experimental
6688 bhargavichinnaparapu/job-listing-project

Job Listing Scraper is an end-to-end Python project that scrapes job...

14
Experimental
6689 YounesBensafia/DevJobsScraper

Tired of manually searching for remote developer jobs? This Python Discord...

14
Experimental
6690 RivkyHailbron/PropertyMonitoringDashboard

Automated Property Inspection Dashboard for APN 2654002037. Features...

14
Experimental
6691 the-ai-entrepreneur-ai-hub/telegram-channel-scraper

Telegram Channel Scraper - No API Key or Phone Needed. Scrape public...

14
Experimental
6692 Husnul66/AI-Powered-Daily-Briefing-Agent

Bulut üzerinde otonom çalışan, piyasa ve haber verilerini Gemini AI ile...

14
Experimental
6693 shuicici/indeed-job-scraper

Scrape Indeed job listings, salaries, company ratings, descriptions. Job...

14
Experimental
6694 chawarma/job-radar

🔍 Search Welcome to the Jungle & Tekkit job listings from your terminal —...

14
Experimental
6695 hiddenexee/News-Video-Bot

Automatically converts news pages into videos with audio.

14
Experimental
6696 khadinakbaronline/google-jobs-scraper

Scrape Google Jobs: titles, companies, salary ranges, and apply links.

14
Experimental
6697 drilon-halili/price-intelligence

Backend web application built with Flask for product price tracking, email...

14
Experimental
6698 lcshlr/ufc_prediction

Data pipelines and scripts to scrape UFC data over the last 20+ years to...

14
Experimental
6699 oniani1/E-Auction

Automated deal finder for eauction.ge — scrapes live government auctions,...

14
Experimental
6700 ojimpo/arigato-gateway

読書メーター・Filmarks のスクレイピングデータを受け取って保存・閲覧するミドルウェア API + 管理ダッシュボード

14
Experimental
6701 katto-1204/grabbr-extension

a fast chrome extension for students, researchers, and power users. it...

14
Experimental
6702 FO1ZZY/auto-poster

Brand-agnostic car poster generator using real automotive data

14
Experimental
6703 thintsing/image_scraper

这是一个专门针对论坛、网站的图片抓取工具,且专门优化用于处理需要代理访问的网站。项目基于实际的技术分析开发,经过验证可在目标网站上稳定工作。

14
Experimental
6704 MALathon/fetcharoo

A Python library for downloading PDF files from webpages with recursive...

14
Experimental
6705 TheBigGoat1/browser-extensions

Collection of Chrome extensions — Binance futures/spot trading (sub-250ms,...

14
Experimental
6706 mouryadipesh1606-oss/web-scraping-companies-python

Web scraping project using Python, BeautifulSoup, and Pandas to extract and...

14
Experimental
6707 BreakNoh/obinus

Coleção de scrapers para horarios de ônibus de Santa Catarina

14
Experimental
6708 Mampfinator/youtube.js

(heavily WIP!) All-in-one YouTube library.

14
Experimental
6709 dusterdiaeresis614/download-mode

Boot Samsung devices into Download Mode using a simple Python script...

14
Experimental
6710 handyautomatization-commits/hackathon-aggregator

Automated weekly digest of coding hackathons and bounties — ranked by prize,...

14
Experimental
6711 zcag/pissedconsumer-scraper

Apify actor to scrape reviews, ratings, and company data from PissedConsumer.com

14
Experimental
6712 SayantanML-IO/civic-notifier

Automated Python tool that monitors government portals for...

14
Experimental
6713 krystxf/scraping-starterpack

Yoink

14
Experimental
6714 sohan-shingade/jobslop

Job board aggregator for VC-backed startups. 12,800+ jobs from 35+ venture...

14
Experimental
6715 Vermaarp/Image-grabber-Chrome-extension

Lightweight Chrome extension to quickly extract, preview, filter, and...

14
Experimental
6716 chandansaipavanpadala/OmniMind-TheIntelligentSecondBrain

OmniMind is a Gemini 2.5 powered "Second Brain" that uses a universal...

14
Experimental
6717 Flavioce1/PY4E

Python for Everybody — Coursera Specialization exercises and solutions

14
Experimental
6718 PareekshithPalat/Youtube_Metadata_scrapper

Extract and download detailed metadata from any YouTube Shorts channel with...

14
Experimental
6719 zcag/capterra-scraper

Apify Actor: Extract Capterra software reviews, ratings, pros/cons,...

14
Experimental
6720 karthik-com/100-Days-of-Code-The-Complete-Python-Pro-Bootcamp

This repo consists the daily coding challenges and projects from "100 Days...

14
Experimental
6721 pikachu140233/wechat-export

????????????? - Export WeChat Official Account articles to Markdown/HTML/PDF...

14
Experimental
6722 ThomasCleary02/book-scraper-for-amazon

Amazon product data scraper using Python and BeautifulSoup.

14
Experimental
6723 matovu-farid/scrap-platform

Scrap Platform is an AI-powered web scraping dashboard built using Next.js...

14
Experimental
6724 Oleksii-Moloiko/books-scraper

Scrapes books.toscrape.com, saves data to SQLite with SQLAlchemy, generates...

14
Experimental
6725 artemleonich/Parser-prices

Price monitoring & alert service for Wildberries, Ozon & Yandex Market with...

14
Experimental
6726 itsnehakv/Python-Coding-Bootcamp

A collection of Python exercises and projects documenting my learning...

14
Experimental
6727 the-ai-entrepreneur-ai-hub/full-sanctions-screener

Global Sanctions Screener API - Screen entities against OFAC, EU, UN & UK...

14
Experimental
6728 agoutsmedt/central_bank_database

Project to collect documents published by central banks and to clean this...

14
Experimental
6729 dmitrii-gliuz/lpzg-bot

Telegram bot that scrapes Leipzig event listings and posts weekly...

14
Experimental
6730 Fontihate/SpotiClean-Music-Bot

Herramienta de automatización musical para Telegram. Extrae metadatos de...

14
Experimental
6731 Dat0s/restaurace-menu-reporyje

Aktuální polední menu restaurací v Řeporyjích — automatický scraping každých 15 minut

14
Experimental
6732 Sidali-Djeghbal/udemiha

Old project, for now probably you should update APIs usages

14
Experimental
6733 welchs1423/Dev-Dashboard

Dev Dashboard - Junior Developer Job Curation & Tech Trend Tracker

14
Experimental
6734 danisc23/padel-tavernes

A padel court search engine supporting multiple platforms, including Webs de...

14
Experimental
6735 KaveenDK/SnekSquad-VHN-Readmission-Analytics

Strategic Patient Risk Stratification & Predictive Modeling system for...

14
Experimental
6736 shuicici/zillow-house-scraper

Scrape Zillow property listings, prices, beds/baths, sqft, Zestimate. Built on Apify.

14
Experimental
6737 oxylabs/asynchronous-web-scraping-python

A comparison of asynchronous and synchronous web scraping methods with...

14
Experimental
6738 ahmedrana24/Crypto-Analytics-Engine

An end-to-end Python pipeline for scraping historical cryptocurrency data...

14
Experimental
6739 shuicici/tripadvisor-scraper

Extract TripAdvisor restaurants, hotels, attractions, reviews, ratings....

14
Experimental
6740 Garridot/football_players_web_sraping

Automated ETL pipeline that extracts player statistics from Transfermarkt,...

14
Experimental
6741 wahhabriaz/hn-scraper-pro

A production-grade async web scraper for Hacker News — featuring rate...

14
Experimental
6742 rakin406/gitro

Gitro lets you check the most maintained GitHub repositories

14
Experimental
6743 CassianoE/siphon-cli

CLI tool that reverse-engineers API flows from browser traffic and generates...

14
Experimental
6744 zcag/sitejabber-scraper

Apify Actor: Extract reviews, ratings, and company data from SiteJabber/SmartCustomer

14
Experimental
6745 M-tech-cmd/PriSync

Smart e-commerce price tracking & product monitoring app built with Next.js...

14
Experimental
6746 AnujShah06/steep-wisdom

Graph-based tea discovery tool — 140 teas from 11 brands, scraped and...

14
Experimental
6747 flavioro/job_scraper_ia

Pipeline local em Python para coletar vagas via URLs, fazer web scraping...

14
Experimental
6748 shuicici/google-maps-scraper

Extract Google Maps business listings, reviews, ratings, phone, address,...

14
Experimental
6749 ghostdog-dev/film-reviews

Agregateur d'avis de films — Scraping, Django

14
Experimental
6750 kduvur100/Baltimore_Sports_Scraper

Real-time Baltimore Orioles & Ravens news aggregator — Go + SvelteKit +...

14
Experimental
6751 rahuldangeofficial/10-worldupdate-CLI

A CLI tool that crawls 20+ tech sources (HN, Reddit, GitHub) and uses GPT-4o...

14
Experimental
6752 jungtaeinn/shopshot

Chrome extension that extracts product images from any shopping site and...

14
Experimental
6753 danywaked/TrackingTool

A CLI project that provides shipment tracking data via the DB Schenker...

14
Experimental
6754 dlasley/table-mutation-tracker

Automated data change detection for ephemeral website data tables....

14
Experimental
6755 shuicici/reddit-scraper

Extract Reddit posts, comments, upvotes, and subreddit trends as clean JSON....

14
Experimental
6756 the-ai-entrepreneur-ai-hub/indeed-job-scraper

Indeed Job Scraper - Extract job listings, salaries & company data from Indeed.com

14
Experimental
6757 Gunkev/seo-competitor-analysis-scraper

A prodcution-ready Apify scraper that extracts, normalizes, and compares...

14
Experimental
6758 opauloobruuno/Agro_Mercantil

Este é um projeto que coleta, trata e analisa preços agropecuários...

14
Experimental
6759 jjf2009/InvestorFinder

A free, automated weekly scraper that collects Indian startup funding data...

14
Experimental
6760 AmirHBuilds/some-scripts

Scripts written by me to automate small tasks. Different practice codes and...

14
Experimental
6761 shuicici/linkedin-scraper

Scrape LinkedIn profiles, job titles, companies, skills, connections. B2B...

14
Experimental
6762 RazorKenway/Email-Scraper-Pro

Advanced Chrome extension for extracting, cleaning, and validating email...

14
Experimental
6763 realsamer/motqdmon-news-nodejs

Backend Node.js REST API that scrapes Gaza aid updates from Motqdmon...

14
Experimental
6764 mauricioffdev/java-ans-etl-pipeline

Pipeline de ETL completo em Java 25: Web Scraping (ANS), Enriquecimento de...

14
Experimental
6765 chanuthdewhan/clinical-risk-stratification

Data-driven hospital readmission risk stratification using Python to reduce...

14
Experimental
6766 KrishnaD2911/GSTN-Verification

GST Verification API & Web Interface built with Node.js and Express. Fetches...

14
Experimental
6767 atharvajoshi01/linkedin-profile-collector

Chrome extension that collects LinkedIn candidate information from profile pages

14
Experimental
6768 driversti/erepublik-profiler

eRepublik citizen profile scanner and analytics dashboard

14
Experimental
6769 genusexaeretodonspellingbee638/seo-toolkit-platform

Analyze SEO data with one platform for WHOIS, meta tags, robots.txt,...

14
Experimental
6770 paezdavid/agregador-noticias

Sitio web donde se recopilan las noticias más importantes del día, extraídas...

14
Experimental
6771 Gylmynnn/world-news

world-news scraping , learning go

14
Experimental
6772 onlynayan/vocab-mnemonics-pro

🚀 The Complete Vocabulary Toolkit for GRE, GMAT, IBA. 🧠 Mnemonics: Smart...

14
Experimental
6773 shuicici/youtube-scraper

Extract YouTube video metadata, thumbnails, views, comments, channel info....

14
Experimental
6774 Himanshu-Laddhad/bestbuy-review-scraper

Scrapes paginated customer reviews from Best Buy product pages using...

14
Experimental
6775 Rhodri-Morgan/faa-atc-extractor

Extractor for FAA ATC staffing dataset

14
Experimental
6776 roegzychux/Python-Web-Scraper-Amazon-Item-Price-Tracker-Email-Notifier

Automated Amazon price tracker using Python and BeautifulSoup. Scrapes...

14
Experimental
6777 ScraperHub/costco-scrapers

Costco.com Search Listings and Product Pages Scrapers. To handle JS...

14
Experimental
6778 DA-Shravan/MY-PROJECTS

Aspiring Data Analyst | End-to-end projects featuring Web Scraping, Data...

14
Experimental
6779 Lucasoil1234799/online-course-pricing-eda-analysis

Analyze online course pricing to assess its impact on ratings, reviews, and...

14
Experimental
6780 matheusbbritto/cs2-match-prediction

Machine Learning project to predict Counter-Strike 2 (CS2) match outcomes...

14
Experimental
6781 SerhatKaraman0/teknokent-scraper

This project created for scraping company names, their descriptions and...

14
Experimental
6782 sasikanth6076/Web-Scrapping-Project-using-Python

Python web scraping project to extract largest US companies data from...

14
Experimental
6783 shuicici/xiaohongshu-scraper

Extract Xiaohongshu (RED) posts, likes, comments, KOL data. China social...

14
Experimental
6784 mn-cs/data-science-analysis-projects

Stock and revenue analysis of Tesla and GameStop using Python, data...

14
Experimental
6785 itsoutlawz/DD-Master-Bot

DamaDam Master Bot - Professional Web Scraper

14
Experimental
6786 izzdataflow/python-api-automation

Automated cryptocurrency price tracker using CoinMarketCap API — fetches,...

14
Experimental
6787 Bahm9919/pinterest-board-scraper

Download complete Pinterest boards with all pins, images, descriptions, and...

14
Experimental
6788 sous4sec/DeepSocial

DeepSocial is a Python tool for researching user profiles across various...

14
Experimental
6789 1010sb/webScraping_Weather

The project is a web scraping and data visualization application for...

14
Experimental
6790 hencollins/lyst-index

👚 Lyst index fashion label rankings (EDA, data viz, web scraping)

14
Experimental
6791 ventz/scrape-website

Incredibly High Performant web scraper (seconds for what takes others lots...

14
Experimental
6792 raushan-yadav/wikipedia-company-web-scraper

Python web scraping project that extracts tables of the largest U.S....

14
Experimental
6793 MihrimatriX/Custom-Folder-Creator

A comprehensive JavaFX desktop application that simplifies file management,...

14
Experimental
6794 bryantegar/bisnis-crawler

Production-ready news crawler with retry logic, structured logging, and...

14
Experimental
6795 barbara-wachek/iPBL_manual_works_analysis

Skrypty utworzone w ramach projektu „Bibliografia polskiej internetowej...

14
Experimental
6796 mattiaveroniunibo/Ai-driven-web-data-extraction-system

AI-driven microservices system for automated web data extraction and processing

14
Experimental
6797 csteves1/nfl-qb-webscraping-3d-viz

Live NFL.com web scraping + 3D visualization using Python, BeautifulSoup,...

14
Experimental
6798 maxpdr96/hidari-novel

Uma ferramenta CLI robusta em Java (Spring Boot) para buscar, extrair e...

14
Experimental
6799 Toriefaithful525/StealthyWMIExec.py

Execute commands remotely on Windows systems via WMI with a diskless,...

14
Experimental
6800 the-ai-entrepreneur-ai-hub/bluesky-scraper

Bluesky Scraper - Extract posts, profiles & search data from bsky.app using...

14
Experimental
6801 ilhamsj/BundleBee

A Chrome extension that allows users to extract, preview, filter, view, and...

14
Experimental
6802 Alec-Aoki/OOP

Object Oriented Programming

14
Experimental
6803 alisster00/animeflv-downloader

Script en Python para extraer enlaces de descarga desde AnimeFLV y descargar...

14
Experimental
6804 feileberlin/krawl.ist

krawl | Events bis Sonnenaufgang

14
Experimental
6805 MukundaKatta/ScrapeMate

Smart web scraping toolkit — structured HTML extraction with CSS selectors,...

14
Experimental
6806 Nakoliss/app-idea-hunter

Automatically mine complaints from Reddit and Google Play reviews, filter...

14
Experimental
6807 evomi/mobile-proxies-instructions

Code Integrations for our Swiss Quality Mobile Proxies in multiple...

14
Experimental
6808 Devashish-Pisal/multi-source-job-aggregator

Python-based job aggregator that integrates multiple APIs (Arbeitsamt,...

14
Experimental
6809 sleep2agi/ai-trending-tracker

AI industry trending tracker — automated Twitter/X monitoring for AI news...

14
Experimental
6810 zcag/trustpilot-scraper

Apify Actor: Extract reviews, ratings, and company data from Trustpilot

14
Experimental
6811 shuicici/weather-scraper

Get current weather, 7-day forecast, severe alerts for any city. Built on...

14
Experimental
6812 the-ai-entrepreneur-ai-hub/ai-deepfake-detector

AI Deepfake & Image Detector API - Detect AI-generated images using 12...

14
Experimental
6813 matimatech/HotelOps

Platform end-to-end data engineering yang mengotomatisasi pengumpulan,...

14
Experimental
6814 DeepakSinghRajputC/AI-Powered-Funding-Intelligence

This is a sample working prototype for screening round for humanAI project...

14
Experimental
6815 shuicici/amazon-product-scraper

Extract Amazon product listings, prices, ratings, reviews, ASINs as clean...

14
Experimental
6816 omkarcloud/expedia-scraper

Search airports, compare one-way flights, and get real-time fares with full...

14
Experimental
6817 pdrhenrick/technews-scraper

Crawler de Engenharia de Dados que extrai notícias de tecnologia, trata as...

13
Experimental
6818 bijay085/Bijay-Protfolio

Personal portfolio website with interactive terminal, GitHub stats...

13
Experimental
6819 danir-pye/tiktok-account-generator-pro

Powerful TikTok account creator using full mobile API, captcha solver, and...

13
Experimental
6820 oscargala/nh-legislature-accessibility

A Node.js scraper making NH legislative hearing schedules more accessible....

13
Experimental
6821 rajshekharbind/ML-WEB-SCRIPTING-DATA

A beginner-friendly project that demonstrates web scraping, data cleaning,...

13
Experimental
6822 leoncvlt/bidbybid

💸 Python tool which scrapes sold eBay auctions for minimum, maximum and...

13
Experimental
6823 tara-nguyen/english-premier-league-random-forest-analysis

Random forest analysis of match statistics and team performances in five...

13
Experimental
6824 bharathguntreddi3/Web_Scraper_Tutor

This repo basically contains details on how to work with WEB SCRAPER and...

13
Experimental
6825 alexiscolin/awwwards-notion-scraping

🏆 Web Scrapping from Awwwards to Notion

13
Experimental
6826 willwillems/wtchr

Open-source privacy focused show downloader & tracker.

13
Experimental
6827 FirasKahlaoui/web-scraping-lvl1

The "web-scraping-lvl1" project is a beginner-level exercise in web scraping...

13
Experimental
6828 mbilvl/web-crawler-c

A lightweight and fast web crawler written in C that extracts all internal...

13
Experimental
6829 BenSFGamer/B.I.O.S.

A biographer

13
Experimental
6830 fgrehm/covid19br-pub

Projeto de monitoramento de publicações oficiais relacionadas a COVID-19 no Brasil.

13
Experimental
6831 ReactorcoreGames/Web-Link-Collector-1000

Lightweight tool for automatically collecting and exporting all links from a...

13
Experimental
6832 mohamadesmaeilii28-hub/divar-telegram-bot

A Python-based Telegram bot that fetches and displays real-time listings...

13
Experimental
6833 samiyaMalik/SmartWebScraper_Python

A Python-based intelligent web scraping tool built with BeautifulSoup and...

13
Experimental
6834 rifatsh3ikh/InstantGallery-Image-Downloader

A Python tool that extracts and downloads all images from a given gallery or...

13
Experimental
6835 plhnnathan/PyMotors-OLX

An intelligent vehicle scout tool that scrapes OLX listings, integrates with...

13
Experimental
6836 ItsMyEyes/scrapping-berita-nodejs

Scraping News is a powerful scrapping news indonesia

13
Experimental
6837 pa-paget/Jeux_Olympiques_Data_Analysis

Ma vision pour l'analyse des JO : piloter une exploration...

13
Experimental
6838 bright-data-de/web-unlocker-api

Web Unlocker ist eine leistungsstarke Scraping API, die hochentwickelte...

13
Experimental
6839 Vaisakh-Nirupam/Python_Async_Scrapper

Improved async version of an earlier Python web scraper, rebuilt with...

13
Experimental
6840 shyndman/package-watch

WXT + Vue extension that scrapes Amazon and AliExpress orders and notifies...

13
Experimental
6841 kami4ka/RedfinScraper

Python scraper for Redfin.com rental listings using ScrapingAnt API....

13
Experimental
6842 iklobato/shodan_rtsp

Camera search using python shodan engine

13
Experimental
6843 VK-Venkatesh/mobiles-discount-prediction-streamlit

Mobile Discount Price Prediction using ML model (Predictive Modeling)...

13
Experimental
6844 service-dept/bandwidth

Bandwidth is a text-based aggregator for non-profit and open-source news. No...

13
Experimental
6845 cheesenca/fashion-etl-pipeline

Simple ETL pipeline built using Python which performs web scraping to...

13
Experimental
6846 oxylabs/python-syntax-errors

A practical guide to reading Python syntax errors and fixing them.

13
Experimental
6847 danielilievskii/wordpress-media-scraper

Scraper for WordPress news and media sites - part of the Vezilka project.

13
Experimental
6848 D-Luan/teste_intuitive_care

Solução Full Stack para o Desafio Técnico da Intuitive Care. Pipeline ETL de...

13
Experimental
6849 MoShahan/kerala-gold-rate-tg-bot

🪙 Automated Telegram bot that scrapes daily 18K & 22K gold rates in Kerala...

13
Experimental
6850 HasData/captcha-solver-benchmark

Performance benchmark of top 5 CAPTCHA solving services: 2Captcha,...

13
Experimental
6851 sergiokutspires/global-banks-etl-pipeline

End-to-end Python ETL pipeline scraping and processing global bank market...

13
Experimental
6852 guepardlover77/chercher_voiture

Bot Telegram de surveillance d'annonces voitures sur Leboncoin avec scoring...

13
Experimental
6853 jansim/WG-SuchR

Eine R/Shiny App um Daten von der Website WG-Gesucht zu scrapen und...

13
Experimental
6854 jackshee/real-estate-industry-project-public-version

This is a clone of an archived private repository containing an ETL data...

13
Experimental
6855 bonniesimon/Flipkart-Price-Tracker

A web-scraping project using cheerio and axios in nodejs :yellow_heart: .

13
Experimental
6856 bright-kr/bright-data-web-unlocker-nodejs-project

Bright Data Web Unlocker Nodejs 보일러플레이트 코드

13
Experimental
6857 enzoofs/prospector

B2B lead prospecting pipeline — Google Maps scraping, lead scoring (0-100),...

13
Experimental
6858 syunend-create/keiba-ai

Horse racing prediction AI using machine learning and historical race data

13
Experimental
6859 Lulzx/coldpipe

Cold outreach pipeline — scrape, enrich, validate, send, track

13
Experimental
6860 kalpanajoycedovari/scamscan

A Python data pipeline that scrapes online course listings, detects scam...

13
Experimental
6861 kami4ka/ByOwnerScraper

Python scraper for ByOwner.com rental listings using ScrapingAnt API....

13
Experimental
6862 07fahim/EmailCraft-AI

AI-powered B2B cold email generator with automated lead sourcing, quality...

13
Experimental
6863 wanerllubbse/zillow-search-scraper-all-in-one-pay-per-results

zillow data extraction scraper

13
Experimental
6864 kirtanpatel01/krapper

A scraping platform for jobs

13
Experimental
6865 deniserosales/mercado-consumo-canino-oaxaca

Análisis del mercado de consumo canino en Oaxaca, enfocado en patrones de...

13
Experimental
6866 wojtekdomino/ucl-winners-streamlit

Streamlit app that checks if a football club has ever won the UEFA Champions...

13
Experimental
6867 sbsonusunil/Blackcoffer_nlp_analysis

This project focuses on building an automated NLP pipeline that extracts...

13
Experimental
6868 m15kh/Web_Scraping

A collection of Python scripts for web scraping using Beautiful Soup,...

13
Experimental
6869 lengoctam449-cloud/backlink-crawler

Backlink crawler for web data

13
Experimental
6870 oxylabs/parse-html-pyquery

Learn to parse HTML using PyQuery, a Python library for web scraping and...

13
Experimental
6871 ShreeKudande/AI-ML-Learnings

🚀 My code archive for Data Science & ML. Stack includes: Python, SQL, NumPy,...

13
Experimental
6872 vwkd/shore-scrape

Scrape available slots from Shore

13
Experimental
6873 PauloWgDev/TwitterPathfinder

On this project we create a twitter network using mentions found on tweets.

13
Experimental
6874 bright-kr/Scraping-Proxies

Webスクレイピング을 위한 100M 이상의 プロキシ를 보유한 Bright Data는 전 세계 20,000명 이상의 고객에게 서비스를...

13
Experimental
6875 is-leeroy-jenkins/Koolaid

Koolaid is a WPF-based web crawler written in C-Sharp.

13
Experimental
6876 meet447/dokusha

Dokusha is a versatile manga and webtoon reader crafted with React Native,...

13
Experimental
6877 daren6666/Python-Data-Projects-Archive

This repository is a collection of Python projects developed during my...

13
Experimental
6878 pradyten/web-scraping-projects

Collection of web scraping projects for Amazon product reviews. Data...

13
Experimental
6879 omar-elmaria/python_scrapy_airflow_pipeline

This repo contains a full-fledged Python-based script that scrapes a...

13
Experimental
6880 chrisjm66/search-crawler

Custom-written search crawlers designed to compare efficiency of different...

13
Experimental
6881 sanket143/Hi

A Programming language for Web Scraping

13
Experimental
6882 ujeebu/ujeebu-go

Go SDK for the Ujeebu web scraping and content extraction API with full...

13
Experimental
6883 oxylabs/web-scraping-r

A tutorial for web scraping with R

13
Experimental
6884 aymane-maghouti/Youtube-data-pipeline

The project aims to automate the extraction of data from a YouTube channel,...

13
Experimental
6885 Traven-B/gomodern

Go app lists checked-out and ready-hold books at multiple library websites....

13
Experimental
6886 redouane1992/printscout

TeePublic product research tool that detects high-potential designs using...

13
Experimental
6887 acuciureanu/spidertrap-rs

A simple trap for web crawlers

13
Experimental
6888 Luigina2001/StartupScoutingAI

Pipeline automatizzata per la ricerca di acceleratori in Europa e l'analisi...

13
Experimental
6889 erogluegemen/ResearchRover

The research paper scrape bot is designed to help researchers and students...

13
Experimental
6890 akasgj007/image-downloader-extension

Chrome extension that extracts, previews, and downloads images from webpages.

13
Experimental
6891 Bhuvneshn/School-Timetable-Fetcher

A discord bot to fetch my school timetable

13
Experimental
6892 tommasofacchin/polytype-trainer

Polytype Trainer is a lightweight browser app built with plain HTML, CSS and...

13
Experimental
6893 IPFoxy/proxy-for-web-scraping

Practical guides and examples for using residential proxies

13
Experimental
6894 davytheprogrammer/Scrapper

Powerful Web scrapper that saved the data scrapped from a website to Pdf

13
Experimental
6895 Jeffrey0117/Nextjs-ptt-beauty

🎨 PTT Beauty Board Crawler - Automated image and metadata scraper for PTT...

13
Experimental
6896 bright-kr/ISP-Proxies

シームレスでコンプライアンスに準拠したWebスクレイピングのために、700K+のスタティックレジデンシャルIPを備えた信頼性の高い高速ISPプロキシです。...

13
Experimental
6897 bright-data-de/jupyter-notebooks-web-scraping

Führen Sie Web-Scraping interaktiv mit Jupyter Notebooks durch, indem Sie...

13
Experimental
6898 bright-data-de/Zillow-dataset-samples

Ein Beispiel-Datensatz mit über 1000 Zillow-Listings, extrahiert mithilfe...

13
Experimental
6899 osredgar/ExportarDadosTabelaCSV

Exemplo de como gerar um arquivo CSV a partir de uma tabela do site

13
Experimental
6900 kami4ka/AutoScout24Scraper

Python scraper for AutoScout24 car marketplace powered by ScrapingAnt API

13
Experimental
6901 oxylabs/best-buy-price-tracker

A tutorial for building a scalable price tracker with Python and Oxylabs...

13
Experimental
6902 B3zaleel/MangaDownloader

A Windows application for downloading manga.

13
Experimental
6903 bright-kr/Datacenter-Proxies

シームレスで高速なWebスクレイピングを実現する、770K以上のIPを備えた信頼性の高い高性能なデータセンタープロキシです。無料でお試しください!

13
Experimental
6904 sachs7/Youtube-Bot-

Get Pycon video links and basic stats

13
Experimental
6905 NaufalK25/gamiverse-bot

Gamiverse is a bot that can get player stats from various games and display...

13
Experimental
6906 mihneadumi/Python-Web-Scraper

An adaptive Python Web Scraper App to catch the best deals by scraping and...

13
Experimental
6907 FlowExtractAPI/linkedin-ads-scraper

🔍 Extract comprehensive LinkedIn ads data from the Ad Library. Get ad...

13
Experimental
6908 Shravanch19/Google-Maps_Service-Sector_Analysis

This repository contains an end-to-end data analytics project focused on...

13
Experimental
6909 baderGorchene/y-r_ocr

freelance project for Y&R

13
Experimental
6910 ArmelVidali/derja_ninja_scraper

Get Tunisian translation, audio and sample sentence for the most common...

13
Experimental
6911 willyChairullah/PPW

Repository untuk pembelajaran Mata Kuliah Pencarian dan Penambangan Web

13
Experimental
6912 mtsfy/deadlinks

Dead Links Scraping CLI Tool

13
Experimental
6913 anatolykoptev/go-threads

Threads (threads.net) scraping module — public GraphQL API, LSD token auth,...

13
Experimental
6914 vtu-datatools/rrchackathon

Real Rent Control Hackathon - Vancouver - Project

13
Experimental
6915 Arthur-destb38/MoSEF_API_AnalyseSentiment_VF

Groupe : Arthur DESTRIBATS, Niama EL KAMAL, Matéo MARTIN. Dernière version...

13
Experimental
6916 sergio20041/reddit-sentiment-tracker

CLI tool that scores Reddit post and comment sentiment using VADER NLP + SQLite

13
Experimental
6917 gabe-frasz/fr.what

My personal whealth assitant using Termux.

13
Experimental
6918 Shirouky/lab2-Data-analysis

Парсинг интернет-магазина бисера на Python. Сбор данных товаров, сохранение...

13
Experimental
6919 ayamekni/JobNest-App

JobNest: A web application that connects IT professionals and students to...

13
Experimental
6920 K31NER/ScrapyJob-Insight

Agente de IA especializado en el análisis del mercado laboral. Extrae...

13
Experimental
6921 HasData/auto-ecommerce-scraper

Universal e-commerce web scraper with automatic platform detection...

13
Experimental
6922 team-spark-code/redfin_scrap_api

Redfin 뉴스 데이터 수집기 차세대 버전. 성능 및 아키텍처 개선

13
Experimental
6923 theekify/Ecommerce-Scraper

A Python web scraper that extracts data from e-commerce sites, directories,...

13
Experimental
6924 bright-data-de/Datacenter-Proxies

Zuverlässige, leistungsstarke Rechenzentrums-Proxies mit 770K+ IPs für...

13
Experimental
6925 gugli28/youtube_scrapper

downloads video from youtueb using just a click

13
Experimental
6926 abhirxp/amazon-price-monitor

A Python automation tool that tracks Amazon prices and logs history to CSV.

13
Experimental
6927 vuphan121/personal-data-pipeline

Modular personal data pipelines orchestrated with Dagster

13
Experimental
6928 DrTinkle/ai-lead-enrichment

AI-driven lead enrichment engine with structured analysis, caching, and...

13
Experimental
6929 Ibraah-analyst/Project-1-Web-Scraping-Intelligence

An autonomous, dual-layer e-commerce intelligence engine that extracts...

13
Experimental
6930 Derek-G1/wayback-batch-archiver

A high-fidelity batch archiving tool for the Internet Archive's Wayback...

13
Experimental
6931 vimscientist69/atlastradingonlinescraper

Scrape product data from atlastradingonline.com and saves it to a CSV file.

13
Experimental
6932 DemirSacirovic/serbian-estate-intelligence

Real estate data platform for Serbian market

13
Experimental
6933 stargate91/fiverr-gig-data-scaper

Simple Python web scraper using BeautifulSoup to extract gig metadata,...

13
Experimental
6934 rin4096/bandori-cards

🎀 A robust BanG Dream! card fetcher for OpenClaw. Features real-time HTML...

13
Experimental
6935 Deepak-J0shi/SEO-Interlinking-Tool

An automated SEO internal linking tool that crawls a domain, extracts...

13
Experimental
6936 AnastasiiaDesiateryk/enricherDescriptionSSC

Streamlit-based tool for enriching company descriptions from websites with...

13
Experimental
6937 EasWay/Data-Extraction

Automated data extraction tool for Ghana Revenue Authority. Scrapes and...

13
Experimental
6938 goddivor/linkedlead-ext

Chrome/Firefox browser extension for extracting LinkedIn profile data

13
Experimental
6939 XxTavo16xX/News-Extracter

This project is meant to be used to fetch text content from Websites posts...

13
Experimental
6940 adityajain-hub/marketplace-negotiator-extension

🤖 AI Negotiator for Facebook Marketplace. Automatically scrapes listings and...

13
Experimental
6941 PRAKASH-REDDY33841/wiki-quiz-app

AI-powered Wiki Quiz Generator built with FastAPI, React, and PostgreSQL.

13
Experimental
6942 maheshshinde9100/ScrapeHire

A full-stack job board application that scrapes remote jobs from RemoteOK...

13
Experimental
6943 jjshay/artsy-extension

Chrome extension for scraping artwork listings from Artsy.net

13
Experimental
6944 wfgsss/yiwugo-scraper-example

Example code for using the Yiwugo.com Scraper on Apify

13
Experimental
6945 Annyfee/spider-defense-bypass

精选不同站点的爬虫实战案例,内含博客详细讲解,并辅以知识点概括、难度对比与链接跳转。涵盖异步爬虫,自动化爬取,scrapy框架使用等诸多要点。

13
Experimental
6946 robertosolari/LexiPop

Type a word, click on it, and watch it burst open into its synonyms and...

13
Experimental
6947 simonbalanoff/ACMCSU

A full-stack web platform for the ACM chapter at Colorado State University.

13
Experimental
6948 bright-kr/jupyter-notebooks-web-scraping

Jupyter Notebooksを使用して対話的にWebスクレイピングを実行し、コーディング、データ分析、可視化を1つのシームレスなワークフローに統合します。

13
Experimental
6949 OSINTCabal/X-Sniper

Python wrapper for a cheap Twitter RapidAPI key. Allows for user searches,...

13
Experimental
6950 nomikura/future-contest

Competition programming calendar (AtCoder, yukicoder, Codeforces, CS Academy)

13
Experimental
6951 bright-kr/web-unlocker-api

Web Unlocker는 정교한 アンチボット対策をバイパス하는 강력한 スクレイピング API로, 원활한 데이터 수집을 위해 プロキシ 관리,...

13
Experimental
6952 CumaKaradash/Data-Scraper

Amazon, Trendyol ve diğer e-ticaret sitelerinden ürün verilerini (isim,...

13
Experimental
6953 AAA0109/DomPicker_Extension

Google Extension - DOM Pick and Send API

13
Experimental
6954 AadiJo/Web-Scraper

A simple web scraper to grab prices from www.ebay.com and www.newegg.com.

13
Experimental
6955 Nour1512/soccer-network-analytics

Soccer analytics pipeline using SerpApi and NetworkX to model player...

13
Experimental
6956 boddu-siddhartha/second-hand-cars-hyderabad-eda

End-to-end data collection, cleaning and exploratory data analysis of...

13
Experimental
6957 dodyharianto/singapore-tech-jobs-salary-predictor

Machine learning solution to predict salary ranges of tech jobs in Singapore.

13
Experimental
6958 hemusuku86/Prosopo-Procaptcha

Prosopo Procaptcha Solver / Reverse Engineered

13
Experimental
6959 kami4ka/HabitacliaScraper

Python scraper for Habitaclia.com Spanish real estate listings using ScrapingAnt API

13
Experimental
6960 victorgois/cop30-colector

This system was developed to monitor and analyze conversations about COP30...

13
Experimental
6961 lorenzowne/onlyfans-profile-scraper

onlyfans profile data extraction

13
Experimental
6962 DushyantRajpurohit/Aviation-News-Engine

An automated engine that collects aviation news from multiple sources,...

13
Experimental
6963 oosei25/africa-momentum-index-demo

A small, production-friendly pipeline + Streamlit dashboard capturing...

13
Experimental
6964 bright-kr/curl-user-agent

cURL에서 User-Agent ヘッダー를 사용자 지정하고 로ーテーション하여 보다 효과적인 Webスクレイピング과 더 나은 リクエスト...

13
Experimental
6965 conflict-investigations/liveuamap-analysis

Territory control via liveuamap, NZZ.ch, Novaya Gazeta

13
Experimental
6966 vwkd/anonymsms-scrape

Scrape newest number from AnonymSMS

13
Experimental
6967 PedroTurtt/Reddit-Insights-Generator

Um simples gerador de resumos sobre determinado tema, utilizando posts,...

13
Experimental
6968 frederick2003/Data-Science-in-Python

Jupyter notebooks for COMP47670 Data Science in Python

13
Experimental
6969 bright-data-de/best-python-http-clients

Die besten Python HTTP-Clients für Web-Scraping. Vergleichen Sie Funktionen,...

13
Experimental
6970 nicoserrano/Mission-to-Mars

HTML Web scraping on mars data to create a flask web application using...

13
Experimental
6971 bright-data-de/bright-data-web-unlocker-nodejs-project

Bright Data Web Unlocker Nodejs Boilerplate-Code

13
Experimental
6972 lokrau/PhD-Scraper

Python tool that scrapes Fellowship Board PhD listings (first five pages)...

13
Experimental
6973 Fisayomi-h/Remote-Data-Analyst-market-scraper

This project demonstrates web scraping for real-world business insights in...

13
Experimental
6974 kami4ka/AutoUncleScraper

Python scraper for AutoUncle.de car listings using ScrapingAnt API

13
Experimental
6975 CRalves-ops/Projeto-de-webscraping

Web Scraper desenvolvido em Python para extrair e catalogar tecnologias e...

13
Experimental
6976 er1k23/Yerevan-real-estate-price-analysis

Data science project building a complete real estate data pipeline using web...

13
Experimental
6977 azizahadilaa/Sentiment-Analysis-DANA-Reviews

End-to-End Sentiment Analysis of DANA App Reviews using Python. Includes web...

13
Experimental
6978 althropic/visual-mirror

Design extraction and cloning tool. Scrape any website, analyze its visual...

13
Experimental
6979 mostafa8026/crawl-alfont

Node.js crawler for alfont.com that extracts font detail pages and downloads...

13
Experimental
6980 mossimka/autodesk-icons-scraper

Script that collect icons for some AutoDesk products

13
Experimental
6981 Mazennaji/ai-job-market-intelligence

Python-based web scraping and data analysis project that extracts tech job...

13
Experimental
6982 Tejasbhalavi/dealdrop

Built a SaaS-style price monitoring application with secure authentication,...

13
Experimental
6983 plhnnathan/PyScout-Br

A Python-based ETL pipeline for football scouting in the Brazilian League....

13
Experimental
6984 mohdtalal3/msn-scraper

Python tool to scrape posts from MSN channels with likes, comments &...

13
Experimental
6985 amichai1/israeli-price-comparison

real-time grocery price comparison across Israeli supermarket chains. React...

13
Experimental
6986 EduardMilitaruG/JobFy-v2

Full-Stack Job Scraper Dashboard — TypeScript monorepo with React, Express,...

13
Experimental
6987 theekify/Lead-Generator

A Python-based automated lead generation tool that extracts structured...

13
Experimental
6988 AnkoninaShahar/Link-Scraper

Visits a website and parses every html link for pages containing statistics...

13
Experimental
6989 GrandLay-e/EntreprisesEtDirigeants

Trouver les dirigeants finaux d'une organisation à l'aide de son n° de SIREN...

13
Experimental
6990 luminati-io/Rotating-Residential-Proxies

Reliable, high-performance residential proxies with 150M+ IPs for seamless,...

13
Experimental
6991 FirasKahlaoui/web-scraping-lvl2

The "web-scraping-lvl2" project is a learning exercise to explore advanced...

13
Experimental
6992 pun-4/threads-phone-number-scraper

threads phone number extraction tool

13
Experimental
6993 bright-kr/Rotating-Residential-Proxies

シームレスでコンプライアンスに準拠したWebスクレイピングのための、150M+のIPを備えた信頼性が高く高性能なレジデンシャルプロキシです。無料でお試しください!

13
Experimental
6994 Arthur-destb38/MoSEF_FinanceQuantitative_ComportementsMoutonniers_VF

Analyse de sentiment sur les réseaux sociaux (Reddit, Twitter, StockTwits,...

13
Experimental
6995 ApaarRaina/Hospital-Chain-Comparison

A hospital chain comparison project using ollama which compares different...

13
Experimental
6996 vitoriaferreirap/Trip_aggregation

Este projeto tem como objetivo principal o aprendizado de web scraping,...

13
Experimental
6997 gbmerrall/gocache

GoCache is a local caching proxy for HTTP and HTTPS traffic. It's designed...

13
Experimental
6998 HASYIM56/h56-github-scrapper

Github scrapper to retrieve user's github account statistics information...

13
Experimental
6999 ParthPatel2000/expedia_price_tracker_extension

Be competitve with a larger set of properties than expedia's compset.

13
Experimental
7000 sternepenitentiary330/google

Manage multi-account fingerprint browsers with stealth patches, Chrome...

13
Experimental
7001 0khacha/web-scraper

A high-performance, production-ready Python web scraping framework. Supports...

13
Experimental
7002 Ravi0529/keyword-based-crawling-scraping

Crawling and Scraping using Crawl4AI - Keyword wise

13
Experimental
7003 noe999x/KomikDewasa-API

Unofficial API / Wrapper API KomikDewasa - Platform baca komik dewasa (18+)

13
Experimental
7004 tomari3/ScrapeWrangler

ScrapeWrangler is a powerful and fast web scraping framework built with...

13
Experimental
7005 rudijetson/content-engine

Extract content from reddit, tiktok, articles, youtube

13
Experimental
7006 thebipolarbabu/telegram_bot_project

This is a telegram bot which helps you fact check misleading information...

13
Experimental
7007 bloodyst/proxy-pool-manager

Async proxy health checker & weighted proxy pool manager for automation and...

13
Experimental
7008 FirasKahlaoui/amazon-scraper

The Amazon Scraper automates the process of gathering and comparing prices...

13
Experimental
7009 Nils-dev-mertens/Hybrid-scraping

An experimental scraping service to see if we can improve the current way of scraping

13
Experimental
7010 Alfiansyahp2/Agentic-Ai-Scraper

This repository contains an Agentic AI–powered web scraping system designed...

13
Experimental
7011 hibatallahchmicha/career-compass-ai

AI-powered skill gap analysis with real-time job market intelligence and forecasting

13
Experimental
7012 kami4ka/VintedScraper

A Python scraper for Vinted, a popular secondhand fashion marketplace,...

13
Experimental
7013 AndrewUru/Python-Instagram

📧 Streamlit app que extrae emails públicos de perfiles de Instagram (bio y...

13
Experimental
7014 Gopinath-chinnadurai/python-data-collector

Production-ready Python data collection tool that scrapes website data and...

13
Experimental
7015 naravid19/spacebar-scraper

โปรแกรมดึงข่าวอัตโนมัติจาก spacebar.th รองรับการเลือกหมวดหมู่ ฟิลเตอร์วันที่...

13
Experimental
7016 joao-mbn/jobhunt

An ETL for scraping, filtering, cleaning, analyzing, ranking and...

13
Experimental
7017 prabhatisme/cashifracker-price-alert

A powerful web application that helps you track price drops on refurbished...

13
Experimental
7018 vishnurajk82/job_scraper

A job scraper tool built using python,flask,html and css

13
Experimental
7019 noe999x/VhaRasc-Rest-API

VhaRasc Rest API | Unofficial API Docs Anime, Manga, Manhwa, Manhua, Comic...

13
Experimental
7020 Pranavsingh431/FOA-Scraper-GSoC-Screening-Task

Python CLI tool for extracting and structuring FOA data with rule-based...

13
Experimental
7021 vsoeiro/bedetheque

A robust and scalable Python toolkit for scraping and analyzing comic book...

13
Experimental
7022 Roxnsox/scraper-core

Data Acquisition Element of AI Model Training Pipeline

13
Experimental
7023 bright-data-de/Amazon-scraper

Extrahieren Sie Amazon-Daten mit der #1 Amazon Scraper API, einschließlich...

13
Experimental
7024 harneetbagga/books-webscraper

End-to-end Python web scraping and data engineering pipeline using BooksToScrape.

13
Experimental
7025 kiwijos/scientist-wiki-scraper

Basic program to scrape Wikipedia articles about scientists in the course...

13
Experimental
7026 kami4ka/2ememain-scraper

A Python scraper for extracting product listings from 2ememain.be (French...

13
Experimental
7027 lengoctam449-cloud/link-indexer

backlink-indexing, SEO, fast, automation

13
Experimental
7028 djurm/fortune

Serverless application for scraping and ingesting Serbian lottery data.

13
Experimental
7029 zahidayturan/go-web-scraper-cti

A fundamental CTI tool built in Go for static data acquisition

13
Experimental
7030 AnishK-047/Hotel-Pricing-Trends-Analysis-EDA-Project

This project analyzes hotel pricing trends using data scraped from...

13
Experimental
7031 bawfng04/dma-automatic-news-classification-system

A Machine Learning Approach for Automated Vietnamese News Categorization...

13
Experimental
7032 elog08/scrape-to-wp

Scrape web pages directly into WordPress

12
Experimental
7033 azfaradhi/Tubes2_FE_Bolang

This program is a web application for Little Alchemy 2 element recipe finder

12
Experimental
7034 vaibhav11123/coldemail-outreach-system

Production-grade cold email outreach infrastructure with strict data...

12
Experimental
7035 FIREWALL-cafe/great-firewall-watch

Automated tracking of censorship via image search results, for the Firewall...

12
Experimental
7036 xleonardov/gallery-keyword-search

An image scrapping website built using Next.js from online Galleries....

12
Experimental
7037 hsnmnr/COVID-DATA-SCRAPPING

Scrapping COVID-19 🦠 data from...

12
Experimental
7038 rawford-ilderman/tiktok-number-scraper

tiktok number extraction utility

12
Experimental
7039 daniel-isidro/hot_n_pop_song_machine

Repository for the Hot'n'Pop Song Machine project, my Master's in Data...

12
Experimental
7040 KushalJain-00/Scraper

A Python web scraper that extracts internship listings from Internshala with...

12
Experimental
7041 Deving789/Mission_to_Mars

Scrape High-Resolution Mars Hemisphere Images and Titles, Update the Web App...

12
Experimental
7042 Mooseburger1/NFL-Social-Network-Analysis

Performing Social Network Analysis on the 2017 NFL schedule - Scraping the...

12
Experimental
7043 josh-56/twitter-email-scraper

twitter email profile harvesting

12
Experimental
7044 AbdulmalikAlayande/free-courses-scraper

Extract hundreds of free Udemy courses daily with coupon codes and search...

12
Experimental
7045 FDUTCH/bedrock_server_scanner

cli/gui tool for scanning web for bedrock servers

12
Experimental
7046 atsy-ovacek/iCIMS-Jobs-Scraper

icims job listings extractor

12
Experimental
7047 JordanAllen101/AioProx

aioprox – Asynchronous proxy manager for Python. Fetch, test, and filter...

12
Experimental
7048 Brendonk139/bluesky-posts-scraper

bluesky posts data extraction

12
Experimental
7049 kyomind/library-tracker

一個可以讓使用者CRUD的網站,用來一口氣追縱行天宮圖書館所有想借閱的書籍狀態,使用 Python Flask

12
Experimental
7050 u3ffrzi/Pricing-car-auctions

AI-powered auction bidding system using machine learning to optimize car...

12
Experimental
7051 Sch8ill/GSearch-web

A simple web search engine written in go

12
Experimental
7052 abhisheksahu-iitk/Decadal-Analysis-On-Pollution

The motive of this project is two fold, Performing a Decadal analysis of air...

12
Experimental
7053 ToddNieb/social-media-influencer-scraper

influencer discovery metrics tool

12
Experimental
7054 SepidehHayati/Hands-on-Python

Hands-On: My learning journey and tutorials for Python Programming and...

12
Experimental
7055 domini-67/skool-groups-scraper-fast-cheap

skool scraper community data extraction

12
Experimental
7056 Shubhamrawat5/Tech-News

A python program to create tech news list !

12
Experimental
7057 Abhayparashar31/Web-Scraping-Projects

Drinking coffee is my second favorite thing to do, web scraping will always be first.

12
Experimental
7058 kami4ka/ticombo-scraper

Python scraper for Ticombo.com event listings using ScrapingAnt API

12
Experimental
7059 vaibhavbhagee/web-crawler

Web crawler to return static assets of all reachable URLs from a web page

12
Experimental
7060 itwars/golang-scraping-colly

Exemples de récupération de données non structurées avec le framework Golang COLLY

12
Experimental
7061 eadehekeedyxv7/makerworld-com-scraper

Scrape maker profiles, projects, and data

12
Experimental
7062 Karanjot786/QuickNews

Modern Django news aggregation app with dark theme UI. Scrapes Inshorts.com...

12
Experimental
7063 AlpAribal/gradcafestats

Visualize/filter results from TheGradCafe.com

12
Experimental
7064 Pastorsin/casares-news-api

Django API that scrapes and provides the last news of the city of Carlos...

12
Experimental
7065 SakinaJaffri/British_Airway_Virtual_Internship

Web Scrapping British Airways review to gain company insights. Build a...

12
Experimental
7066 berinackr/Astrology_Website

🔮 Feature-rich astrology web app with horoscopes, tarot, rising/descending...

12
Experimental
7067 prasanth-42/AI-Enhanced-Web-Crawler

AI-Enhanced Web Crawler scrapes websites and enables users to chat with the...

12
Experimental
7068 estebanpdl/wordpress-scraper

A command-line tool for scraping WordPress sites via the WordPress REST API

12
Experimental
7069 tungpatrick/food_recognition

A web app that takes in users input of a food image and outputs a...

12
Experimental
7070 raahulrathore/Python-YouTube-Scraper

A simple YouTube Scraper to scrape data from YouTube using URL and download...

12
Experimental
7071 HussainAther/scrape

Web scraping tools for anyone

12
Experimental
7072 alxmares/webscraping-MercadoLibre

Web scraping tool for extract important data and save images from Mercado Libre.

12
Experimental
7073 Dezento/crawlify

Simple Concurrent Crawler

12
Experimental
7074 arrod-bbott/TikTok-Instagram-Video-Info-Scraper

social video metadata extractor

12
Experimental
7075 Qharny/Dart_Web_Scraper

A versatile command-line web scraper built with Dart. This tool allows you...

12
Experimental
7076 theSoberSobber/Fresources-Backup

Unofficial Mirror of a site named Fresources

12
Experimental
7077 jowsey/ow2-data-frontend

Overwatch 2 data visualiser web-app

12
Experimental
7078 hienpatch/property-tax-bill-scraper-elasticsearch

Scraper for U.S. property tax data with Elasticsearch integration

12
Experimental
7079 MarcOBL012/Exchange-Rate-Scraper-SBS-Peru

This project is an automation tool developed in Python to extract the...

12
Experimental
7080 AdigunaHakim/node-scrapper

web scrapping - news portal (kompas, detik, kumparan & google trend)

12
Experimental
7081 deepankarvarma/ETL-Parameter-Sensitivity-Analysis-Using-Multithreading-In-Python

This repository contains an extract, transform, load (ETL) system...

12
Experimental
7082 ENDE25/WebCrawler

Web-based tool for visualizing and exploring website structures, ideal for...

12
Experimental
7083 luonglearnstocode/Seinfeld-text-corpus

text corpus :page_with_curl: scraped from the scripts :speech_balloon: of...

12
Experimental
7084 krautsdubisq1g/fanvue-scraper

FanVue.com scraper, AI-based creator scraping

12
Experimental
7085 ayla-ussel/TheFork-Scraper

TheFork Scraper

12
Experimental
7086 soccer-it/crawling-scraping-scripts

Collection of brazilian soccer data crawling/scraping scripts.

12
Experimental
7087 teyang-lau/GoogleGame_RecommenderSystem

Building a recommendation system for Google Play games using content-based...

12
Experimental
7088 mbh00/medium-publishers-js-snippet

Javascript code snippet for auto scroll on Medium Publishers' List Page

12
Experimental
7089 obaskly/Telegram-Scraper

A script that scrapes messages of a specific user from a telegram group chat

12
Experimental
7090 aresheelamechn/facebook-page-search-results-with-details-about-tab-scraper

facebook page details extraction

12
Experimental
7091 cryptprosteel/land-com-scraper

Land.com property listings scraper

12
Experimental
7092 kjanjua26/Bulk_CV_Paper_Downloader

A small script to bulk download all CVPR/ICCV/ECCV papers for different...

12
Experimental
7093 rafsanza-hub/komik-api

Unofficial Komikcast API

12
Experimental
7094 fukuiascarrg/patreon-extractor-5-0

patreon scraper data extraction

12
Experimental
7095 enigma522/Spider

This asynchronous web crawler is designed for reconnaissance tasks. It...

12
Experimental
7096 Arshdeep54/CinequestWA

This project is a combination of a React frontend and a Django backend. This...

12
Experimental
7097 paul-733/australian-business-scraper

australian business leads scraper

12
Experimental
7098 AnantShankhdhar/codeforces-crawler

A website that recommends problems, virtual contests and shows user...

12
Experimental
7099 lynch-66/pinterest-boards-scraper

Pinterest boards scraper for discovery

12
Experimental
7100 Damliar1/google-lead-generation

google leads business data extractor

12
Experimental
7101 neezr/Website-Screenshotter-for-DaVinci-Resolve

Take a quick high-res screenshot of a website and import directly to DaVinci Resolve!

12
Experimental
7102 erfansobhaei/digikrawl

Data is the new gold. This repository will help you gain some! Using Python,...

12
Experimental
7103 Lprabodha/laravel-9-web-scraping

Laravel Roach web scraping

12
Experimental
7104 knmn2000/Bajaj_FinSearch-hackrx2.0

Solution to Bajaj HackRx's problem statment 1 : Website search engine.

12
Experimental
7105 tareqmahmud/IMDBScraping

Scrape Data From IMDB Movie DataBase

12
Experimental
7106 shaido987/InvivoGen-Printer-Tool

For automatic download of specified TDS documents

12
Experimental
7107 wenkesj/summarize_text

Experimenting with Medium Digests: Learning to Summarize

12
Experimental
7108 RAlexeev/AvitoBIContest

Моё решение первой задачи из Avito BI Contest

12
Experimental
7109 adiredri/DS_Project

End-to-end data science project for hotel price prediction, combining web...

12
Experimental
7110 x10102/regiopy

Reverse-engineering the Regiojet internal API for fun and profit

12
Experimental
7111 meshvaapatel/smartphone-price-prediction-system

This project predicts smartphone prices using a custom AI model. It scrapes...

12
Experimental
7112 rebac-6/spotify

Spotify data extraction tool

12
Experimental
7113 garyhtou/railsconf-2022-schedule

Web scrapes RailsConf's 2022 schedule to create an ICS link

12
Experimental
7114 kami4ka/KleinanzeigenScraper

Python scraper for kleinanzeigen.de (formerly eBay Kleinanzeigen) property...

12
Experimental
7115 michaellopez7032-pixel/funda-in-business-scraper

funda business data extractor

12
Experimental
7116 krautsdubisq1g/search-threads-by-keywords

Fast social media scraper, keyword-based search

12
Experimental
7117 chaudharypraveen98/stackoverflow-scraping-with-rust

A scraper that will extract question, link and title from stackoverflow....

12
Experimental
7118 Abdelmathin/product-scraper

A tool that scrapes images and details of products from specific e-commerce...

12
Experimental
7119 makannrojelvwp1et/xvideos-scraper-bulk-scraper-pro

Extract video data, trend analysis

12
Experimental
7120 kimber-56/indeed-jobs-scraper

indeed jobs structured extraction

12
Experimental
7121 bjagrelli/bjj_data_scrapping

Data scraping from BJJ Heroes website for statistical analysis of Brazilian...

12
Experimental
7122 mohidex/data-pipeline-on-gcp

The Real-time Ecommerce Data Collection and Processing project empowers...

12
Experimental
7123 TanakAiko/wget

A modern, high-performance wget implementation in Rust with async downloads,...

12
Experimental
7124 cgatama/Python-Project-for-Data-Science

Foundational Python skills for Working with a real-world data set and a...

12
Experimental
7125 cryptprosteel/airbnb-seo-keyword-scraper

Airbnb SEO keywords extractor

12
Experimental
7126 manishanker/scrape_toi

This repository contains python code which can be used to scrape TOI(Times...

12
Experimental
7127 VeryOldpApY/AnimeWatching

Watch your anime video in the desktop app !

12
Experimental
7128 scholar-8/livabl-scraper

livabl real-estate data scraper

12
Experimental
7129 bitt00l/instagram-profile-scraper

Instagram Profile Scraper to extract user profiles, bio, posts, and follower data.

12
Experimental
7130 rogergarciapages/EmailScrapper

Pulls HTML emails from imap folder and takes screenshots like a champ

12
Experimental
7131 AarnoStormborn/gamerecommendationsystem

Video Game Recommendation System based on Content Based Filtering using Clustering

12
Experimental
7132 Just1truc/ScrapMyLinkedin

Scrap linkedin

12
Experimental
7133 agottardo/cineplex-api-php

🍿 A scraper and REST endpoint for the Cineplex.com APIs.

12
Experimental
7134 kami4ka/SelogerScraper

Python scraper for SeLoger.com - France's #1 real estate portal. Extracts...

12
Experimental
7135 Eric-Mendes/estatisticas-quem-cair-calil

Análise de dados da liga "Quem Cair Calil" do fantasy game de futebol Cartola F.C.

12
Experimental
7136 sarthak0797/Extracting-News-from-different-sites

Basic program of scrapping news from different web sites for specific tags...

12
Experimental
7137 kosmickroma/devpulse

A real-time trends aggregation platform (GitHub, HN, Dev.to) built with...

12
Experimental
7138 candaCewrc/facebook-marketplace-scraper

facebook marketplace listing extractor

12
Experimental
7139 eeeds/Projects

In this repository you'll find projects about data science and data engineering.

12
Experimental
7140 sablekunal/apify

APIfy is a powerful web application that allows you to interact with and...

12
Experimental
7141 qoli/newSafari

Safari page extraction and summarization tools for macOS, with Markdown...

12
Experimental
7142 Ghurtchu/github-topics-web-scraper

:page_facing_up::arrow_right::open_file_folder: Web Scraper for GitHub topics.

12
Experimental
7143 tomcardoso/intro-to-scraping

An introduction to web and document scraping

12
Experimental
7144 onlypathan/machine-learning-driven-business-success-recipe

An end-to-end machine learning and data analytics project that integrates...

12
Experimental
7145 sevbo2003/parsing_news_feed

Parsing news feed of websites by datetime

12
Experimental
7146 javipzv/letterbox-stats

A web scraping application that retrieves the most viewed directors and...

12
Experimental
7147 orma-unsch/houston-we-have-a-problem

AI-powered deep crawling extractor

12
Experimental
7148 rafabelokurows/sports-odds

Obtaining odds for MLB and NFL games through an API

12
Experimental
7149 abdulrahman-mh/get-proxy

Collecting, validating, and caching free proxies, very fast!

12
Experimental
7150 mikevidotto/trackprice-ai

TrackPrice AI automates competitor price tracking with a Go (Fiber) backend,...

12
Experimental
7151 conflict-investigations/deepstatemap-territory

Scrape deepstatemap.live and calculate the total area marked as "occupied"

12
Experimental
7152 76Telecom/76telecom-search-pppoe

Automatic pPPoE generator for 76Telecom company

12
Experimental
7153 drealdumore/MetaScraper

Ever needed the lowdown on a website? or need quick website details? This...

12
Experimental
7154 z23788677/Weather_API

An API can catch weather, by any location in Taiwan.

12
Experimental
7155 capturr/jsonld-extract

A damn simple tool to extract json-ld metadata from webpage using jquery...

12
Experimental
7156 ShovalBenjer/admaven-python-data-engineering

Production-grade Ad-Tech Intelligence Suite featuring a high-performance...

12
Experimental
7157 umihico/minigun-requests

Web scraping API to outsource tons of GET & xpath to cloud computing

12
Experimental
7158 skathuria29/web-scraping

Getting started with web scraping with Nodejs using Cheerio

12
Experimental
7159 raphelemmanuvel/entity-resolution-pipeline

Simple entity resolution using Public Data

12
Experimental
7160 lynkos/downloader

Basic web scraper to download media from websites. Supports .pdf generation...

12
Experimental
7161 ViniciusReisch/ScrapyProject

Project developed in the Entra21 Python Class - Using the Scrapy library as...

12
Experimental
7162 omkar2503/T20WorldCup2024-Analytics

Power BI dashboard and data pipeline for T20 World Cup 2024—scraped match,...

12
Experimental
7163 nsozturk/sarisite-export

Browser extension to export listing results to CSV/Excel with optional...

12
Experimental
7164 alessandraluzm/amazon-bot

Bot criado com a finalidade de monitorar as mudanças de preços dos itens na...

12
Experimental
7165 J4GL/bt-dht

A bittorrent dht scraper

12
Experimental
7166 4LIF27/webhook-json

Ini adalah contoh program JavaScript yang mengekstrak data dari webhook dan...

12
Experimental
7167 FeridunDuran/python-website-change-detector

This Python script, "Website Change Detector," is designed to monitor...

12
Experimental
7168 cchummer/cme-api

Documenting methods of scraping data from different CME Group endpoints

12
Experimental
7169 osanna-locko/Fb-Lead-Extractor-Scraper

facebook lead data extractor

12
Experimental
7170 oxylabs/walmart-price-tracker

Tutorial for creating a Walmart price tracker using Python and Oxylabs...

12
Experimental
7171 NotYuSheng/signaslAPI

A FastAPI-based scraper and REST API for retrieving ASL (American Sign...

12
Experimental
7172 phucvn16409/web-scraping

This project is a web scraping application that collects data from websites...

12
Experimental
7173 oxylabs/javascript-web-scraping

JavaScript Web Scraping

12
Experimental
7174 onreen/instagram-profile-hunter-bulk-website-to-instagram-mapper

Instagram Profile Hunter bulk mapper

12
Experimental
7175 kami4ka/ticket-compare-scraper

Python scraper for ticket-compare.com football matches using ScrapingAnt API

12
Experimental
7176 iankonradjohnson/HealthyFoodFinder

Used Data Science techniques to find healthy dishes from TasteAtlas

12
Experimental
7177 hemusuku86/fingerprint-generator

Generate Consistent JavaScript Fingerprint from User-Agent String, In Full...

12
Experimental
7178 Thanaraklee/dsi321_2025

This system is designed to monitor and analyze public data related to...

12
Experimental
7179 JefersonLC/my-portfolio

My personal portfolio

12
Experimental
7180 Cmatrix1/MusicAPI-Scraping-Redis-restframework

API for Iranian Musics with Restframeword , Web Scraping and Caching with redis

12
Experimental
7181 josh-56/immobilien-suchmaschine

real estate listings extractor

12
Experimental
7182 rafaelPermec/live-broker-api

Um estudo sobre raspagem de dados em back-end, simulando uma corretora que...

12
Experimental
7183 Kauanrodrigues01/web-scrapper-olx

Este projeto contém um web scraper desenvolvido em Python para coletar dados...

12
Experimental
7184 KhaiNguyenDuc/proxy-generator

The script creates local HTTP proxies that tunnel traffic into the Tor...

12
Experimental
7185 omar-elmaria/amazon_luwak_coffee_scraper

This repo contains a Python-based web crawler that scrapes data on Luwak...

12
Experimental
7186 alyn-ulas/google-python-business-emails-scraper

Google Python email scraping utility with validation

12
Experimental
7187 im-n1/rug

Library for fetching various stock data from the internet (official and...

12
Experimental
7188 nbilabsystems/webscraper_pro

Configurable Python web scraping tool using Requests, BeautifulSoup, and...

12
Experimental
7189 kulkansecurity/in4m

A Python tool to obtain the latest infosec news from curated sources.

12
Experimental
7190 minskylab/instaminer

A research tool to understand and explore the hashtag's dynamics on Instagram.

12
Experimental
7191 ryanchen2134/ig-project

Instagram Post -> Song Recommendation

12
Experimental
7192 welmends/WebScraping_Qacademico

Web Scraping - Qacademico

12
Experimental
7193 geofflangenderfer/gigMax

A better dashboard for Uber Eats Drivers

12
Experimental
7194 pulsedev2gwencd/tumblr-tags-scraper

Tumblr tags analytics

12
Experimental
7195 Nayemjaman/mobilehouse

Scraped news data using Scrapy and make a pipeline to push data in...

12
Experimental
7196 grigolin/JusBrasil-Scraper

JusBrasil Scraper

12
Experimental
7197 giancarllotorres/FutBin-Player-Popularity

This script automatically retrieves and exports useful player data, by FUT...

12
Experimental
7198 lek-orer/facebook-marketplace-vehicle-scraper-scrapfly

Facebook Marketplace vehicle scraper using Scrapfly API

12
Experimental
7199 piertiarvinaea/telegram-whatsapp-vk-scraper

messaging platforms data scraper

12
Experimental
7200 imgomez0127/cryptocurrency-predictor

A Machine learning pipline which gathers data from coinmarketcap.com and...

12
Experimental
7201 chaelzvaethz/scrapeunblocker

anti-bot bypass html extractor

12
Experimental
7202 chqwey3509/DjangoFoodSearch

富得比 (FoodCompare) —— 針對外送平台的跨店比價搜尋引擎,打破演算法限制,幫你找出高 CP 值餐點。Built with Django & Python.

12
Experimental
7203 belajarqywok/scraping_pemilu_2024

scraping and analyzing the 2024 election website (the program only runs...

12
Experimental
7204 adin786/autotrader-analysis

Web scraping and analysis of autotrader adverts, to build a used car valuation model.

12
Experimental
7205 datasint/DorkSint

OSINT Tool. For dork searching - Yandex, Google, Bing!

12
Experimental
7206 Dashbloxx/iSpy

Multithreaded IPv4 address scanner.

12
Experimental
7207 techcentaur/Scraping-Product-Info

WebApp for scraping product information from Amazon and eBay

12
Experimental
7208 zmesror/avito-trackr

A Python web scraper for Avito.ma, providing real estate data insights for...

12
Experimental
7209 JonasJoKuJonas/homeassistant-AldiTalk

Custom component for Home Assistant to access data from Aldi Talk

12
Experimental
7210 bradklassen/Professional_Golf_Database

Documentation for a professional golf database. Six web-scraping programs...

12
Experimental
7211 roshanlc/khabar-haru

A Nepali news aggregator written in GO.

12
Experimental
7212 kuhumcst/cuphic

Transform or scrape Hiccup with a declarative DSL.

12
Experimental
7213 krautsdubisq1g/trademe-scraper

Scrape vehicle listings, prices, images, location

12
Experimental
7214 arthurcluet/webscraping-project

Academic Assignment - Web scraping of cryptocurrencies' prices using Shell...

12
Experimental
7215 sinancsoysal/reddit-video-downloader-java

same thing but with java

12
Experimental
7216 sandrocods/IdlixAPI

Program sederhana yang dibuat dengan bahasa pemrograman python3. menggunakan...

12
Experimental
7217 Yashraj-Muthyapwar/Scalable-ETL-Pipeline-Data-Quality-Framework

Reliable, production-style data pipeline that ingests data from multiple...

12
Experimental
7218 acey-arton/Rebecca-Minkoff-Scraper

rebecca minkoff product extractor

12
Experimental
7219 Allie72-Aur/torrent_scraper

A web scraping utility that extracts and lists magnet links and .torrent...

12
Experimental
7220 pineconedata/pineconedata.github.io

Custom software development services specializing in AI/ML, data analysis,...

12
Experimental
7221 martinhoward4468-blip/youtube-wealth-financial-coach-leads-scraper

youtube wealth coach leads extraction

12
Experimental
7222 codica2/scrapinghub-ruby-example

Simple guide to working with Scrapinghub

12
Experimental
7223 bodrovis-learning/Python-Google-scraping

How to scrape Google search results data in Python easily

12
Experimental
7224 bersena911/bing-scraper

Mostly helpful when scraping usernames.

12
Experimental
7225 ajaygithub2/yellow-pages-scraper

There is a script for scraping yellowpages.com website for name, contact,...

12
Experimental
7226 elchin-hasanov/Conference-Trend-Detector

Conference Trend Dashboard — a Next.js + Supabase app that scrapes top ML...

12
Experimental
7227 Ashad001/EmailScraping

Email Scraping in python

12
Experimental
7228 CodeChefVIT/important-know-how

Useful resources to explore different technological trends.

12
Experimental
7229 Antoinegtir/oros

Remake of oros website

12
Experimental
7230 narex-ai/web-scraping

This project is a Python-based web scraping tool designed to extract data...

12
Experimental
7231 ortizdavidg/linkedin-connections-parser-scraper

Python scraper to parse LinkedIn connections.

11
Experimental
7232 skymagi-d/LinkedIn-post-scraping

Scraping Script for LinkedIn Posts | Unipile API

11
Experimental
7233 ysfzkn/twitter_scraper

Scraping tweets with tweepy using Twitter API

11
Experimental
7234 zjw-hunter/Dota2EsportDataset

This project is about making a Dota 2 Esport Dataset

11
Experimental
7235 khyrulAlam/data-scraper-browser-extension

🔥Browser Extension for website data scraping 🕸 and download in Excel or CSV format

11
Experimental
7236 bird1and1fish/JD-Image-Search

python实现京东商城上的图像目标检索

11
Experimental
7237 kkiapay/lulz-scraping

Scraping the data you want from a website by specifying your output in parser.yml

11
Experimental
7238 sinjoysaha/Disney-Movies-Wiki-WebScraper

Web Scraping Wikipedia for Disney Movies to create a Disney Movies dataset...

11
Experimental
7239 Rohan-Agrawal029/Medbazaar

Medbazaar is a website that functions as a pharmaceutical metasearch engine....

11
Experimental
7240 felpssc/amazon-twitter-bot

🤖 Amazon <> Twitter Bot | Automation to web scrape amazon promotions and...

11
Experimental
7241 oxylabs/csharp-web-scraping

Web Scraping With C#

11
Experimental
7242 colin4554/stocks

Stock data scrapers and other useful scripts

11
Experimental
7243 freder/designer-description-chrome-extension

Browser extension that collects texts of how designers describe themselves

11
Experimental
7244 shantanugodbole/dashjobs

A prototype which scrapes LinkedIn Jobs and creates a Supabase database.

11
Experimental
7245 filipe4ndrade/web-scraping

Uso de Web Scraping

11
Experimental
7246 MaskofDevil/cheerio

Web scraping in Node using cheerio

11
Experimental
7247 robertocommit/StubHubScraper

Automated ticket data extraction and monitoring system for StubHub, built...

11
Experimental
7248 Cr0mb/Python-Web-Scanner

How to Identify Active Servers & Organize IPs

11
Experimental
7249 SAN-vin-GIT/Python-Pit

This repository serves as a curated collection of my personal projects,...

11
Experimental
7250 ROHITHA-TATA/SocialScrape

SocialScrape is a Python-based tool for fetching content from YouTube and...

11
Experimental
7251 ermcgrew/bootcamp_project_three

Webpage, running off a flask app & pulling data from a SQLite database, to...

11
Experimental
7252 AAlkiyumi/Youtube-URL-Scraper-Chrome-Extension

A simple Chrome extension to extract video URLs from YouTube playlists or...

11
Experimental
7253 hariharmayuresh/Cricket-Data-Analytics

A data-driven analysis of the 2022 T20 World Cup, featuring web-scraped...

11
Experimental
7254 bright-jp/bright-data-web-unlocker-nodejs-project

Bright Data Web Unlocker Nodejs ボイラープレートコード

11
Experimental
7255 Oezguercancevlani/FoodScore

Fullstack Lebensmittelbewertungs-App (Spring Boot + PostgreSQL + React/Vite)

11
Experimental
7256 bright-jp/web-unlocker-api

Web Unlocker は、高度なアンチボット対策をバイパスする強力なスクレイピング API であり、プロキシ管理、CAPTCHA...

11
Experimental
7257 kami4ka/WikicasaScraper

Python scraper for Wikicasa.it - Italian real estate portal using ScrapingAnt API

11
Experimental
7258 kami4ka/LogicImmoScraper

Python scraper for Logic-Immo.com French real estate portal using ScrapingAnt API

11
Experimental
7259 francoisdotdev/knowledge-ingester

Un système de gestion des connaissances personnelles qui ingère, traite et...

11
Experimental
7260 ShivamSabbarwal/icici-forex-api

A high-performance Cloudflare Worker API that provides real-time foreign...

11
Experimental
7261 herzogmatthias/instagram-recipe-extraction

a Next.Js app for extracting Recipies from Instagram Videos and/or captions

11
Experimental
7262 jpreszler/peak-neo4j

Data and Cypher scripts to build and explore Neo4J graph database of College...

11
Experimental
7263 GauravShambharkar/Contextly-FE

A modern React + TypeScript web interface that allows users to input YouTube...

11
Experimental
7264 hbatra21/IND-Cricket-Buzz

A python script to send live India's cricket score via SMS

11
Experimental
7265 artheioupfat/mini-gpt-wiki

Projet visant à créer un mini LLM entraîné sur des données Wikipédia et à...

11
Experimental
7266 a8392280-web/book_scraper

a script to scrape books info from books to scrape website

11
Experimental
7267 kami4ka/dice-scraper

Python scraper for DICE.fm event listings using ScrapingAnt API

11
Experimental
7268 mallei/venator

Script for scraping email addresses from a given URL

11
Experimental
7269 victorssanches/projeto-nlp-filmow

Pipeline NLP com scraping no Filmow (Ação/Comédia/Drama), SBERT + SVM/KNN/LogReg.

11
Experimental
7270 Z786ZA/google-maps-scraper-

Google Maps scraper business Extractor

11
Experimental
7271 Gami13/StockTicker

A real-time stock price ticker application designed specifically for...

11
Experimental
7272 Divya7822/SMA_Project

Social Media Analytics capstone analyzing scraped Dot & Key (moisturizers)...

11
Experimental
7273 bright-jp/Awesome-Web-Scraping

Webスクレイピングおよびデータ処理のためのライブラリ、ツール、APIの一覧です。HTTPライブラリからブラウザ自動化ツール、プロキシサービスまで、Web...

11
Experimental
7274 andreanasuto/coin_portfolio

An easy way to know how much money is worth your investments. A no-frills...

11
Experimental
7275 luminati-io/laravel-with-proxy

Configuring and using proxies in Laravel for web scraping, bypassing rate...

11
Experimental
7276 codepressed/proxyScraperBackend

Proxy Scraper is a Java application developed which purpose is to scrape the...

11
Experimental
7277 gauravraj0510/Covid-Saathi

Our platform helps patients to keep themselves updated with the no of beds...

11
Experimental
7278 andraderaul/naruto-name-generator

Foi treinada uma rede neural recorrente (RNN) em um conjunto de dados...

11
Experimental
7279 ivangrana/web-scraping-python

Repositório dedicado a pratica de web scraping utilizando Python

11
Experimental
7280 hsnmnr/Flipkart-Product-Scrapping

Scrapping Products From flipkart.com

11
Experimental
7281 frascu/varieteebot

A telegram bot that sends today's tee of some tee shops.

11
Experimental
7282 MSarmadQadeer/debank-and-nanoly-scrapping

A web platform that tells you about your token's best yield based on your...

11
Experimental
7283 katreparitosh/Web-Scrapping-and-EDA

Web Scrapping and Exploratory Data Analysis using Beautiful Soup and Plotly...

11
Experimental
7284 quvonchbek-dev/looksrare-scraper

Looks Rare collections scraper

11
Experimental
7285 JakobAIOdev/nintendo-product-monitor

A Discord bot that monitors Nintendo Store Germany for product availability...

11
Experimental
7286 hrbrmstr/splashttpd

Slight modifications to the scrapinghub/splash Docker environment to enable...

11
Experimental
7287 huysuy05/WatchOutForChicago

This project, developed by Huy Nguyen and Anh Le, serves as the final...

11
Experimental
7288 rafaelglikis/sinama

Web scraping library

11
Experimental
7289 karagultm/Job-Odyssey

The aim of this project is to develop a user-friendly web application for...

11
Experimental
7290 kami4ka/SubitoScraper

Python scraper for Subito.it property listings using ScrapingAnt API

11
Experimental
7291 Bishal-im/Python

Python projects on web scraping, data cleaning, and exploratory data...

11
Experimental
7292 raimbekovm/car-market-scraper

Scraper for car listings and brand/model data from Kolesa.kz, Drom.ru and Mashina.kg.

11
Experimental
7293 shofiq0023/java-google-scholar-scraper

A simple web scraper to scrape data from google scholar

11
Experimental
7294 Anukul07/Baketball-Analytics-DB

End-to-end ETL pipeline analyzing NBA stats (2024-25). Uses PostgreSQL &...

11
Experimental
7295 roshho/NLP-political-marketing-analysis

A Columbia Business School political marketing analysis project...

11
Experimental
7296 hawkqueen674acl/zensah-scraper

Zensah apparel product scraper

11
Experimental
7297 chaelzvaethz/cryptocurrency-jobs-scraper

crypto job listings extractor

11
Experimental
7298 pavleshuricrlhkf/opentable-review-scraper

OpenTable reviews sentiment extractor

11
Experimental
7299 piertiarvinaea/magicbricks-property-search-scraper

Magicbricks property data extraction tool

11
Experimental
7300 auriaoodeen/remax-scraper

real estate listings extraction tool

11
Experimental
7301 nightking-oliver-powers/zeturf-fr-scraper

Zeturf horse racing data

11
Experimental
7302 OckyUnolfsdottir/linkedin-lead-extractor-scraper

LinkedIn Lead Extractor for automated data gathering, sales leads, and...

11
Experimental
7303 skiddle-archives/Trends-Keyword

Scrape Trends Keyword from Google (frequently updated)

11
Experimental
7304 NadavIs56/WebCrawler2

A simple Python web crawler that processes URLs from web pages, handles...

11
Experimental
7305 jacobsoftware/market-overview-and-analyze

Scraping data about items from cs2 and all data around #100commitow

11
Experimental
7306 lukeweston1234/MangaReader-PDF-Downloader

Python script to convert separate Manga Reader pages into a single PDF

11
Experimental
7307 hemusuku86/mCaptcha-solver

mCaptcha solver (pow)

11
Experimental
7308 luizmellodev/Google-Search

Automated script that navigates the World Wide Web in a methodical and...

11
Experimental
7309 epmyas2022/uped-vunerabilidad

Script que permite obtener la información de estudiantes y la sesion de un...

11
Experimental
7310 btwlouis/fivem-tracker

[Outdated] Unlock the secrets of FiveM servers with detailed insights and...

11
Experimental
7311 gnes-iehn/woocommerce-scraper-5-0

woocommerce scraper for ecommerce data

11
Experimental
7312 candaCewrc/facebook-reviews-scraper

Facebook reviews data extraction utility

11
Experimental
7313 phantommanzonek/deepdiscount-scraper

DeepDiscount product data extraction

11
Experimental
7314 chaelzvaethz/grailed-com-fashion-product-scraper

Grailed fashion product extraction

11
Experimental
7315 krautsdubisq1g/nextdoor-business-scraper

Scrape business data from Nextdoor

11
Experimental
7316 vjavallar-ship-it/builtwith-technology-stack-scraper

builtwith tech stack data extractor

11
Experimental
7317 robi-369/telegram

telegram profile message extraction

11
Experimental
7318 bright-jp/datadome-captcha-solver

Bright Data の高度な AI 駆動の CAPTCHA Solver を使用して DataDome CAPTCHA を解決し、自動化された IP...

11
Experimental
7319 alxytaylor41/amazon-sellers-leads-scraper-from-asin-list

amazon seller leads extraction tool

11
Experimental
7320 malav-radia/news_summarizer

A Flask web app that summarizes news (from web scraping) and newspaper...

11
Experimental
7321 acey-arton/RecordGo-Rentacar-Scraper

recordgo rental pricing extractor

11
Experimental
7322 BigWillyJ/business_scraper

Scraping for small businesses in a certain area code (Outputs a JSON file of...

11
Experimental
7323 Maximus220/instagram-followers

🕵️‍♂️ Extract and save followers list from any Instagram user.

11
Experimental
7324 HaleyEgan/Detecting-Accredited-vs-Unaccredited-Online-Pharmacies-with-Multimodal-Deep-Learning

Multimodal deep learning to detect accredited vs non-accredited online...

11
Experimental
7325 18520339/web-scraping-with-scrapy

Python web scraping with Scrapy

11
Experimental
7326 JoJosuk/Web-scraping-Project

An Online Store Webscraper used to compare prices of a product from 3...

11
Experimental
7327 itsachrafmansari/moroccan-real-estate-analysis

Scrape, process, analyze, and visualize data from Avito.ma to uncover...

11
Experimental
7328 nanonymoussu/aerothai-lms

Python Script สำหรับ Automate การอัปเดต Progress บน AEROTHAI LMS ให้ครบ 100%...

11
Experimental
7329 raghav1010/CurrencyConverterDesktopApp

💰💵 A web application build on top of a Python web scrapping script to...

11
Experimental
7330 JunsooJung/CUBoulder_CSCI5502_DataMining_Project

CSCI5502 UCB Data Mining Project

11
Experimental
7331 YuJunWang/News-Catcher-AI

AI-driven news intelligence system that filters 86% noise using Gemini 2.5 flash.

11
Experimental
7332 jenyadev3/Web-Scrapping-Books-Shop

Web-scrapping книжного онлайн магазина с помощью библиотеки BeautifulSoup

11
Experimental
7333 NNKTV28/web-scraping-project-tutorial

Web scraping tutorial project using Python and BeautifulSoup

11
Experimental
7334 Stefano-Trovato-89/books-to-scrape-web-scraper

Automated web scraping of the Books to Scrape online bookstore, extracting...

11
Experimental
7335 luciano-im/SimpleDesktop-Bot

This simple script crawl wallpepers site Simpledesktops.com and download...

11
Experimental
7336 SurinShah/Web-Scraper-using-BS4-and-Flask

Developed a Web Scraper using Flask that extracts useful data from different...

11
Experimental
7337 scrapingbypass/google-serp-scraper

Google SERP scraper

11
Experimental
7338 ItsMyEyes/api-v2-covidIndonesia

Api Covid Indonesia. dimana saya menggunakan updater, scrapper, dan...

11
Experimental
7339 aston-llrich/target-keyword-scraper

target keyword product finder

11
Experimental
7340 auric-code/DexScreener-Scraping

When a specific token pair is provided from DEX Screener, the script...

11
Experimental
7341 pulsedev2gwencd/kennstdueinen-reviews-scraper

kennstdueinen reviews data scraper

11
Experimental
7342 onreen/livabl-scraper

livabl data extraction tool

11
Experimental
7343 PuddingPotato/webscraping-artistsongs

[Task] This project is a Python-based web scraper that extracts song titles...

11
Experimental
7344 ayushjay/vahan

Generate a score for each vehicle by performing sentiment analysis on...

11
Experimental
7345 oxylabs/regex-web-scraping

Web Scraping with RegEx

11
Experimental
7346 obrunet/Web_Scraping_Projects

Various projects in order to improve my scraping skills :)

11
Experimental
7347 Anksharskarp/Anthracite

Real estate web scraping tool

11
Experimental
7348 hasansmadix/serper

Modern web scraper built with Next.js. Extract content, links, and images...

11
Experimental
7349 leonardo-bispoo/crypto-mine-cli

CLI to get information of all cryptocurrencies

11
Experimental
7350 Rimkus85/robo-imoveis

🏠 Plataforma completa de monitoramento de oportunidades imobiliárias em...

11
Experimental
7351 roissyahf/simple-etl-pipeline

ETL pipeline build with Python

11
Experimental
7352 kami4ka/axs-scraper

AXS.com event scraper using ScrapingAnt API

11
Experimental
7353 Samu1808/elwis-to-anki

A Python tool to extract questions and images from the official ELWIS...

11
Experimental
7354 keanej/webscraper-dashboard

Flask dashboard that scrapes book data, stores it in SQLite, and visualizes...

11
Experimental
7355 Dch-in-algo/book-scraper-system

A complete web scraping system for book information collection, analysis and...

11
Experimental
7356 ChunkyTortoise/scrape-and-serve

Web scraping framework + Excel-to-web converter + SEO content tools

11
Experimental
7357 indiser/Web-Scrapers-Collection

A modern, production-ready collection of web scrapers for extracting data...

11
Experimental
7358 kami4ka/WohnungsboerseScraper

Python scraper for wohnungsboerse.net property listings using ScrapingAnt API

11
Experimental
7359 klckubra/Books-Scraper

Python-based Web Scraper extracting 1000+ book data points (price, rating,...

11
Experimental
7360 ajdeve/UsedCarMarket

Used car price prediction using Craigslist data and web-scraped MSRP dataset

11
Experimental
7361 Vaga-666/tg-economic-news-bot

Telegram bot that scrapes economic/markets headlines and sends to a chat...

11
Experimental
7362 harjotsinghgill/personal-job-feed

A Python-based job scraper to collect job postings from multiple job boards...

11
Experimental
7363 Khatib-imen/Smart_Web_Automation_Agent

Smart Web Automation Agent

11
Experimental
7364 sopanatx/psru-grade-api

Node.js web scraping for convert psru website html to json api.

11
Experimental
7365 zladovan/luster

Simple tool for scraping data from Facebook

11
Experimental
7366 elreyfahad/Mining-Social-Media-and-News-websites-in-Morocco

Fouille des sujets abordée par les marocains dans les medias sociaux...

11
Experimental
7367 abhishekpaul11/fashion

A web application that displays the trending and lagging designs as well as...

11
Experimental
7368 akary-ackett/crunchbase-leads-scraper

Crunchbase Data Scraping Tool

11
Experimental
7369 AlidaSoble/linkedin-employees-scraper

linkedin employees data extraction

11
Experimental
7370 bright-jp/Datacenter-Proxies

シームレスで高速なWebスクレイピングのための、770K以上のIPを備えた信頼性の高い高性能データセンタープロキシです。無料でお試しください!

11
Experimental
7371 ortizdavidg/marriott-hilton-ihg-hotel-data-scraper

US Hotels Data Scraper with PHP

11
Experimental
7372 yogski/textmining-pidato-jokowi

scrape Jokowi's speech in 2017 from official website and extract relevant keywords

11
Experimental
7373 devvf/quotes-scraper

Simple quotes scraper for goodreads written in Go

11
Experimental
7374 Soufiane-Majdar/getsource

download web pages

11
Experimental
7375 thisisNaman/Salon-Hub

An E commerce application for buying and selling salon based products.

11
Experimental
7376 SyedFaisal30/ScrapeBoard

📰 ScrapeBoard is a full-stack web app to scrape, search, and bookmark real-time news

11
Experimental
7377 buildwithfiroz/AI-Team-Intern-Collaboration

An AI project developed by interns Nehal, Huzzaifa, and Romman, under the...

11
Experimental
7378 OckyUnolfsdottir/linkedin-job-scraper

LinkedIn Job Scraper for Android automation, job data extraction, and job...

11
Experimental
7379 MarcherGA/VacanSeek

An automated job scraper that monitors job boards, filters positions based...

11
Experimental
7380 ssahoo11742/Sentinel-AI

Identifying mispriced prediction markets through AI-driven signal extraction

11
Experimental
7381 arminshfatemi/web-scraper

A Web-Scraper to get price of cars in Divar website

11
Experimental
7382 steelify-mark/dynaquest-pc-scraper

DynaQuest PC product data

11
Experimental
7383 harshbhandari7/scrapped-mf-details

This repo contains a python script to scarp scheme data for mutual fund from...

11
Experimental
7384 vwkd/handyverkauf-scrape

Scrape purchase prices from handyverkauf.net

11
Experimental
7385 oxylabs/pricing-data-collection-from-ecommerce-stores

Appache Airflow DAGs for e-commerce pricing collection.

11
Experimental
7386 Markvillainy/Comparador

Página que Scrapea datos de Amazon y Mercado Libre

11
Experimental
7387 thestarfarer/yt-channelactivity-scraper

Extract members-only community posts from YouTube channels via cookie auth

11
Experimental
7388 Vatsalasingh17/BeyondChat-Automation

A system that automatically rewrites and modernizes old blog articles using...

11
Experimental
7389 twmalby/scriptpy

A Scrapy-based tool with CSV export was built to extract key data—Name,...

11
Experimental
7390 Luna-BLox/Luna-Crawler

✨🎮 Turn a Roblox Page into a JSON/CSV

11
Experimental
7391 kayraaktas/tor-scraper

Tor network scraper with automated screenshot capture. Scans .onion sites...

11
Experimental
7392 MouncefMoe/automated-job-scraper

Java Job Scraper using Jsoup, Multithreading, and CSV Export.

11
Experimental
7393 Jbond007-11/PowerBI-Portfolio

This repository is my sandbox for testing the limits of Power BI. I'm...

11
Experimental
7394 yuriiter/flparser

Lightweight and fast parser of Freelance.com projects by multiple parameters...

11
Experimental
7395 blondelg/docker-tor

Tor container to send requests and rotate public ip

11
Experimental
7396 onreen/mercadolivre-scraper-brasil-portugu-s

mercadolivre data extraction tool

11
Experimental
7397 lorijta92/mission-to-mars

Gather key data on Mars and display on webpage.

11
Experimental
7398 pavleshuricrlhkf/miodottore-scraper

MioDottore doctor data extractor

11
Experimental
7399 Zeghm/ebay-reviews-scraper

eBay reviews scraper for structured insights

11
Experimental
7400 lkolas-arber/advanced-website-domain-name-validator

domain validator technology scraper

11
Experimental
7401 lorenzowne/new-york-post-scraper

news extraction automation tool

11
Experimental
7402 obetzlitkinp/etsy-seller-products-bulk-scraper-pro

etsy seller products extraction tool

11
Experimental
7403 bright-jp/jupyter-notebooks-web-scraping

Jupyter Notebooks を使用して Webスクレイピングを対話的に実行し、コーディング、データ分析、可視化を1つのシームレスなワークフローに統合します。

11
Experimental
7404 lorenzowne/cheap-flights-flight-price-trends-skyscanner

cheap flights daily price trends

11
Experimental
7405 osanna-locko/Wix-Product-Parser-Scraper

Wix store product data extractor

11
Experimental
7406 gnes-iehn/erasmus-organisation-scraper

Erasmus organisations data extractor

11
Experimental
7407 depeelalgussz/simplyhired-job-scraper

SimplyHired job scraper for listings

11
Experimental
7408 violet-heath/pbs-physical-balance-solution-blog-scraper

PBS blog content extractor

11
Experimental
7409 seralexger/filmaffinity-scraper

Unofficial class for scrap and recollect info from Filmmaffinity

11
Experimental
7410 mi-ki-ri/awesome-brew-cask-site

brew caskでダウンロードできるアプリの2020年時点まとめ

11
Experimental
7411 Fahmi-XD/google-form-solver

Google forms solver with LLM

11
Experimental
7412 indiser/LinkedIn-profile-scraper

🔍 Extract publicly visible data from LinkedIn profiles & companies. Batch...

11
Experimental
7413 lifeislearningforever/wikipedia-crawler-hive

Production-ready Wikipedia crawler with PySpark and Apache Hive integration....

11
Experimental
7414 wwsalmon/rl-timeline

"A new way to see Rocket League History" -- Esports datavis with wiki...

11
Experimental
7415 neophyte88/yuki

Yuki - A Tor scraper

11
Experimental
7416 asparton-portfolio/notion-auto-squash-rankings

Python script able to fill a Notion database with the squash french or world...

11
Experimental
7417 mattprodani/FolioWatch

A Python model that takes my portfolio holdings and scrapes websites for...

11
Experimental
7418 EdmundMartin/baiduBot

baidubot is a small package that allows users to scrape search results from...

11
Experimental
7419 cheekeet86/project_3

Games Reddits Classifier (General Assembly SG Data Science Immersive Batch 9)

11
Experimental
7420 abtswath/crawler

An URL crawler created by go-rod.

11
Experimental
7421 OktavioS/python_projects

My collection of Python scripts

11
Experimental
7422 sameer-at-git/Scrape-Site-to-PDF-Distil-Pub

a simple html to pdf converter after scraping each articles

11
Experimental
7423 makannrojelvwp1et/bulk-linkedin-company-scraper-with-website-no-cookies

LinkedIn company profile scraper, bulk processing

11
Experimental
7424 DevSen05/vlr.ggscraper

Passion project, scrapes player's information from vlr.gg, formats and...

11
Experimental
7425 vwkd/samsung-corporate-benefits-carrier-plans-scrape

Scrape Samsung Corporate Benefits carrier plans

11
Experimental
7426 gasparian/fetch_pinterest

Easy way to search and download pins

11
Experimental
7427 sdpetrides/eSuds

Python web scraper deployed on AWS Lambda

11
Experimental
7428 darthSoura/Scraping-test-matches-data

This is a Web scraping project using BeautifulSoup and Python to scrape...

11
Experimental
7429 Sarathisme/google-webscraper

Web scraping of Google Search Results

11
Experimental
7430 ddunne6/house-price-predictor

CS7CS4 Machine Learning Group 7 Project

11
Experimental
7431 bright-jp/Amazon-scraper

検索結果、商品詳細、オファー、レビュー、Q&A、ベストセラー、出品者情報を含む、No.1のAmazon Scraper...

11
Experimental
7432 kami4ka/funda-scraper

Python scraper for Funda.nl Dutch real estate listings

11
Experimental
7433 indiser/Regulatory-Compliance-Sentinel

An automated ETL pipeline that monitors regulatory portals (SEBI) for...

11
Experimental
7434 MckAnissa/crypto-scraper

A Python tool to track cryptocurrency prices and market changes using...

11
Experimental
7435 kami4ka/GratkaScraper

Python scraper for Gratka.pl real estate listings using ScrapingAnt API

11
Experimental
7436 naz445/python-webscraper

Multi-source news scraping tool using Python, Requests and BeautifulSoup....

11
Experimental
7437 Mik3M4n/twitter_outils

Useful tools to scrape twitter: get all replies to a list of tweets,...

11
Experimental
7438 ornscar/ws_ghibli

Scrapeando (ou raspando) a página do Studio Ghibli, na Wikipédia.

11
Experimental
7439 matthieuvion/match2kd

Save thousands of API calls. Custom model & dataset aiming at predicting a...

11
Experimental
7440 tomaszcekalo/UfcComScraper

Scraper for ufc.com site

11
Experimental
7441 WasifSohail5/Real-Estate-Automation-System

A comprehensive solution for real estate agencies and property managers to...

11
Experimental
7442 mickeywmoore/scrapy-quotes-tutorial

My first web scraping project using the Scrapy framework, following the...

11
Experimental
7443 herrerovir/Web-scraping-chemical-producers

End to end data analysis project on the largest chemical companies in the...

11
Experimental
7444 Temela/Python-Project-for-Data-Science

📈 Analyze stock market trends using Python, web scraping, and real-time...

11
Experimental
7445 Peris-Wallace/Reddit-Product-Sentiment-Analytics

This project focuses on extracting and analyzing social media data from...

11
Experimental
7446 Erick-Salas/FindJobsInCostaRicaAutomation

UI Web Automation to get information about a selected job name from multiple...

11
Experimental
7447 sanyabeast/imprint

Imprint is a lightweight, declarative DOM scraping library for extracting...

11
Experimental
7448 rubenperezm/rae2anki

Anki flashcards generator for the Spanish TV show Pasapalabra.

11
Experimental
7449 Vylax/daily_ai_feed

An automated Python pipeline that leverages the Google Gemini API to...

11
Experimental
7450 Romtaug/EtherScam

Détection automatisée des arnaques et comportements frauduleux dans les...

11
Experimental
7451 tvey/usefulness

Various utils and snippets proved useful :wrench:

11
Experimental
7452 Romtaug/Scoring-SP500

Scoring et création de portefeuilles SP500 via scrapping Wikipédia et envoi...

11
Experimental
7453 ganevaaaa/web-vuln-scanner

A Python-based web vulnerability scanner to detect SQLi, XSS, and more. This...

11
Experimental
7454 mscandan/cs-quotes-twitter-bot

Basic web scraping app with twitter api

11
Experimental
7455 ThiruvarankanM/WebAgent_AI

A web application that summarizes the content of any public web page using...

11
Experimental
7456 hemusuku86/fastly_browser_check_reverse

pypi's ahh thing reverse engineered cuz it was too easy

11
Experimental
7457 chaves/ETSY_trends

Follow a sample of Etsy shops

11
Experimental
7458 LakshayD02/Web_Scraping_Python

This repository contains a Python program that scrapes product information...

11
Experimental
7459 CzarX86/TwitterTopBot_Python

Customize Twitter searches and analyze trending tweets with this open-source...

11
Experimental
7460 mvmendes/lambda-services

collection of serverless microservices deployed on AWS Lambda, featuring a...

11
Experimental
7461 jacygao/spiderman

A simple web crawler that crawls a website n-links deep and calculate the...

11
Experimental
7462 BennetLe/python_manga_scraper

This is a Python program to download a manga from Manganato.com. Every...

11
Experimental
7463 thedivtagguy/movie-ratings

🎬✂ Scraping movies from Common Sense Media

11
Experimental
7464 FANIMAN/blockchain-price-tracker

Project designed to track and display cryptocurrency prices in real-time....

11
Experimental
7465 issamoxix/EzScraper

Scrape table from website and save them to a .csv file

11
Experimental
7466 phosphore/EML-email-carving

Extract "From", "To", "Cc", "Bcc" fields from .eml files (useful for email...

11
Experimental
7467 bertrandmartel/covid19-nyc-vaccine-tracker

Covid19 NYC Vaccine Tracker data extracted from Tableau

11
Experimental
7468 mddunlap924/Daily-Object-Detection-Pipeline-YOLO-AWS

An automated pipeline that performs daily object detection on Columbus...

11
Experimental
7469 salvatorecorvaglia/nft-explorer-algoscraping

Python script that downloads the list of all the public addresses that have...

11
Experimental
7470 Ronit-Roushan/LNCT-Attendance-APIs

A flask based web application which provide APIs to get data about the...

11
Experimental
7471 piotrszacilowski/olx-flat-alert

Bot that sends notifications about new apartments from olx.pl according to...

11
Experimental
7472 Yarden-zamir/install-mssql-odbc

Action for installing odbc drivers for mssql

11
Experimental
7473 MaamounBenhafsa/nemoscan

Nemoscan is a script For Get Information About Targets Using Online API That...

11
Experimental
7474 luminati-io/twitter-scraper

Twitter (X) Scraper provides a free scraper for small-scale projects and an...

11
Experimental
7475 aksh-patel1/parallel-web-scraper-on-cloud

This project demonstrates an event-driven architecture for parallel web...

11
Experimental
7476 Clock-Skew/seopie

SEOpie is a comprehensive Python-based utility designed to analyze various...

11
Experimental
7477 bestmahdi2/Uni__ContactManagementSystem

A university project in which a Content Management System (CMS) is designed...

11
Experimental
7478 Sumdiboii/serp-api-web-crawler-summer-internship-pccoe-public

This full-stack web application was developed as a summer internship project...

11
Experimental
7479 Gallillio/WebScraping-DataCleaning-IMDb_Videogame_Webscrapper

IMDb Web Scrapper using Python. The scraped data is automatically data...

11
Experimental
7480 Polytech-Paris-Saclay/polytech-discord-bot

Bot pour le Discord Polytech Paris-Saclay | Scrapper des notes sur Oasis...

11
Experimental
7481 maskedsyntax/covid-tracker

Qt app to keep a track of Covid-19 records of different countries.

11
Experimental
7482 justinliu23/stockscrape

Web scraping for personalized stock tracking

11
Experimental
7483 3wille/fanticket_scraper

Scraper and Telegram Bot for FC St.Pauli second-market tickets

11
Experimental
7484 carlosdg/SimpleWebSearchEngine

Have you ever wondered how to build a very simple Google and run everything...

11
Experimental
7485 jrzvnn/pop-names-scraper

Python web scraper that extracts most popular names in the Philippines

11
Experimental
7486 davide-coccomini/Publication-Tracker

Software to allow people to explore the information about authors and their...

11
Experimental
7487 g-popovic/teams-autojoiner

Web scraper that automatically joins online meetings, so that you don't have to.

11
Experimental
7488 vivekkumar2696/spotify-lyrics-chrome-extension

Get lyrics of the current playing song in Spotify Web - WIP

11
Experimental
7489 MaximeVerdy/little-scraper

Scraper node express axios cheerio

11
Experimental
7490 TheDivineOne/odysee.py

OdySee video metadata lookup API

11
Experimental
7491 RenatoCap/Web-Scrapping

El proyecto consiste en la recopilación de información de documentos...

11
Experimental
7492 peakpanda/Bing-API-Searchengine-PHP

An open-source search engine built with PHP and the Bing Search API....

11
Experimental
7493 meaqese/private-apis

Что делать если у нужной вам компании нет официальной API? Найти...

11
Experimental
7494 luiswirth/crawler

An asynchronous web crawler.

11
Experimental
7495 Aravindhan-G/Profile_Scrapper

Bot to scarp user profile data in Linked-in .

11
Experimental
7496 AnshShrivastava/SPY_WEB

A python based web crawler

11
Experimental
7497 eehwan/courtAuctionCrawler

대한민국 대법원 부동산 경매시스템에서 경매 매물 정보를 자동으로 수집하는 Python 기반 크롤러입니다.

11
Experimental
7498 elalbaicin/progarchives

Uma rotina para colher os dados de discos do ProgArchives.

11
Experimental
7499 exentio/twitter-to-pixiv-migration

Finds your Twitter followings' Pixiv accounts and automatically follows them

11
Experimental
7500 brocla/scrape_sharepoint

SSPI Authorization and Web Scraping on SharePoints

11
Experimental
7501 laurascocco/Videogames-Analysis

Project analyzing video game data, using Python for scraping reviews from...

11
Experimental
7502 capturr/price-extract

Performant way to extract price amount and metadatas (currency, decimal &...

11
Experimental
7503 JesusDR01/scrapeJIT

scrapeJIT is a CLI which allow you to get content from a website and manage...

11
Experimental
7504 HariKrishna-28/GoSearch

Search Engine that scrapes google search results

11
Experimental
7505 mikah13/UptoTech

An application to compile and display blog posts from the top tech companies...

11
Experimental
7506 gamingflexer/twitter-account-analysis

Twitter Account | Sentimental Analysis

11
Experimental
7507 falcononrails/scraper-seloger

A scraper for seloger.com built using Scrapy.

11
Experimental
7508 halfcreative/websearch

Python search engine

11
Experimental
7509 saadejazz/di_ekaf

Fake ID Generator -- Python requests

11
Experimental
7510 Abdelrahman-tlayjeh/micro-apps

python-based tools for automating some operations.

11
Experimental
7511 talsan/ssrn

Scrapes SSRN Abstracts: first by searching for abstract urls (by JEL code),...

11
Experimental
7512 SakuraPuare/HBUAS_jwxt

湖北文理学院强智教务系统自动化工具 | Automation tool for HBUAS Qiangzhi academic system

11
Experimental
7513 Abdulrahmankhaled11/Yala-Motors-Website-Scrapping

Web Scraping project for one of the most famous Arabic sites for selling...

11
Experimental
7514 ZoroTech/Curriculum_downloader

A Python script for downloading curriculum PDFs, scraping data, and...

11
Experimental
7515 hidoominik/spotify-playlist-generator

A Python program that scrapes data on the top 100 songs from a specified...

11
Experimental
7516 Shreesh8/Data-Extractor

A lightweight data extraction tool that collects, processes, and structures...

11
Experimental
7517 codershiyar/web-content-scraper

A fast and powerful web scraping tool built with Python. Boost your data...

11
Experimental
7518 matthieuvion/lmd_ukr

Custom dataset of Le Monde (236 k comments), 1-year-coverage-on-Ukraine &...

11
Experimental
7519 NasroelLah/api-wilayah-indonesia

API Wilayah Indonesia – REST API dan scraper untuk data wilayah...

11
Experimental
7520 Diegiwg/serebii-pokemon

Este é um projeto Python de raspagem de dados de Pokémon do site Serebii e...

11
Experimental
7521 SireJeff/PROJECT-LIBERTAD

A dual-purpose Python project featuring a Dockerized Telegram proxy scraper...

11
Experimental
7522 VincentGerard/Ebay-Web-Scrapper

A basic python web scrapper for Ebay-Kleinanzeigen.

11
Experimental
7523 CallumAS/Medium-Fuser

MediumFuser - Creating a free medium news feed that bypasses restrictions...

11
Experimental
7524 code-alchemist01/github_email_scrapper

Bu Python tabanlı bot, GitHub kullanıcılarının takipçilerini tarayarak...

11
Experimental
7525 angryred027/Dashboard-Vuexy-Next.js

ReddKarma用のRedditスクレイピング検索ダッシュボードサイト

11
Experimental
7526 NightMachinery/r_HPfanfiction

r/HPfanfiction archived in plain-text org-mode (good for, e.g., doing...

11
Experimental
7527 hemusuku86/MTCaptcha-solver

MTCaptcha Solver

11
Experimental
7528 meee-low/web-of-marvel-characters

Scrapes and visualizes data from https://marvel.fandom.com/wiki/. Shows the...

11
Experimental
7529 techcentaur/Lyrics-scraper

Scrapes the lyrics of songs.

11
Experimental
7530 bitsmuggler/ai-product-price-search

Example Google Shopping Price Scraper with Stagehand + OpenAI

11
Experimental
7531 alimghmi/ice-client

Web scraper for ICE (Intercontinental Exchange) Markit Settlement Prices....

11
Experimental
7532 Ahmed-GoCode/Proxy-Scraper-Checker

Minimal Python script that scrapes public proxy lists and threads checks to...

11
Experimental
7533 DebanilBora/flight-deals

Python project that tracks cheap flight deals using Amadeus API, Sheety...

11
Experimental
7534 peixotojeff/ProjetoWebScraper.py

Projeto para scraping de anúncios de vídeo na Facebook Ads Library, com...

11
Experimental
7535 ssinix/crag-to-competition

Climbing Performance Analysis: Does outdoor sport climbing success (8a.nu,...

11
Experimental
7536 calfarfremeg7h8/lowe-s-extractor

Lowes product data scraper

11
Experimental
7537 MaklonFR/Youtube-Comment-Sentiment-Analysis

Submission Dicoding Indonesia - YouTube Comment Sentiment Analysis

11
Experimental
7538 rameez543/link-fetcher

this program fetches all the links from any website

11
Experimental
7539 vanila-io/automatio

Public repo of Automatio.co for reporting bugs, fixes, issues and reading...

11
Experimental
7540 LeonardoSalvucci/big-bang-theory

Open API for query serie cast, scrapped from IMDB - Frontend with Astro,...

11
Experimental
7541 aecio/gp4c

GP4C - Genetic Programming for Crawling

11
Experimental
7542 Mario662629/Logo-Collection

Collecting sports logos in original hex colors and resolutions from logo packages

11
Experimental
7543 oxylabs/integration-python-requests

A guide for integrating Oxylabs Residential and Datacenter Proxies with...

11
Experimental
7544 JakeRutherford/rightmove-filtering

Rightmove does not let you filter properties by number of bathrooms, floor...

11
Experimental
7545 oxylabs/how-to-build-web-scraper

Step by step guide to building a web scraper with Python

11
Experimental
7546 rezkhaleghi/digimovie-scraper

Simple Rust-based web scraper designed to collect movie information and...

11
Experimental
7547 fabrizio94tr/python-seo-tool

A lightweight Python tool to analyze web pages for SEO best practices...

11
Experimental
7548 daniel-leal/homily-ai

AI-powered homily generation application that generates homilies in...

11
Experimental
7549 CamelCod/youtube-success-analyzer

🎯 Transform YouTube channels into actionable insights with comprehensive...

11
Experimental
7550 SamiraSiavash/Perfume_Scraper

A complete web scraping pipeline built with Python, Requests, BeautifulSoup,...

11
Experimental
7551 kami4ka/viagogo-scraper

Python scraper for Viagogo event listings using ScrapingAnt API

11
Experimental
7552 kami4ka/twickets-scraper

Python scraper for Twickets.live ticket listings using ScrapingAnt API

11
Experimental
7553 maelgoujon/moodle-resource-downloader

Téléchargeur de ressources et quiz pour Moodle sans API.

11
Experimental
7554 IPRoyal/python-web-scraping-guide

A complete step-by-step Python web scraping guide for 2025 - learn how to...

11
Experimental
7555 atharva-lipare/price-tracker-android

Android app to get the cheapest way to buy any product and to track product...

11
Experimental
7556 101t/odoo-partners-scraping

Odoo Partners Scraping using BeautifulSoup and Requests

11
Experimental
7557 JamsterJava/raycast-irish-dictionary

Raycast extension that accesses the main online Irish dictionaries,...

11
Experimental
7558 kami4ka/skiddle-scraper

A Python scraper for extracting event listings from Skiddle.com using ScrapingAnt API

11
Experimental
7559 cqmeronn/Its-on-Sale-Tracker

An automated data pipeline for tracking and alerting on product price...

11
Experimental
7560 Transformers-GANG/Influence

Influence IQ is a platform to rank current influence of Internet Personality...

11
Experimental
7561 MathCodeLab1/portfolio_projects

Python automation , data cleaning & web scraping potfolio.

11
Experimental
7562 divulgacheur/gr20-bivouac-checker

Script Python pour surveiller automatiquement la disponibilité des bivouacs...

11
Experimental
7563 okozolin/SearchPages-Node

NodeJs project. Scrape bookmark urls for searching desired info

11
Experimental
7564 ajisyahroni/scrapping-node

scrapping-node

11
Experimental
7565 returnyso/capsolver-spanish-examples

Colección de ejemplos en Python, Node.js, Rust y Go para resolver captchas...

11
Experimental
7566 Servus-Altissimi/StudyGo-nr-Anki

Zet StudyGo URLs om naar Anki flitskaarten.

11
Experimental
7567 christianfabi/instagram-tiktok-leads-scraper

Instagram & TikTok Lead Scraper

11
Experimental
7568 bright-jp/Mobile-Proxies

信頼性が高く高性能なモバイルプロキシを、7M+のIPでご利用いただけます。実際のモバイルネットワーク上で、本物のジオターゲティングされたWebスクレイピン...

11
Experimental
7569 bright-jp/Shared-Proxies

シームレスでコンプライアンスに準拠したWebスクレイピングのための、100M+のIPを備えた信頼性が高く高性能な共有プロキシです。無料でお試しください!

11
Experimental
7570 vedantvisoliya/Flutter-ChatGPT-Clone

ChatGPT AI Clone

11
Experimental
7571 SoumyaMukhija/pyshop

A tool for extracting and comparing prices of a book from amazon, flipkart...

11
Experimental
7572 shishirRsiam/WebScraping-With-Python

A beginner-friendly Python project that demonstrates how to scrape data from...

11
Experimental
7573 baslare/euroleague

A pretty comprehensive analysis of EL data from the EL API

11
Experimental
7574 rvaughan/coronavirus-data

All the raw datasets I can find for Coronavirus data.

11
Experimental
7575 D1918/telegram-music-bot

Telegram Music Bot written in Python.

11
Experimental
7576 OstinUA/App-Ads.txt-mass-Checker

Professional AdOps utility for high-performance app-ads.txt validation....

11
Experimental
7577 DeepanNarayanaMoorthy/What-Does-BLM-Say

This is an analysis on Black Lives Matter Tweets from Normal People and News...

11
Experimental
7578 steve2700/rankcraft-ai

User Input → Keyword Research API → Competitor Analysis → Content...

11
Experimental
7579 divyansha1115/UNIX-Command-Line-Prediction

This repository provides an insight into ventures of framing an intelligent...

11
Experimental
7580 tozastation/Line-Bot

APIとスクレイピングを学んでいたので作ってみました。自身では初めての成果物です。

11
Experimental
7581 sennhvi/python-scraping

python网络数据采集一书代码,使用Python 3,并修改书籍中大量错误

11
Experimental
7582 hartblanc/CardRates

Scrapy spider for retrieving Mastercard and Visa exchange rates

11
Experimental
7583 tanersekmen/mackolik_web_scraping

Pulled the matches played on the same day from mackolik.com

11
Experimental
7584 jairaj26/croma-smart-filter

Automatically removes unavailable items and enables continuous scrolling on Croma.

11
Experimental
7585 jjnanthakumar/python-udemycoupon-scrape

Scraping Coupons from techitweets and storing them in an Excel sheet then...

11
Experimental
7586 MadgicDev/smart-contracts-scraper

Scrape Smart Contract addresses inside source code of website. Useful for...

11
Experimental
7587 Tharinda-Pamindu/LinkedIn-Post-downloader

A modern web app to download LinkedIn posts, images, videos & PDFs with a...

11
Experimental
7588 tsitsimis/suits-overused-phrases

Scraping and processing of the TV series Suits transcript to extract most...

11
Experimental
7589 tesserakh/pergikuliner

Restaurant with cuisine in Indonesia

11
Experimental
7590 yngvark/outlook-365-web-calendar-exporter

Scrape Outlook 365 web calendar events to JSON

11
Experimental
7591 Ayrton-Milessi/analisis_ODS_5-7

Rastreo web y web scraping a páginas de interés para destacar las ODS 5 y 7

11
Experimental
7592 admacpherson/Sample-Revenue-Management

Simulating a revenue management case study based on publicly available data

11
Experimental
7593 emami7495/Java-simple-web-crawler

simple web crawler in java

11
Experimental
7594 BitTigerInst/FalconCrawler

GIVE ME THE FIVE!

11
Experimental
7595 jonmac422/chewy-scraper

Chewy product data extractor

11
Experimental
7596 bright-jp/web-scraping-with-google-sheets

Google Sheets の IMPORTXML および IMPORTHTML 関数を使用して Web...

11
Experimental
7597 wanerllubbse/web-crawler

web crawler metadata extraction

11
Experimental
7598 harlasdrucyg/idealista-location-scraper

idealista location data extractor

11
Experimental
7599 fukuiascarrg/twitch-recent-video-scraper-by-username

Twitch video data extractor

11
Experimental
7600 chaelzvaethz/we-work-remotely-scraper

remote job listings extractor

11
Experimental
7601 osanna-locko/Ofsted-Inspection-Reports-Scraper

ofsted inspection data extractor

11
Experimental
7602 depeelalgussz/eksi-sozluk-scraper

eksi sozluk data extraction tool

11
Experimental
7603 rutvikdumre/envio-edu-Flask-Python-Data-Analytics-

A website to raise awareness about climate change, that allows a user to get...

11
Experimental
7604 kathansheth04/Covidapp

The ultimate survival kit during the coronavirus pandemic for iOS and Android.

11
Experimental
7605 kishlayjeet/GitHub-Topics-Data-Scraping

This code is a web scraping script that extracts data from GitHub. It...

11
Experimental
7606 dumisanimagagula/mercedes-benz-dealership-scraper

An end-to-end Python project that scrapes car dealership data from Cars.com,...

11
Experimental
7607 harshit7962/CSE3024-Web-Mining

Lab Assignments of Course Web Mining (CSE-3024)

11
Experimental
7608 IshtyM/IPhone-12-Amazon-Data-Extraction

Data scrapping is done from Amazon web page that contains the list of Iphone 12.

11
Experimental
7609 Sairyo-No-Developers/currency-converter

Welcome, to our webapp, here you can input any currency value of your choice...

11
Experimental
7610 polcats/TweetScraper

A tweet scraping application.

11
Experimental
7611 bradendubois/animal-crossing-wiki-villager-scraper

Scrapes the Animal Crossing Fandom wiki to gather data on New Horizons villagers

11
Experimental
7612 breck7/crawlers

Crawlers for extracting measurements from the web for Scroll datasets

11
Experimental
7613 Mirtia/Inappropriate-YouTube

This repository contains the scripts used to obtain channel YouTube features...

11
Experimental
7614 erik-roger-fuller/art_scraper

a set of Scrapy Spiders and pipelines that scrape articles form prominent...

11
Experimental
7615 shahriar-rahman/Scraping-Crypto-Stocks-in-Finance

Web Scraping Crypto Stock Markets in Yahoo Finance using Scrapy.

11
Experimental
7616 mabushelbaia/NotesForProfessionals

A simple script to download all the programming books from goalkicker.

11
Experimental
7617 yuanyuanzijin/12306-transfer

12306任意次换乘查询,实时监控,支持邮件提醒

11
Experimental
7618 tam0w/poverty_data

Attempting to analyse and estimate poverty indicators at the Indian district...

11
Experimental
7619 arunvemana/searchpro

gives top 5 results of google,yahoo,bing

11
Experimental
7620 nix1707/WebScrapper-BrowserExtension

Scraper Master is a Chrome extension for effortless web data extraction....

11
Experimental
7621 Lorg0n/anitube-ua-lib

Library that parses data from the site anitube.in.ua

11
Experimental
7622 Apichevin/veille_automatique

Automatisation d’une veille IA/Data : RSS → scraping → résumé → e-mail

11
Experimental
7623 Aditya23303/Cricket_Analytics_Project

Comprehensive T20 World Cup 2022 analytics project — leveraging web...

11
Experimental
7624 mahmoodhamdi/downloader-api

A Flask-based RESTful API for extracting direct download links from YouTube...

11
Experimental
7625 Umangsinha-21/MARS-Cosmetics_Data-Analysis_Project

Power BI dashboard project analyzing MARS Cosmetics' product, sales, and...

11
Experimental
7626 proxira/cheap-residential-proxies

Fast, cheap residential proxies in 140+ countries – perfect for scraping,...

11
Experimental
7627 datacollectionspecialist/Scraping-Proxy-Provider

In this article, we will take a deep dive into the concept of proxy servers...

11
Experimental
7628 khaouitiabdelhakim/FreeSquirrelEmail

SquirrelEmail is a Chrome extension designed to make collecting email...

11
Experimental
7629 NightMachinery/htmlmetadata

CLI Nim app that extracts metadata out of HTML. Extremely fast, but might...

11
Experimental
7630 Minagoroshi/DiscordScraper

Simple script to scrape discord usernames or vanities

11
Experimental
7631 chasecmiller/Crumbls-Web-Scraper

Click and point to turn any webpage into an API.

11
Experimental
7632 thepiratex/swappa

A python program to fetch subscriptions from mail, pull the swappa listings...

11
Experimental
7633 kushagra-aa/multlists

A Craigslist Scrapper Application. Mult Lists is an App made with Python...

11
Experimental
7634 Arushi04/Information-Retrieval

This repo contains mini projects in Information Retrieval. Covers indexing,...

11
Experimental
7635 laya-noormonavar/cosmetics-scraping-khanoomi

Data Collection with Python

11
Experimental
7636 aliahmet/web-crawler

Simple Web Crawler with customizable independent backend support.

11
Experimental
7637 luminati-io/B2B-business-dataset-samples

A collection of multiple business dataset samples. Each sample contains more...

11
Experimental
7638 luminati-io/curl_cffi-web-scraping

Use curl_cffi in Python to mimic browser TLS fingerprints for reliable and...

11
Experimental
7639 ZoeLeBlanc/dhq_scraper

A small repository for compiling Digital Humanities Quarterly into a dataset

11
Experimental
7640 lebrancconvas/Python-Scraping

Web Scraping by using Python.

11
Experimental
7641 mo-karbalaee/JSON-HTML-parser

This project aimed to mimic what Gson and Jackson packages do in Java world

11
Experimental
7642 sarthakagarwal18/CodeForces-Stalker

A simple python script, which displays the handles and the ratings of your...

11
Experimental
7643 ckhawks/ig-download-DM-media

Chrome Extension that downloads media (images, videos, and carousels) inside...

11
Experimental
7644 justNoOneHere/EmailScraper

This script allows you to scrape email addresses from a website and its linked pages.

11
Experimental
7645 Jaishreebala/job-scraper

A python script that takes in user input for their field of job search,...

11
Experimental
7646 elliottsmith/bankofparliament.data

Python tools to download data on members of parliament and extract entities,...

11
Experimental
7647 theodoremoreland/LinkedInScrape

Script for scraping LinkedIn company profiles and posts. Local IT...

11
Experimental
7648 mwmdev/w2md

A tool to scrape online content and convert it to markdown.

11
Experimental
7649 ArtyomArtamonov/filmparser

Getting new films from baskino.me

11
Experimental
7650 PyAmirAli/upload_story

Upload Instagram stories with Python

11
Experimental
7651 ivy-phngyn/book-scraper

Terminal app to create a page in Notion database from scraped book...

11
Experimental
7652 milesrack/savnac

Canvas client.

11
Experimental
7653 ttavni/PyWebScraper

A set of functions and classes to help web scraping and simple web audits

10
Experimental
7654 Pibaska/nba-basketball-prediction

O programa neste repositório foi construído com o intuito de ser uma solução...

10
Experimental
7655 jacksonpf1/md-vzla-tg-bot

A Telegram bot to get the current prices of he dollar from various financial...

10
Experimental
7656 AyushSrivastava27/Musical-Time-Machine

A musical time machine using Python, BeautifulSoup, Requests, and Spotipy....

10
Experimental
7657 JesseRai/Public-Holiday-Scraper-Python

Scrapes verified national public holidays from timeanddate.com, from a...

10
Experimental
7658 NomanAhmed234/auto-web-scraper

AI Web Scraper + LLM-Powered Insights is a powerful, open-source Streamlit...

10
Experimental
7659 adel-alaa-dp/ebay_dailydeals_scraper

A professional Scrapy spider that scrapes eBay daily deals across all...

10
Experimental
7660 reservamos/movie-night

Movie Night - Taller de Node.JS para requests y Web Scraping

10
Experimental
7661 anakagung55/WebScrapping-Jora

Here is our Project to collect Job List Data in Australia by Scrapping the...

10
Experimental
7662 MohammedDerouiche/aliExpressReviewsScraper

Web scraping product reviews data from AliExpress.

10
Experimental
7663 whogotpwned/generic-cve-extractor

The Generic CVE Extractor is a Python-based tool designed to automate the...

10
Experimental
7664 devspidr/web-scraper

A basic Python web scraper built using requests and BeautifulSoup. Created...

10
Experimental
7665 preraksudan/ebay_pipeline

Scraping content for insights rendered in .xlsx for insights

10
Experimental
7666 u3ffrzi/options-market-maker-algorithm

Profitable algorithmic trading system achieving 10-15% monthly returns...

10
Experimental
7667 Martial2023/Linkedin-Performance-Analytics-Pipeline

Scrapping et analyses des performances des publications linkedin pour...

10
Experimental
7668 pc8544/Website-Scraping-And-Data-Extraction

Demonstration of scraping data from website and saving the data to a CSV...

10
Experimental
7669 el-pol/mini_scraper

A high-performance web scraper written in Rust that fetches titles from...

10
Experimental
7670 harshitdwivedi011/disaster-response-ai

🌍 AI-Powered Disaster Response Dashboard A full-stack + Supabase platform to...

10
Experimental
7671 desirelovellcom/theCRM

CRM for updating contact by scanning the web / linux base

10
Experimental
7672 ewkt/Depop-Search-Monitor

Lightweight bot that scrapes Depop API and notifies a Discord channel of new...

10
Experimental
7673 Tuxel1/scraper-stala-bw

A Python-based scraper to download data from Statistisches Landesamt...

10
Experimental
7674 Jujulis18/smartdata_tracker

Outil de scraping conçu pour extraire proprement le contenu d’articles en...

10
Experimental
7675 lambdagirl/randomfortune

Omikuji Fortune Telling App

10
Experimental
7676 coolyansh/django_news_site

A simple news site + (Google forms -> JSON converter) built on the Django framework.

10
Experimental
7677 Pugn0/httrack-site-cloner

Tutorial passo a passo para baixar um site completo usando o HTTrack Website...

10
Experimental
7678 tl3049/AutoCheck

Auto check the publication status of a proceeding

10
Experimental
7679 b00rg/vector-born-diseases

Neural network used to identify disease in arachnids or insects

10
Experimental
7680 cmjagtap/VolonTask

I have taken tweets of user and dump those data into Elasticsearch

10
Experimental
7681 jesusvillota/BIS_Scraper

A comprehensive tool for scraping central bank speeches published by the...

10
Experimental
7682 eteskeredzic/zamger-report-scraper

A small R script for fetching Zamger (information system of the Faculty of...

10
Experimental
7683 Mgancita/wikipedia_connection_finder

Web crawling application which finds the most efficient internal wikipedia...

10
Experimental
7684 Anas-Altaf/Multilingual-Dictionary

The MultiLingual Dictionary is an advanced Arabic dictionary application...

10
Experimental
7685 asparuhkostov/tuner

Automatically fetch information and prices for a vinyl record.

10
Experimental
7686 rajeshmn47/scraping_puresults_2023

scraping from pu board website and showing filtered results

10
Experimental
7687 HirojiSawatari/WeiboCrawler

A web crawler which can search Weibo through a keyword

10
Experimental
7688 RodrigoSen4/tech-news-data-scraping

Foi desenvolvido um crawler que realizar raspagem de dados no blog da trybe.

10
Experimental
7689 ZekeRedgrave/PyDoujin-Downloader

PyDoujin is a Python Downloader for Manga and Doujin

10
Experimental
7690 Khalid-Sultan/urban-guacamole

Email harvester that uses Scraping Search Engines and BeautifulSoup

10
Experimental
7691 QRho/Tech_Companies_In_PHX

This is an exploratory career tool using data from the tech companies in...

10
Experimental
7692 reclosedev/stravaweb

Analyze Strava activities on interactive map

10
Experimental
7693 batman-nair/WikiMapper

Create maps of wiki links on how they interconnect with each other.

10
Experimental
7694 wrzadkow/arxivdwnld

A script I use to automatically download and unpack the source of Arxiv papers

10
Experimental
7695 97arushisharma/Web_Search_in_Python

Using python to search the keywords in an audio and opening the searched...

10
Experimental
7696 ismetcanbyk/ML-House-Price-Estimate-App

House price prediction with machine learning

10
Experimental
7697 Krystkowiakk/IMDB-TV-Rating-Predictor

Metis project 2/7

10
Experimental
7698 aayushgit/CollegeScraper

College Scraper A scraping script for scraping data off of the website...

10
Experimental
7699 Mr-Monster-0248/ScrapScan

*DO NOT USE* Python script to scrap Manga scans online and convert them as PDF

10
Experimental
7700 smit-m/DA-projects

This repo includes the web scraping and analytics projects from my work at...

10
Experimental
7701 lebrancconvas/Cheerio-Typescript

Web Scraping with Cheerio by Typescript.

10
Experimental
7702 xadityax/ERP-BITS

Making ERP easier to access. Collecting data made easier.

10
Experimental
7703 evanwinter/transcript-compiler

Scrapes all episode transcripts for a television show.

10
Experimental
7704 M4theus13/Hashtag-treinamento

Intensivão de Python do hashtag-treinamento abordando alguns temas, como...

10
Experimental
7705 alihussein1779/Housing_Analysis_Toronto_vs_Ottawa

An indepth analysis on the cost of renting in Toronto and Ottawa.

10
Experimental
7706 Alihtt/WebScrapping-Cyruscrafts

Web scraping from Cyruscrafts and saving them in an Excel file

10
Experimental
7707 Kadetron/Denex

A script that scrapes information about an anime or manga from myanimelist

10
Experimental
7708 manuelinfosec/imdb-scraper-rs

scraping top 100 movies list from the Internet Movie Database (IMDb) with Rust.

10
Experimental
7709 ABinfinity/Web_crawler

A simple web crawler tutorial.

10
Experimental
7710 datacollectionspecialist/Scrape-Google-Jobs-Results

Scrapeless Google Job Scraping API is a tool for extracting job data from...

10
Experimental
7711 chinmaysharmacs10/The_Fashion_Capital

Repo for clustering model code submission of Flipkart Grid 2.0 Hackathon project

10
Experimental
7712 jpereiran/falabella-utils

Code to scrape information from the Falabella Peru website

10
Experimental
7713 nikolatechie/Movie-Selector

Python web scraping script that selects around 270 movies with the best...

10
Experimental
7714 yds12/gphelper

Web-scraper that aggregates news from some specific sources.

10
Experimental
7715 codenigma1/Python_Specilization_University_of_Michigan

This Specialization builds on the success of the Python for Everybody course...

10
Experimental
7716 PagarciaSima/Amazon-clone-web-scraping

Amazon clone with scraping

10
Experimental
7717 erenalpaslan/movie-providers-kt

Movie source provider Client-SDK re-written in Kotlin with Ktor. A kotlin...

10
Experimental
7718 BugByte14/cradose

Powerful web crawler and search engine built using the Django framework.

10
Experimental
7719 stayml/popular-recent-useragents-list

Quickly generate a list of desktop, mobile, and/or tablet useragent strings...

10
Experimental
7720 fzaca/topic-web-crawler

Web Crawler que permite buscar contenido en una o varias páginas web,...

10
Experimental
7721 aykhans/PostScrape

car data scraper from turbo.az

10
Experimental
7722 Polhovsky/SkiNet

Using deep learning to predict the popularity of pictures from ski resorts

10
Experimental
7723 lebrancconvas/API-Scraper

Web Scraping Playground.

10
Experimental
7724 larifeliciana/Netshoes_scraper

Extração automática de dados do website de vendas Netshoes. (Teste Prático...

10
Experimental
7725 A-Jatin/Web-Scraper

This is a python script by which we can download multiple files with same...

10
Experimental
7726 khamdullaevuz/parser

Parsing web site

10
Experimental
7727 sarahkadar/8bittools

Various scripts for scraping sites with Chiptunes

10
Experimental
7728 waqashamid/face-crawl

A repository to hold all my Facebook Scraping/Crawling Scripts

10
Experimental
7729 praneetmehta/news_segregator

KMeans unsupervized learning algorithm news seggregator

10
Experimental
7730 JcxAu/ReptilePy

This is a web crawler written in Python.

10
Experimental
7731 Cy8erEgo/2ch-fap-finder

2ch-fap-finder allows to find fap threads on 2ch.hk

10
Experimental
7732 deskobar/AgendaFutbolTelegramBot

Bot de Telegram para saber el horario y canal de los partidos de fútbol que...

10
Experimental
7733 Yan-ni/job-market-analysis

Custom ELT pipeline for scraping job listings from 'Welcome to the Jungle'...

10
Experimental
7734 evoluteur/web-scraper-sitemaps

Sitemaps for the Web Scraper Chrome extension.

10
Experimental
7735 brenoxav/news-scraper

Terminal news scraper in Ruby.

10
Experimental
7736 wkrzywiec/eurovision-2021

Web scrapper for getting number of views of YouTube videos of Eurovision contestants

10
Experimental
7737 didaquis/node-scraping-mysql

Example of scraping data from a website and store on database

10
Experimental
7738 manuelernestog/tu-envio-combo-search-bot

Robot para buscar combos en Tu Envio y notificarlos por Telegram

10
Experimental
7739 scrapingbypass/api

ScrapingBypass API for web scraping with Python, Curl, NodeJS, and Java.

10
Experimental
7740 pepelisto/webscrapthings

Collection of Python bots that scrape judicial court websites for case...

10
Experimental
7741 Harshraj1301/Pharma-KOL-Identification

Developed an advanced scoring and network model using Bayesian analysis to...

10
Experimental
7742 CunningDJ/WebScrape

Playing with web scraping. screen_scraper main() method allows image...

10
Experimental
7743 8140171224/Khatrimaza_links

V.0.01

10
Experimental
7744 zippoxer/grape

Grape is a fast CSS-like language for scraping HTML documents.

10
Experimental
7745 rajshrestha86/police-brutality-data-analysis

In this project, we analyze the events after George Floyd’s death. The...

10
Experimental
7746 randomairborne/discord-powertools

Discord PowerShell utilities

10
Experimental
7747 TopreGroup/AIWebscraper

Open Source AIWebscraper built in Python, based on StanfordNLP models

10
Experimental
7748 CarolMoore19/Ski-Resort-Webscraping-Exercise

Convert website information on PA ski resorts into a dictionary for analysis.

10
Experimental
7749 adogb/housing-market-dk

Exploration and visualisation of the housing market in Denmark, using web scraping

10
Experimental
7750 sherlvick/sentimental-analysis_SVM

Sentiment analyis of Amazon product reviews using SVM 'rbf':kernel...

10
Experimental
7751 eyana-m/python-data-dictionary-writer

Add html elements in SchemaSpy pages using Python scripts

10
Experimental
7752 techcentaur/Book-Worm

Given author name get all the books, pages, and information related.

10
Experimental
7753 dilz64/asunime

Anime Streaming Based CLI

10
Experimental
7754 mayankt18/noticepuller

A notice puller designed to pull all the current notices from NIT Durgapur...

10
Experimental
7755 alirezaeftekhari/Search-Tree

Simultaneous search on three search engines Google, Bing and Yahoo

10
Experimental
7756 Splines/bachelor-community-detection-datasets

Datasets used in my bachelor thesis: "Louvain-initialized Genetic Algorithms...

10
Experimental
7757 rini94/manga-scraper

Scrape manga chapters from Mangafox and organise it into folders.

10
Experimental
7758 segalgouldn/course-catalog-parser

Using Beautiful Soup to scrape the courses from Bard College course catalogs...

10
Experimental
7759 Tanuj2552/SchoolSolver-Discord-Bot

A cloud based web scraping discord bot which sends a message in channel...

10
Experimental
7760 Parsankamusa/alx-higher_level_programming

Repo for high level programming specifically for Python programming

10
Experimental
7761 chinomsokoye/alx-higher_level_programming

Python | Data Structures | Algorithms | Object-Oriented Programming | SQL |...

10
Experimental
7762 juanfrilla/linkedin_unfollowers

Who from my contacts on linkedin that I follow, is not following me?

10
Experimental
7763 aenesgur/scrape-youtube-autocomplete

It is an application that scrapes Youtube Autocomplete with Python.

10
Experimental
7764 RedVelocity/distrowatch-remastered

DistroWatch.com Remastered!

10
Experimental
7765 killian31/Wikipedia-Map

Scraping Wikipedia in order to create a map of the concepts around a topic

10
Experimental
7766 humblelad/WOTD

Word of the Day in Terminal via python

10
Experimental
7767 korewatori/imx.to

Some scripts I made to be able to scrape information about a photo album on...

10
Experimental
7768 ourylydibin/reviews-scrapping

This application scraps informations from Flipkart website. You simply enter...

10
Experimental
7769 Mehdi-Guendouz/GL-Project

This is our 3rd year GL project

10
Experimental
7770 saadamir1/mericloset

MeriCloset: Smart fashion discovery across multiple brands

10
Experimental
7771 Gera3dartist/spiders

spiders from official doc #python3.6 #scrapy

10
Experimental
7772 R33vil/Wall-street-bets--WSB--praw

Built using the praw library requires python 3. Functionality includes a...

10
Experimental
7773 suleyman-kaya/aslanlaraltin.com

Live currency and gold table with profit added

10
Experimental
7774 Binaykumar12/Argparse-for-Web-Scraping

Python script for web scraping using argparse, requests, and BeautifulSoup ....

10
Experimental
7775 fatimashehab99/data-pulse-web-scraper

A web scraping Flask API that collects product data from a given URL and...

10
Experimental
7776 vkbandari/seo-comparative-analytics

Data Science work on SEO

10
Experimental
7777 rizkynhidayat/Web-Scraping-IMDb-Top-Chart-2024

Web scraping is a technique used to extract information from websites...

10
Experimental
7778 coding-gene/SCRAPING_DATA-RealEstateProperties

[INDEX.HR] Scrape Real-Estate Properties With Python And Create A Dashboard...

10
Experimental
7779 Alperencode/Best_Movies_Scraping

In this repository i'll scrape the top ranked moveies from [imdb,...

10
Experimental
7780 anupam-io/makDa

A multithreaded web crawler in Cpp using libCurl. The single-threaded...

10
Experimental
7781 JAWAD-ASGHAR/Custom-Search-Image-Scrapper

A Node.js script to fetch image URLs for products using the Google Custom...

10
Experimental
7782 rshks/pinterest-search-and-scrape

A tool for automatically downloading images from Pinterest based on search...

10
Experimental
7783 savka777/reddit-ecosystem-analyzer

Interactive 3D visualization of r/SideProject trends - discover what the...

10
Experimental
7784 calvinmorett/ufc

UFC Data Analysis and Visualizations

10
Experimental
7785 plmercereau/nhs-jobs

A simpler way to browse NHS jobs

10
Experimental
7786 joseortuno/sentinel-scraper

Scraper is a tool for scraping websites

10
Experimental
7787 pedrohcleal/kabum-api-scraper

Scraping (coleta de dados) de produtos do site da Kabum via API

10
Experimental
7788 sam-pop/NewsScraper

📰 Node.js, MongoDB & Mongoose news scraping web-app.

10
Experimental
7789 cltxvz/snapQuiz

Test your memory with AI-generated quizzes based on random images!

10
Experimental
7790 andreaponti5/flaticon-scraper

A simple Python Dash web app to scrape icons from Flaticon

10
Experimental
7791 cs-fedy/wikipedia-crawler

I'm crawling the Wikipedia website, and I want to store them in a...

10
Experimental
7792 knightron0/tunefind

Given a TV show, this program takes all of the songs from the show and adds...

10
Experimental
7793 dkhramov/pharmdnepr

Scrapy-based spider that crawls the Dnipropetrovs’k pharmacies web sites.

10
Experimental
7794 bielrv/iahorro-scraping-jupyter

Web Scraping iahorro with Beautiful Soup and Jupyter Notebook

10
Experimental
7795 spekulatius/link-scraping-test-beautifulsoup-vs-phpscraper

Tasking both BeautifulSoup and PHPScraper to extract links - a comparison of...

10
Experimental
7796 MichaelFarquhar/python-ebay-price-scraper

Python script to scrap ebay prices of recently sold items given a search term.

10
Experimental
7797 vishal-kumar-paswan/Cryptocurrency-Price-List-API

Cryptocurrency price list API using web scraping

10
Experimental
7798 fabyangliu/Practice-for-Web-Crawler-Spider

Python爬虫实战,Practice for Web Crawler and Spider in Python

10
Experimental
7799 pwnbaby/shopee-token-generator

Shopee security header generator

10
Experimental
7800 gabsens/Scraping-Twitter-by-Searching

A proof-of-concept project that scrapes Twitter accounts of Metro and RER...

10
Experimental
7801 BIJOY-SUST/Simple-Web-Scraping-in-Python

A list of resources and introductory notebooks for Web Scraping in Python...

10
Experimental
7802 kevinkietle/NBA-Age-Decline-Project

I complete a full project start to finish researching about when players in...

10
Experimental
7803 IshtyM/Lenovo-Laptops-Flipkart-Data-Extraction

Data scrapping is done from Flipkart web page that contains the list of...

10
Experimental
7804 josetxu1974/Google_Trends

Scrap Google Trends

10
Experimental
7805 sachinsaini4278/Web-Scraping-of-flipkart-products

Simple webscraping of dell laptops from flipkart website.

10
Experimental
7806 cybergeekgyan/LINKEDIN-LEARNING-VIDEOS-DOWNLOAD

Linkedin Learning videos downloader

10
Experimental
7807 JeroenKortus/funda_scraper

A simple web scraper, made with scrapy, to check Funda for new listings and...

10
Experimental
7808 PSavvateev/JobScrapingApp_Indeed.nl

Web scraper to get information about posted jobs in the Netherlands from Indeed.nl

10
Experimental
7809 IMpcuong/scheduling-linear-opt

Linear and Integer Optimization using bus-station scraped dataset

10
Experimental
7810 willhuangongit/Glassdoor-Analyzer

A project for crawling and analyzing public data from Glassdoor.com.

10
Experimental
7811 velibor7/ccscraper

crypto currency scraper

10
Experimental
7812 rjackowens/eBay-Search-Automation-Tools-Revised

Scrapes eBay for listing data and dynamically categorizes into DynamoDB...

10
Experimental
7813 segalgouldn/course-catalog-server

Using MongoDB and Flask to serve up some freshly baked courses.

10
Experimental
7814 Yuri-Castro/scrap-materia-unb

Web scraping for downloading UnB subjects names

10
Experimental
7815 alessandrror/img-downloader-cli

A CLI application script written in Python to learn how to download images...

10
Experimental
7816 DebugDemocracy/dadosabertos-scraper

Scraper to retrieve all metadata from the https://dados.gov.br/ website

10
Experimental
7817 sachs7/Apartment-Bot

A bot that sends you the newest available apartments by scraping Craigslist...

10
Experimental
7818 HasData/email-scraper

This repository provides a collection of practical, easy-to-understand...

10
Experimental
7819 claytomode/search-scraper

scrape search results from http search engines

10
Experimental
7820 TheJoin95/passport-agenda-notification

Recupero disponibilità per appuntamenti online per richieste di passaporto

10
Experimental
7821 nkanven/univers

The web scraper for Cameroon news websites and Youtube

10
Experimental
7822 adel-alaa-dp/telegram-scraper

A Python-based Telegram scraper that reads channel URLs from Excel, scrapes...

10
Experimental
7823 roncapat/NASA-Hirise-DTMs-DEMs-index

Easy access to HiRISE Digital Terrain/Elevation Models

10
Experimental
7824 chilsonite/chilsonite-main

an open‑source rotating proxy system, similar to commercial services like VIP72

10
Experimental
7825 pc8544/XML-Sitemap-Generator

XML Sitemap Generator Powered by Websitecrawler API

10
Experimental
7826 sabamadadi/YouTube-Videos-Analysis

This project analyzes YouTube trending videos to uncover how content...

10
Experimental
7827 moogrocker/synthesizer

An advanced research project focused on generating high-quality synthetic...

10
Experimental
7828 BlakvGhost/flemmar-api

Flemmar API est une application Symfony dédiée au scrapping de torrents...

10
Experimental
7829 luminati-io/scrapy-web-scraping

build a Scrapy web scraper to collect and organize school homework and meal...

10
Experimental
7830 databoutique/Nike-web-scraped-data

Nike web scraped data, on sale on Databoutique.com. Dataset created with web...

10
Experimental
7831 chaw-thiri/clickbait_detection

Clickbait Detector: AI-powered headline classifier using DistilBERT....

10
Experimental
7832 tskhirtladze/agruni-network

Web scraper and co-authorship network visualizer for Agricultural University...

10
Experimental
7833 jsonusuman351/Data_Extraction-NLP_Analysis_Project

This project demonstrates a complete pipeline for extracting textual data...

10
Experimental
7834 ameru/stock-miner-app

web scraping for stonks, shoutout to my boi XÆA-12

10
Experimental
7835 ashutosh229/music-news-aggregator-backend

This is a aggregator backend system which aggregates the news feed from...

10
Experimental
7836 gabsss1/manga4u-api

API for a Manga WebPage using FastAPI and Web Scrapping

10
Experimental
7837 JesseRai/ONS-Weekly-Shipping-Indicators-Scraper

Automatically downloads and converts the latest ONS Weekly Shipping...

10
Experimental
7838 hemusuku86/twitter-js_inst

twitter js_inst(ui_metrics) solver / No Browser and Full Python

10
Experimental
7839 Burton-David/lead-gen-pipeline

AI-powered Chamber of Commerce directory scraper using local LLM (Qwen2-7B)...

10
Experimental
7840 aashnajoshi/TaskMaster

TaskMaster is a collection of programming tasks completed during Forage...

10
Experimental
7841 gdifiore/bcs-recreation

bcs-recreation - project aiming to recreate BCS college football rankings...

10
Experimental
7842 george-dominic/cryptopunks-scraping

Scraping cryptopunks NFT data and storing it in a sqlite DB for analysis

10
Experimental
7843 thiagomarqs/f1-standings-api

API that provides the F1 driver standings, team standings and race results...

10
Experimental
7844 Yahlawat/UFC_Data_WEBSCRAPING

A Scrapy-based tool for extracting UFC fight data from UFCStats.com,...

10
Experimental
7845 vijay18399/imdb-crawler

This is a Python script that scrapes Movies and Series on IMDb and outputs...

10
Experimental
7846 SMojtabaE/web-scraper-TopLearn

web scrape using python and beautifulsoup TopLearn website to save topic of...

10
Experimental
7847 ScraperHub/healthline-scrapers

Healthline.com Article Listings and Article Page Scrapers. To handle JS...

10
Experimental
7848 ottles91/PokeFamilyDex

Generates a National Dex–ordered list of Pokémon grouped by evolutionary...

10
Experimental
7849 Marco90v/scrapingAbogadosPr

scraping a tribunalelectronico

10
Experimental
7850 LouisChrr/py-lyrics-scraper

Lyrics Generator -- Genius Lyrics Scraper v1.0

10
Experimental
7851 kurpau/set-scraper

Stock Exchange of Thailand (SET) F45 EPS report scraping bot

10
Experimental
7852 Diegiwg/beecrowd-challenges-extractor

Script de raspagem de dados, dos desafios do site Beecrowd, em português,...

10
Experimental
7853 luminati-io/httpx-web-scraping

Web scraping using HTTPX in Python, covering setup, advanced features,...

10
Experimental
7854 atul-1511/Targeted-YouTube-Advertisements

Classification of YouTube Videos into Threat and Non-Threat

10
Experimental
7855 anhvung/csgo_pro_matches_analysis

Bookdown source files for EDAV final project

10
Experimental
7856 slsriehl/opinionater

bootcamp project, scrape the Daily Kos and save articles

10
Experimental
7857 ej-f/count_jobs

A simple Bash script that shows the number of job offers available by country

10
Experimental
7858 chayuto/web-extract

python web extract

10
Experimental
7859 prokawsar/Scraping

Website data, personal information, emails, links Scraping in PHP with cURL library

10
Experimental
7860 dullibri/zeit-2

Analysis of web-scrapped news articles of DIE ZEIT. Construction of a...

10
Experimental
7861 Jefersonalves/congresso-scraper

Scraping das proposições/materias e discursos do congresso usando o scrapy

10
Experimental
7862 gsauthof/openmensa

Open Mensa Feed v2 Generators

10
Experimental
7863 v-nakon/vk.com_parse_user_from_group

vk.com parse user from group and write to file

10
Experimental
7864 tburakozdemir/Web_Scraping

Simple web scraping examples

10
Experimental
7865 yurihs/brioa_port

Tools for interpreting data relating to the seaport in Itapoá, Brazil.

10
Experimental
7866 louiscklaw/appium-playlist

my appium sandbox

10
Experimental
7867 antimattercorrade/Scholaris

A crowdsourced search engine, which will return the specifics about...

10
Experimental
7868 paritosh-34/google-map-reviews-scraping

Scrape all the reviews on a Google Maps link. This project is for...

10
Experimental
7869 raghu9189/java-code-snippets

here , Java exception handling things , problems i have explained few things .

10
Experimental
7870 ricardotachinardi/scraping-example

Projeto de web scraping para exemplificar algumas boas práticas

10
Experimental
7871 Philippe-Guerrier/scrape-llm

Small Python scraping + LLM pipeline with strict resource/output caps. Works...

10
Experimental
7872 salhernandez/twitter_scrape_gui

Shows the pictures of the selected user and displays the local user network...

10
Experimental
7873 Alberto12x/Pinterest-Analyser

Analizador de Pinterest desarrollado como proyecto final de la asignatura...

10
Experimental
7874 avakado0/realtor_scraper

This scraper written in Scrapy framework extracts price, open address and...

10
Experimental
7875 Kamii114/Irandoc-Coword

This repository analyzes academic theses related to Dr. Babak Teimourpour...

10
Experimental
7876 j-e-d/SismosArg

Bot that publishes INPRES quakes to twitter.

10
Experimental
7877 lunajulio/HTML-To-Trees

Draw a tree taking into account the tags of a web page by scraping it.

10
Experimental
7878 renehlavova/bike-scraper

A tiny scraping project in Python

10
Experimental
7879 AchrefBY/Web-Scraping-Utility

Python web scraping utility for data extraction.

10
Experimental
7880 hanyuanz2000/EconomiCrawler

Automates weekly web scraping using Scrapy, shell scripting, and cron job...

10
Experimental
7881 AlbyCosmy99/eurobet-site-scraping

A Node.js project that scrapes live betting data from Eurobet and saves...

10
Experimental
7882 sebaiturravaldes/scraping-union-arena

En este repositorio podrás encontrar el código fuente generado en el curso...

10
Experimental
7883 MaxHou-infinity/MD_knowledge_great_again

网页爬虫与Markdown清洗工具

10
Experimental
7884 su-mana-s/Banking-and-Finance

Banking Risk Management Framework

10
Experimental
7885 siddhant-savant/ml-brand-detection

ML-powered brand detection and market analytics system. Uses TensorFlow 2...

10
Experimental
7886 akunna1/Web-Scraping-Movie-Names

Web Scraping movies names from script website with Python's Beautiful Soup

10
Experimental
7887 siddheshrm/StalkStock

Effortlessly track product availability and stay updated with email alerts....

10
Experimental
7888 Noursalem2005/Web-Scraping-Project

A basic web scraping project for educational purposes. It demonstrates how...

10
Experimental
7889 oxylabs/proxy-integration-with-parsehub

ParseHub is a convenient low-cost tool for scraping public data from...

10
Experimental
7890 kshitijabanala/Projects

This is a compilation of my data science projects.

10
Experimental
7891 tphummel/onroto-standings-scraper

scrape onroto.com daily standings

10
Experimental
7892 tmcdonald92/Web-Scraping

Using BeautifulSoup to web scrape Darty

10
Experimental
7893 rinatiwari/Mission_mars

Mission to mars : scraping website of NASA about mars weather, images and...

10
Experimental
7894 8140171224/Web-Scraping

Web scraping, web harvesting, or web data extraction is data scraping used...

10
Experimental
7895 nicolelumagui/FTW-Capstone_Second-Hand-Cars-in-PH

This is a capstone project for FTW Foundation Data Science program that...

10
Experimental
7896 karlyndiary/Amazon-Web-Scraping

Web Scraping using BeautifulSoup [Python]

10
Experimental
7897 AlbusDracoSam/Data-Science-Salary-Project

Predicting the Data Scientist salary.

10
Experimental
7898 Muhammad-Usama-07/WebScrapingWork

This Repository is all about to work with Web Scraping using python.

10
Experimental
7899 mohammed-alhusaini/movie-info-agent

Scrapes VOX Cinemas to show live movie listings with a Gradio interface

10
Experimental
7900 jordanho1006/python-projects

Explore my data-driven journey! This repository showcases a collection of...

10
Experimental
7901 KoketsoMangwale/We-Buy-Cars

Data analysis of second-hand hatchback vehicles from the WeBuyCars...

10
Experimental
7902 RushanKhan1/deepl-translate-scraper

A scraper that scrapes deepl.com to translate any language to any language...

10
Experimental
7903 Kirankumar6251/Laptop-Price-prediction-with-Reccomendations

Use of machine learning models, for predicting laptop prices based on...

10
Experimental
7904 rociobenitez/cloud-data-architecture-running-shoes

Arquitectura cloud escalable para recopilar y analizar datos de zapatillas...

10
Experimental
7905 LauraMarieRoss/Mission-to-Mars

Automated web scraping project using Jupyter Notebooks, BeautifulSoup, and Splinter.

10
Experimental
7906 futuresea-dev/Event-Scrape

www.trisignup.com event scrape

10
Experimental
7907 jeffthedeveloper/Applied-Data-Science-Capstone-End-to-End-Analysis-with-Python-SQL-and-Machine-Learning

🎓 Capstone IBM Data Science: Análise ponta a ponta com Python, SQL & ML em...

10
Experimental
7908 amoghshakya/WikiTLDR

Comparison between the English and Simple English Wikipedia summaries

10
Experimental
7909 gucaselo/MSA-Project

A look into Mass Shootings in America (MSA) in the last 4 years. Created an...

10
Experimental
7910 TebasMartinez/DA-HIV-PrEP

Data Analysis: HIV and PrEP. Project created for Week 10 of Ironhack's Data...

10
Experimental
7911 bpieszko/WebCrawler

Webcrawler written in C++.

10
Experimental
7912 KompocikDot/allegro-scraper

Simple allegro.pl scraper

10
Experimental
7913 olucascruz/dollarTomorrow

Projeto em que eu busco dados do dólar, treino um modelo de predição e...

10
Experimental
7914 abanobmossad/job-aggregator

job aggregation service made with nodeJs

10
Experimental
7915 ArnelMalubay/Marvel-Predicting-Appearances

A simple data science project that involves web scraping, data cleaning and...

10
Experimental
7916 speed676/web_scrapping_nodejs

Probando en nodejs como hace web scraping con express, request y cheerio.

10
Experimental
7917 MetaDr0me/Scraping_for_clues

scraping clues from J! archive, a fan-run site for Jeopardy! clues

10
Experimental
7918 AhmedAmirBC/inflation-project

Scraping inflation data from the web, and storing it in a form that is...

10
Experimental
7919 Saurav-Navdhare/TakeHomeAssignment_FrontPage

Scrapes YCombinator news, processes data, serves APIs, implements Prometheus...

10
Experimental
7920 jcjv86/song-recommender

Spotify song recommender based on features or related artists

10
Experimental
7921 stacksapien/scalable-nodejs-web-crawler

A NodeJS based web-Crawler which scales on the go!

10
Experimental
7922 ruwiss/stackoverflow-videomaker-bot

Stackoverflow Soru Cevap içeriklerini Video haline getiren örnek bir otomasyon

10
Experimental
7923 luanasa/ResumoDiarioApp

Agente de IA que cria um resumo diário personalizado, combinando notícias de...

10
Experimental
7924 jorgeandrespadilla/rmp-ai-assistant

Rate My Professor AI Assistant

10
Experimental
7925 Madi-S/2gis-parser

Yet to be implemented 2gis parser written in Go.

10
Experimental
7926 lukas-bunat/web-scrapenator

A web app that lets a user create a script that can scrape data from a given URL.

10
Experimental
7927 italovisconti/Scraping-ML

Script que exporta datos de productos de ML a Excel mediante Scraping y magia

10
Experimental
7928 aklampert/county_radius_scraper

Allows one to easily scrape zip metadata. The current paths are zips within...

10
Experimental
7929 mattemugno/Used-car-price-predictor

Project for the Data Mining and Machine Learning course, that aims to...

10
Experimental
7930 evjeny/telegram_channel_extractor

Script for parsing Telegram channels

10
Experimental
7931 reinelt88/smart-article-summarizer

Smart Article Summarizer is a lightweight AI-powered web app that extracts...

10
Experimental
7932 JonOlav95/finn_scraper

Scraping https://www.finn.no/

10
Experimental
7933 stav/statira

Medicare/Medicaid lookup automation

10
Experimental
7934 Sandreke/Temperature-Data-Analysis-in-Peruvian-Regions

This project aims to get temperature time series data of peruvian regions in...

10
Experimental
7935 GonzaBarberis/calculadora_lnb

Calculadora diseñada para simular y proyectar los resultados futuros de...

10
Experimental
7936 MousaZourob/EssayResearcher

A website that streamlines the research process by showing articles with...

10
Experimental
7937 syedirfanx/web-scraping

A Python-based web scraper that efficiently extracts data from multiple news...

10
Experimental
7938 pritesh-ranjan/Python-Image-downloader

Dowload all the images from a webpage.

10
Experimental
7939 p3l1/changedetectionio-tor

Docker Compose stack for changedetection.io using TOR as HTTP proxy for requests

10
Experimental
7940 gsiddhad/Data-Analytics-Python

Data Analytics in Jupyter Notebook

10
Experimental
7941 venkata-naveen-varma-v/ACC_Project_Team_Crawlers

A Real estate search engine, Fall 2022 ACC Final Project

10
Experimental
7942 Kyawkk/Spec-Comparer

Specification comparison of smartphones, Soc, laptops, and cpus using web scraping

10
Experimental
7943 swatijha-2906/github-web-scraping

Scraps the github website to get all issues from top repositories

10
Experimental
7944 AurelliaChristie/Multivariate-Analysis-McD-and-KFC-Nutrition-Facts

All of the code was done in Python, and it covered the topics of Clustering,...

10
Experimental
7945 underwoodbrady/urban-wordle

Wordle clone using words from Urban Dictionary, built with a React front-end...

10
Experimental
7946 Acejoy/Dictionary-Web-Scraping

A simple web scraping project to find meaning of words using BeautifulSoup

10
Experimental
7947 mus1cholic/WCU

2018 HackDuke Project - Wild Chicken University

10
Experimental
7948 Deluxer/amabot

Telegram bot to search products in mazon and Mercado Libre (scraping and...

10
Experimental
7949 akunna1/Web-Scraping-NC-Senators-Data

To scrape data of NC Senators from the NC Legislature website, analyze the...

10
Experimental
7950 dunyaoguz/lyrics_decomposed

🎶 Capstone project for General Assembly's Data Science bootcamp

10
Experimental
7951 yesdeepakmittal/web-scrapping-ecommerce-website-python-app

Web Scraping Python web application to visualize product information

10
Experimental
7952 nassrkhan/Scraping_Preprocessing_Sentiment-Analysis_Frequency-Distribution_Visualization_Classification

This repository provides a collection of code and utilities for various text...

10
Experimental
7953 jiro4989/naro-data

「小説家になろう」のタイトル一覧をスクレイピングする

10
Experimental
7954 MYounus-Codes/multi-query-web-scraper

This project is a Python-based web scraper that processes queries from a...

10
Experimental
7955 giobirkelund/Recipe-Genie-Alexa-Skill

Recipe Genie is Amazon Alexa skill powered by voice and visuals that will...

10
Experimental
7956 kakyoin01/python-web-scraper-example

Example Python-based web scraper program using 'requests' and...

10
Experimental
7957 matthew-martinez/MMAFightScraper

A series of scripts for obtaining and analyzing MMA fight data.

10
Experimental
7958 Elpiu/WebScraping

Progetto Web per scraping di dati su siti web

10
Experimental
7959 aasimkhan0207/Cinepy

extracts names of theatre and their movies from a website

10
Experimental
7960 wanzhuz/web-scraping

web scraping stack overflow

10
Experimental
7961 KubangPawis/wikipedia-knowledge-graph

BeautifulSoup-based Wikipedia crawler that captures page metadata and...

10
Experimental
7962 BBC-Data-Unit/no-DSS-continues

Benefit claimants face landlord discrimination despite ruling

10
Experimental
7963 FerdiaMT/Flask_EtymologyScraper

A Flask API Webscraper that scrapes www.etymonline.com using BeautifulSoup4...

10
Experimental
7964 vonschell/python-portfolio

A collection of Python-based data analysis and visualization projects using...

10
Experimental
7965 harshhes/centris-ca-scrape

Centris.ca is a canadian real estate property listing website. This scraper...

10
Experimental
7966 an-anurag/song-downloader

A handy tool for downloading hindi songs mp3 from various sites. It also...

10
Experimental
7967 abdulrahmans0414/MasteryPython

Master Python by building 100 projects in 100 days. Learn data science,...

10
Experimental
7968 RNFS/google_trends_scraper

Google Trends Scraper

10
Experimental
7969 ProfessorPatrickSlatraigh/CST3512

CST3512 Information and Data Management II, NYC College of Technology (CityTech)

10
Experimental
7970 sostenesapollo/brigaa

Web Crawling of sigaa.ufpi.br UFPI's students class system. Sigaa Schedule...

10
Experimental
7971 MuhammadAlifBudiman/spartapedia

A simple movie review web service built with Flask and MongoDB. Users can...

10
Experimental
7972 dqj5182/Lawyers_Twitter_Turnover

A BeautifulSoup4 (Python library), Tweepy (Python library) implementation...

10
Experimental
7973 cab-1729/SnapChan

**This project is NOT ready for usage.**

10
Experimental
7974 RodriAF/GovernmentDataWebScraping

This code is for doing web scraping to get information from the Spanish...

10
Experimental
7975 BSteiner1/Bushfire-Spread-Prevention-Solution-Challenge-2022

A machine learning based approach to identify wildfires for the 2022 Google...

10
Experimental
7976 mmahdin/mini-projects

Various codes and ideas in different languages

10
Experimental
7977 gcb-umkc/porsche-scrape

In this we take PDFs from the Porsche Newsroom and try to extract meaningful...

10
Experimental
7978 slvg01/95.05_wiki_scrap

Scraping global leaders historical information from wikipedia

10
Experimental
7979 tuke307/cancel-culture-impact

analysis of music celebrity data to check if cancel culture has an impact on...

10
Experimental
7980 AmirUCR/webmd_spider

Use Python's Scrapy library to crawl WebMD and extract the name and usage of...

10
Experimental
7981 benrjbrown/Glassdoor_Web_Scraper

An ongoing project which uses a web scraper build for career webside...

10
Experimental
7982 adhirajpandey/amazon-scraper

Project to Scrape Search Results and Product Details from Amazon

10
Experimental
7983 OleksandrKosovan/sentiment-analysis-uk

Інтелектуальна система аналізу тональності тексту.

10
Experimental
7984 BirdsAreFlyingCameras/PyEnhance

A python library.

10
Experimental
7985 SawanGurjar/NewsCrawler

A Python-based project to search news on a topic, powered by news API.

10
Experimental
7986 Student-FastDev/Tineye-Scraper

Program for scraping data from TinEye website.

10
Experimental
7987 vitorribeiroc/ec_prestacao_contas

Script para automatizar a prestação de contas do programa Empresa Cidadã.

10
Experimental
7988 rajprem4214/Social-Sentinel

A platform for Police Department where police can gather data about an...

10
Experimental
7989 AnirbanBanik1998/Speak_and_Spell

Speak and Spell prototype

10
Experimental
7990 Poova53/Scraping-amazon-products-and-reviews-using-Scrapy

I scraped amazon smatphones data and its reviews and stored it in sqlite...

10
Experimental
7991 bugzmanov/scrappybot

A bot that scrapes and sends updates to a telegram channel

10
Experimental
7992 wfsecs/Proxyscraper

Simple Proxyscraper that checks proxies too.

10
Experimental
7993 olucascruz/beecrowdScraping

Automação que extrai quantidade de problemas resolvidos do beecrowd

10
Experimental
7994 Kajaljain22/Amazon-Price-Tracker

Python app to track Amazon prices of any product

10
Experimental
7995 benedictdebrah/Personal-News

scraped news from citinews and orchestrated with Prefect(Game changer)

10
Experimental
7996 TryGuys/MovieRecommender

Movie Recommendation Web+Desktop App working on both...

10
Experimental
7997 akshatz/Scraping-a-website

Scrapping Project

10
Experimental
7998 ZhaochengLi/Zhaocheng-s

"Give me a lever long enough and a fulcrum on which to place it, and I shall...

10
Experimental
7999 themightyoarfish/hochschulsport

:bicyclist: Super-fast auto-signup for Uos-Hochschulsport courses

10
Experimental
8000 pkb01/scrape_bbc_news_hindi

This project (using python and scrapy) contains 2 spiders for BBC news to...

10
Experimental
8001 mstech66/ScrapingPy

Web Scraping HNGU Results with Python 2.7 and BeautifulSoup

10
Experimental
8002 PatMyron/wpial

WPIAL statistics

10
Experimental
8003 kaymen99/Yelp-scraper

Yelp scraper is a tool to collect business and consumers reviews data for...

10
Experimental
8004 clarknull/newsscraper

A simple news scraper built with newspaper3k, it can be modified to suite...

10
Experimental
8005 rladies-paris/2018-01-24_twitteR_rvest

Analyse sentimentale des tweets avec twitteR, et web scraping de Le Figaro avec Rvest

10
Experimental
8006 nachat-ayoub/MitAnime

MitAnime is an anime website that provides Arabic-translated anime content...

10
Experimental
8007 pradhanhitesh/FENS-JobsAlert

Collecting and mailing FENS Job Postings every week!

10
Experimental
8008 Yuvijadeja/web_scrapper

Simple Python script for scraping websites and collecting structured data.

10
Experimental
8009 webbben/LinkedIn-Web-Scraper

Gets the keywords and tech terms currently popular in LinkedIn job postings...

10
Experimental
8010 debbyalmadea/SiX-Mata-Kuliah-Scraper

SiX Web Scraper untuk mengambil data mata kuliah, kelas mata kuliah, jadwal,...

10
Experimental
8011 bhanukad610/Sinhala-Song-Lyrics-Search-Engine

Song lyrics search engine for Sinhalese language using Elasticsearch

10
Experimental
8012 observatorioobstetrico/workshop_cs2022

Repositório dos materiais apresentados no Workshop Ciência de Dados

10
Experimental
8013 locus-x64/image-scraper

This is a python utility for downloading images from a given hyperlink. This...

10
Experimental
8014 oneEyedSunday/NairalandScraper

A scraper for emails on NL

10
Experimental
8015 anmoljhamb/fedora_media_writer_linux

A simple, command-line tool for Linux users to download the latest official...

10
Experimental
8016 ytsmee/Auto-post-artikel-blogger

Use Google Spreadsheets, go to the apps script extension, copy paste the...

10
Experimental
8017 Sarthak-Mohapatra/Dow-Jones-Stock-Price-Forecasting

Stock Price Forecasting of Dow Jones 30 companies (DJIA) - (2000-01-01 to 2020-25-05)

10
Experimental
8018 kumresh/scrape_imdb

Scrape and Extracting movies details from imdb.com by using pyhton

10
Experimental
8019 gshashank84/Web_Scraping

Implemented Web Scrapers for different task.

10
Experimental
8020 AntonVarsh/SummerizeSubmission

Web-Scraper that summarizes articles and provides visual representations of the text

10
Experimental
8021 Jonqora/VibeCheckMyProf

A project to analyze RateMyProfessor comments for emotional content.

10
Experimental
8022 pratiknabriya/Tracking-Covid19-India-Python-Project

Extracting the latest State-wise data from the official website of Ministry...

10
Experimental
8023 oxylabs/how-to-scrape-imdb

A quick guide to effortlessly scraping IMDb data, such as public movie lists...

10
Experimental
8024 jefang15/Website-Monitor

Website scraping and monitoring

10
Experimental
8025 cher-cheur/popular-movies

Un programme qui crée des animations "chart race" (courses de graphiques)...

10
Experimental
8026 onesse/projetappart

Scraper d'annonces immobilières sur le boncoin

10
Experimental
8027 DarlanSchmeller/python-bootcamp

Projects and exercises from the Complete Python Bootcamp: From Zero to Hero in Python

10
Experimental
8028 taroshg/rowan_courses

Better section tally for Rowan students

10
Experimental
8029 gra-vel/covid-pichincha

Visualization of reported cases of COVID-19 in Pichincha, Ecuador

10
Experimental
8030 udita31/Food-Price-Inflation

Analyzing price trends of 9 essential food items across 4 Indian states (May...

10
Experimental
8031 DouglasMacKrell/venue-ninja

Backend automation project built with Node.js and TypeScript to scrape,...

10
Experimental
8032 PeterM45/email-scrape

Toolkit for extracting email addresses from HTML and remote websites

10
Experimental
8033 Rjchi/anime-api-tsc-server

Api para buscar el enlace de transmisión de un anime en un episodio en...

10
Experimental
8034 soleuniverse101/logseq-web-scraper

A simple plugin to do structured web scraping directly inside Logseq.

10
Experimental
8035 pedrazadixon/latitude-longitude-from-maps

Lightweight, dependency-free JavaScript library for retrieving geographic...

10
Experimental
8036 jansenv/ScraperTutorial

Learning web scraping

10
Experimental
8037 taricov/R_scraping_viz_data

Scraping data tables from HTML files over the web using R, then I used...

10
Experimental
8038 shxntanu/solar-intelligence

☀️ Solar Data Aggregation platform for powerful Data Analytics!

10
Experimental
8039 ashudevcodes/Mini-Web-Scraping-Project

Amazon Web Scraping Project

10
Experimental
8040 GabrielFersPin/FilmAffinity

FilmAffinity Project

10
Experimental
8041 harmanveer-2546/Amazon-Web-Scraping

In this repo, I will be scraping product information from Amazon website....

10
Experimental
8042 arjunrajpal/webapp_instalocate

Real time tracking of flights on Google Maps and retrieval of flight details...

10
Experimental
8043 AjanShrestha/nepse-scraper

Scrapes and serves data from the Nepal Stock Exchange's website

10
Experimental
8044 kokseen1/Chii

A minimal marketplace bot maker.

10
Experimental
8045 ZenHanley/NicoScraper

A Fast , Simple, and Lightweight Web Scraper for Nico's Weg

10
Experimental
8046 u9320831/Lynx

Toutes les offres, en un clic .

10
Experimental
8047 FuadAnalyst/Portfolio-Project-AutoRia

Auto Ria porfolio project. From data scraping to cleaning and creating dashboard

10
Experimental
8048 ni79ls/web-scraper-wordpress-images

This script will help you to migrate posts, pages including a large volume...

10
Experimental
8049 dkhramov/gathering_data_addendum

Дополнительные материалы к книге "Сбор данных в Интернете".

10
Experimental
8050 aleedhillon/image-scrapper

This is Image Scrapping PHP command line app build using Laravel Zero and...

10
Experimental
8051 neospl0it/regexscan

A Tool for scanning and detecting patterns using regular expressions...

10
Experimental
8052 AravindRajeshkanna/arkrawler

Node.js web crawler to crawl the entire web

10
Experimental
8053 WaleedHashmi/Delivery_Scanner

A hackathon project that aims to scrape the food delivery websites to...

10
Experimental
8054 henry-richard7/shows-flix

A new Flutter project that scrapes streaming contents from Asianload.io...

10
Experimental
8055 luminati-io/recaptcha-solver

Solve reCaptchas with Bright Data's advanced AI-driven CAPTCHA Solver,...

10
Experimental
8056 SulimanLab/YoutubeScrapingExtension

Chrome extension for scraping youtube history, since weirdly enough!, google...

10
Experimental
8057 AdrianArnaiz/COVID_timeseries_scrap_and_analysis

Data Extraction and Statistical Analysis in R with COVID-19 data [First...

10
Experimental
8058 codepressed/proxyScraperFrontend

Proxy Scraper is a Java application developed which purpose is to scrape the...

10
Experimental
8059 overengineer/UK-AIP-Scraper

UK AIP Scraper

10
Experimental
8060 alexferrari88/sitemap-scraper

Simple tool to extract website content from sitemaps using CSS selectors and...

10
Experimental
8061 Ron0p/Dashboard

Dataset of 59 ipl match from kaggle named as IPL_Matches_2022.csv,Data...

10
Experimental
8062 nirajmalviya/product-review-scraper

A Python-based web scraper for extracting product reviews from sites using...

10
Experimental
8063 cedric130813/telegram-bot-node-js

This is a Telegram Bot API project using Node.js, with web scraper and...

10
Experimental
8064 redoper1/covid-sk-3

Apify.com actor for scraping data from website...

10
Experimental
8065 samapatil1729/Tools-In-Data-Science

This course will teach students to use popular tools for sourcing data,...

10
Experimental
8066 Sawrav-23/Swiggy_Data_Analysis

Analyzing Swiggy's restaurant data in Bangalore to provide management with...

10
Experimental
8067 othreecodes/newzz-backend

Backend that powers -> https://github.com/othreecodes/NewZZ Basically...

10
Experimental
8068 JackWorld99/Python-Web-Scraping-Jobs

Scrape jobs on recruitment website that match expected salaries, with...

10
Experimental
8069 novlan1/web-crawler-one

爬虫《一个》

10
Experimental
8070 0u44/Github-scraper

Scrape and download a GitHub Users repositories

10
Experimental
8071 ShishirShekhar/Github-Web-Scrapping

This app scrap the GitHub and show summary table of all the trading repositories.

10
Experimental
8072 stephancill/instagram-scrape

Dirtily scrape image links from instagram by tag, name or url.

10
Experimental
8073 ZuzkaK11/Orienteering-in-Slovakia

This project explores orienteering in Slovakia by analyzing data on runners,...

10
Experimental
8074 Anas-Zaki/SAL_BW_Project---Book-Data-Analysis

Scraped and analyzed book data using BeautifulSoup, SQL, and EDA to reveal...

10
Experimental
8075 harmanveer-2546/Implementing-Web-Scraping-in-Python-with-BeautifulSoup

Just implementing basics functions of Beautiful soup

10
Experimental
8076 Ashwin-Dev-P/CoinMarketCap-Scraping

Web scraping task given by Ignis Tech Solutions as a selection for internship.

10
Experimental
8077 ybrenning/hoopy

🏀 Tool for scraping NBA data

10
Experimental
8078 Md-Soliman-Ali/Scraping

🕷 A Smart, Automatic, Fast, and Lightweight Web Scraper for Python

10
Experimental
8079 vladieboi/shopify-collection-scraper

Scrape a Shopify website to output all collections to a file.

10
Experimental
8080 ossama131/ImmoScout24-scrapy-mongodb-docker

Docker image for scrapy based spider to scrape...

10
Experimental
8081 karthikraja001/Gadget-Specs

A console based application built using python to find specification and...

10
Experimental
8082 justinmiller33/SAPS-public

Scraping social media stock discourse and respective financial data.

10
Experimental
8083 yhcwawo/Flask-Web-Scrapper

:rocket: Python과 Flask를 활용하여 replit 환경에서 개발한 구인정보 Scrapper 웹 프로젝트입니다.

10
Experimental
8084 kuang-wei/astro-event-gcalendar

Automatically adds talks to your Google Calendar

10
Experimental
8085 GopeshMv/Ad_Scraping

Minimal scraper tool for extracting useful ads from google.

10
Experimental
8086 Sandreke/Data-Analysis-of-The-500-Most-Influential-People-in-LatAm-2022

This project consits on web scraping name, country, sector and company using...

10
Experimental
8087 deepme987/FakeNewsVerification

A Fake News Detector based on google searches and a magic algorithm to...

10
Experimental
8088 garvitkhurana/Beautiful_soup_web_scraping

Program to extract handy data from websites along with some nice materials

10
Experimental
8089 harshhes/Flipkart-iphone-Scrapper

Flipkart-iphone-13pro-Scrapper

10
Experimental
8090 limchiahooi/web-scraping-rental

This repo contains my web scraping project to extract property rental data.

10
Experimental
8091 eahussein/zebra_imageClassification

A binary image classification problem

10
Experimental
8092 nvaldebenitomolina/download_simulations_esgf_node

Descarga de simulaciones CMIP6

10
Experimental
8093 SaleHunter/Backend

Graduation Project - Product search engine for local products in Egypt and...

10
Experimental
8094 aurelienmorgan/french_text_sentiment

Sentiment Analysis in texts written in French language using...

10
Experimental
8095 databoutique/Allbirds-web-scraped-data

Allbirds web scraped data, on sale on Databoutique.com. Dataset created with...

10
Experimental
8096 yuliianikolaenko/topic-modelling-media

Master thesis project dedicated to the media ideology and discourse analysis

10
Experimental
8097 KadirGokdeniz/FurFetch--Pet-Data-Processing

Project for web scraping and managing data related to pet products in a database.

10
Experimental
8098 mominurr/Walmart-Data-Scraping

walmart product data scraping and bypassing ip blocking, press & hold captcha.

10
Experimental
8099 oleksio-z/scrape_mails

This is simple Python email scrapper that finds and writes into file all...

10
Experimental
8100 adam-ben-rhaiem/Bulk-SMS-Platform

It is full-stack web application that enables users to launch targeted SMS...

10
Experimental
8101 deepankarvarma/Mashup-Generator-and-Emailing---Python

This project is a command-line tool that allows users to download multiple...

10
Experimental
8102 AbssZy/web-crawler

This is a web crawler example with the help of BeautfulSoup4 in Python.

10
Experimental
8103 databoutique/Cettire-web-scraped-data

Cettire web scraped data, on sale on Databoutique.com. Dataset created with...

10
Experimental
8104 hoangdv99/jax

EC scraping tool

10
Experimental
8105 Ram-95/Image_downloader_flask

A flask app to scrape and download images from IB, RG, CJ and Blogspot

10
Experimental
8106 TopazLah/EmpireTracker

C#/.NET tool that collects and analyzes roulette results in real time, with...

10
Experimental
8107 lucia-blanco/wtm-web-scraping

Introduction to Web Scraping with NodeJS (Workshop)

10
Experimental
8108 ChrisVilches/Youtube-Podcast-Frontend

Frontend for Youtube-Podcast. Made with Flutter.

10
Experimental
8109 PhilipS01/greeter

TuCan Infotafel

10
Experimental
8110 Aidoni0797/internship_first_task

Internship task: scraping HTML content using Python

10
Experimental
8111 knetic0/GoMovieApp-WebScraping

GoMovieApp-WebScraping. Movie App with GoLang and Using WebScraping.

10
Experimental
8112 samrat2k03/Ecommerce-Scraper

Amazon, Flipkart and Meesho web scraper using ERN Stack ( ExpressJs, ReactJs, NodeJs)

10
Experimental
8113 jjoeldaniel/linkedin-jobs

swe opportunity scraper

10
Experimental
8114 codingstar77/Automatically-Downloading-Images-related-to-given-Query-

This is small Python script which lets you download and save the images from...

10
Experimental
8115 Artur-at-work/glasshouse

Django app to scrape houses' listings from https://www.century21global.com/...

10
Experimental
8116 spfrantz/vidhan-sabha-2017-scraper

Scrape India's 2017 Vidhan Sabha (state assembly) election results using...

10
Experimental
8117 ssharmapavitra/webcrawler

Crawler is a C++ & Node.js application that allows you to crawl web pages,...

10
Experimental
8118 garyldavis/FBref-Big-5-League-Merge

Scraping FBref data and merging it into one CSV file

10
Experimental
8119 satwikkansal/comprehensive_image_search

Script for scraping/fetching images/gifs from Bing, Google and Giphy for a...

10
Experimental
8120 AmaLS367/parts_info_collector

Automation toolkit for mass collection of spare-part specs using Gemini...

10
Experimental
8121 danieldev0724/telegram-bot-scrapper

telegram bot scrapper

10
Experimental
8122 MohammedAHO/online-offers-detector

In this project, we started with web scraping for restaurants and coffee...

10
Experimental
8123 SwastikUdupa/scraper

This is a custom comand used to scrape imdb and get details

10
Experimental
8124 meta-ks/Deity-Darshan-2.0

A more general Deity Darshan App

10
Experimental
8125 charlesalexanderlee/wikicrawl

A network graph visualization tool for Wikipedia articles

10
Experimental
8126 georgeputhean/web-scraping-projects

This Repo is entirely dedicated to my web scraping projects. I webscrape...

10
Experimental
8127 tegenterter/fide-data

Library for processing open data published by FIDE for PHP

10
Experimental
8128 amirroox/LibGenDownloaderTelBot

LibGen Downloader Telegram Bot

10
Experimental
8129 Braa-GH/MEVN-news-scrapper

this is a Node.js scrapping project on a news website (Arabic), Vue.js 3...

10
Experimental
8130 dsgkirkby/CanucksArmy

Tools used at CanucksArmy

10
Experimental
8131 simondelarue/Vendee_Globe_2020

Data retrieval, analysis and predictions about "Vendée Globe" race (2020-2021)

10
Experimental
8132 parulc7/LearningWebScraping

Practice Repository for learning Web Scraping using Python

10
Experimental
8133 akashsuper2000/malware-webpage-detection

A web application to identify malicious webpages and block them from user

10
Experimental
8134 omaryassin96/UK-Companies-Webscraping

I used Python (along with BeautifulSoup) to automatically collect the...

10
Experimental
8135 rosswelltiongco/CSULB_Class_Search

Finds unused CSULB classrooms to study at in real time

10
Experimental
8136 RodriguesL1/ipea_streamlit

Aplicação Streamlit para análise e previsão do preço do barril de petróleo...

10
Experimental
8137 denisabani/Web-Scraping

This Jupyter file explores the use of Yelp Fusion and BeautifulSoup for web...

10
Experimental
8138 krishpranav/spider

A ruby web spidering tool that can spider a site, multiple domains, certain...

10
Experimental
8139 dexiio/dexictl

Dexi.io command line utility

10
Experimental
8140 Luisgb98/cybersec-bootcamp

42 Cybersecurity Bootcamp

10
Experimental
8141 tonbiattack/line-notify-web-site-update

webサイトの変更を検知してLINE Notifyに通知するPythonスクリプトです。

10
Experimental
8142 Yasmine-Cheng/shopeeWebScrapy

My first case.(with Hannah)

10
Experimental
8143 nicodomergue/api-feriados-argentina

ᴇɴ: API that scrapes a site to get the Argentinian holidays in the passed...

10
Experimental
8144 williamjouse/Prog_archives_scraping

Web scraping and exploratory data analysis of ProgArchives data.

10
Experimental
8145 souheib1/Phishing-Website-Detection

Development of a model to classify phishing sites from legitimate ones. It...

10
Experimental
8146 priscilla-arinze/Most-Common-Programming-Languages

Web crawling project that finds the most common programming languages that...

10
Experimental
8147 KAFSALAH/IBM_DataScience

This repository includes Data Collection, Mining, Visualization, Analytics,...

10
Experimental
8148 marcusmvl/loto_results_scraping

Get Loto results from http://loterias.caixa.gov.br/

10
Experimental
8149 Project-Drop/TodayNews

TodayNews is an Android News Application built using Kotlin.

10
Experimental
8150 tddyer/mlb-statistics-web-crawler

A Scrapy web crawler that gathers lifetime batting statistics for all active...

10
Experimental
8151 GrindSC/Dog-breed-recognition

Convolutional neural network training for dog breed recognition based on web...

10
Experimental
8152 ksondeji/Price-predictions-on-video-game-consoles

Prédiction du prix de consoles de jeux vidéo grâce au web-scrapping et au...

10
Experimental
8153 Rohrym/AZLyrics_Scraper

This is a scraper for the lyrics website AZLyrics. With this scraper you can...

10
Experimental
8154 ermiasgelaye/web-scraping-challenge

web-scraping challenge

10
Experimental
8155 dunyaoguz/subreddit_classifier

🗣 Determine what subreddit a post belongs to, using NLP and classification

10
Experimental
8156 amin-nejad/text-mining

Web scraping and Named Entity Recognition in Python

10
Experimental
8157 HanaZubovic/Mars_Web_Scraping

Web scraping challenge that uses Mars-related websites, scrapes it, displays...

10
Experimental
8158 Prajwalsrinvas/web-scraping

Various Web Scraping projects I've worked on over the years

10
Experimental
8159 nirml08/WebScrapping-Funmovies.com_Data

Project demonstrating WEB-scraping and Analysis of an entertainment website...

10
Experimental
8160 KickItLikeShika/Scraping-Disney-Data

Scraping Wikipedia to gather data about Disney movies and create a CSV file...

10
Experimental
8161 luminati-io/http-headers-with-curl

Use HTTP headers with cURL to improve your data collection and server...

10
Experimental
8162 riazsajidgit/CT2017-Final

Web Scrapping using Beautiful Soup Library. Scraped Champions Trophy 2017...

10
Experimental
8163 AzimNahin/Python-Web-Scraping

Scrapes and processes Fortune 500 company data from Wikipedia into a clean,...

10
Experimental
8164 AnshAviKhanna/Personalized-Diet-Recommender

This project aims to simplify the process of making healthy dietary choices...

10
Experimental
8165 JamesCWeber/British_Airways_Data_Project_Part_1_Sentiment_Analysis

The first task given to me while completing the British Airways Data Science...

10
Experimental
8166 GabrielMesquitaOliveira/AnimeList

High-performance anime rating aggregator API built with Quarkus that...

10
Experimental
8167 gaurav-bhadane/Data-Science

Data Science Roadmap from Scratch to Professional

10
Experimental
8168 pdqnguyen/cod-ttk-app

Call of Duty weapon damage calculator based on recoil simulations

10
Experimental
8169 Ayush1891/Quotes_Analysis

This project involves scraping quotes from the web, performing exploratory...

10
Experimental
8170 KalimAmzad/bikroy-scrapping

Scrapping bikroy.com adverts along with images for educational purpose

10
Experimental
8171 AhmadSubadri/Twitter-Sentiment-Analysis

Sentiment Analysis with jupyter notebook python by Pycharm Edu

10
Experimental
8172 HAFDIAHMED/Extracting-Stock-Data

Extracing Stock data using web scraping , compare Tesla Stocks and Gamestop Stocks.

10
Experimental
8173 fbarffmann/scraping

Automated the extraction of NASA Mars news and weather data using Python web...

10
Experimental
8174 rakeshj13/SpaceX_Rocket_Landing_Intelligence

**SpaceX Rocket Landing Intelligence** uses machine learning to predict the...

10
Experimental
8175 andy-clarke-uofg/Pundits-Review-Scraping

Development of the scraping process used to collect data for the Pundits...

10
Experimental
8176 MurtazaMister/ImageFinder

ImageFinder is a multi-threaded web crawler designed to efficiently extract...

10
Experimental
8177 sandeepkota312/Identification-of-promising-e-commerce-acquisition-targets.

sanitized and analyzed the data to profile the sellers present and develop...

10
Experimental
8178 jkrenick2022/CBB-Transfer-Portal-Tracker

An automated NCAA basketball transfer portal tracker that scrapes new and...

10
Experimental
8179 elixir-formula/elixir_formula

News and Articles from the world of Elixir-lang.

10
Experimental
8180 nur1208/voice-assistant-Ai-for-finance

This project aims to develop a voice-controlled application for finance, a...

10
Experimental
8181 El-Vim55/Scrap

CM4 Web Scraper

10
Experimental
8182 chaudharypraveen98/FlaskTweepy

This bot will extract the data from the the twitter and display the whole...

10
Experimental
8183 babakhabibi/Web-Scraping-With-Node.js-Cheerio

Scraping Huffington articles using Nodejs and Cheerio

10
Experimental
8184 alexsnow348/FX-Key-Eco-Event

A notification engine for alerting key economic events for the trading purposes.

10
Experimental
8185 saglamcem/unite-the-band-crawler

A Node.js application to crawl a web page and notify if the applications for...

10
Experimental
8186 malbiruk/yelp-data-engineering-pipeline

Practical data engineering pipeline that scrapes Yelp data, processes it,...

10
Experimental
8187 ice-ice-bear/Classes-Data-Crawling

class reviews and mid-term project

10
Experimental
8188 Totalus/WebDataFetcher

Tool that allows you to run scheduled web scraping jobs

10
Experimental
8189 jsm1306/TrendTakeaway

A MERN-based platform for intelligent product analysis and price comparison...

10
Experimental
8190 KrizzhSriskantharajah-UK/PDFScout-v3

PDF Scout is a simple API that allows you to search for any pdf or books online.

10
Experimental
8191 Mustkeem324/Chegg-Expert-Auto-Refresh-Alarm

The Chegg Expert Auto Refresh Alarm is a Google Chrome extension developed...

10
Experimental
8192 hansputera/samehadaku-scraper

Testing Scrape samehadaku.vip

10
Experimental
8193 Sorrence/HTTP-Web-Crawler

A Node.js project that crawls the specified website

10
Experimental
8194 Carouge/arXiv-parsing

Collecting data from https://arXiv.org for scientific text summarization

10
Experimental
8195 gustavoguerrero/botConsumeApi

Bots que publican en un canal de Telegram a partir del consumo de una apiWeb...

10
Experimental
8196 Momollax/automatic-linkedin-post

Automates the retrieval, summarization, and posting of RSS feed content to...

10
Experimental
8197 beyond2013/bbcurdu

web scrapper for bbc urdu

10
Experimental
8198 thesoftwaremavericks/TCFEmailMiner

The Ultimate Email Extractor ⛏️ Generate Email leads 24-7 with this Amazing...

10
Experimental
8199 charlesl46/allocine-stareval-python

A scraping of a Allocine's starevals in Python3

10
Experimental
8200 antrgngn/capstone

A fashion dataset for the world of luxury fashion scholarship and research

10
Experimental
8201 pniedzwiedzinski/fb-web-scraper

Web scraper for downloading posts from facebook page

10
Experimental
8202 rxavier/cpe_ds_scraping

Notas de scraping del curso de Análisis de datos con Python para el Diploma...

10
Experimental
8203 ggerdsen/my_ruby_scraper

A web scraper that searches Indeed.com for entry-level remote jobs based on...

10
Experimental
8204 Shyeok/System-Programming

Sogang univ system programming course assignment

10
Experimental
8205 TalMizrahii/MusicBrains-WebCralwer

Big Data Crawling - MusicBrains web crawler

10
Experimental
8206 tharinduRE/web-scraping-mail

Web scraping for emails using scrapy

10
Experimental
8207 nghiapham1026/SportScore

Sports Tracking Application Node.js Back-end, fetching sports data and...

10
Experimental
8208 asimmakhmudov/top-rated-coffee-data-scraping

☕ Coffee Data Scraping Project – A data-driven dive into top-rated coffees!...

10
Experimental
8209 pgfernandez/Flight-Scraper-and-Hive-DB

BigData Architecture's assignment, scrapping flights and record them in CSV...

10
Experimental
8210 jatin69/fetcherJS

DU Result Fetcher made with Node for concurrency.

10
Experimental
8211 PBPatil/FIFA-WC-favorite-Twitter-Analysis

read my blog post @...

10
Experimental
8212 pvcodes-zz/ptorr-api

A webscraping project which scrapes torrent for website. This is just for...

10
Experimental
8213 UnBParadigmas2022-2/2022.2_G2_Logico_InimigosDaIgnorancia

Rede social para unir pessoas que acessam a wikipédia.

10
Experimental
8214 rohiit-chaurasiya/Amazon-Web-Scraping

Amazon Web Scraping Using Python and BeautifulSoup

10
Experimental
8215 SAS-DHRH/webcarbon-scraper

Script to scrape website data transmissions carbon emissions from website...

10
Experimental
8216 kevinzihlmann/ScrapingHydrodaten

I'm a passionate surfer. In Switzerland we have a famous riverwave in...

10
Experimental
8217 abhimodi310/web-scraping.code

My Project is web Scraping in python

10
Experimental
8218 helenaEH/Lyrics_classifier_NLP

This project shows how to scrape the lyrics from specific artists and...

10
Experimental
8219 solidsnk86/neo-scraper

App para web-scraping

10
Experimental
8220 siddarthkrishna10/Player_Scraping

I've scraped all the Premier League goalscorers (prior to the 2019-2020...

10
Experimental
8221 Kajaljain22/IMDb-Scraper

A Python app that lists out the top rated movies for you and suggests a...

10
Experimental
8222 espinoza/sabropedia

El buscador de sabores

10
Experimental
8223 QiliWu/web-scraping-with-python

Code about 'Web Scraping with Python'

10
Experimental
8224 Bushramjad/Scraper-BeautifulSoup

Data Scraping from Zameen.com website (Multiple pages) via BeautifulSoup

10
Experimental
8225 nateambringit/InstaEz

Instagram Bot Auto Like berdasarkan Hashtag

10
Experimental
8226 huseyinatilgan/turkiye-deprem-takip

Türkiye'deki deprem verilerini gerçek zamanlı takip eden web uygulaması

10
Experimental
8227 ffreemt/get-ppbrowser

Instantiate a pyppeteer browser object

10
Experimental
8228 akunna1/Offline-Web-Scraper

Offline R Web Scraper of the HTML page of the Neptune Technologies (NP) Job...

10
Experimental
8229 raphael-ps/passagens-aereas-scraper

O programa recebe informações de data, origem e destino de voos, raspa as...

10
Experimental
8230 wdebsqi/read-it

WORK IN PROGRESS. Django-based web app for browsing data about books, book...

10
Experimental
8231 yassinMi/scraper

An extensible, plugin-driven web scraping tool using WPF

10
Experimental
8232 Tale152/real_estate_data_scraper

Scala parallel web scraper for real-estate data source in a Big Data project

10
Experimental
8233 fahmifan/perpustakaan-rdf

Scrape page to csv & Convert to RDF/TTL

10
Experimental
8234 Acsts/Data_Collection--Travel_Recommandations

Collecting data from APIs and scraping Booking.com website to find the best...

10
Experimental
8235 catstyle1101/bot_home

my home telegram bot

10
Experimental
8236 atwamahmoud/SearchEngine

A Fast Multi-Threaded search engine implemented in Java, supporting...

10
Experimental
8237 Timmy93/API1fichier

Provide easy to use API to manage your 1fichier account through PHP

10
Experimental
8238 tomasriba/python-data-scraper

Scrapes long/short positions on IG and Plus500 sites on an hourly schedule.

10
Experimental
8239 avakado0/ganderson

This scraper written in Scrapy framework extracts town, district, open...

10
Experimental
8240 haroon0x/Web-QueryAI

Web-QueryAI

10
Experimental
8241 twillecke/floripa-rent-watch-crawler-server

Floripa Rent Watch é um projeto de análise de dados focado na análise...

10
Experimental
8242 Vishnu8299/new-s-web-scraping-

News Article Scraper is a Flask application that scrapes articles from...

10
Experimental
8243 fethullahceviz/Team3-Weather-Application

Weather aplication with API and Scrapy

10
Experimental
8244 burns534/BookAppFB

Library for storing your favorite books

10
Experimental
8245 NandoRunner/Web-Scraping-R

Web scrapping scripts using R language

10
Experimental
8246 akunna1/Django-Web-Scraper

A web app build with Python's Django, that scraps through the products on...

10
Experimental
8247 NandanSatheesh/Web-Scraper-Bot

A web scraper bot developed using Java (Result Scraper Application)

10
Experimental
8248 abdrahiman/uiscraper

UiScraper: A visual web scraping tool for effortless data extraction.

10
Experimental
8249 tharindukw96/sinhala_lyrics_search_project

A text-based Sinhala song lyrics search engine implemented using ElasticSearch.

10
Experimental
8250 TrinTragula/SharpScraperWebsite

A website to host the results generated by SharpScraper

10
Experimental
8251 Alihtt/ImageFinder

web scraping from Wikipedia to find the photos of each movie folder.

10
Experimental
8252 cchummer/faa-api

Notebooks documenting different endpoints and data available via the FAA website

10
Experimental
8253 Vidhish-Trivedi/From-BillBoard-To-Spotify

Create playlists of top 100 songs according to Billboard on Spotify.

10
Experimental
8254 Nimeizan/DTMer-s-Wallet-Breaker

複数サイトからDTMプラグインセール記事をスクレイピングし、結果をHTMLに出力します。

10
Experimental
8255 devender-yadav/GitUserDetailsFinder

To get User Details (name, company, location, email) of Subscribers,...

10
Experimental
8256 Im-Rises/hotel_scraping

Hotels' scraping and data manipulation.

10
Experimental
8257 davidrogger/trybe-project-tech-news

Projeto de raspagem de dados do blog da trybe

10
Experimental
8258 deidax/Avito.ma-data-web-scraper

Avito.ma web scraper app (data collector), that extract data from avito...

10
Experimental
8259 pratham534/wiki-scrape

api for wiki-scraper

10
Experimental
8260 NoumanHere/IMBD

Scraping top 250 movies with there title, genre, ratings, year and the url.

10
Experimental
8261 MukuD4T4/Scraping-1mg

This dataset contains list of medicines. The dataset contains 16,944 rows...

10
Experimental
8262 DanielWTE/anilist-auto-liker

A Python script that automates the process of liking activities on Anilist....

10
Experimental
8263 cr34t1ve/osemu-finance

Exchange rates API with Stanbic api web data

10
Experimental
8264 shady070/cloudflare-bypass-scrapper

This is a python script that can bypass cloudflare to scrape data from any...

10
Experimental
8265 rjackowens/ebay-auction-dashboard

Scrapes and aggregates eBay auctions listings onto a web dashboard

10
Experimental
8266 PierreMrt/yahoo_finance_scrap

Easily monitor companies you want by scraping their financial statements into excel

10
Experimental
8267 nishant7372/Web-Scraping-Application

RateGain Coderangers - Web Scraping Application

10
Experimental
8268 MehediHasannOvi/Jamuna-TV-app--Flutter-Web-Scraper

Jamuna TV App is a Flutter-based web scraping application designed to...

10
Experimental
8269 JamesRobionyRogers/Uni-KeyDates-to-Calendar

A small project to web scrape the University of Otago's key dates page and...

10
Experimental
8270 dev-smk/telegram-group-search

Search multiple groups on telegram

10
Experimental
8271 MartinAAcebeyL/ApiUnidadFomento

Api de la unidad de fomento de Chile.

10
Experimental
8272 Yonas650/Spotify_Stock_Analysis

This is an in-depth exploratory data analysis of Spotify's stock performance...

10
Experimental
8273 Shegszz/SpaceX-Mission-Data-Scraper

The goal of this project was to scrape mission data from the SpaceX website,...

10
Experimental
8274 vinhnguyen-22/Scrapping-FMCG-Tool

A tool for scraping and analyzing FMCG product data for market research and modeling

10
Experimental
8275 bhimrazy/web-scraping-using-python

Scrape List of American films of 2022 from wikipedia

10
Experimental
8276 reemkhaleed/Bookstore-Scraper

Simple Python web scraping script that collects book titles and prices and...

10
Experimental
8277 cicidi/cicidi-home

My homepage http://walter-chen.site and PDF resume generator

10
Experimental
8278 AdityaThote27/airscan-india-flight-tracker

✈️ A Python + Flask-based flight tracking dashboard for Indian air routes....

10
Experimental