1712n/dedup-service
A high-performance service designed to eliminate duplicate and near-duplicate content, ensuring diversity and token uniqueness in datasets. Built on Cloudflare Workers.
21
/ 100
Experimental
No Package
No Dependents
Maintenance
10 / 25
Adoption
2 / 25
Maturity
9 / 25
Community
0 / 25
Stars
2
Forks
—
Language
TypeScript
License
Unlicense
Category
Last pushed
Feb 06, 2026
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/1712n/dedup-service"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Higher-rated alternatives
ChenghaoMou/text-dedup
All-in-one text de-duplication
76
loretoparisi/fasttext.js
FastText for Node.js
69
messense/fasttext-serving
fastText model serving service
56
vrasneur/pyfasttext
Yet another Python binding for fastText
52
olegtarasov/FastText.NetWrapper
.NET Standard wrapper for fastText library. Now works on Windows, Linux and MacOs!
50