blmoistawinde/HarvestText
文本挖掘和预处理工具(文本清洗、新词发现、情感分析、实体识别链接、关键词抽取、知识抽取、句法分析等),无监督或弱监督方法
Combines unsupervised statistical methods (TextRank, TextTiling, new word discovery rules) with domain knowledge integration to enable weak-supervision NLP tasks on Chinese text, particularly effective for entity disambiguation and relationship extraction from noisy sources like social media and novels. Integrates PyHanLP for dependency parsing and NER, supports modular sentiment analysis through seed word bootstrapping, and provides built-in domain vocabularies (legal, financial, culinary, IT) for immediate application without extensive labeled data.
2,603 stars and 1,333 monthly downloads. Used by 1 other package. No commits in the last 6 months. Available on PyPI.
Stars
2,603
Forks
339
Language
Python
License
MIT
Category
Last pushed
May 13, 2024
Monthly downloads
1,333
Commits (30d)
0
Dependencies
14
Reverse dependents
1
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/nlp/blmoistawinde/HarvestText"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
polm/unidic-py
Unidic packaged for installation via pip.
huspacy/huspacy
HuSpaCy: industrial-strength Hungarian natural language processing
BramVanroy/spacy_conll
Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and...
tanloong/neosca
L2SCA & LCA fork: cross-platform, GUI, without Java dependency
bnosac/udpipe
R package for Tokenization, Parts of Speech Tagging, Lemmatization and Dependency Parsing Based...