codelion/pts
Pivotal Token Search
Identifies decision-point tokens in LLM generations that significantly impact task success, then converts them into DPO fine-tuning datasets or steering vectors for inference optimization. Supports multiple reasoning formats (chain-of-thought, GSM8k, MATH) and includes a web visualizer for exploring token-level reasoning circuits and causal dependencies. Integrates with Hugging Face Hub for dataset distribution and works with activation-based steering approaches like optillm.
146 stars.
Stars
146
Forks
9
Language
Python
License
Apache-2.0
Category
Last pushed
Dec 20, 2025
Commits (30d)
0
Get this data via API
curl "https://pt-edge.onrender.com/api/v1/quality/llm-tools/codelion/pts"
Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.
Related tools
RLHFlow/Directional-Preference-Alignment
Directional Preference Alignment
dannylee1020/openpo
Building synthetic data for preference tuning
DtYXs/Pre-DPO
Pre-DPO: Improving Data Utilization in Direct Preference Optimization Using a Guiding Reference Model
Rahulkumar010/microDPO
microDPO: A minimalist, pure PyTorch implementation of Direct Preference Optimization. Inspired...
pspdada/Uni-DPO
[ICLR 2026] Official repository of "Uni-DPO: A Unified Paradigm for Dynamic Preference...