AnderssonProgramming/llm-embeddings-text-preprocessing

LLM text preprocessing and embedding pipeline implementation for the Enterprise Architecture (AREP) course at Escuela Colombiana de Ingeniería Julio Garavito. Based on "Build a Large Language Model (From Scratch)," it covers BPE tokenization, sliding window sampling experiments, and positional embedding integration using PyTorch.

19
/ 100
Experimental
No Package No Dependents
Maintenance 10 / 25
Adoption 0 / 25
Maturity 9 / 25
Community 0 / 25

How are scores calculated?

Stars

—

Forks

—

Language

Jupyter Notebook

License

MIT

Category

embedding-model-tuning

Last pushed

Feb 11, 2026

Commits (30d)

0

GitHub
Embedding Model Tuning · 41 tools

Get this data via API

curl "https://pt-edge.onrender.com/api/v1/quality/embeddings/AnderssonProgramming/llm-embeddings-text-preprocessing"

Open to everyone — 100 requests/day, no key needed. Get a free key for 1,000/day.

Higher-rated alternatives

ContextualAI/gritlm

Generative Representational Instruction Tuning

63

xlang-ai/instructor-embedding

[ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings

45

liuqidong07/LLMEmb

[AAAI'25 Oral] The official implementation code of LLMEmb

42

hpcaitech/CachedEmbedding

A memory efficient DLRM training solution using ColossalAI

40

shobrook/weightgain

Train an adapter for any embedding model in under a minute

37

Explore Embedding Tools

All categories Trending Embeddings directory Insights