repoGitHubTrust 82 · PrimaryPublished 3h agoLive · 1h ago
niieani/gpt-tokenizer
The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.
Lineage graph
Paper → model → repo connections mined from source citations (Tier-1 exact match).
Why these links exist
Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.
- PossiblePossibly related (embedding) · 58%OpenAI introduces ‘Ultrafast,’ a new mode that makes GPT-5.6 Sol work at 14x the speed →
- PossiblePossibly related (embedding) · 54%GPT-2 Fully Decoded Internally Black Box Fully Open With Demo →
- PossiblePossibly related (embedding) · 52%GPT-5.6 launches, but OpenAI is taking it slow - IBM →
- PossiblePossibly related (embedding) · 51%Previewing GPT-5.6 Sol: a next-generation model →
- PossiblePossibly related (embedding) · 50%GigaToken: ~1000x faster Language model tokenization →
- PossiblePossibly related (embedding) · 47%Pokee-Isaac 28B: 10M-Token Context on a Single GPU - Pasquale Pillitteri →
Covers
newsOpenAI introduces ‘Ultrafast,’ a new mode that makes GPT-5.6 Sol work at 14x the speednewsGPT-2 Fully Decoded Internally Black Box Fully Open With DemonewsGPT-5.6 launches, but OpenAI is taking it slow - IBMnewsPreviewing GPT-5.6 Sol: a next-generation modelnewsGigaToken: ~1000x faster Language model tokenization
Covers (incoming)
Related across the graph
newsPreviewing GPT-5.6 Sol: a next-generation modelnewsGPT-2 Fully Decoded Internally Black Box Fully Open With DemonewsGPT-5.6 launches, but OpenAI is taking it slow - IBMnewsPokee-Isaac 28B: 10M-Token Context on a Single GPU - Pasquale PillitterinewsGigaToken: ~1000x faster Language model tokenizationnewsOpenAI introduces ‘Ultrafast,’ a new mode that makes GPT-5.6 Sol work at 14x the speed