Skip to main content
Angestrom home
SearchPapersModelsLive AIIntelligence
Search⌕⌘K
EnterprisePricingSign in

Stay Ahead in the AI Revolution

Weekly digest — EPI pulse, top intelligence, fresh lineage. Free, no account.

Follow Angestrom
Global source network
Synced every 5 minutes

Continuous sync from primary AI sources — indexed, enriched, and queryable in real time.

arXivHugging FaceGitHubOpenAIAnthropicDeepMindReutersBBC TechHacker NewsReddit MLVerified feedsFunding
ANGESTROM

The Intelligence Layer of Humanity. Everything AI. All in One Place.

Angestrom connects every piece of the AI ecosystem — data, models, research, companies, tools, and people.

info@angestrom.comwww.angestrom.comLucknow, Uttar Pradesh, India

Product

  • AI Search
  • AI Models
  • Research Papers
  • Companies
  • News & Events
  • GitHub Explorer
  • APIs & Tools
  • Datasets
  • Benchmarks
  • Model lifecycle
  • Funding graph
  • Contributors
  • AI Agents

Resources

  • Weekly digest
  • Documentation
  • Tutorials
  • Guides
  • News
  • Help / Start
  • Community

Company

  • About
  • Contact
  • Privacy Policy
  • Terms of Service
  • Acceptable Use

Enterprise

  • Pricing
  • Workspace
  • Contact Sales

Developer

  • Developer Hub
  • API docs
  • GitHub

Learn

  • Learning Academy
  • Roadmaps
  • Glossary
  • AI for Beginners

Popular Topics

Loading topics…
View All Topics →
© 2026 Angestrom Intelligence Private Limited. All rights reserved.
English
Theme
Angestrom home
SearchPapersModelsLive AIIntelligence
Search⌕⌘K
EnterprisePricingSign in
  1. Home
  2. /Repositories
  3. /georg-jung/FastBertTokenizer
Read original ↗
repoGitHubTrust 82 · PrimaryPublished 4d agoLive · 3d ago

georg-jung/FastBertTokenizer

Fast and memory-efficient library for WordPiece tokenization as it is used by BERT.

Lineage graph

Paper → model → repo connections mined from source citations (Tier-1 exact match).

Why these links exist

Every edge carries a method, confidence, and the source snippet that justified it — so bad links are debuggable.

  • PossiblePossibly related (embedding) · 56%Token →
  • PossiblePossibly related (embedding) · 48%Gigatoken: A new open source tokenizer ~100x faster than Tiktoken, -500-1000x faster than Huggingface →
  • PossiblePossibly related (embedding) · 61%GigaToken: ~1000x faster Language model tokenization →

Related to

glossary_termToken

Covers (incoming)

newsGigatoken: A new open source tokenizer ~100x faster than Tiktoken, -500-1000x faster than HuggingfacenewsGigaToken: ~1000x faster Language model tokenization

Related across the graph

glossary_termTokennewsGigaToken: ~1000x faster Language model tokenizationnewsGigatoken: A new open source tokenizer ~100x faster than Tiktoken, -500-1000x faster than Huggingface
Knowledge path·GToken→NGigaToken: ~1000x faster Language model tokenization→NGigatoken: A new open source tokenizer ~100x faster than Tiktoken, -500-1000x faster than Huggingface→Rgeorg-jung/FastBertTokenizer

Topics

aibertbert-embeddingsllmmachine-learningnatural-language-processingnlpnlp-machine-learningtokenizationtokens

Explore

Search similar →Knowledge graph →All repos →Full intelligence feed →
Graph trust82Primary
Graph score54