glossary_term · Angestrom

Token

A chunk of text (often a word-piece) that a model reads and predicts.

A chunk of text (often a word-piece) that a model reads and predicts. A chunk of text (often a word-piece) that a model reads and predicts.
Read it here, in full.View original →