Skip to content
AI Atlas
LibraryActive

tiktoken

OpenAIgithub.com/openai/tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models

quality64

Updated 5 h ago · first seen 11 Sept 2026

lib_01M29AAM3PJDM21AYWYZHG9NAJ

Version
0.14.0
T2 · 5 h ago
Released
17 Aug 2026
T2 · 5 h ago

As of

Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.

Claim history · Author

1 claims · 1 propertiesShow all properties

Authorauthor1

Claim history for Author
ValueValid from → toStatusSourceConfidenceExtractor
Shantanu JaincurrentcurrentPyPI public package metadataT2mediumdeterministic

Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →