tiktoken
OpenAIgithub.com/openai/tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models
Updated 4 h ago · first seen 11 Sept 2026
lib_01M29AAM3PJDM21AYWYZHG9NAJ
- Version
- 0.14.0
- T2 · 4 h ago
- Released
- 17 Aug 2026
- T2 · 4 h ago
Specification
- Repository
Source:PyPI public package metadataT2observed 4 h agomedium
- Author
- Shantanu Jain
Source:PyPI public package metadataT2observed 4 h agomedium
- Homepage
- https://github.com/openai/tiktoken
Source:PyPI public package metadataT2observed 4 h agomedium
- Latest release
- 17 Aug 2026
Source:PyPI public package metadataT2observed 4 h agomedium
- Latest version
- 0.14.0
Source:PyPI public package metadataT2observed 4 h agomedium
- Releases
- 20
Source:PyPI public package metadataT2observed 4 h agomedium
- PyPI
- tiktoken
Source:PyPI public package metadataT2observed 4 h agomedium
- Pypi release at
- 17 Aug 2026
Source:PyPI public package metadataT2observed 4 h agomedium
- Pypi url
- https://pypi.org/project/tiktoken/
Source:PyPI public package metadataT2observed 4 h agomedium
- Pypi version
- 0.14.0
Source:PyPI public package metadataT2observed 4 h agomedium
- Requires python
- >=3.9
Source:PyPI public package metadataT2observed 4 h agomedium
Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →
Provenance
Attributed facts
12
Source tiers
T212
Freshest observation
4 h ago
Conflicts
None
- Developed by
- OpenAI
As of
Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.
Claim history
Repositoryrepository_url1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| https://github.com/openai/tiktoken | → current | current | PyPI public package metadataT2 | medium | deterministic |
Descriptiondescription1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| tiktoken is a fast BPE tokeniser for use with OpenAI's models | → current | current | PyPI public package metadataT2 | medium | deterministic |
Homepagehomepage1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| https://github.com/openai/tiktoken | → current | current | PyPI public package metadataT2 | medium | deterministic |
Latest releaselatest_release_at1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 17 Aug 2026 | → current | current | PyPI public package metadataT2 | medium | deterministic |
Latest versionlatest_version1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 0.14.0 | → current | current | PyPI public package metadataT2 | medium | deterministic |
Releasesmetric.releases1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 20 | → current | current | PyPI public package metadataT2 | medium | deterministic |
PyPIpypi1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| tiktoken | → current | current | PyPI public package metadataT2 | medium | deterministic |
Pypi release atpypi_release_at1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 17 Aug 2026 | → current | current | PyPI public package metadataT2 | medium | deterministic |
Pypi urlpypi_url1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| https://pypi.org/project/tiktoken/ | → current | current | PyPI public package metadataT2 | medium | deterministic |
Pypi versionpypi_version1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 0.14.0 | → current | current | PyPI public package metadataT2 | medium | deterministic |
Requires pythonrequires_python1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| >=3.9 | → current | current | PyPI public package metadataT2 | medium | deterministic |
Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →
| Source | Document | Type | Tier | Last observed | Snapshots |
|---|---|---|---|---|---|
| PyPI public package metadata | pypi.org/pypi/tiktoken/json | package | T2· Quality secondary | 4 h ago | 1 |
Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.