lighteval
Hugging Facegithub.com/huggingface/lighteval
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
Updated 2 h ago · first seen 11 Sept 2026
framework_01M294NXJ2F8JQYEPXB8TF0B22
- Version
- 0.13.0
- T2 · 4 h ago
- Released
- 24 Nov 2025
- T2 · 4 h ago
- License
- MIT
- T2 · 4 h ago
- Stars
- 2,540
- T2 · 2 h ago
Specification
- License
- MIT
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
- Repository
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
- Created at
- 26 Jan 2024
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
- Default branch
- main
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
- Homepage
- https://huggingface.co/docs/lighteval/en/index
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
- Kind
- tool
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
- Latest release
- 24 Nov 2025
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
- Latest release tag
- v0.13.0
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
- Latest version
- 0.13.0
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
- License name
- MIT License
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
- Forks
- 554
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 2 h agomedium
- Releases
- 15
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 2 h agomedium
- Stars
- 2,540
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 2 h agomedium
- Tags
- 18
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 2 h agomedium
- Watchers
- 26
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 2 h agomedium
- PyPI
- lighteval
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
- Pypi license
- MIT License
Source:PyPI public package metadataT2observed 2 h agomedium
- Pypi release at
- 24 Nov 2025
Source:PyPI public package metadataT2observed 2 h agomedium
- Pypi url
- https://pypi.org/project/lighteval/
Source:PyPI public package metadataT2observed 2 h agomedium
- Pypi version
- 0.13.0
Source:PyPI public package metadataT2observed 2 h agomedium
- Python classifiers
- Programming Language :: Python :: 3.10
Source:PyPI public package metadataT2observed 2 h agomedium
- Readme url
- https://raw.githubusercontent.com/huggingface/lighteval/HEAD/README.md
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
- Releases url
- https://github.com/huggingface/lighteval/releases
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
- Requires python
- >=3.10
Source:PyPI public package metadataT2observed 2 h agomedium
- Topics
- evaluation, evaluation-framework, evaluation-metrics, huggingface
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 4 h agomedium
Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →
Provenance
Attributed facts
26
Source tiers
T226
Freshest observation
2 h ago
Conflicts
None
- Developed by
- Hugging Face
As of
Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.
Claim history · Pypi release at
Pypi release atpypi_release_at1
| Value | Valid from → to | Status | Source | Confidence | Extractor |
|---|---|---|---|---|---|
| 24 Nov 2025 | → current | current | PyPI public package metadataT2 | medium | deterministic |
Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →
| Source | Document | Type | Tier | Last observed | Snapshots |
|---|---|---|---|---|---|
| GitHub public repositories (HTML, releases.atom, raw files) | github.com/huggingface/lighteval/releases.atom | feed | T2· Quality secondary | 2 h ago | 3 |
| GitHub public repositories (HTML, releases.atom, raw files) | raw.githubusercontent.com/huggingface/lighteval/HEAD/README.md | readme | T2· Quality secondary | 2 h ago | 1 |
| GitHub public repositories (HTML, releases.atom, raw files) | github.com/huggingface/lighteval | repository | T2· Quality secondary | 2 h ago | 3 |
| PyPI public package metadata | pypi.org/pypi/lighteval/json | package | T2· Quality secondary | 2 h ago | 1 |
Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.