FrameworkActive

lighteval

Hugging Face github.com/huggingface/lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

Explore graph

Updated 11 min ago · first seen 11 Sept 2026

framework_01M294NXJ2F8JQYEPXB8TF0B22

Version: 0.13.0; T2 · 16 min ago
Released: 24 Nov 2025; T2 · 16 min ago
License: MIT; T2 · 16 min ago
Stars: 2,540; T2 · 11 min ago

Specification

License: MIT
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Repository: github.com/huggingface/lighteval
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Created at: 26 Jan 2024
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Default branch: main
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Homepage: https://huggingface.co/docs/lighteval/en/index
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Kind: tool
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Latest release: 24 Nov 2025
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Latest release tag: v0.13.0
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Latest version: 0.13.0
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
License name: MIT License
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Forks: 554
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium
Releases: 15
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium
Stars: 2,540
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium
Tags: 18
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium
Watchers: 26
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium
PyPI: lighteval
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Readme url: https://raw.githubusercontent.com/huggingface/lighteval/HEAD/README.md
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Releases url: https://github.com/huggingface/lighteval/releases
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Topics: evaluation, evaluation-framework, evaluation-metrics, huggingface
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →

Provenance

Attributed facts

Source tiers

T220

Freshest observation

11 min ago

Conflicts

None

As of

Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.

Claim history

20 claims · 20 properties

Licenselicense1

Claim history for License
Value	Valid from → to	Status	Source	Confidence	Extractor
MIT	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Repositoryrepository_url1

Claim history for Repository
Value	Valid from → to	Status	Source	Confidence	Extractor
https://github.com/huggingface/lighteval	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Created atcreated_at1

Claim history for Created at
Value	Valid from → to	Status	Source	Confidence	Extractor
26 Jan 2024	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Default branchdefault_branch1

Claim history for Default branch
Value	Valid from → to	Status	Source	Confidence	Extractor
main	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Descriptiondescription1

Claim history for Description
Value	Valid from → to	Status	Source	Confidence	Extractor
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Homepagehomepage1

Claim history for Homepage
Value	Valid from → to	Status	Source	Confidence	Extractor
https://huggingface.co/docs/lighteval/en/index	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Kindkind1

Claim history for Kind
Value	Valid from → to	Status	Source	Confidence	Extractor
tool	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Latest releaselatest_release_at1

Claim history for Latest release
Value	Valid from → to	Status	Source	Confidence	Extractor
24 Nov 2025	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Latest release taglatest_release_tag1

Claim history for Latest release tag
Value	Valid from → to	Status	Source	Confidence	Extractor
v0.13.0	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Latest versionlatest_version1

Claim history for Latest version
Value	Valid from → to	Status	Source	Confidence	Extractor
0.13.0	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

License namelicense_name1

Claim history for License name
Value	Valid from → to	Status	Source	Confidence	Extractor
MIT License	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Forksmetric.forks1

Claim history for Forks
Value	Valid from → to	Status	Source	Confidence	Extractor
554	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Releasesmetric.releases1

Claim history for Releases
Value	Valid from → to	Status	Source	Confidence	Extractor
15	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Starsmetric.stars1

Claim history for Stars
Value	Valid from → to	Status	Source	Confidence	Extractor
2,540	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Tagsmetric.tags1

Claim history for Tags
Value	Valid from → to	Status	Source	Confidence	Extractor
18	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Watchersmetric.watchers1

Claim history for Watchers
Value	Valid from → to	Status	Source	Confidence	Extractor
26	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

PyPIpypi1

Claim history for PyPI
Value	Valid from → to	Status	Source	Confidence	Extractor
lighteval	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Readme urlreadme_url1

Claim history for Readme url
Value	Valid from → to	Status	Source	Confidence	Extractor
https://raw.githubusercontent.com/huggingface/lighteval/HEAD/README.md	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Releases urlreleases_url1

Claim history for Releases url
Value	Valid from → to	Status	Source	Confidence	Extractor
https://github.com/huggingface/lighteval/releases	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Topicstopics1

Claim history for Topics
Value	Valid from → to	Status	Source	Confidence	Extractor
evaluation, evaluation-framework, evaluation-metrics, huggingface	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →

Source documents
Source	Document	Type	Tier	Last observed	Snapshots
GitHub public repositories (HTML, releases.atom, raw files)	github.com/huggingface/lighteval/releases.atom	feed	T2· Quality secondary	11 min ago	2
GitHub public repositories (HTML, releases.atom, raw files)	raw.githubusercontent.com/huggingface/lighteval/HEAD/README.md	readme	T2· Quality secondary	11 min ago	1
GitHub public repositories (HTML, releases.atom, raw files)	github.com/huggingface/lighteval	repository	T2· Quality secondary	11 min ago	2

Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.