FrameworkActive

lighteval

Hugging Face github.com/huggingface/lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

Explore graph

quality59

Updated 16 min ago · first seen 11 Sept 2026

framework_01M294NXJ2F8JQYEPXB8TF0B22

Version: 0.13.0; T2 · 2 h ago
Released: 24 Nov 2025; T2 · 2 h ago
License: MIT; T2 · 2 h ago
Stars: 2,540; T2 · 2 h ago

As of

Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.

Claim history

27 claims · 26 properties

Licenselicense1

Claim history for License
Value	Valid from → to	Status	Source	Confidence	Extractor
MIT	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Repositoryrepository_url1

Claim history for Repository
Value	Valid from → to	Status	Source	Confidence	Extractor
https://github.com/huggingface/lighteval	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Created atcreated_at1

Claim history for Created at
Value	Valid from → to	Status	Source	Confidence	Extractor
26 Jan 2024	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Default branchdefault_branch1

Claim history for Default branch
Value	Valid from → to	Status	Source	Confidence	Extractor
main	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Descriptiondescription1

Claim history for Description
Value	Valid from → to	Status	Source	Confidence	Extractor
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Homepagehomepage1

Claim history for Homepage
Value	Valid from → to	Status	Source	Confidence	Extractor
https://huggingface.co/docs/lighteval/en/index	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Kindkind1

Claim history for Kind
Value	Valid from → to	Status	Source	Confidence	Extractor
tool	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Latest releaselatest_release_at1

Claim history for Latest release
Value	Valid from → to	Status	Source	Confidence	Extractor
24 Nov 2025	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Latest release taglatest_release_tag1

Claim history for Latest release tag
Value	Valid from → to	Status	Source	Confidence	Extractor
v0.13.0	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Latest versionlatest_version1

Claim history for Latest version
Value	Valid from → to	Status	Source	Confidence	Extractor
0.13.0	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

License namelicense_name1

Claim history for License name
Value	Valid from → to	Status	Source	Confidence	Extractor
MIT License	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Forksmetric.forks1

Claim history for Forks
Value	Valid from → to	Status	Source	Confidence	Extractor
554	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Releasesmetric.releases2

Claim history for Releases
Value	Valid from → to	Status	Source	Confidence	Extractor
22	11 Sept 2026 22:44 UTC → current	current	PyPI public package metadataT2	medium	deterministic
15	11 Sept 2026 21:06 UTC → 11 Sept 2026 22:44 UTC	superseded	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Starsmetric.stars1

Claim history for Stars
Value	Valid from → to	Status	Source	Confidence	Extractor
2,540	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Tagsmetric.tags1

Claim history for Tags
Value	Valid from → to	Status	Source	Confidence	Extractor
18	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Watchersmetric.watchers1

Claim history for Watchers
Value	Valid from → to	Status	Source	Confidence	Extractor
26	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

PyPIpypi1

Claim history for PyPI
Value	Valid from → to	Status	Source	Confidence	Extractor
lighteval	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Pypi licensepypi_license1

Claim history for Pypi license
Value	Valid from → to	Status	Source	Confidence	Extractor
MIT License	11 Sept 2026 22:44 UTC → current	current	PyPI public package metadataT2	medium	deterministic

Pypi release atpypi_release_at1

Claim history for Pypi release at
Value	Valid from → to	Status	Source	Confidence	Extractor
24 Nov 2025	11 Sept 2026 22:44 UTC → current	current	PyPI public package metadataT2	medium	deterministic

Pypi urlpypi_url1

Claim history for Pypi url
Value	Valid from → to	Status	Source	Confidence	Extractor
https://pypi.org/project/lighteval/	11 Sept 2026 22:44 UTC → current	current	PyPI public package metadataT2	medium	deterministic

Pypi versionpypi_version1

Claim history for Pypi version
Value	Valid from → to	Status	Source	Confidence	Extractor
0.13.0	11 Sept 2026 22:44 UTC → current	current	PyPI public package metadataT2	medium	deterministic

Python classifierspython_classifiers1

Claim history for Python classifiers
Value	Valid from → to	Status	Source	Confidence	Extractor
Programming Language :: Python :: 3.10	11 Sept 2026 22:44 UTC → current	current	PyPI public package metadataT2	medium	deterministic

Readme urlreadme_url1

Claim history for Readme url
Value	Valid from → to	Status	Source	Confidence	Extractor
https://raw.githubusercontent.com/huggingface/lighteval/HEAD/README.md	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Releases urlreleases_url1

Claim history for Releases url
Value	Valid from → to	Status	Source	Confidence	Extractor
https://github.com/huggingface/lighteval/releases	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Requires pythonrequires_python1

Claim history for Requires python
Value	Valid from → to	Status	Source	Confidence	Extractor
>=3.10	11 Sept 2026 22:44 UTC → current	current	PyPI public package metadataT2	medium	deterministic

Topicstopics1

Claim history for Topics
Value	Valid from → to	Status	Source	Confidence	Extractor
evaluation, evaluation-framework, evaluation-metrics, huggingface	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →

Source documents
Source	Document	Type	Tier	Last observed	Snapshots
PyPI public package metadata	pypi.org/pypi/lighteval/json	package	T2· Quality secondary	16 min ago	1
GitHub public repositories (HTML, releases.atom, raw files)	github.com/huggingface/lighteval/releases.atom	feed	T2· Quality secondary	2 h ago	2
GitHub public repositories (HTML, releases.atom, raw files)	raw.githubusercontent.com/huggingface/lighteval/HEAD/README.md	readme	T2· Quality secondary	2 h ago	1
GitHub public repositories (HTML, releases.atom, raw files)	github.com/huggingface/lighteval	repository	T2· Quality secondary	2 h ago	2

Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.