FrameworkActive

helm

Stanford CRFM github.com/stanford-crfm/helm

Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multi

Explore graph

Updated 11 min ago · first seen 11 Sept 2026

framework_01M294NQV1YNXYG1KN3DHW0RXD

Version: 0.5.16; T2 · 16 min ago
Released: 30 Apr 2026; T2 · 16 min ago
License: Apache-2.0; T2 · 16 min ago
Stars: 2,907; T2 · 11 min ago

Specification

License: Apache-2.0
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Repository: github.com/stanford-crfm/helm
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Created at: 29 Nov 2021
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Default branch: main
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Homepage: https://crfm.stanford.edu/helm
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Kind: tool
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Latest release: 30 Apr 2026
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Latest release tag: v0.5.16
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Latest version: 0.5.16
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
License name: Apache License 2.0
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Forks: 413
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium
Releases: 25
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium
Stars: 2,907
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium
Tags: 25
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium
Watchers: 39
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 11 min agomedium
PyPI: crfm-helm
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Readme url: https://raw.githubusercontent.com/stanford-crfm/helm/HEAD/README.md
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium
Releases url: https://github.com/stanford-crfm/helm/releases
Source:GitHub public repositories (HTML, releases.atom, raw files)T2observed 16 min agomedium

Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →

Provenance

Attributed facts

Source tiers

T219

Freshest observation

11 min ago

Conflicts

None

As of

Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.

Claim history

19 claims · 19 properties

Licenselicense1

Claim history for License
Value	Valid from → to	Status	Source	Confidence	Extractor
Apache-2.0	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Repositoryrepository_url1

Claim history for Repository
Value	Valid from → to	Status	Source	Confidence	Extractor
https://github.com/stanford-crfm/helm	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Created atcreated_at1

Claim history for Created at
Value	Valid from → to	Status	Source	Confidence	Extractor
29 Nov 2021	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Default branchdefault_branch1

Claim history for Default branch
Value	Valid from → to	Status	Source	Confidence	Extractor
main	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Descriptiondescription1

Claim history for Description
Value	Valid from → to	Status	Source	Confidence	Extractor
Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models (CRFM) at Stanford for holistic, reproducible and transparent evaluation of foundation models, including large language models (LLMs) and multimodal models.	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Homepagehomepage1

Claim history for Homepage
Value	Valid from → to	Status	Source	Confidence	Extractor
https://crfm.stanford.edu/helm	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Kindkind1

Claim history for Kind
Value	Valid from → to	Status	Source	Confidence	Extractor
tool	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Latest releaselatest_release_at1

Claim history for Latest release
Value	Valid from → to	Status	Source	Confidence	Extractor
30 Apr 2026	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Latest release taglatest_release_tag1

Claim history for Latest release tag
Value	Valid from → to	Status	Source	Confidence	Extractor
v0.5.16	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Latest versionlatest_version1

Claim history for Latest version
Value	Valid from → to	Status	Source	Confidence	Extractor
0.5.16	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

License namelicense_name1

Claim history for License name
Value	Valid from → to	Status	Source	Confidence	Extractor
Apache License 2.0	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Forksmetric.forks1

Claim history for Forks
Value	Valid from → to	Status	Source	Confidence	Extractor
413	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Releasesmetric.releases1

Claim history for Releases
Value	Valid from → to	Status	Source	Confidence	Extractor
25	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Starsmetric.stars1

Claim history for Stars
Value	Valid from → to	Status	Source	Confidence	Extractor
2,907	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Tagsmetric.tags1

Claim history for Tags
Value	Valid from → to	Status	Source	Confidence	Extractor
25	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Watchersmetric.watchers1

Claim history for Watchers
Value	Valid from → to	Status	Source	Confidence	Extractor
39	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

PyPIpypi1

Claim history for PyPI
Value	Valid from → to	Status	Source	Confidence	Extractor
crfm-helm	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Readme urlreadme_url1

Claim history for Readme url
Value	Valid from → to	Status	Source	Confidence	Extractor
https://raw.githubusercontent.com/stanford-crfm/helm/HEAD/README.md	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Releases urlreleases_url1

Claim history for Releases url
Value	Valid from → to	Status	Source	Confidence	Extractor
https://github.com/stanford-crfm/helm/releases	11 Sept 2026 21:06 UTC → current	current	GitHub public repositories (HTML, releases.atom, raw files)T2	medium	deterministic

Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →

Source documents
Source	Document	Type	Tier	Last observed	Snapshots
GitHub public repositories (HTML, releases.atom, raw files)	github.com/stanford-crfm/helm/releases.atom	feed	T2· Quality secondary	11 min ago	1
GitHub public repositories (HTML, releases.atom, raw files)	raw.githubusercontent.com/stanford-crfm/helm/HEAD/README.md	readme	T2· Quality secondary	11 min ago	1
GitHub public repositories (HTML, releases.atom, raw files)	github.com/stanford-crfm/helm	repository	T2· Quality secondary	11 min ago	2

Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.