DelistBench: Evaluating Search-Enabled LLMs for Auditable Corporate-Event Database Completion — Paper

Abstract

Financial institutions need an independent way to detect missing, stale, and misclassified corporate-event records in vendor databases. We introduce Search-to-Record, a database-assurance task in which search-enabled large language models reconstruct institution-defined event records from public sources for a known security universe and historical cutoff, and DelistBench, a 1,200-record benchmark for security-level delisting announcements. We evaluate five models in paired closed-book and web-enabled conditions. Web access raises announcement-date accuracy within seven days by 34.0 to 48.0 percentage points and event-status accuracy by approximately 2.8 to 21.7 points; the best system achieves 81.5% overall joint accuracy within seven days. Economy web systems achieve 75.9-78.3% overall joint accuracy within seven days at 4.5-6.6% of the API cost of the most expensive web system. Risk-based triage identifies low-error subsets, although the highest-coverage operating point still sends 27.3% of the balanced test set to review. The evaluation identifies web retrieval as the main source of timing gains and shows that low-cost systems can approach the best system's accuracy. Together, Search-to-Record, DelistBench, and the evaluation provide concrete deployment guidance: calibrate triage to local event prevalence and market mix, preserve positive-event recall, and route positive and ambiguous cases to targeted review.

Authors 5

Xuan Yao, Shuping Li, Yang Dai, Yi Zhou, Ke-Wei Huang

Specification

Official page: arxiv.org/abs/2608.22770
Source:arXiv (Atom API + RSS)T1observed 9 h agohigh
Arxiv announce type: replace
Source:arXiv (Atom API + RSS)T1observed 9 h agohigh
arXiv id: 2608.22770
Source:arXiv (Atom API + RSS)T1observed 9 h agohigh
Categories: cs.CL
Source:arXiv (Atom API + RSS)T1observed 9 h agohigh
PDF: arxiv.org/pdf/2608.22770
Source:arXiv (Atom API + RSS)T1observed 9 h agohigh
Primary category: cs.CL
Source:arXiv (Atom API + RSS)T1observed 9 h agohigh
Published: 11 Sept 2026
Source:arXiv (Atom API + RSS)T1observed 9 h agohigh

Each value shows its source, tier and observation time. Conflicting claims are kept side by side and flagged — never averaged. How AI Atlas records facts →

Provenance

Attributed facts

9

Source tiers

T19

Freshest observation

9 h ago

Conflicts

None

No models linked to this paper yet.

Authors: Xuan Yao, Shuping Li, Yang Dai

As of

Rewind the record: see this entity's attributes exactly as AI Atlas knew them on a given day.

Claim history · Official page

1 claims · 1 propertiesShow all properties

Official pageofficial_url1

Claim history for Official page
Value	Valid from → to	Status	Source	Confidence	Extractor
https://arxiv.org/abs/2608.22770	11 Sept 2026 21:03 UTC → current	current	arXiv (Atom API + RSS)T1	high	deterministic

Claims are temporal and append-only: a new observation closes the previous claim (valid_to) instead of overwriting it. Conflicting claims from different sources are kept side by side and flagged — never averaged. Methodology →

11 Sept 2026
New paperPaperDelistBench: Evaluating Search-Enabled LLMs for Auditable Corporate-Event Database Completion
New paper: DelistBench: Evaluating Search-Enabled LLMs for Auditable Corporate-Event Database Completion
arxiv
rss.arxiv.org

Full timeline →

Source documents
Source	Document	Type	Tier	Last observed	Snapshots
arXiv (Atom API + RSS)	rss.arxiv.org/rss/cs.CL	feed	T1· Official	2 h ago	1

Tier 1 = official/primary, 2 = quality secondary, 3 = community, 4 = unverified. Every snapshot is archived; see all sources and the methodology.