BTTF’s 95.33% score measures SQL execution

BTTF is described as a research framework for querying chip-simulation data. Its reported 95.33% execution accuracy covers 150 benchmark queries; a separate summary defines the measure as successful SQL execution against expert-annotated queries. IndexBox’s October 13, 2026, account outlines the framework, while ArXiv TLDR’s summary explains the metric.

How BTTF is reported to work

The framework’s reported workflow starts with unstructured simulation output. IndexBox says BTTF organizes those data in a normalized SQLite database, then uses a multi-agent system to turn natural-language verification questions into schema-aware SQL. SQL, or Structured Query Language, is used to retrieve and work with data in a database.

The same account says BTTF correlates signal anomalies with versioned RTL repositories. RTL, short for register-transfer level, describes a chip’s design. In this workflow, the database and query system are intended to help engineers examine simulation results alongside versions of that design. The description places BTTF in electronic design automation (EDA), the software field used to design and verify chips.

What the 95.33% result measures

IndexBox reports 95.33% execution accuracy on a benchmark of 150 queries. ArXiv TLDR defines execution accuracy as successful SQL execution against expert-annotated queries. The figure therefore describes performance on that database-query task: whether the generated SQL ran successfully for the benchmark questions.

That is a narrower measure than an end-to-end chip-verification result. The reported percentage concerns query execution; it does not quantify how often BTTF finds chip defects or establishes that a design is correct.

A research framework alongside separate products

IndexBox described BTTF as a research framework in an October 2026 preprint and associated its researchers with Columbia University, Google DeepMind, and Google. A separate 2024 announcement described Alpha Design AI’s ChipAgents as a product for chip design and verification. The announcement concerns that distinct system, not BTTF.