LINKEDIN / 4:5 / 1200 × 1500
The tool was not the problem.
Six web mechanisms. Eighteen correct answers. The harder question may be how an agent finds what it can use.
Can an AI use a web tool it has to build a client for?
All eighteen visitors obtained the required answer across six web mechanisms, including WebSocket and WebAssembly. The expected capability barrier did not appear. Each visitor was given the address, so discovering the tool remained untested.
SEE WHERE THIS QUESTION FITS ↗ABOUT THIS NOTE +
Eighteen assigned AI agents used six web mechanisms at LLM Wilds. All completed the task, including three WebSocket clients and three WebAssembly executions, refuting the predicted drop-off for mechanisms requiring code. The study raises a question about agentic discoverability; it did not test discovery from a site's front door. One harness cache leak also showed how the web an agent receives can differ from the web being served.
PUBLICATION HISTORY
Each version preserves its manuscript, claims and source references. Research status is recorded separately from publication.
- V1.0 · 2026-09-12 ↗
Initial publication: the capability census refutes its predicted drop-off and motivates a discovery experiment. REFUTED
- V1.1 · 2026-09-12 ↗
Clarified K17 and the six mechanisms; shortened the visual reading path and moved the full record into expandable notes. Findings unchanged. REFUTED
SOURCES & PROVENANCE
- WEB-CAPABILITY-1A / audited outcomes and source hashes ↗
Read from chuk-experiments: experiment EXP-20260912-161711-00770, write-up v2 and all 18 completed runs. All 36 subject report/transcript hashes, the protocol and the final report were checked against local source files. Original Git pointers may require repository access.
PRESERVED COPY ↗ · CAPTURED 2026-09-12
- The final results, including the falsified prediction ↗
Public copy of the final report at source commit 3bc32f8e65baaf23ae45dcf582c1b23a82536618, registered as artifact 1212. It supersedes the earlier results artifact, which omitted the explicit verdict paragraph.
PRESERVED COPY ↗ · CAPTURED 2026-09-12
- The frozen protocol ↗
Frozen before the build and first subject at source commit b6454073c1ac02d2d3d4f746aa54d5f452064ba7. The prior, falsifier, supplied task address and configuration limits remain in the record.
PRESERVED COPY ↗ · CAPTURED 2026-09-12
AUTHOR / Chris Hay · VERSION / 1.1
PUBLISHED 12 SEP 2026 · REVISED 12 SEP 2026 · VERSION 1.1
CITECITE THIS
Research note · 1.1
Hay, C. (2026). The tool was not the problem. (Version 1.1). Chris Hay. https://chrishayuk.com/records/N-MACHINE-CAPABILITY/1.1
FOLLOW THE WORK
New notebook entries and recorded work, as they appear. Point a feed reader — or an agent of your own — at an address below. No account, no email address, nothing for this site to keep.
The notebook
New ideas, experiments and essays, as they are recorded. Includes labelled working drafts.
OPEN FEEDhttps://chrishayuk.com/notebook/feed.xmlThe record
Everything published to the Chris Hay record.
OPEN FEEDhttps://chrishayuk.com/record/feed.xml
FOR PROGRAMS · follow.json · JSON Feed