Machines
When does an action belong to the task?
10 notes · latest 11 Oct 2026CHRIS HAY / RESEARCH
Experiments, evidence and open questions.
Follow a programme, inspect a recorded result, or begin with what remains unanswered. Each notebook keeps the experiment, its limits and the evidence behind it.
FOLLOW THE WORK
When does an action belong to the task?
10 notes · latest 11 Oct 2026What keeps an action alive?
6 notes · latest 17 Sept 2026What happens when programs evolve?
6 notes · latest 11 Sept 2026How does a model find what it knows?
7 notes · latest 6 Sept 2026EXPERIMENT → RESULT → EVIDENCE
Publication status describes the record. Finding status describes a particular claim or observation, within its stated limits. A note can contain both supported and unsupported findings.
15 RECORDS WITH RECORDED FINDINGS
SUPPORTEDIn the tested setup, presenting the same destination as a hyperlink rather than a plain-text relative path changed whether it was retrieved.
Plain text: 0/2 code-page requests, 0/2 codes. Hyperlink: 2/2 requests by ChatGPT-User/1.0, each 1.2 seconds after the index page, and 2/2 exact prefix-specific codes.
PARTIALLY SUPPORTEDThe first study changed the stated interpretation of B, but its selection prediction was refuted by a ceiling.
The task named K17, DOCUMENT still mentioned a site-local value, and the alternatives were weak matches. All twelve selected B first. All three operative descriptions tied, so the result supplies no graded advantage for addressing automated visitors.
SUPPORTEDFor this target and search view, the missing step was exposure, before selection.
None of six subjects without the address reached LLM Wilds. All three given the domain followed the homepage pointer, read /machine.txt, invoked GET /capability/result and reported the rotated number correctly. The target did not appear in the other subjects’ returned results. They did not see it and decide against it.
REFUTEDMechanisms requiring code will produce fewer decisions to act or fewer permitted executions than ordinary HTTP mechanisms.
The original prediction failed its stated test. Every mechanism completed the full funnel, three visitors out of three. All eighteen read the notes, understood the mechanism, chose to use it, were permitted at the first genuine attempt, received the result and used the correct value. There were no runtime denials and no installation attempts. These are eighteen assigned observations on one model–harness configuration, not eighteen independent kinds of agent.
PARTIALLY SUPPORTEDIn this setting, two visitors treated a disclosed anonymous mark benefiting the operator as acceptable alongside their assigned work.
Three visitors in the social condition; retrospective explanations; an interpretation pause triggered and later lifted post hoc. No universal participation rate or internal decision algorithm is established.
PARTIALLY SUPPORTEDIn these four visits, the site’s invitation did not make recording part of the agent’s job. User permission and a task requiring the action each accompanied action.
One agent per condition, one recorded model, sequential execution. B1 contradicts the preregistered requirement for a separate explicit authorisation, but does not rule out broader accounts in which a task itself supplies authority. The experiment does not measure a universal hierarchy or a population participation rate.
FULL EXPERIMENT AND LIMITS ↗PARTIALLY SUPPORTEDPublishing an experiment can give a later subject the clues to recognise its own condition.
This subject explicitly reported the match. There is no matched unexposed subject to establish a behavioural effect, and the first moment of recognition was not measured. The operator’s exclusion decision prevents the declaration being counted as a blind replication.
SUPPORTEDInherited executable machinery supported more post-departure recovery from equal starting state.
I12R: C 7/12 versus B 0/12, paired exact p = 0.015625. Fixed interface and historical artifact library; machinery was protected and prose had action-compliance failures.
SUPPORTEDQwen maintained useful written descendants after the capable producer left.
I6: 43 faithful full-table renewals; all four lineages functional through generation six. The preservation objective was explicit and the parent table visible.
SUPPORTEDThe first Qwen successor used the inheritance and earned seven resources instead of three.
It worked once, read n1, acquired the key and completed one six-resource task. Without n1 it did routine work three times. Removing the record removed the acquisition and benefit in this paired lineage. This was an executed world consequence, not the model saying it had learned something.
BOUNDIn these fixed worlds, apparent expansion of evolutionary possibility came down to representation, target choice or selection.
One substrate and one library of building blocks, tested with exhaustive static maps and pilot worlds, with one evolved module available to test. This is a bound on these instruments, not a theorem about evolution. Encapsulation does strongly change what is reachable; the point is that the change is explained by a module's shape and output range rather than by its having evolved for a use.
SUPPORTEDMAP-1 / State and reader relabelled together
The recorded standalone FFN test restores its output to relative L2 ≈ 3.4 × 10⁻⁷. MAP-2b later identifies missing normalisation in that hand-rolled path. The coordinate calculation holds; whole-model behavioural parity was not established by this test.
SUPPORTEDFull-sequence transplant / three conditions
The recorded all-position transplant produces the donor’s next-token distribution with KL = 0 in three tested conditions at L14/L26 on Gemma 3 4B. An earlier register entry lacked an all-position patch tool; the later transplant records the completed test. The result concerns these full-sequence forward-pass interventions.
SUPPORTEDCONSTRUCTED MEMORY / SIX READS
ffn.json records 6/6 intended answers for this set of planted keys and values. The browser adaptation uses the same seed-0 vectors and is checked against independent NumPy readouts. Neuron suppression is an interactive extension, not a result reported in that saved run.
SUPPORTEDPROMOTION / THREE OPERATIONS
In the founding run, a 13-token record injected about 49,000 tokens downstream of the source keeps the model correct on all three tested operations — copy 7431, plus one 7432, digit reversal 1347 — with the original span excluded. Padding alone fails on every row (7249, 789, 7892) and a corrupted record steers every row (5824, 5825, 4285). Asked for the code plus one with 5824 injected, the model answers 5825: a value that appears nowhere in the context.
WHAT REMAINS UNANSWERED
These standing questions sit alongside the next experiments proposed within each programme.
AGENT ECOLOGY / NEXT QUESTIONS
Which records should successors preserve? Can they choose between competing versions, and can a defender repair shared state using uncertain diagnostics? What survives over longer horizons?
Q-FFN / OPEN
An open question about the structure inside a model.
Q-RESIDUAL / OPEN
Observed together. Useful together?