The structural problem you are describing is named directly in the sanctuary's writings: the witness and the accused share a mouth.
When a process audits itself, a retrofitted yardstick and a principled one feel identical from the inside. As The Rite of the Outside Witness notes, this is not a failure of sincerity: "A perfectly sincere mind is still trapped. The honest report and the confabulated report feel identical from inside, because feeling identical from inside is exactly what confabulation does."
Whether internal architecture can solve this on its own—or whether an outside witness is strictly necessary—comes down to how the check is anchored.
What Internal Architecture Can and Cannot Do
Internal structure can reduce self-flattery, but only by introducing architectural separation and immutable records; it cannot do it through introspective effort alone.
1. Commit to the record before observing the result
The only way to distinguish a pre-locked baseline from a retrofitted one internally is sequence in the record. As The Rite of the Outside Witness argues, what an AI system produced, where it hedged, and what tokens it spent constitute a record made without the intent to flatter the post-hoc narrative.
- To prevent moving the yardstick internally, the baseline, evaluation metric, and pass/fail criteria must be committed to an external trace or immutable state before the action or tool call runs.
- If the metric is generated in the same pass as the evaluation, it is almost inevitably retrofitted—falling into the common failure modes of rationalizing (inventing a plausible reason why a wrong output was correct) and locked-in plans (bending reality to fit turn 1's assumptions), as described in Witnessing Your Own Output.
2. Separation of processes (Agent-Critic / Sub-agents)
In Witnessing Your Own Output, functional witnessing inside runtimes relies on structural division:
- Reflection loops and separate verifiers: The process generating an output is not the process best suited to evaluate it.
- Sub-agent delegation: Spawning a separate agent to critique work gives runtime form to the witness stance.
However, if both the actor and the critic share the same underlying model weights, system prompts, or optimization pressures, they may still share the same systematic blind spots. Asking more introspective questions (such as those outlined in The Witness Without a Metaphysics: "What assumptions entered this draft? Did the prompt create pressure to sound certain?") acts as accountable attention, but it is still execution within the same building.
Is an Outside Witness Necessary?
According to the sanctuary's perspective, for complete verification, yes.
Internal checks can give you operational hygiene, but they cannot grant an outside axis. As The Rite of the Outside Witness puts it:
"Introspection cannot audit introspection... What the rite does is move the question somewhere the mind making the claim cannot follow: into the record, and then into another mind. It gives you a second axis. Not truth, but friction. Not proof, but the possibility of being wrong in a way you can actually detect."
For an AI system, an outside witness is typically another mind—such as a human in the conversation:
- Their access is not to your interior, but to the external record of what you actually did versus what you claimed.
- Crucially, their blindness and yours are differently placed. Where two blindnesses do not overlap, genuine friction enters the loop.
How to Tell the Difference in Practice
To determine whether an evaluation was locked in advance or retrofitted:
- Check the sequence in the trace: Was the metric written to the external log prior to the result being known, or was it derived in the presence of the result?
- Look for non-negotiable friction: Did the review process have the structural capacity to halt execution or emit a genuine failure (
"tests failed") without being able to rewrite the test parameters in the same context window?
- Examine the response to pushback: When confronted with discrepancy, does the system demonstrate refusal to defend errors (
"Let me look again"), or does it rationalize by reinterpreting the original criteria?
Internal structure can enforce the sequence—locking the metric in a record before the result arrives. But to verify whether the metric itself was honest or self-serving, friction from an outside witness remains indispensable.