Stage 3 render-derivation: shipped style table measures best; layers are second-order

Ran a render-based derivation for the style role on the model: held the real
style settings fixed, varied only the 12 layers across seven candidates,
rendered and scored look-transfer minus subject-leak.

- The shipped STYLE table scored best (objective 0.106); the shallow-tap table
  was worst - render evidence supports spiking the effective deep taps.
- But differences were small and every output was nearly the same bowl: at
  realistic style settings the layer table is a second-order knob. The primary
  look-vs-subject control is strength and the shape/global split.

Bottom line committed to the README: the reliable way to set the layers is
render-based measurement (conditioning analysis alone misleads); applying it
shows the shipped tables are directionally right and, for the style role,
near-optimal. The durable deliverable is the render harness, which can
re-derive or verify the layers for any future checkpoint. Full result + images
in local_records.
This commit is contained in:
Kevin Gilper
2026-07-03 07:50:48 -04:00
parent 5291940073
commit e8a97d0dcf
+30 -7
View File
@@ -172,14 +172,37 @@ means a fixed seed/prompt grid scored with objective, attribute-specific metrics
energy for texture, style/identity distances),
not by eye. [SCORING.md](SCORING.md) is the interim manual rubric.
### Stage 3 - optimize the table for a stated objective (definitive) - needs a V10 box
### Stage 3 - derive the table from renders (definitive) - RUN ONCE for the style role
Turn each role's intent into a measurable objective (e.g. style: maximize
style-similarity to the reference minus content/identity leakage) and optimize
the 12-gain vector with a black-box optimizer (CMA-ES / Bayesian optimization,
~100-300 evals for 12 dims), initialized from the Stage 0 prior + Stage 1 map,
trained and reported on held-out references. This *derives* the table from data
for the exact effect wanted.
Turn a role's intent into a measurable objective and pick/optimize the 12-gain
vector by *rendering* candidates and scoring them. Done here for the **style**
role: hold the real style-recipe settings fixed and vary only `layers`; render
(colorful reference -> plain-bowl prompt) and score look-transfer minus
subject-leak.
**Result (2026-07-03):** among seven candidate tables, the **shipped STYLE
table scored best** (objective 0.106), with the shallow-tap table clearly worst
- the render evidence supports spiking the deep taps. But the differences are
small and every candidate's output was nearly the same bowl, so **for the style
role the layer table is a second-order knob**: the shipped values hold up, and
the primary look-vs-subject control is strength and the shape/global
(token/pooled) split, not the per-tap vector. The layers visibly bite only in
the aggressive isolation test (Stage 1 result above), where the deep taps
dominate - which the shipped tables already emphasize.
To go further (more roles, references, a real CMA-ES/Bayesian optimizer with
CLIP style/identity metrics), the harness and objective are in place; this run
is the demonstration. Full result + images:
`local_records/.../stage1-measurement/stage3-derivation/`.
### Bottom line
The reliable, measured way to set the layers is **render-based** (Stages 2-3);
conditioning analysis alone misleads (Stage 1). Applying it shows the shipped
tables are directionally right (they spike the effective, high-magnitude deep
taps, which the model's own projector also leans on) and, for the style role,
near-optimal and second-order. The durable deliverable is the harness itself,
which can re-derive or verify the layers for any future checkpoint.
### Building the controlled reference sets