Byte BPE can merge final native punctuation with appended newlines, changing an
existing token before any study encode. Keep the exact native prompt/template
and image row authoritative, then insert separately tokenized plain pole payloads
with explicitly owned delimiters before its original suffix.
Require deletion of every owned span to recover the original token objects,
weights, image handles and order. Reject special/media/role pole tokens and keep
native projection, neutral identity and existing node interfaces unchanged.
Validation: 181 host-free tests, required compile, exact saved-tokenizer source
bindings and real byte-BPE construction regressions. No post-fix model or visual
acceptance is claimed.
Kevin Gilper
b250536b89