pdf_signature_extraction/paper/codex_review_gpt55_v4_round5.md

Paper A Round 25 Review - v4 round 5

Reviewer: gpt-5.5 xhigh
Date: 2026-05-12
Target: paper/v4/paper_a_results_v4_section_iv.md (§IV v3.1 target; file header still says Draft v3)
Paired methodology: paper/v4/paper_a_methodology_v4_section_iii.md (§III v5)
Rubric: paper/codex_review_gpt55_v4_round4.md (3 Major-PARTIAL, 2 Minor-PARTIAL, 1 Editorial-OPEN, plus 7 next-step actions)

Verdict

Minor Revision.

The round-24 empirical and cross-reference residuals have mostly converged. §III v5 now aligns the K=3 LOOO weight drift to 0.023, fixes the §IV-I / v3.20.0 Table X FAR pointer, makes the low-cosine rule inclusive at cos <= 0.837, and adds the full-dataset n = 686 provenance row. §IV v3.1 remains numerically/provenance-faithful.

I do not recommend Accept yet because the partner-facing package still contains internal draft notes/checklists and unresolved table-numbering/version residues. There is also a small anonymisation regression in §III's v5 changelog: the body now uses Firm A-D, but the internal note itself reprints two real firm names (§III:11).

Round-24 Finding Closure Table

Round-24 item	v5/v3.1 status	v5/v3.1 line evidence
Major 1. Table numbering was incoherent and inherited v3 tables collided with current v4 tables.	PARTIAL	Core collision remains fixed: §IV says fresh v4 tables are V-XVIII and inherited v3 tables keep v3.20.0 Table N (§IV:3); inherited detection/all-pairs/ablation are cited as v3.20.0 Tables III/IV/V/XVIII (§IV:13, 19, 256). Residual remains: the same note still says "Tables IV-XVIII" despite the v4 sequence starting at Table V (§IV:3), and the close-out checklist repeats "Tables IV-XVIII" with Table XV-B (§IV:265).
Major 2. §III stale cross-references not supported by §IV.	CLOSED	§III now points signature-level classification to §IV-J and inherited inter-CPA FAR to §IV-I (§III:18), scopes v4-new vs inherited §IV sections accurately (§III:28), cites the FAR evidence as §IV-I / v3.20.0 §IV-F.1 Table X (§III:124), and no longer sends the moderate-band open question to current §IV-F (§III:204).
Major 4. Anonymisation leak in paired §III/§IV package.	PARTIAL	The manuscript body is repaired: §III uses Firm A-D in the score discussion (§III:104), and §IV tables/prose use Firm A-D (§IV:95-98, 181-184, 217-222). However §III's internal v5 changelog reprints real names while saying they were removed (§III:11). This is not a body-table leak, but it keeps the file-level anonymisation cleanup incomplete until draft notes are stripped.
Minor 1. K=3 LOOO C1 weight drift should be 0.023/0.0235, not 0.025.	CLOSED	§III now reports 0.023 in the K=3 LOOO discussion (§III:76, 120) and provenance table (§III:178); §IV reports 0.023 (§IV:139). This matches Script 37 (k3_loo_report.md:79).
Minor 3. Low-cosine cutoff inclusivity should match Script 42 (cos <= 0.837).	CLOSED	§III-L now defines Likely hand-signed as "Cosine at or below" the crossover with cos <= 0.837 (§III:148); §IV repeats cosine <= 0.837 => Likely-hand-signed and explicitly ties it to Script 42 (§IV:19).
Editorial 1. Remove draft notes and Phase 3 close-out checklist before submission.	OPEN	Internal notes remain in both files: §III has a draft note, cross-reference index, and open questions (§III:3, 193-208); §IV has a draft note and Phase 3 checklist (§IV:3, 260-269). §IV also still identifies itself as Draft v3 / post rounds 21-23 (§IV:1, 3) despite this round targeting v3.1.
Action 1. Scrub §III real firm names/aliases.	PARTIAL	The old body leaks are gone, but §III:11 now quotes two real firm names in the v5 changelog. Replace with "real firm names/aliases" or remove the changelog before partner review.
Action 2. Align K=3 LOOO weight drift to Script 37 throughout §III.	CLOSED	§III:76, §III:120, and §III:178 all use 0.023; §IV:139 matches.
Action 3. Fix stale §III refs: FAR pointer and moderate-band open question.	CLOSED	FAR pointer now cites §IV-I / v3.20.0 §IV-F.1 Table X (§III:124); the moderate-band open question now points to v3.20.0 Tables IX/XI/XII/XII-B and §IV-J, not current §IV-F (§III:204).
Action 4. Make §III-L low-cosine rule inclusive.	CLOSED	§III:148 says cos <= 0.837; §IV:19 and Script 42 agree.
Action 5. Remove/move internal notes and fix stale v2/v3/round-23 text.	OPEN	Notes remain (§III:3, 193-208; §IV:3, 260-269). Some stale text is still visible: §IV title and draft note say Draft v3 / post rounds 21-23 (§IV:1, 3), and the checklist says "this v3 of §IV" (§IV:267).
Action 6. Finalise table numbering and remove residual "Tables IV-XVIII" if sequence starts at Table V.	PARTIAL	The current body table sequence is internally usable (V-XVIII with XV-B), but the finalisation note still says Tables IV-XVIII (§IV:3, 265), and §III leaves table numbering open (§III:208).
Action 7. Add §III provenance for full-dataset n = 686.	CLOSED	§III now states §IV-K uses n = 686 (§III:28) and adds a provenance row citing Script 41 / fulldataset_report.md (§III:184). §IV reports the same full-dataset count (§IV:230, 247).

Newly Introduced Issues

1. §III v5 changelog reintroduces real firm names. The body anonymisation fix succeeded, but §III:11 quotes two real names in the internal changelog. If the note is stripped before partner review, this disappears; if the file is circulated as-is, anonymisation is still not clean.

2. §III empirical-anchor range is stale after the Script 41/42 additions. §III:14 says empirical anchors reference Scripts 32-40, but the same file now cites Script 41 for full-dataset n = 686 (§III:184) and references Scripts 38-42 in the classifier-validation caveat (§III:136). §IV's anchor statement already uses Scripts 32-42 (§IV:3). Align §III:14 to Scripts 32-42.

3. §IV v3.1 is not labelled as v3.1 in the file. The requested target is §IV v3.1, but the file title and draft note still say v3 / post rounds 21-23 (§IV:1, 3). This is editorial, but it will confuse the Phase 4 handoff.

Cross-Reference Checks (§III v5 <-> §IV v3.1)

Linkage	§III v5 evidence	§IV v3.1 evidence	Status
Big-4 scope and inherited/full-dataset exceptions.	§III:28, 36	§IV:9, 15, 230, 254-256	Tight.
K=2/K=3 mixtures are descriptive, not operational.	§III:62, 76-84, 154	§IV:75, 139, 224	Tight.
Three-score internal-consistency and per-firm ranking nuance.	§III:88-104	§IV:79-102	Tight in body; anonymisation note issue remains outside body (§III:11).
Positive-anchor miss rate and inherited inter-CPA FAR.	§III:122-132, 186	§IV:143-159	Tight; the old bad "§III-J inherited; Table X" pointer is gone.
Five-way classifier retained; MC band inherited only.	§III:136-150, 204	§IV:163, 213	Tight.
Inclusive LH cutoff at cos <= 0.837.	§III:148	§IV:19	Tight and matches Script 42.
Full-dataset robustness is light scope only.	§III:28, 184, 204	§IV:230-252	Tight.
Internal notes / table-numbering handoff.	§III:193-208	§IV:260-269	Not partner-ready; remaining editorial open items are all here.

Provenance Spot-Checks Of v5 Changes

v5 change checked	Manuscript evidence	Spike-report evidence	Status
K=3 LOOO C1 weight drift is 0.023, not 0.025.	§III:76, 120, 178; §IV:139	k3_loo_report.md:76 lists fold C1 weights; k3_loo_report.md:79 reports max C1 weight deviation 0.023.	Confirmed.
Full-dataset n = 686 provenance row added.	§III:28, 184; §IV:230, 247	fulldataset_report.md:10-13 reports Big-4 437 and full dataset 686; lines 29-31 report full rho 0.9558 and drift 0.0069, matching §IV:246-248.	Confirmed.
Low-cosine Likely-hand-signed rule is inclusive at cos <= 0.837.	§III:148; §IV:19	five_way_report.md:6-10 defines HC/MC/HSC/UN/LH and gives LH : cos <= 0.837.	Confirmed.
Full-dataset component rows in §IV-K.	§IV:236-240	fulldataset_report.md:19-23 reports the same full component centers, drifts, and BIC values after rounding.	Confirmed.

Phase 4 Readiness

Partial.

The empirical content and §III-§IV technical cross-references are ready for Phase 4 technical review. The package is not yet clean enough for partner-facing circulation because the internal notes/checklists remain, §IV still carries v3/round-23 labels, table numbering is still provisional, and §III:11 reprints real firm names inside the changelog.

Recommended Next-Step Actions

1. Strip or move all internal draft notes, cross-reference indices, open questions, and the §IV Phase 3 checklist before partner review. This also removes the §III:11 anonymisation regression if the changelog is deleted.

2. If any changelog remains, replace the real names in §III:11 with "real firm names/aliases" and update §III:14 from Scripts 32-40 to Scripts 32-42.

3. Finalise §IV table numbering: either make the current v4 sequence explicitly Tables V-XVIII with XV-B accepted, or renumber to remove XV-B; in either case remove residual "Tables IV-XVIII" wording (§IV:3, 265).

4. Update the §IV header/draft note to the actual target version and round status, or remove the draft note entirely (§IV:1, 3, 267).