gbanyan
12637cd413
Lands v4.0 §IV / §V / §VI content into v3.20.0 master sub-files. Strips internal close-out checklists, draft notes, and open-questions blocks at splice. Completes the Phase 6 manuscript-master file assembly. §IV Results (paper_a_results_v3.md): - §IV-A..C: kept v3.20.0 inherited content (experimental setup, detection performance, all-pairs distribution); added v4 scope note (Big-4 primary) at the §IV header - §IV-D..K: replaced v3.20.0 §IV-D..H with v4.0 §IV-D..K (Big-4 distributional / mixture / convergence / LOOO / pixel-identity / inter-CPA reference / five-way classification / full-dataset robustness) - §IV-L: renumbered v3.20.0 §IV-I (backbone ablation) content to match v4's "§IV-L inherited from v3.20.0 §IV-I" reframing - §IV-M: appended v4.0 ICCR calibration tables (XX-XXVI): composition decomposition, per-comparison/per-signature/ per-document ICCRs, firm heterogeneity + cross-firm hit matrix, alert-rate sensitivity - §III-K ablation cross-ref updated to §IV-L (was §IV-I) - Phase 3 close-out checklist (lines 365+) stripped §V Discussion (paper_a_discussion_v3.md): - Replaced v3.20.0 §V with v4.0 §V (8 sub-sections A-H): A. Distinct problem framing B. Continuous quality spectrum + composition-driven multimodality C. Firm A as templated end (case study, not anchor) D. K=2 / K=3 descriptive partitions E. Three-score convergent internal-consistency F. Anchor-based multi-level calibration G. Pixel-identity hard positive anchor + ICCR reframing H. Limitations (14 items: 9 v4-specific + 5 inherited from v3.x) §VI Conclusion (paper_a_conclusion_v3.md): - Replaced v3.20.0 §VI with v4.0 §VI (8 contribution items mirroring §I contributions; 4-direction future work). Known splice-time issue (deferred to typesetting): §IV table numbering is sequential by label (V, VI, ..., XXVI) but Table XIX (document-level worst-case) appears physically before Tables XVI/XVII/XVIII in §IV-J narrative flow. IEEE Access typesetters typically normalize table order during typesetting; we accept the in-file ordering quirk to preserve the §IV-J narrative arc (per-signature -> document-level worst-case -> K=3 cross-tab). Renumbering to strictly-ascending physical order would require renaming Tables XVI/XVII/XVIII -> XVII/XVIII/XIX with downstream cross-reference updates; deferred unless partner Jimmy review or IEEE Access submission portal flags it. Manuscript splice complete. Working drafts in paper/v4/ retained as archive of the round-by-round Phase 5 fix history. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
PDF Signature Extraction System
Automated extraction of handwritten Chinese signatures from PDF documents using hybrid VLM + Computer Vision approach.
Quick Start
Step 1: Extract Pages from CSV
cd /Volumes/NV2/pdf_recognize
source venv/bin/activate
python extract_pages_from_csv.py
Step 2: Extract Signatures
python extract_signatures_hybrid.py
Documentation
- PROJECT_DOCUMENTATION.md - Complete project history, all approaches tested, detailed results
- README_page_extraction.md - Page extraction documentation
- README_hybrid_extraction.md - Hybrid signature extraction documentation
Current Performance
Test Dataset: 5 PDF pages
- Signatures expected: 10
- Signatures found: 7
- Precision: 100% (no false positives)
- Recall: 70%
Key Features
✅ Hybrid Approach: VLM name extraction + CV detection + VLM verification
✅ Name-Based: Signatures saved as signature_周寶蓮.png
✅ No False Positives: Name-specific verification filters out dates, text, stamps
✅ Duplicate Prevention: Only one signature per person
✅ Handles Both: PDFs with/without text layer
File Structure
extract_pages_from_csv.py # Step 1: Extract pages
extract_signatures_hybrid.py # Step 2: Extract signatures (CURRENT)
README.md # This file
PROJECT_DOCUMENTATION.md # Complete documentation
README_page_extraction.md # Page extraction guide
README_hybrid_extraction.md # Signature extraction guide
Requirements
- Python 3.9+
- PyMuPDF, OpenCV, NumPy, Requests
- Ollama with qwen2.5vl:32b model
- Ollama instance: http://192.168.30.36:11434
Data
- Input:
/Volumes/NV2/PDF-Processing/master_signatures.csv(86,073 rows) - PDFs:
/Volumes/NV2/PDF-Processing/total-pdf/batch_*/ - Output:
/Volumes/NV2/PDF-Processing/signature-image-output/
Status
✅ Page extraction: Tested with 100 files, working ✅ Signature extraction: Tested with 5 files, 70% recall, 100% precision ⏳ Large-scale testing: Pending ⏳ Full dataset (86K files): Pending
See PROJECT_DOCUMENTATION.md for complete details.