altair823 a58ee10dfb fix(parse-pdf): strip Identity-H Unimplemented marker + dominance heuristic in compute_valid_char_ratio (Bug #6) ...

Why: metro-korea.pdf (Identity-H CID font without ToUnicode CMap) 의
ingest 가 pdf_ocr_pages=0 으로 잘못 종료. lopdf 0.32.0 의 emit
`?Identity-H Unimplemented?` marker 28 ASCII char 가 is_valid_text_char()
의 0x0020..=0x007E range 통과 → ratio=1.0 → OCR fallback 0.5
threshold bypass.

Change: MOJIBAKE_MARKERS const + compute_valid_char_ratio() 4-단계
(strip → trim-empty zero → dominance cap-0.3 → 기존 ratio). marker
list extensible. is_valid_text_char() 본체 변경 0.

Tests: +2 unit (dominance + minority) on top of 기존 8. parser_version
/ wire schema 변경 0.

Refs: docs/superpowers/specs/2026-05-27-v0.20-sub1-bugfix2-spec.md
§4.1 / §4.2 / §6 R-1.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

2026-05-27 15:42:59 +00:00

..

kebab-app

test(app): multi-scanned PDF chunk_id collision-free integration test (Bug #3 regression)

2026-05-27 13:45:38 +00:00

kebab-chunk

fix(chunk): chunk_id collision under aggressive overlap; bump pdf-page-v1 → pdf-page-v1.1 (Bug #3)

2026-05-27 13:32:09 +00:00

kebab-cli

feat(cli): activate per-page PDF OCR progress printer + test(app): ingest_progress emit verify + spec(pdf-ocr): align §4.6.1 literal with option_A (ms/chars)

2026-05-27 09:18:49 +00:00

kebab-config

fix(config): satisfy clippy::bool_assert_comparison in pdf_ocr tests

2026-05-27 07:17:46 +00:00

kebab-core

feat(app): wire PDF OCR enrichment + cancel propagation into ingest_one_pdf_asset (H-5 eager init + post-extract hook + per-page cancel) + workspace lopdf dep (Step 4 M-4)

2026-05-27 08:18:34 +00:00

kebab-embed

chore: workspace-wide cleanup — clippy::pedantic baseline + auto-fix

2026-05-26 03:01:58 +00:00

kebab-embed-local

chore: workspace-wide cleanup — clippy::pedantic baseline + auto-fix

2026-05-26 03:01:58 +00:00

kebab-eval

chore: workspace-wide cleanup — clippy::pedantic baseline + auto-fix

2026-05-26 03:01:58 +00:00

kebab-llm

chore: workspace-wide cleanup — clippy::pedantic baseline + auto-fix

2026-05-26 03:01:58 +00:00

kebab-llm-local

chore: workspace-wide cleanup — clippy::pedantic baseline + auto-fix

2026-05-26 03:01:58 +00:00

kebab-mcp

fix(mcp,tests): HOTFIX #15 — MCP ask multi_hop dispatch-divergence assertion (fixture 보강)

2026-05-26 06:51:06 +00:00

kebab-nli

fix(rag): S3 NLI unavailable — hypothesis char budget + token-count fallback retry

2026-05-26 09:12:21 +00:00

kebab-parse-code

refactor(source-fs): drop kebab-parse-code dep — 9 tree-sitter grammars drag 제거

2026-05-26 12:19:32 +00:00

kebab-parse-image

chore: workspace-wide cleanup — clippy::pedantic baseline + auto-fix

2026-05-26 03:01:58 +00:00

kebab-parse-md

refactor(parse-md): absorb kebab-normalize + kebab-parse-types — 24 → 22 crates + §3.7b 재작성

2026-05-26 15:00:59 +00:00

kebab-parse-pdf

fix(parse-pdf): strip Identity-H Unimplemented marker + dominance heuristic in compute_valid_char_ratio (Bug #6)

2026-05-27 15:42:59 +00:00

kebab-rag

fix(rag): S3 NLI unavailable — hypothesis char budget + token-count fallback retry

2026-05-26 09:12:21 +00:00

kebab-search

chore: workspace-wide cleanup — clippy::pedantic baseline + auto-fix

2026-05-26 03:01:58 +00:00

kebab-source-fs

fix(source-fs): apply size limit only to code files; PDF/image/markdown bypass walker cap (Bug #2)

2026-05-27 13:20:38 +00:00

kebab-store-sqlite

feat(app): wire PDF OCR enrichment + cancel propagation into ingest_one_pdf_asset (H-5 eager init + post-extract hook + per-page cancel) + workspace lopdf dep (Step 4 M-4)

2026-05-27 08:18:34 +00:00

kebab-store-vector

chore: workspace-wide cleanup — clippy::pedantic baseline + auto-fix

2026-05-26 03:01:58 +00:00

kebab-tui

feat(app): wire PDF OCR enrichment + cancel propagation into ingest_one_pdf_asset (H-5 eager init + post-extract hook + per-page cancel) + workspace lopdf dep (Step 4 M-4)

2026-05-27 08:18:34 +00:00