altair823
58ac62d53a
혼합 출처 KB(위키+jira 등)에서 색인은 전부 하되 질의 시 출처로 좁히는 provenance 레버. 전역 trust 곱셈가중(weighted-RRF)은 A/B 에서 반증(θ=0.85 만으로 incident MRR 0.918→0.340 절벽, 점수 압축) — 필터가 see-saw 없는 올바른 레버. - config [[workspace.sources]] (각 id/root/exclude/trust_level/source_type); 단일 root 는 implicit `default` source 로 정규화. validate: id 유일·비어있지 않음. - config schema v3→v4 (step_3_to_4, root→[[workspace.sources]] id=default 미러, 멱등) - V014 documents.source_id 컬럼+인덱스 (additive, DEFAULT 'default', 재색인 0) - Metadata.source_id + BodyHints trust precedence(frontmatter > source 기본값 > Primary) - ingest: --root 미지정 시 resolved_sources() 순회 + doc 마다 source_id/trust stamp - 검색 SearchFilters.source_type/source_id → lexical + vector 두 site (IN, OR) - CLI kebab search --source <id> / --source-type <type> (repeatable/comma-sep) 도그푸딩(620 doc, jira400+wiki220): --source wiki 로 개념 질의 MRR 0.780→0.810, --source jira 로 incident 0.918→0.975. trust precedence 실측(jira=secondary 기본값). version bump 0.28.0 → 0.29.0 (신규 CLI flag + config 키 + V014 migration → minor). follow-up: MCP search 필터 미노출 · kebab list source_id 미표시 · RAG provenance 라벨. 자세한 내용: tasks/HOTFIXES.md (2026-06-21), docs/release-notes/v0.29.0-draft.md. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_012Mc6W1fgsrbFKTsqA6P8La
115 lines
4.2 KiB
Rust
115 lines
4.2 KiB
Rust
//! Integration: kebab_app::ingest_file_with_config copies external file
|
|
//! to _external/, ingests as single asset, idempotent on second call.
|
|
|
|
use std::fs;
|
|
|
|
use kebab_config::Config;
|
|
|
|
#[test]
|
|
fn ingest_file_copies_external_md_and_reports_new() {
|
|
let dir = tempfile::tempdir().unwrap();
|
|
let workspace = dir.path().join("notes");
|
|
let data = dir.path().join("data");
|
|
fs::create_dir_all(&workspace).unwrap();
|
|
fs::create_dir_all(&data).unwrap();
|
|
|
|
let mut cfg = Config::defaults();
|
|
cfg.workspace.root = Some(workspace.to_string_lossy().into_owned());
|
|
cfg.storage.data_dir = data.to_string_lossy().into_owned();
|
|
cfg.models.embedding.provider = "none".to_string();
|
|
cfg.models.embedding.dimensions = 0;
|
|
|
|
// Source file outside the workspace.
|
|
let external_src = dir.path().join("source.md");
|
|
fs::write(&external_src, "# Hello\n\nbody.").unwrap();
|
|
|
|
let report = kebab_app::ingest_file_with_config(cfg.clone(), &external_src).unwrap();
|
|
assert_eq!(report.scanned, 1, "{report:?}");
|
|
assert_eq!(report.new, 1, "{report:?}");
|
|
assert_eq!(report.unchanged, 0, "{report:?}");
|
|
|
|
// _external/ dir created, file copied with hash prefix.
|
|
let ext_dir = workspace.join("_external");
|
|
assert!(ext_dir.is_dir());
|
|
let entries: Vec<_> = fs::read_dir(&ext_dir)
|
|
.unwrap()
|
|
.filter_map(std::result::Result::ok)
|
|
.collect();
|
|
assert_eq!(entries.len(), 1, "exactly one file in _external/");
|
|
let name = entries[0].file_name().to_string_lossy().into_owned();
|
|
assert!(name.ends_with(".md"));
|
|
|
|
// .kebabignore has _external/ line.
|
|
let ki = fs::read_to_string(workspace.join(".kebabignore")).unwrap();
|
|
assert!(ki.lines().any(|l| l.trim() == "_external/"));
|
|
}
|
|
|
|
#[test]
|
|
fn ingest_file_idempotent_on_second_call() {
|
|
let dir = tempfile::tempdir().unwrap();
|
|
let workspace = dir.path().join("notes");
|
|
let data = dir.path().join("data");
|
|
fs::create_dir_all(&workspace).unwrap();
|
|
fs::create_dir_all(&data).unwrap();
|
|
|
|
let mut cfg = Config::defaults();
|
|
cfg.workspace.root = Some(workspace.to_string_lossy().into_owned());
|
|
cfg.storage.data_dir = data.to_string_lossy().into_owned();
|
|
cfg.models.embedding.provider = "none".to_string();
|
|
cfg.models.embedding.dimensions = 0;
|
|
|
|
let src = dir.path().join("doc.md");
|
|
fs::write(&src, "# A\n\nbody.").unwrap();
|
|
|
|
let r1 = kebab_app::ingest_file_with_config(cfg.clone(), &src).unwrap();
|
|
assert_eq!(r1.new, 1);
|
|
|
|
let r2 = kebab_app::ingest_file_with_config(cfg.clone(), &src).unwrap();
|
|
assert_eq!(r2.new, 0, "{r2:?}");
|
|
assert_eq!(r2.unchanged, 1, "{r2:?}");
|
|
}
|
|
|
|
#[test]
|
|
fn ingest_file_errors_on_missing_path() {
|
|
let dir = tempfile::tempdir().unwrap();
|
|
let workspace = dir.path().join("notes");
|
|
let data = dir.path().join("data");
|
|
fs::create_dir_all(&workspace).unwrap();
|
|
fs::create_dir_all(&data).unwrap();
|
|
|
|
let mut cfg = Config::defaults();
|
|
cfg.workspace.root = Some(workspace.to_string_lossy().into_owned());
|
|
cfg.storage.data_dir = data.to_string_lossy().into_owned();
|
|
cfg.models.embedding.provider = "none".to_string();
|
|
cfg.models.embedding.dimensions = 0;
|
|
|
|
let nonexistent = dir.path().join("nope.md");
|
|
let err = kebab_app::ingest_file_with_config(cfg, &nonexistent).unwrap_err();
|
|
assert!(err.to_string().contains("does not exist"), "{err}");
|
|
}
|
|
|
|
#[test]
|
|
fn ingest_file_errors_on_unsupported_extension() {
|
|
let dir = tempfile::tempdir().unwrap();
|
|
let workspace = dir.path().join("notes");
|
|
let data = dir.path().join("data");
|
|
fs::create_dir_all(&workspace).unwrap();
|
|
fs::create_dir_all(&data).unwrap();
|
|
|
|
let mut cfg = Config::defaults();
|
|
cfg.workspace.root = Some(workspace.to_string_lossy().into_owned());
|
|
cfg.storage.data_dir = data.to_string_lossy().into_owned();
|
|
cfg.models.embedding.provider = "none".to_string();
|
|
cfg.models.embedding.dimensions = 0;
|
|
|
|
let docx = dir.path().join("doc.docx");
|
|
fs::write(&docx, b"fake docx bytes").unwrap();
|
|
|
|
let err = kebab_app::ingest_file_with_config(cfg, &docx).unwrap_err();
|
|
assert!(err.to_string().contains("unsupported extension"), "{err}");
|
|
assert!(
|
|
err.to_string().contains(".docx") || err.to_string().contains("docx"),
|
|
"{err}"
|
|
);
|
|
}
|