Pipeline
Turn the document drop into verified experiment records — work the steps left to right.
1
Discoversee what's in the drop
2
Extractdocuments → data, checked as you go
3
Linkconnect to experiments
4
Browsethe experiment records
OCR pending PDFs (Chandra 2)
Status
done
Started18:24:59 → 18:25:31
Steps2
Log
$ [1/2] bash /Users/moryasolutions/local-docqa/scripts/ingest_all.sh ocr OCR engine: Chandra 2 (MLX, in-process) — the model servers stay up. skip (done): IR SAW #19 976030726B.pdf skip (done): IR BYK 9076 STD.pdf skip (done): NO-P-76 1H.pdf skip (done): NO-P-76 1H zoom1.pdf skip (done): NO-P-76 1H zoom2.pdf skip (done): NO-P-76 1H expn.pdf skip (done): NO-P-76 13C.pdf skip (done): NO-P-76 13C zoom1.pdf skip (done): NO-P-76 13C expn.pdf skip (done): NO-P-76 13C zoom2.pdf skip (done): P 76 B.NO 48 13C.pdf skip (done): P 76 B.NO 48 13C zoom1.pdf skip (done): P 76 B.NO 48 1H zoom1.pdf skip (done): P 76 B.NO 48 1H.pdf skip (done): marketplace listing byk 9076 print.pdf skip (done): US20990112345A1 phosphate ester dispersant.pdf skip (done): EP4123456B1 comb copolymer additive.pdf skip (done): DISPERBYK-9076 TDS.pdf skip (done): Exp 19.pdf skip (done): Lab Batch 51.pdf skip (done): Lab Batch 24A.pdf skip (done): Lab Batch 30.pdf skip (done): Lab Batch 26.pdf skip (done): LBN 8.pdf skip (done): Lab Batch 35.pdf skip (done): LBN 23.pdf skip (done): Lab Batc 40.pdf skip (done): Lab Batch 12.pdf skip (done): Lab Batch 16.pdf skip (done): Exp 49.pdf skip (done): LBN 3.pdf skip (done): Lab Batch 48.pdf skip (done): 9076 lab notebook scan.pdf scanned | 1 pages | 159 chars/page | CN114899001A pigment dispersant.pdf scanned | 1 pages | 115 chars/page | CN109887654B ink additive.pdf model loaded in 1.9s === CN114899001A pigment dispersant === page 1: 1596x2240px 366 chars in 15.5s --- CN114899001A pigment dispersant: 15.5s total === CN109887654B ink additive === page 1: 1596x2240px 314 chars in 12.6s --- CN109887654B ink additive: 12.7s total Profiled 35 documents, 40 distinct identifiers -> /Users/moryasolutions/local-docqa/projects/test-project/context/generated Scored 0 documents -> /Users/moryasolutions/local-docqa/projects/test-project/context/generated/ocr-accuracy.md $ [2/2] /Users/moryasolutions/local-docqa/.venv/bin/python /Users/moryasolutions/local-docqa/scripts/pipeline/crawl_sources.py crawl_sources: 49 files in 10 categories; 38 ingested, 0 extracted, 20 with suggestions; crawl diff +0 ~0 -0