Fujigo

AI Drawing Extraction — Automated Quotation & Material Breakdown

Solution Overview

This solution addresses the problem of manual drawing reading and quotation calculation — work that currently consumes significant time and resources for mechanical and steel structure enterprises. The current manual process has 4 bottlenecks: engineers check each detail on PDF (scanned drawings must be zoomed and read manually), look up steel grades across multiple standards (JIS/DIN/EN/ASTM) and material densities in scattered locations, sum quantities manually without an independent verification step, then re-type data into Excel — error risk increases with line count, and mistakes only surface after the quotation has been sent.

The system automates the entire workflow in 6 end-to-end steps, uniform across all 4 document types: Document Ingestion (PDF/Excel/ZIP) → Classification (document type recognition) → Extraction (specialized engine) → Normalization (steel grade · unit · density) → Verification (numerical cross-check) → File Export (Quotation + Material Breakdown). When thresholds are not met, documents are routed to Human-in-the-loop; when the reviewer makes corrections, the system recalculates instantly and logs changes. The core differentiator: all data is traceable to its source, empty cells are flagged rather than guessed — results were measured on 04 sample document sets, processing 04/04 sets with quantity deviation ≤ 0.37% and 0 estimated data points.

Detailed Capabilities

Unified Data Model for All Document Sources

All sources — Excel, vector PDF, imperial cutlist, scan images — normalize to a unified structure. Adding new document types doesn't require rewriting calculation or quotation export logic.

SAP-Exported BOM Excel Extraction (Q2)

Reads the internal structure of files that common Excel libraries report as corrupted; recognizes columns by field name rather than position, making it resilient when column order or width changes between exports. Merges multiple document sets into a single consolidated quotation: actually ran 11 BOM files in one pass, aggregated quantities across the entire job before verification, producing a total of 374,559.89 USD with the summary section matching exactly.

Vector PDF Bill of Quantities Table Reading (Q3)

Reconstructs BOQ table rows and columns accurately based on character coordinates rather than image recognition, yielding high precision; verifies by section rather than just totals, so deviations surface at the right location. Handles Japanese terminology documents: correctly recognizes labels like 合計重量 (total weight), デッキ (deck), 手摺 (handrail) — no manual translation needed before feeding into the system.

SolidWorks Imperial Cutlist Processing (Q4)

Converts feet–inch–fraction strings to millimeters and pounds to kilograms before price calculation; all pricing calculations run on a unified metric system. Maps material standards to JIS (ASTM A36 → SS400, A500 Gr B → STKR400, S235JR+N → SS400); lines without direct JIS equivalents are flagged for reviewer decision, not auto-converted. Also calculates painting / surface treatment costs: when components lack lookup codes, the system estimates area based on m²/ton rates for section groups taken from the material sheet itself, clearly labeled as estimates.

Scan Drawing Reading Without Text Layer (Q1)

Recognizes title blocks and annotations from scanned images (e.g., UMW-550L exhaust silencer, weight 2,680 kg, material SS, heat-resistant paint 600°C), then extracts 23 structural components with materials and dimensions. Three-layer fallback, not dependent on a single provider: prioritize AI vision model → extracted results → character recognition. Can plug in Claude, OpenAI, or Gemini as preferred.

Numerical Verification Before Every File Export

Σ extracted quantities are automatically cross-checked against the reference total printed in the source document: within threshold allows export, outside threshold blocks and routes to reviewer — no seemingly-correct files are exported. Catches errors in the source documents themselves (e.g., 325 kg discrepancy in Q3 because the detail table has a handrail 手摺 line but the reference total デッキ doesn't include it).

Lookup from Customer's Own Data

Densities and standards are read directly from the material sheet in the customer's template (~1,060 lines). No external lookup tables are used, so results match how the enterprise currently calculates.

Human-in-the-loop — Clear Division of Machine vs Human Decisions

Fully automated by machine: read & extract components, convert units (imperial → metric), look up density from material sheet, calculate quantities and surface areas, cross-check Σ against reference total, fill template preserving formulas.

Machine flags, doesn't auto-decide: steel grades without JIS equivalents, lines missing quantity/dimensions, confidence below configured threshold, Σ exceeding deviation threshold, fire-resistant/stainless/fastener materials, documents exceeding template fill capacity.

Human decides, never automatic: commercial unit prices (system always leaves blank), confirm steel grades after mapping, approve flagged lines, decide when source documents conflict, approve final quotation before sending.

Each time a reviewer makes corrections, the system re-maps material standards and recalculates verification immediately, while logging who changed what — the final quotation is always traceable to its source.

Full Control of Quotation Templates

Fills into the customer's actual template (opens the correct file, preserves formulas, formatting, and layout); the original Breakdown sheet is kept intact for parallel verification. The template library has an admin page: naming, selecting default version, enabling/disabling per document type; users only select from a list when exporting, no need to upload files themselves. Changing templates doesn't require re-running extraction — template selection is separate from document reading, outputting the same dataset to a different template takes only seconds. Auto-detects template file layout instead of applying a hardcoded column map, preventing silent mis-fills.

Security & Two Deployment Options

On-premise: entire system runs within the internal network, drawings never leave the infrastructure, AI models run internally without calling external services — recommended for documents with strict security constraints.

Cloud: ready to use without server investment, continuous feature updates, data isolated per customer — recommended for initial phases.

Common mechanisms: clear permission separation (admin pages separate from user screens), edit logs, AI access keys stored in configuration not embedded in code, job-level data isolation.

Layered Architecture

5 layers: User Interface (document processing screen · HITL review screen · template admin page) → Application Services (document intake · processing orchestration · session and log storage) → Processing & Business Rules (document-type-specific extraction · unit normalization · steel grade mapping · quantity verification) → Data & File Export (unified data model · material catalog · template library · Excel file generation) → Technology Platform.

Adding new document types doesn't require modifying calculation or quotation export logic.

Field Validation Results (04 Sample Sets)

SetDocument TypeActual Source FileIndependent Verification TestResult
Q2SAP-exported BOM Excel7000027815_10_30921599Σ(quantity × unit weight) of 13 components vs Level 1 quantityDeviation 0 — 10,049.02 / 10,049.02 kg
Q3Vector PDF BOQ table①加熱炉_制作見積依頼.pdfΣ 合計重量 per section vs published reference totalDeviation 0.37% — 2/5 sections match exactly (S3, S4)
Q4Imperial cutlist (SolidWorks)FLR33000144 FRAME DETAILSΣ TOTAL vs TOTAL WEIGHT printed on drawingDeviation 0.15% — 9,026.09 / 9,040 LBS
Q1Scan drawing (image, no text)参考製作図.pdfDocument only publishes total 2,680 kg, no per-component quantities23 components → routed to HITL

Note: Q1's "insufficient data" report is the correct result, not an error — the system extracted all 23 components and routed to the reviewer rather than evenly distributing 2,680 kg to make the numbers add up. Q4 has 157 drawings, the presentation ran on a representative cluster; all 157 drawings fall within the scope of the official deployment phase. Q4 also calculated 100.37 m² surface area → painting cost 1,204 USD.

Technical Specifications

ParameterValue
Processing languagePython — document processing and calculation
Deployment architectureLightweight web service, container-based deployment
DatabaseEmbedded DB for sessions and logs
Excel processingRead/write library preserving formulas and formatting
PDF processingCharacter coordinate-based vector PDF reader
AI vision modelProvider-swappable — Claude / OpenAI / Gemini / in-house model
LicenseAll core technology is open source, no workstation count restrictions
Input formatsPDF · Excel · ZIP
Supported document typesBOM Excel (SAP) · Vector PDF (BOQ table) · Imperial cutlist (SolidWorks) · Scan drawing (image)
OutputQuotation + Material Breakdown sheets per original template
Material standardsJIS / DIN / EN / ASTM — mapped to JIS
Unit conversionfeet–inch–fraction → mm; pound → kg (all pricing calculations run on metric)
Material catalogRead directly from customer's material sheet (~1,060 lines)
Deployment optionsOn-premise or Cloud
Commercial modelSaaS (subscription) or License (perpetual license, unlimited users)

Deployment Roadmap

PhaseTimelineContentMilestone
Phase 0CompletedExtract Q2 · Q3 · Q4; numerical quantity verification; fill actual template; HITL review interfaceCurrent status
Phase 1Month 1–2Complete scan drawing branch; build geometry-based quantity calculation module; process all 157 Q4 drawingsCover 4/4 types
Phase 2Month 3–4Parallel operation testing with manual process; threshold tuning based on feedback; reviewer trainingReal-world trial run
Phase 3Month 5–6Official deployment; hand over operation documentation; transfer and warrantyGo live to production

Milestones are calculated from contract signing date and can be shortened by narrowing scope — e.g., temporarily shelving the scan drawing branch to bring the other 3 document types into operation earlier.

Commercial Models

Model A — Subscription (SaaS)Model B — License (License)
CostSetup & configuration fee + monthly subscriptionOne-time deployment fee + annual maintenance
IncludedOperation · updates · supportOn-site installation · transfer · warranty
CharacteristicsLow initial costPerpetual usage rights, unlimited users
Suitable whenWant to start quickly, reduce investment riskPriority is keeping data in-house

Both models include: source code handover per agreement, reviewer training, operation documentation, and support response time commitment.

Why Choose Fujigo

We don't just sell software — we deliver a system validated by real numerical data on 04 sample document sets, with quantity deviation ≤ 0.37% and 0 estimated data points. Every decision is transparent: what the machine does, what the human decides, and every number is traceable to its source.

Contact us for consulting and a demo on your actual documents.