* hayro-interpret: ink colors, overprint and font bytes for the flattener Local patches for craft-prepress's PDF-in adapter, labeled Craft patch (flatten) and listed in vendor/README.craft-reader.md: - Device::set_overprint and Device::set_isolated, called where the blend mode is set and after an isolated group is pushed. - Color::ink_paint, ColorSpace::ink_space and ink_values: colors and image samples as the inks they print, without converting to RGB. RasterImage::with_inks gives native samples with Decode and Matte. - OutlineFontData::embedded and index, and the CFF bytes of Type1C fonts, so text can be embedded again. - The sh operator ignores /Background (ISO 32000-2 8.7.4.5.1). * plate-test: flattened-page checks, image alpha and scenes F01, F02 - report::run_flattened separates each scene's page after a caller's flattener as well as the original, and structure::transparency lists what transparency a page still has. plate-test doesn't depend on the flattener. - Scene images take an alpha channel, written as /SMask. - F01: a partly transparent image over a flat fill; where its alpha is 0 the fill keeps its exact inks (vectorcraft#2160). - F02: art hidden under opaque fills leaves no trace after flattening (vectorcraft#2161). * prepress: transparency flattener (flatten feature) craft_prepress::flatten turns PDF pages with transparency into pages without it, keeping inks, overprint and live text, for PDF/X-1a and other output that can't carry transparency. - pdf: reads a page into a display list in inks through hayro-interpret: paths, outlined strokes, clips, groups, soft masks, overprint, spot and DeviceN colors, images in their own color space, gradients, rasterized mesh shadings, tiling patterns and glyph runs. - font: prepares the source fonts for embedding again (TrueType, OpenType, CFF wrapped as OpenType); others fall back to outlines with ActualText. - geom: planar regions with the shapes that cover each one (linesweeper). - compose: composites each region per ink (separable and non-separable blend modes, isolated and knockout groups, overprint per plate as ISO 32000 defines it); regions under images, gradients and soft masks are marked complex. - raster: complex regions as DeviceN images through plate mode, grid snapped with a one-pixel outset; flatten_page. - write: writes the result with the vendored krilla; flatten_document writes every page into one PDF with the output intent, page boxes and fonts shared across pages when their bytes match. The regions and the compositor are ported from VectorCraft (commit c2b15982, crates/pathops and crates/engine/src/cmd/flatten.rs), credited in the crate README. scripts/plate-check.sh --flatten separates every scene's flattened page with Ghostscript (local only). CI runs craft-prepress with all features. * krilla: DeviceN /Colorants from PDF 1.3, NChannel attributes from 1.6 (patch 11) * prepress: flatten_document output PDF version and PDF/X version * prepress: format the PDF/X-1a flatten test * krilla, craft-prepress: write GTS_PDFXConformance next to GTS_PDFXVersion PDF/X-1a:2003 files carry GTS_PDFXVersion (PDF/X-1:2003) and GTS_PDFXConformance (PDF/X-1a:2003). Krilla patch 12 adds SerializeSettings::pdfx_conformance, and FlattenDocumentOptions passes it through. * krilla, craft-pdf, craft-prepress: carry the modification date over Krilla patch 13 adds Metadata::modification_date, written as /ModDate and xmp:ModifyDate in place of the creation date. craft-pdf's Metadata gains modified, and flatten_document takes it from the source's ModDate. * craft-prepress: count the print annotations a read leaves out ReadReport::dropped_annotations counts the annotations a printer would paint (Print flag, not Hidden, with a normal appearance) when ReadOptions::annotations is false; FlattenTotals sums it. * craft-prepress: degenerate groups rasterize without a soft mask A group the region sweep fails on is clipped to its members' boxes, which no other group's items reach, so the paper is its only backdrop. Its image is written opaque, as the plates of the items over paper, and the page keeps no transparency for PDF/X-1a. * craft-prepress: write untouched JPEG images as they are A DCT-encoded DeviceGray or DeviceCMYK image that krilla's JPEG passthrough writes with the same meaning (8 bits, no decode parameters, the default gray Decode or the inverted Adobe CMYK one) keeps its data in ImageItem::jpeg, and the writer embeds it unchanged when the image has no soft mask. Other images are still 8-bit Flate samples. * craft-prepress: keep group members with no transparency above them Groups are transitive by bounding box, so a background frame put all the body text on it under a transparent object far away, and the text came back as outlined fills. A member is now drawn as it is when it is opaque and, in every region its shapes are in, only members kept this way are above it. The region fills under it are the composite of the other members, and it is drawn over them in paint order. * prepress: keep the backdrop under elements of a knockout group * prepress: rasterize complex regions thinner than a point * prepress: mark flatten errors, reasons and reports non_exhaustive * prepress: bound the items a tiling pattern fill expands into Each of up to MAX_TILING_CELLS cells copied the whole cell content, and a cell can hold many items or an expanded pattern of its own. A fill whose cells would hold more than MAX_TILING_ITEMS items in all, counting groups, masks and nested patterns, is read as an image. * prepress: stroke solid past the dash budget A dash pattern that cuts a stroke into more than 250,000 pieces is outlined solid, with the estimate hayro's renderer uses. * prepress: bound the sampling and memory of rasterized tiling patterns Each pixel sampled every cell over it, which for a BBox far larger than its step is millions of cells per pixel; past MAX_TILING_CELLS cells per pixel the fill paints nothing, and below it the image resolution drops to keep the samples within MAX_TILING_SAMPLES. The canvases also hold a value per page ink, so their pixel limits shrink with the ink count to keep the memory of CMYK canvases, and the canvas size uses checked arithmetic. * prepress: mark the page reader's error and report non_exhaustive * prepress: format the tiling tests * prepress: CodeRabbit fixes: no nonzero overprint mode for images and shadings, count dropped tilings, widen the hhea ascender * prepress: refuse DeviceN spaces past the output's colorant limit and regions past the separated spot inks
craft-pdf
Shared PDF infrastructure with independent optional features. Applications own document models, editing, layout, font policy, worker scheduling, output presets and printing. No feature is enabled by default.
| Feature | Provides |
|---|---|
read |
Bounded opening and the patched Hayro syntax types |
interpret |
read plus an app-owned Device interpreter, fonts and CMaps |
raster |
interpret plus premultiplied RGBA8 rendering |
write |
Guarded Krilla authoring; no shared reader dependency |
write-pdf |
write plus Krilla's embedded-PDF support |
write-simple-text |
write plus Krilla's optional text shaper and draw_text |
Reading and rendering
open accepts shared bytes without copying. open_slice reserves storage fallibly before
copying. Both preserve typed password errors. Their _with_options variants accept
OpenOptions: a caller-owned input limit and immutable per-document syntax::DecodeLimits.
The default input limit is 512 MiB; callers can preserve their own accepted-file policy.
Ordinary Flate/LZW/RunLength expansion defaults to 256 MiB per stream and can be lowered,
including during initial xref reads, object streams, repair and fallback. Known-size image
pixels and streaming page content have separate backend budgets. These controls do not bound
total parser memory or execution time.
For a bare Flate page, Page::page_stream materializes content under the ordinary limit,
while Page::content_reader decodes incrementally under the separate streaming budget.
Interpretation and rasterization use that incremental path. Lowering the ordinary limit
(even to zero) therefore does not limit streamed Flate page content or cause a truncation
warning by itself. Whole-stream fallback decoders still use the ordinary limit.
interpret_page guards an app-owned Device. raster::render and render_into accept explicit
background, scale, viewport, offset and optional solid-colour replacement. Output is
premultiplied RGBA8. Geometry is cropped, rotated and scaled for UserUnit by the backend.
Dimensions without an explicit viewport floor to at least one pixel per side; callers can
request rounded-up sizes for partial edge pixels. Output is limited to 8192 pixels per side
and 64,000,000 pixels total. Invalid geometry and buffer lengths fail before drawing.
InterpreterSettings preserves caller font resolution, annotation policy, OCG object
identities, cancellation, preview quality and warning callbacks. Preview caches remain
separate from final-quality image entries. Reading-colour presets and print bypass policy
belong to the app; the shared layer only maps the requested colours.
Diagnostics report known image failures and incomplete page or nested painting content,
including omitted streams, failed decoding and exhausted content budgets. They are not a fidelity certificate: the
backend may approximate unsupported content, does not currently emit UnsupportedFont,
and cached objects need not repeat previous warnings. Structural xref repair and objects
omitted by a decode limit have no separate warning; a successful open does not certify
that all objects survived. Some tolerant whole-stream decoders can return an incomplete
prefix without a failure status. Use fresh caches for checks, while retaining these limitations.
Native unwinding panics become errors; discard partial devices, buffers, parsers and caches
after backend failure. WASM aborts and process-wide allocation failure cannot be caught.
Cancellation is polled between operators, so a decoder may finish before noticing it.
Backend provenance and consumer pins
The shared reader vendors the current patched Hayro trees from PdfCraft revision
ec0a965074f376a5bf610435948e4e5184bf3299. See
vendor/README.craft-reader.md for the transfer and
local patches. Lopdf, COS editing, inspection fallback and application caches remain app-owned.
The patched 0.7 reader also carries focused compatibility changes from Hayro 0.8: whole-dictionary resource scopes, a 64-level direct-container limit, whole-run text fill/stroke order and byte transfer-function sampling. It retains the existing Lab Bradford and floating-color behavior, Type 3 handling, decoding limits and streaming completion diagnostics. Iterative page-tree traversal preserves deep valid trees and valid siblings around cycles, with a 100,000-entry work budget that fails closed rather than exposing a partial page list. These changes do not imply full equivalence to the 0.8 backend; the vendor notes record the boundaries. Existing consumers remain on their immutable revision until they explicitly adopt a new one.
Consumers pin craft-pdf and their required root [patch.crates-io] entries to the same full
https://github.com/storytold/craft-libs revision. Cargo ignores dependency-local patches.
Reader consumers patch hayro-syntax, hayro-interpret and hayro-jbig2; raster consumers
also patch hayro. Writer consumers patch krilla. A plain write consumer does not need
reader patches. Keep unrelated craft-ui/craft-print versions unchanged when adopting PDF.
A pinned commit must be available remotely before a fresh public checkout can resolve it.
Synthetic native and WASM contracts cover opening, caller limits, alpha, geometry, settings, preview/final caching, diagnostics, cancellation and native panic recovery. Vendored syntax unit tests additionally cover decoder limits and incomplete streams. App-owned regression suites retain higher-level fidelity, editing, text and worker contracts. Real-file corpora stay outside this repository; dependency assets and licences are in the root attribution.
Reader verification
The Shared PDF workflow runs native and WebAssembly facade contracts, an independent
read-only-contract consumer, and the transferred backend tests. The independent consumer
keeps interpreter-bearing dev-dependencies out of the shipping read feature graph.
Run bash scripts/test-pdf-backends.sh from the repository root to test all four vendored
backends, the syntax doctest and the syntax-only configuration. The script uses temporary
source copies and the complete local patch set, preserving the vendored lockfiles.
Run cargo test --manifest-path crates/pdf/read-only-contract/Cargo.toml --locked for the
read-only consumer, then repeat with --target wasm32-unknown-unknown and the test runner.
These backend checks supplement the root workspace gates; excluded vendor crates are not
covered by cargo test --workspace alone.
Writing
Plain write retains Krilla raster images without its optional text shaper. Applications
that supply shaped glyphs do not need that shaper. Adapters that call draw_text, such as
DeckCraft, also need write-simple-text when adopting this revision. write-pdf adds
embedded-PDF support independently of text shaping.
The writer pins Krilla 0.8.2, with local unwind-cleanup, print color and optional content patches documented in
vendor/krilla/README.craft.md. Successful
serialization uses the same backend version as before extraction. It provides:
write::configuration: version and archival validation configuration with typed failures.write::Metadataandwrite::Writer: common metadata setup and consuming serialization; compression, colour profiles and other serialization settings pass through unchanged.Writer::new_with_languagealso accepts an optional document language for the catalog and XMP metadata; empty language is treated as absent, while callers retain selection and validation policy for nonempty tags.write::font: fallible font copying/preparation for subset embedding, with a 512 MiB limit per font, at most 256 variation coordinates, and rejection of non-finite coordinates.write::guard: a native unwind guard for the whole app export, including drawing and postprocessing. App errors pass through; serialization errors retain backend diagnostics. Caught panic messages retain up to 1024 Unicode scalar values; the installed panic hook remains responsible for logging source locations and full diagnostics.write::uri_target: the Krilla link target for a URI link, orNonewhensafe_urlrefuses it. Apps build URI links with it instead ofbackend::action::LinkAction, so a link target from someone else's document becomes a PDF link only when it is anhttp/httpsURL with a host or amailtoaddress. A refused target writes no link annotation.safe_url(crate root, any feature): the same rule, for apps that open links themselves, such as a slide show.
Print color
write::print::cmyk_blending(profile) returns Result<SerializeSettings, WriteError>
with the settings for a plain CMYK print PDF: DeviceCMYK color and transparency blending in
CMYK (GroupColorSpace::Cmyk), with no output intent. write::print::settings adds the
document's CMYK profile as a GTS_PDFX output intent and /Trapped /False, for PDF/X. Both
fail with WriteError::InvalidProfile when the profile is not a readable CMYK ICC profile.
The profile is the document's working space. craft-pdf takes the profile bytes and does not
depend on craft-cms. Its CC0 builtin::COATED_FOGRA39_ICC is the default working space, described by
PrintColor::fogra39:
use craft_pdf::write::print::{self, PrintColor};
let settings = print::settings(PrintColor::fogra39(craft_cms::builtin::COATED_FOGRA39_ICC))?;
let writer = Writer::new(SerializeSettings { configuration, ..settings }, metadata);
For another profile, fill PrintColor with its condition identifier (Custom when it is
not registered) and info. The settings claim no PDF/X version and are not checked against
PDF/X; apps that claim conformance set pdfx_version (and pdfx_conformance for PDF/X-1a
and X-3) and keep their own checks. Writing these
settings needs the patched Krilla (CRAFT_PRINT_COLOR, see
vendor/krilla/README.craft.md).
Optional content
Drawing layers are written as optional content groups. Document::add_optional_content_group(name, visible) returns an OcgId; Surface::start_optional_content(id) and
Surface::end_optional_content() mark the content between them, and nest independently of
tagged sections. Both return KrillaError on misuse instead of panicking, and a mark left open
when its stream finishes fails Writer::finish. The catalog lists every group in
/OCProperties, hidden ones in /OFF; Document::set_optional_content_page_mode(true) adds
/PageMode /UseOC. Optional content needs PDF 1.5 and fails PDF/A-1 validation (patch 12 in
vendor/krilla/README.craft.md, marker
CRAFT_OPTIONAL_CONTENT).
Writer::document_mut and write::backend deliberately expose Krilla's page, resource and
painting APIs. The apps keep their document walks, pagination, font selection/licensing,
outline fallbacks and warnings, colour policy, PDF/X postprocessing, tagging semantics,
links, export presets and native editing payloads. Shared writing does not introduce a
universal document model or claim additional format conformance. Dates and branding are
provided by callers; the shared writer does not read a clock.
Writer::finish consumes its document even on error. When guard returns an internal failure,
discard any writer or drawing state captured by the closure; construct it inside the closure
where possible. Failed page/surface cleanup poisons the backend document, so retaining it
after a narrow catch cannot silently serialize a missing page. This also rejects failure
during explicit surface finalization. Other captured app state must still be discarded.
Native unwind recovery cannot catch WASM aborts or process-wide out-of-memory
failures. Font preparation bounds do not impose a total memory, output-size or time budget on
PDF serialization. Individual unsupported fonts still follow each app's existing outline
fallback and warning behavior.
Run cargo test -p craft-pdf --no-default-features --features write, and repeat with
--features write-pdf and --all-features. The same writer contracts run with
--target wasm32-unknown-unknown and a matching wasm-bindgen-test-runner. They exercise
metadata, page sizes, versions, reproducibility, typed validation failures, malformed fonts,
application error preservation, embedded pages, and native-only panic recovery.
Source pinning and local development
Consumers pin both the facade and patched writer to the same full commit:
[workspace.dependencies]
craft-pdf = { git = "https://github.com/storytold/craft-libs", rev = "<full-commit-id>", version = "=0.1.0", default-features = false, features = ["write"] }
[patch.crates-io]
krilla = { git = "https://github.com/storytold/craft-libs", rev = "<full-commit-id>", version = "=0.8.2" }
Choose write-pdf only when embedding PDF pages. Cargo ignores dependency workspaces'
root patches; copy the Krilla patch into the consuming workspace. A compile-time marker
rejects unpatched Krilla. Check the normal dependency graph separately from the test graph
and ensure there is one Krilla source, including uses through krilla-svg. This writer
migration does not change an application's reader backend or its other craft-libs pins.
The selected revision must be remotely available before fresh consumers can resolve it.
Local path replacements are development-only and should not be committed to an app.
Run cargo fmt --check, cargo clippy --workspace --all-targets -- -D warnings and
cargo test --workspace, then test craft-pdf with --features write and
--features write-pdf (the default feature set intentionally enables no PDF operations).
Run the same writer contracts on wasm32-unknown-unknown with a matching
wasm-bindgen-test-runner. Native recovery tests are subprocess or unwind checks;
WASM tests exercise successful paths and typed input errors, not recovery from aborts.
Unicode and font contracts
The writer embeds the font and glyph run supplied by the application. Applications must select a font that covers the requested characters, shape text and resolve bidirectional layout before drawing. Passing correct Unicode only in document metadata does not preserve page text. A selectable-text export must retain the actual glyph outlines and a matching ToUnicode map, and applications must report unsupported font preparation rather than silently dropping characters. Existing app-specific outline fallback remains an explicit policy choice.
tests/unicode_writing.rs adds opt-in, externally supplied font fixtures. It exports,
reopens and interprets real page text without putting the source text in metadata,
checks nonzero glyph IDs, embedded fonts and visible non-space outlines, and asserts
exact extraction for Latin accents, Greek, Cyrillic, Vietnamese, Arabic and Thai.
A variable-font test checks default/empty coordinates and distinct light/bold
embedded outlines while preserving extraction. These are embedding/mapping
contracts; they do not qualify Arabic joining, RTL caret behavior, shaping quality,
or lossless text editing in an application's separate COS editor.
No PDF test fonts are stored in this repository. Obtain the licensed fixtures listed in
tests/fonts.json, verify their SHA-256 hashes, place them in
one directory using the listed names, then run:
CRAFT_PDF_TEST_FONT_DIR=/absolute/path/to/licensed-fonts \
RUSTFLAGS="--cfg craft_pdf_unicode_fixtures" \
cargo test -p craft-pdf --all-features --test unicode_writing
Repeat with --target wasm32-unknown-unknown and the matching test runner for
runtime WASM coverage. Ordinary builds and tests do not require these fonts or the
fixture environment variable. With write enabled, the complete test code is
compiled even without fixtures; its two runtime tests are explicitly ignored with a
provisioning reason. Running ignored tests without fixtures fails with setup instructions.
The Shared PDF CI workflow fetches and hash-verifies these fonts outside the checkout
and enables the contracts on native and WASM. Locally, run
python3 scripts/fetch-pdf-test-fonts.py /absolute/path/to/licensed-fonts to provision
them. tests/upstream_reading.rs uses the same Inter fixture to verify TrueType
WinAnsi fallback with missing or partial ToUnicode maps, explicit Encoding and
Differences precedence, and a ToUnicode override. The fallback changes extraction
only: existing nonsymbolic glyph selection can still choose StandardEncoding glyphs
or .notdef. Tests pin that distinction and the upstream WinAnsi unused-code bullet
mapping; fallback text is not proof of the original author's text. Without fixtures those reader
contracts are also compiled and explicitly ignored; provisioned CI executes them.