Repository navigation
Marker 2.2.0: 4 Conversion Modes (no_ocr, fast, balanced, vllm), Indra ONNX Integration, Interactive Web Viewer, and OmniParseBench - #1142
Merged
Merged
Conversation
…me Streamlit warnings
Indra ONNX integration, 4 conversion modes, and updated viewer/CLI
…w<14) (#1141) marker declares pillow>=10.1.0,<11, which holds every install on Pillow 10.4.0 and its 52 published GitHub advisories (4 critical, 33 high, 15 moderate), none fixed anywhere in 10.x. Raising the cap is only worth doing if it reaches 13.0.0: every intermediate release is at least as bad by count (11.0.0: 54, 11.3.0: 58, 12.0.0: 60, 12.1.1: 59, 12.3.0: 41, each with 5 criticals), and 13.0.0 is the first with none. One of the criticals is directly reachable here -- GHSA-332p-7hrc-92wf, a heap overflow in _tiffWriteProc when saving TIFF to a BytesIO, which is what marker/providers/document.py:96 does with images carried in a DOCX input. marker uses no Pillow API removed in 11, 12 or 13. The only two module-level constants it touches are Image.LANCZOS (marker/providers/image.py:52) and Image.MAX_IMAGE_PIXELS (marker/renderers/html.py:21), both of which still exist in 13.0.0; the three removed in 10.0.0 (ANTIALIAS, LINEAR, CUBIC) appear nowhere. The reachable PIL surface was exercised against both Pillow 13.0.0 and 11.3.0 under -W error::DeprecationWarning with identical results and no warnings. This change is necessary but not sufficient on its own: surya-ocr 0.23.0 independently declares pillow>=10.2.0,<11, so until that is relaxed and released the resolve still lands on Pillow 10.4.0 -- the intersection of the two caps -- which is why uv.lock moves only marker-pdf's own recorded specifier here. Pillow 13.0.0 also requires Python >= 3.11, so 3.10 installs top out at 12.3.0 regardless. Co-authored-by: Greg Krieg <gkriegspeedbay@users.noreply.github.com> Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
…the package (#1108) - FONT_PATH was a class-level default computed from the default FONT_DIR at import time, so setting FONT_DIR (environment or local.env) changed nothing: the font still downloaded to the package tree. It is now derived after validation; an explicit FONT_PATH still wins. - The default location moves from <package>/static/fonts to $XDG_CACHE_HOME/datalab/marker/fonts (~/.cache/... when unset). The font is a 14.7 MB runtime download; writing it into site-packages fails on a read-only install and, for an editable install, leaves an ignored file in the git checkout. Existing installs download it once more at the new path, or keep the old one by setting FONT_DIR. - tests/config/test_font_settings.py: FONT_DIR is honoured, FONT_PATH is honoured, and the default lies outside BASE_DIR. Co-authored-by: tryinget <tryinget@users.noreply.github.com> Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Contributor
|
CLA Assistant Lite bot All contributors have signed the CLA ✍️ ✅ |
replace_bullets ran re.sub without a count, so it removed every dash or hyphen surrounded by spaces in the first line instead of just the leading bullet. A list item whose text held a spaced dash mid-sentence lost that dash. Passing count=1 limits the substitution to the leading bullet. Fixes #1024
Parse retryDelay from the google.rpc.RetryInfo error details and use it as the sleep duration before retrying. Falls back to the existing linear backoff (tries * retry_wait_time) when the field is absent or malformed. Ref: googleapis/python-genai#2114 Ref: #490
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
no_ocr,fast,balanced,vllm):no_ocr: Pure PDF text layer (pdftext) + in-process Indra ONNX layout and reading order on CPU (71.0OmniParseBench at23.8 pg/sCPU /33.0 pg/sGPU).fast: In-process Indra ONNX layout, reading order, and ONNX OCR on CPU without requiring an external inference server (81.8OmniParseBench at7.1 pg/sCPU /32.9 pg/sGPU).balanced: Hybrid routing usingpdftext+ Indra ONNX layout on clean Latin prose pages, and Surya 2.5 VLM on tables, math, non-Latin/CJK scripts, and scanned/garbled pages (92.0OmniParseBench at25.2 pg/sGPU).vllm: Full-page Surya 2.5 VLM OCR on every page (92.8OmniParseBench at8.1 pg/sGPU).marker_gui&marker_server):marker/scripts/viewer.py) with page-by-page SVG layout/line/reading-order overlays, mode & pipeline controls, live progress banner & stage timing bars, andPreview/Markdown/Blocks/Lines/HTML/Chunks/JSONtabs.--stdout,--keep_headers_footers,--keep_server,--skill, and--install_skilltomarker_single/marker.markerbatch conversion to support single files or directories, filter supported extensions, walk subdirectories with--recursive, and pre-filter--skip_existingfiles before pool initialization.doclingandliteparse.