All pull requests

Pull requests

• fix(arxiv): keep the character before an inline comment

  community-request
  #2534·alphasafal opened Oct 25, 2026·3 tasks done·

  ·
  3

• docs: fix typos in arXiv extractor and Slicer comments

  community-request
  #2533·Avicennasis opened Oct 25, 2026·

  ·
  2

• perf(interleaved): streamline single-content WebDataset writes

  #2532·VibhuJawa opened Oct 25, 2026Contributor·

  ·
  2

• fix(interleaved): omit range offsets for compressed WebDataset shards

  #2531·VibhuJawa opened Oct 24, 2026Contributor·

  ·
  2

• feat(pdf): support managed Nemotron Parse 3.5 on CUDA 13

  community-request
  #2530·jperez999 opened Oct 23, 2026·

  ·
  5

• feat(deduplication): add configurable GPU groupby aggregation

  #2529·VibhuJawa opened Oct 23, 2026Contributor·3 tasks done·

  ·
  6

• fix(string): SymbolsToWordsFilter counts individual '' characters, not runs

  community-requestwaiting-on-maintainers
  #2528·cf3901646 opened Oct 22, 2026·

  ·
  1

  4

• feat(interleaved): extract image references from document batches

  #2527·VibhuJawa opened Oct 22, 2026Contributor·3 tasks done·

  ·
  1

• feat(interleaved): support served Nemotron Parse 3.5 modes

  community-requestwaiting-on-maintainers
  #2526·KyleZheng1284 opened Oct 22, 2026·3 tasks done·

  ·
  3

• fix: bound inference startup and repair OCR installation

  #2525·praateekmahajan opened Oct 22, 2026Contributor·3 tasks done·

  ·
  1

• feat(audio): bundle original FastMSS for meeting simulation

  #2524·timofeeva16tanya opened Oct 22, 2026·4 of 6 tasks·

  ·
  6

• feat(dedup): upgrade RAPIDS to 26.10 and use ParquetDatasetWriter

  #2523·praateekmahajan opened Oct 22, 2026Contributor·

  ·
  4

• fix(text): keep punctuation that follows a URL in UrlRemover

  community-requestwaiting-on-maintainers
  #2520·usmanmateen opened Oct 20, 2026Contributor·3 tasks done·

  ·
  1

  6

• fix(text): count hash characters, not runs, in SymbolsToWordsFilter

  community-requestwaiting-on-maintainers
  #2519·usmanmateen opened Oct 20, 2026Contributor·3 tasks done·

  ·
  1

  2

• fix(dedup): explain how to start Ray when the ID generator actor is missing

  community-request
  #2514·hzmsh opened Oct 19, 2026·3 tasks done·

  ·
  1

  3

• fix(text): compute histogram filter ratio over stripped text

  community-request
  #2511·udsy19 opened Oct 17, 2026·

  ·
  3

• fix(utils): match multi-part file extensions such as .jsonl.gz

  community-requestwaiting-on-maintainers
  #2510·hzmsh opened Oct 16, 2026·3 tasks done·

  ·
  1

  2

• video pipeline hand off doc

  #2508·weijiac0619 opened Oct 15, 2026Contributor·3 tasks·

  ·
  6

• Bump cuda

  #2504·ayushdg opened Oct 13, 2026Contributor·3 tasks·

  ·
  4

• Init Numpipe

  #2501·Jorjeous opened Oct 12, 2026Member·3 tasks·

  ·
  1

• fix(arxiv): give the paragraph header its own alternative

  community-request
  #2500·v0ropaev opened Oct 12, 2026Contributor·

  ·
  6

• docs(video): address usage-team feedback on encoder, summarizer, migr…

  docs-only
  #2486·abhinavg4 opened Oct 8, 2026Contributor·

  ·
  3

  

• Add LLM critics to fuzzy deduplication evaluation tutorial

  #2484·sarahyurick opened Oct 7, 2026Contributor·2 tasks·

  ·
  8

• feat(audio): add an agent interface for audio curation

  #2482·shubhamNvidia opened Oct 6, 2026Contributor·

  ·
  38

• feat(interleaved): add an NRL-backed PDF extraction recipe

  community-requestwaiting-on-maintainers
  #2480·KyleZheng1284 opened Oct 5, 2026·3 tasks done·

  ·
  6