CONSONANCE.for your information
Monday, 5 October 2026frenvi

Worth reading closely

01 — system_design 47 upvotes

RayOrch: Programming and Executing Lineage-Controlled Multi-Grain Dataflows for Foundation-Model Data Preparation

QUESTION — How can variable-cardinality dataflows be executed efficiently in foundation-model data preparation pipelines while strictly preserving parent-child lineage on GPUs?

The paper introduces RayOrch, a programming model and distributed execution engine designed for foundation-model data preparation pipelines. RayOrch preserves parent-child relations and execution order using per-call FIFO ready queues to batch children across parents. On NVIDIA H20 GPUs, RayOrch achieves 15.14 times speedup when scaling MinerU from 4 to 64 GPUs, 7.82 times speedup when scaling a video pipeline from 8 to 64 GPUs, and reduces end-to-end time compared to Ray Data and Daft.

RayOrch achieves 15.14 times speedup when scaling MinerU from 4 to 64 GPUs and 7.82 times speedup when scaling a video pipeline from 8 to 64 GPUs.

It reduces end to end time by 13.1 percent versus Ray Data and 29.0 percent versus Daft on MinerU, and by 16.0 percent versus Ray Data on Docling.

Sunnyhaze · 16 Sept 2026 read the original ↗
↑