We present an approach to writing fused data parallel data flow programs where the library API guarantees that the client programs run in constant space. Our constant space guarantee is achieved by observing that binary stream operators can be provided in several polarity versions. Each polarity version uses a different combination of stream sources and sinks, and some versions allow constant space execution while others do not. Our approach is embodied in the Repa Flow Haskell library, which we are currently using for production workloads at Vertigo.
Conference DayThu 22 SepDisplayed time zone: Osaka, Sapporo, Tokyo change
15:20 - 16:10
|Streaming Nested Data Parallelism on Multicores|
|Polarized Data Parallel Data Flow|