pyf.dataflow Dataflow Core¶

This is the core package for flow-based programming, it contains the building blocks for pyf.manager, pyf.componentized and pyf.services.

pyf.manager Data Manager¶

It contains managers to handle flow networks or paths.

Basically, you can write data networks using pure code with it, getting a lot of helpers.

pyf.splitter Low-Level Data Splitter¶

This is a low-level utility library used to split input flows and store them in buckets on the filesystem.

pyf.transport Data transport building blocks¶

pyf.station Data-flow ip transport¶

PyF.Station is a protocol with client and server to transfer python generators accross tcp networks.