FIL-RetroPGF Logo Filecoin RetroPGF Round 3 Round 2 Round 1

go-fil-dataprep banner go-fil-dataprep logo

Round 1 / go-fil-dataprep

Category

Tooling

Funding amount

1758 FIL

This is a first of its kind streaming tool that does everything related to data preparation, i.e. all that is required until just before deal making. It generates CAR files in a streaming fashion maintaining a fairly small memory footprint without compromising on(in fact in a lot of cases increasing) the throughput. It also provides functionality to split large CAR files into smaller CAR files to ensure that the whole IPLD dag is maintained intact but at the same time CAR file sizes are small enough to fit into a sector.