Round 1 / Verifiable Data Aggregation

Our project introduces a new mechanism, the Proof of Data Segment Inclusion (PoDSI), designed to improve the transparency and accountability of data aggregation processes on the Filecoin network. The core innovation of PoDSI is its ability to generate cryptographic proofs that confirm the inclusion of individual data segments within larger aggregated deals. These proofs are verifiable independently by any third party, which significantly enhances the trustworthiness and reliability of data storage on Filecoin.

The primary contributions of our project are as follows:

• Development of the PoDSI Scheme: We have developed a detailed specification and corresponding cryptographic protocol that allows data aggregators to produce a Proof of Data Segment Inclusion. This proof certifies that a client's data segment has been correctly aggregated and included in a larger on-chain deal without being altered or omitted.

• Implementation of the Proving Library (go-data-segment): We created a robust library in Go that implements the PoDSI protocol. This library facilitates the generation and verification of inclusion proofs by aggregators and third parties, respectively.

• Integration Assistance: Our team has actively worked with prominent storage solutions like Lighthouse and web3.storage to integrate the PoDSI functionality.

• On-chain Verifier Development: In collaboration with the Lighthouse team, we assisted in implementing an on-chain verifier for PoDSI. This tool enables the automatic verification of proofs directly within the Filecoin blockchain, further securing and automating the process.