# Filecoin Project Report on 4/25/2023
## Filecoin

The premise of discussing Filecoin is that the Filecoin app, Lotus, enables ordinary users to upload their files without any discussion and development. However, our data today has a large DataCap, so some of it requires discussion between providers, Filecoin, and us on how to proceed. Providers also need to do development and testing.

## Summary of Efforts
Summary of efforts of Filecoin project by parties
+ Providers:
+ Develop tools to fetch data from Google buckets (this could be our work)
+ Perform data tasks such as downloading, issuing, encapsulating, uploading, and indexing (this could be our work)
+ Deliver data to other providers to save our costs
+ Communicate with other providers (this could be our work)
+ Filecoin:
+ Find qualified providers
+ Propose architectures
+ Lead meetings and communicate with providers about details
+ Provide 3.2PB of free storage
+ Our datacap requirement is much more than normal case, they need to disscuss this specially for solana
+ For phase II, they offer to provide us the tool to process our epoch data.
+ Solana:
+ Communicate our need with providers and Filecoin
+ Apply and defense for large datacap application
+ Present our technology to Filecoin and understand Filecoin Technology if need.
+ keep track of each stages
+ Verify Outcome
## Estimated date
+ Data upload (311T) by providers middle of May
+ (Total data is 3.2PB (311T+filecoin overhead)*5providers)
+ Other 200T data --> Filecoin is discussing, no ETD
+ (More Free datacap or priced storage ?)
+ Verification of upload data --> on going, no ETD
+ tool to upload in epoch data --> no going, no ETD

## Good news
+ cloud like indexing is online. This means the whole process is ok although still debugging some issueThe cloud-like indexing is now online, which is a significant milestone in the project's development. While there are still some debugging issues to resolve, the team is confident that the process is functioning correctly overall.

## Challenges which was not expected
+ One of the hard disks broke during transportation, causing delays of data delivery
+ Two providers left the project, potentially impacting the project's progress.
+ The Filecoin architect and project manager also left the project, which cause a lot effort to pick-up project's status
+ The team spent a considerable amount of time discussing indexing methods, which caused delays and additional work

## Stages
So far we have been through several stages:
Completed will mark as * ongoing concurrently mark as +
### Phase I: Providers did everything
1. *Discussed Requirements with Filecoin
2. *Applied for free 3.2PB largeCap from Filecoin and answer questions with Notaries.
3. *Finding qualified storage providers. The basic criteria is network bandwidth which can process our data every epoch. Another one is in differnt region. Filecoin helps to find the storage provider
4. *Discuss architecture and detail with "lead provider", Origin Storage
As discussion, lead provider will
(I will mark "solana" if it was our responsibility but Origin do it for it)
5. *download our data from google cloud (solana)
6. */+lead provider distributes data to other providers (solana)
7. +Issue order (solana)
8. +Encapsulated (solana)
9. +Upload (solana)
10. *Discussing Indexing method
11. +Implement (solana + filecoin)
12. +Verify our data in Filecoin

### Phase II: upload every epoch data ourselves
+ *Discussing our warehouse node and upload process with Filecoin
+ +discussion on proposed (this week)
+ +Filecoin architect Anjor is developing on the tool to do upload every epoch-data

###### tags: `filecoin` `snapshot` `solana` `storage` `long-term`