---
title: 'Fleek Network - Intro'
disqus: hackmd
---

Fleek Network
===

## Table of Contents

[TOC]

## Fleek.co

1. IPFS Hosting
2. IPFS Storage - S3 (MinIO)
3. ENS and IPNS
4. Dedicated IPFS Gateways & IPFS APIs (on demand)
5. Centralised CDN zones (Cloudflare / BunnyCDN)

## Motivation

Storage based traffic makes up 80% of Fleek traffic, the other 20% is for our websites.


> Globally, gaming traffic will be 6% of consumer Internet traffic in 2021, up from 2% in 2016.. [name=Cisco]
> Globally, consumer Internet video traffic will be 81% of consumer Internet traffic in 2021, up from 72% in 2016. [name=Cisco]
[Cisco Research](https://www.cisco.com/c/dam/m/en_us/solutions/service-provider/vni-forecast-highlights/pdf/Global_2021_Forecast_Highlights.pdf)

## Whats next for Fleek?
Decentralize our entire stack! Today we start with an important piece in our stack, the CDN.

- Accelerate IPFS content retrieval
- Better UX for storage and hosting
- Become non custodial

---

## Fleek Network

- Decentralized
- Scale with demand
- Web3 content
- Interoperable
- Robustness
- P2P

## Architecture

- Content Routing
- GossipSub
- DHT
- Peer discovery
- DHT (Kademlia)
- Request/Response
- Bitswap/Graphsync
- Gateway


## P2P

- Libp2p based
- Trustless
- Censorship-resistant
- Resilient
- Gossiping Protocol
- Content addressable

---

## Content Routing
- DHT based content routing
- Gossip based routing
- Bitswap
- Graphsync Req/Res
- Not permanent
- Cache eviction

## Peer Discovery
- DHT (Kademlia)
- mDns
- Pruning and Grafting, passing lists of peers
- Relay Nodes for nodes behind firewalls
- Fleek Bootstrap nodes
- Act as the network orchestrators
- Gossip Only
- Peer exchange through our Fleek bootstrap nodes

## Consensus


- Narwhal and Bullshark
- Data availabiltiy is ensured using Narwhal
- Bullshark over Tusk for ordering

**Comparing Tusk vs Bullshark:**

| | Common round latency | Async round latency | Garbage collection | Fairness |
| -------- | -------- | -------- | -------- | -------- |
| Tusk | 3 | E(7) | yes | no |
| Bullshark | 2 | E(6) | yes | during sync |

[Fleek Network Consensus](/nDhRUebeSbmCEBrTG0DQyw) More information about Fleek Network consensus

> Decoupling data dissemination from metadata ordering is the key mechanism to allow scalable and high throughput consensus systems
>
> [Narwhal & Tusk](https://arxiv.org/pdf/2105.11827.pdf)

## Indexer

- Each cache node runs an index provider
- Index provider announces the content availability to indexer
- Indexer get the nodes (for Bitswap/GraphSync) that are holding the content
- Accelerates content routing and discovery

## Gateway
- Cherry Picker
- Minimizes latency of requests
- Governance
- Bootstrapping
- Ledger of nodes
- Nodes setup
- TLS
- DNS


## Security
- Sybil
- Eclipse
- Spam
- Bootstrap
- Sybil/Eclipse

User story
---

Feature: Accelerate Content
  As an app
  I want to put content onto the Ursa CDN
  Because I want to accelerate my content worldwide
  Given a trustless, censorship resistent premise

  Scenario: App puts content to Ursa
    Given I'm a signed up to ursa and have an endpoint id
    When I use the given api
    And I make a put request with my content
    Then the content should be uploaded to the network
    And distributed amongst peers and cached on the network and gateway
    And the nodes will also cache the data locally until storage threshold

Feature: Get Content
  As an app
  I want to get my content from Ursa CDN
  Because I want to serve it to my clients

  Scenario: App requests for `/:cid`
    Given the App has a valid endpoint url
    When the App makes a `Get` request for the `cid`
    Then the Gateway returns the data if it is cached
    But if not cached, it will query the closest node
    And if cache miss, gateways
    And nodes will cache the content for repeated requests
    

User flows
---

Client->Gateway: Get: "/<client_endpoint>/:cid"

Gateway->Cherry Picker: Pick closest node

Cherry Picker->Node: Get content
Note right of Node: From cache or content routing

Node-->Client: Returns content and caches it

Note left of Client: Incrementally verifies the data


Project Timeline
---

gantt
    title Mission no.1: First Exploration

    section Network
    Outline and build v0 of node spec           :a1, 2022-06-01, 30d
    Develop networking stack     :after a1  , 25d
    
    section RPC
    Design Cache Node RPC interface      :2022-06-01  , 28d
    Integrate with gateways      :20d
    
    section Store
    Implement an IPLD blockstore      :2022-06-01  , 20d
    
    section Metrics
    Determine the metrics capturing mechanism      :2022-06-01  , 30d
    Determine payout for nodes serving content     : 30d
    
    section Daemon
    Build a local cli to interact with node      :2022-06-01  , 30d
    
    section Gateway
    Create a global gateway     :2022-06-01  , 24d
    Build a governance layer and cherry picker      : after a1  , 30d

## Appendix

:::info
**More coming soon!**
**This is a general overiew, paper, repo, and official announcement soon**
:::

###### tags: `Fleek Network`