---
# System prepended metadata

title: D1.3 Report Meeting

---

# D1.3 Report Meeting

## Existing materials


- Scylla Blog Posting
    - https://www.scylladb.com/2020/08/13/iota-using-scylla-for-distributed-storage-of-the-tangle/

## Items

### Data integrity
- Solidifier: Ensure the Tangle integrity
    - How the solidifier works in high level
- Scylla replication factor: Ensure cluster integrity
- Write-head log: For future detailed debugging/importing/durability

### (Permanode) Data filtering and processing (provide information on data processing and filtering)
- MQTT/Feed source for data receving and filtering on-the-fly
- Stream processing based on map-reduce
- Scalable/distributed permanode cluster
- Parallel processeing by asynchronous actors
- write-ahead logs for batch offline-processing

### (Permanode) Filtering data based for specific purposes - selectiveness.
- The criteria can then be applied within the already existing shards. E.g., storing and filtering data in a geographical (or any other shard) based on additional criteria such as applications, products,... 

- Filtering by the criteria of tangle message (including the parsed data/payload, ids, tags, etc.)
    - A customized protocol can be defined to quicky identify messages
        - E.g., any geographical header can be added in the message


### (Permanode) Scalability of storage solution - deployments, data read and write. 

- Introduce the scylla framework (sharding)
- Qualities the scylla provides
    - LSM
    - Auth
    - Scylla manager
    - Chronicle dashboard (ie add/remove scylla node on-the-fly)
    - User defined keyspace (collection of tables)
    - Users concept (username/password) at the object/operation level (table/keyspace, read/write)
