# D1.3 Report Meeting ## Existing materials - Scylla Blog Posting - https://www.scylladb.com/2020/08/13/iota-using-scylla-for-distributed-storage-of-the-tangle/ ## Items ### Data integrity - Solidifier: Ensure the Tangle integrity - How the solidifier works in high level - Scylla replication factor: Ensure cluster integrity - Write-head log: For future detailed debugging/importing/durability ### (Permanode) Data filtering and processing (provide information on data processing and filtering) - MQTT/Feed source for data receving and filtering on-the-fly - Stream processing based on map-reduce - Scalable/distributed permanode cluster - Parallel processeing by asynchronous actors - write-ahead logs for batch offline-processing ### (Permanode) Filtering data based for specific purposes - selectiveness. - The criteria can then be applied within the already existing shards. E.g., storing and filtering data in a geographical (or any other shard) based on additional criteria such as applications, products,... - Filtering by the criteria of tangle message (including the parsed data/payload, ids, tags, etc.) - A customized protocol can be defined to quicky identify messages - E.g., any geographical header can be added in the message ### (Permanode) Scalability of storage solution - deployments, data read and write. - Introduce the scylla framework (sharding) - Qualities the scylla provides - LSM - Auth - Scylla manager - Chronicle dashboard (ie add/remove scylla node on-the-fly) - User defined keyspace (collection of tables) - Users concept (username/password) at the object/operation level (table/keyspace, read/write)