# Benchmarking CryptoEcon Decision-Making Working Groups Methodology

###### tags: `filecoin-pl` `Benchmarking Decision-Making WGs`

:::info
Updated by February 2023
:::

*Authors: Hasher Nabi & Danilo Lessa Bernardineli (@danlessa)*

## Meta-Methodology

Producing the Benchmark and the Article requires an 6-step process that consists of the Specific Methodology / Collection / Synthesis / Analysis / Conclusions and Curation Steps.

The Specific Methodology Step consists of defining the search & sampling strategy, the extraction method, and the factual compression criteria for the Collection and Synthesis Steps. It is also required to define how case comparisons are to be done on the Analysis Step.

On the Collection Step, sample candidates will be discovered and selected, and both structured and unstructured information will be stored.

On Synthesis Step, summaries will be written for each collected sample, and taxonomies will be discovered as for how to categorize them together. The final output is an cohesive body of unstructured and semi-structured data that allows for an cohesive analysis.

On the Analysis Step, the samples will be compared against each other in light of their categories and by using both structured and non-structured data. The Current Status of Filecoin should be included as an baseline case.

Finally, on the Conclusion Step, an comparative evaluation should be done in terms of how Filecoin is positioned vs the collected samples and groups, and what are the main points of attention in terms of vulnerabilities and opportunities.

The Curation Step is about compressing the Research Report into an public article that's readily consumable by the community at large.

## Specific Methodology

[Miro Board](https://miro.com/app/board/uXjVPpbBBQM=/)

- **Define a set of base questions**
- Brainstorm initial paramenters independent of questions
- 10-12 questions that would help in defining parameters further
- Defining the
- Define the criteria for discarding questions
- Define samples
- Select a sampling method:
*(Re)Define criteria for creating categories *
- We propose 4 ot 5 groups or categories based on the general nomenclature used for the cryto projects viz
- Layer-1
- Layer-2
- Layer-0
- dApps
- DeFi
- NFT Projects
- Determine sample size:
- The sample size within each category would be around 4-diverse projects with distinct governance structures
- Select the sample:
- Stratified Sampling:
- Consider any potential biases:
- Perform an pilot trial: for one sample of each group, answer the base questions through an in-depth research around it.
- Re-evaluate the base questions and take notes of any synthetic variables that can be included
- Collect data for the remaining samples

*I propose an alternate methodology for review where we categorise our sampling groups into a hierarchical/pyramidic stack. Where the stacks are the blockchains that provide infrastructural layer for every built on top

## Milestones

- W1 (Jan 31 to Feb 07)
- Hasher is introduced to the project
- W2 (Feb 08 to Feb 14)
- Specific Methodology is Decided
- Base Questions are Decided
- Sampling Method is Decided
- Sampling Groups are Decided
- W3 (Feb 15 to Feb 21)
- Data collection is performed for the 1st set of samples
- W4 (Feb 22 to Feb 28)
- Preliminary Data Synthesis is performed for the first set of samples
- W5 (Mar 01 to Mar 07)
- Data Collection is performed for the 2nd set of samples
- W6 (Mar 08 to Mar 14)
- Final data synthesis
- W7 (Mar 15 to Mar 21)
- Analysis and Conclusions are written
- Research Report is done
- W8 (Mar 22 to Mar 28)
- Public Report is done