# Data Visualizations for Yearn - 2nd Month

## Scope



The current state of the app can be seen at https://ydata.vercel.app

This is a follow-up request from [the previous request for the data visualization project](https://github.com/yearn/budget/issues/89), the details of which could be seen from the comment section of the issue. Before we ask for the extension, we would like to first share the current progress of the project.

**yData**


[yData](https://github.com/yearn/ydata) is the new branding of the previous yearn-data-analytics repo. We aim to use this web app and the repository to share the results from our research, and potentially also use this space to serve products that are directly related to the research results.

As mentioned above, the app is currently deployed using vercel: https://ydata.vercel.app

yData currently holds two visualizations:
* [Yearn V2 Vaults](https://ydata.vercel.app/visualizations/yearn-v2-vaults)
* [Efficient Frontier](https://ydata.vercel.app/visualizations/efficient-frontier)

The Yearn V2 Vaults is an interactive dashboard that illustrates the various statistics of our vault assets. Efficient Frontier is a simple datapane report that lets the users compare the performance of Yearn's assets against the whole DeFi space.

**Social Media**

Although this was not within our action items, we found out that our [YFI Interns Twitter account](https://twitter.com/YFI_interns) was dormant since the last RT on the 9th of June.
Thus we decided to reactivate this account to start delivering the data-driven narratives.


We tried out some [simple tweets about our vaults](https://twitter.com/YFI_interns/status/1574752793738485763?s=20&t=8-XYhoTBstBIYPT1XRWk8g) to measure the level of traction the account was able to reach. We will continue to post these simple weekly data reports and also continue the RTs for the main account to gradually regain the audience back to the Interns account.

We also created a Discord channel dedicated to the data visualization projects (thanks to Dark) named \#data-science in Yearn Talk. We will be cross-posting the tweets and sharing the updates for the yData app in this channel.

**Shortfalls**

The items that we promised for the first month were the following:

1. Create a frontend server to embed the visualizations using our web template
2. Create a visualization of the efficient frontier of DeFi assets

Thus it may seem like we did deliver the above two items on the surface. However there are a few shortfalls for both items that we did not manage to fulfill.

For 1, we did set up the template but still need to work on the overall branding and creating a better UX. Marco Worms recently joined the team to help us out on this issue.

For 2, the current efficient frontier is built upon only the stablecoins data instead of the whole set of DeFi assets. Also, the current visualization is missing the backtest results of the exemplary portfolios.
The main blocking factor for this was that we had to fetch the price of an arbitrary token on a specific chain, at a given block. We are planning on combining the new coin API from [DefiLlama](https://defillama.com/docs/api) and the [ypricemagic](https://github.com/BobTheBuidler/ypricemagic) to tackle this issue.

For both 1 and 2, we came across several mismatches in the data between the different data sources of Yearn during the project (e.g. https://github.com/yearn/yearn-exporter/issues/393). Thus we had to spend some time to check the integrity of the data and rebuild the pipelines to fetch them from the correct source. We believe that this could be easily fixed after the upcoming update on [yDaemon](https://github.com/yearn/ydaemon).

## Plans

We would like to follow the original 3-month plan that we shared in [the first request](https://github.com/yearn/budget/issues/89), but with a couple of modifications.

**Second Month (Requested Month)**
* ~~Migrate the visualizations created by jameskbh to the frontend~~
* Create a visualization of our customers
* Sample plot at https://chart-studio.plotly.com/~borrito/3/#/
* Aims to help answer the following questions:
* What other protocols do our clients use?
* Were the recent withdrawals transitory?
* How does the distribution of TVL for a single vault look like?
* (NEW) Update the visualizations
* Update the structure of Yearn V2 Vaults
* Sample draft at https://docs.google.com/document/d/11-WwulyYS1N91Z4wTAeCk2UPlS7oNixdUf_9GQInC1w/edit?usp=sharing
* Update the data source and the backtest results for the efficient frontier
* Provide documentations for the visualizations
* Sample draft at https://docs.google.com/document/d/1w0jYpGDqViCOwn4MkiySBPGGEJX6h16rBXUDRKOMQUA/edit
* (NEW) Create a visualization of the tail-dependency of tokens
* Sharing the recent research results of cs data, working within the strategist team
* Create a graph visualization from the correlation of the token price volatilities
* Aims to help answer the following questions:
* Which tokens does a given token share its tail-risk?
* Which strategies should belong to the same risk group?
* How should we diversify our TVL allocations?

The migration of the visualizations created by jameskbh has already begun in the first month. The Yearn V2 Vault visualization directly contains the contents from the [yVaults v2 Historical Overview](https://medium.com/@jameskbh/yvaults-v2-historical-overview-23a9a7db28a5), and also implicitly contains the narratives from [Yearn Vaults’ Stablecoins report: DAI, USDC, and USDT](https://medium.com/@jameskbh/yearn-vaults-stablecoins-report-dai-usdc-and-usdt-620dfc11c72f). Thus we now remove this item from the Second Month and instead replace it by the update item.

This data visualization project has been able to facilitate the exchange of ideas within the YFI Data Analysis group, and the tail-dependency graph is a short-term project that came to life from such ideations. cs data has been working on building forecast models for the price volatilities of different tokens. Although it may take some time until he can complete the model, it seemed beneficial to first take the contemporaneous part of the analysis and visualize it to share the results with the other teams of Yearn. We are planning to visualize this structure as a graph to give us a bird's-eye view on the risk landscape of different tokens.

## Deadline

2022-11-30

## People

List of team members and the responsibilities:

* borrito
* implement the customer visualization
* implement the tail-dependency of tokens
* will be addressing all issues full-time
* huggingbot
* maintain the frontend server
* implement and maintain data pipelines (yearn-exporter, ydaemon)
* kofee
* implement and maintain data pipelines (subgraph, yearn-exporter, ydaemon)
* jameskbh
* keep creating visualizations in flourish studio
* research other data visualization platforms
* marco worms (not receiving remuneration from this grant)
* lead the branding of yData and its products
* implement and enhance the frontend UI/UX
* cs data (not receiving remuneration from this grant)
* give technical advice on the data scientific methods
* implement the tail-dependency of tokens
* farrah (not receiving remuneration from this grant)
* lead product developments from the visualizations
* build visualization to support R&D efforts
* in charge of internal assessment of the performance and effectiveness of the project