---
tags: Project Notes
---

# Transformer Phonebook :telephone_receiver::robot_face:

## Preface

* All weights are [uploaded here](https://owncloud.tuebingen.mpg.de/index.php/apps/files/?dir=/P2PModels&fileid=22243753).
* The [wandb dashboard](https://app.wandb.ai/nasimrahaman/ctt?workspace=user-nasimrahaman) contains the full configuration and training curves. Just search for the transformer (by name) there to get the deets.

## List of Transformers (most recent first)

| Name | Description |
| --------------------- |:----------------------------------------------------------------------------------------------- |
| cosmic-rain-715 | Like twilight-rain, but trained on a dataset with less domain randomization. |
| morning-jazz-714 | Like twilight-rain, but trained on a dataset with no domain randomization. |
| legendary-pyramid-713 | Iteration 3, like twilight-rain but trained on dataset generated with twilight-rain. |
| crimson-breeze-712 | Iteration 2, like twilight-rain but trained on dataset generated with twilight-rain. |
| vague-thunder-705 | Like twilight-rain, but predicts viral load and infectiousness multiplier separately. |
| rosy-forest-704 | Like twilight-rain, but predicts histogram over infectiousness and trained with softmax and CCE |
| twilight-rain-696 | Vanilla transformer trained with MSE loss on a older dataset. |