---
# System prepended metadata

title: 'Transformer Phonebook :telephone_receiver::robot_face:'
tags: [Project Notes]

---

---
tags: Project Notes
---

# Transformer Phonebook :telephone_receiver::robot_face: 

## Preface

* All weights are [uploaded here](https://owncloud.tuebingen.mpg.de/index.php/apps/files/?dir=/P2PModels&fileid=22243753). 
* The [wandb dashboard](https://app.wandb.ai/nasimrahaman/ctt?workspace=user-nasimrahaman) contains the full configuration and training curves. Just search for the transformer (by name) there to get the deets. 

## List of Transformers (most recent first)

| Name                  | Description                                                                                     |
| --------------------- |:----------------------------------------------------------------------------------------------- |
| cosmic-rain-715       | Like twilight-rain, but trained on a dataset with less domain randomization.                    |
| morning-jazz-714      | Like twilight-rain, but trained on a dataset with no domain randomization.                      |
| legendary-pyramid-713 | Iteration 3, like twilight-rain but trained on dataset generated with twilight-rain.            |
| crimson-breeze-712    | Iteration 2, like twilight-rain but trained on dataset generated with twilight-rain.            |
| vague-thunder-705     | Like twilight-rain, but predicts viral load and infectiousness multiplier separately.           |
| rosy-forest-704       | Like twilight-rain, but predicts histogram over infectiousness and trained with softmax and CCE |
| twilight-rain-696     | Vanilla transformer trained with MSE loss on a older dataset.                                   |