# M3 Phoneme Relation Maps

We show the attention map of a head with a fixed utterance on the left, and the PRM of that head over the entire speech corpus on the right.

## Layer 1


## Layer 2


## Layer 3


## Layer 4


## Layer 5


## Layer 6


## Layer 7


## Layer 8


## Layer 9


## Layer 10


## Layer 11


## Layer 12