# M9 Phoneme Relation Maps We show the attention map of a head with a fixed utterance on the left, and the PRM of that head over the entire speech corpus on the right. ## Layer 1 ![](https://i.imgur.com/MTWeTjR.jpg) ## Layer 2 ![](https://i.imgur.com/6e88cID.jpg) ## Layer 3 ![](https://i.imgur.com/V7Wgter.jpg) ## Layer 4 ![](https://i.imgur.com/4eZb0eF.jpg) ## Layer 5 ![](https://i.imgur.com/NjoJHgM.jpg) ## Layer 6 ![](https://i.imgur.com/QQVY1R9.jpg) ## Layer 7 ![](https://i.imgur.com/rTK5VO4.jpg) ## Layer 8 ![](https://i.imgur.com/XNSUnmF.jpg) ## Layer 9 ![](https://i.imgur.com/YIKQl4D.jpg) ## Layer 10 ![](https://i.imgur.com/USRML8t.jpg) ## Layer 11 ![](https://i.imgur.com/GP2hfvH.jpg) ## Layer 12 ![Uploading file..._ecl35ulfk]()