# Attention Is All You Need

###### tags : `transformer` `self-attention`

## :cat: Paper Info

Conference :

Year : 2018

Paper : [PDF](https://arxiv.org/pdf/1706.03762.pdf)

Total Citation(Recent) :

Refs :

<br>

## :palm_tree: Abstract

<br>

## :fireworks: Method

### Key-Query-Valueの関係


<br>

#### 1. 従来のアテンション


<br>

#### 2. Self-attention


<br>

### Positional Encoding


<br>

### Multi Head Attention


<br>

## :bar_chart: Results

<br>

## :ledger: Memo

<br>