1912.08777
GSG: 比較了 6 種變體 (mask 30 %)
MLM: 與 GSG Ind-Orig 一起預訓練 (如架構圖),選 30% 句子與額外的 15% mask
Paper
or
By clicking below, you agree to our terms of service.
New to HackMD? Sign up