---
# System prepended metadata

title: MagViT

---

# MagViT
**Based on: MaskGIT predicts all tokens (masked) in parralel. Use BERT-like model.**

Comprises of two components:
- 3D quantization model to tokenize video
- Masked token modeling for modeling these video tokens

Other related works:
- Two stage image synthesis: VQGAN + DALL-E.
- Non-autoregressive transformers: MaskGIT + Token-Critic: predict all tokens (masked) in parralel. Use BERT-like model

