如有任何疑問，請寄信連繫我們：info@republicofdeveloper.dev 2021年 主要研討議題 One-Shot/Few-Shot Learning Theory of Generalization and Optimization in Deep Learning (2021) Neural-Symbolic AI Domain Adaption Inverse Reinforcement Learning Knowledge Graph and its Applications for NLP

--- tags: deeplearning, cs224n --- # CS224N (2019) Lecture 1 Further Readings ## Gradient for Skip-Gram Model (p30) For a center word $c$ and a context word $o$, how to calculate $\frac{\partial{}}{\partial{v_{c}}}\log{p(o|c)}$? $\frac{\partial{}}{\partial{v_{c}}}\log{p(o|c)}$ $= \frac{\partial{}}{\partial{v_{c}}}\log{\frac{exp(u_{o}^{T}v_{c})}{\sum_{w=1}^{V}exp(u_{w}^{T}v_{c})}}$ $= \frac{\partial{}}{\partial{v_{c}}}\log{exp(u_{o}^{T}v_{c})} - \frac{\partial{}}{\partial{v_{c}}}\log{{\sum_