Attention

Ashish Vaswani’s guest lecture at Stanford about Attention and Transformers from Attention Is All you Need. Followed by Anna Huang’s lecture on music generation. There is also a wonderful notebook from harvardnlp, The Annotated Transformer, for understanding the paper.