Hellow guys, Welcome to my website, and you are watching Rasa Algorithm Whiteboard - Transformers & Attention 3: Multi Head Attention. and this vIdeo is uploaded by Rasa at 2020-05-04T01:31:18-07:00. We are pramote this video only for entertainment and educational perpose only. So, I hop you like our website.
| Name | Rasa Algorithm Whiteboard - Transformers & Attention 3: Multi Head Attention |
| Video Uploader | Video From Rasa |
| Upload Date | This Video Uploaded At 04-05-2020 04:31:18 |
| Video Discription | This is the third video on attention mechanisms. In the previous video we introduced keys, queries and values and in this video we're introducing the concept of multiple heads. The colab notebook that contains the interactive visualisation can be found here: https://colab.research.google.com/github/tensorflow/tensor2tensor/blob/master/tensor2tensor/notebooks/hello_t2t.ipynb#scrollTo=T7UJzFf6fmhp We're going at it step by step, but if you're interested in immediately reading all about it in full detail then we might recommend these online documents: - http://www.peterbloem.nl/blog/transformers - http://jalammar.github.io/illustrated-transformer/ - http://d2l.ai/chapter_attention-mechanisms/attention.html The general github repo for this playlist can be found here: https://github.com/RasaHQ/algorithm-whiteboard-resources. |
| Category | Science & Technology |
| Tags | nlp | ai | rasa | transformers | nlp pipeline | natural language processing |
