Hellow guys, Welcome to my website, and you are watching How do transformers work? (Attention is all you need). and this vIdeo is uploaded by Aleksa Gordić - The AI Epiphany at 2020-10-25T13:54:50-07:00. We are pramote this video only for entertainment and educational perpose only. So, I hop you like our website.
| Name | How do transformers work? (Attention is all you need) |
| Video Uploader | Video From Aleksa Gordić - The AI Epiphany |
| Upload Date | This Video Uploaded At 25-10-2020 16:54:50 |
| Video Discription | ❤️ Become The AI Epiphany Patreon ❤️ ► https://www.patreon.com/theaiepiphany ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ In this video, I give you a semi-quick tour through the "Attention is all you need" paper. The paper that introduced the first-ever transformer model! I also show you some cool blogs along the way and my half-baked implementation of the original transformer model. You'll learn about: ✔️ How the original transformer model works ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ ✅ The Annotated Transformer blog: http://nlp.seas.harvard.edu/2018/04/03/attention.html ✅ Jay Alammar's blog: https://jalammar.github.io/illustrated-transformer/ ✅ Original paper: https://arxiv.org/abs/1706.03762 ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ ⌚️ Timetable: 0:00 prerequisite theory and my semi-done transformer implementation 1:40 High-level overview of the paper 2:55 Visualization of positional encodings (my code) 5:07 Attention mask (no looking forward!) 7:35 Optimizer 10:20 Multi-head attention in depth 15:15 A glimpse at the code implementation 17:49 Training procedure - machine translation 18:09 Na ja, wie geht's? ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 💰 BECOME A PATREON OF THE AI EPIPHANY ❤️ If these videos, GitHub projects, and blogs help you, consider helping me out by supporting me on Patreon! The AI Epiphany ► https://www.patreon.com/theaiepiphany One-time donation: https://www.paypal.com/paypalme/theaiepiphany Much love! ❤️ ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 💡 The AI Epiphany is a channel dedicated to simplifying the field of AI using creative visualizations and in general, a stronger focus on geometrical and visual intuition, rather than the algebraic and numerical "intuition". ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ 👋 CONNECT WITH ME ON SOCIAL LinkedIn ► https://www.linkedin.com/in/aleksagordic/ Twitter ► https://twitter.com/gordic_aleksa Instagram ► https://www.instagram.com/aiepiphany/ Facebook ► https://www.facebook.com/aiepiphany/ 👨👩👧👦 JOIN OUR DISCORD COMMUNITY: Discord ► https://discord.gg/peBrCpheKE 📢 SUBSCRIBE TO MY MONTHLY AI NEWSLETTER: Substack ► https://aiepiphany.substack.com/ 💻 FOLLOW ME ON GITHUB FOR COOL PROJECTS: GitHub ► https://github.com/gordicaleksa 📚 FOLLOW ME ON MEDIUM: Medium ► https://gordicaleksa.medium.com/ ▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬ #transformer #attention #deeplearning |
| Category | Education |
| Tags | attention | transformers | attention is all you need | nlp | natural language processing | paper | deep learning | machine learning | attention mechanism | seq2seq | google | arxiv | neural machine translation | language |
