Hellow guys, Welcome to my website, and you are watching Fine-tuning Large Language Models (LLMs) | w/ Example Code. and this vIdeo is uploaded by Shaw Talebi at 2023-10-01T13:19:38-07:00. We are pramote this video only for entertainment and educational perpose only. So, I hop you like our website.
| Name | Fine-tuning Large Language Models (LLMs) | w/ Example Code |
| Video Uploader | Video From Shaw Talebi |
| Upload Date | This Video Uploaded At 01-10-2023 16:19:38 |
| Video Discription | 👉 Need help with AI? Reach out: https://shawhintalebi.com/ This is the 5th video in a series on using large language models (LLMs) in practice. Here, I discuss how to fine-tune an existing LLM for a particular use case and walk through a concrete example with Python code. More Resources: 👉 Series Playlist: https://www.youtube.com/playlist?list=PLz-ep5RbHosU2hnz5ejezwaYpdMutMVB0 📰 Read more: https://towardsdatascience.com/fine-tuning-large-language-models-llms-23473d763b91?sk=fd31e7444cf8f3070d9a843a8218ddad 💻 Example code: https://github.com/ShawhinT/YouTube-Blog/tree/main/LLMs/fine-tuning Final Model: https://huggingface.co/shawhin/distilbert-base-uncased-lora-text-classification 🔢 Dataset: https://huggingface.co/datasets/shawhin/imdb-truncated [1] Deeplearning.ai Finetuning Large Langauge Models Short Course: https://www.deeplearning.ai/short-courses/finetuning-large-language-models/ [2] arXiv:2005.14165 [cs.CL] (GPT-3 Paper) [3] arXiv:2303.18223 [cs.CL] (Survey of LLMs) [4] arXiv:2203.02155 [cs.CL] (InstructGPT paper) [5] 🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware: https://huggingface.co/blog/peft [6] arXiv:2106.09685 [cs.CL] (LoRA paper) [7] Original dataset source — Andrew L. Maas, Raymond E. Daly, Peter T. Pham, Dan Huang, Andrew Y. Ng, and Christopher Potts. 2011. Learning Word Vectors for Sentiment Analysis. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 142–150, Portland, Oregon, USA. Association for Computational Linguistics. -- Book a call: https://calendly.com/shawhintalebi Socials https://medium.com/@shawhin https://www.linkedin.com/in/shawhintalebi/ https://twitter.com/ShawhinT https://www.instagram.com/shawhintalebi/ The Data Entrepreneurs 🎥 YouTube: https://www.youtube.com/@TheDataEntrepreneurs 👉 Discord: https://discord.gg/RSqZbF9ygh 📰 Medium: https://medium.com/the-data-entrepreneurs 📅 Events: https://lu.ma/tde 🗞️ Newsletter: https://the-data-entrepreneurs.ck.page/profile Support ❤️ https://www.buymeacoffee.com/shawhint Intro - 0:00 What is Fine-tuning? - 0:32 Why Fine-tune - 3:29 3 Ways to Fine-tune - 4:25 Supervised Fine-tuning in 5 Steps - 9:04 3 Options for Parameter Tuning - 10:00 Low-Rank Adaptation (LoRA) - 11:37 Example code: Fine-tuning an LLM with LoRA - 15:40 Load Base Model - 16:02 Data Prep - 17:44 Model Evaluation - 21:49 Fine-tuning with LoRA - 24:10 Fine-tuned Model - 26:50 |
| Category | Education |
| Tags | large language models | large language model | llm | language model | hugging face | python | code | programming | example code | fine-tuning | fine tuning | fine tune | how to fine tune model | tutorial | lecture | workshop | training | for beginners | made easy | fine tune llm | fine tune llama 2 | fine tune chatgpt | fune tune hugging face model | guide | fine-tuning gpt-3 | python code | lesson | open-source | free | for free | no cost fine tuning | fine tune locally | local fine tuning | how to fine tune gpt 3 |
