Decision and Classification Trees, Clearly Explained!!!

Decision trees are part of the foundation for Machine Learning. Although they are quite simple, they are very flexible and pop up in a very wide variety of situations. This StatQuest covers all the basics and shows you how to create a new tree from scratch, one step at a time. NOTE: This is an updated and revised version of the Decision Tree StatQuest that I made back in 2018. It is my hope that this new version does a better job answering some of the most frequently asked questions people asked about the old one. Note, you may also want to learn about... Regression Trees: https://youtu.be/g9c66TUylZ4 Bias and Variance (and over fitting): https://youtu.be/EuBBz3bI-aA Cross Validation: https://youtu.be/fSytzGwwBVw Pruning Trees: https://youtu.be/D0efHEJsfHo For a complete index of all the StatQuest videos, check out: https://statquest.org/video-index/ If you'd like to support StatQuest, please consider... Patreon: https://www.patreon.com/statquest ...or... YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join ...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store... https://statquest.org/statquest-store/ ...or just donating to StatQuest! https://www.paypal.me/statquest Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter: https://twitter.com/joshuastarmer 0:00 Awesome song and introduction 0:18 Basic decision tree concepts 3:16 Building a tree with Gini Impurity 9:15 Numeric and continuous variables 12:35 Adding branches 13:56 Adding leaves 14:32 Defining output values 15:12 Using the tree 15:38 How to prevent overfitting #StatQuest #decisiontree #ML