OpenTube

Support Vector Machines Part 1 (of 3): Main Ideas!!!

StatQuest with Josh Starmer

1,812,809 views

Support Vector Machines are one of the most mysterious methods in Machine Learning. This StatQuest sweeps away the mystery to let know how they work.

Part 2: The Polynomial Kernel: Support Vector Machines Part 2: The Polyno...
Part 3: The Radial (RBF) Kernel: Support Vector Machines Part 3: The Radial...

NOTE: This StatQuest assumes you already know about...
The bias/variance tradeoff: Machine Learning Fundamentals: Bias and Va...
Cross Validation: Machine Learning Fundamentals: Cross Valid...

ALSO NOTE: This StatQuest is based on description of Support Vector Machines, and associated concepts, found on pages 337 to 354 of the Introduction to Statistical Learning in R: http://faculty.marshall.usc.edu/garet...

I also found this blogpost helpful for understanding the Kernel Trick: https://blog.statsbot.co/support-vect...

For a complete index of all the StatQuest videos, check out:
https://statquest.org/video-index/

If you'd like to support StatQuest, please consider...

Patreon: Patreon: statquest
...or...
YouTube Membership: @statquest

...buying one of my books, a study guide, a t-shirt or hoodie, or a song from the StatQuest store...
https://statquest.org/statquest-store/

...or just donating to StatQuest!
https://www.paypal.me/statquest

Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
Twitter: joshuastarmer

0:00 Awesome song and introduction
0:40 Basic concepts and Maximal Margin Classifiers
4:35 Soft Margins (allowing misclassifications)
6:46 Soft Margin and Support Vector Classifiers
12:23 Intuition behind Support Vector Machines
15:25 The polynomial kernel function
17:30 The radial basis function (RBF) kernel
18:32 The kernel trick
19:31 Summary of concepts

#statquest #SVM

20 Comments

@statquest Creator 4 years ago (edited) Pinned

Support StatQuest by buying my books The StatQuest Illustrated Guide to Machine Learning, The StatQuest Illustrated Guide to Neural Networks and AI, or a Study Guide or Merch!!! https://statquest.org/statquest-store/

@Elitea20 2 years ago (edited)

STATQUEST STOP showing up when I search up complex topics that my lecturer cant explain IM TIRED OF YOU HELPING ME OVER AND OVER AGAIN

@lemmiTry 6 years ago

Someone said, "You understand a subject when you can explain it to a 3 year old". Your teachings show how well you have understood the things you teach us! Great job!!

@Lunamaker20 6 years ago

I am a PhD student in the field of data analytics, and took some machine learning classes, but this...
Just WOOWW!
You're a significant value for the world!!!

@osielvivar2552 4 years ago

"BAM" is a perfect way to let someone know they just missed some key information. Great video

@gitarrtoken 6 years ago

Wish more people talked to me like Im a five year old! Really great video, thanks!

@iostream.h 7 years ago

ULTIMATE BAM: You make me understand kernel trick in few minutes where nobody does !

@chronicalllyoffline 1 year ago

I'm currently working on a masters degree in analytics, and your channel is single-handedly preventing me from diving right into the deep end of the imposter syndrome pool of shame. In other words, thank you!

@noahsplayground2564 6 years ago

Andrew Ng got me off to a good start a few years ago, but Josh is hitting it home for me. Thank you!

@HeduAI 5 years ago (edited)

Went to grad school at Stanford University and took many ML/Data Science courses; then spent 5 more years as a deep learning research scientist in some of the top tech companies......but who taught me what SVM kernels REALLY were? StatQuest!!!

@DerKupaner 6 years ago

The special effects in this video are incomparable

@tnield9727 7 years ago

Beautiful work Josh. You have an extremely rare gift of opening up the black box that few people are brave enough to do, much less try to present it in plain English. I especially appreciate how you don't dump a bunch of summations and Greek symbols on learners. I may have to contribute more support after this video.

@daksh_sagar 7 years ago

Would appreciate a video on word2vec, and thanks for the awesome content 😃

@karimafifi5501 6 years ago

After watching a number of tutorials explaining SVMs, this by far is the best one.Thank You.

@GradStudent89 6 years ago

I need a refund on all my math/stat/prob courses. I found a gold pot.

@nirmalkarthikeyan7346 4 years ago

This is literally the first time I'm actually commenting on YouTube. You, sir, have achieved, single handedly, something that my professors, textbooks and several additional resources have failed, in 20 minutes. The level of understanding that you have of Machine Learning is just remarkable, and your delivery makes sure I don't get bored, no matter how long the study session is. Can't remember opening Part 2 of an educational video with such enthusiasm. Will support as soon as I can. Keep it coming!

@PrasanthDreamer19 1 year ago

This channel is single-handedly helps me in becoming a ml engineer. Thank you

@3rdman99 3 years ago (edited)

I'm so glad to finally find the channel about ML where the speaker actually understands the topic and thus able to explain it in the concise but well-explained manner. It also helps tremendously that it's by somebody whose English I understand. Most of videos I've found are lacking in both.