Derivation of Ridge and Lasso Regularization from Bayesian Principles

This lesson explores how Ridge and Lasso regularization methods can be derived using Bayesian principles, starting from Bayes' rule and leading to point estimation by maximizing the log posterior distribution.

Derivation of Ridge and Lasso Regularization from Bayesian Principles
crotoneacademia
549 views β€’ Jan 19, 2021
Derivation of Ridge and Lasso Regularization from Bayesian Principles

About this video

In this lesson, we start from the Bayes rule and show how it reduces to a point estimation of parameters when maximized the log value of the posteior distribution. Finally we show how to get Ridge regularization through a Gaussian prior and Lasso regularization through a Laplace prior.

Tags and Topics

Browse our collection to discover more content in these categories.

Video Information

Views

549

Likes

17

Duration

14:02

Published

Jan 19, 2021

Related Trending Topics

LIVE TRENDS

Related trending topics. Click any trend to explore more videos.