Status Updates From Python Machine Learning

SVM is a generalization of perceptron, where instead of minimizing classification errors, we know maximize the hyperbolic margin

L2 regularization

L2 regularization.

Logistic Regression is actually a classification algorithm

Logistic Regression is actually a classification algorithm

Logistic Regression is actually a classification algorithm

60

3 Types of ways to find local minima:
Batch: Updating weights over the whole sample
Stochastic: Updating one example at a time
Mini Batch: A compromise between both previous examples

if eta (the learning rate) is too small, the progress of minimizing the cost function will be slow. IF eta is too large, we will never converge: it will keep overshooting

Code implementation for Adaptive Linear Perceptron