Status Updates From Python Machine Learning

The theory and logic behind Random Forest

The theory and logic behind Random Forest

Decision trees split the data on each feature in order to increase "order" or information gain. This is in a sense how much pure this split will be compared to the sample before splitting

Decision trees split the data on each feature in order to increase "order" or information gain. This is in a sense how much pure this split will be compared to the sample before splitting

Decision trees have a great advantage of interpretability

for non-linear problem, SVM has a trick: The kernel trick. and the most famous kernel is the RBF kernel

Logistic Regression often gives similar yield to linear SVM. However,
1. LR is more prone to outliers
2. LR is easier to interpret
3. LR is easier to update, which might make it more attractive to streaming data

Logistic Regression often gives similar yield to linear SVM. However,
1. LR is more prone to outliers
2. LR is easier to interpret
3. LR is easier to update, which might make it more attractive to streaming data

SVM is a generalization of perceptron, where instead of minimizing classification errors, we know maximize the hyperbolic margin

L2 regularization

L2 regularization.

Logistic Regression is actually a classification algorithm

Logistic Regression is actually a classification algorithm

Logistic Regression is actually a classification algorithm

60