Basic recipe for ML

Basic recipe for ML Does the model have high bias? (training data performance) Try a bigger network, train longer (more epochs), try a different NN architecture, keep doing it until the training data fits well. Does the model have High Variance? (Dev Set performance) Add more data, data augmentation, try regularization, NN architecture. For High…

Bias and Variance

  When looking at the train set error and comparing to the cross validation error we could have the following situations:Train set error: 1% (the model is doing very well) Cross Val error: 11%There is a big variance in error between the training set and cross val. set, this is an example of High Variance, and…