Resampling (crossvalidation + bootstrap)

Training error + test error
Usually training error is smaller
Bias – deviation from truth
Variance – deviation from average
Other methods (adjust the math) – Cp stat, AIC , BIC
Fit model on training set, then Fitted model then used to predict data from valudation set

Overestimate error
Test errors vary


Leave a Reply

Your email address will not be published. Required fields are marked *