10 Advice for Applying Machine Learning10.1 Deciding What to Try Next10.2 Evaluating a Hypothesis10.3 Model Selection and Train/Validation/Test Sets10.4 Diagnosing Bias vs. Variance10.5 Regularization and Bias/Variance10.6 Learning Curves10.7 Deciding What to Do Next Revisited11 Machine Learning System Design11.1 Prioritizing What to Work On11.2 Error Analysis11.3 Error Metrics for Skewed Classes11.4 Trading Off Precision and Recall11.5 Data For Machine Learning