Evaluating the model

İK Analitiği: Python ile Çalışan Terkini (Churn) Tahmin Etme

Hrant Davtyan

Assistant Professor of Data Science American University of Armenia

Prediction errors

Evaluation metrics (1)

If target is leavers, focus on FN
- Recall score = TP/(TP+FN)
- Lower FN, higher Recall score
- Recall score - % of correct predictions among 1s (leavers)
If target is stayers, focus on FP
- Specificity = TN/(TN+FP)
- Lower FP, higher Specificity,
- Specificity - % of correct predictions among 0s (stayers)

Evaluation metrics (2)

Even if target is leavers, you may still focus on FP:
- Precision score = TP/(TP+FP)
- Lower FP, higher Precision score
- Precision score - % of leavers in reality, among those predicted to leave

Let's practice!

İK Analitiği: Python ile Çalışan Terkini (Churn) Tahmin Etme

Preparing Video For Download...