Public vs Private leaderboard

Winning a Kaggle Competition in Python

Yauhen Babakhin

Kaggle Grandmaster

Competition metric

Evaluation metric Type of problem
Area Under the ROC (AUC) Classification
F1 Score (F1) Classification
Mean Log Loss (LogLoss) Classification
Mean Absolute Error (MAE) Regression
Mean Squared Error (MSE) Regression
Mean Average Precision at K (MAPK, MAP@K) Ranking
Winning a Kaggle Competition in Python

Test split

 

test split into public and private parts

Winning a Kaggle Competition in Python

Leaderboards

# Write a submission file to the disk
submission[['id', 'target']].to_csv('submission_1.csv', index=False)

 

Submission Public LB MSE Private LB MSE
submission_1.csv 2.895 ?
Winning a Kaggle Competition in Python

Overfitting

overfitting example

Winning a Kaggle Competition in Python

Overfitting

overfitting example

Winning a Kaggle Competition in Python

Overfitting

overfitting example with Public and Private leaderboards

Winning a Kaggle Competition in Python

Public vs Private leaderboard shake-up

small shake-up example

large shake-up example

Winning a Kaggle Competition in Python

Let's practice!

Winning a Kaggle Competition in Python

Preparing Video For Download...