WCCI Performance Prediction Challenge

The challenge is over, but a new challenge is on-going using the same datasets, check it out!

Final #3 (corrected)

Submitted by Gavin Cawley

model selection based on leave-one-out AUC, estimation based on cross-validation.

ADA #133
GINA #178
HIVA #134
NOVA #041
SYLVA #133

Dataset Balanced Error Test guess Guess error Test score Area Under Curve
Train Valid Test Train Valid Test
ada 0.1541 0.1607 0.1851 0.1752 0.0099 0.1948 0.9242 0.9243 0.8963
gina 0 0 0.0469 0.0482 0.0014 0.0478 1 1 0.9899
hiva 0.0127 0.0122 0.2937 0.2773 0.0163 0.3085 0.999 0.9969 0.76
nova 0 0 0.0451 0.0467 0.0015 0.046 1 1 0.9916
sylva 0.0026 0.0029 0.0095 0.0085 0.001 0.0105 1 1 0.9989
Overall 0.0339 0.0351 0.116 0.1112 0.006 0.1215 0.9846 0.9842 0.9274

This entry is a complete valid challenge entry.