WCCI Performance Prediction Challenge

The challenge is over, but a new challenge is on-going using the same datasets, check it out!

Final #2

Submitted by Gavin Cawley

model selection based on leave-one-out cross-validation, estimation based on cross-validation (much less biased).

ADA #045
GINA #123
HIVA #042
NOVA #051
SYLVA #088

Dataset Balanced Error Test guess Guess error Test score Area Under Curve
Train Valid Test Train Valid Test
ada 0.149 0.1542 0.1845 0.1742 0.0103 0.1947 0.9248 0.9259 0.8965
gina 0 0 0.0461 0.047 0.0009 0.0466 1 1 0.99
hiva 0.018 0.0216 0.2804 0.2776 0.0028 0.2814 0.9979 0.9963 0.7464
nova 0 0 0.0445 0.047 0.0025 0.0464 1 1 0.9914
sylva 0.0028 0.0029 0.0067 0.0065 0.0002 0.0067 0.9999 0.9998 0.999
Overall 0.034 0.0357 0.1124 0.1105 0.0034 0.1152 0.9845 0.9844 0.9246

This entry is a complete valid challenge entry.