| |
corrected resampled t-test object - significance test of results
|
A=corrt_test(D,ntrain,ntest,ntrials,alpha,[L]) calculates the statistical significance of the mean
loss being equal to competitors for groups of results (data objects)
D, with loss function/type L.
NOTE: Assumes you have the Matlab stats package, uses tinv.
Examples:
d=gen(toy);
corrt_test(train(cv({svm knn}),d),40,10,0.05) or is equivalent to below
train(corrt_test(cv({svm knn}),40,10,0.05),d) or is equivalent to below
corrt=corrt_test; corrt.ntrain=40; corrt.ntest=10; corrt.alpha=0.05;
train(chain({ group(cv({svm knn}),'all') corrt }),d)