neural_trees.paired_t_test#

neural_trees.paired_t_test(clf_A: Any, clf_B: Any, X, y, k_folds: int = 10, alpha: float = 0.05, random_state: int = 42) TestResult[source]#

Paired t-test for classifier comparison.

Splits data into k folds, trains/tests both classifiers on each fold, and applies a paired t-test on the k accuracy differences.

Note: This test has inflated Type I error due to the non-independence of overlapping training sets. Prefer the 5×2cv F test (Alpaydın, 1999).

Parameters:
clf_A, clf_Bsklearn-compatible classifiers
Xarray-like
yarray-like
k_foldsint, default=10
alphafloat, default=0.05
random_stateint, default=42
Returns:
TestResult