元學習算法選擇機制及關(guān)聯(lián)對性能的影響

提出一種元學習定義，從偏差/方差分解角度對元學習中學習算法的選取機制進行研究，得出了元級選用錯誤率低且偏差小的學習算法、基級學習算法按照錯誤率及方差從低到高排列的結(jié)論。鑒于標準數(shù)據(jù)集不能充分評估關(guān)聯(lián)對元學習性能的影響，設(shè)計了一種模擬算法以產(chǎn)生模擬數(shù)據(jù)集。在UCI標準數(shù)據(jù)集和模擬數(shù)據(jù)集上的實驗表明，同常用的多數(shù)投票等組合方法相比，基于算法選擇機制的元學習表現(xiàn)出優(yōu)良的性能，且分類器之間的負關(guān)聯(lián)有助于性能的改進。

In this paper, a general definition of meta-learning is proposed. The selection of learning algorithms in meta-learning is investigated from the point of bias/variance decomposition as well as the effect of correlation on its accuracy. In order to obtain classifiers with variable correlation, artificial datasets are generated based on the simulating algorithm presented in the paper. Experiments are performed on UCI datasets and simulated datasets and show that meta-learning outperforms several combining methods averagely; and that negative correlation measured by Q statistic benefits meta-learning approach.