Boruta – A System for Feature Selection

Article type: Research Article

Authors: Kursa, Miron B. | Jankowski, Aleksander | Rudnicki, Witold R.

Affiliations: ICM, University of Warsaw, Pawińskiego 5a, Warsaw, Poland. [email protected]

Note: [] Address for correspondence: ICM, University of Warsaw, Pawińskiego 5a, Warsaw, Poland

Abstract: Machine learning methods are often used to classify objects described by hundreds of attributes; in many applications of this kind a great fraction of attributes may be totally irrelevant to the classification problem. Even more, usually one cannot decide a priori which attributes are relevant. In this paper we present an improved version of the algorithm for identification of the full set of truly important variables in an information system. It is an extension of the random forest method which utilises the importance measure generated by the original algorithm. It compares, in the iterative fashion, the importances of original attributes with importances of their randomised copies. We analyse performance of the algorithm on several examples of synthetic data, as well as on a biologically important problem, namely on identification of the sequence motifs that are important for aptameric activity of short RNA sequences.

DOI: 10.3233/FI-2010-288

Journal: Fundamenta Informaticae, vol. 101, no. 4, pp. 271-285, 2010