Vol.128, No.1, 2021, pp.65-85, doi:10.32604/cmes.2021.015378
OPEN ACCESS
ARTICLE
Variable Importance Measure System Based on Advanced Random Forest
  • Shufang Song1,*, Ruyang He1, Zhaoyin Shi1, Weiya Zhang2
1 School of Aeronautics, Northwestern Polytechnical University, Xi’an, 710072, China
2 AECC Sichuan Gas Turbine Establishment, Mianyang, 621700, China
* Corresponding Author: Shufang Song. Email:
Received 14 December 2020; Accepted 17 March 2021; Issue published 28 June 2021
Abstract
The variable importance measure (VIM) can be implemented to rank or select important variables, which can effectively reduce the variable dimension and shorten the computational time. Random forest (RF) is an ensemble learning method by constructing multiple decision trees. In order to improve the prediction accuracy of random forest, advanced random forest is presented by using Kriging models as the models of leaf nodes in all the decision trees. Referring to the Mean Decrease Accuracy (MDA) index based on Out-of-Bag (OOB) data, the single variable, group variables and correlated variables importance measures are proposed to establish a complete VIM system on the basis of advanced random forest. The link of MDA and variance-based sensitivity total index is explored, and then the corresponding relationship of proposed VIM indices and variance-based global sensitivity indices are constructed, which gives a novel way to solve variance-based global sensitivity. Finally, several numerical and engineering examples are given to verify the effectiveness of proposed VIM system and the validity of the established relationship.
Keywords
Variable importance measure; random forest; variance-based global sensitivity; Kriging model
Cite This Article
Song, S., He, R., Shi, Z., Zhang, W. (2021). Variable Importance Measure System Based on Advanced Random Forest. CMES-Computer Modeling in Engineering & Sciences, 128(1), 65–85.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.