Multi-objective hyperparameter optimization approach with genetic algorithms towards efficient and environmentally friendly machine learning

Issue title: Special section: Distilled insights from IBERAMIA 2022

Guest editors: Ana Cristina Bicharra Garcia and Mariza Ferro

Article type: Research Article

Authors: Yokoyama, André M.^a | Ferro, Mariza^{b; *} | Schulze, Bruno^a

Affiliations: [a] National Laboratory for Scientifc Computing (LNCC), RJ, Brazil | [b] Computer Science, Federal Fluminense University (UFF), RJ, Brazil

Correspondence: [*] Corresponding author. E-mail: [email protected].

Abstract: This paper presents a multi-objective optimization approach for developing efficient and environmentally friendly Machine Learning models. The proposed approach uses Genetic Algorithms to simultaneously optimize the accuracy, time-to-solution, and energy consumption simultaneously. This solution proposed to be part of an Automated Machine Learning pipeline and focuses on architecture and hyperparameter search. A customized Genetic Algorithm scheme and operators were developed, and its feasibility was evaluated using the XGBoost ML algorithm for classification and regression tasks. The results demonstrate the effectiveness of the Genetic Algorithm for multi-objective optimization, indicating that it is possible to reduce energy consumption while minimizing predictive performance losses.

Keywords: Genetic Algorithm, Machine Learning, Green AI, Multi-objective optimization

DOI: 10.3233/AIC-230063

Journal: AI Communications, vol. 37, no. 3, pp. 429-442, 2024