ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2504.00491
55
0

Challenges of Interaction in Optimizing Mixed Categorical-Continuous Variables

1 April 2025
Youhei Akimoto
Xilin Gao
Ze Kai Ng
Daiki Morinaga
ArXivPDFHTML
Abstract

Optimization of mixed categorical-continuous variables is prevalent in real-world applications of black-box optimization. Recently, CatCMA has been proposed as a method for optimizing such variables and has demonstrated success in hyper-parameter optimization problems. However, it encounters challenges when optimizing categorical variables in the presence of interaction between continuous and categorical variables in the objective function. In this paper, we focus on optimizing mixed binary-continuous variables as a special case and identify two types of variable interactions that make the problem particularly challenging for CatCMA. To address these difficulties, we propose two algorithmic components: a warm-starting strategy and a hyper-representation technique. We analyze their theoretical impact on test problems exhibiting these interaction properties. Empirical results demonstrate that the proposed components effectively address the identified challenges, and CatCMA enhanced with these components, named ICatCMA, outperforms the original CatCMA.

View on arXiv
@article{akimoto2025_2504.00491,
  title={ Challenges of Interaction in Optimizing Mixed Categorical-Continuous Variables },
  author={ Youhei Akimoto and Xilin Gao and Ze Kai Ng and Daiki Morinaga },
  journal={arXiv preprint arXiv:2504.00491},
  year={ 2025 }
}
Comments on this paper