Large Language Model Agent for Hyper-Parameter Optimization

2 February 2024

Yong Li

Papers citing "Large Language Model Agent for Hyper-Parameter Optimization"

44 / 44 papers shown

Title
OptiMindTune: A Multi-Agent Framework for Intelligent Hyperparameter Optimization Meher Bhaskar Madiraju Meher Sai Preetam Madiraju 86 0 0 25 May 2025
AD-AGENT: A Multi-agent Framework for End-to-end Anomaly Detection Tiankai Yang Junjun Liu Wingchun Siu Jiahang Wang Zhuangzhuang Qian Chanjuan Song Cheng Cheng Xiyang Hu Yue Zhao 28 0 0 19 May 2025
Optimization Problem Solving Can Transition to Evolutionary Agentic Workflows Wenhao Li Bo Jin Mingyi Hong Changhong Lu Xiangfeng Wang 121 0 0 07 May 2025
Large Language Model Enhanced Particle Swarm Optimization for Hyperparameter Tuning for Deep Learning Models Saad Hameed Basheer Qolomany Samir Brahim Belhaouari M. Abdallah Junaid Qadir Ala I. Al-Fuqaha 51 0 0 19 Apr 2025
Large Language Models as Particle Swarm Optimizers Yamato Shinohara Jinglue Xu Tianshui Li Hitoshi Iba 33 0 0 12 Apr 2025
Optuna vs Code Llama: Are LLMs a New Paradigm for Hyperparameter Tuning? Roman Kochnev Arash Torabi Goodarzi Zofia Antonina Bentyn D. Ignatov Radu Timofte 83 2 0 08 Apr 2025
From Hypothesis to Publication: A Comprehensive Survey of AI-Driven Research Support Systems Zekun Zhou Xiaocheng Feng L. Huang Xiachong Feng Ziyun Song ... Baoxin Wang Dayong Wu Guoping Hu Ting Liu Bing Qin AI4TS 100 1 0 03 Mar 2025
Large Language Models for Constructing and Optimizing Machine Learning Workflows: A Survey Yang Gu Hengyu You Jian Cao Muran Yu Haoran Fan Shiyou Qian LM&MA AI4CE 95 4 0 11 Nov 2024
Sequential Large Language Model-Based Hyper-parameter Optimization Kanan Mahammadli Seyda Ertekin 130 5 0 27 Oct 2024
SELA: Tree-Search Enhanced LLM Agents for Automated Machine Learning Yizhou Chi Yizhang Lin Sirui Hong Duyi Pan Yaying Fei ... Tianqi Pang Jacky Kwok Ceyao Zhang Bang Liu Chenglin Wu LLMAG 84 3 0 22 Oct 2024
AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML Patara Trirat Wonyong Jeong Sung Ju Hwang LLMAG 71 14 0 03 Oct 2024
SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories Ben Bogin Kejuan Yang Shashank Gupta Kyle Richardson Erin Bransom Peter Clark Ashish Sabharwal Tushar Khot ELM LRM 63 12 0 11 Sep 2024
When Large Language Model Meets Optimization Sen Huang Kaixiang Yang Sheng Qi Rui Wang 65 9 0 16 May 2024
KAN: Kolmogorov-Arnold Networks Ziming Liu Yixuan Wang Sachin Vaidya Fabian Ruehle James Halverson Marin Soljacic Thomas Y. Hou Max Tegmark 165 528 0 30 Apr 2024
Data Interpreter: An LLM Agent For Data Science Sirui Hong Yizhang Lin Bang Liu Bangbang Liu Binhao Wu ... Xinbing Liang Yaying Fei Yuheng Cheng Zongze Xu Chenglin Wu LLMAG AI4CE 90 68 0 28 Feb 2024
Large Language Model-driven Meta-structure Discovery in Heterogeneous Information Network Lin Chen Fengli Xu Nian Li Zhenyu Han Meng Wang Yong Li Pan Hui LRM 60 7 0 18 Feb 2024
Using Large Language Models for Hyperparameter Optimization Michael Ruogu Zhang Nishkrit Desai Juhan Bae Jonathan Lorraine Jimmy Ba 61 50 0 07 Dec 2023
Unleashing the Power of Graph Learning through LLM-based Autonomous Agents Lanning Wei Zhiqiang He Huan Zhao Quanming Yao LLMAG 59 1 0 08 Sep 2023
Large Language Models as Optimizers Chengrun Yang Xuezhi Wang Yifeng Lu Hanxiao Liu Quoc V. Le Denny Zhou Xinyun Chen ODL 59 395 0 07 Sep 2023
MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework Sirui Hong Mingchen Zhuge Jonathan Chen Xiawu Zheng Yuheng Cheng ... Liyang Zhou Chenyu Ran Lingfeng Xiao Chenglin Wu Jürgen Schmidhuber LLMAG AIFin 50 548 0 01 Aug 2023
PriorBand: Practical Hyperparameter Optimization in the Age of Deep Learning Neeratyoy Mallik Eddie Bergman Carl Hvarfner Daniel Stoll Maciej Janowski Marius Lindauer Luigi Nardi Frank Hutter 49 25 0 21 Jun 2023
AutoML in the Age of Large Language Models: Current Challenges, Future Opportunities and Risks Alexander Tornede Difan Deng Theresa Eimer Joseph Giovanelli Aditya Mohan ... Sarah Segel Daphne Theodorakopoulos Tanja Tornede Henning Wachsmuth Marius Lindauer 68 23 0 13 Jun 2023
Voyager: An Open-Ended Embodied Agent with Large Language Models Guanzhi Wang Yuqi Xie Yunfan Jiang Ajay Mandlekar Chaowei Xiao Yuke Zhu Linxi Fan Anima Anandkumar LM&Ro SyDa 88 795 0 25 May 2023
Large Language Models for Automated Data Science: Introducing CAAFE for Context-Aware Automated Feature Engineering Noah Hollmann Samuel G. Müller Frank Hutter 59 57 0 05 May 2023
AutoML-GPT: Automatic Machine Learning with GPT Shujian Zhang Chengyue Gong Lemeng Wu Xingchao Liu Mi Zhou LLMAG 106 64 0 04 May 2023
MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Tasks Lei Zhang Yuge Zhang Kan Ren Dongsheng Li Yuqing Yang LLMAG 66 38 0 28 Apr 2023
Generative Agents: Interactive Simulacra of Human Behavior J. Park Joseph C. O'Brien Carrie J. Cai Meredith Ringel Morris Percy Liang Michael S. Bernstein LM&Ro AI4CE 359 1,852 0 07 Apr 2023
EvoPrompting: Language Models for Code-Level Neural Architecture Search Angelica Chen David Dohan David R. So VLM LRM 61 88 0 28 Feb 2023
Towards Learning Universal Hyperparameter Optimizers with Transformers Yutian Chen Xingyou Song Chansoo Lee Zehao Wang Qiuyi Zhang ... Greg Kochanski Arnaud Doucet MarcÁurelio Ranzato Sagi Perel Nando de Freitas 68 63 0 26 May 2022
HPOBench: A Collection of Reproducible Multi-Fidelity Benchmark Problems for HPO Katharina Eggensperger Philip Muller Neeratyoy Mallik Matthias Feurer René Sass Aaron Klein Noor H. Awad Marius Lindauer Frank Hutter 148 101 0 14 Sep 2021
On Hyperparameter Optimization of Machine Learning Algorithms: Theory and Practice Li Yang Abdallah Shami AI4CE 127 2,079 0 30 Jul 2020
Hyper-Parameter Optimization: A Review of Algorithms and Applications Tong Yu Hong Zhu AAML 43 529 0 12 Mar 2020
LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation Xiangnan He Kuan Deng Xiang Wang Yan Li Yongdong Zhang Meng Wang GNN 141 3,586 0 06 Feb 2020
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 328 19,824 0 23 Oct 2019
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter Victor Sanh Lysandre Debut Julien Chaumond Thomas Wolf 159 7,437 0 02 Oct 2019
Explaining Explanations: An Overview of Interpretability of Machine Learning Leilani H. Gilpin David Bau Ben Z. Yuan Ayesha Bajwa Michael A. Specter Lalana Kagal XAI 75 1,849 0 31 May 2018
On the State of the Art of Evaluation in Neural Language Models Gábor Melis Chris Dyer Phil Blunsom 50 532 0 18 Jul 2017
DeepFM: A Factorization-Machine based Neural Network for CTR Prediction Huifeng Guo Ruiming Tang Yunming Ye Zhenguo Li Xiuqiang He 99 2,625 0 13 Mar 2017
Variational Graph Auto-Encoders Thomas Kipf Max Welling GNN BDL SSL CML 111 3,559 0 21 Nov 2016
Semi-Supervised Classification with Graph Convolutional Networks Thomas Kipf Max Welling GNN SSL 506 28,901 0 09 Sep 2016
ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation Adam Paszke Abhishek Chaurasia Sangpil Kim Eugenio Culurciello SSeg 305 2,069 0 07 Jun 2016
The Cityscapes Dataset for Semantic Urban Scene Understanding Marius Cordts Mohamed Omran Sebastian Ramos Timo Rehfeld Markus Enzweiler Rodrigo Benenson Uwe Franke Stefan Roth Bernt Schiele 784 11,540 0 06 Apr 2016
XGBoost: A Scalable Tree Boosting System Tianqi Chen Carlos Guestrin 454 37,815 0 09 Mar 2016
Deep Residual Learning for Image Recognition Kaiming He Xinming Zhang Shaoqing Ren Jian Sun MedIm 1.6K 192,638 0 10 Dec 2015