Predicting from Strings: Language Model Embeddings for Bayesian
Optimization

Predicting from Strings: Language Model Embeddings for Bayesian Optimization

14 October 2024

Papers citing "Predicting from Strings: Language Model Embeddings for Bayesian Optimization"

17 / 17 papers shown

Title
ExPT: Synthetic Pretraining for Few-Shot Experimental Design Tung Nguyen Sudhanshu Agrawal Aditya Grover 85 17 0 30 Oct 2023
Transformers as Statisticians: Provable In-Context Learning with In-Context Algorithm Selection Yu Bai Fan Chen Haiquan Wang Caiming Xiong Song Mei 42 191 0 07 Jun 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.0K 14,179 0 15 Mar 2023
What Can Transformers Learn In-Context? A Case Study of Simple Function Classes Shivam Garg Dimitris Tsipras Percy Liang Gregory Valiant 116 504 0 01 Aug 2022
Transformer Neural Processes: Uncertainty-Aware Meta Learning Via Sequence Modeling Tung Nguyen Aditya Grover BDL UQCV 63 106 0 09 Jul 2022
Towards Learning Universal Hyperparameter Optimizers with Transformers Yutian Chen Xingyou Song Chansoo Lee Zehao Wang Qiuyi Zhang ... Greg Kochanski Arnaud Doucet MarcÁurelio Ranzato Sagi Perel Nando de Freitas 76 64 0 26 May 2022
Transformers Can Do Bayesian Inference Samuel G. Müller Noah Hollmann Sebastian Pineda Arango Josif Grabocka Frank Hutter BDL UQCV 66 169 0 20 Dec 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 509 4,021 0 18 Apr 2021
Batch Bayesian Optimization on Permutations using the Acquisition Weighted Kernel Changyong Oh Roberto Bondesan E. Gavves Max Welling 46 6 0 26 Feb 2021
Efficient Transformers: A Survey Yi Tay Mostafa Dehghani Dara Bahri Donald Metzler VLM 146 1,115 0 14 Sep 2020
Surrogate NAS Benchmarks: Going Beyond the Limited Search Spaces of Tabular NAS Benchmarks Arber Zela Julien N. Siems Lucas Zimmer Jovita Lukasik Margret Keuper Frank Hutter 63 79 0 22 Aug 2020
AutoML-Zero: Evolving Machine Learning Algorithms From Scratch Esteban Real Chen Liang David R. So Quoc V. Le 70 225 0 06 Mar 2020
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 367 20,053 0 23 Oct 2019
COCO: The Large Scale Black-Box Optimization Benchmarking (bbob-largescale) Test Suite Ouassim Ait ElHara Konstantinos Varelas Duc Manh Nguyen Tea Tušar D. Brockhoff N. Hansen A. Auger 40 27 0 15 Mar 2019
SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing Taku Kudo John Richardson 175 3,514 0 19 Aug 2018
Regularized Evolution for Image Classifier Architecture Search Esteban Real A. Aggarwal Yanping Huang Quoc V. Le 150 3,025 0 05 Feb 2018
XGBoost: A Scalable Tree Boosting System Tianqi Chen Carlos Guestrin 596 38,735 0 09 Mar 2016