Sample-Efficient Optimisation with Probabilistic Transformer Surrogates

27 May 2022

Jun Wang

Papers citing "Sample-Efficient Optimisation with Probabilistic Transformer Surrogates"

50 / 55 papers shown

Title
AntBO: Towards Real-World Automated Antibody Design with Combinatorial Bayesian Optimisation M. A. Khan Alexander I. Cowen-Rivers Antoine Grosnit Derrick-Goh-Xin Deik Philippe A. Robert ... Rasul Tutunov Dany Bou-Ammar Jun Wang Amos Storkey Haitham Bou-Ammar 83 22 0 29 Jan 2022
Bayesian Optimization of Function Networks Raul Astudillo P. Frazier 56 36 0 31 Dec 2021
Transformers Can Do Bayesian Inference Samuel G. Müller Noah Hollmann Sebastian Pineda Arango Josif Grabocka Frank Hutter BDL UQCV 62 160 0 20 Dec 2021
Multi-Step Budgeted Bayesian Optimization with Unknown Evaluation Costs Raul Astudillo Daniel R. Jiang Maximilian Balandat E. Bakshy P. Frazier 39 18 0 12 Nov 2021
Bayesian Optimisation for Sequential Experimental Design with Applications in Additive Manufacturing Mimi Zhang Andrew C. Parnell D. Brabazon A. Benavoli 38 9 0 27 Jul 2021
Attentive Neural Processes and Batch Bayesian Optimization for Scalable Calibration of Physics-Informed Digital Twins Ankush Chakrabarty Gordon Wichern C. Laughman 52 7 0 29 Jun 2021
Repulsive Deep Ensembles are Bayesian Francesco DÁngelo Vincent Fortuin UQCV BDL 76 99 0 22 Jun 2021
High-Dimensional Bayesian Optimisation with Variational Autoencoders and Deep Metric Learning Antoine Grosnit Rasul Tutunov A. Maraval Ryan-Rhys Griffiths Alexander I. Cowen-Rivers ... Wenlong Lyu Zhitang Chen Jun Wang Jan Peters Haitham Bou-Ammar BDL DRL 45 60 0 07 Jun 2021
Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020 Ryan Turner David Eriksson M. McCourt J. Kiili Eero Laaksonen Zhen Xu Isabelle M Guyon BDL 48 291 0 20 Apr 2021
Neural Process for Black-Box Model Optimization Under Bayesian Framework Zhongkai Shangguan Lei Lin Wencheng Wu Beilei Xu 29 11 0 03 Apr 2021
High-Dimensional Bayesian Optimization with Sparse Axis-Aligned Subspaces David Eriksson M. Jankowiak 54 139 0 27 Feb 2021
Bayesian Transformer Language Models for Speech Recognition Boyang Xue Jianwei Yu Junhao Xu Shansong Liu Shoukang Hu Zi Ye Mengzhe Geng Xunying Liu Helen Meng BDL 81 27 0 09 Feb 2021
GIBBON: General-purpose Information-Based Bayesian OptimisatioN Henry B. Moss David S. Leslie Javier I. González Paul Rayson 56 43 0 05 Feb 2021
Training data-efficient image transformers & distillation through attention Hugo Touvron Matthieu Cord Matthijs Douze Francisco Massa Alexandre Sablayrolles Hervé Jégou ViT 273 6,657 0 23 Dec 2020
Are we Forgetting about Compositional Optimisers in Bayesian Optimisation? Antoine Grosnit Alexander I. Cowen-Rivers Rasul Tutunov Ryan-Rhys Griffiths Jun Wang Haitham Bou-Ammar 36 14 0 15 Dec 2020
Transforming Gaussian Processes With Normalizing Flows Juan Maroñas Oliver Hamelijnck Jeremias Knoblauch Theodoros Damoulas 71 34 0 03 Nov 2020
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 317 40,217 0 22 Oct 2020
BOSS: Bayesian Optimization over String Spaces Henry B. Moss Daniel Beck Javier I. González David S. Leslie Paul Rayson 21 68 0 02 Oct 2020
Uncertainty Quantification and Deep Ensembles R. Rahaman Alexandre Hoang Thiery UQCV 26 147 0 17 Jul 2020
Hands-on Bayesian Neural Networks -- a Tutorial for Deep Learning Users Laurent Valentin Jospin Wray Buntine F. Boussaïd Hamid Laga Bennamoun OOD BDL UQCV 63 620 0 14 Jul 2020
Efficient Nonmyopic Bayesian Optimization via One-Shot Multi-Step Trees Shali Jiang Daniel R. Jiang Maximilian Balandat Brian Karrer Jacob R. Gardner Roman Garnett 35 44 0 29 Jun 2020
Sample-Efficient Optimization in the Latent Space of Deep Generative Models via Weighted Retraining Austin Tripp Erik A. Daxberger José Miguel Hernández-Lobato MedIm 51 139 0 16 Jun 2020
Learning Texture Transformer Network for Image Super-Resolution Fuzhi Yang Huan Yang Jianlong Fu Hongtao Lu B. Guo SupR ViT 54 719 0 07 Jun 2020
Deeply Uncertain: Comparing Methods of Uncertainty Quantification in Deep Learning Algorithms J. Caldeira Brian D. Nord BDL UQCV UD 62 81 0 22 Apr 2020
Bayesian Deep Learning and a Probabilistic Perspective of Generalization A. Wilson Pavel Izmailov UQCV BDL OOD 41 649 0 20 Feb 2020
Decision-Making with Auto-Encoding Variational Bayes Romain Lopez Pierre Boyeau Nir Yosef Michael I. Jordan Jeffrey Regier BDL 182 10,591 0 17 Feb 2020
Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning Arsenii Ashukha Alexander Lyzhov Dmitry Molchanov Dmitry Vetrov UQCV FedML 57 314 0 15 Feb 2020
Re-Examining Linear Embeddings for High-Dimensional Bayesian Optimization Benjamin Letham Roberto Calandra Akshara Rai E. Bakshy 89 113 0 31 Jan 2020
AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty Dan Hendrycks Norman Mu E. D. Cubuk Barret Zoph Justin Gilmer Balaji Lakshminarayanan OOD UQCV 75 1,293 0 05 Dec 2019
Deep Ensembles: A Loss Landscape Perspective Stanislav Fort Huiyi Hu Balaji Lakshminarayanan OOD UQCV 65 624 0 05 Dec 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 390 24,160 0 26 Jul 2019
Evaluating Scalable Bayesian Deep Learning Methods for Robust Computer Vision Fredrik K. Gustafsson Martin Danelljan Thomas B. Schon OOD UQCV BDL 53 298 0 04 Jun 2019
Deep Neural Architecture Search with Deep Graph Bayesian Optimization Lizheng Ma Jiaxu Cui Bo Yang AI4CE BDL 21 49 0 14 May 2019
Cross-Modal Self-Attention Network for Referring Image Segmentation Linwei Ye Mrigank Rochan Zhi Liu Yang Wang EgoV 18 472 0 09 Apr 2019
VideoBERT: A Joint Model for Video and Language Representation Learning Chen Sun Austin Myers Carl Vondrick Kevin Patrick Murphy Cordelia Schmid VLM SSL 39 1,238 0 03 Apr 2019
Variational Bayesian Optimal Experimental Design Adam Foster M. Jankowiak Eli Bingham Paul Horsfall Yee Whye Teh Tom Rainforth Noah D. Goodman 50 135 0 13 Mar 2019
Attentive Neural Processes Hyunjik Kim A. Mnih Jonathan Richard Schwarz M. Garnelo S. M. Ali Eslami Dan Rosenbaum Oriol Vinyals Yee Whye Teh 77 436 0 17 Jan 2019
Bayesian Layers: A Module for Neural Network Uncertainty Dustin Tran Michael W. Dusenberry Mark van der Wilk Danijar Hafner UQCV BDL 89 121 0 10 Dec 2018
Neural Processes M. Garnelo Jonathan Richard Schwarz Dan Rosenbaum Fabio Viola Danilo Jimenez Rezende S. M. Ali Eslami Yee Whye Teh BDL UQCV GP 58 511 0 04 Jul 2018
Conditional Neural Processes M. Garnelo Dan Rosenbaum Chris J. Maddison Tiago Ramalho D. Saxton Murray Shanahan Yee Whye Teh Danilo Jimenez Rezende S. M. Ali Eslami UQCV BDL 48 688 0 04 Jul 2018
A Distributional Perspective on Reinforcement Learning Marc G. Bellemare Will Dabney Rémi Munos OffRL 69 1,497 0 21 Jul 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 430 129,831 0 12 Jun 2017
Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles Balaji Lakshminarayanan Alexander Pritzel Charles Blundell UQCV BDL 468 5,748 0 05 Dec 2016
Automatic chemical design using a data-driven continuous representation of molecules Rafael Gómez-Bombarelli Jennifer N. Wei David Duvenaud José Miguel Hernández-Lobato Benjamín Sánchez-Lengeling Dennis Sheberla J. Aguilera-Iparraguirre Timothy D. Hirzel Ryan P. Adams Alán Aspuru-Guzik 3DV 114 2,911 0 07 Oct 2016
GLASSES: Relieving The Myopia Of Bayesian Optimisation Javier I. González Michael A. Osborne Neil D. Lawrence 44 119 0 21 Oct 2015
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning Y. Gal Zoubin Ghahramani UQCV BDL 450 9,233 0 06 Jun 2015
Weight Uncertainty in Neural Networks Charles Blundell Julien Cornebise Koray Kavukcuoglu Daan Wierstra UQCV BDL 107 1,878 0 20 May 2015
Kernel Interpolation for Scalable Structured Gaussian Processes (KISS-GP) A. Wilson H. Nickisch GP 59 512 0 03 Mar 2015
Scalable Bayesian Optimization Using Deep Neural Networks Jasper Snoek Oren Rippel Kevin Swersky Ryan Kiros N. Satish N. Sundaram Md. Mostofa Ali Patwary P. Prabhat Ryan P. Adams BDL UQCV 64 1,039 0 19 Feb 2015
Gaussian Processes for Big Data J. Hensman Nicolò Fusi Neil D. Lawrence GP 77 1,226 0 26 Sep 2013