v1v2 (latest)

Bayesian Off-Policy Evaluation and Learning for Large Action Spaces

22 February 2024

Imad Aouali

Victor-Emmanuel Brunel

Papers citing "Bayesian Off-Policy Evaluation and Learning for Large Action Spaces"

41 / 41 papers shown

Title
Doubly Robust Fusion of Many Treatments for Policy Learning Ke Zhu Jianing Chu I. Lipkovich Wenyu Ye Shu Yang 122 0 0 12 May 2025
Unified PAC-Bayesian Study of Pessimism for Offline Policy Learning with Regularized Importance Sampling Imad Aouali Victor-Emmanuel Brunel David Rohde Anna Korba OffRL 66 2 0 05 Jun 2024
Logarithmic Smoothing for Pessimistic Off-Policy Evaluation, Selection and Learning Otmane Sakhi Imad Aouali Pierre Alquier Nicolas Chopin OffRL 73 5 0 23 May 2024
Diffusion Models Meet Contextual Bandits with Large Action Spaces Imad Aouali DiffM 54 4 0 15 Feb 2024
Prior-Dependent Allocations for Bayesian Fixed-Budget Best-Arm Identification in Structured Bandits Nicolas Nguyen Imad Aouali András Gyorgy Claire Vernade 89 2 0 08 Feb 2024
Marginal Density Ratio for Off-Policy Evaluation in Contextual Bandits Muhammad Faaiz Taufiq Arnaud Doucet Rob Cornish Jean-François Ton OffRL 90 8 0 03 Dec 2023
Off-Policy Evaluation for Large Action Spaces via Policy Convolution Noveen Sachdeva Lequn Wang Dawen Liang Nathan Kallus Julian McAuley OffRL 70 14 0 24 Oct 2023
Value-aware Importance Weighting for Off-policy Reinforcement Learning Kristopher De Asis Eric Graves R. Sutton OffRL 58 1 0 27 Jun 2023
Oracle-Efficient Pessimism: Offline Policy Optimization in Contextual Bandits Lequn Wang A. Krishnamurthy Aleksandrs Slivkins OffRL 94 10 0 13 Jun 2023
Exponential Smoothing for Off-Policy Learning Imad Aouali Victor-Emmanuel Brunel D. Rohde Anna Korba OffRL 67 14 0 25 May 2023
Off-Policy Evaluation for Large Action Spaces via Conjunct Effect Modeling Yuta Saito Qingyang Ren Thorsten Joachims CML OffRL 59 26 0 14 May 2023
Learning Action Embeddings for Off-Policy Evaluation Matej Cief Jacek Golebiowski Philipp Schmidt Ziawasch Abedjan Artur Bekasov OffRL 34 5 0 06 May 2023
Multi-Task Off-Policy Learning from Bandit Feedback Joey Hong Branislav Kveton S. Katariya Manzil Zaheer Mohammad Ghavamzadeh OffRL 74 10 0 09 Dec 2022
PAC-Bayesian Offline Contextual Bandits With Guarantees Otmane Sakhi Pierre Alquier Nicolas Chopin OffRL 139 16 0 24 Oct 2022
Probabilistic Rank and Reward: A Scalable Model for Slate Recommendation Imad Aouali Achraf Ait Sidi Hammou Otmane Sakhi D. Rohde Flavian Vasile OffRL 42 7 0 10 Aug 2022
Contextual Bandits with Large Action Spaces: Made Practical Yinglun Zhu Dylan J. Foster John Langford Paul Mineiro 83 30 0 12 Jul 2022
Mixed-Effect Thompson Sampling Imad Aouali Branislav Kveton S. Katariya OffRL 66 12 0 30 May 2022
KuaiRec: A Fully-observed Dataset and Insights for Evaluating Recommender Systems Chongming Gao Shijun Li Wenqiang Lei Jiawei Chen Biao Li Peng Jiang Xiangnan He Jiaxin Mao Tat-Seng Chua 85 144 0 22 Feb 2022
Off-Policy Evaluation for Large Action Spaces via Embeddings Yuta Saito Thorsten Joachims OffRL 68 46 0 13 Feb 2022
Is Pessimism Provably Efficient for Offline RL? Ying Jin Zhuoran Yang Zhaoran Wang OffRL 187 360 0 30 Dec 2020
BLOB : A Probabilistic Model for Recommendation that Combines Organic and Bandit Signals Otmane Sakhi Stephen Bonner D. Rohde Flavian Vasile 65 37 0 28 Aug 2020
Confident Off-Policy Evaluation and Selection through Self-Normalized Importance Weighting Ilja Kuzborskij Claire Vernade András Gyorgy Csaba Szepesvári OffRL 74 47 0 18 Jun 2020
Off-policy Bandits with Deficient Support Noveen Sachdeva Yi-Hsun Su Thorsten Joachims OffRL 181 78 0 16 Jun 2020
Doubly robust off-policy evaluation with shrinkage Yi-Hsun Su Maria Dimakopoulou A. Krishnamurthy Miroslav Dudík OffRL 56 109 0 22 Jul 2019
Importance Resampling for Off-policy Prediction M. Schlegel Wesley Chung Daniel Graves Jian Qian Martha White OffRL 47 41 0 11 Jun 2019
On the Convergence of the Laplace Approximation and Noise-Level-Robustness of Laplace-based Monte Carlo Methods for Bayesian Inverse Problems C. Schillings Björn Sprungk Philipp Wacker 72 66 0 13 Jan 2019
Bayesian Counterfactual Risk Minimization Ben London Ted Sandler OffRL 36 33 0 29 Jun 2018
Importance Sampling Policy Evaluation with an Estimated Behavior Policy Josiah P. Hanna S. Niekum Peter Stone OffRL 54 68 0 04 Jun 2018
More Robust Doubly Robust Off-policy Evaluation Mehrdad Farajtabar Yinlam Chow Mohammad Ghavamzadeh OffRL 80 269 0 10 Feb 2018
Offline A/B testing for Recommender Systems Alexandre Gilotte Clément Calauzènes Thomas Nedelec A. Abraham Simon Dollé OffRL 89 222 0 22 Jan 2018
Optimal and Adaptive Off-policy Evaluation in Contextual Bandits Yu Wang Alekh Agarwal Miroslav Dudík OffRL 133 222 0 04 Dec 2016
Off-policy evaluation for slate recommendation Adith Swaminathan A. Krishnamurthy Alekh Agarwal Miroslav Dudík John Langford Damien Jose I. Zitouni CML OffRL 70 228 0 16 May 2016
Cascading Bandits for Large-Scale Recommendation Problems Shi Zong Hao Ni Kenny Sung Nan Rosemary Ke Zheng Wen Branislav Kveton 67 125 0 17 Mar 2016
Doubly Robust Policy Evaluation and Optimization Miroslav Dudík D. Erhan John Langford Lihong Li OffRL 194 290 0 10 Mar 2015
The lower tail of random quadratic forms, with applications to ordinary least squares and restricted eigenvalue properties R. Oliveira 87 101 0 10 Dec 2013
Learning to Optimize Via Posterior Sampling Daniel Russo Benjamin Van Roy 223 703 0 11 Jan 2013
Sample-efficient Nonstationary Policy Evaluation for Contextual Bandits Miroslav Dudík D. Erhan John Langford Lihong Li OffRL 159 38 0 16 Oct 2012
Thompson Sampling for Contextual Bandits with Linear Payoffs Shipra Agrawal Navin Goyal 207 1,006 0 15 Sep 2012
Counterfactual Reasoning and Learning Systems Léon Bottou J. Peters J. Q. Candela Denis Xavier Charles D. M. Chickering Elon Portugaly Dipankar Ray Patrice Y. Simard Edward Snelson CML OffRL 396 787 0 11 Sep 2012
Doubly Robust Policy Evaluation and Learning Miroslav Dudík John Langford Lihong Li OffRL 347 698 0 23 Mar 2011
A Contextual-Bandit Approach to Personalized News Article Recommendation Lihong Li Wei Chu John Langford Robert Schapire 473 2,957 0 28 Feb 2010