How Generalizable Is My Behavior Cloning Policy? A Statistical Approach
to Trustworthy Performance Evaluation

How Generalizable Is My Behavior Cloning Policy? A Statistical Approach to Trustworthy Performance Evaluation

8 May 2024

Joseph A. Vincent

Haruki Nishimura

Paarth Shah

Papers citing "How Generalizable Is My Behavior Cloning Policy? A Statistical Approach to Trustworthy Performance Evaluation"

12 / 12 papers shown

Title
Real-is-Sim: Bridging the Sim-to-Real Gap with a Dynamic Digital Twin for Real-World Robot Policy Evaluation Jad Abou-Chakra Lingfeng Sun Krishan Rana Brandon B. May Karl Schmeckpeper M. Minniti Laura Herlant OffRL 137 0 0 04 Apr 2025
Is Your Imitation Learning Policy Better than Mine? Policy Comparison with Near-Optimal Stopping David Snyder Asher Hancock Apurva Badithela Emma Dixon Patrick "Tree" Miller Rares Ambrus Anirudha Majumdar Masha Itkina Haruki Nishimura OffRL 82 1 0 14 Mar 2025
Efficient Evaluation of Multi-Task Robot Policies With Active Experiment Selection Abrar Anwar Rohan Gupta Zain Merchant Sayan Ghosh Willie Neiswanger Jesse Thomason OffRL 67 1 0 14 Feb 2025
Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progress Christopher Agia Rohan Sinha Jingyun Yang Zi-ang Cao Rika Antonova Marco Pavone Jeannette Bohg 28 7 0 06 Oct 2024
Robots that Suggest Safe Alternatives Hyun Joe Jeong Andrea V. Bajcsy Andrea Bajcsy OffRL 43 1 0 15 Sep 2024
Robot Learning as an Empirical Science: Best Practices for Policy Evaluation H. Kress-Gazit Kunimatsu Hashimoto Naveen Kuppuswamy Paarth Shah Phoebe Horgan Gordon Richardson Siyuan Feng Benjamin Burchfiel 34 5 0 14 Sep 2024
Contrast Sets for Evaluating Language-Guided Robot Policies Abrar Anwar Rohan Gupta Jesse Thomason 32 3 0 19 Jun 2024
Explore until Confident: Efficient Exploration for Embodied Question Answering Allen Z. Ren Jaden Clark Anushri Dixit Masha Itkina Anirudha Majumdar Dorsa Sadigh 42 28 0 23 Mar 2024
Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation Zipeng Fu Tony Zhao Chelsea Finn 116 288 0 04 Jan 2024
Foundation Models in Robotics: Applications, Challenges, and the Future Roya Firoozi Johnathan Tucker Stephen Tian Anirudha Majumdar Jiankai Sun ... Brian Ichter Danny Driess Jiajun Wu Cewu Lu Mac Schwager LM&Ro AI4CE LRM VLM 37 140 0 13 Dec 2023
Guarantees on Robot System Performance Using Stochastic Simulation Rollouts Joseph A. Vincent Aaron O. Feldman Mac Schwager 43 6 0 19 Sep 2023
Sample-Efficient Safety Assurances using Conformal Prediction Rachel Luo Shengjia Zhao Jonathan Kuck Boris Ivanovic Silvio Savarese Edward Schmerling Marco Pavone 58 56 0 28 Sep 2021