v1v2v3v4 (latest)

Fast-Slow Test-Time Adaptation for Online Vision-and-Language Navigation

22 November 2023

ArXiv (abs)PDF HTML Github (29★)

Papers citing "Fast-Slow Test-Time Adaptation for Online Vision-and-Language Navigation"

47 / 47 papers shown

Title
Navigation World Models Amir Bar G. Zhou Danny Tran Trevor Darrell Yann LeCun VGen EgoV 177 33 0 04 Dec 2024
March in Chat: Interactive Prompting for Remote Embodied Referring Expression Yanyuan Qiao Yuankai Qi Zheng Yu Qingbin Liu Qi Wu LM&Ro 86 34 0 20 Aug 2023
DREAMWALKER: Mental Planning for Continuous Vision-Language Navigation Hanqing Wang Wei Liang Luc Van Gool Wenguan Wang LM&Ro 78 32 0 14 Aug 2023
Sharpness-Aware Gradient Matching for Domain Generalization Pengfei Wang Zhaoxiang Zhang Zhen Lei Lei Zhang 66 95 0 18 Mar 2023
EcoTTA: Memory-Efficient Continual Test-time Adaptation via Self-distilled Regularization Jun S. Song Jungsoo Lee In So Kweon Sungha Choi TTA 76 94 0 03 Mar 2023
Temporal Coherent Test-Time Optimization for Robust Video Classification Chenyu Yi Siyuan Yang Yufei Wang Haoliang Li Yap-Peng Tan Alex C. Kot TTA 58 13 0 28 Feb 2023
Graph based Environment Representation for Vision-and-Language Navigation in Continuous Environments Ting Wang Zongkai Wu Feiyu Yao Donglin Wang 120 5 0 11 Jan 2023
Robust Mean Teacher for Continual and Gradual Test-Time Adaptation Mario Döbler Robert A. Marsden Bin Yang OOD TTA 66 90 0 23 Nov 2022
A New Path: Scaling Vision-and-Language Navigation with Synthetic Instructions and Imitation Learning Aishwarya Kamath Peter Anderson Su Wang Jing Yu Koh Alexander Ku Austin Waters Yinfei Yang Jason Baldridge Zarana Parekh LM&Ro 95 48 0 06 Oct 2022
Anticipating the Unseen Discrepancy for Vision and Language Navigation Yujie Lu Huiliang Zhang Ping Nie Weixi Feng Wenda Xu Xinze Wang William Yang Wang 83 1 0 10 Sep 2022
Learning from Unlabeled 3D Environments for Vision-and-Language Navigation Shizhe Chen Pierre-Louis Guhur Makarand Tapaswi Cordelia Schmid Ivan Laptev 129 48 0 24 Aug 2022
Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environments Jacob Krantz Stefan Lee 45 38 0 20 Apr 2022
Reinforced Structured State-Evolution for Vision-Language Navigation Jinyu Chen Chen Gao Erli Meng Qiong Zhang Si Liu LM&Ro 58 42 0 20 Apr 2022
Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scale Ram Ramrakhya Eric Undersander Dhruv Batra Abhishek Das LM&Ro 122 119 0 07 Apr 2022
Efficient Test-Time Model Adaptation without Forgetting Shuaicheng Niu Jiaxiang Wu Yifan Zhang Yaofo Chen S. Zheng P. Zhao Mingkui Tan OOD VLM TTA 87 350 0 06 Apr 2022
EnvEdit: Environment Editing for Vision-and-Language Navigation Jialu Li Hao Tan Joey Tianyi Zhou 101 83 0 29 Mar 2022
Continual Test-Time Domain Adaptation Qin Wang Olga Fink Luc Van Gool Dengxin Dai OOD TTA 110 431 0 25 Mar 2022
HOP: History-and-Order Aware Pre-training for Vision-and-Language Navigation Yanyuan Qiao Yuankai Qi Yicong Hong Zheng Yu Peifeng Wang Qi Wu AI4TS 92 76 0 22 Mar 2022
Cross-modal Map Learning for Vision and Language Navigation G. Georgakis Karl Schmeckpeper Karan Wanchoo Soham Dan E. Miltsakaki Dan Roth Kostas Daniilidis 87 66 0 10 Mar 2022
Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigation Shizhe Chen Pierre-Louis Guhur Makarand Tapaswi Cordelia Schmid Ivan Laptev LM&Ro 92 148 0 23 Feb 2022
Parameter-free Online Test-time Adaptation Malik Boudiaf Romain Mueller Ismail Ben Ayed Luca Bertinetto TTA 64 151 0 15 Jan 2022
Less is More: Generating Grounded Navigation Instructions from Landmarks Su Wang Ceslee Montgomery Jordi Orbay Vighnesh Birodkar Aleksandra Faust Izzeddin Gur Natasha Jaques Austin Waters Jason Baldridge Peter Anderson 114 64 0 25 Nov 2021
Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environments Sonia Raychaudhuri Saim Wani Shivansh Patel Unnat Jain Angel X. Chang LM&Ro 73 54 0 30 Sep 2021
SASRA: Semantically-aware Spatio-temporal Reasoning Agent for Vision-and-Language Navigation in Continuous Environments Muhammad Zubair Irshad Niluthpol Chowdhury Mithun Zachary Seymour Han-Pang Chiu S. Samarasekera Rakesh Kumar LM&Ro 73 51 0 26 Aug 2021
Airbert: In-domain Pretraining for Vision-and-Language Navigation Pierre-Louis Guhur Makarand Tapaswi Shizhe Chen Ivan Laptev Cordelia Schmid LM&Ro 52 144 0 20 Aug 2021
Domain Generalization via Gradient Surgery Lucas Mansilla Rodrigo Echeveste Diego H. Milone Enzo Ferrante OOD 75 84 0 03 Aug 2021
Neighbor-view Enhanced Model for Vision and Language Navigation Dongyan An Yuankai Qi Yan Huang Qi Wu Liang Wang Tieniu Tan LM&Ro 80 69 0 15 Jul 2021
Vision-Language Navigation with Random Environmental Mixup Chong Liu Fengda Zhu Xiaojun Chang Xiaodan Liang Zongyuan Ge Yi-Dong Shen LM&Ro 102 87 0 15 Jun 2021
The Road to Know-Where: An Object-and-Room Informed Sequential BERT for Indoor Vision-Language Navigation Yuankai Qi Zizheng Pan Yicong Hong Ming-Hsuan Yang Anton Van Den Hengel Qi Wu LM&Ro 70 69 0 09 Apr 2021
SOON: Scenario Oriented Object Navigation with Graph-based Exploration Fengda Zhu Xiwen Liang Yi Zhu Xiaojun Chang Xiaodan Liang 57 127 0 31 Mar 2021
Scene-Intuitive Agent for Remote Embodied Visual Grounding Xiangru Lin Guanbin Li Yizhou Yu LM&Ro 66 53 0 24 Mar 2021
Topological Planning with Transformers for Vision-and-Language Navigation Kevin Chen Junshen K. Chen Jo Chuang Nathan Tsoi Silvio Savarese LM&Ro 87 101 0 09 Dec 2020
A Recurrent Vision-and-Language BERT for Navigation Yicong Hong Qi Wu Yuankai Qi Cristian Rodriguez-Opazo Stephen Gould LM&Ro 104 303 0 26 Nov 2020
Language and Visual Entity Relationship Graph for Agent Navigation Yicong Hong Cristian Rodriguez-Opazo Yuankai Qi Qi Wu Stephen Gould LM&Ro 224 134 0 19 Oct 2020
Room-Across-Room: Multilingual Vision-and-Language Navigation with Dense Spatiotemporal Grounding Alexander Ku Peter Anderson Roma Patel Eugene Ie Jason Baldridge 96 315 0 15 Oct 2020
Towards Learning a Generic Agent for Vision-and-Language Navigation via Pre-training Weituo Hao Chunyuan Li Xiujun Li Lawrence Carin Jianfeng Gao LM&Ro 90 282 0 25 Feb 2020
Gradient Surgery for Multi-Task Learning Tianhe Yu Saurabh Kumar Abhishek Gupta Sergey Levine Karol Hausman Chelsea Finn 189 1,230 0 19 Jan 2020
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks Fengda Zhu Yi Zhu Xiaojun Chang Xiaodan Liang LRM 90 243 0 18 Nov 2019
Chasing Ghosts: Instruction Following as Bayesian State Tracking Peter Anderson Ayush Shrivastava Devi Parikh Dhruv Batra Stefan Lee 84 74 0 03 Jul 2019
REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environments Yuankai Qi Qi Wu Peter Anderson Xinze Wang Wenjie Wang Chunhua Shen Anton Van Den Hengel LM&Ro 110 330 0 23 Apr 2019
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout Hao Tan Licheng Yu Joey Tianyi Zhou SSL 91 322 0 08 Apr 2019
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation Liyiming Ke Xiujun Li Yonatan Bisk Ari Holtzman Zhe Gan Jingjing Liu Jianfeng Gao Yejin Choi S. Srinivasa 96 169 0 06 Mar 2019
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation Chih-Yao Ma Zuxuan Wu G. Al-Regib Caiming Xiong Z. Kira LM&Ro 85 175 0 05 Mar 2019
Vision-based Navigation with Language-based Assistance via Imitation Learning with Indirect Intervention Khanh Nguyen Debadeepta Dey Chris Brockett W. Dolan LM&Ro 84 131 0 10 Dec 2018
Adapting Auxiliary Losses Using Gradient Similarity Yunshu Du Wojciech M. Czarnecki Siddhant M. Jayakumar Mehrdad Farajtabar Razvan Pascanu Balaji Lakshminarayanan 96 158 0 05 Dec 2018
Speaker-Follower Models for Vision-and-Language Navigation Daniel Fried Ronghang Hu Volkan Cirik Anna Rohrbach Jacob Andreas Louis-Philippe Morency Taylor Berg-Kirkpatrick Kate Saenko Dan Klein Trevor Darrell LM&Ro LRM 319 505 0 07 Jun 2018
A Tutorial on Principal Component Analysis Jonathon Shlens 100 2,500 0 03 Apr 2014