Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

19 April 2021

Papers citing "Multi-Modal Fusion Transformer for End-to-End Autonomous Driving"

50 / 256 papers shown

Title
On the Choice of Data for Efficient Training and Validation of End-to-End Driving Models Marvin Klingner Konstantin Müller Mona Mirzaie Jasmin Breitenstein Jan-Aike Termöhlen Tim Fingscheidt 25 4 0 01 Jun 2022
TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving Kashyap Chitta Aditya Prakash Bernhard Jaeger Zehao Yu Katrin Renz Andreas Geiger ViT 104 295 0 31 May 2022
Multi-Task Learning with Multi-Query Transformer for Dense Prediction Yangyang Xu Xiangtai Li Haobo Yuan Yibo Yang Lefei Zhang ViT 28 45 0 28 May 2022
Exploring Map-based Features for Efficient Attention-based Vehicle Motion Prediction Carlos Gómez-Huélamo Marcos V. Conde Miguel Ortiz 29 6 0 25 May 2022
Learning to Drive Using Sparse Imitation Reinforcement Learning Yuci Han Alper Yilmaz 23 1 0 24 May 2022
Emergent Visual Sensors for Autonomous Vehicles You Li Julien Moreau J. Ibañez-Guzmán 42 28 0 19 May 2022
POViT: Vision Transformer for Multi-objective Design and Characterization of Nanophotonic Devices Xinyu Chen Renjie Li Yueyao Yu Yuanwen Shen Wenye Li Zhaoyu Zhang Yin Zhang ViT 22 1 0 17 May 2022
Transformers in 3D Point Clouds: A Survey Dening Lu Qian Xie Mingqiang Wei Kyle Gao Linlin Xu Jonathan Li 3DPC ViT 32 49 0 16 May 2022
NMR: Neural Manifold Representation for Autonomous Driving U. R. Nair Sarthak Sharma M. S. Menon Srikanth Vidapanakal 12 1 0 11 May 2022
Should attention be all we need? The epistemic and ethical implications of unification in machine learning N. Fishman Leif Hancox-Li 25 10 0 09 May 2022
Learn-to-Race Challenge 2022: Benchmarking Safe Learning and Cross-domain Generalisation in Autonomous Racing Jonathan M Francis Bingqing Chen Siddha Ganju Sidharth Kathpal Jyotish Poonganam ... Ivan Zhukov Max Kumskoy Anirudh Koul Jean Oh Eric Nyberg 19 12 0 05 May 2022
COOPERNAUT: End-to-End Driving with Cooperative Perception for Networked Vehicles Jiaxun Cui Hang Qiu Dian Chen Peter Stone Yuke Zhu 19 112 0 04 May 2022
KING: Generating Safety-Critical Driving Scenarios for Robust Imitation via Kinematics Gradients Niklas Hanselmann Katrin Renz Kashyap Chitta Apratim Bhattacharyya Andreas Geiger 29 87 0 28 Apr 2022
TranSiam: Fusing Multimodal Visual Features Using Transformer for Medical Image Segmentation Xia Li Shiqiang Ma Jijun Tang Fei Guo ViT MedIm 17 9 0 26 Apr 2022
Diverse Instance Discovery: Vision-Transformer for Instance-Aware Multi-Label Image Recognition Yunqing Hu Xuan Jin Yin Zhang Haiwen Hong Jingfeng Zhang Feihu Yan Yuan He Hui Xue ViT 11 1 0 22 Apr 2022
SelfD: Self-Learning Large-Scale Driving Policies From the Web Jimuyang Zhang Ruizhao Zhu Eshed Ohn-Bar 19 20 0 21 Apr 2022
Multimodal Token Fusion for Vision Transformers Yikai Wang Xinghao Chen Lele Cao Wen-bing Huang Gang Hua Yunhe Wang ViT 44 166 0 19 Apr 2022
Deep Relation Learning for Regression and Its Application to Brain Age Estimation Sheng He Yanfang Feng P. E. Grant Yangming Ou 3DH 32 30 0 13 Apr 2022
Probabilistic Compositional Embeddings for Multimodal Image Retrieval Andrei Neculai Yanbei Chen Zeynep Akata CoGe 25 31 0 12 Apr 2022
End-to-end Autonomous Driving with Semantic Depth Cloud Mapping and Multi-agent Oskar Natan J. Miura 25 34 0 12 Apr 2022
Glass Segmentation with RGB-Thermal Image Pairs Dong Huo Jian Wang Yiming Qian Yee-Hong Yang ISeg 27 40 0 12 Apr 2022
Online No-regret Model-Based Meta RL for Personalized Navigation Yuda Song Ye Yuan Wen Sun Kris M. Kitani 36 0 0 05 Apr 2022
In Rain or Shine: Understanding and Overcoming Dataset Bias for Improving Robustness Against Weather Corruptions for Autonomous Vehicles Aboli Rajan Marathe Rahee Walambe K. Kotecha 15 7 0 03 Apr 2022
Learning from All Vehicles Dian Chen Philipp Krahenbuhl 42 176 0 22 Mar 2022
Multi-Modal Learning for AU Detection Based on Multi-Head Fused Transformers Xiang Zhang L. Yin ViT 24 12 0 22 Mar 2022
PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmark Li Chen Chonghao Sima Yang Li Zehan Zheng Jiajie Xu ... Hongyang Li Conghui He Jianping Shi Yu Qiao Junchi Yan 3DPC ViT 33 180 0 21 Mar 2022
CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers Jiaming Zhang Huayao Liu Kailun Yang Xinxin Hu Ruiping Liu Rainer Stiefelhagen ViT 31 299 0 09 Mar 2022
Multi-modal Brain Tumor Segmentation via Missing Modality Synthesis and Modality-level Attention Fusion Ziqi Huang Li Lin Pujin Cheng Linkai Peng Xiaoying Tang MedIm 27 10 0 09 Mar 2022
Dynamic MLP for Fine-Grained Image Classification by Leveraging Geographical and Temporal Information Lingfeng Yang Xiang Li Renjie Song Borui Zhao J. Tao Shihao Zhou Jiajun Liang Jian Yang 26 37 0 07 Mar 2022
Spatiotemporal Transformer Attention Network for 3D Voxel Level Joint Segmentation and Motion Prediction in Point Cloud Zhensong Wei Xuewei Qi Zhengwei Bai Guoyuan Wu S. Nayak Peng Hao Matthew J. Barth Yongkang Liu K. Oguchi ViT 3DPC 27 4 0 28 Feb 2022
Multi-view and Multi-modal Event Detection Utilizing Transformer-based Multi-sensor fusion Masahiro Yasuda Yasunori Ohishi Shoichiro Saito N. Harada 38 13 0 18 Feb 2022
Autonomous Vehicles: Open-Source Technologies, Considerations, and Development Oussama Saoudi Ishwar Singh H. Mahyar VLM 39 4 0 25 Jan 2022
Video Transformers: A Survey Javier Selva A. S. Johansen Sergio Escalera Kamal Nasrollahi T. Moeslund Albert Clapés ViT 22 103 0 16 Jan 2022
EPNet++: Cascade Bi-directional Fusion for Multi-Modal 3D Object Detection Zhe Liu Tengteng Huang Binglin Li Xiwu Chen Xi Wang Xiang Bai 3DPC 18 100 0 21 Dec 2021
Multi-modal Text Recognition Networks: Interactive Enhancements between Visual and Semantic Features Byeonghu Na Yoonsik Kim Sungrae Park 46 54 0 30 Nov 2021
TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions Jeya Maria Jose Valanarasu R. Yasarla Vishal M. Patel ViT 54 276 0 29 Nov 2021
ArchRepair: Block-Level Architecture-Oriented Repairing for Deep Neural Networks Hua Qi Zhijie Wang Qing-Wu Guo Jianlang Chen Felix Juefei Xu L. Ma Jianjun Zhao AAML AI4CE 30 16 0 26 Nov 2021
GRI: General Reinforced Imitation and its Application to Vision-Based Autonomous Driving Raphael Chekroun Marin Toromanoff Sascha Hornauer Fabien Moutarde 36 60 0 16 Nov 2021
Small or Far Away? Exploiting Deep Super-Resolution and Altitude Data for Aerial Animal Surveillance Mowen Xue Theo Greenslade Majid Mirmehdi T. Burghardt 19 6 0 12 Nov 2021
A Survey of Visual Transformers Yang Liu Yao Zhang Yixin Wang Feng Hou Jin Yuan Jiang Tian Yang Zhang Zhongchao Shi Jianping Fan Zhiqiang He 3DGS ViT 77 330 0 11 Nov 2021
Safe Autonomous Racing via Approximate Reachability on Ego-vision Bingqing Chen Jonathan M Francis Jean Oh Eric Nyberg Sylvia L. Herbert 56 14 0 14 Oct 2021
Adversarial Attack across Datasets Yunxiao Qin Yuanhao Xiong Jinfeng Yi Lihong Cao Cho-Jui Hsieh AAML 32 3 0 13 Oct 2021
Deep Federated Learning for Autonomous Driving A. Nguyen Tuong Khanh Long Do Minh-Ngoc Tran Binh X. Nguyen C. Duong T. Phan Erman Tjiputra Quang-Dieu Tran FedML 28 109 0 12 Oct 2021
Cross-modal Knowledge Distillation for Vision-to-Sensor Action Recognition Jianyuan Ni Raunak Sarbajna Yang Liu A. Ngu Yan Yan HAI 24 36 0 08 Oct 2021
NEAT: Neural Attention Fields for End-to-End Autonomous Driving Kashyap Chitta Aditya Prakash Andreas Geiger 3DPC 44 208 0 09 Sep 2021
TransAction: ICL-SJTU Submission to EPIC-Kitchens Action Anticipation Challenge 2021 Xiao Gu Jianing Qiu Yao Guo Benny Lo Guang-Zhong Yang 19 12 0 28 Jul 2021
Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformers Ruihan Yang Minghao Zhang Nicklas Hansen Huazhe Xu Xiaolong Wang OffRL 18 102 0 08 Jul 2021
NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles Holger Caesar Juraj Kabzan Kok Seang Tan Whye Kit Fong Eric M. Wolff A. Lang L. Fletcher Oscar Beijbom Sammy Omari 35 273 0 22 Jun 2021
Improving Multi-Modal Learning with Uni-Modal Teachers Chenzhuang Du Tingle Li Yichen Liu Zixin Wen Tianyu Hua Yue Wang Hang Zhao 29 45 0 21 Jun 2021
Learning to drive from a world on rails Di Chen V. Koltun Philipp Krahenbuhl 98 116 0 03 May 2021