Hypergraph-Transformer (HGT) for Interactive Event Prediction in Laparoscopic and Robotic Surgery

3 February 2024

Daniela Rus

Papers citing "Hypergraph-Transformer (HGT) for Interactive Event Prediction in Laparoscopic and Robotic Surgery"

50 / 53 papers shown

Title
Tracking-Aware Deformation Field Estimation for Non-rigid 3D Reconstruction in Robotic Surgeries Zeqing Wang Han Fang Yihong Xu Yutong Ban MedIm 93 0 0 04 Mar 2025
Capabilities of Gemini Models in Medicine Khaled Saab Tao Tu Wei-Hung Weng Ryutaro Tanno David Stutz ... Christopher Semturs S. S. Mahdavi Juraj Gottweis Alan Karthikesalingam Vivek Natarajan ELM AI4MH LM&MA 67 175 0 29 Apr 2024
Latent Graph Representations for Critical View of Safety Assessment Aditya Murali Deepak Alapatt Pietro Mascagni Armine Vardazaryan Alain Garcia Nariaki Okamoto Didier Mutter N. Padoy MedIm 66 22 0 08 Dec 2022
Rendezvous in Time: An Attention-based Temporal Fusion approach for Surgical Triplet Recognition Saurav Sharma C. Nwoye Didier Mutter N. Padoy 65 21 0 30 Nov 2022
Towards Graph Representation Learning Based Surgical Workflow Anticipation Xiatian Zhang Noura Al Moubayed Hubert P. H. Shum 28 5 0 07 Aug 2022
Uncertainty estimation of pedestrian future trajectory using Bayesian approximation Anshul Nayak A. Eskandarian Zachary R. Doerzaph 39 22 0 04 May 2022
CholecTriplet2021: A benchmark challenge for surgical action triplet recognition C. Nwoye Deepak Alapatt Tong Yu Armine Vardazaryan Fangfang Xia ... Didier Mutter Pietro Mascagni B. Seeliger Cristians Gonzalez N. Padoy 37 53 0 10 Apr 2022
Concept Graph Neural Networks for Surgical Video Understanding Yutong Ban J. Eckhoff Thomas M. Ward Daniel A. Hashimoto O. Meireles Daniela Rus Guy Rosman NAI 62 18 0 27 Feb 2022
TIP: Task-Informed Motion Prediction for Intelligent Vehicles Xin Huang Guy Rosman A. Jasour Stephen G. McGill J. Leonard B. Williams 68 15 0 17 Oct 2021
Sample-Efficient Safety Assurances using Conformal Prediction Rachel Luo Shengjia Zhao Jonathan Kuck Boris Ivanovic Silvio Savarese Edward Schmerling Marco Pavone 182 58 0 28 Sep 2021
TSM: Temporal Shift Module for Efficient and Scalable Video Understanding on Edge Device Ji Lin Chuang Gan Kuan-Chieh Wang Song Han 69 64 0 27 Sep 2021
Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videos C. Nwoye Tong Yu Cristians Gonzalez B. Seeliger Pietro Mascagni Didier Mutter J. Marescaux N. Padoy 60 139 0 07 Sep 2021
Scene Transformer: A unified architecture for predicting multiple agent trajectories Jiquan Ngiam Benjamin Caine Vijay Vasudevan Zhengdong Zhang H. Chiang ... Ashish Venugopal David J. Weiss Benjamin Sapp Zhifeng Chen Jonathon Shlens 52 163 0 15 Jun 2021
SUPR-GAN: SUrgical PRediction GAN for Event Anticipation in Laparoscopic and Robotic Surgery Yutong Ban Guy Rosman J. Eckhoff Thomas M. Ward Daniel A. Hashimoto Taisei Kondo Hidekazu Iwaki O. Meireles Daniela Rus 57 15 0 10 May 2021
Emerging Properties in Self-Supervised Vision Transformers Mathilde Caron Hugo Touvron Ishan Misra Hervé Jégou Julien Mairal Piotr Bojanowski Armand Joulin 642 6,059 0 29 Apr 2021
Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Dataset Scott Ettinger Shuyang Cheng Benjamin Caine Chenxi Liu Hang Zhao ... Jiquan Ngiam Vijay Vasudevan Alexander McCauley Jonathon Shlens Drago Anguelov 180 560 0 20 Apr 2021
Temporal Memory Relation Network for Workflow Recognition from Surgical Video Yueming Jin Yonghao Long Cheng Chen Zixu Zhao Qi Dou Pheng-Ann Heng 61 91 0 30 Mar 2021
Trans-SVNet: Accurate Phase Recognition from Surgical Videos via Hybrid Embedding Aggregation Transformer Xiaojie Gao Yueming Jin Yonghao Long Qi Dou Pheng-Ann Heng MedIm 68 110 0 17 Mar 2021
Core Challenges of Social Robot Navigation: A Survey Christoforos Mavrogiannis Francesca Baldini Allan Wang Dapeng Zhao Pete Trautman Aaron Steinfeld Jean Oh 56 237 0 09 Mar 2021
"Train one, Classify one, Teach one" -- Cross-surgery transfer learning for surgical step recognition Daniel Neimark Omri Bar Maya Zohar Gregory Hager Dotan Asselmann 41 14 0 24 Feb 2021
Medical Transformer: Gated Axial-Attention for Medical Image Segmentation Jeya Maria Jose Valanarasu Poojan Oza Ilker Hacihaliloglu Vishal M. Patel ViT MedIm 103 985 0 21 Feb 2021
TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation Jieneng Chen Yongyi Lu Qihang Yu Xiangde Luo Ehsan Adeli Yan Wang Le Lu Alan Yuille Yuyin Zhou ViT MedIm 90 3,468 0 08 Feb 2021
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai ... Matthias Minderer G. Heigold Sylvain Gelly Jakob Uszkoreit N. Houlsby ViT 585 40,961 0 22 Oct 2020
Mastering Atari with Discrete World Models Danijar Hafner Timothy Lillicrap Mohammad Norouzi Jimmy Ba DRL 95 852 0 05 Oct 2020
daVinciNet: Joint Prediction of Motion and Surgical State in Robot-Assisted Surgery Yidan Qin Seyedshams Feyzabadi M. Allan J. W. Burdick M. Azizian 44 23 0 24 Sep 2020
How Neural Networks Extrapolate: From Feedforward to Graph Neural Networks Keyulu Xu Mozhi Zhang Jingling Li S. Du Ken-ichi Kawarabayashi Stefanie Jegelka MLT 101 312 0 24 Sep 2020
MATS: An Interpretable Trajectory Forecasting Representation for Planning and Control Boris Ivanovic Amine Elhafsi Guy Rosman Adrien Gaidon Marco Pavone 45 53 0 16 Sep 2020
Recognition of Instrument-Tissue Interactions in Endoscopic Videos via Action Triplets C. Nwoye Cristians Gonzalez Tong Yu Pietro Mascagni Didier Mutter J. Marescaux N. Padoy 49 81 0 10 Jul 2020
Deep Learning for Vision-based Prediction: A Survey Amir Rasouli 68 42 0 30 Jun 2020
A Review on Deep Learning Techniques for Video Prediction Sergiu Oprea P. Martinez-Gonzalez Alberto Garcia-Garcia John Alejandro Castro-Vargas S. Orts-Escolano Jose Garcia-Rodriguez Antonis Argyros 60 252 0 10 Apr 2020
CARPAL: Confidence-Aware Intent Recognition for Parallel Autonomy Xin Huang Stephen G. McGill Jonathan A. DeCastro L. Fletcher J. Leonard B. Williams Guy Rosman 72 6 0 18 Mar 2020
VSGNet: Spatial Attention Network for Detecting Human Object Interactions Using Graph Convolutions Oytun Ulutan A S M Iftekhar B. S. Manjunath 91 208 0 11 Mar 2020
Social-STGCNN: A Social Spatio-Temporal Graph Convolutional Neural Network for Human Trajectory Prediction Abduallah A. Mohamed Kun Qian Mohamed Elhoseiny Christian G. Claudel GNN 81 710 0 27 Feb 2020
Decision-Making with Auto-Encoding Variational Bayes Romain Lopez Pierre Boyeau Nir Yosef Michael I. Jordan Jeffrey Regier BDL 370 10,591 0 17 Feb 2020
DiversityGAN: Diversity-Aware Vehicle Motion Prediction via Latent Semantic Sampling Xin Huang Stephen G. McGill Jonathan A. DeCastro L. Fletcher J. Leonard B. Williams Guy Rosman GAN 111 77 0 28 Nov 2019
Human Motion Trajectory Prediction: A Survey Andrey Rudenko Luigi Palmieri Michael Herman Kris Kitani D. Gavrila Kai O. Arras 86 733 0 15 May 2019
Uncertainty-Aware Driver Trajectory Prediction at Urban Intersections Xin Huang Stephen G. McGill B. Williams L. Fletcher Guy Rosman 44 73 0 16 Jan 2019
Weakly Supervised Convolutional LSTM Approach for Tool Tracking in Laparoscopic Videos C. Nwoye Didier Mutter J. Marescaux N. Padoy 56 123 0 04 Dec 2018
Hypergraph Neural Networks Yifan Feng Haoxuan You Zizhao Zhang Rongrong Ji Yue Gao GNN 78 1,371 0 25 Sep 2018
Weakly-Supervised Learning for Tool Localization in Laparoscopic Videos Armine Vardazaryan Didier Mutter J. Marescaux N. Padoy 35 60 0 14 Jun 2018
Surgical Activity Recognition in Robot-Assisted Radical Prostatectomy using Deep Learning Aneeq Zia A. Hung Irfan Essa A. Jarc 39 50 0 01 Jun 2018
Probabilistically Safe Robot Planning with Confidence-Based Human Predictions J. F. Fisac Andrea V. Bajcsy Sylvia Herbert David Fridovich-Keil Steven H. Wang Claire Tomlin Anca Dragan 82 128 0 31 May 2018
Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networks Agrim Gupta Justin Johnson Li Fei-Fei Silvio Savarese Alexandre Alahi GAN 163 1,913 0 29 Mar 2018
Deep learning and its application to medical image segmentation H. Roth Chen Shen H. Oda M. Oda Y. Hayashi K. Misawa K. Mori MedIm SSeg 65 116 0 23 Mar 2018
RSDNet: Learning to Predict Remaining Surgery Duration from Laparoscopic Videos Without Manual Annotations A. P. Twinanda Gaurav Yengera Didier Mutter J. Marescaux N. Padoy MedIm 92 99 0 09 Feb 2018
Graph Attention Networks Petar Velickovic Guillem Cucurull Arantxa Casanova Adriana Romero Pietro Lio Yoshua Bengio GNN 454 20,124 0 30 Oct 2017
Generative Adversarial Networks: An Overview Antonia Creswell Tom White Vincent Dumoulin Kai Arulkumaran B. Sengupta Anil A Bharath GAN 102 3,044 0 19 Oct 2017
Dual Motion GAN for Future-Flow Embedded Video Prediction Xiaodan Liang Lisa Lee Wei-Ming Dai Eric Xing GAN 70 366 0 01 Aug 2017
Attention Is All You Need Ashish Vaswani Noam M. Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan Gomez Lukasz Kaiser Illia Polosukhin 3DV 665 131,414 0 12 Jun 2017
Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset João Carreira Andrew Zisserman 221 8,012 0 22 May 2017