Towards Robust Automation of Surgical Systems via Digital Twin-based
Scene Representations from Foundation Models

Towards Robust Automation of Surgical Systems via Digital Twin-based Scene Representations from Foundation Models

19 September 2024

Lalithkumar Seenivasan

Han Zhang

Juan Antonio Barragan

Russell H. Taylor

Peter Kazanzides

Mathias Unberath

Papers citing "Towards Robust Automation of Surgical Systems via Digital Twin-based Scene Representations from Foundation Models"

12 / 12 papers shown

Title
SegSTRONG-C: Segmenting Surgical Tools Robustly On Non-adversarial Generated Corruptions -- An EndoVis'24 Challenge Hao Ding Tuxun Lu Yuqian Zhang Ruixing Liang Hongchao Shu ... Bo Wang Marcos Fernández-Rodríguez Estevao Lima João L. Vilaça Mathias Unberath 185 4 0 16 Jul 2024
Multi-objective Cross-task Learning via Goal-conditioned GPT-based Decision Transformers for Surgical Robot Task Automation Jiawei Fu Yonghao Long Kai-xiang Chen Wang Wei Qi Dou MedIm 83 4 0 29 May 2024
Creating a Digital Twin of Spinal Surgery: A Proof of Concept Jonas Hein Frederic Giraud Lilian Calvet Alexander Schwarz N. Cavalcanti ... Mazda Farshad Siyu Tang Marc Pollefeys F. Carrillo Philipp Fürnstahl 53 10 0 25 Mar 2024
From Generalization to Precision: Exploring SAM for Tool Segmentation in Surgical Environments K. J. Oguine R. Soberanis-Mukul Nathan G. Drenkow Mathias Unberath MedIm 58 7 0 28 Feb 2024
ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planning Yuanyi Zhong Alihusein Kuwajerwala Sacha Morin Krishna Murthy Jatavallabhula Bipasha Sen ... Celso Miguel de Melo Joshua B. Tenenbaum Antonio Torralba Florian Shkurti Liam Paull LM&Ro 96 180 0 28 Sep 2023
TAToo: Vision-based Joint Tracking of Anatomy and Tool for Skull-base Surgery Zhaoshuo Li Hongchao Shu Ruixing Liang Anna Goodridge M. Sahu Francis X. Creighton Russell H. Taylor Mathias Unberath 41 10 0 29 Dec 2022
CaRTS: Causality-driven Robot Tool Segmentation from Vision and Kinematics Data Hao Ding Jintan Zhang Peter Kazanzides Jinlin Wu Mathias Unberath 65 18 0 15 Mar 2022
Learning to Localize, Grasp, and Hand Over Unmodified Surgical Needles Albert Wilcox Justin Kerr Brijen Thananjeyan Jeffrey Ichnowski M. Hwang Samuel Paradis Danyal Fer Ken Goldberg 69 29 0 08 Dec 2021
Masked-attention Mask Transformer for Universal Image Segmentation Bowen Cheng Ishan Misra Alex Schwing Alexander Kirillov Rohit Girdhar ISeg 200 2,355 0 02 Dec 2021
Vision Transformers for Dense Prediction René Ranftl Alexey Bochkovskiy V. Koltun ViT MDE 125 1,717 0 24 Mar 2021
SuPer: A Surgical Perception Framework for Endoscopic Tissue Manipulation with Surgical Robotics Yang Li Florian Richter Jingpei Lu E. Funk Ryan K. Orosco Jianke Zhu Michael C. Yip 52 103 0 11 Sep 2019
Hybrid Task Cascade for Instance Segmentation Kai-xiang Chen Jiangmiao Pang Jiaqi Wang Yu Xiong Xiaoxiao Li ... Ziwei Liu Jianping Shi Wanli Ouyang Chen Change Loy Dahua Lin ISeg 128 1,301 0 22 Jan 2019