Sparse and Continuous Attention Mechanisms

Sparse and Continuous Attention Mechanisms

12 June 2020

André F. T. Martins

António Farinhas

Marcos Vinícius Treviso

Mário A. T. Figueiredo

Papers citing "Sparse and Continuous Attention Mechanisms"

5 / 5 papers shown

Title
ELITR-Bench: A Meeting Assistant Benchmark for Long-Context Language Models Thibaut Thonet Jos Rozen Laurent Besacier RALM 142 2 0 20 Jan 2025
Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformers Sotiris Anagnostidis Dario Pavllo Luca Biggio Lorenzo Noci Aurelien Lucchi Thomas Hofmann 42 53 0 25 May 2023
Visual Question Answering: A Survey on Techniques and Common Trends in Recent Literature Ana Claudia Akemi Matsuki de Faria Felype de Castro Bastos Jose Victor Nogueira Alves da Silva Vitor Lopes Fabris Valeska Uchôa Décio Gonccalves de Aguiar Neto C. F. G. Santos 30 23 0 18 May 2023
Transformers meet Stochastic Block Models: Attention with Data-Adaptive Sparsity and Cost Sungjun Cho Seonwoo Min Jinwoo Kim Moontae Lee Honglak Lee Seunghoon Hong 40 3 0 27 Oct 2022
Multimodal Continuous Visual Attention Mechanisms António Farinhas André F. T. Martins P. Aguiar 22 7 0 07 Apr 2021