From Cognition to Computation: A Comparative Review of Human Attention and Transformer Architectures

25 April 2024

Papers citing "From Cognition to Computation: A Comparative Review of Human Attention and Transformer Architectures"

7 / 7 papers shown

Title
Polysemy of Synthetic Neurons Towards a New Type of Explanatory Categorical Vector Spaces Michael Pichat William Pogrund Paloma Pichat Judicael Poumay Armanouche Gasparian Samuel Demarchi Martin Corbet Alois Georgeon Michael Veillet-Guillem MILM 31 0 0 30 Apr 2025
Intra-neuronal attention within language models Relationships between activation and semantics Michael Pichat William Pogrund Paloma Pichat Armanouche Gasparian Samuel Demarchi Corbet Alois Georgeon Michael Veillet-Guillem MILM 41 0 0 17 Mar 2025
Synthetic Categorical Restructuring large Or How AIs Gradually Extract Efficient Regularities from Their Experience of the World Michael Pichat William Pogrund Paloma Pichat Armanouche Gasparian Samuel Demarchi Martin Corbet Alois Georgeon Theo Dasilva Michael Veillet-Guillem 47 2 0 25 Feb 2025
Transformers in Vision: A Survey Salman Khan Muzammal Naseer Munawar Hayat Syed Waqas Zamir Fahad Shahbaz Khan M. Shah ViT 233 2,434 0 04 Jan 2021
Text Summarization with Pretrained Encoders Yang Liu Mirella Lapata MILM 258 1,436 0 22 Aug 2019
Towards A Rigorous Science of Interpretable Machine Learning Finale Doshi-Velez Been Kim XAI FaML 257 3,696 0 28 Feb 2017
Effective Approaches to Attention-based Neural Machine Translation Thang Luong Hieu H. Pham Christopher D. Manning 220 7,930 0 17 Aug 2015