ResearchTrend.AI
CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending
v1v2v3 (latest)

CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending

Shiyi Zhu
Jingting Ye
Wei Jiang
Siqiao Xue
Qi Zhang
Yifan Wu
Jianguo Li
ArXiv (abs)PDFHTMLGithub (63★)

Papers citing "CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending"

1 / 1 papers shown
Title
PEER: Expertizing Domain-Specific Tasks with a Multi-Agent Framework and Tuning Methods
PEER: Expertizing Domain-Specific Tasks with a Multi-Agent Framework and Tuning Methods
Yiying Wang
Xiaojing Li
Binzhu Wang
Yueyang Zhou
Yingru Lin
...
Fei Yu
Zewei Zhao
Song Jin
Renji Gong
Wanqing Xu
72
1
0
09 Jul 2024