ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2502.07365
  4. Cited By
LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation

LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation

20 February 2025
Zican Dong
Junyi Li
Jinhao Jiang
Mingyu Xu
Wayne Xin Zhao
B. Wang
Weipeng Chen
    VLM
ArXivPDFHTML

Papers citing "LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation"

2 / 2 papers shown
Title
CAFE: Retrieval Head-based Coarse-to-Fine Information Seeking to Enhance Multi-Document QA Capability
CAFE: Retrieval Head-based Coarse-to-Fine Information Seeking to Enhance Multi-Document QA Capability
Han Peng
Jinhao Jiang
Zican Dong
Wayne Xin Zhao
Lei Fang
RALM
23
0
0
15 May 2025
Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
Z. Qiu
Z. Wang
Bo Zheng
Zeyu Huang
Kaiyue Wen
...
Fei Huang
Suozhi Huang
Dayiheng Liu
Jingren Zhou
Junyang Lin
MoE
23
0
0
10 May 2025
1