ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2405.17067
  4. Cited By
Tokenization Matters! Degrading Large Language Models through Challenging Their Tokenization
v1v2 (latest)

Tokenization Matters! Degrading Large Language Models through Challenging Their Tokenization

27 May 2024
Dixuan Wang
Yanda Li
Junyuan Jiang
Zepeng Ding
Ziqin Luo
Guochao Jiang
Jiaqing Liang
Deqing Yang
ArXiv (abs)PDFHTML

Papers citing "Tokenization Matters! Degrading Large Language Models through Challenging Their Tokenization"

2 / 52 papers shown
Title
Subword Regularization: Improving Neural Network Translation Models with
  Multiple Subword Candidates
Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates
Taku Kudo
278
1,173
0
29 Apr 2018
Neural Machine Translation of Rare Words with Subword Units
Neural Machine Translation of Rare Words with Subword Units
Rico Sennrich
Barry Haddow
Alexandra Birch
287
7,775
0
31 Aug 2015
Previous
12