Correcting diacritics and typos with a ByT5 transformer model

Correcting diacritics and typos with a ByT5 transformer model

31 January 2022

Lukas Stankevicius

M. Lukoševičius

J. Kapočiūtė-Dzikienė

Monika Briediene

Tomas Krilavičius

Papers citing "Correcting diacritics and typos with a ByT5 transformer model"

13 / 13 papers shown

Title
ÚFAL at MultiLexNorm 2021: Improving Multilingual Lexical Normalization by Fine-tuning ByT5 David Samuel Milan Straka 29 16 0 28 Oct 2021
A Simple Recipe for Multilingual Grammatical Error Correction S. Rothe Jonathan Mallinson Eric Malmi Sebastian Krause Aliaksei Severyn 42 164 0 07 Jun 2021
ByT5: Towards a token-free future with pre-trained byte-to-byte models Linting Xue Aditya Barua Noah Constant Rami Al-Rfou Sharan Narang Mihir Kale Adam Roberts Colin Raffel 83 502 0 28 May 2021
Diacritics Restoration using BERT with Analysis on Czech language Jakub Náplava Milan Straka Jana Straková 18 11 0 24 May 2021
Spelling Correction with Denoising Transformer Alexandr Kuznetsov Hector Urdiales 36 18 0 12 May 2021
Restoring Hebrew Diacritics Without a Dictionary Elazar Gershuni Yuval Pinter 42 7 0 11 May 2021
GitHub Typo Corpus: A Large-Scale Multilingual Dataset of Misspellings and Grammatical Errors Masato Hagiwara Masato Mita 45 28 0 28 Nov 2019
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems Alex Jinpeng Wang Yada Pruksachatkun Nikita Nangia Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 234 2,307 0 02 May 2019
SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processing Taku Kudo John Richardson 178 3,514 0 19 Aug 2018
Adafactor: Adaptive Learning Rates with Sublinear Memory Cost Noam M. Shazeer Mitchell Stern ODL 72 1,043 0 11 Apr 2018
Marian: Fast Neural Machine Translation in C++ Marcin Junczys-Dowmunt Roman Grundkiewicz Tomasz Dwojak Hieu T. Hoang Kenneth Heafield ... Ulrich Germann Alham Fikri Aji Nikolay Bogoychev André F. T. Martins Alexandra Birch 85 716 0 01 Apr 2018
Enriching Word Vectors with Subword Information Piotr Bojanowski Edouard Grave Armand Joulin Tomas Mikolov NAI SSL VLM 209 9,957 0 15 Jul 2016
Neural Machine Translation by Jointly Learning to Align and Translate Dzmitry Bahdanau Kyunghyun Cho Yoshua Bengio AIMat 507 27,263 0 01 Sep 2014

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.