Adaptation of Deep Bidirectional Multilingual Transformers for Russian Language

17 May 2019

Papers citing "Adaptation of Deep Bidirectional Multilingual Transformers for Russian Language"

50 / 126 papers shown

Title
Taxonomy Enrichment with Text and Graph Vector Representations Irina Nikishina M. Tikhomirov V. Logacheva Yuriy Nazarov Alexander Panchenko Natalia Loukachevitch 27 8 0 21 Jan 2022
RuMedBench: A Russian Medical Language Understanding Benchmark Pavel Blinov A. Reshetnikova A. Nesterov Galina Zubkova V. Kokh ELM 18 15 0 17 Jan 2022
Training dataset and dictionary sizes matter in BERT models: the case of Baltic languages Matej Ulvcar Marko Robnik-vSikonja 21 12 0 20 Dec 2021
Does BERT look at sentiment lexicon? E. Razova S. Vychegzhanin Evgeny Kotelnikov 29 2 0 19 Nov 2021
Lexicon-based Methods vs. BERT for Text Sentiment Analysis A. Kotelnikova D. Paschenko Klavdiya Olegovna Bochenina Evgeny Kotelnikov 27 17 0 19 Nov 2021
NVIDIA NeMo Neural Machine Translation Systems for English-German and English-Russian News and Biomedical Tasks at WMT21 Sandeep Subramanian Oleksii Hrinchuk Virginia Adams Oleksii Kuchaiev VLM 27 16 0 16 Nov 2021
SocialBERT -- Transformers for Online SocialNetwork Language Modelling I. Karpov Nick Kartashev 30 3 0 13 Nov 2021
Ontology-based question answering over corporate structured data S. Gorshkov Constantin Kondratiev Roman Shebalov 16 0 0 08 Nov 2021
Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey Bonan Min Hayley L Ross Elior Sulem Amir Pouran Ben Veyseh Thien Huu Nguyen Oscar Sainz Eneko Agirre Ilana Heinz Dan Roth LM&MA VLM AI4CE 83 1,039 0 01 Nov 2021
On the Complementarity of Data Selection and Fine Tuning for Domain Adaptation Dan Iter David Grangier 25 9 0 15 Sep 2021
Evaluating Transferability of BERT Models on Uralic Languages Judit Ács Dániel Lévai András Kornai 33 6 0 13 Sep 2021
NEREL: A Russian Dataset with Nested Named Entities, Relations and Events Natalia Loukachevitch Ekaterina Artemova Tatiana Batura Pavel Braslavski Ilia Denisov V. Ivanov S. Manandhar Alexander Pugachev E. Tutubalina NAI 19 18 0 30 Aug 2021
Transfer Learning for Multi-lingual Tasks -- a Survey A. Jafari Behnam Heidary R. Farahbakhsh Mostafa Salehi Mahdi Jalili LRM 29 5 0 28 Aug 2021
AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processing Katikapalli Subramanyam Kalyan A. Rajasekharan S. Sangeetha VLM LM&MA 31 261 0 12 Aug 2021
Evaluation of contextual embeddings on less-resourced languages Matej Ulvcar Alevs vZagar C. S. Armendariz Andravz Repar Senja Pollak Matthew Purver Marko Robnik-vSikonja 36 11 0 22 Jul 2021
Transfer Learning for Improving Results on Russian Sentiment Datasets A. Golubev Natalia Loukachevitch 22 5 0 06 Jul 2021
Traditional Machine Learning and Deep Learning Models for Argumentation Mining in Russian Texts Irina Fishcheva Valeriya Goloviznina Evgeny Kotelnikov 26 9 0 28 Jun 2021
Current Landscape of the Russian Sentiment Corpora Evgeny Kotelnikov 33 4 0 28 Jun 2021
Exploring the Representation of Word Meanings in Context: A Case Study on Homonymy and Synonymy Marcos Garcia 24 18 0 25 Jun 2021
Transformers for Headline Selection for Russian News Clusters Pavel Voropaev Olga Sopilnyak 24 0 0 19 Jun 2021
Can BERT Dig It? -- Named Entity Recognition for Information Retrieval in the Archaeology Domain Alex Brandsen Suzan Verberne K. Lambers M. Wansleeben 33 37 0 14 Jun 2021
Evaluating Various Tokenizers for Arabic Text Classification Zaid Alyafeai Maged S. Al-Shaibani Mustafa Ghaleb Irfan Ahmad 42 41 0 14 Jun 2021
MergeDistill: Merging Pre-trained Language Models using Distillation Simran Khanuja Melvin Johnson Partha P. Talukdar 35 16 0 05 Jun 2021
Evaluating the Efficacy of Summarization Evaluation across Languages Fajri Koto Jey Han Lau Timothy Baldwin 50 19 0 02 Jun 2021
belabBERT: a Dutch RoBERTa-based language model applied to psychiatric classification J. Wouts J. D. Boer A. Voppel S. Brederoo S. V. Splunter I. Sommer 22 4 0 02 Jun 2021
Deception detection in text and its relation to the cultural dimension of individualism/collectivism Katerina Papantoniou P. Papadakos T. Patkos G. Flouris Ion Androutsopoulos Dimitris Plexousakis 55 7 0 26 May 2021
A systematic review of Hate Speech automatic detection using Natural Language Processing Md Saroar Jahan Mourad Oussalah 37 9 0 22 May 2021
Methods for Detoxification of Texts for the Russian Language Daryna Dementieva Daniil Moskovskiy V. Logacheva David Dale Olga Kozlova Nikita Semenov Alexander Panchenko 45 19 0 19 May 2021
HerBERT: Efficiently Pretrained Transformer-based Language Model for Polish Robert Mroczkowski Piotr Rybak Alina Wróblewska Ireneusz Gawlik 36 81 0 04 May 2021
Unreasonable Effectiveness of Rule-Based Heuristics in Solving Russian SuperGLUE Tasks Tatiana Iazykova Denis Kapelyushnik Olga Bystrova Andrey Kutuzov ELM 8 1 0 03 May 2021
Russian News Clustering and Headline Selection Shared Task I. Gusev I. Smurov 21 7 0 03 May 2021
MOROCCO: Model Resource Comparison Framework Valentin Malykh Alexander Kukushkin Ekaterina Artemova Vladislav Mikhailov Maria Tikhonova Tatiana Shavrina 24 0 0 29 Apr 2021
Multilingual Language Models Predict Human Reading Behavior Nora Hollenstein Federico Pirovano Ce Zhang Lena Jäger Lisa Beinborn VLM 50 46 0 12 Apr 2021
Bertinho: Galician BERT Representations David Vilares Marcos Garcia Carlos Gómez-Rodríguez 65 22 0 25 Mar 2021
Detecting Inappropriate Messages on Sensitive Topics that Could Harm a Company's Reputation N. Babakov V. Logacheva Olga Kozlova Nikita Semenov Alexander Panchenko 16 10 0 09 Mar 2021
Bilingual Language Modeling, A transfer learning technique for Roman Urdu Usama Khalid M. O. Beg Muhammad Umair Arshad 27 3 0 22 Feb 2021
LOME: Large Ontology Multilingual Extraction Patrick Xia Guanghui Qin Siddharth Vashishtha Yunmo Chen Tongfei Chen Chandler May Craig Harman Kyle Rawlins A. White Benjamin Van Durme 21 40 0 28 Jan 2021
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models Phillip Rust Jonas Pfeiffer Ivan Vulić Sebastian Ruder Iryna Gurevych 80 235 0 31 Dec 2020
Enhancing deep neural networks with morphological information Matej Klemen Luka Krsnik Marko Robnik-Šikonja 39 12 0 24 Nov 2020
Domain-Transferable Method for Named Entity Recognition Task Vladislav Mikhailov Tatiana Shavrina 11 2 0 24 Nov 2020
Studying Taxonomy Enrichment on Diachronic WordNet Versions Irina Nikishina Alexander Panchenko V. Logacheva Natalia Loukachevitch 11 12 0 23 Nov 2020
Entity Recognition and Relation Extraction from Scientific and Technical Texts in Russian E. Bruches Alexey Pauls Tatiana Batura Vladimir Isachenko 12 7 0 19 Nov 2020
EstBERT: A Pretrained Language-Specific BERT for Estonian Hasan Tanvir Claudia Kittask Sandra Eiche Kairit Sirts 20 36 0 09 Nov 2020
Neural Coreference Resolution for Arabic Abdulrahman Aloraini Juntao Yu Massimo Poesio 19 14 0 31 Oct 2020
RuREBus: a Case Study of Joint Named Entity Recognition and Relation Extraction from e-Government Domain V. Ivanin Ekaterina Artemova Tatiana Batura V. Ivanov V. Sarkisyan E. Tutubalina I. Smurov 11 0 0 29 Oct 2020
RussianSuperGLUE: A Russian Language Understanding Evaluation Benchmark Tatiana Shavrina Alena Fenogenova Anton A. Emelyanov Denis Shevelev Ekaterina Artemova Valentin Malykh Vladislav Mikhailov Maria Tikhonova Andrey Chertok Andrey Evlampiev VLM ELM 33 81 0 29 Oct 2020
When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models Benjamin Muller Antonis Anastasopoulos Benoît Sagot Djamé Seddah LRM 136 165 0 24 Oct 2020
Applying Occam's Razor to Transformer-Based Dependency Parsing: What Works, What Doesn't, and What is Really Necessary Stefan Grünewald Annemarie Friedrich Jonas Kuhn 64 11 0 23 Oct 2020
BARThez: a Skilled Pretrained French Sequence-to-Sequence Model Moussa Kamal Eddine A. Tixier Michalis Vazirgiannis BDL 105 64 0 23 Oct 2020
X-FACTR: Multilingual Factual Knowledge Retrieval from Pretrained Language Models Zhengbao Jiang Antonios Anastasopoulos Jun Araki Haibo Ding Graham Neubig HILM KELM 21 139 0 13 Oct 2020