CamemBERT: a Tasty French Language Model

10 November 2019

Louis Martin

Eric Villemonte de la Clergerie

Djamé Seddah

Benoît Sagot

ArXiv PDF HTML

Papers citing "CamemBERT: a Tasty French Language Model"

50 / 361 papers shown

Title
Adversarial Adaptation for French Named Entity Recognition Arjun Choudhry Inder Khatri Pankaj Gupta Aaryan Gupta Maxime Nicol Marie-Jean Meurs Dinesh Kumar Vishwakarma 27 0 0 12 Jan 2023
Countering Malicious Content Moderation Evasion in Online Social Networks: Simulation and Detection of Word Camouflage Álvaro Huertas-García Alejandro Martín Javier Huertas-Tato David Camacho 34 9 0 27 Dec 2022
MicroBERT: Effective Training of Low-resource Monolingual BERTs through Parameter Reduction and Multitask Learning Luke Gessler Amir Zeldes 25 14 0 23 Dec 2022
Mini-Model Adaptation: Efficiently Extending Pretrained Models to New Languages via Aligned Shallow Training Kelly Marchisio Patrick Lewis Yihong Chen Mikel Artetxe 35 16 0 20 Dec 2022
Multilingual Sequence-to-Sequence Models for Hebrew NLP Matan Eyal Hila Noga Roee Aharoni Idan Szpektor Reut Tsarfaty 36 4 0 19 Dec 2022
Lessons learned from the evaluation of Spanish Language Models Rodrigo Agerri Eneko Agirre ELM 30 15 0 16 Dec 2022
FreCDo: A Large Corpus for French Cross-Domain Dialect Identification Mihaela Găman Adrian-Gabriel Chifu William Domingues Radu Tudor Ionescu 16 3 0 15 Dec 2022
Ensembling Transformers for Cross-domain Automatic Term Extraction T. Hanh Matej Martinc Andraz Pelicon Antoine Doucet Senja Pollak 24 5 0 12 Dec 2022
Modern French Poetry Generation with RoBERTa and GPT-2 Mika Hämäläinen Khalid Alnajjar Thierry Poibeau BDL 27 10 0 06 Dec 2022
Transformer-Based Named Entity Recognition for French Using Adversarial Adaptation to Similar Domain Corpora Arjun Choudhry Pankaj Gupta Inder Khatri Aaryan Gupta Maxime Nicol Marie-Jean Meurs Dinesh Kumar Vishwakarma 32 5 0 05 Dec 2022
TCBERT: A Technical Report for Chinese Topic Classification BERT Ting Han Kunhao Pan Xinyu Chen Dingjie Song Yuchen Fan Xinyu Gao Ruyi Gan Jiaxing Zhang VLM 22 1 0 21 Nov 2022
RobBERT-2022: Updating a Dutch Language Model to Account for Evolving Language Use Pieter Delobelle Thomas Winters Bettina Berendt 24 6 0 15 Nov 2022
Un discours et un public "Gilets Jaunes" au coeur du Grand Débat National? Combinaison des approches IA et textométriques pour lánalyse de discours des plateformes "Grand Débat National" et "Vrai débat" Suignard Philippe 14 0 0 14 Nov 2022
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model BigScience Workshop : Teven Le Scao Angela Fan Christopher Akiki ... Zhongli Xie Zifan Ye M. Bras Younes Belkada Thomas Wolf VLM 118 2,315 0 09 Nov 2022
Local Structure Matters Most in Most Languages Louis Clouâtre Prasanna Parthasarathi Amal Zouaq Sarath Chandar 39 1 0 09 Nov 2022
Detecting Languages Unintelligible to Multilingual Models through Local Structure Probes Louis Clouâtre Prasanna Parthasarathi Amal Zouaq Sarath Chandar 33 3 0 09 Nov 2022
Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models Aaron Mueller Yudi Xia Tal Linzen MILM 36 9 0 25 Oct 2022
Multimodal Model with Text and Drug Embeddings for Adverse Drug Reaction Classification Andrey Sakhovskiy E. Tutubalina 32 18 0 21 Oct 2022
Data-Efficient Strategies for Expanding Hate Speech Detection into Under-Resourced Languages Paul Röttger Debora Nozza Federico Bianchi Dirk Hovy 29 10 0 20 Oct 2022
Machine Generated Text: A Comprehensive Survey of Threat Models and Detection Methods Evan Crothers Nathalie Japkowicz H. Viktor DeLMO 50 107 0 13 Oct 2022
Word Sense Induction with Hierarchical Clustering and Mutual Information Maximization Hadi Abdine Moussa Kamal Eddine Michalis Vazirgiannis Davide Buscaldi 15 1 0 11 Oct 2022
End-to-end Multilingual Coreference Resolution with Mention Head Prediction O. Pražák Miloslav Konopík LRM 29 14 0 26 Sep 2022
An Empirical Study on Cross-X Transfer for Legal Judgment Prediction Joel Niklaus Matthias Sturmer Ilias Chalkidis ELM AILaw 55 19 0 25 Sep 2022
MonoByte: A Pool of Monolingual Byte-level Language Models Hugo Queiroz Abonizio Leandro Rodrigues de Souza R. Lotufo Rodrigo Nogueira 40 1 0 22 Sep 2022
Adaptation of domain-specific transformer models with text oversampling for sentiment analysis of social media posts on Covid-19 vaccines Anmol Bansal Arjun Choudhry Anubhav Sharma Seba Susan MedIm 19 4 0 22 Sep 2022
SMTCE: A Social Media Text Classification Evaluation Benchmark and BERTology Models for Vietnamese Luan Thanh Nguyen Kiet Van Nguyen Ngan Luu-Thuy Nguyen VLM 25 8 0 21 Sep 2022
De-Identification of French Unstructured Clinical Notes for Machine Learning Tasks Yakini Tchouka Jean-François Couchot Maxime Coulmeau David Laiymani Philippe Selles Azzedine Rahmani OOD 19 5 0 16 Sep 2022
ÚFAL CorPipe at CRAC 2022: Effectivity of Multilingual Models for Coreference Resolution Milan Straka Jana Straková LRM 50 13 0 15 Sep 2022
Is Medieval Distant Viewing Possible? : Extending and Enriching Annotation of Legacy Image Collections using Visual Analytics C. Meinecke Estelle Guéville D. Wrisley Stefan Jänicke 35 4 0 20 Aug 2022
Fusing Sentence Embeddings Into LSTM-based Autoregressive Language Models Vilém Zouhar Marius Mosbach Dietrich Klakow 29 1 0 04 Aug 2022
Learning structures of the French clinical language:development and validation of word embedding models using 21 million clinical reports from electronic health records Basile Dura Charline Jean X. Tannier Alice Calliger R. Bey A. Neuraz R. Flicoteaux 19 11 0 26 Jul 2022
Multi-Level Fine-Tuning, Data Augmentation, and Few-Shot Learning for Specialized Cyber Threat Intelligence Markus Bayer Tobias Frey Christian A. Reuter AAML 24 15 0 22 Jul 2022
Benchmarking Transformers-based models on French Spoken Language Understanding tasks Oralie Cattan Sahar Ghannay Christophe Servan Sophie Rosset 36 4 0 19 Jul 2022
On the Usability of Transformers-based models for a French Question-Answering task Oralie Cattan Christophe Servan Sophie Rosset 24 14 0 19 Jul 2022
Multilingual Transformer Encoders: a Word-Level Task-Agnostic Evaluation Félix Gaschi François Plesse Parisa Rastin Y. Toussaint 22 8 0 19 Jul 2022
Effectiveness of French Language Models on Abstractive Dialogue Summarization Task Yongxin Zhou Franccois Portet F. Ringeval 22 8 0 17 Jul 2022
FairDistillation: Mitigating Stereotyping in Language Models Pieter Delobelle Bettina Berendt 26 8 0 10 Jul 2022
Multilingual Persuasion Detection: Video Games as an Invaluable Data Source for NLP Teemu Pöyhönen Mika Hämäläinen Khalid Alnajjar 23 6 0 10 Jul 2022
Multimodal E-Commerce Product Classification Using Hierarchical Fusion Tsegaye Misikir Tashu Sara Fattouh Peter Kiss Tomáš Horváth 24 1 0 07 Jul 2022
ASR-Generated Text for Language Model Pre-training Applied to Speech Tasks Valentin Pelloin Franck Dary Nicolas Hervé Benoit Favre Nathalie Camelin Antoine Laurent Laurent Besacier 50 6 0 05 Jul 2022
Location reference recognition from texts: A survey and comparison Xuke Hu Zhiyong Zhou Hao Li Yingjie Hu F. Gu J. Kersten H. Fan Friederike Klan 22 44 0 04 Jul 2022
Towards a Data-Driven Requirements Engineering Approach: Automatic Analysis of User Reviews Jialiang Wei A. Courbis Thomas Lambolais Binbin Xu P. Bernard Gérard Dray 19 6 0 29 Jun 2022
A Multilingual Dataset of COVID-19 Vaccination Attitudes on Twitter Ninghan Chen Xihui Chen Jun Pang 44 16 0 27 Jun 2022
Multilingual Extraction and Categorization of Lexical Collocations with Graph-aware Transformers Luis Espinosa-Anke A. Shvets Alireza Mohammadshahi James Henderson Leo Wanner 25 4 0 23 May 2022
DistilCamemBERT: a distillation of the French model CamemBERT Cyrile Delestre Abibatou Amar 29 5 0 23 May 2022
Blackbird's language matrices (BLMs): a new benchmark to investigate disentangled generalisation in neural networks Paola Merlo A. An M. A. Rodriguez 36 9 0 22 May 2022
Revisiting Pre-trained Language Models and their Evaluation for Arabic Natural Language Understanding Abbas Ghaddar Yimeng Wu Sunyam Bagga Ahmad Rashid Khalil Bibi ... Zhefeng Wang Baoxing Huai Xin Jiang Qun Liu Philippe Langlais 27 6 0 21 May 2022
Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese Kurt Micallef Albert Gatt Marc Tanti Lonneke van der Plas Claudia Borg 33 28 0 21 May 2022
Overcoming Language Disparity in Online Content Classification with Multimodal Learning Gaurav Verma Rohit Mujumdar Zijie J. Wang M. D. Choudhury Srijan Kumar 23 14 0 19 May 2022
Evaluation of Transfer Learning for Polish with a Text-to-Text Model Aleksandra Chrabrowa Lukasz Dragan Karol Grzegorczyk D. Kajtoch Mikołaj Koszowski Robert Mroczkowski Piotr Rybak 37 18 0 18 May 2022