Temporal Effects on Pre-trained Models for Language Processing Tasks

24 November 2021

Papers citing "Temporal Effects on Pre-trained Models for Language Processing Tasks"

37 / 37 papers shown

Title
TiC-LM: A Web-Scale Benchmark for Time-Continual LLM Pretraining Jeffrey Li Mohammadreza Armandpour Iman Mirzadeh Sachin Mehta Vaishaal Shankar ... Samy Bengio Oncel Tuzel Mehrdad Farajtabar Hadi Pouransari Fartash Faghri CLL KELM 61 0 0 02 Apr 2025
FAME: Towards Factual Multi-Task Model Editing Li Zeng Yingyu Shan Zeming Liu Jiashu Yao Yuhang Guo KELM 31 1 0 07 Oct 2024
LLM Surgery: Efficient Knowledge Unlearning and Editing in Large Language Models Akshaj Kumar Veldanda Shi-Xiong Zhang Anirban Das Supriyo Chakraborty Stephen Rawls Sambit Sahu Milind Naphade KELM MU 36 0 0 19 Sep 2024
Time Matters: Examine Temporal Effects on Biomedical Language Models Weisi Liu Zhe He Xiaolei Huang 26 5 0 24 Jul 2024
CHEW: A Dataset of CHanging Events in Wikipedia Hsuvas Borkakoty Luis Espinosa-Anke 48 1 0 27 Jun 2024
ChronosLex: Time-aware Incremental Training for Temporal Generalization of Legal Classification Tasks Santosh T.Y.S.S Tuan-Quang Vuong Matthias Grabmair AILaw CLL 53 4 0 23 May 2024
A Systematic Analysis on the Temporal Generalization of Language Models in Social Media Asahi Ushio Jose Camacho-Collados 39 0 0 15 May 2024
Future Language Modeling from Temporal Document History Changmao Li Jeffrey Flanigan AI4TS 36 0 0 16 Apr 2024
Set the Clock: Temporal Alignment of Pretrained Language Models Bowen Zhao Zander Brumbaugh Yizhong Wang Hanna Hajishirzi Noah A. Smith CLL KELM 38 9 0 26 Feb 2024
See the Unseen: Better Context-Consistent Knowledge-Editing by Noises Youcheng Huang Wenqiang Lei Zheng-Wei Zhang Jiancheng Lv Shuicheng Yan KELM 24 6 0 15 Jan 2024
ALCUNA: Large Language Models Meet New Knowledge Xunjian Yin Baizhou Huang Xiaojun Wan 15 24 0 23 Oct 2023
SuperTweetEval: A Challenging, Unified and Heterogeneous Benchmark for Social Media NLP Research Dimosthenis Antypas Asahi Ushio Francesco Barbieri Leonardo Neves Kiamehr Rezaee Luis Espinosa-Anke Jiaxin Pei Jose Camacho-Collados 35 9 0 23 Oct 2023
Keeping in Time: Adding Temporal Context to Sentiment Analysis Models Dean Ninalga 25 0 0 24 Sep 2023
WIKITIDE: A Wikipedia-Based Timestamped Definition Pairs Dataset Hsuvas Borkakoty Luis Espinosa-Anke 29 0 0 07 Aug 2023
Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluations Lifan Yuan Yangyi Chen Ganqu Cui Hongcheng Gao Fangyuan Zou Xingyi Cheng Heng Ji Zhiyuan Liu Maosong Sun 39 73 0 07 Jun 2023
Characterizing and Measuring Linguistic Dataset Drift Tyler A. Chang Kishaloy Halder Neha Ann John Yogarshi Vyas Yassine Benajiba Miguel Ballesteros Dan Roth 13 2 0 26 May 2023
Are Large Language Models Robust Coreference Resolvers? Nghia T. Le Alan Ritter LRM 19 11 0 23 May 2023
A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity Shayne Longpre Gregory Yauney Emily Reif Katherine Lee Adam Roberts ... Denny Zhou Jason W. Wei Kevin Robinson David M. Mimno Daphne Ippolito 21 148 0 22 May 2023
Can LMs Generalize to Future Data? An Empirical Analysis on Text Summarization C. Cheang Hou Pong Chan Derek F. Wong Xuebo Liu Zhao Li Yanming Sun Shudong Liu Lidia S. Chao 197 6 0 03 May 2023
Dynamic Benchmarking of Masked Language Models on Temporal Concept Drift with Multiple Views Katerina Margatina Shuai Wang Yogarshi Vyas Neha Ann John Yassine Benajiba Miguel Ballesteros 17 15 0 23 Feb 2023
Boosting classification reliability of NLP transformer models in the long run Zoltán Kmetty Bence Kollányi Krisztián Boros 19 3 0 20 Feb 2023
It's about Time: Rethinking Evaluation on Rumor Detection Benchmarks using Chronological Splits Yida Mu Kalina Bontcheva Nikolaos Aletras 15 19 0 06 Feb 2023
TempEL: Linking Dynamically Evolving and Newly Emerging Entities Klim Zaporojets Lucie-Aimée Kaffee Johannes Deleu Thomas Demeester Chris Develder Isabelle Augenstein KELM 36 15 0 05 Feb 2023
Continuously Reliable Detection of New-Normal Misinformation: Semantic Masking and Contrastive Smoothing in High-Density Latent Regions Abhijit Suprem J. Ferreira C. Pu AAML 32 1 0 19 Jan 2023
Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023? Shuheng Liu Alan Ritter AI4TS 36 12 0 19 Dec 2022
Time-aware Prompting for Text Generation Shuyang Cao Lu Wang 29 11 0 03 Nov 2022
On the Impact of Temporal Concept Drift on Model Explanations Zhixue Zhao G. Chrysostomou Kalina Bontcheva Nikolaos Aletras 18 15 0 17 Oct 2022
Mass-Editing Memory in a Transformer Kevin Meng Arnab Sen Sharma A. Andonian Yonatan Belinkov David Bau KELM VLM 35 525 0 13 Oct 2022
Named Entity Recognition in Twitter: A Dataset and Analysis on Short-Term Temporal Shifts Asahi Ushio Leonardo Neves Vítor Silva Francesco Barbieri Jose Camacho-Collados 25 26 0 07 Oct 2022
TempoWiC: An Evaluation Benchmark for Detecting Meaning Shift in Social Media Daniel Loureiro Aminette D'Souza Areej Muhajab Isabella A. White Gabriel Wong Luis Espinosa Anke Leonardo Neves Francesco Barbieri Jose Camacho-Collados 29 25 0 15 Sep 2022
Learning Dynamic Contextualised Word Embeddings via Template-based Temporal Adaptation Xiaohang Tang Yi Zhou Danushka Bollegala 29 6 0 23 Aug 2022
Then and Now: Quantifying the Longitudinal Validity of Self-Disclosed Depression Diagnoses Keith Harrigian Mark Dredze 17 3 0 22 Jun 2022
TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models Joel Jang Seonghyeon Ye Changho Lee Sohee Yang Joongbo Shin Janghoon Han Gyeonghun Kim Minjoon Seo CLL KELM 27 91 0 29 Apr 2022
TimeLMs: Diachronic Language Models from Twitter Daniel Loureiro Francesco Barbieri Leonardo Neves Luis Espinosa Anke Jose Camacho-Collados 41 247 0 08 Feb 2022
Temporal Attention for Language Models Guy D. Rosin Kira Radinsky VLM 31 33 0 04 Feb 2022
The challenges of temporal alignment on Twitter during crises Aniket Pramanick Tilman Beck Kevin Stowe Iryna Gurevych 17 3 0 17 Apr 2021
Dynamic Contextualized Word Embeddings Valentin Hofmann J. Pierrehumbert Hinrich Schütze 39 51 0 23 Oct 2020