Title
A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations Md Tahmid Rahman Laskar Sawsan Alqahtani M Saiful Bari Mizanur Rahman Mohammad Abdullah Matin Khan ... Chee Wei Tan Md. Rizwan Parvez Enamul Hoque Chenyu You Jimmy Huang ELM ALM 31 28 0 04 Jul 2024
GemmAr: Enhancing LLMs Through Arabic Instruction-Tuning Hasna Chouikhi Manel Aloui Cyrine Ben Hammou Ghaith Chaabane Haithem Kchaou Chehir Dhaouadi 44 0 0 02 Jul 2024
Show Less, Instruct More: Enriching Prompts with Definitions and Guidelines for Zero-Shot NER Andrew Zamai Andrea Zugarini Leonardo Rigutini Marco Ernandes Marco Maggini 29 0 0 01 Jul 2024
Development of Cognitive Intelligence in Pre-trained Language Models Raj Sanjay Shah Khushi Bhardwaj Sashank Varma 34 2 0 01 Jul 2024
FlowVQA: Mapping Multimodal Logic in Visual Question Answering with Flowcharts Shubhankar Singh Purvi Chaurasia Yerram Varun Pranshu Pandya Vatsal Gupta Vivek Gupta Dan Roth 36 4 0 27 Jun 2024
Open-vocabulary Mobile Manipulation in Unseen Dynamic Environments with 3D Semantic Maps Dicong Qiu Wenzong Ma Zhenfu Pan Hui Xiong Junwei Liang LM&Ro 39 7 0 26 Jun 2024
AssertionBench: A Benchmark to Evaluate Large-Language Models for Assertion Generation Vaishnavi Pulavarthi Deeksha Nandal Soham Dan Debjit Pal 35 7 0 26 Jun 2024
A Complete Survey on LLM-based AI Chatbots Sumit Kumar Dam Choong Seon Hong Yu Qiao Chaoning Zhang 59 52 0 17 Jun 2024
Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMs D. Yaldiz Yavuz Faruk Bakman Baturalp Buyukates Chenyang Tao Anil Ramakrishna Dimitrios Dimitriadis Jieyu Zhao Salman Avestimehr 44 2 0 17 Jun 2024
Beyond Boundaries: Learning a Universal Entity Taxonomy across Datasets and Languages for Open Named Entity Recognition Yuming Yang Wantong Zhao Caishuang Huang Junjie Ye Xiao Wang ... Kaixin Huang Yunke Zhang Tao Gui Qi Zhang Xuanjing Huang 44 3 0 17 Jun 2024
Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey Hao Yang Yanyan Zhao Yang Wu Shilong Wang Tian Zheng Hongbo Zhang Zongyang Ma Wanxiang Che Bing Qin 42 8 0 12 Jun 2024
Do LLMs Recognize me, When I is not me: Assessment of LLMs Understanding of Turkish Indexical Pronouns in Indexical Shift Contexts Metehan Oguz Yusuf Umut Ciftci Yavuz Faruk Bakman 28 2 0 08 Jun 2024
Is On-Device AI Broken and Exploitable? Assessing the Trust and Ethics in Small Language Models Kalyan Nakka Jimmy Dani Nitesh Saxena 48 1 0 08 Jun 2024
llmNER: (Zero\|Few)-Shot Named Entity Recognition, Exploiting the Power of Large Language Models F. Villena Luis Miranda Claudio Aracena 58 2 0 06 Jun 2024
Assessing LLMs for Zero-shot Abstractive Summarization Through the Lens of Relevance Paraphrasing Hadi Askari Anshuman Chhabra Muhao Chen Prasant Mohapatra 38 5 0 06 Jun 2024
Keypoint-based Progressive Chain-of-Thought Distillation for LLMs Kaituo Feng Changsheng Li Xiaolu Zhang Jun Zhou Ye Yuan Guoren Wang LRM 50 2 0 25 May 2024
Incremental Comprehension of Garden-Path Sentences by Large Language Models: Semantic Interpretation, Syntactic Re-Analysis, and Attention Andrew Li Xianle Feng Siddhant Narang Austin Peng Tianle Cai Raj Sanjay Shah Sashank Varma LRM 39 5 0 25 May 2024
DrHouse: An LLM-empowered Diagnostic Reasoning System through Harnessing Outcomes from Sensor Data and Expert Knowledge Bufang Yang Siyang Jiang Lilin Xu Kaiwei Liu Hai Li Guoliang Xing Hongkai Chen Xiaofan Jiang Zhenyu Yan LM&MA 48 15 0 21 May 2024
Large Language Models for Medicine: A Survey Yanxin Zheng Wensheng Gan Zefeng Chen Zhenlian Qi Qian Liang Philip S. Yu LM&MA 23 15 0 20 May 2024
DaVinci at SemEval-2024 Task 9: Few-shot prompting GPT-3.5 for Unconventional Reasoning Suyash Vardhan Mathur Akshett Rai Jindal Manish Shrivastava LRM 39 1 0 19 May 2024
Blackbox Adaptation for Medical Image Segmentation Jay N. Paranjape S. Sikder S. Vedula Vishal M. Patel VLM MedIm 43 0 0 17 May 2024
PromptMind Team at MEDIQA-CORR 2024: Improving Clinical Text Correction with Error Categorization and LLM Ensembles Kesav Gundabathula Sriram R Kolar LRM 30 7 0 14 May 2024
Risks of Practicing Large Language Models in Smart Grid: Threat Modeling and Validation Jiangnan Li Yingyuan Yang Jinyuan Stella Sun 62 4 0 10 May 2024
Utilizing Large Language Models to Generate Synthetic Data to Increase the Performance of BERT-Based Neural Networks Chancellor R. Woolsey Prakash Bisht Joshua M Rothman Gondy Leroy AI4MH LM&MA SyDa 22 1 0 08 May 2024
Unraveling the Dominance of Large Language Models Over Transformer Models for Bangla Natural Language Inference: A Comprehensive Study Fatema Tuj Johora Faria Mukaffi Bin Moin Asif Iftekher Fahim Pronay Debnath Faisal Muhammad Shah 38 2 0 05 May 2024
Large Language Models for UAVs: Current State and Pathways to the Future Shumaila Javaid Nasir Saeed Bin He 40 17 0 02 May 2024
From Keyboard to Chatbot: An AI-powered Integration Platform with Large-Language Models for Teaching Computational Thinking for Young Children Changjae Lee Jinjun Xiong LM&Ro LRM 16 0 0 01 May 2024
Learn Your Reference Model for Real Good Alignment Alexey Gorbatovski Boris Shaposhnikov Alexey Malakhov Nikita Surnachev Yaroslav Aksenov Ian Maksimov Nikita Balagansky Daniil Gavrilov OffRL 54 27 0 15 Apr 2024
Rumour Evaluation with Very Large Language Models Dahlia Shehata Robin Cohen Charles Clarke 34 0 0 11 Apr 2024
Lightweight Deep Learning for Resource-Constrained Environments: A Survey Hou-I Liu Marco Galindo Hongxia Xie Lai-Kuan Wong Hong-Han Shuai Yung-Hui Li Wen-Huang Cheng 58 48 0 08 Apr 2024
Physical Property Understanding from Language-Embedded Feature Fields Albert J. Zhai Yuan Shen Emily Y. Chen Gloria X. Wang Xinlei Wang Sheng Wang Kaiyu Guan Shenlong Wang 38 13 0 05 Apr 2024
Evaluating Large Language Models for Health-Related Text Classification Tasks with Public Social Media Data Yuting Guo Anthony Ovadje M. Al-garadi Abeed Sarker AI4MH 40 6 0 27 Mar 2024
Large Language Models Are State-of-the-Art Evaluator for Grammatical Error Correction Masamune Kobayashi Masato Mita Mamoru Komachi ELM 42 3 0 26 Mar 2024
Data-Efficient 3D Visual Grounding via Order-Aware Referring Tung-Yu Wu Sheng-Yu Huang Yu-Chiang Frank Wang 34 0 0 25 Mar 2024
Metaphor Understanding Challenge Dataset for LLMs Xiaoyu Tong Rochelle Choenni Martha Lewis Ekaterina Shutova 51 8 0 18 Mar 2024
Construction of Hyper-Relational Knowledge Graphs Using Pre-Trained Large Language Models Preetha Datta Fedor Vitiugin Anastasiia Chizhikova Nitin Sawhney KELM 52 1 0 18 Mar 2024
HateCOT: An Explanation-Enhanced Dataset for Generalizable Offensive Speech Detection via Large Language Models H. Nghiem Hal Daumé 42 1 0 18 Mar 2024
Meta-Cognitive Analysis: Evaluating Declarative and Procedural Knowledge in Datasets and Large Language Models Zhuoqun Li Hongyu Lin Yaojie Lu Hao Xiang Xianpei Han Le Sun 38 1 0 14 Mar 2024
What is different between these datasets? Varun Babbar Zhicheng Guo Cynthia Rudin 59 1 0 08 Mar 2024
Causal Prompting: Debiasing Large Language Model Prompting based on Front-Door Adjustment Congzhi Zhang Linhai Zhang Jialong Wu Deyu Zhou Guoqiang Xu CML AI4CE LRM 44 15 0 05 Mar 2024
Analyzing and Adapting Large Language Models for Few-Shot Multilingual NLU: Are We There Yet? E. Razumovskaia Ivan Vulić Anna Korhonen 46 6 0 04 Mar 2024
Exploring the Potential of Large Language Models for Improving Digital Forensic Investigation Efficiency Akila Wickramasekara F. Breitinger Mark Scanlon 52 8 0 29 Feb 2024
A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems Zihao Yi Jiarui Ouyang Yuwen Liu Tianhao Liao Zhe Xu Ying Shen LLMAG LRM 62 58 0 28 Feb 2024
MATHSENSEI: A Tool-Augmented Large Language Model for Mathematical Reasoning Debrup Das Debopriyo Banerjee Somak Aditya Ashish Kulkarni ReLM LRM 36 10 0 27 Feb 2024
RoCoIns: Enhancing Robustness of Large Language Models through Code-Style Instructions Yuan Zhang Xiao Wang Zhiheng Xi Han Xia Tao Gui Qi Zhang Xuanjing Huang 39 3 0 26 Feb 2024
LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognition Junjie Ye Nuo Xu Yikun Wang Jie Zhou Qi Zhang Tao Gui Xuanjing Huang 26 15 0 22 Feb 2024
MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMs Yavuz Faruk Bakman D. Yaldiz Baturalp Buyukates Chenyang Tao Dimitrios Dimitriadis A. Avestimehr 29 12 0 19 Feb 2024
Decoding News Narratives: A Critical Analysis of Large Language Models in Framing Detection Valeria Pastorino Jasivan Sivakumar N. Moosavi 28 2 0 18 Feb 2024
scInterpreter: Training Large Language Models to Interpret scRNA-seq Data for Cell Type Annotation Cong Li Meng Xiao Meng Xiao Guihai Feng Xin Li Yuanchun Zhou MILM 9 3 0 18 Feb 2024
ToolSword: Unveiling Safety Issues of Large Language Models in Tool Learning Across Three Stages Junjie Ye Sixian Li Guanyu Li Caishuang Huang Songyang Gao Yilong Wu Qi Zhang Tao Gui Xuanjing Huang LLMAG 38 17 0 16 Feb 2024