v1v2 (latest)

EvalYaks: Instruction Tuning Datasets and LoRA Fine-tuned Models for Automated Scoring of CEFR B2 Speaking Assessment Transcripts

22 August 2024

Nicy Scaria

Silvester John Joseph Kennedy

Thomas Latinovich

Deepak N. Subramani

ArXiv (abs)PDF HTML

Papers citing "EvalYaks: Instruction Tuning Datasets and LoRA Fine-tuned Models for Automated Scoring of CEFR B2 Speaking Assessment Transcripts"

27 / 27 papers shown

Title
Automated Educational Question Generation at Different Bloom's Skill Levels using Large Language Models: Strategies and Evaluation Nicy Scaria S. Chenna Deepak N. Subramani ELM AI4Ed 62 12 0 08 Aug 2024
Math Multiple Choice Question Generation via Human-Large Language Model Collaboration Jaewook Lee Digory Smith Simon Woodhead Andrew Lan AI4Ed 62 11 0 01 May 2024
Exploring LLM Prompting Strategies for Joint Essay Scoring and Feedback Generation Maja Stahl Leon Biermann Andreas Nehring Henning Wachsmuth 56 40 0 24 Apr 2024
Exploring Automated Distractor Generation for Math Multiple-choice Questions via Large Language Models Wanyong Feng Jaewook Lee Hunter McNichols Alexander Scarlatos Digory Smith Simon Woodhead Nancy Otero Ornelas Andrew Lan AI4Ed LRM 76 12 0 02 Apr 2024
Mixtral of Experts Albert Q. Jiang Alexandre Sablayrolles Antoine Roux A. Mensch Blanche Savary ... Théophile Gervet Thibaut Lavril Thomas Wang Timothée Lacroix William El Sayed MoE LLMAG 159 1,121 0 08 Jan 2024
Mistral 7B Albert Q. Jiang Alexandre Sablayrolles A. Mensch Chris Bamford Devendra Singh Chaplot ... Teven Le Scao Thibaut Lavril Thomas Wang Timothée Lacroix William El Sayed MoE LRM 104 2,238 0 10 Oct 2023
Balancing Specialized and General Skills in LLMs: The Impact of Modern Tuning and Data Strategy Zhengwu Zhang Chen Zheng Da Tang Ke Sun Yukun Ma Yingtong Bu Xun Zhou Liang Zhao ALM 98 32 0 07 Oct 2023
Qwen Technical Report Jinze Bai Shuai Bai Yunfei Chu Zeyu Cui Kai Dang ... Zhenru Zhang Chang Zhou Jingren Zhou Xiaohuan Zhou Tianhang Zhu OSLM 266 1,895 0 28 Sep 2023
Performance of the Pre-Trained Large Language Model GPT-4 on Automated Short Answer Grading Gerd Kortemeyer AI4Ed AI4MH ELM 43 31 0 17 Sep 2023
Towards LLM-based Autograding for Short Textual Answers Johannes Schneider Bernd Schenk Christina Niklaus AI4Ed 66 35 0 09 Sep 2023
A Survey on Large Language Model based Autonomous Agents Lei Wang Chengbang Ma Xueyang Feng Zeyu Zhang Hao-ran Yang ... Xu Chen Yankai Lin Wayne Xin Zhao Zhewei Wei Ji-Rong Wen LLMAG AI4CE LM&Ro 95 1,313 0 22 Aug 2023
EduChat: A Large-Scale Language Model-based Chatbot System for Intelligent Education Yuhao Dan Zhikai Lei Yiyang Gu Yong Li Jia-Peng Yin ... Zeyang Zhou Qin Chen Jie Zhou Liang He Xipeng Qiu ELM 43 91 0 05 Aug 2023
Llama 2: Open Foundation and Fine-Tuned Chat Models Hugo Touvron Louis Martin Kevin R. Stone Peter Albert Amjad Almahairi ... Sharan Narang Aurelien Rodriguez Robert Stojnic Sergey Edunov Thomas Scialom AI4MH ALM 400 12,076 0 18 Jul 2023
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena Lianmin Zheng Wei-Lin Chiang Ying Sheng Siyuan Zhuang Zhanghao Wu ... Dacheng Li Eric Xing Haotong Zhang Joseph E. Gonzalez Ion Stoica ALM OSLM ELM 432 4,422 0 09 Jun 2023
Direct Preference Optimization: Your Language Model is Secretly a Reward Model Rafael Rafailov Archit Sharma E. Mitchell Stefano Ermon Christopher D. Manning Chelsea Finn ALM 389 4,163 0 29 May 2023
Self-Refine: Iterative Refinement with Self-Feedback Aman Madaan Niket Tandon Prakhar Gupta Skyler Hallinan Luyu Gao ... Bodhisattwa Prasad Majumder Katherine Hermann Sean Welleck Amir Yazdanbakhsh Peter Clark ReLM LRM DiffM 178 1,678 0 30 Mar 2023
Reflexion: Language Agents with Verbal Reinforcement Learning Noah Shinn Federico Cassano Beck Labash A. Gopinath Karthik Narasimhan Shunyu Yao LLMAG KELM 135 1,320 0 20 Mar 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.5K 14,748 0 15 Mar 2023
Mixture of Soft Prompts for Controllable Data Generation Derek Chen Celine Lee Yunan Lu Domenic Rosati Zhou Yu 159 26 0 02 Mar 2023
CEFR-Based Sentence Difficulty Annotation and Assessment Yuki Arase Satoru Uchida Tomoyuki Kajiwara 60 25 0 21 Oct 2022
Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks Yizhong Wang Swaroop Mishra Pegah Alipoormolabashi Yeganeh Kordi Amirreza Mirzaei ... Chitta Baral Yejin Choi Noah A. Smith Hannaneh Hajishirzi Daniel Khashabi ELM 123 859 0 16 Apr 2022
Survey of Hallucination in Natural Language Generation Ziwei Ji Nayeon Lee Rita Frieske Tiezheng Yu D. Su ... Delong Chen Wenliang Dai Ho Shu Chan Andrea Madotto Pascale Fung HILM LRM 232 2,435 0 08 Feb 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 847 9,683 0 28 Jan 2022
Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh Albert Webson Colin Raffel Stephen H. Bach Lintang Sutawika ... T. Bers Stella Biderman Leo Gao Thomas Wolf Alexander M. Rush LRM 355 1,709 0 15 Oct 2021
Cross-Task Generalization via Natural Language Crowdsourcing Instructions Swaroop Mishra Daniel Khashabi Chitta Baral Hannaneh Hajishirzi LRM 171 752 0 18 Apr 2021
Are pre-trained text representations useful for multilingual and multi-dimensional language proficiency modeling? Taraka Rama Sowmya Vajjala 17 6 0 25 Feb 2021
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 882 42,463 0 28 May 2020