WRENCH: A Comprehensive Benchmark for Weak Supervision

23 September 2021

Yujing Wang

Alexander Ratner

Papers citing "WRENCH: A Comprehensive Benchmark for Weak Supervision"

50 / 85 papers shown

Title
Hide and Seek in Noise Labels: Noise-Robust Collaborative Active Learning with LLM-Powered Assistance Bo Yuan Yulin Chen Yin Zhang Wei Jiang NoLa 37 6 0 03 Apr 2025
Harnessing Multiple Large Language Models: A Survey on LLM Ensemble Zhijun Chen Jingzheng Li Pengpeng Chen Zhuoran Li Kai Sun Yuankai Luo Qianren Mao Dingqi Yang Hailong Sun Philip S. Yu ELM 55 4 0 25 Feb 2025
ScriptoriumWS: A Code Generation Assistant for Weak Supervision Tzu-Heng Huang Catherine Cao Spencer Schoenberg Harit Vishwakarma Nicholas Roberts Frederic Sala NoLa 142 5 0 17 Feb 2025
ARISE: Iterative Rule Induction and Synthetic Data Generation for Text Classification Y. Meena Vaibhav Singh Ayush Maheshwari Amrith Krishna Ganesh Ramakrishnan AI4TS 100 0 0 09 Feb 2025
Knowledge-Infused Prompting: Assessing and Advancing Clinical Text Data Generation with Large Language Models Ran Xu Hejie Cui Yue Yu Xuan Kan Wenqi Shi Yuchen Zhuang Wei Jin Joyce C. Ho Carl Yang 69 14 0 28 Jan 2025
Weak-to-Strong Generalization Through the Data-Centric Lens Changho Shin John Cooper Frederic Sala 88 5 0 05 Dec 2024
Mislabeled examples detection viewed as probing machine learning models: concepts, survey and extensive benchmark Thomas George Pierre Nodet A. Bondu Vincent Lemaire VLM 32 0 0 21 Oct 2024
Cookbook: A framework for improving LLM generative abilities via programmatic data generating templates A. Narayan Mayee F. Chen Kush S. Bhatia Christopher Ré SyDa 36 3 0 07 Oct 2024
A Weakly Supervised Data Labeling Framework for Machine Lexical Normalization in Vietnamese Social Media Dung Ha Nguyen Anh Thi Hoang Nguyen Kiet Van Nguyen 24 1 0 30 Sep 2024
Interactive Machine Teaching by Labeling Rules and Instances Giannis Karamanolakis Daniel J. Hsu Luis Gravano 33 0 0 08 Sep 2024
LLM-assisted Labeling Function Generation for Semantic Type Detection Chenjie Li Dan Zhang Jin Wang 35 0 0 28 Aug 2024
The ALCHEmist: Automated Labeling 500x CHEaper Than LLM Data Annotators Tzu-Heng Huang Catherine Cao Vaishnavi Bhargava Frederic Sala 33 3 0 25 Jun 2024
Detecting Errors through Ensembling Prompts (DEEP): An End-to-End LLM Framework for Detecting Factual Errors Alex Chandler Devesh Surve Hui Su HILM UQCV 28 1 0 18 Jun 2024
WeShap: Weak Supervision Source Evaluation with Shapley Values Naiqing Guan Nick Koudas 60 0 0 16 Jun 2024
Theoretical Analysis of Weak-to-Strong Generalization Hunter Lang David Sontag Aravindan Vijayaraghavan 25 20 0 25 May 2024
Convergence Behavior of an Adversarial Weak Supervision Method Steven An Sanjoy Dasgupta 23 0 0 25 May 2024
NoiseBench: Benchmarking the Impact of Real Label Noise on Named Entity Recognition Elena Merdjanovska Ansar Aynetdinov Alan Akbik NoLa 31 1 0 13 May 2024
A Simple but Effective Approach to Improve Structured Language Model Output for Information Extraction Yinghao Li R. Ramprasad Chao Zhang 95 11 0 20 Feb 2024
Numerical Claim Detection in Finance: A New Financial Dataset, Weak-Supervision Model, and Market Analysis Agam Shah Arnav Hiray Pratvi Shah Arkaprabha Banerjee Anushka Singh Dheeraj Eidnani Bhaskar Chaudhury S. Chava 31 3 0 18 Feb 2024
Leveraging Large Language Models for Structure Learning in Prompted Weak Supervision Jinyan Su Peilin Yu Jieyu Zhang Stephen H. Bach 24 2 0 02 Feb 2024
Fusing Conditional Submodular GAN and Programmatic Weak Supervision Kumar Shubham Pranav Sastry AP Prathosh 27 1 0 16 Dec 2023
How Many Validation Labels Do You Need? Exploring the Design Space of Label-Efficient Model Ranking Zhengyu Hu Jieyu Zhang Yue Yu Yuchen Zhuang Hui Xiong 26 5 0 04 Dec 2023
Noise-Robust Fine-Tuning of Pretrained Language Models via External Guidance Song Wang Zhen Tan Ruocheng Guo Wenlin Yao NoLa 25 20 0 02 Nov 2023
Can Large Language Models Design Accurate Label Functions? Naiqing Guan Kaiwen Chen Nick Koudas ALM 23 7 0 01 Nov 2023
Utilizing Weak Supervision To Generate Indonesian Conservation Dataset Mega Fransiska Diah Pitaloka Saripudin Satrio Putra Lintang Sutawika 27 0 0 17 Oct 2023
Making Scalable Meta Learning Practical Sang Keun Choe Sanket Vaibhav Mehta Hwijeen Ahn W. Neiswanger Pengtao Xie Emma Strubell Eric P. Xing 47 15 0 09 Oct 2023
Neural-Hidden-CRF: A Robust Weakly-Supervised Sequence Labeler Zhijun Chen Hailong Sun Wanhao Zhang Chunyi Xu Qianren Mao Pengpeng Chen BDL 17 6 0 10 Sep 2023
Incorporating Dictionaries into a Neural Network Architecture to Extract COVID-19 Medical Concepts From Social Media A. Hasan M. Levene David J. Weston 19 0 0 05 Sep 2023
Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification Neel Guha Mayee F. Chen Kush S. Bhatia Azalia Mirhoseini Frederic Sala Christopher Ré 32 4 0 20 Jul 2023
RACH-Space: Reconstructing Adaptive Convex Hull Space with Applications in Weak Supervision Woojoo Na Abiy Tasissa 21 0 0 10 Jul 2023
Pareto Optimal Learning for Estimating Large Language Model Errors Theodore Zhao Mu-Hsin Wei J. S. Preston Hoifung Poon 19 6 0 28 Jun 2023
LabelBench: A Comprehensive Framework for Benchmarking Adaptive Label-Efficient Learning Jifan Zhang Yifang Chen Gregory H. Canal Stephen Mussmann Arnav M. Das ... Yinglun Zhu Jeffrey Bilmes S. Du Kevin G. Jamieson Robert D. Nowak VLM 33 10 0 16 Jun 2023
Re-Benchmarking Pool-Based Active Learning for Binary Classification Po-Yi Lu Chun-Liang Li Hsuan-Tien Lin 15 7 0 15 Jun 2023
TART: A plug-and-play Transformer module for task-agnostic reasoning Kush S. Bhatia A. Narayan Chris De Sa Christopher Ré LRM ReLM VLM 28 14 0 13 Jun 2023
Weakly-Supervised Scientific Document Classification via Retrieval-Augmented Multi-Stage Training Ran Xu Yue Yu Joyce C. Ho Carl Yang 47 21 0 12 Jun 2023
Learning with Noisy Labels by Adaptive Gradient-Based Outlier Removal Anastasiia Sedova Lena Zellinger Benjamin Roth 14 2 0 07 Jun 2023
Local Boosting for Weakly-Supervised Learning Rongzhi Zhang Yue Yu Jiaming Shen Xiquan Cui Chao Zhang WSOL 39 2 0 05 Jun 2023
An Adaptive Method for Weak Supervision with Drifting Data Alessio Mazzetto Reza Esfandiarpoor E. Upfal Stephen H. Bach Stephen H. Bach 65 1 0 02 Jun 2023
DyGen: Learning from Noisy Labels via Dynamics-Enhanced Generative Modeling Yuchen Zhuang Yue Yu Lingkai Kong Xiang Chen Chao Zhang NoLa SyDa AI4CE 22 13 0 30 May 2023
Alfred: A System for Prompted Weak Supervision Peilin Yu Stephen H. Bach 19 7 0 29 May 2023
Weaker Than You Think: A Critical Look at Weakly Supervised Learning D. Zhu Xiaoyu Shen Marius Mosbach Andreas Stephan Dietrich Klakow NoLa 31 9 0 27 May 2023
A Benchmark on Extremely Weakly Supervised Text Classification: Reconcile Seed Matching and Prompting Approaches Zihan Wang Tianle Wang Dheeraj Mekala Jingbo Shang VLM 29 8 0 22 May 2023
ReGen: Zero-Shot Text Classification via Training Data Generation with Progressive Dense Retrieval Yue Yu Yuchen Zhuang Rongzhi Zhang Yu Meng Jiaming Shen Chao Zhang VLM 38 33 0 18 May 2023
DataComp: In search of the next generation of multimodal datasets S. Gadre Gabriel Ilharco Alex Fang J. Hayase Georgios Smyrnis ... A. Dimakis J. Jitsev Y. Carmon Vaishaal Shankar Ludwig Schmidt VLM 30 412 0 27 Apr 2023
A Benchmark Generative Probabilistic Model for Weak Supervised Learning Georgios Th. Papadopoulos Fran Silavong Sean J. Moran SyDa 21 0 0 31 Mar 2023
Mitigating Source Bias for Fairer Weak Supervision Changho Shin Sonia Cromp Dyah Adila Frederic Sala 29 2 0 30 Mar 2023
Identification of Negative Transfers in Multitask Learning Using Surrogate Models Dongyue Li Huy Le Nguyen Hongyang R. Zhang 42 12 0 25 Mar 2023
Learning with Explanation Constraints Rattana Pukdee Dylan Sam J. Zico Kolter Maria-Florina Balcan Pradeep Ravikumar FAtt 32 6 0 25 Mar 2023
Weakly Supervised Label Learning Flows You Lu Chidubem Arachie Bert Huang 23 0 0 19 Feb 2023
Learning from Noisy Crowd Labels with Logics Zhijun Chen Hailong Sun Haoqian He Pengpeng Chen NoLa NAI 32 7 0 13 Feb 2023