Is one annotation enough? A data-centric image classification benchmark for noisy and ambiguous label estimation

13 July 2022

Papers citing "Is one annotation enough? A data-centric image classification benchmark for noisy and ambiguous label estimation"

27 / 27 papers shown

Title
Legitimate ground-truth-free metrics for deep uncertainty classification scoring Arthur Pignet Chiara Regniez John Klein 66 1 0 30 Oct 2024
dopanim: A Dataset of Doppelganger Animals with Noisy Annotations from Multiple Humans M. Herde Denis Huseljic Lukas Rauch Bernhard Sick 29 1 0 30 Jul 2024
You can't handle the (dirty) truth: Data-centric insights improve pseudo-labeling Nabeel Seedat Nicolas Huynh F. Imrie Mihaela van der Schaar 38 0 0 19 Jun 2024
Pretrained Visual Uncertainties Michael Kirchhof Mark Collier Seong Joon Oh Enkelejda Kasneci UQCV 394 8 1 26 Feb 2024
The METRIC-framework for assessing data quality for trustworthy AI in medicine: a systematic review Daniel Schwabe Katinka Becker Martin Seyferth Andreas Klass Tobias Schäffter 29 20 0 21 Feb 2024
CODIS: Benchmarking Context-Dependent Visual Comprehension for Multimodal Large Language Models Fuwen Luo Chi Chen Zihao Wan Zhaolu Kang Qidong Yan ... Xiaoyue Mi Peng Li Ning Ma Maosong Sun Yang Janet Liu 35 5 0 21 Feb 2024
Conformalized Credal Set Predictors Alireza Javanmardi David Stutz Eyke Hüllermeier 24 11 0 16 Feb 2024
Pseudo-labelling meets Label Smoothing for Noisy Partial Label Learning Darshana Saravanan Naresh Manwani Vineet Gandhi 17 0 0 07 Feb 2024
Data-Centric Long-Tailed Image Recognition Yanbiao Ma Licheng Jiao Fang Liu Shuyuan Yang Xu Liu Puhua Chen 35 1 0 03 Nov 2023
The Empty Signifier Problem: Towards Clearer Paradigms for Operationalising "Alignment" in Large Language Models Hannah Rose Kirk Bertie Vidgen Paul Röttger Scott A. Hale 41 2 0 03 Oct 2023
Provable advantages of kernel-based quantum learners and quantum preprocessing based on Grover's algorithm Till Muser Elias Zapusek Vasilis Belis Florentin Reiter 28 5 0 25 Sep 2023
VisAlign: Dataset for Measuring the Degree of Alignment between AI and Humans in Visual Perception Jiyoung Lee Seung Wook Kim Seunghyun Won Joonseok Lee Marzyeh Ghassemi James Thorne Jaeseok Choi O.-Kil Kwon E. Choi 27 1 0 03 Aug 2023
URL: A Representation Learning Benchmark for Transferable Uncertainty Estimates Michael Kirchhof Bálint Mucsányi Seong Joon Oh Enkelejda Kasneci UQCV 358 13 0 07 Jul 2023
Annotating Ambiguous Images: General Annotation Strategy for High-Quality Data with Real-World Biomedical Validation Lars Schmarje Vasco Grossmann Claudius Zelenka Johannes Brunger Reinhard Koch 27 1 0 21 Jun 2023
Label Smarter, Not Harder: CleverLabel for Faster Annotation of Ambiguous Image Classification with Higher Quality Lars Schmarje Vasco Grossmann Tim Michels Jakob Nazarenus M. Santarossa Claudius Zelenka Reinhard Koch 34 3 0 22 May 2023
Automotive Perception Software Development: An Empirical Investigation into Data, Annotation, and Ecosystem Challenges Hans-Martin Heyn K. M. Habibullah E. Knauss Jennifer Horkoff Markus Borg Alessia Knauss Polly Jing Li 9 4 0 10 Mar 2023
Probabilistic Contrastive Learning Recovers the Correct Aleatoric Uncertainty of Ambiguous Inputs Michael Kirchhof Enkelejda Kasneci Seong Joon Oh UQCV 351 19 0 06 Feb 2023
$Opportunistic hip fracture risk prediction in Men from X-ray: Findings from the Osteoporosis in Men (MrOS) Study$ Opportunistic hip fracture risk prediction in Men from X-ray: Findings from the Osteoporosis in Men (MrOS) Study Lars Schmarje Stefan Reinhold T. Damm E. Orwoll C. Glüer Reinhard Koch AI4CE OOD 13 2 0 22 Jul 2022
DataPerf: Benchmarks for Data-Centric AI Development Mark Mazumder Colby R. Banbury Xiaozhe Yao Bojan Karlavs W. G. Rojas ... Carole-Jean Wu Cody Coleman Andrew Y. Ng Peter Mattson Vijay Janapa Reddi VLM 33 101 0 20 Jul 2022
Beyond Hard Labels: Investigating data label distributions Vasco Grossmann Lars Schmarje Reinhard Koch 19 11 0 13 Jul 2022
Eliciting and Learning with Soft Labels from Every Annotator K. M. Collins Umang Bhatt Adrian Weller 11 44 0 02 Jul 2022
A Data-Centric Approach for Training Deep Neural Networks with Less Data Mohammad Motamedi Nikolay Sakharnykh T. Kaldewey 59 66 0 07 Oct 2021
A data-centric approach for improving ambiguous labels with combined semi-supervised classification and clustering Lars Schmarje M. Santarossa Simon-Martin Schroder Claudius Zelenka R. Kiko J. Stracke N. Volkmann Reinhard Koch 30 10 0 30 Jun 2021
Correlated Input-Dependent Label Noise in Large-Scale Image Classification Mark Collier Basil Mustafa Efi Kokiopoulou Rodolphe Jenatton Jesse Berent NoLa 178 53 0 19 May 2021
Re-labeling ImageNet: from Single to Multi-Labels, from Global to Localized Labels Sangdoo Yun Seong Joon Oh Byeongho Heo Dongyoon Han Junsuk Choe Sanghyuk Chun 392 142 0 13 Jan 2021
BYOL works even without batch statistics Pierre Harvey Richemond Jean-Bastien Grill Florent Altché Corentin Tallec Florian Strub ... Samuel L. Smith Soham De Razvan Pascanu Bilal Piot Michal Valko SSL 250 114 0 20 Oct 2020
Improved Baselines with Momentum Contrastive Learning Xinlei Chen Haoqi Fan Ross B. Girshick Kaiming He SSL 267 3,369 0 09 Mar 2020