Are You Getting What You Pay For? Auditing Model Substitution in LLM APIs

Are You Getting What You Pay For? Auditing Model Substitution in LLM APIs

7 April 2025

ArXiv (abs)PDF HTML

Papers citing "Are You Getting What You Pay For? Auditing Model Substitution in LLM APIs"

15 / 15 papers shown

Title
Is Your LLM Overcharging You? Tokenization, Transparency, and Incentives Ander Artola Velasco Stratis Tsirtsis Nastaran Okati Manuel Gomez Rodriguez 46 1 0 27 May 2025
Flex-Judge: Think Once, Judge Anywhere Jongwoo Ko S. Kim Sungwoo Cho Se-Young Yun ELM LRM 206 0 0 24 May 2025
Invisible Tokens, Visible Bills: The Urgent Need to Audit Hidden Operations in Opaque LLM Services Guoheng Sun Ziyao Wang Xuandong Zhao Bowei Tian Zheyu Shen Yexiao He Jinming Xing Ang Li 55 0 0 24 May 2025
CoIn: Counting the Invisible Reasoning Tokens in Commercial Opaque LLM APIs Guoheng Sun Ziyao Wang Bowei Tian Meng Liu Zheyu Shen Shwai He Yexiao He Wanghao Ye Yiting Wang Ang Li LRM 54 0 0 19 May 2025
Idiosyncrasies in Large Language Models Mingjie Sun Yida Yin Zhiqiu Xu J. Zico Kolter Zhuang Liu 104 7 0 17 Feb 2025
SVIP: Towards Verifiable Inference of Open-source Large Language Models Yifan Sun Yuhang Li Yue Zhang Yuchen Jin Huan Zhang 55 2 0 29 Oct 2024
Logits of API-Protected LLMs Leak Proprietary Information Matthew Finlayson Xiang Ren Swabha Swayamdipta PILM 87 24 0 14 Mar 2024
Towards Possibilities & Impossibilities of AI-generated Text Detection: A Survey Soumya Suvra Ghosal Souradip Chakraborty Jonas Geiping Furong Huang Dinesh Manocha Amrit Singh Bedi DeLMO 76 37 0 23 Oct 2023
Fast-DetectGPT: Efficient Zero-Shot Detection of Machine-Generated Text via Conditional Probability Curvature Guangsheng Bao Yanbin Zhao Zhiyang Teng Linyi Yang Yue Zhang 66 153 0 08 Oct 2023
Qwen Technical Report Jinze Bai Shuai Bai Yunfei Chu Zeyu Cui Kai Dang ... Zhenru Zhang Chang Zhou Jingren Zhou Xiaohuan Zhou Tianhang Zhu OSLM 264 1,895 0 28 Sep 2023
DNA-GPT: Divergent N-Gram Analysis for Training-Free Detection of GPT-Generated Text Xianjun Yang Wei Cheng Yue Wu Linda R. Petzold William Yang Wang Haifeng Chen DeLMO 85 97 0 27 May 2023
DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature E. Mitchell Yoonho Lee Alexander Khazatsky Christopher D. Manning Chelsea Finn 93 626 0 26 Jan 2023
Training Verifiers to Solve Math Word Problems K. Cobbe V. Kosaraju Mohammad Bavarian Mark Chen Heewoo Jun ... Jerry Tworek Jacob Hilton Reiichiro Nakano Christopher Hesse John Schulman ReLM OffRL LRM 326 4,569 0 27 Oct 2021
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 459 20,317 0 23 Oct 2019
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Jacob Devlin Ming-Wei Chang Kenton Lee Kristina Toutanova VLM SSL SSeg 1.8K 95,175 0 11 Oct 2018