Towards Optimizing the Costs of LLM Usage

Towards Optimizing the Costs of LLM Usage

29 January 2024

Shivanshu Shekhar

Koyel Mukherjee

ArXiv (abs)PDF HTML

Papers citing "Towards Optimizing the Costs of LLM Usage"

13 / 13 papers shown

Title
FAA Framework: A Large Language Model-Based Approach for Credit Card Fraud Investigations Shaun Shuster Eyal Zaloof A. Shabtai Rami Puzis 71 0 0 13 Jun 2025
RedactOR: An LLM-Powered Framework for Automatic Clinical Data De-Identification Praphul Singh Charlotte Dzialo Jangwon Kim Sumana Srivatsa Irfan Bulu Sri Gadde Krishnaram Kenthapadi 27 0 0 23 May 2025
Causal LLM Routing: End-to-End Regret Minimization from Observational Data Asterios Tsiourvas Wei-Ju Sun Georgia Perakis 46 0 0 21 May 2025
Transforming Decoder-Only Transformers for Accurate WiFi-Telemetry Based Indoor Localization Nayan Sanjay Bhatia Katia Obraczka 46 0 0 16 May 2025
Optimizing Large Language Models: Metrics, Energy Efficiency, and Case Study Insights Tahniat Khan Soroor Motie Sedef Akinli Kocak Shaina Raza MQ 75 0 0 07 Apr 2025
Think Together and Work Better: Combining Humans' and LLMs' Think-Aloud Outcomes for Effective Text Evaluation SeongYeub Chu JongWoo Kim MunYong Yi 142 4 0 21 Feb 2025
Optimizing Model Selection for Compound AI Systems Lingjiao Chen Jared Quincy Davis Boris Hanin Peter Bailis Matei A. Zaharia James Zou Ion Stoica 124 4 0 20 Feb 2025
Software Performance Engineering for Foundation Model-Powered Software (FMware) Haoxiang Zhang Shi Chang Arthur Leung Kishanthan Thangarajah Boyuan Chen Hanan Lutfiyya Ahmed E. Hassan 273 1 0 14 Nov 2024
Engineering Trustworthy AI: A Developer Guide for Empirical Risk Minimization Diana Pfau Alexander Jung 75 1 0 25 Oct 2024
LLMProxy: Reducing Cost to Access Large Language Models Noah Martin Abdullah Bin Faisal Hiba Eltigani Rukhshan Haroon Swaminathan Lamelas Fahad Dogar 469 1 0 04 Oct 2024
Concise Thoughts: Impact of Output Length on LLM Reasoning and Cost Sania Nayab Giulio Rossolini Giorgio Buttazzo Nicolamaria Manes F. Giacomelli Nicolamaria Manes Fabrizio Giacomelli LRM 135 42 0 29 Jul 2024
Foundation Models for Autonomous Robots in Unstructured Environments Hossein Naderi Alireza Shojaei Lifu Huang LM&Ro 93 0 0 19 Jul 2024
KG-RAG: Bridging the Gap Between Knowledge and Creativity Diego Sanmartin RALM 86 45 0 20 May 2024