ORAN-Bench-13K: An Open Source Benchmark for Assessing LLMs in Open Radio Access Networks

8 July 2024

Papers citing "ORAN-Bench-13K: An Open Source Benchmark for Assessing LLMs in Open Radio Access Networks"

13 / 13 papers shown

Title
Enhancing Large Language Models (LLMs) for Telecommunications using Knowledge Graphs and Retrieval-Augmented Generation Dun Yuan Hao Zhou Di Wu Xue Liu Hao Chen Yan Xin Jianzhong Zhang RALM 72 0 0 31 Mar 2025
Leveraging Fine-Tuned Retrieval-Augmented Generation with Long-Context Support: For 3GPP Standards Omar Erak Nouf Alabbasi Omar Alhussein Ismail Lotfi Amr Hussein Sami Muhaidat Merouane Debbah RALM 103 5 0 17 Jan 2025
Evaluating the Efficacy of Open-Source LLMs in Enterprise-Specific RAG Systems: A Comparative Study of Performance and Scalability Gautam B A. Purwar 61 14 0 17 Jun 2024
Large Language Model (LLM) for Telecommunications: A Comprehensive Survey on Principles, Key Techniques, and Opportunities Hao Zhou Chengming Hu Ye Yuan Yufei Cui Yili Jin ... Di Wu Xue Liu Charlie Zhang Xianbin Wang Jiangchuan Liu 68 75 0 17 May 2024
Unveiling LLM Evaluation Focused on Metrics: Challenges and Solutions Taojun Hu Xiao-Hua Zhou ELM 77 18 0 14 Apr 2024
CloudEval-YAML: A Practical Benchmark for Cloud Configuration Generation Yifei Xu Yuning Chen Xumiao Zhang Xianshang Lin Pan Hu† ... Songwu Lu Wan Du Z. Mao Ennan Zhai Dennis Cai ALM 55 9 0 10 Nov 2023
TeleQnA: A Benchmark Dataset to Assess Large Language Models Telecommunications Knowledge Ali Maatouk Fadhel Ayed Nicola Piovesan Antonio De Domenico Merouane Debbah Zhi-Quan Luo 68 48 0 23 Oct 2023
Mistral 7B Albert Q. Jiang Alexandre Sablayrolles A. Mensch Chris Bamford Devendra Singh Chaplot ... Teven Le Scao Thibaut Lavril Thomas Wang Timothée Lacroix William El Sayed MoE LRM 74 2,204 0 10 Oct 2023
GPT-4 Technical Report OpenAI OpenAI OpenAI Josh Achiam Steven Adler Sandhini Agarwal Lama Ahmad ... Shengjia Zhao Tianhao Zheng Juntang Zhuang William Zhuk Barret Zoph LLMAG MLLM 1.4K 14,359 0 15 Mar 2023
Large Language Models Encode Clinical Knowledge K. Singhal Shekoofeh Azizi T. Tu S. S. Mahdavi Jason W. Wei ... A. Rajkomar Joelle Barral Christopher Semturs Alan Karthikesalingam Vivek Natarajan LM&MA ELM AI4MH 136 2,334 0 26 Dec 2022
WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domain Raj Sanjay Shah Kunal Chawla Dheeraj Eidnani Agam Shah Wendi Du Sudheer Chava Natraj Raman Charese Smiley Jiaao Chen Diyi Yang AIFin 78 109 0 31 Oct 2022
Vision-Aided 6G Wireless Communications: Blockage Prediction and Proactive Handoff Gouranga Charan Muhammad Alrabeiah Ahmed Alkhateeb 38 134 0 18 Feb 2021
Language Models are Few-Shot Learners Tom B. Brown Benjamin Mann Nick Ryder Melanie Subbiah Jared Kaplan ... Christopher Berner Sam McCandlish Alec Radford Ilya Sutskever Dario Amodei BDL 762 42,055 0 28 May 2020