CyberMetric: A Benchmark Dataset based on Retrieval-Augmented Generation
for Evaluating LLMs in Cybersecurity Knowledge

v1v2 (latest)

CyberMetric: A Benchmark Dataset based on Retrieval-Augmented Generation for Evaluating LLMs in Cybersecurity Knowledge

12 February 2024

Norbert Tihanyi

Tamás Bisztray

Merouane Debbah

ArXiv (abs)PDF HTML

Papers citing "CyberMetric: A Benchmark Dataset based on Retrieval-Augmented Generation for Evaluating LLMs in Cybersecurity Knowledge"

4 / 4 papers shown

Title
ACSE-Eval: Can LLMs threat model real-world cloud infrastructure? Sarthak Munshi Swapnil Pathak Sonam Ghatode Thenuga Priyadarshini Dhivya Chandramouleeswaran Ashutosh Rana ELM 156 0 0 16 May 2025
Aligning Offline Metrics and Human Judgments of Value for Code Generation Models Victor C. Dibia Adam Fourney Gagan Bansal Forough Poursabzi-Sangdeh Han Liu Saleema Amershi ALM OffRL 103 12 0 29 Oct 2022
Evaluating Large Language Models Trained on Code Mark Chen Jerry Tworek Heewoo Jun Qiming Yuan Henrique Pondé ... Bob McGrew Dario Amodei Sam McCandlish Ilya Sutskever Wojciech Zaremba ELM ALM 238 5,675 0 07 Jul 2021
DRCD: a Chinese Machine Reading Comprehension Dataset C. Shao Trois Liu Yuting Lai Yiying Tseng Sam S. Tsai 80 128 0 04 Jun 2018

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.