ResearchTrend.AI
Purple Llama CyberSecEval: A Secure Coding Benchmark for Language Models

Purple Llama CyberSecEval: A Secure Coding Benchmark for Language Models

Manish P Bhatt
Sahana Chennabasappa
Cyrus Nikolaidis
Shengye Wan
Ivan Evtimov
Dominik Gabi
Daniel Song
Faizan Ahmad
Cornelius Aschermann
Lorenzo Fontana
Sasha Frolov
Ravi Prakash Giri
Dhaval Kapil
Yiannis Kozyrakis
David LeBlanc
James Milazzo
Aleksandar Straumann
Gabriel Synnaeve
Varun Vontimitta
Spencer Whitman
Joshua Saxe
    ELM
ArXiv (abs)PDFHTML

Papers citing "Purple Llama CyberSecEval: A Secure Coding Benchmark for Language Models"

11 / 11 papers shown
Title
A Framework for Evaluating Emerging Cyberattack Capabilities of AI
A Framework for Evaluating Emerging Cyberattack Capabilities of AI
Mikel Rodriguez
Raluca Ada Popa
Four Flynn
Lihao Liang
Allan Dafoe
Anna Wang
ELM
132
8
0
14 Mar 2025
Transferable Foundation Models for Geometric Tasks on Point Cloud Representations: Geometric Neural Operators
Transferable Foundation Models for Geometric Tasks on Point Cloud Representations: Geometric Neural Operators
Blaine Quackenbush
P. Atzberger
3DPCAI4CE
135
1
0
06 Mar 2025
CWEval: Outcome-driven Evaluation on Functionality and Security of LLM Code Generation
CWEval: Outcome-driven Evaluation on Functionality and Security of LLM Code Generation
Jinjun Peng
Leyi Cui
Kele Huang
Junfeng Yang
Baishakhi Ray
ELM
112
13
0
14 Jan 2025
Bridging Today and the Future of Humanity: AI Safety in 2024 and Beyond
Bridging Today and the Future of Humanity: AI Safety in 2024 and Beyond
Shanshan Han
150
1
0
09 Oct 2024
Root Defence Strategies: Ensuring Safety of LLM at the Decoding Level
Root Defence Strategies: Ensuring Safety of LLM at the Decoding Level
Xinyi Zeng
Yuying Shang
Yutao Zhu
Jingyuan Zhang
Yu Tian
AAML
458
4
0
09 Oct 2024
SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safety
SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model Safety
Paul Röttger
Fabio Pernisi
Bertie Vidgen
Dirk Hovy
ELMKELM
154
39
0
08 Apr 2024
Can ChatGPT replace StackOverflow? A Study on Robustness and Reliability of Large Language Model Code Generation
Can ChatGPT replace StackOverflow? A Study on Robustness and Reliability of Large Language Model Code Generation
Li Zhong
Zilong Wang
ELMSILM
87
74
0
20 Aug 2023
AI-assisted Code Authoring at Scale: Fine-tuning, deploying, and mixed methods evaluation
AI-assisted Code Authoring at Scale: Fine-tuning, deploying, and mixed methods evaluation
V. Murali
C. Maddila
Imad Ahmad
Michael Bolin
Daniel Cheng
Negar Ghorbani
Renuka Fernandez
Nachiappan Nagappan
Peter C. Rigby
66
14
0
20 May 2023
How Secure is Code Generated by ChatGPT?
How Secure is Code Generated by ChatGPT?
R. Khoury
Anderson R. Avila
Jacob Brunelle
Baba Mamadou Camara
SILM
85
107
0
19 Apr 2023
Lost at C: A User Study on the Security Implications of Large Language Model Code Assistants
Lost at C: A User Study on the Security Implications of Large Language Model Code Assistants
Gustavo Sandoval
Hammond Pearce
Teo Nys
Ramesh Karri
S. Garg
Brendan Dolan-Gavitt
ELM
67
96
0
20 Aug 2022
Evaluating Large Language Models Trained on Code
Evaluating Large Language Models Trained on Code
Mark Chen
Jerry Tworek
Heewoo Jun
Qiming Yuan
Henrique Pondé
...
Bob McGrew
Dario Amodei
Sam McCandlish
Ilya Sutskever
Wojciech Zaremba
ELMALM
236
5,647
0
07 Jul 2021

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from. See our policy.