code-bert-score
CodeBERTScore: an automatic metric for code generation, based on BERTScore
- 211
- Jupyter Notebook
- MIT
- 3 y ago
CodeBERTScore: an automatic metric for code generation, based on BERTScore
EVIL (Exploiting software VIa natural Language) is an approach to automatically generate software exploits in assembly/Python language from descriptions in natural language. The approach leverages Neural Machine Translation (NMT) techniques and a dataset that we developed for this work.
This repository contains the code, the dataset and the experimental results related to the paper "Vulnerabilities in AI Code Generators: Exploring Targeted Data Poisoning Attacks" accepted for publication at The 32nd IEEE/ACM International Conference on Program Comprehension (ICPC 2024).
This study compares three transformer-based mod- els—CodeT5, CodeBERT, and CodeGen.