code-bert-score
CodeBERTScore: an automatic metric for code generation, based on BERTScore
- 211
- Jupyter Notebook
- MIT
- 3 y ago
CodeBERTScore: an automatic metric for code generation, based on BERTScore
EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
Domain-specific adaptation of CodeT5 for Python docstring generation. Compares pre-trained vs fine-tuned performance using NLP metrics (ROUGE, METEOR, BERTScore), showing significant improvements after targeted training.