P-tuning-v2
An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
- 2.1k
- Python
- Apache-2.0
- 3 y ago
An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks
word2vec, sentence2vec, machine reading comprehension, dialog system, text classification, pretrained language model (i.e., XLNet, BERT, ELMo, GPT), sequence labeling, information retrieval, information extraction (i.e., entity, relation and event extraction), knowledge graph, text generation, network embedding
ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
[NeurIPS 2023] This is the code for the paper `Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Bias`.
Official implementation of the ACL 2024: Scientific Inspiration Machines Optimized for Novelty
[WWW 2022] Topic Discovery via Latent Space Clustering of Pretrained Language Model Representations
It is a comprehensive resource hub compiling all LLM papers accepted at the International Conference on Learning Representations (ICLR) in 2024.
[NeurIPS 2022] Generating Training Data with Language Models: Towards Zero-Shot Language Understanding
Implementation of ICLR 21 paper: Probing BERT in Hyperbolic Spaces
EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
[KDD22] Official PyTorch implementation for "Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning".
[ACL2023] Preserving Commonsense Knowledge from Pre-trained Language Models via Causal Inference
Official implementation of the ACL Findings 2023 paper: Multimedia Generative Script Learning for Task Planning
Code for the ACL2022 paper "C-MORE: Pretraining to Answer Open-Domain Questions by Consulting Millions of References"
[EMNLP 2024] Official Implementation of DisGeM: Distractor Generation for Multiple Choice Question with Span Masking
Source code of "PeerDA: Data Augmentation via Modeling Peer Relation for Span Identification Tasks" (ACL23)