data-collator

Open repos and models their makers tagged data-collator, most starred first. The same for everyone.

GitHubRepo

UL2_5

GPU-optimized UL2 mixture-of-denoisers data collator for T5/FLAN encoder-decoder pretraining. Supports span corruption, prefix LM, infilling, curriculum learning, Flash Attention unpadding, and HuggingFace Trainer integration.

  • 0
  • Python
  • Apache-2.0
  • 11 mo ago
pszemrajTake it
Search GitHub and Hugging Face for data-collator

Get , open it once and sign in. Then come back here and press the button again.

data-collator: open source repos and models on Take My Repo