END-TO-END-GENERATIVE-AI-PROJECTS
End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects
- 643
- MIT
- 22 mo ago
End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects
Mergekit supports various architectures like Llama, Mistral, and more models, enabling merges on CPU or GPU with low memory needs through lazy tensor loading and out-of-core processing. It handles elaborate operations such as interpolated gradients, frankenmerging (layer-wise), LoRA extraction, and mixture of experts merging. [ by Arcee AI ]