Deploying-Llama-3.3-70B
Serve Llama 3.3 70B (with AWQ quantization) using vLLM and deploy it on BentoCloud.
- 30
- Python
- Apache-2.0
- 22 mo ago
Serve Llama 3.3 70B (with AWQ quantization) using vLLM and deploy it on BentoCloud.
build and deploy an audio generation API server using Bark and BentoML ecosystem.