OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
- 13k
- Python
- Apache-2.0
- 5 d ago
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Repo for vLLM Hook, an vLLM plug-in for programming internal states of models deployed on vLLM
LM Studio: Local LLM Desktop Runtime with Offline Inference and Model Management
Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies" and "Cognitive Edge Computing: A Comprehensive Survey on Optimizing Large Models and AI Agents for Pervasive Deployment"
Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)
EmbeddedLLM: API server for Embedded Device Deployment. Currently support CUDA/OpenVINO/IpexLLM/DirectML/CPU
Run Qwen3.8-Flash-Next on one AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). EXL3 4.05 and 3.05 bpw packs, own ROCm/HIP kernels, OpenAI-compatible server, 4 sessions of 262K context, setup guide included.
Streamlining the process for seamless execution of PyCoral in running TensorFlow Lite models on an Edge TPU USB.
Генерация описаний к изображениям с помощью различных архитектур нейронных сетей
Deploy DeepSeek-V4.1 (dsv4.1) on Ascend 910B / 910B3 (NPU): a hardware-specialized LLM inference engine with W4A8, DSpark speculative decoding, 128K+ context and 8,700+ tok/s prefill. Also supports NVIDIA A100/A800. 昇腾910B 部署 DeepSeek-V4.1-Flash。
AI Dev OS is a production-grade autonomous AI agent orchestration platform that combines six cutting-edge AI/ML technologies into a unified workflow. It enables autonomous agents to handle complete engineering tasks—from design through deployment—with human oversight at critical checkpoints.
Image Classifiers are used in the field of computer vision to identify the content of an image and it is used across a broad variety of industries, from advanced technologies like autonomous vehicles and augmented reality, to eCommerce platforms, and even in diagnostic medicine.
Deep learning solution for apple disease detection using CNN architecture. Trained on PlantVillage dataset to classify 4 apple leaf conditions with real-time image analysis.
Successfully established a multiclass text classification model by fine-tuning pretrained DistilBERT transformer model to classify several distinct types of mental health statuses such as anxiety, stress, personality disorder, etc. with an accuracy of 77%.
Successfully developed a multiclass text classification model by fine-tuning pretrained DistilBERT transformer model to classify various distinct types of luxury apparels into their respective categories i.e. pants, accessories, underwear, shoes, etc.
Successfully established an LSTM model to effectively forecast global equity based on over 20+ years of historical data of global equity.
Successfully developed a wildlife detection model using Faster R-CNN to identify and localize animals in natural habitats, supporting conservation efforts and ecological research.
Successfully established an image classification model using PyTorch to classify the images of several distinct natural sceneries such as mountains, glaciers, forests, seas, streets and buildings with an accuracy of 86%.
Successfully developed an image classification model using PyTorch to classify two types of oral diseases, namely caries and gingivitis.
Successfully established an ANN model which can classify wine cultivators based on several characteristics of distinct wines.
Successfully developed an image classification model using PyTorch to classify the species of grapevine leaves based on their corresponding images.