model-inference

Open repos and models their makers tagged model-inference, most starred first. The same for everyone.

AI on my own machineRepo

crucible-strix-halo

Run Qwen3.8-Flash-Next on one AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). EXL3 4.05 and 3.05 bpw packs, own ROCm/HIP kernels, OpenAI-compatible server, 4 sessions of 262K context, setup guide included.

  • 35
  • Python
  • Apache-2.0
  • 2 d ago
jaedyncTake it
AI on my own machineRepo

ljqinfer

Deploy DeepSeek-V4.1 (dsv4.1) on Ascend 910B / 910B3 (NPU): a hardware-specialized LLM inference engine with W4A8, DSpark speculative decoding, 128K+ context and 8,700+ tok/s prefill. Also supports NVIDIA A100/A800. 昇腾910B 部署 DeepSeek-V4.1-Flash。

  • 7
  • C++
  • MIT
  • 6 d ago
lsdefineTake it
AI on my own machineRepo

AI-DEV-OS

AI Dev OS is a production-grade autonomous AI agent orchestration platform that combines six cutting-edge AI/ML technologies into a unified workflow. It enables autonomous agents to handle complete engineering tasks—from design through deployment—with human oversight at critical checkpoints.

  • 7
  • Python
  • MIT
  • 5 mo ago
Imposter-zxTake it
Computer visionRepo

sagemaker-ML-workflow

Image Classifiers are used in the field of computer vision to identify the content of an image and it is used across a broad variety of industries, from advanced technologies like autonomous vehicles and augmented reality, to eCommerce platforms, and even in diagnostic medicine.

  • 4
  • HTML
  • 4 y ago
Data and analyticsRepo

Mental-Health-Classification-using-fine-tuned-DistilBERT

Successfully established a multiclass text classification model by fine-tuning pretrained DistilBERT transformer model to classify several distinct types of mental health statuses such as anxiety, stress, personality disorder, etc. with an accuracy of 77%.

  • 1
  • Jupyter Notebook
  • Apache-2.0
  • 23 mo ago
SayamAltTake it
Language and translationRepo

Luxury-Apparel-Product-Category-Classification-using-fine-tuned-DistilBERT

Successfully developed a multiclass text classification model by fine-tuning pretrained DistilBERT transformer model to classify various distinct types of luxury apparels into their respective categories i.e. pants, accessories, underwear, shoes, etc.

  • 0
  • Jupyter Notebook
  • MIT
  • 23 mo ago
SayamAltTake it
Search GitHub and Hugging Face for model-inference

Get , open it once and sign in. Then come back here and press the button again.

model-inference: open source repos and models on Take My Repo