cai
User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!
- 204
- Rust
- ISC
- 5 wk ago
User friendly CLI tool for AI tasks. Stop thinking about LLMs and prompts, start getting results!
A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows
Distribute and run llamafile/LLMs with a single docker image.
AI appliance builder. Define AI agents and workflows in YAML. Ship them as Docker, Kubernetes, ISO, or one standalone binary.
Probably one of the lightest native RAG + Agent apps out there,experience the power of Agent-powered models and Agent-driven knowledge bases in one click, without complex configuration.
Text generation model, used with transformers.
Serverless AI Inference with Gemma 2 using Mozilla's llamafile on AWS Lambda
Portable offline AI kit on a USB SSD — run LLM chat + Wikipedia + encrypted vault anywhere. No internet, no install, no subscriptions. Windows/macOS/Linux/Android/iOS. Powered by Qwen3 + llamafile.
This repository demonstrates LLM execution on CPUs using packages like llamafile, emphasizing low-latency, high-throughput, and cost-effective benefits for inference and serving.
An offline knowledge library on a USB drive. Wikipedia, Stack Exchange, Gutenberg, and Khan Academy, plus a local LLM that answers questions using those sources as context. Works on any computer, no internet required.
Run a fully private, offline AI assistant from a USB flash drive — no installation, no internet, no admin rights required.
👾 Self-Healing AI Terminal Assistant — 100% local, offline-capable, privacy-first. Multi-tier LLM (llamafile/GGUF), auto-fix with FixNet consensus, 80+ commands. No cloud, no API keys needed.
Self-hosted, privacy-first grammar checking and AI writing assistance in your browser and across your desktop. Your text only goes to your own server.