prompt-caching

Open repos and models their makers tagged prompt-caching, most starred first. The same for everyone.

AI agentsRepo

sqz

Context compression for AI coding agents: compresses tool output before it enters the model, dedups repeats to 13-token refs. Claude Code, Cursor, Codex, Kiro, Zed, any MCP client. Rust, zero LLM calls.

  • 679
  • Rust
  • Apache-2.0
  • 10 d ago
ojuschugh1Take it
AI agentsRepo

token-optimizer-mcp

91.5% fewer tokens on tool output on Headroom's own benchmark, where Headroom removes 61.4%. Separately, the same SWE-bench tasks resolved at 0.71x the cost of plain Claude Code. Plus memory across sessions and subscription quota pacing. Claude Code, Codex, Copilot, Gemini and 12 more. Local, MIT.

  • 591
  • JavaScript
  • MIT
  • 5 d ago
ooplesTake it
AI agentsRepo

always-accompany

Companionship, chat, coding, and work share one memory and context framework — the kind of AI you see in science fiction: it keeps you company, and it gets things done with you.(这是一个基于上下文和注意力机制做的一个多元化的agent项目)

  • 461
  • JavaScript
  • AGPL-3.0
  • 3 mo ago
beilusaiyingTake it
Developer toolsRepo

effortless

Mods for Claude Code. effortless picks the reasoning effort for every prompt and shows the cache countdown. textless (desktop app) shows art, quotes and chess instead of the wall of text while Claude works.

  • 358
  • HTML
  • MIT
  • 4 wk ago
HeyCubitTake it
AI on my own machineRepo

awesome-ai-tokenomics

A curated list on AI token economics: what tokens cost, where they get wasted, and how to cut the bill. Tools, benchmarks, papers, and copy-paste configs for the token economy of LLMs and coding agents.

  • 221
  • Python
  • CC0-1.0
  • 9 d ago
QuesmaOrgTake it
AI agentsRepo

multi-agent-reasoning

The Multi-Agent Reasoning framework creates an interactive chatbot where AI agents collaborate via structured reasoning and Swarm Integration for optimal answers. Simulating a team that discusses, debates, and refines responses, it enables complex problem-solving and precise results. Now with Prompt Caching to reduce latency and costs.

  • 189
  • Python
  • MIT
  • 22 mo ago
AdieLaineTake it
AI agentsRepo

autocache

🚀 Autocache - Intelligent Anthropic API Cache Proxy Automatically inject cache-control fields into Claude API requests to reduce costs by up to 90% and latency by up to 85%. Works as a transparent drop-in replacement for popular AI platforms like n8n, Flowise, Make.com, LangChain, and LlamaIndex—no code changes required

  • 177
  • Go
  • MIT
  • 10 mo ago
monteviveTake it
AI agentsRepo

ctx-handoff-mod

Claude Code mod: hands off to a fresh conversation when context fills up, keeps the cache warm while you're away, and turns what you teach Claude into project notes

  • 132
  • TypeScript
  • MIT
  • 11 d ago
cablateTake it
AI on my own machineRepo

Lynn

开源桌面 AI Agent 与 CLI:长期记忆、多 Agent、实时语音;Qwen3.8-27B Coder390 EfficientThink 本地 GGUF(llama.cpp Q2/Q3,内置 Q4 MTP)· Open-source desktop AI agent & CLI with Coder390 local models

  • 73
  • TypeScript
  • Apache-2.0
  • 10 d ago
MerkyorLynnTake it
AI agentsRepo

lemoncrow

A Complete faster runtime for coding agents. Optimize the journey, not the hop. Make coding agents 25% faster and 30% cheaper on average while keeping the quality same or more. Same Task, Same Quality, Faster and Cheaper.

  • 71
  • Python
  • 3 wk ago
AI agentsRepo

observer

Track what every AI coding agent costs and see the limit coming. Per-session, per-model cost for Claude Code, Codex, Cursor and 37 more tools from your provider's own token counts, plus limit gauges, a dangerous-command guard and dashboard terminals. Free, Apache-2.0, runs on your machine.

  • 62
  • Go
  • 1 d ago
Developer toolsRepo

killi

Open-source AI coding agent for your terminal, written in Rust. One 7 MB native binary for Apple Silicon Macs, ~18 MB RAM, 70–90% prompt-cache hits. Works with OpenAI, Anthropic and any compatible LLM; MCP, subagents, plan mode, skills, hooks, AGENTS.md. A lightweight Claude Code / Codex CLI alternative.

  • 55
  • Rust
  • MIT
  • 2 d ago
timwuhaotianTake it
AI on my own machineRepo

rightsize

Make every Claude token count. rightsize picks the right model and effort for each prompt, while keeping cache and context costs low. It learns how you work and gets better over time.

  • 45
  • TypeScript
  • MIT
  • 4 d ago
archid21Take it
Developer toolsRepo

claude-mods

Claude Code mod: context in tokens, 5-hour and weekly limits vs. the clock, prompt cache countdown, session cost and running agents, in one band above the prompt.

  • 30
  • JavaScript
  • Apache-2.0
  • 9 d ago
augiefraTake it
GitHubRepo

frugent

Cost-efficient coding-agent runtime: prefix-aware prompt-cache routing, poisoning-safe semantic cache, budgeted context compression, request batching/dedup, cascading model routing with DP-optimal policies, hard budget scheduling, span-level cost attribution, sandboxed tools, synthetic workload factory. NumPy core, CPU-only torch extra.

  • 37
  • Python
  • MIT
  • 3 wk ago
shinefuerTake it
Search GitHub and Hugging Face for prompt-caching

Get , open it once and sign in. Then come back here and press the button again.

prompt-caching: open source repos and models on Take My Repo