crawl4ai

Open repos and models their makers tagged crawl4ai, most starred first. The same for everyone.

AI on my own machineRepo

DevDocs

Completely free, private, UI based Tech Documentation MCP server. Designed for coders and software developers in mind. Easily integrate into Cursor, Windsurf, Cline, Roo Code, Claude Desktop App

  • 2.1k
  • TypeScript
  • Apache-2.0
  • 10 mo ago
cyberagiincTake it
AI agentsRepo

n8n-claw

OpenClaw-inspired autonomous AI agent built entirely in n8n. Adaptive RAG-powered memory, Skills via MCP templates, Expert Agents with delegated sub-agents, proactive task management, media understanding - self-hosted with one setup script

  • 565
  • Shell
  • 6 d ago
AI agentsRepo

searxNcrawl

Open-source MCP server that gives AI agents web search (SearXNG) and clean Markdown crawling of pages, whole sites and logged-in areas. Self-hosted, no API key. Firecrawl-compatible API planned.

  • 194
  • Python
  • MIT
  • 5 d ago
AI agentsRepo

crawl4ai-mcp-server

🕷️ A lightweight Model Context Protocol (MCP) server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents. Similar to Firecrawl's API but self-hosted and free. Perfect for integrating web scraping into your AI workflows with OpenAI Agents SDK, Cursor, Claude Code, and other MCP-compatible tools.

  • 118
  • Python
  • MIT
  • 10 mo ago
sadiuysalTake it
AI on my own machineRepo

searxng-mcp

Private web search MCP: SearXNG metasearch → ML reranking → 4-tier fetch cascade (Firecrawl / Crawl4AI / raw / Wayback) with per-domain learning, Ollama query expansion and synthesis. No cloud APIs.

  • 30
  • TypeScript
  • MIT
  • 2 d ago
TadMSTRTake it
AI agentsRepo

wet

Open-source MCP server for AI agents: web search, content extraction, and library docs -- 5-strategy scraping, runs without API keys.

  • 24
  • Python
  • Apache-2.0
  • 1 d ago
n24q02mTake it
AI agentsRepo

bdos-ai-extensions

Community extensions for BDOS AI (Google Ads management) - web scraping (crawl4ai), landing-page & schema audits, URL health, page-change monitoring, content-gap analysis, and profit-driven bidding (marginal ERS). Update-safe, mostly pure-Python, no MCP required.

  • 5
  • Python
  • MIT
  • 5 mo ago
romek-rozenTake it
AI on my own machineRepo

WebScraper_AI_Agent

An AI-powered web scraper built with Crawl4AI that crawls websites, extracts and embeds text using HuggingFace, performs semantic search with FAISS, and answers queries using Langchain and GROQ LLM - all through a simple Gradio UI.

  • 1
  • Python
  • 16 mo ago
jasoncobra3Take it
Search GitHub and Hugging Face for crawl4ai

Get , open it once and sign in. Then come back here and press the button again.