web-scraper

Open repos and models their makers tagged web-scraper, most starred first. The same for everyone.

AI agentsRepo

Scrapling

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

  • 104k
  • Python
  • BSD-3-Clause
  • 2 d ago
D4VinciTake it
AI agentsRepo

crw

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

  • 1.3k
  • Rust
  • AGPL-3.0
  • 6 h ago
fastcrwTake it
Websites and appsRepo

google-play-scraper

Google Play scraper for Node.js with a fully typed TypeScript API. App details, search, top charts, reviews, permissions and data safety. A modern replacement for the unmaintained google-play-scraper.

  • 106
  • TypeScript
  • MIT
  • 13 h ago
MrAdex77Take it
DatabasesRepo

makra

Makra is a memory layer between the web and your AI agents. It serves real-time structured data from the open web at the cost of a vector search.

  • 30
  • Python
  • MIT
  • 3 mo ago
makralabsTake it
Search GitHub and Hugging Face for web-scraper

Get , open it once and sign in. Then come back here and press the button again.

web-scraper: open source repos and models on Take My Repo