Alternatives to avidLearnerInProgress/python-automation-scripts
firecrawl
Knowledge infrastructure to make your agents smarter. Search, scrape and 550+ data providers through one API.
- 203k
- TypeScript
- AGPL-3.0
- 2 h ago
crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.
- 9.7k
- Python
- Apache-2.0
- 1 h ago
Scrapling
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
- 104k
- Python
- BSD-3-Clause
- 2 d ago
omni-verse-reader
The Ultimate Self-Hosted Media Manager 2026: Automate Downloads, Metadata & Sync Anywhere
- 116
- HTML
- 7 h ago
crawl4ai
Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
- 88k
- Python
- Apache-2.0
- 17 h ago
scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
- 65k
- Python
- BSD-3-Clause
- 13 h ago
Side by side
| Name | Stars | License | Language | Last change | In common | Compare |
|---|---|---|---|---|---|---|
| avidLearnerInProgress/python-automation-scripts | 562 | GPL-3.0 | Python | 6 y ago | ||
| psf/requests-html | 14k | MIT | Python | 3 y ago | beautifulsoup | Compare |
| josueBarretogit/manga-tui | 962 | MIT | Rust | 3 d ago | comic-downloader | Compare |
| firecrawl/firecrawl | 203k | AGPL-3.0 | TypeScript | 2 h ago | crawler | Compare |
| apify/crawlee-python | 9.7k | Apache-2.0 | Python | 1 h ago | beautifulsoup, crawler | Compare |
| JonBunator/Quicop | 10 | MIT | TypeScript | 3 y ago | codetopdf, pdf | Compare |
| D4Vinci/Scrapling | 104k | BSD-3-Clause | Python | 2 d ago | crawler | Compare |
| anaskhan96/soup | 2.3k | MIT | Go | 4 wk ago | beautifulsoup | Compare |
| Mutashim99/DocAble | 0 | MIT | C# | 16 mo ago | codetopdf, pdf-converter | Compare |
| RobinDoom/omni-verse-reader | 116 | None declared | HTML | 7 h ago | comic-downloader | Compare |
| unclecode/crawl4ai | 88k | Apache-2.0 | Python | 17 h ago | crawler | Compare |
| shubraj/sourcecodeToPDF | 0 | MIT | HTML | 4 y ago | codetopdf | Compare |
| scrapy/scrapy | 65k | BSD-3-Clause | Python | 13 h ago | crawler | Compare |