Alternatives to commoncrawl/whirlwind-python
ArchiveBox
🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...
- 29k
- Python
- MIT
- 14 h ago
dsh-purge
DeepSeek Harness 破甲 (mirror of YuJunZhiXue/dsh-purge) — 上游即将删库,此为本仓库全量镜像:含全部分支/73 个 tag/完整提交历史。原作者署名与二开要求见 README 署名章节。
- 5.6k
- JavaScript
- MIT
- 6 wk ago
learn-claude-code
Bash is all you need - A nano claude code–like 「agent harness」, built from 0 to 1
- 81k
- Python
- MIT
- 6 d ago
cdx_toolkit
A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine
- 225
- Python
- Apache-2.0
- 5 wk ago
LinkAce
LinkAce is a self-hosted archive to collect links of your favorite websites.
- 3.4k
- PHP
- GPL-3.0
- 6 d ago
ai-engineering-from-scratch
Learn AI Engineering! Learn it. Build it. Ship it for others.
- 80k
- Python
- MIT
- 3 d ago
CommonCrawlDocumentDownload
A small tool which uses the CommonCrawl URL Index to download documents with certain file types or mime-types. This is used for mass-testing of frameworks like Apache POI and Apache Tika
- 74
- Java
- BSD-2-Clause
- 7 wk ago
Side by side
| Name | Stars | License | Language | Last change | In common | Compare |
|---|---|---|---|---|---|---|
| commoncrawl/whirlwind-python | 47 | Apache-2.0 | Python | 2 d ago | ||
| tubearchivist/tubearchivist | 8.6k | GPL-3.0 | Python | 4 wk ago | archive | Compare |
| practical-tutorials/project-based-learning | 290k | MIT | Python | 5 d ago | tutorial | Compare |
| ArchiveBox/ArchiveBox | 29k | MIT | Python | 14 h ago | warc | Compare |
| kalcaddle/KodExplorer | 6.4k | None declared | PHP | 6 wk ago | archive | Compare |
| datawhalechina/hello-agents | 88k | None declared | Python | 8 d ago | tutorial | Compare |
| commoncrawl/news-crawl | 384 | Apache-2.0 | Java | 7 d ago | warc | Compare |
| mmparko/dsh-purge | 5.6k | MIT | JavaScript | 6 wk ago | archive | Compare |
| shareAI-lab/learn-claude-code | 81k | MIT | Python | 6 d ago | tutorial | Compare |
| commoncrawl/cdx_toolkit | 225 | Apache-2.0 | Python | 5 wk ago | warc | Compare |
| Kovah/LinkAce | 3.4k | GPL-3.0 | PHP | 6 d ago | archive | Compare |
| rohitg00/ai-engineering-from-scratch | 80k | MIT | Python | 3 d ago | tutorial | Compare |
| centic9/CommonCrawlDocumentDownload | 74 | BSD-2-Clause | Java | 7 wk ago | warc | Compare |


