internet-archiving

Open repos and models their makers tagged internet-archiving, most starred first. The same for everyone.

Run my own servicesRepo

wikipedia-mirror

🌐 Guide and tools to run a full offline mirror of Wikipedia.org with three different approaches: Nginx caching proxy, Kiwix + ZIM dump, and MediaWiki/XOWA + XML dump

  • 556
  • PLpgSQL
  • MIT
  • 20 mo ago
pirateTake it
Developer toolsRepo

abx-dl

⬇️ A simple all-in-one CLI tool to download EVERYTHING from a URL (like youtube-dl/yt-dlp, forum-dl, gallery-dl, simpler ArchiveBox). 🎭 Uses headless Chrome to get HTML, JS, CSS, images/video/audio/subtitles, PDFs, screenshots, article text, git repos, and more...

  • 154
  • Python
  • MIT
  • 7 h ago
ArchiveBoxTake it
Data and analyticsRepo

abx-plugins

🧩 Plugins and extractors that ArchiveBox + abx-dl use: chrome, ytdlp, wget, singlefile, readability, forum-dl, gallery-dl, papers-dl, and more...

  • 20
  • Python
  • MIT
  • 5 h ago
ArchiveBoxTake it
GitHubRepo

archivebox-js

</> JS Port of ArchiveBox so that it can run fully in-browser, using modern WACZ + CDX capture based on webrecorder + WASM to run Python plugins in-browser using pyiodide. Lets us run the full ArchiveBox plugin suite directly inside the ArchiveBox Browser Extension without a separate remote server.

  • 3
  • TypeScript
  • AGPL-3.0
  • 13 d ago
ArchiveBoxTake it
Search GitHub and Hugging Face for internet-archiving

Get , open it once and sign in. Then come back here and press the button again.

internet-archiving: open source repos and models on Take My Repo