forks/archivebox
1
0
Fork 0
Code Releases Activity
Open source self-hosted web archiving https://github.com/ArchiveBox/ArchiveBox
486 commits 1 branch 28 tags 7.9 MiB
Python 69%
HTML 24.6%
CSS 2%
Dockerfile 2%
Shell 1.3%
Other 1%
Find a file
Nick Sweeting 2c76f29b78
better issue template
2019-01-22 19:16:09 -05:00
.github better issue template 2019-01-22 19:16:09 -05:00
archivebox add chrome user agent example in config 2019-01-20 14:08:33 -05:00
bin install youtubedl in setup 2019-01-12 03:14:07 -05:00
docs@d8ed24c6df update docs version 2019-01-20 14:08:49 -05:00
etc fix etc nginx and Docker config 2019-01-16 09:20:15 -05:00
.dockerignore fix etc nginx and Docker config 2019-01-16 09:20:15 -05:00
.gitignore Update .gitignore 2018-12-31 20:57:12 -05:00
.gitmodules add docs 2018-12-31 20:59:36 -05:00
_config.yml Set theme jekyll-theme-merlot 2019-01-10 14:00:41 -05:00
archive fix the setup/archive symlinks 2018-12-21 22:10:25 +00:00
CNAME Create CNAME 2018-12-31 21:18:34 -05:00
docker-compose.yml fix etc nginx and Docker config 2019-01-16 09:20:15 -05:00
Dockerfile fix etc nginx and Docker config 2019-01-16 09:20:15 -05:00
LICENSE Initial commit 2017-05-05 04:50:15 -04:00
README.md Update README.md 2019-01-18 17:45:48 -05:00
setup clean up binaries in PATH 2018-12-21 18:21:03 -05:00

README.md

Logo

ArchiveBox
The open source self-hosted web archive Github Stars Twitter URL

(Recently renamed from Bookmark Archiver)

"Your own personal Way-Back Machine"

💻 Demo | Website | Source | Changelog | Roadmap

▶️ Quickstart | Details | Configuration | Troubleshooting

ArchiveBox saves an archived copy of the websites you visit into a local browsable folder (the actual content of each site, not just the list of links). It can archive your entire browsing history, or import links from bookmarks managers, rss, text files and more.

Can import links from:

  • Browser history or bookmarks (Chrome, Firefox, Safari, IE, Opera)
  • Pocket
  • Pinboard
  • RSS or plain text lists
  • Shaarli, Delicious, Instapaper, Reddit Saved Posts, Wallabag, Unmark.it, and more!

Can save these things for each site:

  • Favicon
  • Browsable static HTML archive (wget)
  • PDF (Chrome headless)
  • Screenshot (Chrome headless)
  • HTML DUMP after 2s of JS running in Chrome headless
  • Git repo download (git clone)
  • Media download (youtube-dl: video, audio, subtitles, including playlists)
  • WARC archive (wget warc)
  • Submits URL to archive.org
  • Index summary pages: index.html & index.json

The archiving is additive, so you can schedule ./archive to run regularly and pull new links into the index. All the saved content is static and indexed with JSON files, so it lives forever & is easily parseable, it requires no always-running backend.

DEMO: archive.sweeting.me 网站存档 / 爬虫

git clone https://github.com/pirate/ArchiveBox.git
cd ArchiveBox
./setup

# Export your bookmarks, then run the archive command to start archiving!
./archive ~/Downloads/firefox_bookmarks.html

# Or to add just one page to your archive
echo 'https://example.com' | ./archive

Documentation

We use the Github wiki system for documentation.

You can also access the docs locally by looking in the ArchiveBox/docs/ folder.

Getting Started

Reference

More Info

Screenshots

Desktop ScreenshotMobile Screenshot
CLI Screenshot

Twitter URL