1
0
Fork 0
Commit graph

10 commits

Author SHA1 Message Date
Tim Schuster
ba8307c27e Quick Fix for Wrong Argument Splitting on wget
When setting the user agent, the resulting CLI arguments for wget where `['wget', '--timestamping', '--adjust-extension', '--no-parent', '--page-requisites', '--convert-links', '-', '-', 'u', 's', 'e', 'r', '-', 'a', 'g', 'e', 'n', 't', '=', '"', 'L', 'y', 'n', 'x', '"', 'https://example.org']`, with this fix it turns into `['wget', '--timestamping', '--adjust-extension', '--no-parent', '--page-requisites', '--convert-links', '--user-agent="Lynx"', '', 'https://example.org']`
2017-07-08 15:19:43 +02:00
Nick Sweeting
acf59faa06 add custom WGET_USER_AGENT override option 2017-07-06 16:51:41 -05:00
Nick Sweeting
648223fc6c wonky exception 2017-07-05 17:30:00 -05:00
Nick Sweeting
5122fa0738 better format wget output 2017-07-05 17:28:09 -05:00
Nick Sweeting
02f711b8cb fix CHROME_BINARY and TIMEOUT configs not being used 2017-07-05 17:26:36 -05:00
Nick Sweeting
b894e0ff92 properly handle Archive.org denied by robots.txt 2017-07-05 16:57:19 -05:00
Nick Sweeting
a167d2a1f4 colorize output and add progress bar 2017-07-05 16:44:25 -05:00
Nick Sweeting
60ffe0b2b4 hardcode more encodings 2017-07-04 06:26:46 -05:00
Nick Sweeting
881de8adbe minor url fixes and refactoring 2017-07-04 06:24:03 -05:00
Nick Sweeting
fd1435164b split archive.py into multiple files, refactor config system 2017-07-04 05:38:07 -05:00