github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,243 Commits 1 Branch 0 Tags
0055fdd714d848c9cc54354ea6d60abcfd335979
Commit Graph

1243 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
0055fdd714 change OAuth test server 
DNS record for oauthbin.com expired
 2018-06-28 14:32:02 +02:00
Mike Fährmann
9e3415886c [senmanga] fix/update tests 2018-06-27 20:05:22 +02:00
Mike Fährmann
973cf98e88 fix download skip for files without extension 2018-06-27 17:16:07 +02:00
Mike Fährmann
b8c97d2295 use 'extractor.request()' for more HTTP requests 2018-06-25 23:40:59 +02:00
Mike Fährmann
cc15c6105c release version 1.4.1 2018-06-22 16:35:21 +02:00
Mike Fährmann
150a6b9064 [xvideos] fix metadata extraction 2018-06-22 16:32:04 +02:00
Mike Fährmann
7a98cc9798 [smugmug] update tests 
My test account expired and all uploaded images got deleted.
 2018-06-22 15:04:31 +02:00
Mike Fährmann
4eb94aca17 [postprocessor:ugoira] pass '-f' if not present 2018-06-22 13:26:17 +02:00
Mike Fährmann
0c1c4557dd [postprocessor:ugoira] add option for two-pass encoding 2018-06-20 18:48:10 +02:00
Mike Fährmann
a9e276bc37 reset delete-flag 
Since 'PathFormat' objects are being reused, setting `delete`
to True once caused all files downloaded after to be deleted as well.
 2018-06-20 18:12:59 +02:00
Mike Fährmann
91340d9d27 [pixiv] fix ugoira test 2018-06-18 19:22:54 +02:00
Mike Fährmann
709c5d466d add '--zip' and '--ugoira-conv' command-line options 2018-06-18 18:14:38 +02:00
Mike Fährmann
eb7a1f3b98 [pixiv] rework ugoira handling 
Frame information now gets attached to the ZIP file's keyword dict
instead of being written to a separate text file.
 2018-06-18 17:57:57 +02:00
Mike Fährmann
017188d268 improve extractor.request() 
Replace the 'fatal' parameter with 'expect', which is a list/range
of HTTP status codes >= 400 that should also be accepted.
 2018-06-18 16:29:56 +02:00
Mike Fährmann
b84e71da91 add postprocessor documentation to configuration.rst 2018-06-16 15:46:41 +02:00
Mike Fährmann
613b692275 [postprocessor:ugoira] add a few options 
- ffmpeg-location: path to the ffmpeg (or avconv) executable
- ffmpeg-args: additional command line args for ffmpeg
- extension: filename extension of the resulting video file
 2018-06-16 12:03:53 +02:00
Mike Fährmann
a444755979 [postprocessor] add 'ugoira' to convert pixiv animations to webm 2018-06-15 20:28:59 +02:00
Mike Fährmann
f10bd5cdbe [4chan] unescape filenames 2018-06-12 23:19:38 +02:00
Mike Fährmann
eec081dd3e [postprocessor:zip] delete directory (#85) 2018-06-11 18:08:12 +02:00
Mike Fährmann
2d1a104739 [mangadex] unescape manga names and chapter titles 
pretty sure I previously tested if unescaping strings from the
embedded JSON object was necessary ... maybe they changed it
 2018-06-11 17:53:21 +02:00
Mike Fährmann
3bcce77f6d release version 1.4.0 2018-06-08 22:21:35 +02:00
Mike Fährmann
6ac403c5d3 add postprocessor config example 2018-06-08 18:31:59 +02:00
Mike Fährmann
2403c405e3 Merge branch 'postprocessor' 2018-06-08 17:43:11 +02:00
Mike Fährmann
baccf8a958 improve postprocessor handling 
- add pathfmt argument for __init__()
- add finalization step
- add option to keep or delete zipped files
 2018-06-08 17:39:02 +02:00
Mike Fährmann
2628911ba0 [pp:exec] add 'async' option 2018-06-07 23:35:18 +02:00
Mike Fährmann
7646bdbcfd improve postprocessor initialization code 2018-06-07 22:29:54 +02:00
Mike Fährmann
b344f2290f fix downloader tests 2018-06-07 22:27:36 +02:00
Mike Fährmann
37d97ff02c [pp:classify] use temppath 2018-06-06 21:11:20 +02:00
Mike Fährmann
97189e50cd [pp:zip] use temppath; add options 2018-06-06 20:49:52 +02:00
Mike Fährmann
821535b458 adjust PathFormat class 2018-06-06 20:17:17 +02:00
Mike Fährmann
a47c6136cd [simplyhentai] avoid redirects for all-pages.json (#89) 2018-06-01 22:06:34 +02:00
Mike Fährmann
ad14de19c6 [imgur] support "unmuted" URLs 2018-05-30 16:19:01 +02:00
Mike Fährmann
72e66f0aac [simplyhentai] improve URL pattern 
[ci skip]
 2018-05-30 11:44:43 +02:00
Mike Fährmann
cdcc3427a0 [simplyhentai] add video extractor (#89) 
All videos hosted on their own servers seem be to dead,
but myhentai.tv embeds, which are most of the videos, work fine.
 2018-05-30 11:25:23 +02:00
Mike Fährmann
f9a6a19658 [simplyhentai] add image extractor (#89) 2018-05-30 10:58:48 +02:00
Mike Fährmann
ebf596b399 [pawoo] restore metadata fields + smaller improvements 2018-05-29 11:02:14 +02:00
Mike Fährmann
f7e7306e5a [komikcast] update URL pattern and unescape image URLs 2018-05-29 10:35:08 +02:00
Mike Fährmann
70f3617d88 [mangafox] fix URL extraction 2018-05-29 10:34:04 +02:00
Mike Fährmann
a62bd81e9b [pixiv] fix filter for 'type=all' 2018-05-29 10:30:41 +02:00
Mike Fährmann
12797e3b1f update configuration.rst 
... again

- some more 'Path' references
- fixed some inconsistencies and errors
- added note about logging config for files
 2018-05-28 22:14:38 +02:00
Mike Fährmann
c43f02245f update configuration.rst 
- fix default values for 'log' and 'unsupportedfile'

[ci skip]
 2018-05-27 17:12:57 +02:00
Mike Fährmann
dacda69c9e update configuration.rst 
- document logging options
- add a section for "custom types"

[ci skip]
 2018-05-27 16:50:35 +02:00
Mike Fährmann
55b0913412 [simplyhentai] add gallery extractor (#89) 2018-05-27 15:25:04 +02:00
Mike Fährmann
ae9a37a528 implement text.split_html() 2018-05-27 15:00:41 +02:00
Mike Fährmann
53f36176fd update configuration.rst 
- update the API Tokens & IDs section
  - mention redirect URIs for deviantart
  - include api-secret for tumblr
  - add instructions for smugmug
- [ci skip]
 2018-05-26 11:26:50 +02:00
Mike Fährmann
b08d95ebe4 add an 'encoding' option for logging files (default 'utf-8') 2018-05-25 16:29:45 +02:00
Mike Fährmann
513d807632 explicitly open config files as utf-8 2018-05-25 16:29:46 +02:00
Mike Fährmann
2df1a15fb8 add '-s/--simulate' to run data extraction without download 
Useful for quick testing (even though -g and -j kind of do the same)
and to fill a download archive without actually downloading the files.

-s does the same as the default behaviour, except downloading stuff.
Maybe it should get a more fitting name, as it does actually write to
disk (cache, archive)?
 2018-05-25 16:07:18 +02:00
Mike Fährmann
15cce22d82 [mangadex] fix parsing of unusual chapter strings 2018-05-23 18:40:39 +02:00
Mike Fährmann
ecdc3475b8 [pixhost] support .to TLDs 2018-05-23 18:32:34 +02:00