Commit Graph

569 Commits

Author SHA1 Message Date
Mike Fährmann
4e7661ab01 [imgtrex] re-add extractor 2017-03-21 15:47:51 +01:00
Mike Fährmann
2b9cf4fd83 add script to build and release new versions 2017-03-20 13:39:43 +01:00
Mike Fährmann
0257d3e7ac [mangamint] remove extractors - site is down 2017-03-20 13:38:54 +01:00
Mike Fährmann
1d46be545c add login notifications 2017-03-17 09:42:59 +01:00
Mike Fährmann
ed94d9b92d fix/improve various things 2017-03-17 09:39:46 +01:00
Mike Fährmann
abfe7456d6 add '-R/--retries' and '--http-timeout' options
(#10)
2017-03-16 04:28:40 +01:00
Mike Fährmann
22910f9562 improve error handling of http file downloads
(#10)
2017-03-16 04:17:35 +01:00
Mike Fährmann
80df2b3527 add custom argparse action 2017-03-16 03:47:08 +01:00
Mike Fährmann
619c74159a [seiga] fix file extension and xml parsing
- The file extension of the first image had been used for all further
  images
- API responses can contain invalid characters, which cause the XML
  parser to fail (http://seiga.nicovideo.jp/user/illust/26377934
  contains several \x08 characters)
2017-03-14 09:09:04 +01:00
Mike Fährmann
8816dab549 add 'dev' suffix for non-release versions
(#9)
2017-03-14 09:07:52 +01:00
Mike Fährmann
66eb3d3488 fix tests 2017-03-14 08:51:58 +01:00
Mike Fährmann
f622411be5 [deviantart] implement 'skip' method 2017-03-13 21:42:16 +01:00
Mike Fährmann
27ae152f57 use logging to report errors 2017-03-11 01:47:57 +01:00
Mike Fährmann
dfe2c2dced [batoto] update test results 2017-03-11 01:47:05 +01:00
Mike Fährmann
43e3bb24ae [imagefap] don't rely on image-count
(fixes #9)
2017-03-09 20:34:39 +01:00
Mike Fährmann
0cfe51dc78 add '--config-yaml' option
(#8)
2017-03-08 16:57:42 +01:00
Mike Fährmann
379125746a [deviantart] improve API error handling
(#7)
2017-03-08 16:40:20 +01:00
Mike Fährmann
f782282f97 add logger objects to extractors 2017-03-07 23:50:19 +01:00
Mike Fährmann
0b214eeb9d bump version to 0.7.0 2017-03-06 19:30:59 +01:00
Mike Fährmann
2c2de778f2 [deviantart] adjust error message 2017-03-06 19:27:45 +01:00
Mike Fährmann
c24aeb5cbc [whentai] update test results 2017-03-06 19:15:58 +01:00
Mike Fährmann
f36d685ce1 [deviantart] always request access token before api calls
(#7)
2017-03-05 02:22:36 +01:00
Mike Fährmann
ff92674379 [booru] simple skip functionality
(#6)
2017-03-04 23:21:55 +01:00
Mike Fährmann
7a9d66fbce implement basic way to tell extractors to skip ahead 2017-03-03 17:26:50 +01:00
Mike Fährmann
872b8aed97 [4chan] update test 2017-03-03 15:50:10 +01:00
Mike Fährmann
2fa575b273 restore exception-testing to its old form 2017-02-27 23:05:08 +01:00
Mike Fährmann
f361cb13e0 [hentai2read] fix extraction 2017-02-26 02:25:36 +01:00
Mike Fährmann
40be4933b8 fix exception based tests 2017-02-26 02:06:56 +01:00
Mike Fährmann
24f41e13b3 move some exception handling code 2017-02-25 23:53:31 +01:00
Mike Fährmann
6208d9dd79 implement '--images' and '--chapters' options
- the former '--items' has been renamed to '--chapters'
- #6
2017-02-23 21:51:29 +01:00
Mike Fährmann
38aa496ecb [deviantart] restore tests + set api version 2017-02-23 20:58:39 +01:00
Mike Fährmann
39b1a18f12 [deviantart] fix issue with missing 'content'-key 2017-02-22 01:42:08 +01:00
Mike Fährmann
e87e6fbc67 change some config keys
directory_fmt     -> directory
filename_fmt      -> filename
download-original -> original
2017-02-21 22:11:02 +01:00
Mike Fährmann
2a32b12043 add '--items' option
this allows to specify which manga-chapters/comic-issues to download
when using gallery-dl on a manga/comic URL
2017-02-20 22:02:49 +01:00
Mike Fährmann
96baea0959 [hentaibox] remove extractor 2017-02-18 12:34:10 +01:00
Mike Fährmann
3bca866185 rework the '-g' cmdline option
the amount of how often the -g option is given now determines up until
what level URLs are resolved.

example:

$ gallery-dl -g http://kissmanga.com/Manga/Dropout
http://kissmanga.com/Manga/Dropout/Ch-000---Oneshot-?id=145847

- when applied to a manga-extractor, specifying the -g option once will
  now print a list of all chapter URls

$ gallery-dl -gg http://kissmanga.com/Manga/Dropout
http://2.bp.blogspot.com/.../000.png
http://2.bp.blogspot.com/.../001.png
...

- specifying it twice (or even more often) will go a level deeper and
  print the image URLs found in those chapters
2017-02-17 22:18:16 +01:00
Mike Fährmann
9d36acbbc4 [yonkouprod] update test results 2017-02-17 02:42:45 +01:00
Mike Fährmann
9a08f8a097 improved foolslide-based extractors
- this includes dokireader, fallenangels, jaiminisbox, powermanga,
  sensescans, worldthree, yonkouprod, gomanga, yomanga
- added 'chapter_string', 'chapter_id', 'chapter_minor' and 'count'
  keywords
- changed the 'chapter' keyword to always be just a number
- changed the default directory format
2017-02-16 23:42:30 +01:00
Mike Fährmann
0a6487afe8 [exhentai] fix detection of invalid gallery keys 2017-02-15 03:36:46 +01:00
Mike Fährmann
4cb49cfd76 bump version to 0.6.4 2017-02-13 00:55:01 +01:00
Mike Fährmann
0b59d9f8c7 disable urllib3s InsecureConnectionWarning 2017-02-11 21:21:57 +01:00
Mike Fährmann
bad623751f [hentaihere] transition to https 2017-02-10 21:28:17 +01:00
Mike Fährmann
331b413c60 update extractor test script 2017-02-10 21:22:57 +01:00
Mike Fährmann
c84e975dcb [twitter] fix image extraction 2017-02-09 02:09:23 +01:00
Mike Fährmann
0af02007a9 [imagetwist] fix site access 2017-02-08 22:59:00 +01:00
Mike Fährmann
2f6e3874a7 [sensescans support http://sensescans.com/reader/... URLs 2017-02-08 02:34:17 +01:00
Mike Fährmann
52104b2bb6 [fallenangels] add chapter extractor 2017-02-06 20:05:58 +01:00
Mike Fährmann
7880cc1ad7 [imgtrex] remove extractor - domain no longer exists 2017-02-05 16:54:04 +01:00
Mike Fährmann
21e0dfbe20 [chronos] raise NotFoundError instead of crashing 2017-02-02 15:54:50 +01:00
Mike Fährmann
2b38398940 [imgyt] raise NotFoundError instead of crashing 2017-02-02 15:52:48 +01:00