github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
1,276 Commits 1 Branch 0 Tags
df082e923cb2b04dbaa8c79c930a671561ba7cd3
Commit Graph

212 Commits

Author SHA1 Message Date
Mike Fährmann
b6fffa9e26 [directlink] update filename format and metadata 2017-05-30 17:33:09 +02:00
Mike Fährmann
48ccee2505 [gfycat] add image extractor 2017-05-28 17:09:54 +02:00
Mike Fährmann
691c4dd709 support direct image links 2017-05-24 12:51:18 +02:00
Mike Fährmann
398506da45 update release script 2017-05-22 08:47:58 +02:00
Mike Fährmann
2974d782a3 [yomanga] remove module 
site has been shut down
 2017-05-20 11:18:44 +02:00
Mike Fährmann
a90c6acc9c code cleanup + fixes 2017-05-18 15:18:18 +02:00
Mike Fährmann
4c88c0d496 rework the output format for --list-keywords 2017-05-15 18:30:47 +02:00
Mike Fährmann
107d29ad8a improve handling of text:... URLs 
- don't require // after the colon
- open output files in text mode
 2017-05-12 14:10:25 +02:00
Mike Fährmann
9f1c83297f [pinterest] allow URLs with any TLD 2017-05-08 15:08:39 +02:00
Mike Fährmann
ef90a2de2f implement the "exit" option for the "skip" config-key 2017-05-05 15:49:58 +02:00
Mike Fährmann
fc9223c072 add '--abort-on-skip' option and ability to control skip behavior 
the 'skip' config option controls skipping behavior:
    true    - skip download if file already exist (default)
    false   - download and overwrite files even if it exists
    "abort" - abort extractor run if a download would be skipped
              (same as '--abort-on-skip')
 2017-05-03 15:26:04 +02:00
Mike Fährmann
d948ba1322 [readcomics] remove module 
- site has been unavailable for two weeks
- (#12)
 2017-05-01 11:44:12 +02:00
Mike Fährmann
244ab75cad [kissmanga] update AES key retrieval 2017-04-21 20:36:47 +02:00
Mike Fährmann
13dc5d72bc update some extractors to use https 2017-04-20 13:32:40 +02:00
Mike Fährmann
f4aa452bd1 update unit test results 2017-04-14 14:40:36 +02:00
Mike Fährmann
fece09d326 [fallenangels] update to new domain and site-layout 2017-04-09 11:37:21 +02:00
Mike Fährmann
cf79a47b59 update unit tests 2017-04-08 11:02:32 +02:00
Mike Fährmann
841fd50242 move code into util.py 2017-03-28 13:12:44 +02:00
Mike Fährmann
e3212dd98f fix some smaller stuff 
- remove support for old windows config paths
- catch exception if cache-database can't be opened
- fix username/password settings for unit tests
- rename variable 'max_tries' to 'retries'
 2017-03-27 14:30:32 +02:00
Mike Fährmann
e4b3077168 improve config module 
- speed improvements, especially in the 'interpolate' function
- 'interpolate' now prioritizes base-level values if they exist
  - "username" is chosen before "extractor.<category>.username"
  - -u/--username & co can now override config-file values
 2017-03-27 11:59:27 +02:00
Mike Fährmann
f2ef49563b fix argument order for python33 and 34 2017-03-23 16:51:42 +01:00
Mike Fährmann
0257d3e7ac [mangamint] remove extractors - site is down 2017-03-20 13:38:54 +01:00
Mike Fährmann
66eb3d3488 fix tests 2017-03-14 08:51:58 +01:00
Mike Fährmann
872b8aed97 [4chan] update test 2017-03-03 15:50:10 +01:00
Mike Fährmann
2fa575b273 restore exception-testing to its old form 2017-02-27 23:05:08 +01:00
Mike Fährmann
40be4933b8 fix exception based tests 2017-02-26 02:06:56 +01:00
Mike Fährmann
6208d9dd79 implement '--images' and '--chapters' options 
- the former '--items' has been renamed to '--chapters'
- #6
 2017-02-23 21:51:29 +01:00
Mike Fährmann
e87e6fbc67 change some config keys 
directory_fmt     -> directory
filename_fmt      -> filename
download-original -> original
 2017-02-21 22:11:02 +01:00
Mike Fährmann
96baea0959 [hentaibox] remove extractor 2017-02-18 12:34:10 +01:00
Mike Fährmann
9a08f8a097 improved foolslide-based extractors 
- this includes dokireader, fallenangels, jaiminisbox, powermanga,
  sensescans, worldthree, yonkouprod, gomanga, yomanga
- added 'chapter_string', 'chapter_id', 'chapter_minor' and 'count'
  keywords
- changed the 'chapter' keyword to always be just a number
- changed the default directory format
 2017-02-16 23:42:30 +01:00
Mike Fährmann
bad623751f [hentaihere] transition to https 2017-02-10 21:28:17 +01:00
Mike Fährmann
331b413c60 update extractor test script 2017-02-10 21:22:57 +01:00
Mike Fährmann
4f123b8513 code adjustments according to pep8 2017-01-30 19:40:15 +01:00
Mike Fährmann
9538a873cb move create_test_data script 2017-01-19 01:35:59 +01:00
Mike Fährmann
434ef4d5a2 [mangafox] raise proper exception if chapter is not available 2017-01-14 22:11:47 +01:00
Mike Fährmann
cc0b4f2661 [yomanga] add chapter extractor 2017-01-13 00:03:12 +01:00
Mike Fährmann
ad4b02508f trying to understand travis-ci unit test failures 
- added some debug output via logging module
- unit tests work on my machine (tm)
 2017-01-12 22:35:42 +01:00
Mike Fährmann
72d3ca0bf9 [deviantart] use API for user-extractor 2017-01-12 21:08:49 +01:00
Mike Fährmann
989820d719 workaround for python 3.6s behaviour with BEGIN EXCLUSIVE in sqlite 2017-01-11 00:34:32 +01:00
Mike Fährmann
00074a71d7 several changes to make travis build work 
- fixed html.unescape not being available on Python3.3
- removed inconsistent test result
- added username/password pairs for authenticating extractors
 2017-01-10 13:41:00 +01:00
Mike Fährmann
a1fb46d984 make extractor unittest discoverable 2017-01-09 12:27:20 +01:00
Mike Fährmann
2c9bc50c23 support expecting exceptions in tests 2016-12-30 01:41:17 +01:00
Mike Fährmann
4e75e923cd sanatize extractor test output 2016-12-09 01:15:40 +01:00
Mike Fährmann
d1f90bb424 add method to re-create existing test-data 2016-12-09 00:25:52 +01:00
Mike Fährmann
57a12f5be0 fix module-names for extractor tests 2016-07-23 17:53:19 +02:00
Mike Fährmann
b0c333b799 rewrite cache module 2016-04-20 08:40:41 +02:00
Mike Fährmann
871f4c8a48 initialize cache-module before running tests 2016-03-08 18:01:35 +01:00
Mike Fährmann
b3aab5745b dynamically create extractor testcases 2016-02-18 15:53:53 +01:00
Mike Fährmann
2b8977cb2e script to easily create testdata 2015-12-22 01:49:25 +01:00
Mike Fährmann
565ea042c9 update HashJob to generate hashes for downloaded content 2015-12-21 22:49:04 +01:00