github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,286 Commits 1 Branch 0 Tags
fc6ea8ee5ca3ff4205fe9fd5fc711eca5f5794fb
Commit Graph

3125 Commits

Author SHA1 Message Date
Mike Fährmann
fc6ea8ee5c [instagram] update API domain and headers 2023-01-21 17:30:39 +01:00
Mike Fährmann
137de090dd merge #3549: [twitter] fix search (#3536) 2023-01-20 14:46:30 +01:00
Mike Fährmann
02e314c1b6 merge #3537: [wikifeet/wikifeetx] add 'gallery' extractor 2023-01-20 14:44:25 +01:00
Mike Fährmann
568112dfbb [oauth] improve output 
- show which api key / client id gets used (#3518)
- show in which browser authorization URLs gets opened in
 2023-01-20 12:33:26 +01:00
ClosedPort22
ab58c375b4 [twitter] fix search (#3536) 
- partially revert 18fe4b334d
- properly search for cursor when processing 'replaceEntry'
 2023-01-20 14:12:25 +08:00
Mike Fährmann
df91ebb945 [oauth] simplify OAuth 1.0a init 2023-01-19 18:34:54 +01:00
Mike Fährmann
107c60c973 [sankaku] update URL pattern (#3523) 
match tag searches with language codes without a trailing slash
 2023-01-18 21:38:01 +01:00
enduser420
5cb263fdd2 [wikifeet/wikifeetx] add 'gallery' extractor 2023-01-16 21:08:45 +05:30
Mike Fährmann
35a30498bc merge #3531: [kemonoparty] improve hash extraction 
- extract md5 hashes if available
- extract discord file hashes
 2023-01-16 15:15:32 +01:00
Mike Fährmann
9683d79bb7 [twitter] "fix" search pagination (#3536, #3534) 
- properly process instructions
- do not expect a predetermined instruction order
 2023-01-16 14:58:30 +01:00
Mike Fährmann
4fec848858 [twitter] use "browser": "firefox" by default (#3522) 
and reenable TLS 1.2 ciphers
 2023-01-15 22:11:04 +01:00
Mike Fährmann
78937564fd [twitter] fix login after 32b03433 2023-01-15 22:10:21 +01:00
ClosedPort22
20d6194ffa [kemonoparty] improve hash extraction 
- extract MD5 hash from URLs
- extract MD5 and SHA256 hash from Discord URLs (kemono.party only)
- minor optimization (do not call 'hashes.add' when 'duplicates' is
  true)
- update tests accordingly

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2023-01-15 12:01:13 +08:00
Mike Fährmann
80a2ff2d38 support setting 'write-pages' to "ALL" 
to show authentication header, cookies, etc
 2023-01-14 22:34:46 +01:00
Mike Fährmann
c881548a27 add 'extractor.retry-codes' option (#3313) 
do not retry 429 and 430 by default
 2023-01-14 17:25:30 +01:00
Mike Fährmann
e30e8aeef7 [mastodon] rename '_check_move' -> '_check_moved' 2023-01-14 14:46:24 +01:00
Mike Fährmann
32b0343334 [twitter] refresh guest tokens (#3445, #3458) 2023-01-13 22:19:25 +01:00
Mike Fährmann
512abeb4ae [booru] add 'url' option 2023-01-13 16:32:32 +01:00
Mike Fährmann
c87bd1a752 [danbooru] extend 'metadata' option 
make it possible to specify a custom list of metadata includes
 2023-01-13 16:20:01 +01:00
Mike Fährmann
26c3292538 [twitter] disable TLS 1.2 ciphers by default (#3522) 2023-01-13 16:05:43 +01:00
Mike Fährmann
18fe4b334d [twitter] remove 'tweet_search_mode' from search parameters (#3522) 
and update API root and general query parameters
 2023-01-13 15:50:46 +01:00
Mike Fährmann
85bd1cbc89 [kemonoparty] fix regression from 473bd380 (#3519) 
- do not access 'response.content' unless necessary
- only validate responses if filename extensions differ
 2023-01-11 15:25:01 +01:00
Mike Fährmann
473bd380c8 [kemonoparty] reject invalid/empty files (#3510) 2023-01-10 19:04:47 +01:00
Mike Fährmann
4833ec323e [imagefap] add 'folder' extractor (#3504) 2023-01-08 16:57:31 +01:00
Mike Fährmann
362cd6991b [pixiv] implement 'metadata-bookmark' option (#3417) 2023-01-07 23:19:43 +01:00
Mike Fährmann
2142b9c7ae merge #3503: [myhentaigallery] handle whitespace before title tag 2023-01-07 15:15:11 +01:00
Mike Fährmann
3a0450adbf [behance] use default delay between requests (#2507) 2023-01-07 14:49:26 +01:00
Mike Fährmann
2cae4567ba [telegraph] fix file URLs (#3506) 2023-01-07 14:35:06 +01:00
Mike Fährmann
cbaeee9533 [imagefap] warn about redirects to '/human-verification' (#1140) 2023-01-07 13:04:42 +01:00
Mike Fährmann
435de1329a [imagefap] use default delay between requests (#1140) 2023-01-07 12:59:09 +01:00
Erik Rimskog
a8a982359e [myhentaigallery] handle whitespace before the title tag 2023-01-06 16:33:04 +01:00
Mike Fährmann
d1dd52349a merge #3189: [tcbscans] add 'chapter' and 'manga' extractors 2023-01-06 13:42:27 +01:00
Mike Fährmann
2f31d21509 merge #3455: [twitter] apply tweet type checks before uniqueness check 2023-01-06 13:32:50 +01:00
enduser420
e8541a131d [tcbscans] add 'chapter' and 'manga' extractors 2023-01-06 16:16:31 +05:30
Mike Fährmann
9695c4e88d emit debug logging message when loading cookies from file 
attempt nr. 2
no idea how I managed to remove 6514828d in a918ce29
 2023-01-06 11:13:44 +01:00
Mike Fährmann
30a31836e7 merge #3449: [twitter] force HTTPS for TwitPic URLs 2023-01-05 14:57:03 +01:00
Mike Fährmann
e18482e9ae [twitter] improve 'http' -> 'https' replacement 2023-01-05 14:55:55 +01:00
Mike Fährmann
4fd6da474f merge #3473: [twitter] fix crash when using 'expand' and 'syndication' 2023-01-05 14:19:47 +01:00
Mike Fährmann
a918ce29b5 run tests on ubuntu-20.04 
and remove Python 3.4, since that's no longer available
on this test runner
 2023-01-05 13:33:27 +01:00
Mike Fährmann
6514828d4e emit debug logging message when loading cookies from file 2023-01-05 12:40:22 +01:00
Mike Fährmann
3a238fd490 [poipiku] warn about login requirements 2023-01-05 12:29:31 +01:00
Mike Fährmann
f29ba089ff merge #3474: [fanleaks] add 'post' and 'model' extractors 2023-01-04 17:39:17 +01:00
Mike Fährmann
6933727b45 merge #3483: [twitter] implement 'syndication=extended' 2023-01-04 17:36:17 +01:00
Mike Fährmann
07ed3a1fbf merge #3460: [poipiku] fix extraction for a different warning button style 
(#3493, #3492)
 2023-01-04 17:29:27 +01:00
Mike Fährmann
9116398c1c [pinterest] add 'domain' option (#3484) 
use input URL domain by default
 2023-01-04 17:20:14 +01:00
blankie
2f985bcddb [poipiku] fix extraction for a different warning button style 2023-01-04 08:28:31 +07:00
Mike Fährmann
294108c90a [pinterest] support 'All Pins' boards (#2855, #3484) 2023-01-03 19:11:20 +01:00
Mike Fährmann
77df8d3116 [deviantart] implement username&password login for scraps (#1029) 
re-login when getting prematurely logged out by dA
is missing at the moment
 2023-01-03 18:42:28 +01:00
Mike Fährmann
ed2d715019 fix 'keywords' in extractor tests (#3491) 2023-01-03 15:14:23 +01:00
ClosedPort22
6853b14be3 [twitter] apply suggestions from code review 
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2023-01-02 21:03:01 +08:00