github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
4,332 Commits 1 Branch 0 Tags
0f7e6c422ab374114e82bc294a487fb6926e9cf4
Commit Graph

3162 Commits

Author SHA1 Message Date
Mike Fährmann
0f7e6c422a merge #3596: [shopify] support ohpolly.com 2023-01-31 20:13:51 +01:00
enduser420
fcf7030b85 [shopify] support ohpolly.com 2023-02-01 00:31:12 +05:30
Mike Fährmann
a6a631f992 merge #3589: [redgifs] support v3 URLs 2023-01-31 19:28:08 +01:00
Mike Fährmann
137a395ae0 [imagefap] fix infinite pagination loop (#3594) 2023-01-31 19:21:43 +01:00
Mike Fährmann
3c708ade8f [imagefap] fix metadata extraction 2023-01-31 15:38:55 +01:00
Mike Fährmann
17e24eacf0 [imagefap] update 'gallery' URLs (#3595) 2023-01-31 15:33:35 +01:00
Mike Fährmann
c2bc70593e implement ability to load external extractor classes 
- -X/--extractors
- extractor.module-sources
 2023-01-30 23:10:10 +01:00
enduser420
a18f627bfc [redgifs] support v3 URLs 2023-01-30 20:06:43 +05:30
Mike Fährmann
13a90969c7 merge #3575: [nudecollect] add 'image' and 'album' extractors 2023-01-28 16:04:47 +01:00
Mike Fährmann
aacd27e4ef merge #3581: [hotleak] fix video URLs 2023-01-28 16:03:32 +01:00
Mike Fährmann
abc3619feb [lexica] add 'search' extractor (#3567) 2023-01-28 16:00:32 +01:00
Mike Fährmann
7c9b1ec830 [hotleak] optimize decoding video URLs 
- use binascii module
- combine slice and reverse step
 2023-01-28 15:41:53 +01:00
nifnat
f14dbfe079 Make decode_video_url static (used in both post and creator extractor). 2023-01-28 14:36:49 +00:00
nifnat
bd23a701f3 Tidy up code. 2023-01-27 22:00:41 +00:00
nifnat
7f34f99a26 Reverse engineered obfuscated JS function and reimplemented in python. 2023-01-27 21:30:06 +00:00
Mike Fährmann
0d818d3540 [fantia] send 'X-CSRF-Token' headers (#3576) 2023-01-27 16:18:57 +01:00
enduser420
2a5903dc16 [nudecollect] add 'image' and 'album' extractors 2023-01-26 17:25:33 +05:30
Mike Fährmann
c8fdd5096e merge #3571: [bunkr] Fix extracting mkv and ts files 2023-01-26 12:05:59 +01:00
Mike Fährmann
58c008e30a [hiperdex] update domain (#3572) 2023-01-26 12:01:16 +01:00
Luc Ritchie
842064e597 [bunkr] Fix extracting ts files 2023-01-25 15:24:14 -05:00
Luc Ritchie
99ca0437e4 [bunkr] Fix extracting mkv files 2023-01-25 14:36:13 -05:00
Mike Fährmann
76b01b64cf [kemonoparty] remove MD5 hash extraction (#3531) 
This partially reverts commit 20d6194ffa.
 2023-01-25 11:10:09 +01:00
Mike Fährmann
09fb212414 [philomena] match URLs with www subdomain 2023-01-24 22:43:24 +01:00
Mike Fährmann
7e2fd2e573 merge #3560: [deviantart] add support for /deviation/ and fav.me URLs 2023-01-23 14:16:18 +01:00
Mike Fährmann
caae8fefe1 merge #3541: [deviantart] add extractor for status updates 2023-01-23 13:54:51 +01:00
ClosedPort22
c90b4ea8d9 [deviantart] add support for fav.me URLs 2023-01-23 20:35:03 +08:00
Mike Fährmann
d63af4f3d3 merge #3555: [generic] fix regex for non-src image URLs 2023-01-23 13:18:23 +01:00
Mike Fährmann
8993b10751 [mastodon] add 'num' and 'count' metadata fields (#3517) 2023-01-23 13:10:11 +01:00
Mike Fährmann
d817d23ccb [instagram] update csrf token handling 
- update internal value according to cookie
- do not send a second 'csrftoken' cookie
 2023-01-23 13:01:35 +01:00
Mike Fährmann
00b94946b3 [instagram] show -o cursor=… after every error (#3440) 2023-01-23 13:00:44 +01:00
ClosedPort22
674c719646 [deviantart] refactor base36 conversion 2023-01-23 17:59:55 +08:00
ClosedPort22
293abb8921 [deviantart] add support for /deviation/ URLs 2023-01-23 17:37:57 +08:00
thatfuckingbird
8cfeed78b1 [generic] fix regex for non-src image URLs 2023-01-21 22:32:42 +01:00
Mike Fährmann
fc6ea8ee5c [instagram] update API domain and headers 2023-01-21 17:30:39 +01:00
ClosedPort22
597b89245e [deviantart] misc improvements to status extractor 
- relax regex pattern
- handle invalid 'items' field
- add a test for shared sta.sh item

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2023-01-21 13:04:27 +08:00
Mike Fährmann
137de090dd merge #3549: [twitter] fix search (#3536) 2023-01-20 14:46:30 +01:00
Mike Fährmann
02e314c1b6 merge #3537: [wikifeet/wikifeetx] add 'gallery' extractor 2023-01-20 14:44:25 +01:00
Mike Fährmann
568112dfbb [oauth] improve output 
- show which api key / client id gets used (#3518)
- show in which browser authorization URLs gets opened in
 2023-01-20 12:33:26 +01:00
ClosedPort22
ab58c375b4 [twitter] fix search (#3536) 
- partially revert 18fe4b334d
- properly search for cursor when processing 'replaceEntry'
 2023-01-20 14:12:25 +08:00
Mike Fährmann
df91ebb945 [oauth] simplify OAuth 1.0a init 2023-01-19 18:34:54 +01:00
ClosedPort22
013733c9e9 [deviantart] fix index fields for embedded/shared images 2023-01-19 12:17:27 +08:00
ClosedPort22
c4aeca7a5a [deviantart] improve handling of statuses 
- recursively yield statuses
- ignore items with missing or unexpected field(s)
 2023-01-19 11:48:21 +08:00
ClosedPort22
3b32671fbd [deviantart] add extractor for status updates 
extract user status updates using the '/user/statuses/' endpoint
 2023-01-19 11:30:48 +08:00
Mike Fährmann
107c60c973 [sankaku] update URL pattern (#3523) 
match tag searches with language codes without a trailing slash
 2023-01-18 21:38:01 +01:00
enduser420
5cb263fdd2 [wikifeet/wikifeetx] add 'gallery' extractor 2023-01-16 21:08:45 +05:30
Mike Fährmann
35a30498bc merge #3531: [kemonoparty] improve hash extraction 
- extract md5 hashes if available
- extract discord file hashes
 2023-01-16 15:15:32 +01:00
Mike Fährmann
9683d79bb7 [twitter] "fix" search pagination (#3536, #3534) 
- properly process instructions
- do not expect a predetermined instruction order
 2023-01-16 14:58:30 +01:00
Mike Fährmann
4fec848858 [twitter] use "browser": "firefox" by default (#3522) 
and reenable TLS 1.2 ciphers
 2023-01-15 22:11:04 +01:00
Mike Fährmann
78937564fd [twitter] fix login after 32b03433 2023-01-15 22:10:21 +01:00
ClosedPort22
20d6194ffa [kemonoparty] improve hash extraction 
- extract MD5 hash from URLs
- extract MD5 and SHA256 hash from Discord URLs (kemono.party only)
- minor optimization (do not call 'hashes.add' when 'duplicates' is
  true)
- update tests accordingly

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2023-01-15 12:01:13 +08:00