Commit Graph

3983 Commits

Author SHA1 Message Date
Mike Fährmann
c4a62a48ae [nijie] add 'feed' extractor (#3048) 2022-10-14 12:03:00 +02:00
Mike Fährmann
d1314df6e6 [nozomi] fix extraction (#3051) 2022-10-14 00:19:37 +02:00
Mike Fährmann
277be410a7 [2chen] update 'archive_fmt' 2022-10-14 00:19:27 +02:00
pink-red
88f8975ab9 Fix duplicated metadata bug (#3033) 2022-10-13 19:17:23 +02:00
Mike Fährmann
ed55bd3a5c [redgifs] extract Bearer token (#3037) 2022-10-13 18:56:11 +02:00
Mike Fährmann
e974c75083 [redgifs] fix extraction (#3037)
send public Bearer token as 'authorization' header
2022-10-12 11:17:05 +02:00
Mike Fährmann
68466a7d61 [tumblr] support 'https://www.tumblr.com/BLOGNAME' URLs (#3034) 2022-10-11 21:09:24 +02:00
Mike Fährmann
b6a68f5a4b [fanbox] extend 'content' test result (#3020) 2022-10-11 19:01:26 +02:00
Mike Fährmann
f1f89b2436 [tumblr] add 'offset' option 2022-10-11 10:54:23 +02:00
Mike Fährmann
827ab0a62d [instagram] fix login
- use mobile user agent header
- update general headers
- skip /data/shared_data/ step
2022-10-11 10:48:28 +02:00
Mike Fährmann
1ca6be8619 [fanbox] add 'content' metadata field (#3020) 2022-10-11 10:48:28 +02:00
Mike Fährmann
e5d229c524 [tumblr] sleep between fallback retries (#2957) 2022-10-11 10:48:28 +02:00
Mike Fährmann
b2b0b1c455 [hitomi] fall back to webp when format not available (#3030) 2022-10-11 10:48:28 +02:00
Mike Fährmann
15a4d7696f [docs] update 'adjust-extensions' explanation (#3031) 2022-10-11 10:48:28 +02:00
Mike Fährmann
1696f68a68 [8chan] add 'thread' and 'board' extractors (#2938) 2022-10-11 10:47:19 +02:00
Mike Fährmann
560f7b41d8 [vk] add 'tagged' extractor (#2997) 2022-10-08 15:41:39 +02:00
Mike Fährmann
122e1a467a [vk] unescape error messages 2022-10-08 15:41:39 +02:00
Mike Fährmann
7f30a0d7a7 add 'path-extended' option (#3021) 2022-10-08 15:41:39 +02:00
Mike Fährmann
bc9d291c13 [imagefap] fix and improve folder extraction (#3013) 2022-10-08 15:41:39 +02:00
Mike Fährmann
55fca5fe4b [imagefap] fix and improve gallery pagination (#3013) 2022-10-08 15:41:39 +02:00
Mike Fährmann
8b1fe0bcf1 emit debug logging messages before calling time.sleep() (#2982) 2022-10-08 15:41:39 +02:00
Mike Fährmann
a6e2d96dde fix bug when processing input file comments (#2808)
and move 'parse_inputfile()' to util.py
2022-10-08 15:41:39 +02:00
Mike Fährmann
14717f3fc9 [deviantart] add 'group' option (#3018)
disabling this option allows to better download from deleted accounts
2022-10-08 15:41:21 +02:00
Mike Fährmann
5a0b4cfab4 [postprocessor:metadata] don't ignore mode:json
fixes a bug introduced in b57015cf
where {"mode": "json", "format": "foobar"}
would behave like mode:custom
2022-10-06 13:14:08 +02:00
Mike Fährmann
220a04a74a [artstation] skip missing projects (#3016) 2022-10-06 12:04:39 +02:00
Mike Fährmann
a12ce2bb41 [deviantart] fix 'deviation' extraction (#2981) 2022-10-05 21:30:08 +02:00
Mike Fährmann
36afb519b3 [instagram] prevent crash on empty user profile 2022-10-05 20:02:20 +02:00
Mike Fährmann
b57015cf0a [postprocessor:metadata] assume 'mode: custom' when format is set
{"name": "metadata", "format": "foobar"}
will now implicitly use mode:custom and no longer mode:json like before
2022-10-04 22:35:26 +02:00
enduser420
f0321f423d [2chen] Add 2chen.moe extractor (#2707)
* [2chen] Add 2chen.moe extractor

* change "==" to is

* fix for "test_unique_pattern_matches"

* fix regex pattern and group matching

* fix regex again

* [2chen] add 'reply_no' and 'hash' metadata and change 'filename_fmt'

also made an entry in supportedsites.md

* [2chen] unescape 'title'

* [2chen] partition() -> rpartition()

* [2chen] extract 'date' and 'name' metadata

* [2chen] remove 'offset' argument

* [2chen] do some changes

* [2chen] do some more changes

* [2chen] unescape 'name' and 'filename'
2022-10-04 22:18:13 +02:00
enduser420
f7ba19a1c0 [nana] add 'nana' extractors (#2967) 2022-10-04 09:23:24 +02:00
Mike Fährmann
6ccb18642c restrict importlib-metadata version for tests 2022-10-03 23:00:01 +02:00
Mike Fährmann
fce6642699 [instagram] restore warnings for private profiles (#3004) 2022-10-03 22:40:30 +02:00
Mike Fährmann
3e65645cfa [instagram] restore 'cursor' functionality (#2991) 2022-10-03 16:43:29 +02:00
Mike Fährmann
b8d268f57e allow '/' and '?' in URL queries 2022-10-02 19:02:05 +02:00
Mike Fährmann
60cce7462c release version 1.23.2 2022-10-01 13:24:22 +02:00
Mike Fährmann
7b5dad075d [fappic] fix extraction 2022-10-01 12:19:33 +02:00
Mike Fährmann
78694a61bb [kemonoparty] restore 'favorites' API endpoints (#2994) 2022-10-01 12:15:32 +02:00
Mike Fährmann
5fd4374036 [sankaku] improve 429 and tag limit handling 2022-10-01 11:49:47 +02:00
Mike Fährmann
b84982b2f9 [kemonoparty] send Referer headers (#2989, #2990) 2022-10-01 11:45:56 +02:00
blankie
98f67ae333 [instagram] add 'count' metadata field (#2979) 2022-09-30 20:40:35 +02:00
Mike Fährmann
4089bceddd [sankaku] implement 'refresh' option (#2958) 2022-09-30 19:55:48 +02:00
Mike Fährmann
779e75c6f8 [kemonoparty] fix attachment IDs overwriting post IDs (#2984)
regression from 09a5cc61
2022-09-30 16:47:09 +02:00
Mike Fährmann
e1d714943b [tumblr] catch exception when updating image token (#2957) 2022-09-30 15:08:21 +02:00
Mike Fährmann
e3a03f335c [instagram] fix GraphQL bugs 2022-09-30 15:05:29 +02:00
Mike Fährmann
6c76b5f90c [deviantart] fix extraction (#2981, #2983)
send a 'csrf_token' with every Eclipse API request
2022-09-29 10:28:39 +02:00
Mike Fährmann
f728b5ca06 [tumblr] add fallback for failed higher-resolution images (#2957) 2022-09-28 21:36:09 +02:00
Mike Fährmann
6992d01e19 [artstation] support search filters (#2970) 2022-09-28 16:51:17 +02:00
Mike Fährmann
194803f3a7 [plurk] fix extraction (#2977) 2022-09-28 13:04:32 +02:00
Mike Fährmann
63e0924927 [pixiv] add 'series' extractor (#2964) 2022-09-27 23:24:03 +02:00
Mike Fährmann
aafea0c4f8 [artstation] fix searches (#2970) 2022-09-27 14:25:55 +02:00