Commit Graph

3960 Commits

Author SHA1 Message Date
Mike Fährmann
5a0b4cfab4 [postprocessor:metadata] don't ignore mode:json
fixes a bug introduced in b57015cf
where {"mode": "json", "format": "foobar"}
would behave like mode:custom
2022-10-06 13:14:08 +02:00
Mike Fährmann
220a04a74a [artstation] skip missing projects (#3016) 2022-10-06 12:04:39 +02:00
Mike Fährmann
a12ce2bb41 [deviantart] fix 'deviation' extraction (#2981) 2022-10-05 21:30:08 +02:00
Mike Fährmann
36afb519b3 [instagram] prevent crash on empty user profile 2022-10-05 20:02:20 +02:00
Mike Fährmann
b57015cf0a [postprocessor:metadata] assume 'mode: custom' when format is set
{"name": "metadata", "format": "foobar"}
will now implicitly use mode:custom and no longer mode:json like before
2022-10-04 22:35:26 +02:00
enduser420
f0321f423d [2chen] Add 2chen.moe extractor (#2707)
* [2chen] Add 2chen.moe extractor

* change "==" to is

* fix for "test_unique_pattern_matches"

* fix regex pattern and group matching

* fix regex again

* [2chen] add 'reply_no' and 'hash' metadata and change 'filename_fmt'

also made an entry in supportedsites.md

* [2chen] unescape 'title'

* [2chen] partition() -> rpartition()

* [2chen] extract 'date' and 'name' metadata

* [2chen] remove 'offset' argument

* [2chen] do some changes

* [2chen] do some more changes

* [2chen] unescape 'name' and 'filename'
2022-10-04 22:18:13 +02:00
enduser420
f7ba19a1c0 [nana] add 'nana' extractors (#2967) 2022-10-04 09:23:24 +02:00
Mike Fährmann
6ccb18642c restrict importlib-metadata version for tests 2022-10-03 23:00:01 +02:00
Mike Fährmann
fce6642699 [instagram] restore warnings for private profiles (#3004) 2022-10-03 22:40:30 +02:00
Mike Fährmann
3e65645cfa [instagram] restore 'cursor' functionality (#2991) 2022-10-03 16:43:29 +02:00
Mike Fährmann
b8d268f57e allow '/' and '?' in URL queries 2022-10-02 19:02:05 +02:00
Mike Fährmann
60cce7462c release version 1.23.2 2022-10-01 13:24:22 +02:00
Mike Fährmann
7b5dad075d [fappic] fix extraction 2022-10-01 12:19:33 +02:00
Mike Fährmann
78694a61bb [kemonoparty] restore 'favorites' API endpoints (#2994) 2022-10-01 12:15:32 +02:00
Mike Fährmann
5fd4374036 [sankaku] improve 429 and tag limit handling 2022-10-01 11:49:47 +02:00
Mike Fährmann
b84982b2f9 [kemonoparty] send Referer headers (#2989, #2990) 2022-10-01 11:45:56 +02:00
blankie
98f67ae333 [instagram] add 'count' metadata field (#2979) 2022-09-30 20:40:35 +02:00
Mike Fährmann
4089bceddd [sankaku] implement 'refresh' option (#2958) 2022-09-30 19:55:48 +02:00
Mike Fährmann
779e75c6f8 [kemonoparty] fix attachment IDs overwriting post IDs (#2984)
regression from 09a5cc61
2022-09-30 16:47:09 +02:00
Mike Fährmann
e1d714943b [tumblr] catch exception when updating image token (#2957) 2022-09-30 15:08:21 +02:00
Mike Fährmann
e3a03f335c [instagram] fix GraphQL bugs 2022-09-30 15:05:29 +02:00
Mike Fährmann
6c76b5f90c [deviantart] fix extraction (#2981, #2983)
send a 'csrf_token' with every Eclipse API request
2022-09-29 10:28:39 +02:00
Mike Fährmann
f728b5ca06 [tumblr] add fallback for failed higher-resolution images (#2957) 2022-09-28 21:36:09 +02:00
Mike Fährmann
6992d01e19 [artstation] support search filters (#2970) 2022-09-28 16:51:17 +02:00
Mike Fährmann
194803f3a7 [plurk] fix extraction (#2977) 2022-09-28 13:04:32 +02:00
Mike Fährmann
63e0924927 [pixiv] add 'series' extractor (#2964) 2022-09-27 23:24:03 +02:00
Mike Fährmann
aafea0c4f8 [artstation] fix searches (#2970) 2022-09-27 14:25:55 +02:00
Mike Fährmann
2c67bee5c4 [instagram] update
- reorder some functions and extractors
- add missing GraphQL endpoints
- fix some GraphQL bugs
2022-09-27 14:17:36 +02:00
Mike Fährmann
aa49bf13d2 [instagram] add 'api' option 2022-09-26 22:05:29 +02:00
Mike Fährmann
6f77193a24 [instagram] move API related code into separate classes
may contain bugs and is probably incomplete for the GraphQL variant
2022-09-26 22:04:39 +02:00
Mike Fährmann
ac45ed2764 [skeb] implement 'filters' option (#2945) 2022-09-26 15:17:28 +02:00
Mike Fährmann
32c30754d1 [tumblr] warn when unable to fetch higher-resolution images (#2957)
and download the smaller version
instead of failing with a 404 error
2022-09-26 12:05:34 +02:00
Mike Fährmann
08b0c4c0b1 [docs] add kemono text content example (#2963) 2022-09-25 14:07:41 +02:00
Mike Fährmann
ff532d6c3c [newgrounds] extract 'type' metadata 2022-09-24 20:29:43 +02:00
Mike Fährmann
0393e59535 [newgrounds] add 'games' extractor (#2955) 2022-09-24 12:34:37 +02:00
Mike Fährmann
68f11e02a9 [skeb] add 'search_tags' metadata to search results (#2945) 2022-09-23 13:56:00 +02:00
Mike Fährmann
1378cbb8dd [myportfolio] use fallback when no images are found (#2959) 2022-09-23 13:10:57 +02:00
Mike Fährmann
850608551c [sankaku] detect expired links (#2958) 2022-09-23 11:51:30 +02:00
Mike Fährmann
09a5cc6103 [kemonoparty] add 'count' metadata field (#2952) 2022-09-23 10:44:12 +02:00
Mike Fährmann
89610a49dc [instagram] use REST API endpoint for user feeds (#2666)
With this change, everything is using the newer REST API endpoints
providing higher-quality photos except the now obsolete '/channel' feed.
2022-09-23 10:40:14 +02:00
Mike Fährmann
6737499dbd [instagram] use REST API endpoint for saved posts (#2911)
provides 'username' and 'fullname'
as well as higher-quality images
2022-09-21 20:46:44 +02:00
Mike Fährmann
50e3179c56 [instagram] update _user_by_screen_name()
use REST API
2022-09-21 20:23:37 +02:00
Mike Fährmann
3dacfb3c56 [instagram] update API headers 2022-09-21 20:17:45 +02:00
Mike Fährmann
4b2a006871 [skeb] add 'search' extractor (#2945) 2022-09-21 17:57:55 +02:00
Mike Fährmann
94b34f460e [exhentai] add slash to the end of gallery URLs (#2947) 2022-09-21 17:54:20 +02:00
Mike Fährmann
2787c8511a [mastodon] warn about moved accounts (#2939) 2022-09-20 17:57:14 +02:00
Mike Fährmann
d699310fdf [blogger] add 'label' or 'query' metadata fields (#2930)
for '/search/label/…' or '/search?q=…' URLs
2022-09-20 11:37:39 +02:00
Mike Fährmann
eef50c1f28 [blogger] split 'search' extractor (#2930) 2022-09-19 21:01:21 +02:00
Mike Fährmann
64202dd012 release version 1.23.1 2022-09-18 14:01:09 +02:00
Mike Fährmann
d29fb94098 [bunkr] use 'media-files' servers for m4v and mov files (#2925) 2022-09-18 13:39:29 +02:00