Commit Graph

4753 Commits

Author SHA1 Message Date
Mike Fährmann
0ba8d1f168 merge #4312: [redgifs] add 'niches' extractor 2023-07-18 18:36:15 +02:00
Mike Fährmann
c5565f79f7 merge #4096: [danbooru] add support for booru.borvar.art instance 2023-07-18 18:33:08 +02:00
Mike Fährmann
63326e3168 [danbooru] add tests for booruvar 2023-07-18 18:29:57 +02:00
Mike Fährmann
5171d8975c [E621] support 'e6ai.net' (#4320) 2023-07-18 18:16:30 +02:00
Mike Fährmann
a996d936d2 [imagefap] fix pagination (#3013) 2023-07-18 17:56:33 +02:00
Mike Fährmann
22099422ca [deviantart] fix shortened URLs (#4316) 2023-07-18 17:55:13 +02:00
Mike Fährmann
90231f2d5a [twitter] add 'tweet-endpoint' option (#4307)
use the newer TweetResultByRestId only for guests by default
2023-07-18 17:19:32 +02:00
Mike Fährmann
20ed647f6f [twitter] add 'user' extractor and 'include' option (#4275) 2023-07-18 16:42:55 +02:00
Mike Fährmann
86be197d11 [twitter] remove '/search/adaptive.json' 2023-07-18 15:45:37 +02:00
enduser420
12cd85658b [redgifs] add 'niches' extractor 2023-07-16 21:22:06 +05:30
Mike Fährmann
248e8bc699 release version 1.25.8 2023-07-15 19:24:43 +02:00
Mike Fährmann
bc9123cfee [naverwebtoon] fix 'comic' metadata extraction 2023-07-14 22:41:36 +02:00
Mike Fährmann
ab5dde7221 [mangaread] fix 'tags' extraction 2023-07-14 22:36:06 +02:00
Mike Fährmann
c9a82c9313 [erome] ignore duplicate album IDs 2023-07-14 22:21:02 +02:00
Mike Fährmann
c84397023a [slideshare] fix extraction 2023-07-14 21:52:53 +02:00
Mike Fährmann
ffbbbd3baf [gelbooru_v01] 'vidyart' -> 'vidyart2' 2023-07-14 15:09:39 +02:00
Mike Fährmann
e40b90e137 merge #4303: [gelbooru_v01] fix 'source' (#4302) 2023-07-14 15:00:58 +02:00
Mike Fährmann
c6b31a2169 [reddit] set default 0.6s delay between requests (#4292)
to limit API requests to 100 per minute
https://www.reddit.com/r/redditdev/comments/14nbw6g/
2023-07-14 14:41:16 +02:00
Mike Fährmann
20da41018d [pornhub] set 'accessAgeDisclaimerPH' cookie (#4301) 2023-07-14 14:30:27 +02:00
ncaat
75757c4ace [gelbooru_v01] fix 'source' (#4302) 2023-07-14 12:53:24 +02:00
Mike Fährmann
2dd6942d1c [jpgfish] update domain to 'jpeg.pet' 2023-07-13 23:21:01 +02:00
Mike Fährmann
1137b89ed4 [lineblog] remove module
"LINE BLOGは2023年6月29日をもちましてサービスを終了いたしました"
2023-07-13 20:46:04 +02:00
Mike Fährmann
86560fe0cd [bcy] remove module
"The website was shut down on July 12, 2023"
https://danbooru.donmai.us/wiki_pages/bcy
2023-07-13 20:46:04 +02:00
Mike Fährmann
fceabee433 [philomena] use API interface class
handle 429 errors and retry after 10min (#4288)
2023-07-13 20:46:04 +02:00
Mike Fährmann
fc43c74694 [docs] update reddit client-id instructions (#4292)
add clearing cached access tokens and getting a new refresh token
2023-07-13 20:43:36 +02:00
Mike Fährmann
f079d9a703 [reddit] notify users about registering an oauth application
(#4292, #4253, #3943)
2023-07-12 21:43:00 +02:00
Mike Fährmann
fb3d1462b1 merge #4291: [wikifeet] fix 'tag' extraction 2023-07-10 14:42:56 +02:00
Mike Fährmann
0b08e2e8a8 merge #4287: [twitter] Fix following extractor not getting all users 2023-07-10 14:41:00 +02:00
Mike Fährmann
f6553ffd2f [twitter] simplify '_pagination_users'
- remove 'stop' variable
- call 'cursor.startswith()' only once
2023-07-10 14:39:09 +02:00
Mike Fährmann
1590124aae [twibooru] fix '--range' 2023-07-10 14:12:56 +02:00
enduser420
a2111dd025 [wikifeet] fix 'tag' extraction 2023-07-09 12:48:47 +05:30
Mike Fährmann
a1ffa1ff09 [philomena] fix '--range' (#4288) 2023-07-08 23:17:27 +02:00
Mike Fährmann
a27dbe8c82 [twitter] use 'TweetResultByRestId' endpoint (#4250)
allows accessing single Tweets without login
2023-07-08 23:17:10 +02:00
Mike Fährmann
d3d639a159 [twitter] don't treat missing 'TimelineAddEntries' as fatal (#4278) 2023-07-08 22:49:34 +02:00
ActuallyKit
c321c773f2 make the code less ugly 2023-07-09 02:52:04 +07:00
ActuallyKit
a437a34bcf fix lint i guess? 2023-07-09 02:41:46 +07:00
ActuallyKit
6cbc434b54 Fix users pagination 2023-07-09 02:28:35 +07:00
Mike Fährmann
d5b6802774 [seiga] set 'skip_fetish_warning' cookie (#4242) 2023-07-07 20:51:49 +02:00
Mike Fährmann
88d1e29401 [bunkr] use '.la' TLD for 'media-files12' servers (#4147, #4276) 2023-07-07 20:10:28 +02:00
Mike Fährmann
f0cb951566 [paheal] unescape 'source' 2023-07-07 20:03:00 +02:00
Mike Fährmann
b480b7076a [paheal] fix a78f8ce5 for enabled 'metadata' (#4262) 2023-07-07 20:00:49 +02:00
Mike Fährmann
384337d3dd [fantia] send 'X-Requested-With' header only for API requests (#4273) 2023-07-07 15:16:18 +02:00
Mike Fährmann
c2ac665ff7 [fantia] send 'X-Requested-With' header (#4273) 2023-07-06 19:03:53 +02:00
Mike Fährmann
7444fc125b [gfycat] implement login support (#3770, #4271)
For the record: '/webtoken' and '/weblogin' are not the same ...
2023-07-06 18:56:34 +02:00
Mike Fährmann
e9b9f751bf [gfycat] support '@me' user (#3770, #4271) 2023-07-06 16:03:35 +02:00
Mike Fährmann
5b59a0d143 update default User-Agent header to Firefox 115 ESR 2023-07-05 15:12:50 +02:00
Mike Fährmann
0556e1ad45 merge #4268: [newgrounds] extract & pass auth token for login 2023-07-04 21:51:03 +02:00
Mike Fährmann
a16d7c59cb [newgrounds] access 'response.text' only once 2023-07-04 21:49:57 +02:00
Mike Fährmann
1bf9f52c99 [twitter] add 'ratelimit' option (#4251) 2023-07-04 18:17:32 +02:00
Mike Fährmann
f86fdf64a6 [twitter] use GraphQL search by default (#4264) 2023-07-04 17:55:22 +02:00