Commit Graph

3727 Commits

Author SHA1 Message Date
Mike Fährmann
6a4218aa23 handle 'json' parameter in Extractor.request() manually
Mainly to allow passing custom classes like util.LazyPrompt,
but also to simplify and streamline how requests handles it.
2023-12-06 22:13:13 +01:00
Mike Fährmann
9dd5cb8c8a interactively prompt for passwords on login when none is provided 2023-12-06 22:12:59 +01:00
Mike Fährmann
4eb3590103 [nijie] fix image URLs of multi-image posts (#4876) 2023-12-05 17:48:50 +01:00
Mike Fährmann
a4e6ea667b [twitter] retry API calls when their response contains errors (#4811) 2023-12-05 15:57:26 +01:00
Mike Fährmann
cf5702c843 [twitter] generalize "Login Required" error (#4734, #4324) 2023-12-05 15:13:58 +01:00
Mike Fährmann
da0da0faaa [exhentai] store more cookies when logging in (#4881)
include 'igneous', 'hath_perks', etc
and not just 'ipb_member_id' and 'ipb_pass_hash' like before
2023-12-04 23:24:11 +01:00
Mike Fährmann
c83fbe6c2d merge #4855: [nitter] fix video extraction (#4853) 2023-11-27 18:39:05 +01:00
Mike Fährmann
013ca21543 [idolcomplex] update to site layout changes 2023-11-27 18:27:08 +01:00
enduser420
1e9bacd169 [nitter] fix video extraction 2023-11-27 21:58:06 +05:30
Mike Fährmann
9f3368c46f [pornhub] fix 'user' metadata for gifs 2023-11-26 23:52:24 +01:00
Mike Fährmann
bdb3ce7217 [foolslide] remove 'powermanga.org' 2023-11-26 23:19:05 +01:00
Mike Fährmann
d9734ce008 [cyberdrop] update to site layout changes 2023-11-26 18:03:13 +01:00
Mike Fährmann
8ac68ffba2 [hentaicosplays] force 'https://' for download URLs 2023-11-26 02:08:12 +01:00
Mike Fährmann
fc1101779c [hiperdex] fix 'manga' metadata 2023-11-26 01:24:42 +01:00
Mike Fährmann
d119507037 [imagefap] fix single image resolution
Downloading from a single image page like
https://www.imagefap.com/photo/123456789/
returned only the thumbnail URL.
2023-11-26 00:30:52 +01:00
Mike Fährmann
311ec1d9ef [mangaread] fix extraction 2023-11-25 23:53:27 +01:00
Mike Fährmann
7608201a44 [tumblr] fix 'day' extractor
another bug caused by a383eca7
2023-11-25 00:51:14 +01:00
Mike Fährmann
c8c744a7c0 [webtoons] fix pagination when receiving an HTTP redirect 2023-11-24 22:17:34 +01:00
Mike Fährmann
23cd17997d [wallpapercave] fix extraction 2023-11-24 21:54:21 +01:00
Mike Fährmann
5b979b5706 [xvideos] fix metadata extraction 2023-11-24 21:27:19 +01:00
Mike Fährmann
adc3aa0b77 [zerochan] fix metadata extraction
author, path, tags
2023-11-24 21:21:14 +01:00
Mike Fährmann
f9dac43be9 [warosu] fix file URLs 2023-11-24 02:44:55 +01:00
Mike Fährmann
645b4627ef [sankaku] update URL patterns 2023-11-24 02:41:52 +01:00
Mike Fährmann
1ae43d8123 merge #4841: [fapello] support '.su' TLD (#4840) 2023-11-22 20:18:32 +01:00
Mike Fährmann
b43be67206 [exhentai] add 'gp' option (#4576) 2023-11-22 20:15:00 +01:00
Mike Fährmann
cb9a1176e6 [pixeldrain] add 'api-key' option (#4839) 2023-11-22 19:13:51 +01:00
Mike Fährmann
e1404827a6 [pixeldrain] add 'file' and 'album' extractors (#4839) 2023-11-22 19:01:19 +01:00
enduser420
2402162e8a [fapello] support '.su' TLD 2023-11-22 19:35:43 +05:30
Mike Fährmann
725c8dd55a [tmohentai] 'categories' -> 'genres'
quite likely that the site meant 'genres' by "Genders"
2023-11-21 22:11:43 +01:00
Mike Fährmann
ce7c4cb544 merge #4832: [tmohentai] add 'gallery' extractor (#4808) 2023-11-21 20:25:49 +01:00
Mike Fährmann
c4a201ed42 [tmohentai] simplify + tests 2023-11-21 20:24:07 +01:00
Mike Fährmann
e17a48fe56 [blogger] inherit from BaseExtractor
- support www.micmicidol.club (#4759)
2023-11-21 16:52:25 +01:00
jsouthgb
714b1a7089 [tmohentai] simplify url matching 2023-11-21 10:46:48 -05:00
jsouthgb
31963fa947 [tmohentai] inherit from GalleryExtractor. refactor metadata. 2023-11-20 21:35:32 -05:00
Mike Fährmann
0fa85360a0 merge #4812: [erome] add 'count' metadata field 2023-11-20 22:42:02 +01:00
Mike Fährmann
a43cf78bb7 [erome] tests 2023-11-20 22:41:12 +01:00
Mike Fährmann
34a387b6e2 support 'metadata-*' names for '*-metadata' options
For example, instead of 'url-metadata' it is now also possible to use
'metadata-url' as option name.

- metadata-url
- metadata-path
- metadata-http
- metadata-version
- metadata-parent
2023-11-18 23:52:10 +01:00
Mike Fährmann
e97d7b1c85 [exhentai] fix empty api_url with '"source": "hitomi"' (#4829) 2023-11-18 21:06:41 +01:00
jsouthgb
ed965eecbb [tmohentai] refactor to str.format for backwards compatibility 2023-11-18 14:39:17 -05:00
jsouthgb
dad7ba1d58 [tmohentai] fix edge cases. updated archive_fmt and filename_fmt 2023-11-17 21:08:34 -05:00
jsouthgb
286d0cb098 [tmohentai] add support 2023-11-17 19:34:34 -05:00
Mike Fährmann
07cb584231 [behance] add 'modules' option (#4799) 2023-11-17 22:54:38 +01:00
Mike Fährmann
6a753d9ff3 [behance] support 'text' modules (#4799) 2023-11-17 22:54:38 +01:00
jsouthgb
c6ad9bcd9b [erome] add "count" for albums 2023-11-15 07:08:52 -05:00
Mike Fährmann
17e710c4bf [oauth] warn when cache is enabled but not writeable (#4771) 2023-11-13 16:24:54 +01:00
Mike Fährmann
2e4bf54644 [hentaifoundry] check for and update expired sessions (#4694) 2023-11-13 00:27:22 +01:00
Mike Fährmann
0435c6e603 [exhentai] handle 'Downloading … requires GP' errors (#4576, #4763) 2023-11-12 22:47:40 +01:00
Mike Fährmann
4288cea94a [mastodon] fix reblogs (#4580) 2023-11-11 00:34:49 +01:00
Mike Fährmann
7a0f145cbe [twitter] ignore promoted Tweets (#4790, #3894)
add 'ads' option in case someone actually wants to
download promoted content for whatever reason
2023-11-10 23:46:46 +01:00
Mike Fährmann
e8b5e59a08 [weibo] detect redirects to login page (#4773) 2023-11-10 19:35:29 +01:00