Commit Graph

5072 Commits

Author SHA1 Message Date
Mike Fährmann
e256434c9e use custom HTTPBasicAuth class
to support LazyPrompt as password
and to generate the Authorization header only once
instead of for every request
2023-12-07 01:40:31 +01:00
Mike Fährmann
bdebe4597a fix util.dump_response to work with bytes as header values 2023-12-06 23:03:34 +01:00
Mike Fährmann
6a4218aa23 handle 'json' parameter in Extractor.request() manually
Mainly to allow passing custom classes like util.LazyPrompt,
but also to simplify and streamline how requests handles it.
2023-12-06 22:13:13 +01:00
Mike Fährmann
9dd5cb8c8a interactively prompt for passwords on login when none is provided 2023-12-06 22:12:59 +01:00
Mike Fährmann
db978b34f1 [docker] use PAK for GHCR login (#4831) 2023-12-06 12:28:52 +01:00
Mike Fährmann
d1ea60c057 [github] fix docker workflow (#4831)
- run only on tagged commits and not on every commit to master
- use the correct github token
2023-12-05 22:55:07 +01:00
Mike Fährmann
99b76628f7 implement '-e/--error-file' command-line option (#4732)
copying per-URL options from regular, read-only input files
does currently not work
2023-12-05 20:49:51 +01:00
Mike Fährmann
4eb3590103 [nijie] fix image URLs of multi-image posts (#4876) 2023-12-05 17:48:50 +01:00
Mike Fährmann
a4e6ea667b [twitter] retry API calls when their response contains errors (#4811) 2023-12-05 15:57:26 +01:00
Mike Fährmann
cf5702c843 [twitter] generalize "Login Required" error (#4734, #4324) 2023-12-05 15:13:58 +01:00
Mike Fährmann
da0da0faaa [exhentai] store more cookies when logging in (#4881)
include 'igneous', 'hath_perks', etc
and not just 'ipb_member_id' and 'ipb_pass_hash' like before
2023-12-04 23:24:11 +01:00
Mike Fährmann
ad0134daf7 add Python 3.12 to classifiers list 2023-12-02 17:57:24 +01:00
Mike Fährmann
43ca49c1b4 [github] add workflow to build and push docker images
heavily inspired by and adapted from
https://github.com/danbooru/danbooru/blob/master/.github/workflows/docker-build.yaml
2023-12-02 17:53:11 +01:00
Mike Fährmann
4dde36889c release version 1.26.3 2023-11-27 21:49:20 +01:00
Mike Fährmann
c83fbe6c2d merge #4855: [nitter] fix video extraction (#4853) 2023-11-27 18:39:05 +01:00
Mike Fährmann
1137d72d48 [tests] skip test_init for BaseExtractor classes without instances 2023-11-27 18:36:15 +01:00
Mike Fährmann
625e94fa7d update extractor test results
still not everything, but good enough for now
2023-11-27 18:30:53 +01:00
Mike Fährmann
013ca21543 [idolcomplex] update to site layout changes 2023-11-27 18:27:08 +01:00
enduser420
1e9bacd169 [nitter] fix video extraction 2023-11-27 21:58:06 +05:30
Mike Fährmann
95c1dfb089 [tests] swap assertEqual argument order
before this, it would show test failures as
+ test value
- extracted value
when it should be the other way round
2023-11-27 01:06:13 +01:00
Mike Fährmann
9f3368c46f [pornhub] fix 'user' metadata for gifs 2023-11-26 23:52:24 +01:00
Mike Fährmann
bdb3ce7217 [foolslide] remove 'powermanga.org' 2023-11-26 23:19:05 +01:00
Mike Fährmann
d9734ce008 [cyberdrop] update to site layout changes 2023-11-26 18:03:13 +01:00
Mike Fährmann
8ac68ffba2 [hentaicosplays] force 'https://' for download URLs 2023-11-26 02:08:12 +01:00
Mike Fährmann
fc1101779c [hiperdex] fix 'manga' metadata 2023-11-26 01:24:42 +01:00
Mike Fährmann
d119507037 [imagefap] fix single image resolution
Downloading from a single image page like
https://www.imagefap.com/photo/123456789/
returned only the thumbnail URL.
2023-11-26 00:30:52 +01:00
Mike Fährmann
311ec1d9ef [mangaread] fix extraction 2023-11-25 23:53:27 +01:00
Mike Fährmann
7608201a44 [tumblr] fix 'day' extractor
another bug caused by a383eca7
2023-11-25 00:51:14 +01:00
Mike Fährmann
c8c744a7c0 [webtoons] fix pagination when receiving an HTTP redirect 2023-11-24 22:17:34 +01:00
Mike Fährmann
23cd17997d [wallpapercave] fix extraction 2023-11-24 21:54:21 +01:00
Mike Fährmann
5b979b5706 [xvideos] fix metadata extraction 2023-11-24 21:27:19 +01:00
Mike Fährmann
adc3aa0b77 [zerochan] fix metadata extraction
author, path, tags
2023-11-24 21:21:14 +01:00
Mike Fährmann
f9dac43be9 [warosu] fix file URLs 2023-11-24 02:44:55 +01:00
Mike Fährmann
645b4627ef [sankaku] update URL patterns 2023-11-24 02:41:52 +01:00
Mike Fährmann
119755a5a3 [tests] implement skipping/failing tests when pressing ctrl+c 2023-11-24 00:48:37 +01:00
Mike Fährmann
4e15513415 [docs] fix 'Example' -> 'Default' from b43be672
copy-paste mistake
2023-11-22 22:14:30 +01:00
Mike Fährmann
1ae43d8123 merge #4841: [fapello] support '.su' TLD (#4840) 2023-11-22 20:18:32 +01:00
Mike Fährmann
b43be67206 [exhentai] add 'gp' option (#4576) 2023-11-22 20:15:00 +01:00
Mike Fährmann
cb9a1176e6 [pixeldrain] add 'api-key' option (#4839) 2023-11-22 19:13:51 +01:00
Mike Fährmann
e1404827a6 [pixeldrain] add 'file' and 'album' extractors (#4839) 2023-11-22 19:01:19 +01:00
enduser420
2402162e8a [fapello] support '.su' TLD 2023-11-22 19:35:43 +05:30
Mike Fährmann
725c8dd55a [tmohentai] 'categories' -> 'genres'
quite likely that the site meant 'genres' by "Genders"
2023-11-21 22:11:43 +01:00
Mike Fährmann
0f3a068e3d merge #4831: add simple dockerfile 2023-11-21 20:27:50 +01:00
Mike Fährmann
ce7c4cb544 merge #4832: [tmohentai] add 'gallery' extractor (#4808) 2023-11-21 20:25:49 +01:00
Mike Fährmann
c4a201ed42 [tmohentai] simplify + tests 2023-11-21 20:24:07 +01:00
Mike Fährmann
e17a48fe56 [blogger] inherit from BaseExtractor
- support www.micmicidol.club (#4759)
2023-11-21 16:52:25 +01:00
jsouthgb
714b1a7089 [tmohentai] simplify url matching 2023-11-21 10:46:48 -05:00
jsouthgb
31963fa947 [tmohentai] inherit from GalleryExtractor. refactor metadata. 2023-11-20 21:35:32 -05:00
Mike Fährmann
0fa85360a0 merge #4812: [erome] add 'count' metadata field 2023-11-20 22:42:02 +01:00
Mike Fährmann
a43cf78bb7 [erome] tests 2023-11-20 22:41:12 +01:00