Commit Graph

5097 Commits

Author SHA1 Message Date
Mike Fährmann
aac8bb4eae [deviantart] simplify 9951c112 2023-12-15 17:39:42 +01:00
Mike Fährmann
9951c112f8 [deviantart] workaround for integer client_id values (#4924) 2023-12-14 16:25:06 +01:00
Mike Fährmann
a37b7759bc [myhentaigallery] recognize '/g/' URLs (#4920) 2023-12-12 20:02:28 +01:00
Mike Fährmann
da76e13e3b [tumblr] fix exception after waiting for rate limit (#4916)
use a loop instead of recursive function calls
2023-12-12 19:14:06 +01:00
Mike Fährmann
d59d4ebff4 [tumblr] support infinite 'fallback-retries' 2023-12-11 23:40:13 +01:00
Mike Fährmann
2d5cda2b92 [exhentai] fix TypeError for infinite 'fallback-retries' (#4911) 2023-12-11 23:39:56 +01:00
Mike Fährmann
a24b82e67d add 'util.repeat()' 2023-12-11 23:32:28 +01:00
Mike Fährmann
92fbf09643 remove single quotes in some logging messages (#4908)
('FileNotFoundError: [Errno 2] No such file or directory: ''')
->
(FileNotFoundError: [Errno 2] No such file or directory: '')
2023-12-11 19:13:45 +01:00
Mike Fährmann
1d5ee4239d [docker] let metadata-action automatically generate 'latest' tags 2023-12-10 22:43:04 +01:00
Mike Fährmann
28d60e3546 release version 1.26.4 2023-12-10 17:43:32 +01:00
Mike Fährmann
9a001fa6e4 merge #4906: [patreon] fix bootstrap data extraction (#4904) 2023-12-10 16:53:54 +01:00
Tobi823
66cbe9da41 - fix style check failure "line to long" 2023-12-10 16:24:00 +01:00
Tobi823
244444b194 - adapt code to current code style 2023-12-10 16:22:32 +01:00
Tobi823
fd06255f93 - reformat and refactor to pass tests 2023-12-10 16:17:34 +01:00
Tobi823
5ff7106d4f - add code for the situation when Patreon is using window.patreon = wrapInProxy({"bootstrap":' to store metadata
- refactor code to make it more readable
- output page content when the HTML structure is unknown (to make debugging easier)
2023-12-10 16:10:46 +01:00
Mike Fährmann
75697dfb26 implement -e/--error-file as a logging handler
similar to --write-unsupported
2023-12-10 00:06:39 +01:00
Mike Fährmann
ac22bbe80c [twitter] retry API requests only for Timeout errors (#4811) 2023-12-09 22:30:48 +01:00
Mike Fährmann
c55955db03 [twitter] quick and dirty fix for /media changes (#4898) 2023-12-09 15:38:42 +01:00
Mike Fährmann
9a8dc6b02b [exhentai] add 'fallback-retries' option (#4792) 2023-12-09 02:01:59 +01:00
Mike Fährmann
bf74eb5c46 merge #4886: [urlgalleries] add 'gallery' extractor (#919, #1184, #2905) 2023-12-08 22:55:58 +01:00
Mike Fährmann
ade93c5397 [urlgalleries] add tests 2023-12-08 22:55:16 +01:00
Mike Fährmann
c29ae9af08 [urlgalleries] simplify + resolve redirects 2023-12-08 22:43:56 +01:00
Mike Fährmann
042a9da451 add 'output.errorfile' config option 2023-12-08 17:29:54 +01:00
Mike Fährmann
e256434c9e use custom HTTPBasicAuth class
to support LazyPrompt as password
and to generate the Authorization header only once
instead of for every request
2023-12-07 01:40:31 +01:00
Mike Fährmann
bdebe4597a fix util.dump_response to work with bytes as header values 2023-12-06 23:03:34 +01:00
Mike Fährmann
6a4218aa23 handle 'json' parameter in Extractor.request() manually
Mainly to allow passing custom classes like util.LazyPrompt,
but also to simplify and streamline how requests handles it.
2023-12-06 22:13:13 +01:00
Mike Fährmann
9dd5cb8c8a interactively prompt for passwords on login when none is provided 2023-12-06 22:12:59 +01:00
Mike Fährmann
db978b34f1 [docker] use PAK for GHCR login (#4831) 2023-12-06 12:28:52 +01:00
Mike Fährmann
d1ea60c057 [github] fix docker workflow (#4831)
- run only on tagged commits and not on every commit to master
- use the correct github token
2023-12-05 22:55:07 +01:00
Mike Fährmann
99b76628f7 implement '-e/--error-file' command-line option (#4732)
copying per-URL options from regular, read-only input files
does currently not work
2023-12-05 20:49:51 +01:00
Mike Fährmann
4eb3590103 [nijie] fix image URLs of multi-image posts (#4876) 2023-12-05 17:48:50 +01:00
Mike Fährmann
a4e6ea667b [twitter] retry API calls when their response contains errors (#4811) 2023-12-05 15:57:26 +01:00
Mike Fährmann
cf5702c843 [twitter] generalize "Login Required" error (#4734, #4324) 2023-12-05 15:13:58 +01:00
jsouthgb
ecaa0feb5d [urlgalleries] add support 2023-12-05 07:08:11 -05:00
jsouthgb
1770c31e63 [urlgalleries] add support 2023-12-05 07:07:06 -05:00
Mike Fährmann
da0da0faaa [exhentai] store more cookies when logging in (#4881)
include 'igneous', 'hath_perks', etc
and not just 'ipb_member_id' and 'ipb_pass_hash' like before
2023-12-04 23:24:11 +01:00
Mike Fährmann
ad0134daf7 add Python 3.12 to classifiers list 2023-12-02 17:57:24 +01:00
Mike Fährmann
43ca49c1b4 [github] add workflow to build and push docker images
heavily inspired by and adapted from
https://github.com/danbooru/danbooru/blob/master/.github/workflows/docker-build.yaml
2023-12-02 17:53:11 +01:00
Mike Fährmann
4dde36889c release version 1.26.3 2023-11-27 21:49:20 +01:00
Mike Fährmann
c83fbe6c2d merge #4855: [nitter] fix video extraction (#4853) 2023-11-27 18:39:05 +01:00
Mike Fährmann
1137d72d48 [tests] skip test_init for BaseExtractor classes without instances 2023-11-27 18:36:15 +01:00
Mike Fährmann
625e94fa7d update extractor test results
still not everything, but good enough for now
2023-11-27 18:30:53 +01:00
Mike Fährmann
013ca21543 [idolcomplex] update to site layout changes 2023-11-27 18:27:08 +01:00
enduser420
1e9bacd169 [nitter] fix video extraction 2023-11-27 21:58:06 +05:30
Mike Fährmann
95c1dfb089 [tests] swap assertEqual argument order
before this, it would show test failures as
+ test value
- extracted value
when it should be the other way round
2023-11-27 01:06:13 +01:00
Mike Fährmann
9f3368c46f [pornhub] fix 'user' metadata for gifs 2023-11-26 23:52:24 +01:00
Mike Fährmann
bdb3ce7217 [foolslide] remove 'powermanga.org' 2023-11-26 23:19:05 +01:00
Mike Fährmann
d9734ce008 [cyberdrop] update to site layout changes 2023-11-26 18:03:13 +01:00
Mike Fährmann
8ac68ffba2 [hentaicosplays] force 'https://' for download URLs 2023-11-26 02:08:12 +01:00
Mike Fährmann
fc1101779c [hiperdex] fix 'manga' metadata 2023-11-26 01:24:42 +01:00