Commit Graph

4708 Commits

Author SHA1 Message Date
Mike Fährmann
fbebc58189 [deviantart] add 'intermediary' option (#4955) 2023-12-21 02:23:22 +01:00
Mike Fährmann
75fa1a5553 [pinterest] remove login code
this has been broken since forever
and is still "protected" by an invisible recaptcha check
2023-12-20 20:59:18 +01:00
Mike Fährmann
92ff99c8e5 [twitter] remove 'syndication' option (#3889) 2023-12-20 14:38:36 +01:00
Mike Fährmann
a75f85a2c2 [twitter] remove 'date_liked' (#3850, #4108, #4657)
Twitter's 'sortIndex' can't be used to calculate the timestamp
of when a Tweet was liked anymore.
2023-12-20 14:12:49 +01:00
Mike Fährmann
a94f944148 [twitter] default to 'tweets' timeline when 'replies' are enabled (#4953) 2023-12-20 01:57:18 +01:00
Mike Fährmann
a30a3e44d5 [nijie] move 'username required' out of _login_impl 2023-12-18 23:57:44 +01:00
Mike Fährmann
57fc6fcf83 replace '24*3600' with '86400'
and generalize cache maxage values
2023-12-18 23:57:22 +01:00
Mike Fährmann
1f9b16a70b replace static 'sleep-request' defaults with dynamic ones 2023-12-18 22:06:26 +01:00
Mike Fährmann
b127321b5c [exhentai] only show 'using e-hentai.org' warning for exh domains 2023-12-18 15:29:54 +01:00
Mike Fährmann
e097aaf64a [exhentai] output continuation URL when interrupted (#4782) 2023-12-17 23:25:47 +01:00
Mike Fährmann
99aa923322 [inkbunny] improve '/submissionsviewall.php' patterns (#4934)
allow 'mode=…' to be in any position
don't require it to be somewhere in the middle
2023-12-16 19:21:20 +01:00
Mike Fährmann
3f9c113d78 [mastodon] Support non-numeric status IDs (#4936) 2023-12-16 01:52:31 +01:00
Mike Fährmann
2852404e49 [inkbunny] add 'unread' extractor (#4934) 2023-12-15 21:20:12 +01:00
Mike Fährmann
8b87a5330d [inkbunny] stop pagination on empty results 2023-12-15 21:15:02 +01:00
Mike Fährmann
6cd5e6adad [patreon] fix bootstrap data extraction (#4904) 2023-12-15 18:24:52 +01:00
Mike Fährmann
aac8bb4eae [deviantart] simplify 9951c112 2023-12-15 17:39:42 +01:00
Mike Fährmann
9951c112f8 [deviantart] workaround for integer client_id values (#4924) 2023-12-14 16:25:06 +01:00
Mike Fährmann
a37b7759bc [myhentaigallery] recognize '/g/' URLs (#4920) 2023-12-12 20:02:28 +01:00
Mike Fährmann
da76e13e3b [tumblr] fix exception after waiting for rate limit (#4916)
use a loop instead of recursive function calls
2023-12-12 19:14:06 +01:00
Mike Fährmann
d59d4ebff4 [tumblr] support infinite 'fallback-retries' 2023-12-11 23:40:13 +01:00
Mike Fährmann
2d5cda2b92 [exhentai] fix TypeError for infinite 'fallback-retries' (#4911) 2023-12-11 23:39:56 +01:00
Mike Fährmann
a24b82e67d add 'util.repeat()' 2023-12-11 23:32:28 +01:00
Mike Fährmann
92fbf09643 remove single quotes in some logging messages (#4908)
('FileNotFoundError: [Errno 2] No such file or directory: ''')
->
(FileNotFoundError: [Errno 2] No such file or directory: '')
2023-12-11 19:13:45 +01:00
Mike Fährmann
1d5ee4239d [docker] let metadata-action automatically generate 'latest' tags 2023-12-10 22:43:04 +01:00
Mike Fährmann
28d60e3546 release version 1.26.4 2023-12-10 17:43:32 +01:00
Mike Fährmann
9a001fa6e4 merge #4906: [patreon] fix bootstrap data extraction (#4904) 2023-12-10 16:53:54 +01:00
Tobi823
66cbe9da41 - fix style check failure "line to long" 2023-12-10 16:24:00 +01:00
Tobi823
244444b194 - adapt code to current code style 2023-12-10 16:22:32 +01:00
Tobi823
fd06255f93 - reformat and refactor to pass tests 2023-12-10 16:17:34 +01:00
Tobi823
5ff7106d4f - add code for the situation when Patreon is using window.patreon = wrapInProxy({"bootstrap":' to store metadata
- refactor code to make it more readable
- output page content when the HTML structure is unknown (to make debugging easier)
2023-12-10 16:10:46 +01:00
Mike Fährmann
75697dfb26 implement -e/--error-file as a logging handler
similar to --write-unsupported
2023-12-10 00:06:39 +01:00
Mike Fährmann
ac22bbe80c [twitter] retry API requests only for Timeout errors (#4811) 2023-12-09 22:30:48 +01:00
Mike Fährmann
c55955db03 [twitter] quick and dirty fix for /media changes (#4898) 2023-12-09 15:38:42 +01:00
Mike Fährmann
9a8dc6b02b [exhentai] add 'fallback-retries' option (#4792) 2023-12-09 02:01:59 +01:00
Mike Fährmann
bf74eb5c46 merge #4886: [urlgalleries] add 'gallery' extractor (#919, #1184, #2905) 2023-12-08 22:55:58 +01:00
Mike Fährmann
c29ae9af08 [urlgalleries] simplify + resolve redirects 2023-12-08 22:43:56 +01:00
Mike Fährmann
042a9da451 add 'output.errorfile' config option 2023-12-08 17:29:54 +01:00
Mike Fährmann
e256434c9e use custom HTTPBasicAuth class
to support LazyPrompt as password
and to generate the Authorization header only once
instead of for every request
2023-12-07 01:40:31 +01:00
Mike Fährmann
bdebe4597a fix util.dump_response to work with bytes as header values 2023-12-06 23:03:34 +01:00
Mike Fährmann
6a4218aa23 handle 'json' parameter in Extractor.request() manually
Mainly to allow passing custom classes like util.LazyPrompt,
but also to simplify and streamline how requests handles it.
2023-12-06 22:13:13 +01:00
Mike Fährmann
9dd5cb8c8a interactively prompt for passwords on login when none is provided 2023-12-06 22:12:59 +01:00
Mike Fährmann
99b76628f7 implement '-e/--error-file' command-line option (#4732)
copying per-URL options from regular, read-only input files
does currently not work
2023-12-05 20:49:51 +01:00
Mike Fährmann
4eb3590103 [nijie] fix image URLs of multi-image posts (#4876) 2023-12-05 17:48:50 +01:00
Mike Fährmann
a4e6ea667b [twitter] retry API calls when their response contains errors (#4811) 2023-12-05 15:57:26 +01:00
Mike Fährmann
cf5702c843 [twitter] generalize "Login Required" error (#4734, #4324) 2023-12-05 15:13:58 +01:00
jsouthgb
ecaa0feb5d [urlgalleries] add support 2023-12-05 07:08:11 -05:00
jsouthgb
1770c31e63 [urlgalleries] add support 2023-12-05 07:07:06 -05:00
Mike Fährmann
da0da0faaa [exhentai] store more cookies when logging in (#4881)
include 'igneous', 'hath_perks', etc
and not just 'ipb_member_id' and 'ipb_pass_hash' like before
2023-12-04 23:24:11 +01:00
Mike Fährmann
43ca49c1b4 [github] add workflow to build and push docker images
heavily inspired by and adapted from
https://github.com/danbooru/danbooru/blob/master/.github/workflows/docker-build.yaml
2023-12-02 17:53:11 +01:00
Mike Fährmann
4dde36889c release version 1.26.3 2023-11-27 21:49:20 +01:00