Commit Graph

4392 Commits

Author SHA1 Message Date
Mike Fährmann
0d142e403c [szurubooru] add 'tag' and 'post' extractors (#3583, #3713) 2023-03-01 18:47:10 +01:00
Mike Fährmann
075c965512 add '--config-create' command-line option
(#2333)
2023-03-01 14:49:40 +01:00
Mike Fährmann
26d06e0bb2 move executable check into util.py 2023-02-28 23:10:23 +01:00
Mike Fährmann
de2f35d068 simplify config.load() 2023-02-28 22:02:15 +01:00
Mike Fährmann
632d5d7745 allow loading config files in TOML format with --config-toml 2023-02-28 21:54:46 +01:00
Mike Fährmann
9e870eb930 rename --ignore-config to --config-ignore
--ignore-config still works as before,
but is no longer shown by --help
2023-02-28 21:07:42 +01:00
Mike Fährmann
d66257f2c8 improve option.Formatter performance
as always, only a very marginal difference,
but it still uses less resources than before
2023-02-28 20:57:28 +01:00
Mike Fährmann
d788e6c60c implement 'globals' option 2023-02-28 18:18:55 +01:00
Mike Fährmann
b14f8d5817 [gelbooru] add 'favorite' extractor (#3704)
requires logged in cookies to work
2023-02-27 18:03:47 +01:00
Mike Fährmann
e480a93337 add 'output.stdout', '.stdin', and '.stderr' options
(#1621, #2152, #2529)

Allow setting custom input/output encodings and options
without having to rely on Python's defaults.
2023-02-26 14:56:19 +01:00
Mike Fährmann
a70a3e5da6 [mangasee] extract 'author' and 'genre' metadata (#3703)
Both are lists/arrays. Use {author!S} or {genre:J, } to format them.
2023-02-26 14:12:19 +01:00
Mike Fährmann
6b03506655 [deviantart] allow searching when not logged in 2023-02-25 19:04:18 +01:00
Mike Fährmann
511a051705 [fanbox] fix crash with missing images (#3673) 2023-02-23 23:30:55 +01:00
Mike Fährmann
3fa456d989 [deviantart] remove mature scraps warning (#3691)
warn about private deviations
when paginating over eclipse results
2023-02-23 22:56:37 +01:00
Mike Fährmann
51301e0c31 replace remaining time.sleep() calls
with Extractor.sleep() or request_interval
2023-02-23 00:35:37 +01:00
Mike Fährmann
6ed4309aba [deviantart] add 'gallery-search' extractor (#1695) 2023-02-22 17:25:31 +01:00
Mike Fährmann
3d8777fbc1 move user agent string to util.py 2023-02-22 11:09:17 +01:00
Mike Fährmann
56039d2456 add 'hash_md5' and 'hash_sha1' functions (#3679)
... to global eval namespace
2023-02-22 10:58:44 +01:00
Mike Fährmann
e1df7f73b1 [deviantart] add 'search' extractor
(#538, #1264, #2954, #2970, #3577)

Requires login to fetch any results, since the API endpoint raises an
error for not logged in requests.

TODO: parse HTML search results
2023-02-20 20:54:46 +01:00
Mike Fährmann
4f029ab38b [pornpics] support '/pornstar' and '/channels' listings
- fix docstring (#3671)
- simplify code
2023-02-18 22:38:21 +01:00
Mike Fährmann
cbe4769246 [danbooru] use gallery-dl UA (#3665)
this removes the ability to set a custom UA via 'user-agent' option
for extractor requests
2023-02-18 22:28:35 +01:00
Mike Fährmann
253ac08203 pre-define and use 'gallery-dö/<version>' UA string 2023-02-18 22:25:54 +01:00
Mike Fährmann
b4899c266f merge #3656: [deviantart] fix crash when handling deleted deviations in status updates 2023-02-18 13:11:47 +01:00
Mike Fährmann
bb11c2a576 merge #3662: [redgifs] add 'collection' extractors 2023-02-18 13:09:17 +01:00
Mike Fährmann
884f1848d6 [redgifs] fix syntax for older Python versions
and update docs/supportedsites
2023-02-18 13:07:40 +01:00
Mike Fährmann
725baedad3 [deviantart] use '/collections/all' endpoint for favorites
(#3666 ,#3668)
2023-02-17 23:11:35 +01:00
Mike Fährmann
2bd8f2f4bd [pornpics] add 'search' and 'tag' extractors
(#263, #3544, #3654)
2023-02-17 23:03:14 +01:00
Mike Fährmann
79bc82884c [pornpics] add 'gallery' extractor (#263, #3544, #3654) 2023-02-17 15:00:57 +01:00
Mike Fährmann
7bdc1d6d3d [manganelo] update and fix metadata extraction 2023-02-16 22:31:18 +01:00
Mike Fährmann
363bb76dff [manganelo] simplify URL pattern 2023-02-16 21:36:11 +01:00
enduser420
b28bd9789e [redgifs] add 'collection' extractors 2023-02-16 20:10:22 +05:30
ClosedPort22
f4e211356d [deviantart] slight refactor 2023-02-16 21:23:55 +08:00
Mike Fährmann
bd5d08abbc [catbox] add 'file' extractor (#3570) 2023-02-15 19:50:26 +01:00
Mike Fährmann
8e1e8a5bea [soundgasm] rewrite (#3578)
use a more standard extractor structure to make -A work as expected
2023-02-15 16:52:07 +01:00
Mike Fährmann
0b93420a81 [pinterest] unescape search terms (#3621) 2023-02-15 15:44:20 +01:00
Mike Fährmann
ad96e70546 [bunkr] fix extraction (#3636, #3655) 2023-02-15 15:42:32 +01:00
Mike Fährmann
9335d55bbc [manganelo] support mobile-only chapters 2023-02-15 00:02:28 +01:00
ClosedPort22
a74114ef7a [deviantart] fix crash when handling deleted deviations
in status updates
2023-02-15 00:17:11 +08:00
Mike Fährmann
75570ad3f1 [oauth] remove stray 'exit()' (#3628)
- bug from 70ce45d9
- broke oauth:tumblr, oauth:flickr, and oauth:smugmug
2023-02-13 15:58:34 +01:00
Mike Fährmann
d37e7f4898 add 'hooks' option
Very much a work in progress.

At the moment, it allows to
- wait and restart an extractor (#3338)
- change the exit code (#3630)
- change the log level of a logging message
based on the contents of a logging message
2023-02-13 13:33:42 +01:00
Mike Fährmann
8fb043e8ff [tumblr] raise more detailed errors for dashboard-only blogs
(#3628)
2023-02-12 19:38:14 +01:00
Mike Fährmann
d4232f3a8b implement restarting an extractor (#3338) 2023-02-11 21:06:14 +01:00
Mike Fährmann
ce996dd21b [poipiku] warn about incorrect passwords (#3646) 2023-02-11 15:10:49 +01:00
Mike Fährmann
70ce45d965 [oauth] use default name for browsers without 'name' attribute
(#3645)

Seem to only be an issue for MacOSXOSAScript before Python 3.11.
d12bec6993
2023-02-11 14:48:59 +01:00
Mike Fährmann
1aae72773f put argument init on separate lines 2023-02-10 17:05:20 +01:00
Mike Fährmann
2a53e6445c [bunkr] update domain (#3636) 2023-02-09 19:28:32 +01:00
Mike Fährmann
5503ac4d5e replace json.dumps with direct calls to JSONEncoder.encode 2023-02-09 15:51:40 +01:00
Mike Fährmann
dd884b02ee replace json.loads with direct calls to JSONDecoder.decode 2023-02-09 15:22:00 +01:00
Mike Fährmann
b7337d810e [postprocessor:metadata] add 'sort' and 'separators' options 2023-02-07 18:28:14 +01:00
Mike Fährmann
8805bd38ab merge #3622: [imagetwist] add phun.imagetwist.com and imagehaha.com support 2023-02-06 14:52:45 +01:00