Commit Graph

949 Commits

Author SHA1 Message Date
Mike Fährmann
0a7eee3ee0 [deviantart] add 'public' option 2023-04-08 23:04:34 +02:00
Mike Fährmann
75666cf9c3 [danbooru] reduce API requests for fetching extended 'metadata'
Instead of using one additional API request per post object (N+1),
this requires only one request per 200-post batch.
2023-04-02 20:11:52 +02:00
Mike Fährmann
421db26aff [bunkr] update domain to 'bunkr.la' 2023-03-28 20:10:36 +02:00
Mike Fährmann
89a67c45e0 [nitter] support nitter.it (#3819) 2023-03-25 13:29:22 +01:00
Mike Fährmann
197882cf12 [twitter] add 'hashtag' extractor (#3783) 2023-03-22 22:20:40 +01:00
Mike Fährmann
46fdf46f21 [formatter] support loading an f-string from a template file
"\fTF ~/path/to/file.txt"
2023-03-20 22:05:33 +01:00
Mike Fährmann
1a4d4a799b [formatter] support filesystem paths for \fM 2023-03-20 22:01:33 +01:00
Mike Fährmann
00f0233b28 [postprocessor:metadata] add 'skip' option (#3786) 2023-03-17 23:30:11 +01:00
Mike Fährmann
a1ca2404f9 add 'globals' instead of overwriting the default (#3773) 2023-03-16 18:37:00 +01:00
Mike Fährmann
17bd053d94 [hiperdex] fix extraction (#3768) 2023-03-15 14:28:03 +01:00
Mike Fährmann
817fc0fbd1 [nitter] remove nitter.pussthecat.org
"Shutdown"
2023-03-09 23:48:39 +01:00
Mike Fährmann
da9840a39d [reddit] update 'videos' option (#3712)
- add 'dash' to directly extract DASH manifest URLs
  (was default behavior since a7c79531)
- change default strategy back to before a7c79531
- disable 'Falling back on generic information extractor' warning
2023-03-06 12:18:25 +01:00
Mike Fährmann
baf41d7437 [misskey] update (#3717)
- add module docstring
- add options to docs/gallery-dl.conf
2023-03-03 15:52:50 +01:00
enduser420
e1867cf5eb [misskey] add 'renotes' and 'replies' options 2023-03-02 19:56:19 +05:30
enduser420
a95b5e0d8e [misskey] add misskey extractors 2023-03-02 19:49:47 +05:30
Mike Fährmann
0d142e403c [szurubooru] add 'tag' and 'post' extractors (#3583, #3713) 2023-03-01 18:47:10 +01:00
Mike Fährmann
075c965512 add '--config-create' command-line option
(#2333)
2023-03-01 14:49:40 +01:00
Mike Fährmann
632d5d7745 allow loading config files in TOML format with --config-toml 2023-02-28 21:54:46 +01:00
Mike Fährmann
d788e6c60c implement 'globals' option 2023-02-28 18:18:55 +01:00
Mike Fährmann
b14f8d5817 [gelbooru] add 'favorite' extractor (#3704)
requires logged in cookies to work
2023-02-27 18:03:47 +01:00
Mike Fährmann
e480a93337 add 'output.stdout', '.stdin', and '.stderr' options
(#1621, #2152, #2529)

Allow setting custom input/output encodings and options
without having to rely on Python's defaults.
2023-02-26 14:56:19 +01:00
Mike Fährmann
6ed4309aba [deviantart] add 'gallery-search' extractor (#1695) 2023-02-22 17:25:31 +01:00
Mike Fährmann
e1df7f73b1 [deviantart] add 'search' extractor
(#538, #1264, #2954, #2970, #3577)

Requires login to fetch any results, since the API endpoint raises an
error for not logged in requests.

TODO: parse HTML search results
2023-02-20 20:54:46 +01:00
Mike Fährmann
bb11c2a576 merge #3662: [redgifs] add 'collection' extractors 2023-02-18 13:09:17 +01:00
Mike Fährmann
884f1848d6 [redgifs] fix syntax for older Python versions
and update docs/supportedsites
2023-02-18 13:07:40 +01:00
Mike Fährmann
2bd8f2f4bd [pornpics] add 'search' and 'tag' extractors
(#263, #3544, #3654)
2023-02-17 23:03:14 +01:00
Mike Fährmann
79bc82884c [pornpics] add 'gallery' extractor (#263, #3544, #3654) 2023-02-17 15:00:57 +01:00
Mike Fährmann
bd5d08abbc [catbox] add 'file' extractor (#3570) 2023-02-15 19:50:26 +01:00
Mike Fährmann
2a53e6445c [bunkr] update domain (#3636) 2023-02-09 19:28:32 +01:00
Mike Fährmann
b7337d810e [postprocessor:metadata] add 'sort' and 'separators' options 2023-02-07 18:28:14 +01:00
Mike Fährmann
762a68996b implement 'archive-pragma' option 2023-02-05 17:00:31 +01:00
Mike Fährmann
bbf0911a46 [e621] implement 'notes' and 'pools' metadata extraction
(#3425)
2023-02-04 21:20:38 +01:00
Mike Fährmann
925b467496 split e621 from danbooru module (#3425) 2023-02-03 19:24:31 +01:00
Mike Fährmann
1ae48a54f8 [twitter] add 'transform' option 2023-02-02 22:01:36 +01:00
Mike Fährmann
78d3960a31 [postprocessor:exec] implement archive options (#3584) 2023-02-01 13:57:16 +01:00
Mike Fährmann
0f7e6c422a merge #3596: [shopify] support ohpolly.com 2023-01-31 20:13:51 +01:00
enduser420
fcf7030b85 [shopify] support ohpolly.com 2023-02-01 00:31:12 +05:30
Mike Fährmann
4572c122d8 document 'extractor.module-sources' 2023-01-30 23:32:36 +01:00
Mike Fährmann
c2bc70593e implement ability to load external extractor classes
- -X/--extractors
- extractor.module-sources
2023-01-30 23:10:10 +01:00
Mike Fährmann
13a90969c7 merge #3575: [nudecollect] add 'image' and 'album' extractors 2023-01-28 16:04:47 +01:00
Mike Fährmann
abc3619feb [lexica] add 'search' extractor (#3567) 2023-01-28 16:00:32 +01:00
Mike Fährmann
f58215705a add '-O/--postprocessor-option' command-line option (#3565) 2023-01-26 14:59:24 +01:00
enduser420
2a5903dc16 [nudecollect] add 'image' and 'album' extractors 2023-01-26 17:25:33 +05:30
Mike Fährmann
58c008e30a [hiperdex] update domain (#3572) 2023-01-26 12:01:16 +01:00
Mike Fährmann
caae8fefe1 merge #3541: [deviantart] add extractor for status updates 2023-01-23 13:54:51 +01:00
ClosedPort22
3b32671fbd [deviantart] add extractor for status updates
extract user status updates using the '/user/statuses/' endpoint
2023-01-19 11:30:48 +08:00
enduser420
5cb263fdd2 [wikifeet/wikifeetx] add 'gallery' extractor 2023-01-16 21:08:45 +05:30
Mike Fährmann
4e86aaa4db document 'extractor.headers' and 'extractor.ciphers' 2023-01-16 14:49:56 +01:00
Mike Fährmann
c881548a27 add 'extractor.retry-codes' option (#3313)
do not retry 429 and 430 by default
2023-01-14 17:25:30 +01:00
Mike Fährmann
512abeb4ae [booru] add 'url' option 2023-01-13 16:32:32 +01:00