Commit Graph

527 Commits

Author SHA1 Message Date
Mike Fährmann
1bf9f52c99 [twitter] add 'ratelimit' option (#4251) 2023-07-04 18:17:32 +02:00
Mike Fährmann
f86fdf64a6 [twitter] use GraphQL search by default (#4264) 2023-07-04 17:55:22 +02:00
Mike Fährmann
6ae3101fd0 [mangapark] add 'source' option (#3969) 2023-07-02 15:07:22 +02:00
Mike Fährmann
c45a913bfd [flickr] add 'exif' option 2023-07-01 19:19:39 +02:00
Mike Fährmann
ccbc1a1d55 [flickr] add 'metadata' option (#4227) 2023-06-26 16:49:48 +02:00
Mike Fährmann
c1cce4a80b [twitter] extend 'conversations' option (#4211) 2023-06-24 21:34:34 +02:00
Mike Fährmann
f50b81d3e9 [docs] add novel-related keys to 'pixiv.include' (#4111) 2023-06-19 15:01:53 +02:00
Mike Fährmann
deff3b434d [vipergirls] implement login support (#4166) 2023-06-13 21:05:09 +02:00
Mike Fährmann
54cf1fa3e7 [twitter] use GraphQL search endpoint (#3942)
for guest users; selectable with 'search-endpoint' option.

adapted from 9c7b888ffa
2023-06-01 21:37:31 +02:00
Mike Fährmann
0cf7282fa0 [pixiv] add 'full-series' option for novels (#4111) 2023-06-01 13:07:20 +02:00
Mike Fährmann
28f6487c64 [instagram] add 'metadata' option (#3107) 2023-05-27 15:51:13 +02:00
Mike Fährmann
f3cca50b9e [mangadex] update links to API docs 2023-05-24 12:32:13 +02:00
Mike Fährmann
65a9f4b124 merge #3950: [misskey] add 'favorite' extractor 2023-05-23 22:18:32 +02:00
Mike Fährmann
c76f0f3a1b [misskey] update
- rename to 'MisskeyFavoriteExtractor'
- add 'access-token' option to docs
- add test URLs for other instances
- simplify 'pattern'
2023-05-23 22:17:17 +02:00
Mike Fährmann
3fca455b82 [pixiv] add 'embeds' option (#1241) 2023-05-23 12:14:06 +02:00
Mike Fährmann
e6f55d1555 [imagechest] add API support and 'access-token' option (#4065) 2023-05-20 17:00:27 +02:00
Mike Fährmann
77abcf5ab3 [gofile] automatically fetch 'website-token' by default
the hardcoded token changed yet again
2023-05-20 17:00:27 +02:00
Mike Fährmann
a83983c651 [instagram] add 'order-posts' option (#4017, #3993) 2023-05-18 22:50:12 +02:00
Mike Fährmann
d680623db3 [instagram] add 'order-files' option (#4017, #3993) 2023-05-18 22:34:33 +02:00
Mike Fährmann
5037013e2b [gofile] update 'website-token' (#4056) 2023-05-15 14:59:44 +02:00
Mike Fährmann
a14b63d941 support selecting a domain for '--cookies-from-browser'
for example 'gallery-dl --cookies-from-browser firefox/twitter.com'
2023-05-06 15:09:49 +02:00
Mike Fährmann
3ca5dac8b6 extend 'cookies-update' functionality
Allow writing cookies to a different file than a given cookies.txt,
making it possible to export cookies imported with --cookies-from-browser

To convert browser cookies to cookies.txt format:
  gallery-dl --cookies-fr chromium \
             -o cookies-update=cookies.txt \
             --no-download \
             http://example.org/file.jpg
2023-05-04 15:10:47 +02:00
Mike Fährmann
79f47f98dd [nana] remove module
permanently gone since 2023-03-13
2023-05-03 18:05:53 +02:00
Mike Fährmann
c182094ebf merge #3748: [downloader:http] add 'consume-content' option 2023-04-26 23:03:18 +02:00
Mike Fährmann
b81ce381f0 fix backticks for 'extractor.redgifs.format' docs
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1518331927
2023-04-21 23:12:01 +02:00
Mike Fährmann
aaf58a1259 [imgur] document 'client-id' option (#3937) 2023-04-21 15:08:50 +02:00
Mike Fährmann
0a7eee3ee0 [deviantart] add 'public' option 2023-04-08 23:04:34 +02:00
Mike Fährmann
75666cf9c3 [danbooru] reduce API requests for fetching extended 'metadata'
Instead of using one additional API request per post object (N+1),
this requires only one request per 200-post batch.
2023-04-02 20:11:52 +02:00
Mike Fährmann
00f0233b28 [postprocessor:metadata] add 'skip' option (#3786) 2023-03-17 23:30:11 +01:00
Mike Fährmann
a1ca2404f9 add 'globals' instead of overwriting the default (#3773) 2023-03-16 18:37:00 +01:00
ClosedPort22
fcaeaf539c [downloader:http] handle exceptions while consuming content 2023-03-11 21:36:37 +08:00
ClosedPort22
df77271438 [downloader:http] add 'consume-content' option
* fix connection not being released when the response is neither
  successful nor retried
* add the ability to consume the HTTP response body instead of closing
  the connection

reference:

https://docs.python-requests.org/en/latest/user/advanced/#body-content-workflow
2023-03-09 21:07:10 +08:00
Mike Fährmann
da9840a39d [reddit] update 'videos' option (#3712)
- add 'dash' to directly extract DASH manifest URLs
  (was default behavior since a7c79531)
- change default strategy back to before a7c79531
- disable 'Falling back on generic information extractor' warning
2023-03-06 12:18:25 +01:00
enduser420
e1867cf5eb [misskey] add 'renotes' and 'replies' options 2023-03-02 19:56:19 +05:30
Mike Fährmann
0d142e403c [szurubooru] add 'tag' and 'post' extractors (#3583, #3713) 2023-03-01 18:47:10 +01:00
Mike Fährmann
d788e6c60c implement 'globals' option 2023-02-28 18:18:55 +01:00
Mike Fährmann
e480a93337 add 'output.stdout', '.stdin', and '.stderr' options
(#1621, #2152, #2529)

Allow setting custom input/output encodings and options
without having to rely on Python's defaults.
2023-02-26 14:56:19 +01:00
Mike Fährmann
b7337d810e [postprocessor:metadata] add 'sort' and 'separators' options 2023-02-07 18:28:14 +01:00
Mike Fährmann
762a68996b implement 'archive-pragma' option 2023-02-05 17:00:31 +01:00
Mike Fährmann
bbf0911a46 [e621] implement 'notes' and 'pools' metadata extraction
(#3425)
2023-02-04 21:20:38 +01:00
Mike Fährmann
925b467496 split e621 from danbooru module (#3425) 2023-02-03 19:24:31 +01:00
Mike Fährmann
1ae48a54f8 [twitter] add 'transform' option 2023-02-02 22:01:36 +01:00
Mike Fährmann
78d3960a31 [postprocessor:exec] implement archive options (#3584) 2023-02-01 13:57:16 +01:00
Mike Fährmann
4572c122d8 document 'extractor.module-sources' 2023-01-30 23:32:36 +01:00
Mike Fährmann
f58215705a add '-O/--postprocessor-option' command-line option (#3565) 2023-01-26 14:59:24 +01:00
ClosedPort22
3b32671fbd [deviantart] add extractor for status updates
extract user status updates using the '/user/statuses/' endpoint
2023-01-19 11:30:48 +08:00
Mike Fährmann
4e86aaa4db document 'extractor.headers' and 'extractor.ciphers' 2023-01-16 14:49:56 +01:00
Mike Fährmann
c881548a27 add 'extractor.retry-codes' option (#3313)
do not retry 429 and 430 by default
2023-01-14 17:25:30 +01:00
Mike Fährmann
512abeb4ae [booru] add 'url' option 2023-01-13 16:32:32 +01:00
Mike Fährmann
c87bd1a752 [danbooru] extend 'metadata' option
make it possible to specify a custom list of metadata includes
2023-01-13 16:20:01 +01:00