Commit Graph

3226 Commits

Author SHA1 Message Date
Mike Fährmann
7b029dfe85 [instagram] increase default delay between HTTP requests to 8s
(closes #1732)
2021-08-05 22:08:35 +02:00
Mike Fährmann
5eca3781be [kemonoparty] fix username extraction (#1750) 2021-08-04 16:09:22 +02:00
Mike Fährmann
fe970fc87f [vk] prevent exception for empty/private profiles (fixes 1742) 2021-08-02 15:38:51 +02:00
Mike Fährmann
ac91a84543 [bbc] provide fallback URLs (#1706) 2021-07-30 01:14:07 +02:00
Mike Fährmann
a316e44f8e [bbc] add 'width' option (#1706) 2021-07-30 01:09:32 +02:00
Mike Fährmann
c37c2818fb [nsfwalbum] retry all requests when extracting image URLs
(#1733, fixes #1271)
2021-07-30 00:23:04 +02:00
Mike Fährmann
220cfe244e [deviantart] get original files for GIF previews (#1731) 2021-07-30 00:20:53 +02:00
Mike Fährmann
7a0da4f93f [newgrounds] add 'format' option (closes #1729) 2021-07-29 19:11:20 +02:00
Mike Fährmann
223a4e79cd [newgrounds] fix using 'category-tranfer' (#1274) 2021-07-29 15:54:04 +02:00
Mike Fährmann
4e95cef6d2 [nsfwalbum] retry backend requests (fixes #1733) 2021-07-29 15:29:37 +02:00
Mike Fährmann
6c11105587 [bbc] improve image dimensions (#1706)
download the 1920xN versions instead of 976x549
2021-07-29 03:22:15 +02:00
Mike Fährmann
57c1a86082 [bbc] support multi-page gallery listings (closes #1730) 2021-07-28 22:42:33 +02:00
Mike Fährmann
2792ed6e4b implement 'util.format_value()' 2021-07-26 02:11:22 +02:00
Mike Fährmann
552032d4fb release version 1.18.2 2021-07-23 17:39:19 +02:00
Mike Fährmann
486474800f [kemonoparty] skip duplicated patreon files (closes #1689)
this behavior can be disabled with the 'patreon-skip-file' option
2021-07-23 16:38:57 +02:00
Mike Fährmann
da7297c0b9 [comicvine] add extractor (closes #1712) 2021-07-23 16:17:06 +02:00
Mike Fährmann
e4788fa663 [bbc] add 'gallery' and 'programme' extractors (closes #1706) 2021-07-22 20:37:05 +02:00
Mike Fährmann
13d4045a8a add 'archive-prefix' option (#1711) 2021-07-20 20:21:33 +02:00
Mike Fährmann
c3b5c88b04 update extractor test results 2021-07-20 20:21:33 +02:00
Mike Fährmann
74b457b2b5 remove unused entries 2021-07-20 20:21:32 +02:00
Mike Fährmann
9e42cd58ea replace ChainPredicate class with 'functools.partial' 2021-07-20 20:21:32 +02:00
Mike Fährmann
1b2f9050fb rename all instances of 'kwds' to 'kwdict' 2021-07-20 20:21:19 +02:00
Mike Fährmann
3868ec02d1 [pururin] update domain and fix extraction 2021-07-18 04:11:59 +02:00
Mike Fährmann
b89a44090f [naverwebtoon] fix comic extraction 2021-07-18 03:41:54 +02:00
Mike Fährmann
4048eabeab allow 'extractor.modules' to be a string
with comma-separated module names
2021-07-18 00:34:04 +02:00
Mike Fährmann
c8e678a5b4 [instagram] fix extraction of '/explore/tags/' posts
(closes #1666)
2021-07-18 00:21:18 +02:00
Mike Fährmann
a6a51f207d [moebooru] fix 'tags' ending with a '+' when logged in (#1702) 2021-07-16 15:42:03 +02:00
Mike Fährmann
f5b097165e [ytdl] transfer YoutubeDL objects to downloader (#1680)
allows specifying downloader-specific options per subcategory
but overwrites all downloader.ytdl settings
2021-07-16 15:40:54 +02:00
Mike Fährmann
06e69ea79a [ytdl] actually set options for YoutubeDL objects (#1680)
I somehow managed to remove the options parameter for
the YoutubeDL constructor in 9a849cdf without noticing ...
2021-07-16 15:05:55 +02:00
Mike Fährmann
fc19010808 [downloader:ytdl] fix 'outtmpl' setting for yt_dlp (#1680)
yt_dlp supports multiple outtmpl settings for different file types and
uses its 'outtmpl_dict' for that.
2021-07-16 15:05:16 +02:00
Mike Fährmann
dfe1f490e9 [mangadex] use custom User-Agent header (#1535) 2021-07-15 16:39:32 +02:00
Mike Fährmann
36a2aff363 [vk] improve metadata extraction and URL pattern (fixes #1691)
- always fetch all user metadata
- use 'user[name]' for directory names if available
2021-07-15 00:43:42 +02:00
Mike Fährmann
b9783403d9 add 'url-metadata' option (#1659, #1073) 2021-07-14 03:08:49 +02:00
Mike Fährmann
e622e004f0 [ytdl] improve module imports (#1680)
Apply 'extractor.ytdl.module' for every URL, not just the first.
2021-07-14 03:08:00 +02:00
Mike Fährmann
e95f99882f extend 'parent-metadata' functionality (#1687, #1651, #1364) 2021-07-14 02:53:41 +02:00
Mike Fährmann
193401ce3b [ytdl] "fix" cookie transfer between session and ytdl (#1680)
requests' CookieJar class is not quite compatible with the standard
http.cookiejar.CookieJar used by youtube_dl
2021-07-12 18:50:25 +02:00
Mike Fährmann
9a849cdf61 [ytdl] allow setting 'module' for subcategories (#1680) 2021-07-12 18:47:12 +02:00
Mike Fährmann
dff0da60f9 [ytdl] add 'generic' option (#1680) 2021-07-11 23:48:18 +02:00
Mike Fährmann
d3da96142a [ytdl] support cookies + username&password (#1680) 2021-07-11 22:51:57 +02:00
Mike Fährmann
36ac2197db [ytdl] add extractor for sites supported by youtube-dl
(#1680, #878)

Can be used by prefixing any URL with 'ytdl:',
or by setting 'extractor,ytdl.enabled' to 'true'.
2021-07-10 20:55:47 +02:00
Mike Fährmann
64240c8d42 [imagevenue] fix extraction
(closes #1677)
2021-07-09 20:13:18 +02:00
Mike Fährmann
d287d2eb88 [kemonoparty] parse 'o' query parameters (#1674) 2021-07-09 18:29:50 +02:00
Mike Fährmann
8b036778e3 [kemonoparty] add 'max-posts' option (#1674) 2021-07-09 18:19:02 +02:00
Mike Fährmann
5612ca31c2 [hitomi] fix image URLs (closes #1679) 2021-07-09 18:01:49 +02:00
Mike Fährmann
8ecca3af58 [pixiv] add extractor for 'pixivision' articles (#1672) 2021-07-07 16:27:16 +02:00
Mike Fährmann
312a28e78a [mastodon] add 'replies' option (#1669) 2021-07-07 00:59:02 +02:00
Mike Fährmann
513c491cea [mastodon] reset 'params' after first pagination iteration
otherwise query parameters in 'params' get specified twice the second
time around - once from the 'links["next"]' URL and once from 'params'
itself.
2021-07-07 00:07:18 +02:00
Mike Fährmann
a1f5b78039 [mastodon] add 'reblogs' option (#1669) 2021-07-06 23:27:32 +02:00
Mike Fährmann
317ecc8180 use HTML tables in docs/formatting.md 2021-07-05 23:29:03 +02:00
Mike Fährmann
5f1b13d1a5 release version 1.18.1 2021-07-04 22:37:19 +02:00