Commit Graph

3819 Commits

Author SHA1 Message Date
Mike Fährmann
51b1999d4b release version 1.22.4 2022-07-15 19:30:48 +02:00
Mike Fährmann
a566e63cdf [tumblr] support '/blog/view' URLs (#2760) 2022-07-15 15:22:54 +02:00
Mike Fährmann
46f11a3118 [bunkr] fix extraction (#2732)
move bunkr.is code to its own module
2022-07-15 13:00:57 +02:00
Mike Fährmann
baf3815ebd [nozomi] small code optimizations 2022-07-14 14:59:11 +02:00
Mike Fährmann
9704c04172 [postprocessor:zip] ensure target directory exists (#2758) 2022-07-14 11:55:39 +02:00
blankie
836402bf58 [twitter] unescape content (#2756) (#2757)
Fixes #2756
2022-07-13 19:45:14 +02:00
Mike Fährmann
62cc47755b [nozomi] reduce memory consumption during searches (#2754)
only load and use the entire 'index.nozomi' database
if there are only negative search terms
2022-07-13 17:16:10 +02:00
Mike Fährmann
467a2a4d35 [instagram] add 'pinned' metadata field (#2752)
'pinned' is a list of user IDs for which a post is pinned
and empty if not pinned anywhere.
2022-07-13 15:54:08 +02:00
Mike Fährmann
fe2b3d57d4 [komikcast] update domain 2022-07-12 23:07:58 +02:00
Mike Fährmann
4e11ca737e [hentaifoundry] fix metadata extraction 2022-07-12 22:19:22 +02:00
Mike Fährmann
f2e59cc906 [slideshare] fix 'description' extraction 2022-07-12 18:38:44 +02:00
Mike Fährmann
31e868fca1 [khinsider] extract 'platform' metadata 2022-07-12 18:31:31 +02:00
Mike Fährmann
c6a9bab019 update extractor test results 2022-07-12 15:49:22 +02:00
Mike Fährmann
539e3bbed9 [weibo] handle invalid/broken status objects 2022-07-12 15:49:09 +02:00
Mike Fährmann
32c75d12e8 [sankaku] rewrite URLs to s.sankakucomplex.com (#2746) 2022-07-11 12:46:04 +02:00
Mike Fährmann
d5ded11aa8 [pixiv] fix default filenames for backgrounds 2022-07-11 12:45:38 +02:00
Mike Fährmann
e1f501ed14 [mangakakalot] update domain 2022-07-11 00:29:25 +02:00
Mike Fährmann
2dc57637cf [foolfuuka] remove archive.wakarimasen.moe 2022-07-10 23:13:49 +02:00
Mike Fährmann
98744977cf [itaku] fix 'date' parsing 2022-07-10 20:45:51 +02:00
Mike Fährmann
b590774f67 [twitter] add 'count' metadata field (#2741) 2022-07-10 14:37:04 +02:00
Mike Fährmann
7c0505868c [kemonoparty] ensure all files have an 'extension' (#2740) 2022-07-10 13:53:07 +02:00
Mike Fährmann
74865adae5 implement 'format-separator' option (#2737)
a global option, that servers as a workaround for shortcomings due to
lack of a proper format string parser
2022-07-10 13:31:43 +02:00
bradenhilton
117eeefda0 [postprocessor:mtime] add 'value' option (#2739) 2022-07-08 20:56:01 +02:00
Mike Fährmann
90ae48c40c [formatter] implement 'O' format specifier (#2736)
to apply a UTC offset to 'date' values and other datetime objects
2022-07-08 12:51:03 +02:00
Mike Fährmann
e4f48cc810 make it easier to disable default 'browser' settings
Previously it was necessary to set 'browser' to a non-empty, non-string
value to disable any default 'browser' value.
Now '-o browser=' or '-o browser=false' is enough.
2022-07-07 11:17:43 +02:00
Mike Fährmann
92b75bcdce limit path length for --write-pages output on Windows (#2733) 2022-07-06 18:56:23 +02:00
Mike Fährmann
04bed1eba3 [formatter] allow for custom "format" functions (#2721) 2022-07-05 12:22:01 +02:00
Mike Fährmann
311e9383af [pinterest] handle section pins with separate extractors (#2684) 2022-07-03 18:12:16 +02:00
Mike Fährmann
1d14928bd9 [twitter] ignore previously seen Tweets (#2712)
occurs primarily for /with_replies results when logged in
2022-07-03 16:13:53 +02:00
Mike Fährmann
4b2a0a0eda [twitter] implement 'strategy' option (#2712)
to be able to better control what Tweets get used an returned
for twitter.com/USER URLs.
2022-07-03 14:29:15 +02:00
Mike Fährmann
5806a1851e add --no-postprocessors command-line option (#2725) 2022-07-03 12:09:09 +02:00
Mike Fährmann
c794777600 [newgrounds] prevent exception on empty results (#2727) 2022-07-03 11:44:46 +02:00
Mike Fährmann
36ead45546 [itaku] fix caching bug (#1842)
ItakuApi.user() would always return the first user it was called with,
regardless of its 'username' argument.
2022-07-01 21:00:39 +02:00
Mike Fährmann
124b5c6410 [postprocessor:ugoira] enable 'mtime' by default (#2714) 2022-07-01 20:59:19 +02:00
Mike Fährmann
127a190c94 [itaku] categorize sections by group (#1842) 2022-06-29 22:34:07 +02:00
Mike Fährmann
de20cadc68 add 'brotli' as optional dependency (#2716)
only send 'Accept-Encoding: br' if supported
2022-06-29 15:10:05 +02:00
Mike Fährmann
37453a9528 [newgrounds] only login if necessary (#2715) 2022-06-29 11:46:07 +02:00
Mike Fährmann
86a7dad081 release version 1.22.3 2022-06-28 22:44:46 +02:00
Mike Fährmann
7b073bf9ef Revert "[twitter] improve strategy for user URLs (#2665)"
'user_tweets_and_replies' was a mistake
2022-06-28 20:38:56 +02:00
Mike Fährmann
3a5d5c3a91 update default User-Agent header to Firefox 102 ESR
snd update headers and ciphers for "browser": "firefox"
2022-06-28 17:38:58 +02:00
Mike Fährmann
1f9ff518ad release version 1.22.2 2022-06-27 16:38:14 +02:00
Mike Fährmann
f8cfc3b08a [skeb] add 'following' extractor (#2698) 2022-06-27 11:31:49 +02:00
Mike Fährmann
367a491128 [vk] get URLs from *_src entries (#2535)
https://github.com/mikf/gallery-dl/issues/2535#issuecomment-1166566986
2022-06-27 10:24:35 +02:00
Mike Fährmann
54525d2e21 [formatter] implement slice operator as format specifier
this allows using a slice operator alongside other (special) format
specifiers like J, to first join list elements to a string and then
trimming that with a slice.

{tags:J, /[:50]}
2022-06-25 16:52:58 +02:00
Mike Fährmann
241e82e18d [horne] add support for horne.red (#2700) 2022-06-25 16:52:16 +02:00
Mike Fährmann
7af4d2047b [instagram] improve metadata generated by _parse_post_api()
(#2695)
2022-06-24 23:44:20 +02:00
Mike Fährmann
3f50e2fb5f [poipiku] add simple password support (#1602) 2022-06-22 18:21:01 +02:00
Mike Fährmann
9d8e99af80 [itaku] support videos (#1842) 2022-06-20 19:47:53 +02:00
Mike Fährmann
c8ec2c4e85 [itaku] add 'title' to default filenames (#1842) 2022-06-20 19:35:46 +02:00
Mike Fährmann
e0c60a1206 [itaku] metadata cleanup (#1842)
- parse 'date_added' as 'date'
- simplify 'tags', 'categorized_tags',  and 'sections'
2022-06-20 19:28:15 +02:00