Commit Graph

3640 Commits

Author SHA1 Message Date
Mike Fährmann
202c1210d5 [exhentai] fix pagination 2022-12-06 22:39:13 +01:00
Mike Fährmann
4a3a1f4c87 [komikcast] update domain and fix extraction 2022-12-06 22:00:23 +01:00
ClosedPort22
13d825731e [deviantart] fix test for sta.sh URL extraction
Without the 'count' assertion, the test would be essentially useless.
2022-12-07 00:32:03 +08:00
ClosedPort22
6356c9be96 [deviantart] extract sta.sh URLs from 'text_content' 2022-12-06 22:57:53 +08:00
Mike Fährmann
5f57a27ba6 [imagetwist] fix extraction 2022-12-05 22:15:59 +01:00
Mike Fährmann
a42ba25ca1 [foolslide] remove 'kireicake'
site redirects to (unclaimed) mangadex group
2022-12-05 19:47:56 +01:00
Mike Fährmann
86f0597c95 [kissgoddess] remove module
site does not host albums anymore
2022-12-05 19:28:50 +01:00
Mike Fährmann
20e12b5d7c [nitter] support '/i/user/' URLs (#3310)
as well as using 'id:<userid>' as username

not all nitter instances seem to support '/i/user/' ...
2022-12-04 16:21:13 +01:00
Mike Fährmann
fceaee3c4f [lolisafe] remove zz.ht 2022-12-04 16:21:13 +01:00
Mike Fährmann
4554c43d5f [bunkr] use 'media-files' servers for more file types 2022-12-04 16:21:13 +01:00
enduser420
4bc756dfe0 [2chen] fix extraction (#3356)
update 'archive_fmt'
update tests
update 'board' regex
2022-12-04 16:19:36 +01:00
enduser420
54844944ab [pixhost] add 'gallery' support (#3353) 2022-12-04 16:19:14 +01:00
enduser420
213676c785 [fapachi] add 'post' and 'user' extractors (#3347)
* [fapachi] add 'post' and 'user' extractors

* [fapachi] add 'keyword' to test

* [fapachi] remove whitespaces
2022-12-02 13:54:29 +01:00
Mike Fährmann
a18511e346 [nitter] retry downloads on 404 (#3313) 2022-12-01 11:09:02 +01:00
Mike Fährmann
88610c3478 [patreon] update API query parameters 2022-12-01 10:02:28 +01:00
Mike Fährmann
c19b1f03b9 [patreon] fix '403 Forbidden' errors
send 'Content-Type' headers for API requests
2022-12-01 09:52:36 +01:00
Mike Fährmann
fc34f76cc5 [bunkr] fix video downloads (#3326)
by sending 'https://stream.bunkr.is/' as Referer header
2022-11-30 15:10:31 +01:00
Mike Fährmann
86a396e086 [bcy] fix JSONDecodeError (#3321) 2022-11-30 14:44:19 +01:00
Mike Fährmann
5b9a22af7f [patreon] improve 'campaign_id' extraction (#3235) 2022-11-30 11:57:52 +01:00
Mike Fährmann
1bdd0e4338 [nitter] support '/i/web/' Tweet URLs (#3310) 2022-11-30 11:45:56 +01:00
Mike Fährmann
7e277d0f7d [weibo] add 'count' metadata field (#3305)
or '{status[count]}', as most metadata for weibo is inside 'status'
2022-11-30 11:36:46 +01:00
0x1f595
19ea6ee84f Fix 8muses album URL, add permalink path 2022-11-29 20:27:01 -08:00
0x1f595
8cbc05786a Add 8muses album permalink parts to album data
This allows customizing the directory without breaking changes.
2022-11-29 20:22:00 -08:00
Mike Fährmann
4287a93202 [nitter] handle base64-encoded filenames 2022-11-27 18:09:07 +01:00
sudo
a6305d031c [hitomi] apply format check for every image (#3030) (#3280) 2022-11-27 15:55:25 +01:00
Steven Docherty
a7c7953107 [reddit] use 'dash_url' for videos (#3258) (#3306)
* use fallback_url for reddit_video to fix issue 3258

* changed to dash_url to include audio

* update

- use [] instead of .get
- catch TypeErrors in case one of the elements is not a dict

Co-authored-by: InterruptSpeed <steven@docherty.ca>
Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2022-11-27 14:09:55 +01:00
Mike Fährmann
0e75358af8 [twitter] fix using user IDs for suspended accounts 2022-11-26 12:02:05 +01:00
Mike Fährmann
c25905641e [weibo] fix bug with empty 'playback_list' (#3301) 2022-11-26 12:00:17 +01:00
Mike Fährmann
6cb12f513b [nitter] support quoted Tweets
- distinguish between regular and quoted Tweets and media
- add 'quoted' option and metadata field
2022-11-26 11:23:03 +01:00
Mike Fährmann
aabfa7cf34 [nitter] fix direct Tweet links 2022-11-25 20:50:38 +01:00
Mike Fährmann
a41d093bb1 [nitter] add 'retweets' option (#3278) 2022-11-25 19:53:28 +01:00
Mike Fährmann
3d6489a4c0 [nitter] update 'user' and 'author' 2022-11-25 18:50:04 +01:00
Mike Fährmann
e99ce99284 [danbooru] remove stray 'print()' 2022-11-25 18:27:45 +01:00
Mike Fährmann
ed49e63d95 [nitter] set 'hlsPlayback' cookie 2022-11-25 16:53:55 +01:00
Mike Fährmann
e081b1fac4 [nitter] sanitize filenames (#3294) 2022-11-25 16:53:27 +01:00
Mike Fährmann
e31d12139c [nitter] add 'videos' option (#3279)
with the same semantics as for twitter
2022-11-24 22:56:01 +01:00
enduser420
8c4e21b110 [itaku] remove 'Extreme' rating (#3287) 2022-11-24 11:09:00 +01:00
Mike Fährmann
72c5d26e85 [hotleak] fix UnboundLocalError (#3288, #3293) 2022-11-23 22:21:59 +01:00
Mike Fährmann
501d9bccfe [artstation] add 'max-posts' option (#3270) 2022-11-23 22:00:18 +01:00
Mike Fährmann
b1ad6f2289 [artstation] add 'pro-first' option (#3273) 2022-11-23 21:45:20 +01:00
Mike Fährmann
5a17e15b76 [pixiv] preserve 'tags' order (#3266)
for '"tags": "translated"'

As it turns out, set() does *not* preserve insertion order.
2022-11-22 19:11:37 +01:00
Mike Fährmann
1392b44bfe [inkbunny] provide additional metadata (#3274)
- 'pool_id' for pools
- 'favs_user_id' for favorites
- 'search[...]' for searches
2022-11-22 18:54:22 +01:00
Mike Fährmann
a24dcbe802 [twitter] fix login (#3220)
Using an email as 'username' seems to no longer be possible,
as Twitter will always additionally ask for username or phone number
when providing an email address as 'username'.
2022-11-19 23:11:37 +01:00
Mike Fährmann
53a5d95b7d [instagram] skip private check for avatars (#3255) 2022-11-19 11:10:18 +01:00
Mike Fährmann
08fd1ff835 [twitter] add 'avatar' and 'background' extractors (#349, #3023) 2022-11-18 23:06:22 +01:00
Mike Fährmann
6379157543 [instagram] use REST API by default
regardless of logged in status
2022-11-17 17:15:38 +01:00
enduser420
7897f68225 [wallhaven] update 'user' extractor (#3226)
* [wallhaven] update 'user' extractor

* [wallhaven] update 'configuration.rst'

add 'extractor.wallhaven.include' entry

* [wallhaven] add 'wallhaven.include' in gallery-dl.conf
2022-11-15 17:35:52 +01:00
enduser420
5a68b5cb3c [wallhaven] add 'user' extractor (#3213) 2022-11-15 12:25:12 +01:00
enduser420
442b03f7c3 [khinsider] fix song extraction (#3219) 2022-11-15 12:20:47 +01:00
Mike Fährmann
eaae4d9b65 [pixiv] stop with error for invalid search/ranking parameters
instead of falling back to defaults
2022-11-15 12:17:53 +01:00