Commit Graph

173 Commits

Author SHA1 Message Date
Mike Fährmann
c0d7d2be35 [downloader:http] add 'validate' option 2023-01-11 15:37:40 +01:00
Mike Fährmann
362cd6991b [pixiv] implement 'metadata-bookmark' option (#3417) 2023-01-07 23:19:43 +01:00
Mike Fährmann
9116398c1c [pinterest] add 'domain' option (#3484)
use input URL domain by default
2023-01-04 17:20:14 +01:00
Mike Fährmann
2952add4a8 [reddit] increase 'id-max' default value (#3397)
to float("inf")
2022-12-12 12:10:06 +01:00
Mike Fährmann
6b6f886dcf [bunkr] update domain (#3391)
and improve bunkr/app.bunkr handling
2022-12-11 23:18:01 +01:00
Mike Fährmann
6cb12f513b [nitter] support quoted Tweets
- distinguish between regular and quoted Tweets and media
- add 'quoted' option and metadata field
2022-11-26 11:23:03 +01:00
Mike Fährmann
a41d093bb1 [nitter] add 'retweets' option (#3278) 2022-11-25 19:53:28 +01:00
Mike Fährmann
e31d12139c [nitter] add 'videos' option (#3279)
with the same semantics as for twitter
2022-11-24 22:56:01 +01:00
Mike Fährmann
b1ad6f2289 [artstation] add 'pro-first' option (#3273) 2022-11-23 21:45:20 +01:00
Mike Fährmann
6379157543 [instagram] use REST API by default
regardless of logged in status
2022-11-17 17:15:38 +01:00
enduser420
7897f68225 [wallhaven] update 'user' extractor (#3226)
* [wallhaven] update 'user' extractor

* [wallhaven] update 'configuration.rst'

add 'extractor.wallhaven.include' entry

* [wallhaven] add 'wallhaven.include' in gallery-dl.conf
2022-11-15 17:35:52 +01:00
Mike Fährmann
8d543b040d update docs
- document '"mode": "jsonl"' for metadata pp
- remove 'username' and 'password' from 'instagram'
- add 'ytdl' example (#3180)
2022-11-09 22:17:08 +01:00
Mike Fährmann
bca9f965e5 [downloader:http] add 'chunk-size' option (#3143)
and double the previous default from 16384 (2**14) to 32768 (2**15)
2022-11-02 16:50:26 +01:00
Mike Fährmann
52d1eb928d [pixiv] extend 'metadata' option (#3057)
make it usable for all 'pixiv' extractors
2022-10-16 15:32:31 +02:00
Mike Fährmann
f1f89b2436 [tumblr] add 'offset' option 2022-10-11 10:54:23 +02:00
Mike Fährmann
7f30a0d7a7 add 'path-extended' option (#3021) 2022-10-08 15:41:39 +02:00
Mike Fährmann
14717f3fc9 [deviantart] add 'group' option (#3018)
disabling this option allows to better download from deleted accounts
2022-10-08 15:41:21 +02:00
enduser420
f7ba19a1c0 [nana] add 'nana' extractors (#2967) 2022-10-04 09:23:24 +02:00
Mike Fährmann
4089bceddd [sankaku] implement 'refresh' option (#2958) 2022-09-30 19:55:48 +02:00
Mike Fährmann
aa49bf13d2 [instagram] add 'api' option 2022-09-26 22:05:29 +02:00
Mike Fährmann
ac45ed2764 [skeb] implement 'filters' option (#2945) 2022-09-26 15:17:28 +02:00
Mike Fährmann
3cb8327c60 [zerochan] add 'metadata' option (#2861) 2022-09-02 23:25:19 +02:00
Martin Juhasz
9ea521bec5 [oauth] add host config option (#2806) 2022-08-14 17:08:01 +02:00
Mike Fährmann
df1c643dda [tumblr] attempt to extract full-resolution photos
- for photos with apparent width == 2048 or height == 3072
- can be disabled with 'original' option
2022-08-10 20:01:46 +02:00
Mike Fährmann
a69f198ac9 [wallhaven] implement 'metadata' option (#2803) 2022-08-08 21:46:36 +02:00
Mike Fährmann
8cf5981ded [skeb] add option to download 'article' images (#1031) 2022-07-29 16:32:00 +02:00
Mike Fährmann
98af5a0409 [zerochan] implement login with username & password (#1434) 2022-07-29 12:56:20 +02:00
Mike Fährmann
f225247670 [gelbooru] add support for api_key and user_id (#2767) 2022-07-18 18:46:31 +02:00
Mike Fährmann
1d14928bd9 [twitter] ignore previously seen Tweets (#2712)
occurs primarily for /with_replies results when logged in
2022-07-03 16:13:53 +02:00
Mike Fährmann
4b2a0a0eda [twitter] implement 'strategy' option (#2712)
to be able to better control what Tweets get used an returned
for twitter.com/USER URLs.
2022-07-03 14:29:15 +02:00
Mike Fährmann
3a5d5c3a91 update default User-Agent header to Firefox 102 ESR
snd update headers and ciphers for "browser": "firefox"
2022-06-28 17:38:58 +02:00
Mike Fährmann
4b78bd423f [paheal] add 'metadata' option (#2641) 2022-06-04 16:05:49 +02:00
Mike Fährmann
e0ac358aa5 [gofile] fix 401 Unauthorized errors (#2632) 2022-06-01 13:02:34 +02:00
Mike Fährmann
4bf5bc2403 [weibo] support 'livephoto' entries (#2146) 2022-05-31 15:35:24 +02:00
Mike Fährmann
603af48265 implement 'output.ansi' option (#2628) 2022-05-29 19:15:25 +02:00
Mike Fährmann
9df4e0f65b [twitter] disable 'cards' by default 2022-05-21 15:39:25 +02:00
Mike Fährmann
79dce8ae68 [weasyl] implement 'metadata' option (#2610) 2022-05-20 22:32:35 +02:00
Mike Fährmann
6b6eb0b8f6 [lolisafe] implement 'domain' option (#2575) 2022-05-10 12:17:59 +02:00
Mike Fährmann
61887c895b implement 'output.colors' options (#2532) 2022-05-02 12:41:14 +02:00
Mike Fährmann
84756982e9 [pixiv] implement 'include' option
- split 'user' extractor and its 'avatar' and 'background' options into
  separate extractors ('artworks', 'avatar', 'background')
- avatars can now be downloaded with
  https://www.pixiv.net/en/users/ID/avatar
  as URL and will use a proper archive key; similar for backgrounds
- options for the 'user' subcategory must be moved to 'artworks' to have
  the same effect as before
2022-05-02 09:03:35 +02:00
Mike Fährmann
f1c853c6ef [furaffinity] add 'layout' option (#2277)
to be able to force gallery-dl to parse according to a specific layout
in case its auto-detect fails
2022-02-11 00:28:47 +01:00
Mike Fährmann
86fa412b47 [hitomi] add 'format' option (#2260)
default is 'webp' since downloading original files is no longer allowed
2022-02-03 23:32:19 +01:00
Mike Fährmann
f2e8aedd74 [twitter] changes to 'cards' option
- change default value to 'true'
- only invoke youtube-dl for cards unsupported by gallery
  when 'cards' is set to "ytdl"

"cards": true   --> only download card images
"cards": "ytdl" --> download card images and
                    use youtube_dl on otherwise unsupported cards
2022-01-15 22:02:57 +01:00
Mike Fährmann
099ed72de7 [hitomi] disable extra 'metadata' by default
safes one HTTP request that not needed with default filename settings
2021-12-16 22:21:07 +01:00
Mike Fährmann
f4e3cee6ac use yt-dlp by default (#1850, #2028) 2021-11-29 18:24:26 +01:00
Mike Fährmann
11a3d96d13 [mangadex] load additional metadata using includes[] directives
- always provide 'artist', 'author', and 'group' metadata fields (#2049)
- remove 'metadata' option
2021-11-22 01:16:33 +01:00
Mike Fährmann
b315a0ecef [redgifs] update to API v2 (#1984) 2021-11-04 21:31:20 +01:00
Mike Fährmann
9156e90f1f [twitter] add 'pinned' option 2021-10-29 22:10:58 +02:00
Mike Fährmann
02a247f4e5 [deviantart] full resolution for non-downloadable images (#293)
Many thanks to @Ironchest337 for discovering this method
and providing a well-documented implementation.
2021-10-24 21:11:12 +02:00
Mike Fährmann
8bb442f20d [redgifs][gfycat] provide fallback URLs (fixes #1962)
and extend the 'format' option
2021-10-22 22:47:29 +02:00