github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5,376 Commits 1 Branch 0 Tags
d3003f8531610e125e4f4502f4e6c75b9d2260a2
Commit Graph

4930 Commits

Author SHA1 Message Date
Mike Fährmann
d3003f8531 merge #5270: [imagefap] add 'folder' metadata 2024-03-07 01:31:40 +01:00
Mike Fährmann
05331f9cf1 [imagefap] flake8, cleanup, tests 2024-03-07 01:29:19 +01:00
Mike Fährmann
40c0553523 [twitter] add 'quotes' extractor (#5262) 
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1981571924

It's implemented as a search for 'quoted_tweet_id:…' on Twitter.
 2024-03-07 00:52:50 +01:00
Mike Fährmann
790c0ffb8d [lensdump] recognize direct image links (#5293 2024-03-06 22:56:57 +01:00
Mike Fährmann
6d9e3c0eb1 [skeb] add extractor for followed users (#5290) 
needs 'Authorization' header from browser session
-o headers.Authorization="Bearer ey…"
 2024-03-06 22:43:01 +01:00
Mike Fährmann
ace16f00f5 [weibo] fix retweets (#2825, #3874, #5263) 
- handle 快转 retweets
- disable 'retweets' by default
- skip all retweet media when 'retweets' are disabled
- extract all retweet media when 'retweets' is set to "original"
 2024-03-06 19:36:53 +01:00
Mike Fährmann
0676a9d6ec [weibo] fix 'livephoto' filename extensions (#5287) 2024-03-06 19:36:32 +01:00
Mike Fährmann
a8027745e3 [downloader:http] add MIME type and signature for .mov files (#5287) 2024-03-06 14:00:24 +01:00
Mike Fährmann
db507e30c7 [pixiv] fix novel text extraction (#5285) 
change to '/webview/v2/novel'
since '/v1/novel/text' does not work anymore
 2024-03-06 02:31:26 +01:00
Mike Fährmann
296f20e630 [warosu] fix 'board_name' metadata 2024-03-06 01:28:47 +01:00
Mike Fährmann
24873c2724 [warosu] fix crash for threads with deleted posts (#5289) 2024-03-06 01:27:45 +01:00
Mike Fährmann
f296067797 [naver] unescape post 'title' and 'description' 2024-03-06 00:46:19 +01:00
Mike Fährmann
a71cdab53e merge #5126: [naver] fix EUC-KR encoding issue in old image URLs 2024-03-06 00:22:33 +01:00
Mike Fährmann
a8d3efbb99 [naver] simplify code + add test 2024-03-06 00:21:23 +01:00
Johann Hong
f64fb8f239 [naver] EUC-KR encoding issue in old image URLs Fix 
Around October 2010, the image server URL format and file name
encoding changed from EUC-KR to UTF-8.
Modified to detect old URL format and decode image URLs into EUC-KR

- (lint with flake8) Customize conditions
  Wrap lines smaller than 79 characters

- (lint with flake8) Customize conditions (2nd try)
  - One import per line
  - Indent on consecutive lines

- (lint with flake8) Customize conditions (3rd try)
  - E128 continuation line under-indented for visual indent
  - E123 closing bracket does not match indentation of opening bracket's line

- Update naver.py
  Check encoding for all image URLs
 2024-03-06 00:21:23 +01:00
Mike Fährmann
7b28418f69 [naver] recognize '.naver' URLs 
https://blog.naver.com/PostView.naver?…
 2024-03-05 22:30:29 +01:00
Mike Fährmann
a767832332 [deviantart:avatar] ignore default avatars (#5276) 2024-03-04 23:11:30 +01:00
Mike Fährmann
0cbc910905 [deviantart:avatar] fix 'index' for avatars without '?' (#5276) 2024-03-04 22:31:35 +01:00
Mike Fährmann
6482bbc525 [bluesky] handle different 'embed' structure 2024-03-03 20:41:01 +01:00
Mike Fährmann
1115dccd0d [bluesky] fix feeds and lists 
bug introduced in 495c9ee1
 2024-03-03 20:22:34 +01:00
Mike Fährmann
1a9b9aa310 [artstation] support video clips (#2566, #3309, #3911) 
- add 'videos' and 'previews' options
- fix 403 errors for video previews
 2024-03-03 18:00:45 +01:00
termvacycurtocs
f8b037ed40 [Imagefap] Add folder metadata 
[Imagefap] Add "folder" metadata when downloading a folder or user profile.
No additional request is made to the server.

Use for example with the following configuration :
"parent-metadata": true
"directory":["{category}", "{uploader}", "{folder}", "{gallery_id} {title}"]
 2024-03-02 22:15:45 +01:00
Mike Fährmann
982880615d [deviantart] prevent unnecessary API requests (#4995) 
… when using 'comments-avatars'

This also has the added benefit of making it possible to download
comment avatars from users without a valid user profile entry,
like deleted users.
 2024-03-02 21:59:16 +01:00
Mike Fährmann
25d2854272 [deviantart] add 'comments-avatars' option (#4995) 2024-03-02 21:59:16 +01:00
Mike Fährmann
218ec1a9ee [instagram] raise proper error for missing 'reels_media' (#5257) 2024-03-02 21:58:59 +01:00
Mike Fährmann
82c73c77b0 [redgifs] make 'date' available for directories (#5262) 
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1973975415
 2024-03-01 23:39:16 +01:00
Mike Fährmann
cf9e99c07b [artstation] support collections (#146) 
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1972101003
 2024-03-01 20:21:21 +01:00
Mike Fährmann
32ec695195 merge #5256: [wikimedia] add azurlane.koumakan.jp 2024-02-29 21:50:24 +01:00
thatfuckingbird
88a06df165 [wikimedia] add azurlane.koumakan.jp to presets 2024-02-29 19:28:50 +01:00
Mike Fährmann
1db0a587f3 [nitter] ignore invalid Tweets (#5253) 
like "Load newest"
 2024-02-29 16:31:37 +01:00
Mike Fährmann
76581c13f7 handle URLs without '/' after their TLD (#5252) 2024-02-29 15:05:46 +01:00
Mike Fährmann
a00b171d4e [bluesky] wait unitl 'RateLimit-Reset' on 429 responses 2024-02-28 18:13:16 +01:00
Mike Fährmann
7d874e2497 [bluesky] improve API error messages 2024-02-28 14:45:36 +01:00
Mike Fährmann
d921d860f1 automatically create directory path for logging files (#5249) 2024-02-28 02:11:20 +01:00
Mike Fährmann
495c9ee126 [bluesky] add 'reposts' option (#4438, #5248) 2024-02-27 18:42:29 +01:00
Mike Fährmann
c8b591303f [paheal] cleanup 2024-02-27 02:27:20 +01:00
Mike Fährmann
8a11b72253 remove extractor/test.py (#4504) 2024-02-27 01:37:57 +01:00
Mike Fährmann
fde9e25c9f [tests:kemonoparty] '.party' -> '.su' 2024-02-26 22:25:04 +01:00
Mike Fährmann
311a21bfb2 [bluesky] fix '/follows' not spawning child extractors (#5246) 2024-02-26 15:38:31 +01:00
Mike Fährmann
d3dca68225 [xvideos] fix galleries with more than 500 images (#5244) 2024-02-26 15:36:41 +01:00
Mike Fährmann
13443f40a3 [xvideos] support '/channels/' URLs (#5244) 2024-02-26 00:08:37 +01:00
Mike Fährmann
c60ebc6519 [deviantart] improve fetching extended metadata (#5175) 
use multiple metadata API calls per chunk of deviations if necessary
 2024-02-25 03:36:00 +01:00
Mike Fährmann
cc6b9e4c18 [zerochan] use API by default (#3669) 
add 'pagination' option
 2024-02-25 00:36:14 +01:00
Mike Fährmann
a2b55d5dde [skeb] retry 429 responses containing a 'request_key' cookie (#5210) 2024-02-24 00:54:15 +01:00
Mike Fährmann
e51ee6b132 fix HttpError.status value 
'response' with error status code evaluates to False
 2024-02-24 00:04:24 +01:00
Mike Fährmann
b4c46de4b8 merge #5224: [artstation] update URL patterns to recognize usernames with dashes 2024-02-21 14:41:02 +01:00
blankie
962f55cc68 [artstation] fix handling usernames with dashes 2024-02-21 17:39:37 +11:00
Mike Fährmann
fe7e2281ac [nijie] increase default delay between requests (#5221) 
1-2s is not enough
 2024-02-20 18:19:49 +01:00
Mike Fährmann
a34312e3ac [instagram] make accessing 'like_count' non-fatal (#5218) 2024-02-19 19:24:51 +01:00
Mike Fährmann
741fd00cec [deviantart] extend 'metadata' option (#5175) 
alloe fetching extended metadata in addition to the usual
'description', 'tags', etc by setting 'metadata' to a list of
'camera', 'stats', 'submission', 'collection', and 'gallery'

for example "metadata": "stats,submission"
 2024-02-18 23:14:14 +01:00