Commit Graph

4971 Commits

Author SHA1 Message Date
Mike Fährmann
925123e007 [deviantart] handle CloudFront blocks in general (#5363)
This was already done for non-OAuth requests (#655)
but CF is now blocking OAuth API requests as well.
2024-03-23 15:50:24 +01:00
Mike Fährmann
31e7ca73b6 [gelbooru] add 'order-posts' option for favorites (#5220) 2024-03-23 13:30:09 +01:00
Mike Fährmann
4b6f47e571 [pornhub:gif] extract 'viewkey' and 'timestamp' metadata (#4463)
https://github.com/mikf/gallery-dl/issues/4463#issuecomment-2014550302
2024-03-22 18:00:20 +01:00
Mike Fährmann
9f73fac5ef [steamgriddb] raise proper exception for deleted assets 2024-03-22 17:53:06 +01:00
Mike Fährmann
fe9171508f [kemonoparty] fix exception for '/revision/' URLs
caused by 03a9ce98
2024-03-22 03:10:12 +01:00
Mike Fährmann
a650fd3177 [deviantart] improve 'index' extraction for stash files (#5335) 2024-03-22 02:53:54 +01:00
Mike Fährmann
1d6260f456 [bunkr] remove 'description' metadata
album descriptions are no longer available on album pages
and the previous code erroneously returned just '0'
2024-03-22 02:14:41 +01:00
Mike Fährmann
32262a048b [idolcomplex] fix metadata extraction
- replace legacy 'id' vales with alphanumeric ones, since the former are
  no longer available
- approximate 'vote_average', since the real value is no longer
  available
- fix 'vote_count'
2024-03-22 01:43:05 +01:00
Mike Fährmann
77ab015df2 [idolcomplex] support new pool URLs 2024-03-22 01:38:25 +01:00
Mike Fährmann
1b34d5ac40 [subscribestar] fix 'date' metadata 2024-03-22 00:45:09 +01:00
Mike Fährmann
ddb2edfd32 [formatter] fix local DST datetime offsets for ':O'
'O' would get the *current* local UTC offset and apply it to all
'datetime' objects it gets applied to.
This would result in a wrong offset if the current offset includes
DST and the target 'datetime' does not or vice-versa.

'O' now determines the correct local UTC offset while respecting DST for
each individual 'datetime'.
2024-03-21 20:45:46 +01:00
wankio
56f2d5a5f2 fapello.py Fullsize image
by remove ".md" and ".th" in image url, it will download fullsize of images
2024-03-21 18:08:18 +01:00
wankio
eb673a7204 Update fapello.py
get fullsize image instead resized
2024-03-19 02:48:53 +07:00
Mike Fährmann
6d93295fea [gelbooru] add 'date_favorited' metadata field 2024-03-18 20:46:11 +01:00
Mike Fährmann
0d69af94d5 [gelbooru] detect returned favorites order (#5220) 2024-03-18 20:45:06 +01:00
Mike Fährmann
e1c51c0dfb [vipergirls] add 'domain' option (#4166) 2024-03-18 17:36:16 +01:00
Mike Fährmann
ae116812cc [vipergirls] add 'like' option (#4166) 2024-03-18 17:36:16 +01:00
Mike Fährmann
da6ba60331 [bluesky] add 'instance' metadata field (#4438) 2024-03-18 17:36:16 +01:00
Mike Fährmann
5c1f5861b6 [flickr] add 'contexts' option (#5324) 2024-03-18 17:36:16 +01:00
Mike Fährmann
26bc2d55f4 [hiperdex] update URL patterns & fix 'manga' metadata (#5340) 2024-03-18 17:36:16 +01:00
Mike Fährmann
8e694d85c4 [twitter] add 'birdwatch' metadata field (#5317)
should probably get a better name,
but this is what it's called internally by Twitter
2024-03-18 17:36:02 +01:00
Mike Fährmann
b8e7be225c merge #5333: [imagefap] fix folder extractor 2024-03-15 23:46:43 +01:00
Herp
99c53f7fa8 Fix imagefap extrcator 2024-03-15 23:44:25 +01:00
Mike Fährmann
03a9ce9832 [kemonoparty] add 'order-revisions' option (#5334) 2024-03-15 23:06:05 +01:00
Mike Fährmann
1418c0ce38 [kemonoparty] add 'revision_count' metadata field (#5334) 2024-03-15 22:28:15 +01:00
Mike Fährmann
ddee5ae7c4 [gofile] fix extraction 2024-03-15 20:34:54 +01:00
Mike Fährmann
5716430c35 [deviantart:stash] recognize 'deviantart.com/stash/…' URLs 2024-03-15 18:14:55 +01:00
Mike Fährmann
76683c5f5c [deviantart:stash] fix 'index' metadata (#5335) 2024-03-15 18:10:59 +01:00
Mike Fährmann
5158cbb4c1 [weibo] rework pagination logic (#4168)
don't automatically stop when receiving an empty status list

shouldn't improve 'tabtype=feed' results, but at least 'tabtype=album'
ones and others using cursors won't end prematurely
2024-03-14 00:06:25 +01:00
Mike Fährmann
d53db6e11a [twitter] handle "account is temporarily locked" errors (#5300)
- display proper error message
- add 'locked' option
2024-03-13 22:34:25 +01:00
Mike Fährmann
108abab537 [twitter] add 'protected' metadata field (#5327)
for 'author' and 'user'
2024-03-13 14:46:03 +01:00
Mike Fährmann
dde822e69a [instagram] change 'posts are private' exception to a warning (#5322) 2024-03-12 18:58:15 +01:00
Mike Fährmann
e40973118d merge #5323: [instagram] default 'likes' to '0' 2024-03-12 18:47:24 +01:00
Mike Fährmann
b188cb2729 merge #5321: [mastodon] fix handling null 'moved' account field 2024-03-12 18:45:53 +01:00
Martin Contento
c210c7a4ed [instagram] default posts like_count to zero
I don't know when/why this happens and for private account reasons can't
add an example here, but i had this error out and it feels like a safe
fix to default to `0` here.
2024-03-12 15:12:07 +00:00
blankie
225d849139 [mastodon] fix handling null 'moved' account field 2024-03-12 11:44:25 +11:00
Mike Fährmann
106dfdb4c3 cleanup sleep-request retry delay code
more lines but easier to read I'd say
2024-03-11 21:38:06 +01:00
Mike Fährmann
4565de3c8e [reddit] provide 'gif' and 'mp4' variant fallbacks (#5315) 2024-03-10 20:50:55 +01:00
Mike Fährmann
5842e4928d [imgur] fail downloads when redirected to 'removed.png' (#5308) 2024-03-09 23:35:23 +01:00
Mike Fährmann
ac4e29f70a [lensdump] support more direct link formats (#5293) 2024-03-09 23:33:58 +01:00
Mike Fährmann
146459056c [reddit] provide 'fallback_url' as video fallback (#5296) 2024-03-07 15:58:01 +01:00
Mike Fährmann
d3003f8531 merge #5270: [imagefap] add 'folder' metadata 2024-03-07 01:31:40 +01:00
Mike Fährmann
05331f9cf1 [imagefap] flake8, cleanup, tests 2024-03-07 01:29:19 +01:00
Mike Fährmann
40c0553523 [twitter] add 'quotes' extractor (#5262)
https://github.com/mikf/gallery-dl/issues/5262#issuecomment-1981571924

It's implemented as a search for 'quoted_tweet_id:…' on Twitter.
2024-03-07 00:52:50 +01:00
Mike Fährmann
790c0ffb8d [lensdump] recognize direct image links (#5293 2024-03-06 22:56:57 +01:00
Mike Fährmann
6d9e3c0eb1 [skeb] add extractor for followed users (#5290)
needs 'Authorization' header from browser session
-o headers.Authorization="Bearer ey…"
2024-03-06 22:43:01 +01:00
Mike Fährmann
ace16f00f5 [weibo] fix retweets (#2825, #3874, #5263)
- handle 快转 retweets
- disable 'retweets' by default
- skip all retweet media when 'retweets' are disabled
- extract all retweet media when 'retweets' is set to "original"
2024-03-06 19:36:53 +01:00
Mike Fährmann
0676a9d6ec [weibo] fix 'livephoto' filename extensions (#5287) 2024-03-06 19:36:32 +01:00
Mike Fährmann
a8027745e3 [downloader:http] add MIME type and signature for .mov files (#5287) 2024-03-06 14:00:24 +01:00
Mike Fährmann
db507e30c7 [pixiv] fix novel text extraction (#5285)
change to '/webview/v2/novel'
since '/v1/novel/text' does not work anymore
2024-03-06 02:31:26 +01:00