github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5,615 Commits 1 Branch 0 Tags
ea81fa985f6311d968481fde8eb2b0d582f6d0fa
Commit Graph

309 Commits

Author SHA1 Message Date
Mike Fährmann
e17b1d5073 [deviantart] fix 2c8aa9b2 (#5696) 2024-06-08 02:00:36 +02:00
Mike Fährmann
2c8aa9b2de [deviantart] fix watching module ID extraction (#5696) 2024-06-06 15:21:04 +02:00
Mike Fährmann
141a93c8fd [docs] update docs/configuration links (#5059, #5369, #5423) 2024-04-13 02:18:44 +02:00
Mike Fährmann
925123e007 [deviantart] handle CloudFront blocks in general (#5363) 
This was already done for non-OAuth requests (#655)
but CF is now blocking OAuth API requests as well.
 2024-03-23 15:50:24 +01:00
Mike Fährmann
a650fd3177 [deviantart] improve 'index' extraction for stash files (#5335) 2024-03-22 02:53:54 +01:00
Mike Fährmann
5716430c35 [deviantart:stash] recognize 'deviantart.com/stash/…' URLs 2024-03-15 18:14:55 +01:00
Mike Fährmann
76683c5f5c [deviantart:stash] fix 'index' metadata (#5335) 2024-03-15 18:10:59 +01:00
Mike Fährmann
a767832332 [deviantart:avatar] ignore default avatars (#5276) 2024-03-04 23:11:30 +01:00
Mike Fährmann
0cbc910905 [deviantart:avatar] fix 'index' for avatars without '?' (#5276) 2024-03-04 22:31:35 +01:00
Mike Fährmann
982880615d [deviantart] prevent unnecessary API requests (#4995) 
… when using 'comments-avatars'

This also has the added benefit of making it possible to download
comment avatars from users without a valid user profile entry,
like deleted users.
 2024-03-02 21:59:16 +01:00
Mike Fährmann
25d2854272 [deviantart] add 'comments-avatars' option (#4995) 2024-03-02 21:59:16 +01:00
Mike Fährmann
c60ebc6519 [deviantart] improve fetching extended metadata (#5175) 
use multiple metadata API calls per chunk of deviations if necessary
 2024-02-25 03:36:00 +01:00
Mike Fährmann
741fd00cec [deviantart] extend 'metadata' option (#5175) 
alloe fetching extended metadata in addition to the usual
'description', 'tags', etc by setting 'metadata' to a list of
'camera', 'stats', 'submission', 'collection', and 'gallery'

for example "metadata": "stats,submission"
 2024-02-18 23:14:14 +01:00
Mike Fährmann
04e4ffc64c [deviantart] combine 'png' option with 'quality' (#4846) 
"quality": "png" to download PNGs instead og JPEGs
 2024-02-14 22:07:29 +01:00
Mike Fährmann
9cc4ec2c58 [deviantart] add 'png' option (#4846) 2024-02-14 01:03:15 +01:00
Mike Fährmann
966c8608e6 [deviantart] move image content extraction into separate function 2024-02-14 00:30:06 +01:00
Mike Fährmann
814ad9321e [deviantart] skip locked/blurred posts (#4567, #5193) 2024-02-13 14:15:12 +01:00
Mike Fährmann
90b382304a [deviantart] fix KeyError: 'premium_folder_data' (#5063) 2024-01-15 17:30:03 +01:00
Mike Fährmann
4cedf378d5 [deviantart] fix AttributeError for URLs without username (#5065) 
caused by 4f367145
 2024-01-15 16:28:57 +01:00
Mike Fährmann
39904c9e4e [deviantart:avatar] add 'formats' option (#4995) 2024-01-10 17:13:34 +01:00
Mike Fährmann
5f9a98cf0f [deviantart:avatar] fix exception when 'comments' are enabled (#4995) 2024-01-09 20:04:46 +01:00
Mike Fährmann
4f3671458e [deviantart] add 'avatar' and 'background' extractors (#4995) 2024-01-03 00:07:55 +01:00
Mike Fährmann
2a60645095 [deviantart] set 'is_original' for intermediary URLs to 'false' 2023-12-22 14:49:10 +01:00
Mike Fährmann
fbebc58189 [deviantart] add 'intermediary' option (#4955) 2023-12-21 02:23:22 +01:00
Mike Fährmann
57fc6fcf83 replace '24*3600' with '86400' 
and generalize cache maxage values
 2023-12-18 23:57:22 +01:00
Mike Fährmann
aac8bb4eae [deviantart] simplify 9951c112 2023-12-15 17:39:42 +01:00
Mike Fährmann
9951c112f8 [deviantart] workaround for integer client_id values (#4924) 2023-12-14 16:25:06 +01:00
Mike Fährmann
e256434c9e use custom HTTPBasicAuth class 
to support LazyPrompt as password
and to generate the Authorization header only once
instead of for every request
 2023-12-07 01:40:31 +01:00
Mike Fährmann
bfdc07632a [deviantart] expand nested comment replies (#4653) 2023-10-17 19:40:53 +02:00
Mike Fährmann
2d41702762 [deviantart] implement '"group": "skip"' (#4630) 2023-10-12 22:14:20 +02:00
Mike Fährmann
992e86ec94 [deviantart] disable 'jwt' (#4652) 2023-10-12 21:37:10 +02:00
Mike Fährmann
64dbc58a5a [deviantart] update Eclipse API endpoints 2 (#4615) 2023-10-03 14:58:52 +02:00
Mike Fährmann
bb39779e1a [deviantart] use private tokens for 'is_mature' posts (#4563) 2023-09-24 19:15:35 +02:00
Mike Fährmann
0c5d8b1505 [deviantart] re-add 'quality' option and 'intermediary' transform 2023-09-24 17:36:05 +02:00
Mike Fährmann
20d1683c47 [deviantart] fix JWT replacement (#293, #4548, #4563) 
And again, a huge thank you to @Ironchest337
for discovering this.
 2023-09-24 15:06:16 +02:00
Mike Fährmann
2ad75bab05 [deviantart] add 'is_original' metadata field (#4559) 
true for 'downloadable' content, journals, flash animations,
and images without '/v1/' in their URL; false otherwise
 2023-09-22 17:37:11 +02:00
Mike Fährmann
9d8317d963 [deviantart] disable JWT updates (#4548, #4563) 
back to lowres images ...
 2023-09-22 17:13:05 +02:00
Mike Fährmann
8064663bda [deviantart] update Eclipse API endpoints (#4553) 2023-09-22 16:30:16 +02:00
Mike Fährmann
2cd801232b fix --range causing crashes (#4557) 
regression caused by a383eca7
 2023-09-22 16:28:20 +02:00
Mike Fährmann
3ecb512722 send Referer headers by default 2023-09-19 00:02:04 +02:00
Mike Fährmann
a453335a9f remove test results in extractor modules 
and add generic example URLs
 2023-09-11 16:30:55 +02:00
Mike Fährmann
1d2b5d0c60 update test comment positions 
always put them above the test they're referring to
 2023-09-06 18:16:09 +02:00
Mike Fährmann
df5c7ee03e [deviantart] fix search (#4384) 
send correct usernames instead of 'u'
 2023-08-04 17:16:04 +02:00
Mike Fährmann
a383eca7f6 decouple extractor initialization 
Introduce an 'initialize()' function that does the actual init
(session, cookies, config options) and can called separately from
the constructor __init__().

This allows, for example, to adjust config access inside a Job
before most of it already happened when calling 'extractor.find()'.
 2023-07-25 22:16:16 +02:00
Mike Fährmann
d97b8c2fba consistent cookie-related names 
- rename every cookie variable or method to 'cookies_*'
- simplify '.session.cookies' to just '.cookies'
- more consistent 'login()' structure
 2023-07-22 01:20:50 +02:00
Mike Fährmann
22099422ca [deviantart] fix shortened URLs (#4316) 2023-07-18 17:55:13 +02:00
Mike Fährmann
98c9fdb414 [deviantart] revert e9353c63; retry downloads with private token 2023-04-23 21:10:16 +02:00
Mike Fährmann
e9353c63d6 [deviantart] keep using private access tokens 
for deviations returned from a private API call

also fixes a bug from 0a7eee3e where '_pagination()'
would never switch from unspecified (None) to private access token
 2023-04-13 14:46:06 +02:00
Mike Fährmann
0a7eee3ee0 [deviantart] add 'public' option 2023-04-08 23:04:34 +02:00
Mike Fährmann
34699fbf64 [deviantart:search] detect login redirects (#3860) 2023-04-03 19:37:12 +02:00