Commit Graph

335 Commits

Author SHA1 Message Date
Mike Fährmann
ffdec0cc04 [deviantart] match subfolders by name 2025-03-23 17:41:42 +01:00
Mike Fährmann
9a64c3d5fd [deviantart] update code formatting 2025-03-23 17:41:26 +01:00
Bishop Red
e454ded442 Adding functionality for subfolder support from Deviant Art 2025-03-21 22:39:06 -06:00
Mike Fährmann
6532cf9075 [deviantart] match '/gallery/recommended-for-you' URLs (#7168) 2025-03-17 09:49:11 +01:00
Mike Fährmann
8bdd543935 [deviantart:stash] fix legacy sta.sh links (#7181)
follow redirect instead of rewriting them to deviantart.com/stash/…
2025-03-16 19:38:56 +01:00
Mike Fährmann
4904186b70 [deviantart] prevent crash when accessing premium_folder_data (#6873)
e.g. for inactive accounts
2025-01-24 19:08:32 +01:00
Mike Fährmann
a53ce6103c [deviantart:tiptap] smaller fixes
- fix text indentation in headings
- fix deviations formats without 'c' path
- support custom 'target' in links
2025-01-03 22:48:06 +01:00
Mike Fährmann
bd7320fb7d [deviantart:tiptap] support more content block types
- anchor
- blockquote
- da-gif
- da-video
- lists
    - listItem
    - orderedList
    - bulletList
- text indentation
2025-01-02 14:17:32 +01:00
Mike Fährmann
5c5b6d6276 [deviantart:tiptap] fix deviation embeds without 'token' 2024-12-28 19:47:05 +01:00
Mike Fährmann
6059ffccf8 [deviantart] improve 'tiptap' to HTML conversion (#6686)
- fix "KeyError: 'attrs'" for links without 'href'
- support 'strike' text markers
- support 'heading' content blocks
2024-12-20 16:45:19 +01:00
Mike Fährmann
7916c8bf77 allow passing cookies to OAuth extractors
partially revert ce54b8c04c
2024-11-09 18:06:27 +01:00
Mike Fährmann
36883e458e use 'v[0] == "c"' instead of 'v.startswith("c")' 2024-10-15 08:24:06 +02:00
Mike Fährmann
d68bb78f44 use 'True if COND else False' for bool conversions
faster than 'bool(COND)', especially on older Pythons < 3.11
2024-10-14 20:57:47 +02:00
Mike Fährmann
5dd17910d1 [deviantart] fix sta.sh folder extraction 2024-10-11 09:51:20 +02:00
Mike Fährmann
cfb7b3dd71 [deviantart] improve 'tiptap' conversion (#6207)
- support literature link embeds
- support @ mentions
- support more text styles
2024-10-09 20:59:36 +02:00
Mike Fährmann
a9671f160b [deviantart] support converting 'tiptap' markup to HTML (#6207) 2024-10-05 23:43:32 +02:00
Mike Fährmann
7dbd53e9b4 [deviantart] extract journal HTML from webpage (#6254, #6207, #6196) 2024-10-01 21:47:14 +02:00
Mike Fährmann
ed859f05ed [deviantart] fix & improve journal/literature extraction (#6254, #6207)
fetch text from HTML __INITIAL_STATE__,
since the API doesn't reliably work and is unusable for sta.sh journals
2024-10-01 14:36:49 +02:00
Mike Fährmann
bc11dc0de2 [deviantart] add 'previews' option (#3782, #6124) 2024-09-27 10:41:26 +02:00
Mike Fährmann
928e170721 [deviantart] work around OAuth API returning empty journal texts
(#6196, #6207, #5916)
2024-09-27 10:41:26 +02:00
Mike Fährmann
a9dc7a6f98 [deviantart] warn about empty journal texts (#5916)
https://github.com/mikf/gallery-dl/issues/5916#issuecomment-2351069092
2024-09-16 10:12:25 +02:00
Mike Fährmann
0b53f3d0e9 [deviantart] fix '"original": "images"' (#6124) 2024-09-02 15:15:37 +02:00
Mike Fährmann
3bffe7a8bd [deviantart] fix 'manual' cursor-based pagination (#6079) 2024-08-23 16:03:38 +02:00
Mike Fährmann
269b2808f1 [deviantart] fix "KeyError - 'category'" (#5960, #5961)
'deviation' objects returned by the OAuth API no longer include a
'category' or 'category_path' value.
2024-08-08 09:34:51 +02:00
Mike Fährmann
bb07313227 [deviantart] try to work around journal/status API changes (#5916)
The new /user/profile/posts endpoint is documented to
"return all journals & status updates for a given user in a single feed"
but it does not do this.

There are usually several or even all status updates missing.
2024-08-03 13:17:27 +02:00
Mike Fährmann
2bf76461ce [deviantart:following] use OAuth API endpoint (#2511) 2024-07-31 17:21:39 +02:00
Mike Fährmann
e17b1d5073 [deviantart] fix 2c8aa9b2 (#5696) 2024-06-08 02:00:36 +02:00
Mike Fährmann
2c8aa9b2de [deviantart] fix watching module ID extraction (#5696) 2024-06-06 15:21:04 +02:00
Mike Fährmann
141a93c8fd [docs] update docs/configuration links (#5059, #5369, #5423) 2024-04-13 02:18:44 +02:00
Mike Fährmann
925123e007 [deviantart] handle CloudFront blocks in general (#5363)
This was already done for non-OAuth requests (#655)
but CF is now blocking OAuth API requests as well.
2024-03-23 15:50:24 +01:00
Mike Fährmann
a650fd3177 [deviantart] improve 'index' extraction for stash files (#5335) 2024-03-22 02:53:54 +01:00
Mike Fährmann
5716430c35 [deviantart:stash] recognize 'deviantart.com/stash/…' URLs 2024-03-15 18:14:55 +01:00
Mike Fährmann
76683c5f5c [deviantart:stash] fix 'index' metadata (#5335) 2024-03-15 18:10:59 +01:00
Mike Fährmann
a767832332 [deviantart:avatar] ignore default avatars (#5276) 2024-03-04 23:11:30 +01:00
Mike Fährmann
0cbc910905 [deviantart:avatar] fix 'index' for avatars without '?' (#5276) 2024-03-04 22:31:35 +01:00
Mike Fährmann
982880615d [deviantart] prevent unnecessary API requests (#4995)
… when using 'comments-avatars'

This also has the added benefit of making it possible to download
comment avatars from users without a valid user profile entry,
like deleted users.
2024-03-02 21:59:16 +01:00
Mike Fährmann
25d2854272 [deviantart] add 'comments-avatars' option (#4995) 2024-03-02 21:59:16 +01:00
Mike Fährmann
c60ebc6519 [deviantart] improve fetching extended metadata (#5175)
use multiple metadata API calls per chunk of deviations if necessary
2024-02-25 03:36:00 +01:00
Mike Fährmann
741fd00cec [deviantart] extend 'metadata' option (#5175)
alloe fetching extended metadata in addition to the usual
'description', 'tags', etc by setting 'metadata' to a list of
'camera', 'stats', 'submission', 'collection', and 'gallery'

for example "metadata": "stats,submission"
2024-02-18 23:14:14 +01:00
Mike Fährmann
04e4ffc64c [deviantart] combine 'png' option with 'quality' (#4846)
"quality": "png" to download PNGs instead og JPEGs
2024-02-14 22:07:29 +01:00
Mike Fährmann
9cc4ec2c58 [deviantart] add 'png' option (#4846) 2024-02-14 01:03:15 +01:00
Mike Fährmann
966c8608e6 [deviantart] move image content extraction into separate function 2024-02-14 00:30:06 +01:00
Mike Fährmann
814ad9321e [deviantart] skip locked/blurred posts (#4567, #5193) 2024-02-13 14:15:12 +01:00
Mike Fährmann
90b382304a [deviantart] fix KeyError: 'premium_folder_data' (#5063) 2024-01-15 17:30:03 +01:00
Mike Fährmann
4cedf378d5 [deviantart] fix AttributeError for URLs without username (#5065)
caused by 4f367145
2024-01-15 16:28:57 +01:00
Mike Fährmann
39904c9e4e [deviantart:avatar] add 'formats' option (#4995) 2024-01-10 17:13:34 +01:00
Mike Fährmann
5f9a98cf0f [deviantart:avatar] fix exception when 'comments' are enabled (#4995) 2024-01-09 20:04:46 +01:00
Mike Fährmann
4f3671458e [deviantart] add 'avatar' and 'background' extractors (#4995) 2024-01-03 00:07:55 +01:00
Mike Fährmann
2a60645095 [deviantart] set 'is_original' for intermediary URLs to 'false' 2023-12-22 14:49:10 +01:00
Mike Fährmann
fbebc58189 [deviantart] add 'intermediary' option (#4955) 2023-12-21 02:23:22 +01:00