Commit Graph

5384 Commits

Author SHA1 Message Date
Mike Fährmann
ed859f05ed [deviantart] fix & improve journal/literature extraction (#6254, #6207)
fetch text from HTML __INITIAL_STATE__,
since the API doesn't reliably work and is unusable for sta.sh journals
2024-10-01 14:36:49 +02:00
Mike Fährmann
8f09e4eb02 [cohost] remove 'plainTextBody' from default filenames (#6262) 2024-10-01 14:36:49 +02:00
Mike Fährmann
2e87a91e97 [oauth] prevent empty browser names 2024-10-01 08:22:50 +02:00
Mike Fährmann
3d4191fc0d [patreon] handle exception for suspended accounts 2024-10-01 08:22:50 +02:00
Mike Fährmann
319c3a4c9b [patreon] use 'self.groups' to access matched URL values 2024-10-01 08:22:50 +02:00
Mike Fährmann
321161c769 [patreon] use mobile UA (#6241, #6239, #6140) 2024-10-01 08:22:16 +02:00
Mike Fährmann
7d0e5877ce [newgrounds] add more fallback URLs for 'art-images' files 2024-10-01 08:22:16 +02:00
Mike Fährmann
f3f27496d6 [newgrounds] support more comment embed formats (#6253) 2024-09-30 08:20:50 +02:00
Mike Fährmann
987f6c36c0 [civitai] ensure image files have an 'id' (#6251) 2024-09-29 19:25:55 +02:00
Mike Fährmann
a937b72034 [ao3] add 'subscriptions' extractor (#6247) 2024-09-29 13:01:51 +02:00
Mike Fährmann
9a0acbe7c4 [flickr] remove debug remains (#6252)
fixes regression introduced in a051e1c9
2024-09-29 13:01:51 +02:00
Mike Fährmann
6c0cce8dff [build] remove setuptools and requests version restrictions 2024-09-29 12:57:10 +02:00
Mike Fährmann
df4ecef364 release version 1.27.5 2024-09-28 11:44:10 +02:00
Mike Fährmann
0389575e0f [8chan] dynamically generate 'TOS' cookie name 2024-09-28 11:04:27 +02:00
Mike Fährmann
4e9dd036e7 [civitai] add 'nsfw' option (#3706) 2024-09-28 08:44:35 +02:00
Mike Fährmann
1ab90dd9e2 [civitai] improve model 'gallery' extraction (#3706) 2024-09-27 22:14:14 +02:00
Mike Fährmann
bc11dc0de2 [deviantart] add 'previews' option (#3782, #6124) 2024-09-27 10:41:26 +02:00
Mike Fährmann
928e170721 [deviantart] work around OAuth API returning empty journal texts
(#6196, #6207, #5916)
2024-09-27 10:41:26 +02:00
Mike Fährmann
f8f67dab22 [cookies] add 'cookies-select' option 2024-09-27 10:41:26 +02:00
Mike Fährmann
a783d6473c [jpgfish] update domain to 'jpg5.su' (#6231) 2024-09-26 15:23:22 +02:00
Mike Fährmann
f0267f969a [skeb] prevent 429 errors and need for 'request_key' cookie
https://github.com/danbooru/danbooru/pull/5795
2024-09-26 15:15:37 +02:00
Mike Fährmann
e8c5b57a33 merge #6115: [inkbunny:favorite] update default directory
- extract 'favs_username' metadata
- store files in 'favs_username' directory
2024-09-25 20:28:14 +02:00
Mike Fährmann
ac3ff25236 [inkbunny:favorite] update test 2024-09-25 20:25:33 +02:00
Mike Fährmann
050d87d024 merge #6113: [weasyl:favorite] fix pagination, support readable URLs 2024-09-25 20:08:36 +02:00
Mike Fährmann
9d7f8f892d [weasyl:favorite] update
- use 'self.groups' to access userid and username
- safe one request by not doing an explicit username -> userid lookup
- safe one request by following the 'Next' link instead of detecting an
  empty page
2024-09-25 20:02:01 +02:00
Mike Fährmann
3eb3564b5d [civitai] support using internal tRPC API endpoints (#3706) 2024-09-25 18:46:18 +02:00
Mike Fährmann
daa220370c [civitai] improve image URL handling (#3706)
- support building URLs from URL-hash values
- rename '_orig' to '_url'
2024-09-25 17:29:35 +02:00
Mike Fährmann
a2db0d5c0d [civitai] add 'quality' option (#3706)
download 'original=true' files by default
2024-09-25 17:23:08 +02:00
Mike Fährmann
92bbb9bf31 [civitai] add 'image' extractors (#3706, #6220) 2024-09-23 10:13:30 +02:00
Deer-Spangle
cbecaecc43 Fix infinite loop in Weasyl Favs downloader 2024-09-22 11:12:34 +01:00
Mike Fährmann
8bf081d295 [ao3] fix bookmark extraction, support 'series' bookmarks (#6013) 2024-09-21 13:54:42 +02:00
Mike Fährmann
5c062f95c1 [ao3] fix 'title' of restricted works (#6013) 2024-09-21 13:21:45 +02:00
Mike Fährmann
91eb04b0d0 [ao3] detect member-only and adult works (#6013) 2024-09-21 13:20:42 +02:00
Mike Fährmann
3348b05df0 [ao3] implement login with username & password (#6013) 2024-09-21 13:15:50 +02:00
Mike Fährmann
93eca64a73 [civitai] add initial support (#3706, #3787, #4129, #5995) 2024-09-20 17:21:17 +02:00
Mike Fährmann
fe190be589 [8chan] update 'TOS' cookie name 2024-09-19 20:50:58 +02:00
Mike Fährmann
2c7a0c3ca8 add alternatives for deprecated utc datetime functions 2024-09-19 20:47:05 +02:00
Mike Fährmann
a051e1c955 directly pass exception instances as 'exc_info' logger argument 2024-09-19 14:50:08 +02:00
Mike Fährmann
dd56bb2187 include debug exception info for GalleryDLException errors 2024-09-19 13:51:27 +02:00
Mike Fährmann
68bff76d90 [formatter] implement 'L' conversion 2024-09-19 13:50:52 +02:00
Mike Fährmann
b44f0cdab0 [formatter] allow accessing 'util.NONE' via global '_nul' 2024-09-19 13:28:59 +02:00
Mike Fährmann
2dfdc92b21 [ao3] extract detailed 'chapters' metadata (#6013) 2024-09-18 09:48:57 +02:00
Mike Fährmann
1d7df9cef2 [ao3] extract 'date_completed' and 'date_updated' metadata (#6013) 2024-09-17 17:26:54 +02:00
Mike Fährmann
064bc890fc [ao3] parse 'series' metadata (#6013) 2024-09-17 17:14:44 +02:00
Mike Fährmann
6b8628b23f merge #6191: [cohost] support downloading likes 2024-09-17 10:50:28 +02:00
Mike Fährmann
8f777668d0 [ao3] match URLs with 'com' and 'net' TLDs and 'ao3.org' (#6013) 2024-09-17 09:59:55 +02:00
Kae
31af0a12c7 [cohost] Support for downloading likes
turns out it's almost the same as tags, so I was able to get it working pretty easily
2024-09-17 12:50:59 +10:00
Mike Fährmann
73f833d08a [cookies:firefox] support using domain + container filters together 2024-09-16 14:58:44 +02:00
Mike Fährmann
a9dc7a6f98 [deviantart] warn about empty journal texts (#5916)
https://github.com/mikf/gallery-dl/issues/5916#issuecomment-2351069092
2024-09-16 10:12:25 +02:00
Mike Fährmann
4c391805de [bluesky] simplify file extraction code (#6183) 2024-09-16 09:37:18 +02:00