Commit Graph

1024 Commits

Author SHA1 Message Date
Mike Fährmann
c5be50fdaa [pixiv] implement workaround for 'limit_sanity_level' works
(#4327, #4747, #5054, #5435, #5651, #5655)

Metadata should be ~95% identical (there might be some 'date' differences)
and there could be issues with R-18 works, as these require some URL
manipulation to transform /c/250x250_80_a2/ thumbnail URLs into
/img-original/ ones.
2024-10-04 21:07:56 +02:00
Mike Fährmann
57c30fdc5b [bunkr] support 'bunkr.pk' URLs (#6272) 2024-10-04 09:16:31 +02:00
Mike Fährmann
ee8c4e2e49 [boosty] fix typo causing 'links' to always be empty (#2387) 2024-10-03 20:25:12 +02:00
Mike Fährmann
274d99e7d6 [boosty] add 'feed' and 'following' extractors (#2387) 2024-10-03 18:09:31 +02:00
Mike Fährmann
1ad58cab84 [boosty] add initial support (#2387) 2024-10-02 20:39:55 +02:00
Mike Fährmann
fb6be2dd34 [patreon] extract 'attachments_media' files (#6241)
https://github.com/mikf/gallery-dl/issues/6241#issuecomment-2386343160
2024-10-01 20:28:30 +02:00
Mike Fährmann
b03ee3c4c4 [text] implement 'parse_query_list()' 2024-10-01 20:28:30 +02:00
Mike Fährmann
a120295632 [util] use minimal separators for 'json_dumps()' 2024-10-01 17:03:13 +02:00
Mike Fährmann
ed859f05ed [deviantart] fix & improve journal/literature extraction (#6254, #6207)
fetch text from HTML __INITIAL_STATE__,
since the API doesn't reliably work and is unusable for sta.sh journals
2024-10-01 14:36:49 +02:00
Mike Fährmann
3d4191fc0d [patreon] handle exception for suspended accounts 2024-10-01 08:22:50 +02:00
Mike Fährmann
f3f27496d6 [newgrounds] support more comment embed formats (#6253) 2024-09-30 08:20:50 +02:00
Mike Fährmann
987f6c36c0 [civitai] ensure image files have an 'id' (#6251) 2024-09-29 19:25:55 +02:00
Mike Fährmann
53ae5e3fd8 [tests] allow testing for alternative values 2024-09-29 19:16:18 +02:00
Mike Fährmann
a937b72034 [ao3] add 'subscriptions' extractor (#6247) 2024-09-29 13:01:51 +02:00
Mike Fährmann
bc11dc0de2 [deviantart] add 'previews' option (#3782, #6124) 2024-09-27 10:41:26 +02:00
Mike Fährmann
e8c5b57a33 merge #6115: [inkbunny:favorite] update default directory
- extract 'favs_username' metadata
- store files in 'favs_username' directory
2024-09-25 20:28:14 +02:00
Mike Fährmann
ac3ff25236 [inkbunny:favorite] update test 2024-09-25 20:25:33 +02:00
Mike Fährmann
050d87d024 merge #6113: [weasyl:favorite] fix pagination, support readable URLs 2024-09-25 20:08:36 +02:00
Mike Fährmann
a2db0d5c0d [civitai] add 'quality' option (#3706)
download 'original=true' files by default
2024-09-25 17:23:08 +02:00
Mike Fährmann
92bbb9bf31 [civitai] add 'image' extractors (#3706, #6220) 2024-09-23 10:13:30 +02:00
Mike Fährmann
933dc568c3 [tests] ensure 'extractor.find' and 'from_url' extractors are identical 2024-09-22 10:58:59 +02:00
Mike Fährmann
14c57f771c [tests] make "#category" result entries optional
use categories of the given "#class"
when "#category" is not specified
2024-09-21 21:45:45 +02:00
Mike Fährmann
8bf081d295 [ao3] fix bookmark extraction, support 'series' bookmarks (#6013) 2024-09-21 13:54:42 +02:00
Mike Fährmann
93eca64a73 [civitai] add initial support (#3706, #3787, #4129, #5995) 2024-09-20 17:21:17 +02:00
Mike Fährmann
2c7a0c3ca8 add alternatives for deprecated utc datetime functions 2024-09-19 20:47:05 +02:00
Mike Fährmann
68bff76d90 [formatter] implement 'L' conversion 2024-09-19 13:50:52 +02:00
Mike Fährmann
b44f0cdab0 [formatter] allow accessing 'util.NONE' via global '_nul' 2024-09-19 13:28:59 +02:00
Mike Fährmann
2dfdc92b21 [ao3] extract detailed 'chapters' metadata (#6013) 2024-09-18 09:48:57 +02:00
Mike Fährmann
1d7df9cef2 [ao3] extract 'date_completed' and 'date_updated' metadata (#6013) 2024-09-17 17:26:54 +02:00
Mike Fährmann
064bc890fc [ao3] parse 'series' metadata (#6013) 2024-09-17 17:14:44 +02:00
Mike Fährmann
8f777668d0 [ao3] match URLs with 'com' and 'net' TLDs and 'ao3.org' (#6013) 2024-09-17 09:59:55 +02:00
Mike Fährmann
638a676495 [ao3] add initial support (#6013) 2024-09-15 22:38:21 +02:00
Mike Fährmann
7d6520e15d [bluesky] support video downloads (#6183) 2024-09-15 22:38:03 +02:00
Mike Fährmann
af8cba089e [zzup] support 'up.zzup.com' galleries (#6181) 2024-09-15 11:01:27 +02:00
Mike Fährmann
df0d7d4a12 [cohost] add 'user' and 'post' extractors (#4483) 2024-09-11 18:03:33 +02:00
Mike Fährmann
7fe0f35998 [sexcom] add 'likes' extractor (#6149) 2024-09-06 07:44:06 +02:00
Mike Fährmann
32d2e686c2 [batoto] return 'chapter_url' as string (#5562)
don't try to parse it as integer
2024-09-05 17:47:38 +02:00
Mike Fährmann
359572162b [pp:rename] improve renaming files 'to' a format (#5846, #6044) 2024-09-03 21:17:31 +02:00
Mike Fährmann
864484e4c6 [instagram] add 'info' as a possible 'include' value 2024-09-02 15:43:55 +02:00
Mike Fährmann
9d1e5f3c9b [pixiv] allow downloading "original" ugoira frames (#6056) 2024-09-01 13:37:32 +02:00
Mike Fährmann
ae9b0da755 [pp:hash] add 'hash' post processor (#6099) 2024-08-31 17:04:44 +02:00
Mike Fährmann
bd932b6860 [twitter] add 'info' as a possible 'include' value (#6114) 2024-08-31 17:04:22 +02:00
Deer-Spangle
b1b01f56af Add support for the readable URL format of Weasyl favourites page 2024-08-31 12:56:50 +01:00
Mike Fährmann
ef8b1bc56e [twitter] extract 'type' metadata (#6111) 2024-08-31 13:16:51 +02:00
Mike Fährmann
510ca36b35 [tests] fix bug when running tests in a certain order
test_ytdl -> test_downloader -> test_extractor
would cause a test failure in Python <3.6 related to youtube_dl imports
2024-08-31 09:42:30 +02:00
Mike Fährmann
17f5ba43a8 [pp:rename] add 'rename' post processor (#5846, #6044)
renames previously downloaded files to a different filename format
2024-08-30 18:21:36 +02:00
Mike Fährmann
e464c955b3 merge #6104: [generic] better directory names 2024-08-30 11:47:09 +02:00
Allen
a552fb5bcd [generic] better directory formatting/md 2024-08-29 22:30:48 +02:00
Mike Fährmann
127aa45834 [ytdl] ignore SyntaxErrors when trying to import a module 2024-08-29 19:28:08 +02:00
Mike Fährmann
4b286e80fd merge #6050: [wikimedia] add 'wiki' extractor 2024-08-25 09:38:24 +02:00