Commit Graph

796 Commits

Author SHA1 Message Date
Mike Fährmann
8ffa0cd3c8 [webtoons] small optimization
don't extract the entire 'author_area' and
avoid creating a second 'text.extract_from()' object
2024-01-15 18:24:47 +01:00
Mike Fährmann
68196589c4 [2ch] update
- simplify extractor code
- more metadata
- add tests
2024-01-15 04:09:05 +01:00
Mike Fährmann
69726fc82c [tests] skip tests requiring auth when non is provided 2024-01-14 22:47:16 +01:00
blankie
bb446b1598 [webtoons] extract more metadata 2024-01-14 19:26:49 +11:00
Mike Fährmann
355b909f46 merge #5041: [steamgriddb] add support (#5033) 2024-01-13 00:59:15 +01:00
Mike Fährmann
71e2c3e5a2 merge #5037: [hatenablog] add support (#5036) 2024-01-13 00:57:21 +01:00
Mike Fährmann
b97af09e03 [tests] include URL in failure report 2024-01-12 03:23:21 +01:00
Mike Fährmann
58e0665fbc [tests] load config from external file 2024-01-12 03:21:44 +01:00
Mike Fährmann
2dcfb012ea [patreon] download 'm3u8' manifests with ytdl 2024-01-12 02:33:27 +01:00
Mike Fährmann
2191e29e14 [nijie] fix image URL for single image posts (#5049) 2024-01-11 05:07:38 +01:00
Mike Fährmann
39904c9e4e [deviantart:avatar] add 'formats' option (#4995) 2024-01-10 17:13:34 +01:00
Mike Fährmann
887ade30a5 [batoto] support more mirror domains (#5042) 2024-01-09 18:02:49 +01:00
blankie
2ccb7d3bd3 [steamgriddb] add support 2024-01-09 17:12:56 +11:00
blankie
2cfe788f93 [hatenablog] fix extractor naming errors 2024-01-09 01:42:57 +11:00
blankie
61f3b2f820 [hatenablog] add support 2024-01-09 01:29:47 +11:00
Mike Fährmann
657ed93a22 [batoto] improve v2 manga URL pattern
and add tests
2024-01-07 22:23:30 +01:00
Mike Fährmann
33f228756a [mangadex] add 'list' extractor (#5025)
supports listing manga and chapters from list feed
2024-01-07 02:59:35 +01:00
Mike Fährmann
c25bdbae91 [komikcast] fix 'manga' extractor (#5027) 2024-01-06 14:19:44 +01:00
Mike Fährmann
8e1a2b5446 [komikcast] update domain to 'komikcast.lol' (#5027) 2024-01-06 02:16:43 +01:00
Mike Fährmann
a441249ea2 merge #4979: [batoto] add 'chapter' and 'manga' extractors (#1434, #2111) 2024-01-06 01:53:26 +01:00
Mike Fährmann
b11c352d66 [bato] rename to 'batoto'
to use the same category name as the previous bato.to site
2024-01-06 01:49:34 +01:00
Mike Fährmann
3aa24c3744 [bato] simplify and update 2024-01-06 01:10:04 +01:00
Mike Fährmann
11150a7d72 [nudecollect] remove module 2024-01-05 21:32:04 +01:00
Mike Fährmann
c158927c38 merge #5016: [zzup] add 'gallery' extractor (#4517, #4604, #4659, #4863) 2024-01-05 21:25:46 +01:00
Mike Fährmann
217fa7f8a1 include 'test/results' in flake8 checks 2024-01-05 18:16:33 +01:00
Mike Fährmann
e61f016465 [szurubooru] support 'snootbooru.com' (#5023) 2024-01-05 17:56:39 +01:00
Mike Fährmann
b4bcf40278 [weibo] fix AttributeError in 'user' extractor (#5022)
yet another bug caused by a383eca7
2024-01-05 17:18:33 +01:00
Mike Fährmann
0ab0a10d2d [jpgfish] update domain 2024-01-05 02:27:20 +01:00
enduser420
0f30136109 [zzup] add 'gallery' extractor 2024-01-04 21:38:59 +05:30
Mike Fährmann
7eaf648f2e [fanbox] add 'metadata' option (#4921)
extracts 'plan' and extended 'user' metadata
2024-01-04 15:01:33 +01:00
Mike Fährmann
4f3671458e [deviantart] add 'avatar' and 'background' extractors (#4995) 2024-01-03 00:07:55 +01:00
Mike Fährmann
63f649cd92 [idolcomplex] fix extraction & update URL patterns (#5002) 2024-01-01 17:38:32 +01:00
Mike Fährmann
7aa1c9671b [tests] fix 'invalid escape sequence' warnings 2024-01-01 16:12:43 +01:00
Mike Fährmann
b6903a4c90 [nijie] add 'count' metadata field
https://github.com/mikf/gallery-dl/issues/146#issuecomment-1812849102
2023-12-30 22:25:59 +01:00
Mike Fährmann
b93b351db9 merge #4962: [poringa] add support (#4675) 2023-12-30 20:39:35 +01:00
Mike Fährmann
9f21c839ad [poringa] improvements and fixes
- add 'num' and 'count' metadata fields
- prevent crash for "private" posts
- prevent crash when there's no 'main-info'
- update tests
2023-12-30 20:37:09 +01:00
Mike Fährmann
caceb14fc2 [tests] fail when a results file contains syntax errors
or is otherwise not importable
2023-12-30 17:26:57 +01:00
Mike Fährmann
085411f3f1 [rule34] recognize URLs with 'www' subdomain (#4984) 2023-12-30 16:07:56 +01:00
Antonio
e348da7a06 [poringa] add support 2023-12-27 00:07:23 -06:00
bug-assassin
74c225f94e [bato] add support 2023-12-26 22:33:33 -05:00
Mike Fährmann
f9544194c0 [paheal] restore 'extension' metadata (#4976) 2023-12-26 16:09:26 +01:00
Mike Fährmann
77d46e6f0c [lynxchan] update 'bbw-chan' domain (#4970) 2023-12-25 15:29:05 +01:00
Mike Fährmann
108c978073 merge #4919: [postmill] add support (#4917) 2023-12-23 15:23:56 +01:00
Mike Fährmann
2a60645095 [deviantart] set 'is_original' for intermediary URLs to 'false' 2023-12-22 14:49:10 +01:00
Mike Fährmann
01bb75f6cb merge #4945: {shimmie2[ support 'rule34hentai.net' (#861, #4789) 2023-12-22 00:10:26 +01:00
Mike Fährmann
79e4606893 [rule34hentai] cleanup
- fix using 'self._posts_rule34hentai'
- fix 'file_url' for posts
- update docs/supportedsites
- add tests
2023-12-22 00:01:36 +01:00
Mike Fährmann
627ed794a2 [danbooru] provide 'tags' as list (#4942)
keep the old 'tag_string' values around, similar to sankaku

a lot of repeat code ...
would be a lot less bad if "".split(" ") returned an empty list
2023-12-21 14:39:38 +01:00
Mike Fährmann
99aa923322 [inkbunny] improve '/submissionsviewall.php' patterns (#4934)
allow 'mode=…' to be in any position
don't require it to be somewhere in the middle
2023-12-16 19:21:20 +01:00
Mike Fährmann
3f9c113d78 [mastodon] Support non-numeric status IDs (#4936) 2023-12-16 01:52:31 +01:00
Mike Fährmann
2852404e49 [inkbunny] add 'unread' extractor (#4934) 2023-12-15 21:20:12 +01:00