Commit Graph

1374 Commits

Author SHA1 Message Date
Mike Fährmann
9ed31cf992 [civitai] fix & update 'search' extractor (#7609)
- rename to 'search-models'
- use SearchAPI
2025-06-01 10:30:09 +02:00
Mike Fährmann
dc467c7790 [civitai] add 'search-images' extractor (#7609) 2025-06-01 10:06:18 +02:00
Mike Fährmann
02b34e6680 [civitai] support "My Reactions" results for videos (#7608) 2025-05-31 21:30:39 +02:00
Mike Fährmann
9c3e458ced [tests:extractor] check initial '_cfgpath' 2025-05-31 11:00:11 +02:00
Mike Fährmann
8adf48316f [ytdl] detect yt-dlp independent of module name (#7599) 2025-05-30 23:52:32 +02:00
Mike Fährmann
ec523c2c2c [mangasee] remove module 2025-05-30 18:04:55 +02:00
Mike Fährmann
922c296482 [kemono][coomer][schalenetwork] rename modules & extractors
category changes:

- kemonoparty -> kemono
- coomerparty -> coomer
- koharu      -> schalenetwork

also wanted to rename '2chan' -> 'sturdychan',
but the site's main page is still titled '2chen'
2025-05-30 17:51:49 +02:00
Mike Fährmann
002c25d417 [util] add 'NullResponse' class 2025-05-29 20:27:40 +02:00
Mike Fährmann
539ed8fef4 [formatter] add 'D' conversion 2025-05-29 20:09:26 +02:00
Mike Fährmann
17b2910938 [util] implement 'to_datetime()' 2025-05-28 20:10:18 +02:00
Mike Fährmann
6e87ad2ccc [fanbox] extract 'archives' metadata (#7454) 2025-05-27 18:04:35 +02:00
Mike Fährmann
456e93d489 [tests:results] enable 'extension' and ':?' in format tests 2025-05-26 13:50:42 +02:00
Mike Fährmann
e4d139c3ce [tests:text] add cases for query params with empty values 2025-05-26 13:47:46 +02:00
Mike Fährmann
f1ab8c39fb [kemonoparty] add 'artists' extractor (#7582) 2025-05-26 11:35:55 +02:00
Mike Fährmann
e469dc0da8 [imagevenue] detect 404 image files (#7570) 2025-05-24 22:12:48 +02:00
Mike Fährmann
1f869c2786 [kemonoparty:discord] update server & channel metadata (#7569)
to match the Discord Extractors' names

- rename
    server       -> server_id
    channel      -> channel_id
    channel_name -> channel
- add
    server
    channel_nsfw
    channel_type
    channel_topic
    parent_id
2025-05-24 18:05:03 +02:00
Mike Fährmann
f3ed15573a [text] add 'rextr()' 2025-05-23 17:28:58 +02:00
Mike Fährmann
f5b8c25559 [pinterest] ignore 'story_pin_product_sticker_block' blocks (#7563) 2025-05-22 18:42:39 +02:00
Mike Fährmann
7b5dd61e17 [sankaku] implement support for new 'tags' categories (#7333 #7553) 2025-05-22 12:41:03 +02:00
prowlguru
b8f3ca6c4e [pixiv] Implement sanity handling for ugoira works (#4327 #6297 #7285 #7434)
* [pixiv] Implement sanity handling for ugoira works

* [pixiv] fix PEP formatting for sanity ugoira handling

* [pixiv] update Ugoira AJAX error message

* [pixiv] respect disabled 'ugoira' option

* [tests] add 'limit_sanity_level' ugoira test

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-05-21 22:01:09 +02:00
bradenhilton
3ba4404d21 [pixeldrain] add support for filesystem URLs (#7473) 2025-05-21 17:28:09 +02:00
Mike Fährmann
a6de87d00e [civitai] fix exception for images without modelVersionId (#7432) 2025-05-17 20:17:57 +02:00
Mike Fährmann
0285473b04 [flickr] add 'profile' option 2025-05-13 11:47:34 +02:00
Mike Fährmann
6b84de6cf7 [flickr] add 'info' option (#4720 #6817) 2025-05-12 17:07:36 +02:00
Mike Fährmann
bd7fcdab4c [flickr] provide human-readable 'license_name' metadata 2025-05-12 16:44:22 +02:00
Mike Fährmann
7907d0d3bd [mangadex] add 'following' extractor (#7487)
also fixes the URL pattern for the Updates feed at
https://mangadex.org/titles/feed
2025-05-12 12:58:22 +02:00
Mike Fährmann
98fdcd4d72 [subscribestar] fix 'content' extraction (#7486)
and extract 'tags' metadata

Authored by: prowlguru

Co-authored-by: prowlguru <183935626+prowlguru@users.noreply.github.com>
2025-05-10 21:04:27 +02:00
Mike Fährmann
cd01eacd3d [mastodon] support Akkoma/Pleroma '/objects/:uuid' URLs (#7497) 2025-05-10 18:01:45 +02:00
Mike Fährmann
18eac5ca70 merge #7496: [mastodon] support Akkoma/Pleroma '/notice/:id' URLs 2025-05-10 17:50:34 +02:00
Mike Fährmann
1f7c29aee9 [tests:mastodon] move comments into '#comments' fields 2025-05-10 17:49:52 +02:00
Mike Fährmann
e233360015 [vipergirls] extract more metadata & rename fields (#7479)
- forum_title
- thread_title

- id     -> post_id
- title  -> post_title
- number -> post_num
2025-05-10 17:40:43 +02:00
Mike Fährmann
d872509060 [vipergirls] provide 'num' and 'count' metadata (#7479) 2025-05-10 17:10:32 +02:00
Mike Fährmann
f343c8c0b6 [civitai] fix/improve video downloads (#7502)
- add 'quality-videos' option
- fix downloading static .webp files instead of video
2025-05-10 16:13:48 +02:00
Soblow "Opale" Xaselgio
eba44b8f78 [mastodon] Add unit tests for various statuses URL formats on various fediverse software (mastodon/akkoma/pleroma)
Signed-off-by: Soblow "Opale" Xaselgio <113846014+Soblow@users.noreply.github.com>
2025-05-09 12:03:57 +02:00
Mike Fährmann
bff02bc5f4 [weasyl] add '/view/' test 2025-05-03 20:44:34 +02:00
Mike Fährmann
e26ae210bd [kemonoparty] restore using default creator posts endpoint
(#7438 #7450 #7462)

- revert c3fb0f53ee
- add '"endpoint": "legacy+"' option
  to use '/posts-legacy' results and with full metadata
2025-05-02 21:49:28 +02:00
Mike Fährmann
a6803afd36 [tests] implement testing for non-existence of a key 2025-05-02 21:10:05 +02:00
Mike Fährmann
95ec8c7414 [manganelo:manga] extract more metadata
- date_updated
- status
- tags
2025-04-30 09:01:33 +02:00
Mike Fährmann
7b2bcf68a5 [manganelo] support 'nelomanga.net' and mirror domains (#7423)
- natomanga.com
- nelomanga.net
- manganato.gg
- mangakakalot.gg
2025-04-29 21:12:37 +02:00
Mike Fährmann
16b5d41ce5 [kemonoparty] add 'endpoint' option (#7438) 2025-04-28 16:47:48 +02:00
Mike Fährmann
f6330bf16d [tests] implement explicit type checks for 'len:'
for example 'len:dict:3' to check for a dict with 3 items
2025-04-28 16:26:33 +02:00
Mike Fährmann
0725eab34f [deviantart] unescape \' in JSON data (#6653)
https://github.com/mikf/gallery-dl/issues/6653#issuecomment-2833783238
2025-04-28 09:42:16 +02:00
Mike Fährmann
9b43a3677e [pp:directory] add 'directory' post processor (#7432) 2025-04-28 09:08:35 +02:00
Mike Fährmann
7386cb78bc [chevereto] extract 'date' metadata (#7437) 2025-04-27 20:54:10 +02:00
Mike Fährmann
d7c365e08c [scrolller] fix exception for albums with missing media (#7428)
fixes regression introduced in a44ea6b3d9
2025-04-27 17:10:52 +02:00
Mike Fährmann
a44ea6b3d9 [scrolller] support albums for subreddit results (#7339)
update GraphQL queries
2025-04-26 16:41:54 +02:00
Mike Fährmann
2e8b447262 [kemonoparty] fix 'archives' option (#7416)
use '/vi/file/HASH' API endpoint
since '/v1/posts/archives/HASH' is gone or was renamed
2025-04-25 11:05:02 +02:00
Mike Fährmann
754b704ca1 merge #7411: [itaku] add 'stars' extractor 2025-04-24 19:48:09 +02:00
Mike Fährmann
f01b4adcc9 [itaku:stars] update
- remove type hints
- add test
- update docs/supportedsites
2025-04-24 19:45:48 +02:00
Mike Fährmann
4de7c02322 merge #7409: [pictoa] add support (#6683) 2025-04-24 18:02:34 +02:00