Commit Graph

1363 Commits

Author SHA1 Message Date
Mike Fährmann
456e93d489 [tests:results] enable 'extension' and ':?' in format tests 2025-05-26 13:50:42 +02:00
Mike Fährmann
e4d139c3ce [tests:text] add cases for query params with empty values 2025-05-26 13:47:46 +02:00
Mike Fährmann
f1ab8c39fb [kemonoparty] add 'artists' extractor (#7582) 2025-05-26 11:35:55 +02:00
Mike Fährmann
e469dc0da8 [imagevenue] detect 404 image files (#7570) 2025-05-24 22:12:48 +02:00
Mike Fährmann
1f869c2786 [kemonoparty:discord] update server & channel metadata (#7569)
to match the Discord Extractors' names

- rename
    server       -> server_id
    channel      -> channel_id
    channel_name -> channel
- add
    server
    channel_nsfw
    channel_type
    channel_topic
    parent_id
2025-05-24 18:05:03 +02:00
Mike Fährmann
f3ed15573a [text] add 'rextr()' 2025-05-23 17:28:58 +02:00
Mike Fährmann
f5b8c25559 [pinterest] ignore 'story_pin_product_sticker_block' blocks (#7563) 2025-05-22 18:42:39 +02:00
Mike Fährmann
7b5dd61e17 [sankaku] implement support for new 'tags' categories (#7333 #7553) 2025-05-22 12:41:03 +02:00
prowlguru
b8f3ca6c4e [pixiv] Implement sanity handling for ugoira works (#4327 #6297 #7285 #7434)
* [pixiv] Implement sanity handling for ugoira works

* [pixiv] fix PEP formatting for sanity ugoira handling

* [pixiv] update Ugoira AJAX error message

* [pixiv] respect disabled 'ugoira' option

* [tests] add 'limit_sanity_level' ugoira test

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-05-21 22:01:09 +02:00
bradenhilton
3ba4404d21 [pixeldrain] add support for filesystem URLs (#7473) 2025-05-21 17:28:09 +02:00
Mike Fährmann
a6de87d00e [civitai] fix exception for images without modelVersionId (#7432) 2025-05-17 20:17:57 +02:00
Mike Fährmann
0285473b04 [flickr] add 'profile' option 2025-05-13 11:47:34 +02:00
Mike Fährmann
6b84de6cf7 [flickr] add 'info' option (#4720 #6817) 2025-05-12 17:07:36 +02:00
Mike Fährmann
bd7fcdab4c [flickr] provide human-readable 'license_name' metadata 2025-05-12 16:44:22 +02:00
Mike Fährmann
7907d0d3bd [mangadex] add 'following' extractor (#7487)
also fixes the URL pattern for the Updates feed at
https://mangadex.org/titles/feed
2025-05-12 12:58:22 +02:00
Mike Fährmann
98fdcd4d72 [subscribestar] fix 'content' extraction (#7486)
and extract 'tags' metadata

Authored by: prowlguru

Co-authored-by: prowlguru <183935626+prowlguru@users.noreply.github.com>
2025-05-10 21:04:27 +02:00
Mike Fährmann
cd01eacd3d [mastodon] support Akkoma/Pleroma '/objects/:uuid' URLs (#7497) 2025-05-10 18:01:45 +02:00
Mike Fährmann
18eac5ca70 merge #7496: [mastodon] support Akkoma/Pleroma '/notice/:id' URLs 2025-05-10 17:50:34 +02:00
Mike Fährmann
1f7c29aee9 [tests:mastodon] move comments into '#comments' fields 2025-05-10 17:49:52 +02:00
Mike Fährmann
e233360015 [vipergirls] extract more metadata & rename fields (#7479)
- forum_title
- thread_title

- id     -> post_id
- title  -> post_title
- number -> post_num
2025-05-10 17:40:43 +02:00
Mike Fährmann
d872509060 [vipergirls] provide 'num' and 'count' metadata (#7479) 2025-05-10 17:10:32 +02:00
Mike Fährmann
f343c8c0b6 [civitai] fix/improve video downloads (#7502)
- add 'quality-videos' option
- fix downloading static .webp files instead of video
2025-05-10 16:13:48 +02:00
Soblow "Opale" Xaselgio
eba44b8f78 [mastodon] Add unit tests for various statuses URL formats on various fediverse software (mastodon/akkoma/pleroma)
Signed-off-by: Soblow "Opale" Xaselgio <113846014+Soblow@users.noreply.github.com>
2025-05-09 12:03:57 +02:00
Mike Fährmann
bff02bc5f4 [weasyl] add '/view/' test 2025-05-03 20:44:34 +02:00
Mike Fährmann
e26ae210bd [kemonoparty] restore using default creator posts endpoint
(#7438 #7450 #7462)

- revert c3fb0f53ee
- add '"endpoint": "legacy+"' option
  to use '/posts-legacy' results and with full metadata
2025-05-02 21:49:28 +02:00
Mike Fährmann
a6803afd36 [tests] implement testing for non-existence of a key 2025-05-02 21:10:05 +02:00
Mike Fährmann
95ec8c7414 [manganelo:manga] extract more metadata
- date_updated
- status
- tags
2025-04-30 09:01:33 +02:00
Mike Fährmann
7b2bcf68a5 [manganelo] support 'nelomanga.net' and mirror domains (#7423)
- natomanga.com
- nelomanga.net
- manganato.gg
- mangakakalot.gg
2025-04-29 21:12:37 +02:00
Mike Fährmann
16b5d41ce5 [kemonoparty] add 'endpoint' option (#7438) 2025-04-28 16:47:48 +02:00
Mike Fährmann
f6330bf16d [tests] implement explicit type checks for 'len:'
for example 'len:dict:3' to check for a dict with 3 items
2025-04-28 16:26:33 +02:00
Mike Fährmann
0725eab34f [deviantart] unescape \' in JSON data (#6653)
https://github.com/mikf/gallery-dl/issues/6653#issuecomment-2833783238
2025-04-28 09:42:16 +02:00
Mike Fährmann
9b43a3677e [pp:directory] add 'directory' post processor (#7432) 2025-04-28 09:08:35 +02:00
Mike Fährmann
7386cb78bc [chevereto] extract 'date' metadata (#7437) 2025-04-27 20:54:10 +02:00
Mike Fährmann
d7c365e08c [scrolller] fix exception for albums with missing media (#7428)
fixes regression introduced in a44ea6b3d9
2025-04-27 17:10:52 +02:00
Mike Fährmann
a44ea6b3d9 [scrolller] support albums for subreddit results (#7339)
update GraphQL queries
2025-04-26 16:41:54 +02:00
Mike Fährmann
2e8b447262 [kemonoparty] fix 'archives' option (#7416)
use '/vi/file/HASH' API endpoint
since '/v1/posts/archives/HASH' is gone or was renamed
2025-04-25 11:05:02 +02:00
Mike Fährmann
754b704ca1 merge #7411: [itaku] add 'stars' extractor 2025-04-24 19:48:09 +02:00
Mike Fährmann
f01b4adcc9 [itaku:stars] update
- remove type hints
- add test
- update docs/supportedsites
2025-04-24 19:45:48 +02:00
Mike Fährmann
4de7c02322 merge #7409: [pictoa] add support (#6683) 2025-04-24 18:02:34 +02:00
Mike Fährmann
29a4444b21 [pictoa] update
- simplify code
- update URL patterns
- update tests
- update docs/supportedsites
2025-04-24 17:59:47 +02:00
Mike Fährmann
25e8a98547 [scrolller] support album posts (#7339) 2025-04-24 16:36:27 +02:00
nunonda
f342108280 Adding in a first pass at a pictoa extractor
Adds support for galleries and individual Images
2025-04-23 17:37:40 -07:00
Mike Fährmann
ee1ba088b8 [deviantart:stash] extract more metadata (#7397)
- stash_id
- stash_name
- stash_description
- stash_folder
- stash_parent
2025-04-22 13:06:05 +02:00
noxibow
4c974debf5 [naver] support video downloads (#7395)
and fix 'date' for posts newer than 24h

- fix naver blogposts directory error for posts created less than 24 hours ago
- add support for videos on naver blogs
- refactor to remove unnecessary imports
- fix video url scraping method
- rework date handling
- rework video extraction
- add 'videos' option
- add test
2025-04-22 09:14:32 +02:00
Mike Fährmann
abf39b60ef merge #7396: [wikifeet] support redesign 2025-04-21 17:36:01 +02:00
Mike Fährmann
b71b5af38a [wikifeet] fix 'bdate' parsing
and update 'shoesize' test results
2025-04-21 17:32:54 +02:00
Mike Fährmann
99afe58a6e [deviantart] fix multi-image URLs (#6653)
https://github.com/mikf/gallery-dl/issues/6653#issuecomment-2816560271
2025-04-20 21:33:45 +02:00
Mike Fährmann
f0437a5121 merge #6331: [twitter] add 'followers' extractor 2025-04-19 18:29:11 +02:00
stephanelsmith
f0e7992674 [twitter] added 'followers' extractor
modeled after the 'following' extractor

- cleanup
- add test
2025-04-19 18:24:29 +02:00
Etienne Boucher
e6f4dcf90f Handle instagram.com/share/ URLs
- added Sec-Fetch* headers for proper redirect
- fixed formatting
- restore 'guide' test
- integrate in PostExtractor code
2025-04-19 18:19:36 +02:00