Commit Graph

1094 Commits

Author SHA1 Message Date
Mike Fährmann
1ddbcda58b [nhentai] support ',webp' files (#6442) 2024-11-08 17:46:38 +01:00
Mike Fährmann
b6cf348658 [webtoons] extract 'episode_no' for comic results (#6439) 2024-11-08 14:19:17 +01:00
Mike Fährmann
6205e255f4 merge #6394: [tumblr] add 'search' extractor 2024-11-08 08:17:46 +01:00
Mike Fährmann
33778d35ba [tumblr] update
- simplify
- fix search pagination
- support custom search mode and post types
2024-11-08 08:15:13 +01:00
Mike Fährmann
a9a9f3a180 [pinterest] support 'story_pin_music_block' blocks (#6421) 2024-11-05 15:55:24 +01:00
Mike Fährmann
0b3ddd01af [hiperdex] update domain to 'hipertoon.com' (#6420)
and fix 'description' extraction
2024-11-05 15:54:42 +01:00
Mike Fährmann
9afbe91f82 [rule34xyz] add 'format' option (#1078) 2024-11-05 15:45:52 +01:00
Mike Fährmann
cb0d8cae77 merge #6227: [everia] add support (#1067, #2472, #4091) 2024-11-03 17:52:17 +01:00
Mike Fährmann
cea062ffc5 [everia] update
- implement general _pagination method
- simplify code
- adjust URL patterns
- update test results
2024-11-03 17:51:04 +01:00
missionfloyd
d31a3b5da3 [everia.club] Add support
- Unescape title and URL
- Add tags and categories metadata
    Lookup tag id with API instead of downloading tag page
- Add category extractor
- Add tests
- Rename EveriaExtractor to EveriaPostExtractor
- Fix EveriaPostExtractor example
- Lookup tags/categories by post id
- Add date extractor
- Remove leftover pages parameter
- Add error handling for invalid dates.
- Add filename numbering
    Parse date
- Rename extract() to images()
- Remove html import
- Fix search/date URLs with page number
- Fix tag/category search
- Fix post extractor
- Fix tag, category extractors
- Fix search extractor
- Only load first page once
- Fix date extractor
- Fix tests
- Clean up search extractor
2024-11-03 14:09:07 +01:00
Mike Fährmann
d787c0c4ea [rule34xyz] add support (#1078, #4960) 2024-11-03 10:12:26 +01:00
Mike Fährmann
7c0d2ca07d [rule34vault] update
- implement 'tags' categorization
- don't use 'totalCount' for pagination end
- update tests
2024-11-03 09:59:25 +01:00
Delphox
565dc5b43b [bluesky] match fxbsky.app and vxbsky.app 2024-11-02 16:00:43 -03:00
Mike Fährmann
93adfbe935 merge #6410: [bluesky] match common bluesky embed fixes 2024-11-02 18:28:07 +01:00
Mike Fährmann
cd47425ccc [bluesky] fix downloads from non-bsky PDSs (#6406) 2024-11-02 18:22:34 +01:00
Mike Fährmann
9deed87340 [bluesky] add 'author["instance"]' metadata (#4438) 2024-11-02 17:37:11 +01:00
Delphox
80c7246732 [bluesky] match cbsky.app, bskye.app, bskyx.app and bsyy.app urls 2024-11-02 13:04:32 -03:00
Mike Fährmann
99fe2b1f55 [bluesky] support 'main.bsky.dev' URLs (#4438) 2024-11-02 15:33:31 +01:00
Mike Fährmann
b92edb4614 [boosty] update default video format list (#2387) 2024-10-31 20:55:32 +01:00
Mike Fährmann
6f54328a39 [hitomi] update
- remove f-strings
- fix flake8 warnings
- move tests to test/results/hitomi.py
2024-10-29 16:56:52 +01:00
Mike Fährmann
655e42dc92 merge #6240: [rule34vault] add support (#5708) 2024-10-28 22:31:05 +01:00
Mike Fährmann
a974c30057 [rule34vault] update
- use more of BooruExtractor's interface
- use BASE_PATTERN
- define generic pagination method
- parse 'date' metadata
- make tags & extended metadata optional
2024-10-28 22:28:23 +01:00
ssdaniel24
3d0263b3ab [rule34vault] Added initial support for rule34vault.com
- Added playlists support for rule34vault
- Added support for posts in rule34vault
- Fixed supported sites with script
- Fixed posts pattern in rule34vault
- Added tests for rule34vault
- Clean
- Fixed lint warnings
2024-10-28 22:26:47 +01:00
Mike Fährmann
5de8576ff6 [noop] add 'noop' extractor 2024-10-28 19:45:24 +01:00
Mike Fährmann
2bbae0e98d merge #6389: [reddit] support user profile share links 2024-10-28 14:46:18 +01:00
inty
625fe0efce [reddit] support user profile share links 2024-10-28 14:58:06 +03:00
Mike Fährmann
10c076e7f2 [saint] add 'album' and 'media' extractors (#4405, #6324) 2024-10-27 22:27:30 +01:00
Mike Fährmann
061b27f329 [tests] detect calls to 'request()' during initialization (#6387) 2024-10-27 20:08:50 +01:00
Mike Fährmann
6693ae19e8 [civitai] add 'metadata' option (#6383) 2024-10-27 15:46:00 +01:00
Mike Fährmann
a4791f5243 [bluesky] add 'hashtag' extractor (#4438)
https://github.com/mikf/gallery-dl/issues/4438#issuecomment-2439979958
2024-10-27 13:59:46 +01:00
Mike Fährmann
cc07c81063 [mangadex] apply 'lang' only to chapter results (#6372) 2024-10-27 07:55:14 +01:00
Mike Fährmann
8f396cfc57 [bluesky] add 'quoted' option (#6323) 2024-10-25 17:22:33 +02:00
Mike Fährmann
d34e2d56aa [mangadex] use '/manga' endpoint to get manga by author (#6372)
allows for more than 10 manga to be returned
2024-10-24 20:07:11 +02:00
Mike Fährmann
0fd98f67ba [mangadex] add 'author' extractor (#6372) 2024-10-24 14:57:17 +02:00
Mike Fährmann
c243a7b060 [lensdump] fix extraction (#6313)
- support custom sort orders & query parameters
- rewrite pagination logic
2024-10-24 13:59:39 +02:00
Mike Fährmann
8f0b0b0735 [wikimedia] fix non-English Fandom/wiki.gg articles (#6370) 2024-10-24 13:00:02 +02:00
Mike Fährmann
75674944f0 [pixiv] implement 'sanity_level' workaround for user artworks results
(#4327, #5435, #6339)
2024-10-22 20:38:00 +02:00
Mike Fährmann
b08da4ffc7 [reddit] add 'embeds' option (#6357) 2024-10-22 17:06:54 +02:00
Mike Fährmann
33161da121 [pixiv] add 'captions' option (#4327)
make extra requests for empty captions independent of 'sanity'
2024-10-22 16:31:37 +02:00
Mike Fährmann
2d15e64ea9 [pixiv] fix exception when processing deleted sanity_level work (#6339)
https://github.com/mikf/gallery-dl/issues/6339#issuecomment-2427350524
2024-10-21 21:13:26 +02:00
Mike Fährmann
9a2bccd0d9 [bunkr] update to new site layout (#6344, #6352) 2024-10-21 14:17:28 +02:00
Mike Fährmann
66aa514c25 [scrolller] add initial support (#295, #3418, #5051) 2024-10-21 14:17:18 +02:00
Mike Fährmann
eacd4479a2 [patreon] support '/c/' before creator name in URLs (#6348)
and avoid '/CREATOR/posts' redirects
2024-10-21 14:11:19 +02:00
Mike Fährmann
cff3d37551 [civitai] update "My Reactions" handling (#6263)
- use "reactions" subcategory
- raise exception when no api-key or cookies are present
2024-10-20 14:56:56 +02:00
Mike Fährmann
5d984f35aa [pinterest] support 'story' pins (#6188, #6078, #4229) 2024-10-19 17:47:31 +02:00
Mike Fährmann
4667833195 [util] add 'std' object to global eval namespace (#6330)
allows accessing standard library modules (and other external modules)
in a more straightforward manner than '__import__(...)'

* std.os.getcwd()
* std["os"].getcwd()
2024-10-17 21:08:07 +02:00
Mike Fährmann
4b31601dc0 [civitai] fix "My Reactions" results (#6263)
requires 'api-key' or authenticated cookies to work
2024-10-16 23:18:00 +02:00
Mike Fährmann
69a75b1de2 [civitai] add extractors for global 'models' and 'images' (#6310) 2024-10-16 23:00:51 +02:00
Mike Fährmann
a37ac3c748 [civitai] add 'uuid' metadata field & use as archive format (#6326) 2024-10-16 19:56:09 +02:00
Mike Fährmann
6506afb257 [bunkr] support 'bunkr.ps' URLs 2024-10-14 16:27:09 +02:00