github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7,456 Commits 1 Branch 0 Tags
aa397707830f0aa5ef4ed4ccbc7bf5d1aef75ca3
Commit Graph

7456 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
aa39770783 [aryion:search] simplify further 
- skip 'build_query()' step
- add underscores to prefixes
 2025-11-19 19:54:53 +01:00
MyFinalBellyache
a9687d2928 [pornstarstube] add support (#8576) 
* Add support for pornstars.tube
* update
    - adjust pattern/example/page_url
    - extract '' & '' metadata
    - prevent unnecessary request
    - fix result URLs
    - return list comprehension result
* update supportedsites
* update test results
* fix extractor name

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-11-19 16:25:01 +01:00
MyFinalBellyache
cc7003a14c [okporn] add support (#8575) 
* Add support for ok.porn
* update
    - adjust pattern/example/page_url
    - prevent unnecessary request
    - extract 'tags'
    - text.extract -> text.extr
    - return list comprehension result
* update supportedsites name
* update test results

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-11-19 15:49:13 +01:00
MyFinalBellyache
157a37b053 [sxypix] add support (#4507 #8391 #8574) 
* Add support for sxypix.com
* update & simplify
    - text.extract -> text.extr
    - self.request().json() -> self.request_json()
    - use self.groups
    - remove __init__
    - list comprehension
* update test results

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-11-19 10:30:29 +01:00
vorsatile
991fe0f2a7 [aryion] add 'search' extractor (#8567) 
* [aryion] Implement search extractor.
* [aryion] Update capabilities.
* [aryion] Adjust example.
* fix flake8 errors

* update & simplify
    - use existing '_pagination_next()'
    - remove '_pagination_search()'
    - update 'search[…]' metadata
* add tests

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-11-18 20:57:08 +01:00
Mike Fährmann
e60007add6 [xasiat] fix 'IndexError' for albums without category (#8569) 2025-11-18 19:38:30 +01:00
Mike Fährmann
0e0f446368 [rawkuma] update extractors to new site layout (#8568) 2025-11-18 19:38:30 +01:00
Mike Fährmann
9e6b87f850 [fanbox:redirect] disable cookie usage (#8565) 2025-11-18 19:38:14 +01:00
Mike Fährmann
3b33c25378 [reddit] use REST API by default (#8559) 2025-11-17 16:24:54 +01:00
Mike Fährmann
6ee7096558 [instagram] fix "AttributeError: 'videos_dash'" (#8561) 
fixes regression introduced in ab3e34e9c3
 2025-11-15 23:23:31 +01:00
SpiffyChatterbox
f6e67116f2 [cfake] add support (#707 #6021 #8549 #8430) 
* Create cfake.py
* Update __init__.py
* Create cfake.py tests
* update
    - simplify & combine code
    - adjust 'pattern': use '[^/?#]', match lines and groups
    - generalize example URLs
    - update default filenames
* update docs/supportedsites
* update test results

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-11-15 20:55:00 +01:00
Mike Fährmann
2578f7b5c1 [flickr] extract public API key from website (#7564 #7649 #7700 #8553) 
this breaks 'oauth:flickr' with the default key,
but it allows downloading without custom key / Flickr Pro
 2025-11-14 11:38:28 +01:00
Mike Fährmann
5da4fb38c6 [reddit] fix "KeyError: 'media_metadata'" for embeds (#8551) 2025-11-14 08:52:57 +01:00
Mike Fährmann
e6930ebb23 [instagram] improve error for non-existent profiles (#8550) 2025-11-13 20:34:46 +01:00
Mike Fährmann
5cda64c8d8 [job] apply 'keywords-eval' to 'keywords-global' values (#6582) 
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3527246051
 2025-11-13 20:29:31 +01:00
Mike Fährmann
e840e3c680 [docs/configuration] update 'twitter.users' example (#8548) 2025-11-12 22:09:00 +01:00
Mike Fährmann
1b6353064d [rule34us:tag] support URLs with empty 'q' query parameter (#8546) 2025-11-12 21:04:11 +01:00
Mike Fährmann
65c4f00939 [imagehosts] provide 'post_url' metadata (#6582) 
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3520249958
 2025-11-12 19:10:57 +01:00
Mike Fährmann
359681a8e4 [pixhost] extract 'directory' metadata (#6582) 
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3520249958
 2025-11-12 19:09:46 +01:00
Mike Fährmann
691775d0fb [job] add 'keywords-global' option (#6582) 
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3505732704
 2025-11-12 18:48:01 +01:00
Mike Fährmann
d7e1351987 [bellazon] improve 'filename' & 'extension' (#8544) 
https://github.com/mikf/gallery-dl/issues/8544#issuecomment-3522617104

- use 'extension' from file URL (except attachments)
- strip everything after the first '.' from non-URL filenames
 2025-11-12 18:38:44 +01:00
Mike Fährmann
da47214ca0 [bellazon] remove query parameters from attachment IDs (#8544) 2025-11-12 17:46:16 +01:00
Mike Fährmann
b6f855d3f3 [scripts/generate_result] don't reorder "small" dicts/lists 2025-11-11 22:02:01 +01:00
Mike Fährmann
76081b312e [tests/results] improve '{…, …, ...}' tests 
fix error when including 'dict' type as possible result
 2025-11-11 21:20:33 +01:00
Mike Fährmann
c07421cba6 [arena] update metadata structure 
- provide data in 'block', 'channel', 'user', etc dicts
- convert block dates to 'datetime' objects
- update directory/filename/archive formats
 2025-11-11 21:01:02 +01:00
dev-KingMaster
793956d2d5 [arena] add 'channel' extractor (#5847 #8509) 
* feat: issue 5847 site support for are.na
* flake8 lint error fix
* class name error fix
* update
    - prevent unnecessary request to 'page_url'
    - fix pagination
    - simplify block extraction code
    TODO: - rewrite without GalleryExtractor
          - extractors for Blocks, Users, etc
* supportedsites
* tests
* rename to 'channel' extractor
* update site title to 'Are.na'
* prioritize attachments

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-11-11 20:44:40 +01:00
Mike Fährmann
d75a135e03 [myhentaigallery] add 'tag' extractor (#8537) 2025-11-10 19:12:52 +01:00
Mike Fährmann
8876272e3c [misskey] add 'date-min' & 'date-max' options (#8516) 
TODO: implement 'order-posts' option
 2025-11-10 19:12:45 +01:00
Mike Fährmann
9e3e12ef8e [misskey] add 'text-posts' option (#8516) 
do not request text-only notes by default
 2025-11-10 16:57:28 +01:00
Mike Fährmann
89ece8f900 [common] allow general ISO 8601 values for 'date-min' & '-max' 
and parse them as UTC times instead of local time
 2025-11-09 23:00:09 +01:00
Mike Fährmann
3942e6ddc0 [jpgfish] update domain to 'jpg7.cr' (#8530) 2025-11-09 21:01:46 +01:00
Mike Fährmann
9417d2c34f [misskey] remove base-class constructor 
use 'self.groups[-1]' instead
 2025-11-09 17:05:32 +01:00
gengenson-code
a9018d1911 Added support for sex.com's feed (cookie required) (#8519) 
* Added Extractor for sex.com feed
* Removed old comment
* add test URL
* update supportedsites
* simplify & fix flake8 newlines
* warn about missing session cookie

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-11-09 11:57:12 +01:00
Mike Fährmann
aba68f8643 [deviantart:gallery] match URLs with query parameters (#8514) 2025-11-09 11:33:11 +01:00
Mike Fährmann
dfe66e82a8 [cien] fix 'creator' & 'recent' extractors (#8524) 
update '_pagination_articles()' end element
 2025-11-08 18:03:15 +01:00
Mike Fährmann
9b03990be0 [postimg] fix extraction (#8505) 2025-11-05 11:15:05 +01:00
Mike Fährmann
617bd7a657 [imhentai:search] support '/advanced-search/' URLs (#8507) 2025-11-04 18:27:24 +01:00
Mike Fährmann
cc0a313b2d [silverpic] force '.net' TLD & fix extraction 2025-11-04 18:04:48 +01:00
Mike Fährmann
e604c22812 [imagehost] improve 'filename' & 'extension' handling 2025-11-04 18:04:48 +01:00
Mike Fährmann
7ed04d830e [postimg] force 'postimg.cc' domain (#8505) 2025-11-04 18:02:25 +01:00
Mike Fährmann
5591a16cd7 [formatter] add 'Lb' format specifier - 'L' for bytes 2025-11-03 13:36:55 +01:00
Mike Fährmann
91a5fd85db [formatter] add 'Xb' format specifier - 'X' for bytes (#6582) 
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3479362186
 2025-11-03 12:41:20 +01:00
Mike Fährmann
0ecc1b6ead [pp:metadata] document '"mode": "print"' 
4052068d5a
 2025-11-01 19:48:32 +01:00
Tim Wicinski
e174d4fae5 [cyberdrop] update domain to 'cyberdrop.cr' (#8496) 
* added cr to list of cyberdrop TLDs
* update
- example URLs
- tests
- supportedsites

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-11-01 18:22:10 +01:00
Mike Fährmann
37aa7337dc [text] reject long filename extensions (#8491) 
fixes regression introduced in 3252ead7c7
ref bc868e7bb8
 2025-11-01 10:35:33 +01:00
Mike Fährmann
3848a912dc [path] treat broken symlinks as existing files (#8490) 2025-11-01 10:01:45 +01:00
Mike Fährmann
a3734e2e56 [path] improve 'exists()' performance 
call 'os.stat()' directly
 2025-11-01 10:01:06 +01:00
Mike Fährmann
7571ca9671 [patreon] add 'order-posts' option (#7856 #8482) 2025-10-30 19:51:43 +01:00
Mike Fährmann
2194dde9ea [itaku] add 'order' option 2025-10-30 19:51:04 +01:00
Mike Fährmann
20bca3f2e4 [imagehosts] add and use 'not_found()' method 2025-10-29 11:55:11 +01:00