Commit Graph

1724 Commits

Author SHA1 Message Date
Mike Fährmann
ab2c03b39e [xenforo] implement generic XenForo forum extractors
support
- https://simpcity.cr/
- https://nudostar.com/forum/ (#8333)
2025-12-11 21:26:34 +01:00
SpiffyChatterbox
484a15ff83 [fitnakedgirls] add support (#8671)
* [fitnakedgirls] add extractor

Add support for fitnakedgirls.com:
- Photo galleries (/photos/gallery/)
- Category pages (/photos/gallery/category/)
- Tag pages (/photos/tag/)
- Video posts (/videos/)
- Blog posts (/fitblog/)

Handles both newer (wp-block-image) and older (size-large) templates.

* simplify & fix

- use '_extract_title' method
- move '_pagination' into base class
- update 'FitnakedgirlsTagExtractor' pattern

* update docs/supportedsites

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-12-10 21:33:17 +01:00
SpiffyChatterbox
2c8250919b [pornpics] add 'category' and 'listing' extractors (#8662)
* [pornpics] add category and listing extractors

Add support for:
- Category pages like /ass/, /milf/, /blonde/ etc.
- Listing pages like /popular/, /recent/, /rating/, /likes/, /views/, /comments/

Category pages use JSON pagination like tags/search.
Listing pages don't support JSON pagination and use different HTML structure.

* [pornpics] simplify category pattern via class ordering

- Move PornpicsCategoryExtractor after PornpicsListingExtractor
  so it acts as catch-all, eliminating need for negative lookahead
- Use list comprehension in PornpicsListingExtractor.galleries()

* update docs/supportedsites
2025-12-10 20:00:07 +01:00
Mike Fährmann
f5fafd7977 [fikfap] add support (#8673)
add 'post' & 'user' extractors
2025-12-10 18:39:05 +01:00
Mike Fährmann
d5f4a3f5b0 [redbust] remove module (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3635792318
2025-12-10 09:20:05 +01:00
Mike Fährmann
5831679fd2 [blueskx] add 'api-server' option (#8668) 2025-12-09 17:52:55 +01:00
Mike Fährmann
ef9c472f94 [twitter] always use '3' as 'search-stop' default (#8613)
https://github.com/mikf/gallery-dl/issues/8613#issuecomment-3626474518
2025-12-08 20:46:59 +01:00
Mike Fährmann
b1b70528a6 [common] use 'parent' value as 'parent-metadata' default (#8525 #8604)
enable 'parent-metadata' by default for
'chevereto' & 'imagehost' (album/gallery) extractors
2025-12-08 20:07:56 +01:00
Mike Fährmann
9a8746f12d [tiktok] add 'covers' option (#8515) 2025-12-07 20:30:47 +01:00
Mike Fährmann
b5712e7959 [docs/configuration] update 'Logging Configuration' defaults 2025-12-07 17:13:44 +01:00
Mike Fährmann
5da200945b implement 'post-filter' & 'post-range' options
(#8643)
2025-12-05 16:40:23 +01:00
Mike Fährmann
4e2987e007 [path] implement conditional 'part-directory' (#8329) 2025-12-03 11:19:44 +01:00
Mike Fährmann
d15b3d4eae [twitter] add 'limit' option (#8173)
- reduce default number of requested items to 50
- allow using "fallback" values like with 'search-limit'

https://github.com/mikf/gallery-dl/issues/8173#issuecomment-3303015837
2025-12-02 22:34:53 +01:00
Mike Fährmann
0ebb74dfeb [twitter] implement using multiple values for 'search-limit' (#8173)
https://github.com/mikf/gallery-dl/issues/8173#issuecomment-3302713173
2025-12-02 19:51:59 +01:00
Mike Fährmann
f1aa3af119 [vsco] use '"browser": "firefox"' by default (#8127)
and re-enable TLS 1.2 cipher suites
i.e. revert c7fe6ba691
2025-12-01 16:41:11 +01:00
Mike Fährmann
5f38d8ab25 [twitter] increase 'retries-api' default to '9' (#8317) 2025-11-30 16:52:26 +01:00
Mike Fährmann
76765340eb [2ch] support 'org' TLD (#8629) 2025-11-30 16:49:23 +01:00
Mike Fährmann
f51544618e [audiochan] add 'search' extractor (#8602) 2025-11-29 20:01:15 +01:00
Mike Fährmann
9bf52ab8c5 [civitai] implement extracting 'tags' metadata (#8626) 2025-11-29 18:37:57 +01:00
Mike Fährmann
994cc34f75 [audiochan] add initial support (#8602) 2025-11-28 21:46:22 +01:00
Mike Fährmann
e589d6f6ee [pp:exec] add 'verbose' option (#7743) 2025-11-28 19:55:04 +01:00
Mike Fährmann
acf281a46a [twitter] implement 'retries-api' option (#8317)
retry API requests when encountering server-related errors
2025-11-27 19:23:27 +01:00
Mike Fährmann
1e7f4ee178 [output] add 'defer' option for logging files (#8523)
- defer file creation of error files by default
- implement custom FileHandler class
  to support deferred directory creation
2025-11-27 19:23:04 +01:00
Mike Fährmann
36fa543715 [twitter] add 'search-results' option (#8613) 2025-11-27 11:31:07 +01:00
MyFinalBellyache
d74809c538 [eporner] add support (#8581)
* [eporner] Add support
* Line-length <80 chars
* Fix flake8 indentation
* update
    - generalize example URL
    - strip "Photo Gallery" from 'title'
    - extract 'id'
* update supportedsites
* update test results
2025-11-20 18:03:54 +01:00
Mike Fährmann
e91337d5c3 [Danbooru] add 'media-asset' extractor (#8580) 2025-11-19 20:46:22 +01:00
Mike Fährmann
89be2f45e4 [mangadex] add 'data-saver' option (#8573) 2025-11-19 19:54:53 +01:00
MyFinalBellyache
a9687d2928 [pornstarstube] add support (#8576)
* Add support for pornstars.tube
* update
    - adjust pattern/example/page_url
    - extract '' & '' metadata
    - prevent unnecessary request
    - fix result URLs
    - return list comprehension result
* update supportedsites
* update test results
* fix extractor name

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-11-19 16:25:01 +01:00
MyFinalBellyache
cc7003a14c [okporn] add support (#8575)
* Add support for ok.porn
* update
    - adjust pattern/example/page_url
    - prevent unnecessary request
    - extract 'tags'
    - text.extract -> text.extr
    - return list comprehension result
* update supportedsites name
* update test results

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-11-19 15:49:13 +01:00
MyFinalBellyache
157a37b053 [sxypix] add support (#4507 #8391 #8574)
* Add support for sxypix.com
* update & simplify
    - text.extract -> text.extr
    - self.request().json() -> self.request_json()
    - use self.groups
    - remove __init__
    - list comprehension
* update test results

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-11-19 10:30:29 +01:00
vorsatile
991fe0f2a7 [aryion] add 'search' extractor (#8567)
* [aryion] Implement search extractor.
* [aryion] Update capabilities.
* [aryion] Adjust example.
* fix flake8 errors

* update & simplify
    - use existing '_pagination_next()'
    - remove '_pagination_search()'
    - update 'search[…]' metadata
* add tests

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-11-18 20:57:08 +01:00
Mike Fährmann
3b33c25378 [reddit] use REST API by default (#8559) 2025-11-17 16:24:54 +01:00
SpiffyChatterbox
f6e67116f2 [cfake] add support (#707 #6021 #8549 #8430)
* Create cfake.py
* Update __init__.py
* Create cfake.py tests
* update
    - simplify & combine code
    - adjust 'pattern': use '[^/?#]', match lines and groups
    - generalize example URLs
    - update default filenames
* update docs/supportedsites
* update test results

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-11-15 20:55:00 +01:00
Mike Fährmann
5cda64c8d8 [job] apply 'keywords-eval' to 'keywords-global' values (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3527246051
2025-11-13 20:29:31 +01:00
Mike Fährmann
e840e3c680 [docs/configuration] update 'twitter.users' example (#8548) 2025-11-12 22:09:00 +01:00
Mike Fährmann
691775d0fb [job] add 'keywords-global' option (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3505732704
2025-11-12 18:48:01 +01:00
dev-KingMaster
793956d2d5 [arena] add 'channel' extractor (#5847 #8509)
* feat: issue 5847 site support for are.na
* flake8 lint error fix
* class name error fix
* update
    - prevent unnecessary request to 'page_url'
    - fix pagination
    - simplify block extraction code
    TODO: - rewrite without GalleryExtractor
          - extractors for Blocks, Users, etc
* supportedsites
* tests
* rename to 'channel' extractor
* update site title to 'Are.na'
* prioritize attachments

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-11-11 20:44:40 +01:00
Mike Fährmann
d75a135e03 [myhentaigallery] add 'tag' extractor (#8537) 2025-11-10 19:12:52 +01:00
Mike Fährmann
8876272e3c [misskey] add 'date-min' & 'date-max' options (#8516)
TODO: implement 'order-posts' option
2025-11-10 19:12:45 +01:00
Mike Fährmann
9e3e12ef8e [misskey] add 'text-posts' option (#8516)
do not request text-only notes by default
2025-11-10 16:57:28 +01:00
Mike Fährmann
89ece8f900 [common] allow general ISO 8601 values for 'date-min' & '-max'
and parse them as UTC times instead of local time
2025-11-09 23:00:09 +01:00
Mike Fährmann
3942e6ddc0 [jpgfish] update domain to 'jpg7.cr' (#8530) 2025-11-09 21:01:46 +01:00
gengenson-code
a9018d1911 Added support for sex.com's feed (cookie required) (#8519)
* Added Extractor for sex.com feed
* Removed old comment
* add test URL
* update supportedsites
* simplify & fix flake8 newlines
* warn about missing session cookie

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-11-09 11:57:12 +01:00
Mike Fährmann
cc0a313b2d [silverpic] force '.net' TLD & fix extraction 2025-11-04 18:04:48 +01:00
Mike Fährmann
5591a16cd7 [formatter] add 'Lb' format specifier - 'L' for bytes 2025-11-03 13:36:55 +01:00
Mike Fährmann
91a5fd85db [formatter] add 'Xb' format specifier - 'X' for bytes (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3479362186
2025-11-03 12:41:20 +01:00
Mike Fährmann
0ecc1b6ead [pp:metadata] document '"mode": "print"'
4052068d5a
2025-11-01 19:48:32 +01:00
Tim Wicinski
e174d4fae5 [cyberdrop] update domain to 'cyberdrop.cr' (#8496)
* added cr to list of cyberdrop TLDs
* update
- example URLs
- tests
- supportedsites

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-11-01 18:22:10 +01:00
Mike Fährmann
7571ca9671 [patreon] add 'order-posts' option (#7856 #8482) 2025-10-30 19:51:43 +01:00
Mike Fährmann
2194dde9ea [itaku] add 'order' option 2025-10-30 19:51:04 +01:00