Commit Graph

1780 Commits

Author SHA1 Message Date
Mike Fährmann
9133ee321f [fanbox] make '_extract_post()' non-fatal (#8711)
fixes regression introduced in 4a4c1a1154
2025-12-15 17:43:21 +01:00
Mike Fährmann
d43ce45cb8 [boosty] send 'Authorization' header for file downloads (#8704) 2025-12-15 17:31:44 +01:00
Mike Fährmann
c268f793a4 [xenforo] support 'allthefallen.moe/forum' (#3249 #8268) 2025-12-15 17:28:16 +01:00
Mike Fährmann
4f33751c30 [koofer] add 'shared' extractor (#8700) 2025-12-14 18:05:23 +01:00
Mike Fährmann
774cb1e1a0 [comedywildlifephoto] add 'gallery' extractor (#8690) 2025-12-14 17:59:56 +01:00
Mike Fährmann
8f621b32bd [2chen] implement generic 2chen board extractors
support
- https://sturdychan.help/
- https://schan.help/ (#8680)
2025-12-13 18:08:50 +01:00
Mike Fährmann
a8ca947154 [pixiv] warn about invalid 'PHPSESSID' cookie (#8689) 2025-12-13 16:00:02 +01:00
Mike Fährmann
05817c523f [audiochan] relax 'pattern' 2025-12-12 09:21:44 +01:00
Mike Fährmann
739e940a95 [audiochan] extract 'description' texts (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3643689186
2025-12-12 09:13:07 +01:00
Mike Fährmann
ab2c03b39e [xenforo] implement generic XenForo forum extractors
support
- https://simpcity.cr/
- https://nudostar.com/forum/ (#8333)
2025-12-11 21:26:34 +01:00
Mike Fährmann
d85fa5fb14 [facebook] do not match '/permalink' URLs (#8679) 2025-12-11 17:28:02 +01:00
SpiffyChatterbox
1eaaffffbb [nudostarforum] add support (#8664)
Add support for nudostar.com forum (XenForo-based forum site).
This is separate from the existing nudostar.py which handles nudostar.tv.

Supports:
- Thread extraction with pagination
- Individual post extraction
- Authentication via xf_user cookie or username/password
- Internal attachments (both linked and embedded images)
- External image host URLs (queued for recursive processing)
2025-12-11 17:03:17 +01:00
SpiffyChatterbox
484a15ff83 [fitnakedgirls] add support (#8671)
* [fitnakedgirls] add extractor

Add support for fitnakedgirls.com:
- Photo galleries (/photos/gallery/)
- Category pages (/photos/gallery/category/)
- Tag pages (/photos/tag/)
- Video posts (/videos/)
- Blog posts (/fitblog/)

Handles both newer (wp-block-image) and older (size-large) templates.

* simplify & fix

- use '_extract_title' method
- move '_pagination' into base class
- update 'FitnakedgirlsTagExtractor' pattern

* update docs/supportedsites

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-12-10 21:33:17 +01:00
SpiffyChatterbox
2c8250919b [pornpics] add 'category' and 'listing' extractors (#8662)
* [pornpics] add category and listing extractors

Add support for:
- Category pages like /ass/, /milf/, /blonde/ etc.
- Listing pages like /popular/, /recent/, /rating/, /likes/, /views/, /comments/

Category pages use JSON pagination like tags/search.
Listing pages don't support JSON pagination and use different HTML structure.

* [pornpics] simplify category pattern via class ordering

- Move PornpicsCategoryExtractor after PornpicsListingExtractor
  so it acts as catch-all, eliminating need for negative lookahead
- Use list comprehension in PornpicsListingExtractor.galleries()

* update docs/supportedsites
2025-12-10 20:00:07 +01:00
Mike Fährmann
f5fafd7977 [fikfap] add support (#8673)
add 'post' & 'user' extractors
2025-12-10 18:39:05 +01:00
Mike Fährmann
d5f4a3f5b0 [redbust] remove module (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3635792318
2025-12-10 09:20:05 +01:00
Mike Fährmann
8e5d8d8c89 [chevereto:album] extract 'count' & 'num' metadata (#8604) 2025-12-09 21:00:32 +01:00
Mike Fährmann
b141bbd2ae [erome] improve error message for deleted & copyrighted albums (#8665) 2025-12-09 12:10:27 +01:00
Mike Fährmann
4ee998df0a [realbooru] extract video fallbacks (#8661) 2025-12-09 11:51:33 +01:00
Mike Fährmann
efad90696d [dl:http] fail downloads of empty files (#8661) 2025-12-09 11:18:52 +01:00
Mike Fährmann
ae41de3be5 [sankaku][idolcomplex] fix download URLs (#8666) 2025-12-09 10:02:43 +01:00
Mike Fährmann
1b4249ed37 [sankaku][idolcomplex] support URLs with locale code (#8667) 2025-12-09 08:23:40 +01:00
Mike Fährmann
f5f4122cb6 [chevereto:album] extract 'album_…' metadata (#8604) 2025-12-08 19:02:41 +01:00
Mike Fährmann
826b557f6d [util] support integer values for '…-range' options (#8604) 2025-12-08 10:32:46 +01:00
icelit4
2ab74dfbf1 [hentaifoundry] extract 'categories' metadata (#8656)
* [hentaifoundry] Add support for categories
* rename 'hf_categories' to 'categories'
* move code into '_extract_categories()' method
* update tests

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-12-08 10:15:59 +01:00
Mike Fährmann
9a8746f12d [tiktok] add 'covers' option (#8515) 2025-12-07 20:30:47 +01:00
Mike Fährmann
d2b3eb6adb [chevereto] extract 'album_id' & 'album_slug' metadata (#8604) 2025-12-07 17:41:27 +01:00
Mike Fährmann
d1de48e7b2 remove Message.Version 2025-12-07 17:13:25 +01:00
Mike Fährmann
968597a302 yield 3-tuples for Message.Directory
adapt tuples to the same length and semantics as other messages
2025-12-05 21:39:52 +01:00
Mike Fährmann
d9c1d15aee [job] inline 'dispatch' loop 2025-12-05 11:48:51 +01:00
Mike Fährmann
76765340eb [2ch] support 'org' TLD (#8629) 2025-11-30 16:49:23 +01:00
Mike Fährmann
f51544618e [audiochan] add 'search' extractor (#8602) 2025-11-29 20:01:15 +01:00
Mike Fährmann
9bf52ab8c5 [civitai] implement extracting 'tags' metadata (#8626) 2025-11-29 18:37:57 +01:00
Mike Fährmann
994cc34f75 [audiochan] add initial support (#8602) 2025-11-28 21:46:22 +01:00
Mike Fährmann
e589d6f6ee [pp:exec] add 'verbose' option (#7743) 2025-11-28 19:55:04 +01:00
Mike Fährmann
1dc7955ba2 [simpcity] extract "click to load media" URLs (#8609) 2025-11-26 18:35:58 +01:00
Mike Fährmann
25ac5099cf [simpcity] extract attachment/inline files (#8560) 2025-11-26 18:18:41 +01:00
Octavia Togami
685777e43e [patreon] include full metadata with each URL (#4286 #8498)
* include full metadata object with each url
    Fixes #4286
* rename 'url_metadata' to 'file'
2025-11-20 19:30:13 +01:00
MyFinalBellyache
d74809c538 [eporner] add support (#8581)
* [eporner] Add support
* Line-length <80 chars
* Fix flake8 indentation
* update
    - generalize example URL
    - strip "Photo Gallery" from 'title'
    - extract 'id'
* update supportedsites
* update test results
2025-11-20 18:03:54 +01:00
Mike Fährmann
7b059958c2 [fansly] handle posts without accountId/contentId/attachments (#8572) 2025-11-19 20:46:34 +01:00
Mike Fährmann
e91337d5c3 [Danbooru] add 'media-asset' extractor (#8580) 2025-11-19 20:46:22 +01:00
Mike Fährmann
89be2f45e4 [mangadex] add 'data-saver' option (#8573) 2025-11-19 19:54:53 +01:00
Mike Fährmann
aa39770783 [aryion:search] simplify further
- skip 'build_query()' step
- add underscores to prefixes
2025-11-19 19:54:53 +01:00
MyFinalBellyache
a9687d2928 [pornstarstube] add support (#8576)
* Add support for pornstars.tube
* update
    - adjust pattern/example/page_url
    - extract '' & '' metadata
    - prevent unnecessary request
    - fix result URLs
    - return list comprehension result
* update supportedsites
* update test results
* fix extractor name

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-11-19 16:25:01 +01:00
MyFinalBellyache
cc7003a14c [okporn] add support (#8575)
* Add support for ok.porn
* update
    - adjust pattern/example/page_url
    - prevent unnecessary request
    - extract 'tags'
    - text.extract -> text.extr
    - return list comprehension result
* update supportedsites name
* update test results

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-11-19 15:49:13 +01:00
MyFinalBellyache
157a37b053 [sxypix] add support (#4507 #8391 #8574)
* Add support for sxypix.com
* update & simplify
    - text.extract -> text.extr
    - self.request().json() -> self.request_json()
    - use self.groups
    - remove __init__
    - list comprehension
* update test results

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-11-19 10:30:29 +01:00
vorsatile
991fe0f2a7 [aryion] add 'search' extractor (#8567)
* [aryion] Implement search extractor.
* [aryion] Update capabilities.
* [aryion] Adjust example.
* fix flake8 errors

* update & simplify
    - use existing '_pagination_next()'
    - remove '_pagination_search()'
    - update 'search[…]' metadata
* add tests

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-11-18 20:57:08 +01:00
Mike Fährmann
e60007add6 [xasiat] fix 'IndexError' for albums without category (#8569) 2025-11-18 19:38:30 +01:00
Mike Fährmann
0e0f446368 [rawkuma] update extractors to new site layout (#8568) 2025-11-18 19:38:30 +01:00
SpiffyChatterbox
f6e67116f2 [cfake] add support (#707 #6021 #8549 #8430)
* Create cfake.py
* Update __init__.py
* Create cfake.py tests
* update
    - simplify & combine code
    - adjust 'pattern': use '[^/?#]', match lines and groups
    - generalize example URLs
    - update default filenames
* update docs/supportedsites
* update test results

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-11-15 20:55:00 +01:00