Commit Graph

6958 Commits

Author SHA1 Message Date
Mike Fährmann
64f6547aef [scripts/run_tests] use 'TestResult.wasSuccessful()' 2025-07-29 16:52:26 +02:00
Mike Fährmann
1f08f81e67 [scripts/pyprint] fix typo in list generation 2025-07-28 21:50:28 +02:00
Mike Fährmann
876df379f4 [scripts/init] add '-C' command-line option 2025-07-28 21:50:28 +02:00
Mike Fährmann
0a7546201c [scripts/pre-commit] detect debug 'elif' statements 2025-07-28 18:49:08 +02:00
Mike Fährmann
7faa46b90f [misskey] support 'misskey.art' (#7923) 2025-07-28 16:39:43 +02:00
Mike Fährmann
74573118f2 [dankefuerslesen:manga] fix metadata being overwritten 2025-07-28 15:36:32 +02:00
Mike Fährmann
b986edd1ed [dankefuerslesen] extract more metadata (#7915)
- author
- artist
- description
2025-07-28 10:43:13 +02:00
Mike Fährmann
15517ad45c release version 1.30.2 2025-07-27 19:57:22 +02:00
Mike Fährmann
013307af80 [itaku] add 'bookmarks' extractor (#7707) 2025-07-27 19:35:56 +02:00
Mike Fährmann
022f216217 [itaku] add 'posts' extractors (#7707) 2025-07-27 19:30:44 +02:00
Mike Fährmann
be975b7be1 [itaku] update 'items()' to be able to handle all result types 2025-07-27 16:34:04 +02:00
Mike Fährmann
b8fb9c061e [itaku] update API methods 2025-07-27 16:12:39 +02:00
CautiouslyKate
ed2d07181a [kemono] update extractor to use new domains (#7902 #7907 #7904)
* Update kemono.py
* Update coomer.py
* Update kemono.py
* Fixed TypeError
    - Fixed a regex mistake I made
* Make legacy domains resolve as current domains
* Update gallery_dl/extractor/kemono.py
* remove legacy .su domain support
* fixed accidental regex change
* update docs/supportedsites
* update test results
    - (re)add legacy domain URLs
    - update URL pattern TLDs
* restore support for '.su' TLDs

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-07-27 10:10:35 +02:00
cenodis
8b6fffe866 [pp:exec] use 'False' as default for 'start_new_session' to avoid TypeError (#7899)
in Python <= 3.11

* Use False as default instead of None to avoid TypeError
* Update postprocessor tests
2025-07-27 09:41:27 +02:00
Mike Fährmann
c3d385bce0 [scripts/pyprint] support datetime objects 2025-07-27 09:37:46 +02:00
Mike Fährmann
07af386700 [scripts/pyprint] support sets 2025-07-27 09:37:46 +02:00
Mike Fährmann
14c29fe3e0 [scripts/pyprint] restructure dict/list handling 2025-07-27 09:37:46 +02:00
Mike Fährmann
11127726e4 [scripts/pyprint] update maxlen selection
- consider only values smaller than 'lmax' instead of taking the max of
  all lengths and trimming that
- remove 'lmin'
2025-07-27 09:37:45 +02:00
Mike Fährmann
9872a9eae3 [tests/postprocessor] fix 'TypeError' when logging an error (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3121493719
2025-07-27 09:37:06 +02:00
Mike Fährmann
31de2e8299 release version 1.30.1 2025-07-26 09:52:41 +02:00
Mike Fährmann
f627717f21 [tests/results] StopExtraction -> AbortExtraction
and update some test results
2025-07-26 08:40:20 +02:00
Mike Fährmann
8e33d0b985 [pixiv] improve AJAX error handling (#7896) 2025-07-26 07:33:58 +02:00
Mike Fährmann
4138ac06e2 [scripts/pyprint] fix indentation 2025-07-25 23:43:08 +02:00
Mike Fährmann
aa885d8d7c [tests/resulta] add 'pixiv' extended user metadata test 2025-07-25 23:17:15 +02:00
Mike Fährmann
cec712ab04 [tests/results] add 'itaku' following/-ers tests 2025-07-25 23:15:58 +02:00
Mike Fährmann
2732458758 [itaku] add 'following' & 'followers' extractors (#7707) 2025-07-25 20:20:13 +02:00
Mike Fährmann
98f36fb0ac [itaku] implement 'include' option (#7707) 2025-07-25 19:24:56 +02:00
Mike Fährmann
d99b2ab47a [imgadult] add 'image' extractor (#7893) 2025-07-25 18:58:29 +02:00
Mike Fährmann
3eb0b28d6d [facebook] implement 'include' option & add 'avatar' extractor (#7848)
rename 'profile' extractor to 'photos'
2025-07-25 18:20:05 +02:00
Mike Fährmann
ef4f09fab1 [patreon] support 'date-max' for '/home' URLs (#7856) 2025-07-25 00:22:55 +02:00
Mike Fährmann
da44d83438 [patreon] implement 'cursor' support (#7856) 2025-07-24 23:08:58 +02:00
Mike Fährmann
2c85f4a32d [civitai] change default includes to 'user-images,user-videos' (#7874)
less metadata by default, but grabs *all* user files
2025-07-24 18:10:45 +02:00
Mike Fährmann
0440d4128a [bilibili] simplify user articles extractors 2025-07-24 17:46:37 +02:00
Mike Fährmann
20af1e2508 [bilibili] warn about blocked articles (#7880) 2025-07-24 16:24:04 +02:00
Mike Fährmann
cefdde65ba [readcomiconline] use 'text.re()' 2025-07-24 15:58:21 +02:00
Mike Fährmann
aae85fef61 [readcomiconline] force 'One page' Reading mode (#7890) 2025-07-24 15:53:39 +02:00
Mike Fährmann
aa6c2dcbac [behance] provide 'creator[name]' metadata (#7885) 2025-07-24 15:30:51 +02:00
Mike Fährmann
849a5b191f [behance] use '"browser": "firefox"' by default (#7803 #7877) 2025-07-24 09:31:12 +02:00
Mike Fährmann
28205f47b0 [tests/results] fix '#log' checks for URLs raising exceptions 2025-07-24 09:18:58 +02:00
Mike Fährmann
f39c8b125f [4chan] detect files containing only null bytes (#7883) 2025-07-24 09:11:52 +02:00
Mike Fährmann
b2a354f0d2 [urlgalleries] do not strip query parameters (#7888)
fixes regression introduced in fc06243b89
2025-07-24 08:46:59 +02:00
Farahat
cf2e5a1619 [leakgallery] add support (#7872)
* add new extractor for leakgallery.com

    Added support for downloading photo and video posts from leakgallery.com.

    Supports:
    * Individual post URLs
    * User profile URLs with pagination via AJAX
    * Optional type/sort filters (e.g. /Photos/MostRecent)
    * Proper file extension handling
    * Creator-based folder structure
    * Compatibility with --download-archive

    Tested locally and functional, but may still need review or improvement.
    
* [leakgallery] add support
    Added leakgallery to extractor module imports so it's recognized and used.
* [leakgallery] update extractor structure
    - Refactored using LeakGalleryExtractorBase to remove duplication
    - Moved init logic into items() using self.groups
    - Replaced re with text.re as per upstream guidance
    - Added creator fallback and media deduplication
    - Aligned structure with gallery-dl maintainer review tips
* [leakgallery] add support
    - Added leakgallery entry to supportedsites.md
    - Includes post, user, trending, and most-liked subcategories
* add exported extractor results
* [leakgallery] fix flake8 style issues
    Cleaned up code to comply with flake8 rules, especially:
    - removed unused imports
    - split long lines >79 chars
    - ensured newline at EOF
    No functional changes made; purely formatting to satisfy CI checks.
* [tests] update extractor results
* [leakgallery] fix flake8 style issues (part 2)
    Fix remaining flake8 issues in leakgallery.py:
    - Reformat line breaks to avoid W503 (line break before binary operator)
    - Wrap long lines to respect E501 (line too long > 79 characters)
    - Cleaned up exception logging for better clarity
    - Confirmed all flake8 checks now pass successfully
    This superseedes the previous commit which partially fixed formatting violations.
* [leakgallery] fix flake8 style issues (part 3)
* [leakgallery] rename extractor classes
* [tests] update extractor results
* [tests] rename extractor results
* [leakgallery] rename extractor classes (part 2)
* [leakgallery] rename example
* update docs/supportedsites
* update test results
    and convert line endings to '\n'
* update
    - convert line endings to '\n'
    - use _pagination method
    - fix logging calls
* return more metadata for _pagination() results
2025-07-22 22:50:25 +02:00
Mike Fährmann
158ba1b95a [docs/configuration] update
- add Jinja options (#1390)
- add and use custom 'Module' type
- improve 'Path' description
2025-07-22 20:57:54 +02:00
Mike Fährmann
a097a373a9 simplify if statements by using walrus operators (#7671) 2025-07-22 20:57:54 +02:00
Mike Fährmann
e8b2a496ba [scripts] ensure files use 'utf-8' encoding and '\n' newlines (#7872) 2025-07-22 20:57:54 +02:00
Mike Fährmann
afc5b9c9c6 [tests/extractor] improve example URL mismatch error message (#7872) 2025-07-22 20:57:54 +02:00
Mike Fährmann
05cba49062 [options] add '--sleep-429' command-line option (#7871) 2025-07-22 20:57:54 +02:00
Mike Fährmann
a08f4aa1c0 [nhentai] provide 'gallery_id' for pagination results (#7868) 2025-07-22 20:57:54 +02:00
Mike Fährmann
ea61f432f2 [formatter/jinja] add support for options (#1390)
- custom filters
- custom tests
- policies
- Environment.__init__() arguments
2025-07-22 20:57:54 +02:00
Mike Fährmann
f0de034889 [exception] rename 'LoginRequired' to 'AuthRequired' 2025-07-22 20:57:54 +02:00