Commit Graph

1586 Commits

Author SHA1 Message Date
Mike Fährmann
e599e3f0d6 [civitai] add 'videos' extractor (#6644) 2025-08-16 11:08:37 +02:00
Mike Fährmann
682e29a535 [path] implement 'path-convert' option (#493 #6582) 2025-08-14 19:33:24 +02:00
Mike Fährmann
b4a897aede [skeb] rename 'sent-requests' subcategory to 'sentrequests' (#8036)
to avoid clashes with 'sent-requests' option
2025-08-14 17:40:20 +02:00
Mike Fährmann
08a399d9d0 [docs/supportedsites] fix subcategories for imgtaxi/imgwallet 2025-08-14 12:17:11 +02:00
Mike Fährmann
42582af4f1 [kemono] support '"endpoint": "posts+"' for full metadata (#8028)
alias for "legacy+"
2025-08-14 12:13:12 +02:00
Mike Fährmann
8fbb6d29d8 [docs/formatting] update / improve
- add table of contents
- use more links
- reword & reformat general description text
- use HTML entities for double curly braces
  to prevent Jekyll from interpreting them as template expressions
2025-08-13 20:53:31 +02:00
Mike Fährmann
5cb90f685d [docs/supportedsites] add categories as 'id' & 'title' attributes 2025-08-13 18:00:58 +02:00
Mike Fährmann
16d37fcefc [docs/supportedsites] list 'imagehost' sites in separate table 2025-08-13 16:50:11 +02:00
Mike Fährmann
bbdf584919 [imgwallet] add 'image' extractor (#8021) 2025-08-13 11:58:54 +02:00
Mike Fährmann
8581b3f7c5 [silverpic] add 'image' extractor (#8020) 2025-08-13 09:16:03 +02:00
Mike Fährmann
c6f8a99c75 [imgtaxi] add 'image' extractor (#8019) 2025-08-13 08:50:42 +02:00
Mike Fährmann
ca22cb1487 [tumblr] add 'following' & 'followers' extractors (#8018) 2025-08-12 22:11:10 +02:00
Mike Fährmann
ab54f71511 [skeb] implement 'include' option (#6558 #7267)
- split 'user' extractor into 'works' & 'sent-requests' extractors
- use BASE_PATTERN & USER_PATTERN
- use self.groups
2025-08-12 22:11:03 +02:00
Mike Fährmann
e491d56dc3 [idolcomplex] update to new domain and interface (#7559 #8009) 2025-08-11 22:24:04 +02:00
Mike Fährmann
e92538624e [civitai] add 'user-collections' extractor (#8005) 2025-08-10 21:33:23 +02:00
Mike Fährmann
2b03843092 [civitai] add 'collection' extractor (#8005) 2025-08-10 21:33:23 +02:00
Mike Fährmann
0d2b8f53cc [facebook] add 'info' extractor (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3151899420

Currently relies on the profile having a /photos_by page.
2025-08-09 18:49:53 +02:00
Mike Fährmann
2192a2c360 [facebook] add initial 'albums' extractor (#7848)
needs GraphQL API to fetch more than the latest 8
2025-08-08 21:22:41 +02:00
Mike Fährmann
16acfbd1e7 [common] implement '"user-agent": "@BROWSER"' (#7947)
support automatically fetching the 'User-Agent' header
of a specific installed browser, e.g. "@firefox"
2025-08-07 20:58:29 +02:00
Mike Fährmann
c7fe6ba691 [vsco] disable TLS 1.2 cipher suites by default (#7984 #7986) 2025-08-07 20:58:29 +02:00
Mike Fährmann
ef8044f546 [imgdrive] add 'image' extractor (#7976) 2025-08-05 19:50:06 +02:00
Mike Fährmann
efd7821075 merge #7952: [hentaifoundry] add 'descriptions' option 2025-08-02 17:30:38 +02:00
Mike Fährmann
afa720d3e0 [hentaifoundry] add 'html' description test case 2025-08-02 17:29:07 +02:00
Mike Fährmann
8a97a1dad0 [docs/options] update '-A' & '-T' descriptions
2eb5e52055
2025-08-01 23:31:14 +02:00
Mike Fährmann
9eb88905bc [comick] add 'lang' option (#7938) 2025-08-01 23:28:09 +02:00
sarma-tyrant
12f56b888c Added to docs 2025-08-01 16:36:20 -04:00
Mike Fährmann
df4f823f6e [booth] add 'strategy' option (#7920)
- extract file URLs from HTML webpages
- fix 'adult' cookie value
2025-08-01 21:21:41 +02:00
Marcus Minhorst
65fbd3972d [picstate] add 'image' extractor (#7946) 2025-08-01 07:48:00 +02:00
missionfloyd
952fcb1b8b [xasiat] add support (#4161 #5929 #7934)
* [xasiat] Album extractor
* [xasiat] Tags, categories, Models
* [xasiat] Tests
* update 'album' extractor
    - provide 'album_id' metadata
    - use redirected 'album_url' value
    - update metadata extraction in general
* extend test result data
2025-07-30 19:38:33 +02:00
Mike Fährmann
2eb5e52055 extend '-A / --abort' & '"skip": "abort"' functionality (#7891)
implement ascending by more than 1 level or
up to an extractor with a specific subcategory
2025-07-30 00:01:49 +02:00
Mike Fährmann
78f81ee48a [booth] add 'shop' extractor (#7920) 2025-07-29 16:52:27 +02:00
Mike Fährmann
8aa2fe33d5 [booth] add 'item' extractor (#7920) 2025-07-29 16:52:27 +02:00
Mike Fährmann
3c4459c0a0 [docs/configuration] improve 'client-id' / 'api-key' instructions
- better align description format
- make http://localhost:6414/ clickable (#7905)
2025-07-29 16:52:26 +02:00
Mike Fährmann
7faa46b90f [misskey] support 'misskey.art' (#7923) 2025-07-28 16:39:43 +02:00
Mike Fährmann
013307af80 [itaku] add 'bookmarks' extractor (#7707) 2025-07-27 19:35:56 +02:00
Mike Fährmann
022f216217 [itaku] add 'posts' extractors (#7707) 2025-07-27 19:30:44 +02:00
CautiouslyKate
ed2d07181a [kemono] update extractor to use new domains (#7902 #7907 #7904)
* Update kemono.py
* Update coomer.py
* Update kemono.py
* Fixed TypeError
    - Fixed a regex mistake I made
* Make legacy domains resolve as current domains
* Update gallery_dl/extractor/kemono.py
* remove legacy .su domain support
* fixed accidental regex change
* update docs/supportedsites
* update test results
    - (re)add legacy domain URLs
    - update URL pattern TLDs
* restore support for '.su' TLDs

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2025-07-27 10:10:35 +02:00
Mike Fährmann
2732458758 [itaku] add 'following' & 'followers' extractors (#7707) 2025-07-25 20:20:13 +02:00
Mike Fährmann
98f36fb0ac [itaku] implement 'include' option (#7707) 2025-07-25 19:24:56 +02:00
Mike Fährmann
d99b2ab47a [imgadult] add 'image' extractor (#7893) 2025-07-25 18:58:29 +02:00
Mike Fährmann
3eb0b28d6d [facebook] implement 'include' option & add 'avatar' extractor (#7848)
rename 'profile' extractor to 'photos'
2025-07-25 18:20:05 +02:00
Mike Fährmann
ef4f09fab1 [patreon] support 'date-max' for '/home' URLs (#7856) 2025-07-25 00:22:55 +02:00
Mike Fährmann
da44d83438 [patreon] implement 'cursor' support (#7856) 2025-07-24 23:08:58 +02:00
Mike Fährmann
2c85f4a32d [civitai] change default includes to 'user-images,user-videos' (#7874)
less metadata by default, but grabs *all* user files
2025-07-24 18:10:45 +02:00
Mike Fährmann
849a5b191f [behance] use '"browser": "firefox"' by default (#7803 #7877) 2025-07-24 09:31:12 +02:00
Farahat
cf2e5a1619 [leakgallery] add support (#7872)
* add new extractor for leakgallery.com

    Added support for downloading photo and video posts from leakgallery.com.

    Supports:
    * Individual post URLs
    * User profile URLs with pagination via AJAX
    * Optional type/sort filters (e.g. /Photos/MostRecent)
    * Proper file extension handling
    * Creator-based folder structure
    * Compatibility with --download-archive

    Tested locally and functional, but may still need review or improvement.
    
* [leakgallery] add support
    Added leakgallery to extractor module imports so it's recognized and used.
* [leakgallery] update extractor structure
    - Refactored using LeakGalleryExtractorBase to remove duplication
    - Moved init logic into items() using self.groups
    - Replaced re with text.re as per upstream guidance
    - Added creator fallback and media deduplication
    - Aligned structure with gallery-dl maintainer review tips
* [leakgallery] add support
    - Added leakgallery entry to supportedsites.md
    - Includes post, user, trending, and most-liked subcategories
* add exported extractor results
* [leakgallery] fix flake8 style issues
    Cleaned up code to comply with flake8 rules, especially:
    - removed unused imports
    - split long lines >79 chars
    - ensured newline at EOF
    No functional changes made; purely formatting to satisfy CI checks.
* [tests] update extractor results
* [leakgallery] fix flake8 style issues (part 2)
    Fix remaining flake8 issues in leakgallery.py:
    - Reformat line breaks to avoid W503 (line break before binary operator)
    - Wrap long lines to respect E501 (line too long > 79 characters)
    - Cleaned up exception logging for better clarity
    - Confirmed all flake8 checks now pass successfully
    This superseedes the previous commit which partially fixed formatting violations.
* [leakgallery] fix flake8 style issues (part 3)
* [leakgallery] rename extractor classes
* [tests] update extractor results
* [tests] rename extractor results
* [leakgallery] rename extractor classes (part 2)
* [leakgallery] rename example
* update docs/supportedsites
* update test results
    and convert line endings to '\n'
* update
    - convert line endings to '\n'
    - use _pagination method
    - fix logging calls
* return more metadata for _pagination() results
2025-07-22 22:50:25 +02:00
Mike Fährmann
158ba1b95a [docs/configuration] update
- add Jinja options (#1390)
- add and use custom 'Module' type
- improve 'Path' description
2025-07-22 20:57:54 +02:00
Mike Fährmann
05cba49062 [options] add '--sleep-429' command-line option (#7871) 2025-07-22 20:57:54 +02:00
Mike Fährmann
9bbfb09952 [pp:exec] add 'session' option (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3067297033
2025-07-20 19:55:33 +02:00
Mike Fährmann
008a08ca43 [ytdl] add 'deprecations' option
https://github.com/gdl-org/builds/issues/3
2025-07-20 19:55:24 +02:00