github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7,134 Commits 1 Branch 0 Tags
de05453707f11699f38bd4ab55bbd5dcbe28d414
Commit Graph

851 Commits

Author SHA1 Message Date
Mike Fährmann
de05453707 [reddit] add 'limit' option (#7997 #8012 #8092) 
change default value from 100 to null,
i.e. don't send a 'limit' parameter
 2025-08-29 10:02:37 +02:00
Mike Fährmann
2eca790c87 [reddit] add 'api' option (#7997 #8012 #8092) 2025-08-28 22:52:57 +02:00
Mike Fährmann
a953d3d316 [erome] handle reposts on user profiles (#6582) 
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3221322147

- add 'reposts' option
- disable reposts by default
- process URL query parameters, e.g. 't=posts' or 'page=3'
 2025-08-26 11:26:52 +02:00
Mike Fährmann
ed3ac5a402 [sizebooru] add support (#7667) 2025-08-24 10:39:17 +02:00
Mike Fährmann
a41e3c90f4 [civitai:search] add 'token' option (#8093) 2025-08-22 17:21:00 +02:00
Mike Fährmann
0837bc2b70 [gelbooru] update 'api-key' & 'user-id' docs to match 'gelbooru_v02' 2025-08-22 17:06:19 +02:00
Mike Fährmann
926fea5ac8 [docs/configuration] add note to 'deviantart.avatar.formats' (#8044) 2025-08-21 19:11:27 +02:00
Mike Fährmann
78f78fe64b [gelbooru_v02] support using 'api-key' & 'user-id' (#8077) 
- detect API error messages
- add default 1.0s request delay to 'rule34'
 2025-08-20 22:48:20 +02:00
Mike Fährmann
47150f3e8a [twitter] add 'highlights' extractor (#7826) 2025-08-19 09:14:39 +02:00
Mike Fährmann
682e29a535 [path] implement 'path-convert' option (#493 #6582) 2025-08-14 19:33:24 +02:00
Mike Fährmann
b4a897aede [skeb] rename 'sent-requests' subcategory to 'sentrequests' (#8036) 
to avoid clashes with 'sent-requests' option
 2025-08-14 17:40:20 +02:00
Mike Fährmann
42582af4f1 [kemono] support '"endpoint": "posts+"' for full metadata (#8028) 
alias for "legacy+"
 2025-08-14 12:13:12 +02:00
Mike Fährmann
ab54f71511 [skeb] implement 'include' option (#6558 #7267) 
- split 'user' extractor into 'works' & 'sent-requests' extractors
- use BASE_PATTERN & USER_PATTERN
- use self.groups
 2025-08-12 22:11:03 +02:00
Mike Fährmann
e491d56dc3 [idolcomplex] update to new domain and interface (#7559 #8009) 2025-08-11 22:24:04 +02:00
Mike Fährmann
e92538624e [civitai] add 'user-collections' extractor (#8005) 2025-08-10 21:33:23 +02:00
Mike Fährmann
0d2b8f53cc [facebook] add 'info' extractor (#6582) 
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3151899420

Currently relies on the profile having a /photos_by page.
 2025-08-09 18:49:53 +02:00
Mike Fährmann
2192a2c360 [facebook] add initial 'albums' extractor (#7848) 
needs GraphQL API to fetch more than the latest 8
 2025-08-08 21:22:41 +02:00
Mike Fährmann
16acfbd1e7 [common] implement '"user-agent": "@BROWSER"' (#7947) 
support automatically fetching the 'User-Agent' header
of a specific installed browser, e.g. "@firefox"
 2025-08-07 20:58:29 +02:00
Mike Fährmann
c7fe6ba691 [vsco] disable TLS 1.2 cipher suites by default (#7984 #7986) 2025-08-07 20:58:29 +02:00
Mike Fährmann
efd7821075 merge #7952: [hentaifoundry] add 'descriptions' option 2025-08-02 17:30:38 +02:00
Mike Fährmann
afa720d3e0 [hentaifoundry] add 'html' description test case 2025-08-02 17:29:07 +02:00
Mike Fährmann
9eb88905bc [comick] add 'lang' option (#7938) 2025-08-01 23:28:09 +02:00
sarma-tyrant
12f56b888c Added to docs 2025-08-01 16:36:20 -04:00
Mike Fährmann
df4f823f6e [booth] add 'strategy' option (#7920) 
- extract file URLs from HTML webpages
- fix 'adult' cookie value
 2025-08-01 21:21:41 +02:00
Mike Fährmann
2eb5e52055 extend '-A / --abort' & '"skip": "abort"' functionality (#7891) 
implement ascending by more than 1 level or
up to an extractor with a specific subcategory
 2025-07-30 00:01:49 +02:00
Mike Fährmann
78f81ee48a [booth] add 'shop' extractor (#7920) 2025-07-29 16:52:27 +02:00
Mike Fährmann
3c4459c0a0 [docs/configuration] improve 'client-id' / 'api-key' instructions 
- better align description format
- make http://localhost:6414/ clickable (#7905)
 2025-07-29 16:52:26 +02:00
Mike Fährmann
022f216217 [itaku] add 'posts' extractors (#7707) 2025-07-27 19:30:44 +02:00
Mike Fährmann
2732458758 [itaku] add 'following' & 'followers' extractors (#7707) 2025-07-25 20:20:13 +02:00
Mike Fährmann
98f36fb0ac [itaku] implement 'include' option (#7707) 2025-07-25 19:24:56 +02:00
Mike Fährmann
3eb0b28d6d [facebook] implement 'include' option & add 'avatar' extractor (#7848) 
rename 'profile' extractor to 'photos'
 2025-07-25 18:20:05 +02:00
Mike Fährmann
ef4f09fab1 [patreon] support 'date-max' for '/home' URLs (#7856) 2025-07-25 00:22:55 +02:00
Mike Fährmann
da44d83438 [patreon] implement 'cursor' support (#7856) 2025-07-24 23:08:58 +02:00
Mike Fährmann
2c85f4a32d [civitai] change default includes to 'user-images,user-videos' (#7874) 
less metadata by default, but grabs *all* user files
 2025-07-24 18:10:45 +02:00
Mike Fährmann
849a5b191f [behance] use '"browser": "firefox"' by default (#7803 #7877) 2025-07-24 09:31:12 +02:00
Mike Fährmann
158ba1b95a [docs/configuration] update 
- add Jinja options (#1390)
- add and use custom 'Module' type
- improve 'Path' description
 2025-07-22 20:57:54 +02:00
Mike Fährmann
9bbfb09952 [pp:exec] add 'session' option (#6582) 
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3067297033
 2025-07-20 19:55:33 +02:00
Mike Fährmann
008a08ca43 [ytdl] add 'deprecations' option 
https://github.com/gdl-org/builds/issues/3
 2025-07-20 19:55:24 +02:00
Mike Fährmann
1561284815 [madokami] add 'manga' extractor (#7828) 2025-07-17 20:40:26 +02:00
Mike Fährmann
bccf467d19 [actions] allow using actions as 'signals-actions' target 2025-07-14 22:58:02 +02:00
Mike Fährmann
bbe7faed21 [iwara] update 
- add 'include' docs
- simplify code for different result types
- provide 'count' and 'num' metadata
- remove 'search_type' metadata
 2025-07-14 18:47:14 +02:00
NecRaul
a7ebb835ea [iwara] Add support (#2652 #5840 #7785) 
* [iwara] Add initial support
* [iwara] Add search support
* [iwara] Code cleanup
* [iwara] Small fixes and additions
* [iwara] Add tag support
* [iwara] Add mime-type to metadata
* [iwara] Refactor patterns/matching using urllib
* [iwara] Add unit tests
* [iwara] Update docs
* [iwara] Fix linting on older Python versions
* [iwara] update 'IwaraAPI' interface class
    - define endpoints inside methods
    - implement and use _call() and _pagination()
    - cache auth tokens
* [iwara] split and rename 'profile' extractor
    TODO:
    - update test results
    - simplify code
* [iwara] simplify '_user_params()' usage
* [iwara] update 'video' extractor
    and move user data extraction into 'yield_video'
* [iwara] update 'image' extractor
    and move user info extraction into 'yield_image()'
* [iwara] update 'playlist' extractor
* [iwara] update 'search' extractor
* [iwara] update 'tag' extractor
* [iwara] simplify 'yield_image' usage
    perform API calls to get full 'files' list inside the function
* [iwara] add video "image" test
* [iwara] provide 'date' metadata
* [iwara] simplify 'source()'
    remove urllib.parse usage
* [iwara] small optimizations
    * get("key", {}) -> get("key") or {}
    * split("…", 1) -> partition("…")
    * use f-strings for all patterns
* [iwara] add missing 'keyarg=1' to profile() memcache decorator
* [tests/iwara] update results
* [iwara] extract more 'user' metadata
* [iwara] update default format strings
    include 'date' in filenames to order them chronologically
* [iwara] restructure image/video handling
    - use less generators
    - make processing individual media items non-fatal
* [iwara] fix login and token handling
* [iwara] add 'favorite' extractor
* [iwara] add 'following' and 'followers' extractors

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-07-13 21:30:25 +02:00
Mike Fährmann
fc968ebf20 [artstation] support downloading '.mview' files (#7812) 2025-07-12 20:53:16 +02:00
Mike Fährmann
267661680c add 'pixiv-novel' compat categories (#7746) 2025-07-11 11:00:19 +02:00
Mike Fährmann
a619638178 [mangadex] allow 'ratings' to be a (comma-separated) string (#7799) 2025-07-10 16:46:18 +02:00
Mike Fährmann
ad84e72fda [civitai] implement retrieving 'post' metadata (#7548) 2025-07-07 11:48:21 +02:00
Mike Fährmann
05b0a25120 [common] update 'browser' user-agents and headers 
support Firefox 140 ESR and Chrome/Chromium 138
 2025-07-06 19:41:37 +02:00
Mike Fährmann
82891b4d0c [pixiv] move 'novel' extractors to a 'pixiv-novel' category (#7746) 
TODO:
- restore full 'include' functionality
- allow remapping category:subcategory pairs
 2025-07-04 20:13:19 +02:00
Mike Fährmann
e7922ababd [naver] change categories (#7746) 
- 'naver'        -> 'naver-blog'
- 'chzzk'        -> 'naver-chzzk'
- 'naverwebtoon' -> 'naver-webtoon'
 2025-07-02 23:20:40 +02:00
Mike Fährmann
b102c474c1 [bunkr] fix file downloads (#7747) 
update 'root_dl', 'root_api', and default 'endpoint'
 2025-06-29 17:53:13 +02:00