github/gallery-dl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
7,504 Commits 1 Branch 0 Tags
da46d4fc87f19784d835e5fda35db641b9e33ca8
Commit Graph

7504 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mike Fährmann
da46d4fc87 [output] defer creation of 'unsupported' files by default (#8622) 
https://github.com/mikf/gallery-dl/pull/8622#issuecomment-3618151200
 2025-12-07 17:13:44 +01:00
Mike Fährmann
2944cd4b74 [oauth] inline/remove top-level imports 2025-12-07 17:13:44 +01:00
Mike Fährmann
d1de48e7b2 remove Message.Version 2025-12-07 17:13:25 +01:00
Mike Fährmann
968597a302 yield 3-tuples for Message.Directory 
adapt tuples to the same length and semantics as other messages
 2025-12-05 21:39:52 +01:00
Mike Fährmann
80878c1501 [twitter] support '"search-results": "media"' results (#8613 #8635) 
https://github.com/mikf/gallery-dl/issues/8635#issuecomment-3615267040
 2025-12-05 17:49:39 +01:00
Mike Fährmann
5da200945b implement 'post-filter' & 'post-range' options 
(#8643)
 2025-12-05 16:40:23 +01:00
Mike Fährmann
d9c1d15aee [job] inline 'dispatch' loop 2025-12-05 11:48:51 +01:00
Mike Fährmann
402f53616b [dl:ytdl] implement 'retry' functionality (#1131 #8269) 
for 'info_dict' extraction and file download
 2025-12-04 20:43:10 +01:00
Mike Fährmann
1f6577240d [dl:ytdl] update '_extract_manifest()' 
- use 'kwdict' as single argument
- fix '_parse_m3u8_formats_and_subtitles' arguments
 2025-12-04 19:13:28 +01:00
Mike Fährmann
b2e377b650 [twitter] fix TypeError when '_user_obj' is None (#8648) 
fixes regression introduced in 406a74cfaa
 2025-12-04 18:51:11 +01:00
Mike Fährmann
8f91daa9bc [dl:ytdl] improve error message when importing default ytdl modules 2025-12-04 18:28:09 +01:00
Mike Fährmann
918b06caf4 [dl:ytdl] restructure code 2025-12-04 18:14:27 +01:00
Mike Fährmann
4a4c1a1154 [fanbox] yield data for inaccessible posts (#8643) 2025-12-03 20:32:54 +01:00
Mike Fährmann
4e2987e007 [path] implement conditional 'part-directory' (#8329) 2025-12-03 11:19:44 +01:00
Mike Fährmann
c6b2041c43 [twitter] fix 'AttributeError' for "search-pagination": "max_id" (#8613) 
when using it with the regular 'Search' extractor

https://github.com/mikf/gallery-dl/issues/8613#issuecomment-3603946848
 2025-12-02 22:37:57 +01:00
Mike Fährmann
d15b3d4eae [twitter] add 'limit' option (#8173) 
- reduce default number of requested items to 50
- allow using "fallback" values like with 'search-limit'

https://github.com/mikf/gallery-dl/issues/8173#issuecomment-3303015837
 2025-12-02 22:34:53 +01:00
Mike Fährmann
0ebb74dfeb [twitter] implement using multiple values for 'search-limit' (#8173) 
https://github.com/mikf/gallery-dl/issues/8173#issuecomment-3302713173
 2025-12-02 19:51:59 +01:00
Mike Fährmann
406a74cfaa [twitter] update/fix 'pinned' Tweet extraction (#8500) 
- handle pins from 'pinned_tweet_ids_str'
- provide 'pinned' metadata
 2025-12-02 11:44:04 +01:00
Mike Fährmann
ab55399b20 [discord] limit length of default filenames (#6582) 
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3593460556
 2025-12-01 19:54:50 +01:00
Mike Fährmann
f1aa3af119 [vsco] use '"browser": "firefox"' by default (#8127) 
and re-enable TLS 1.2 cipher suites
i.e. revert c7fe6ba691
 2025-12-01 16:41:11 +01:00
Mike Fährmann
cff04f1181 [dl:http] implement '_http_segmented' (#8602) 2025-11-30 19:23:10 +01:00
Mike Fährmann
5f38d8ab25 [twitter] increase 'retries-api' default to '9' (#8317) 2025-11-30 16:52:26 +01:00
Mike Fährmann
76765340eb [2ch] support 'org' TLD (#8629) 2025-11-30 16:49:23 +01:00
Mike Fährmann
f51544618e [audiochan] add 'search' extractor (#8602) 2025-11-29 20:01:15 +01:00
Mike Fährmann
9bf52ab8c5 [civitai] implement extracting 'tags' metadata (#8626) 2025-11-29 18:37:57 +01:00
Mike Fährmann
5c7a27e003 [schalenetwork] fix 'tags' categories (#8625) 2025-11-29 09:29:21 +01:00
Mike Fährmann
994cc34f75 [audiochan] add initial support (#8602) 2025-11-28 21:46:22 +01:00
Mike Fährmann
e589d6f6ee [pp:exec] add 'verbose' option (#7743) 2025-11-28 19:55:04 +01:00
Mike Fährmann
bb16e036e4 [twitter] reset 'api_tries' after successful API call (#8317) 2025-11-28 16:48:59 +01:00
Mike Fährmann
5e3284f0e6 [actions] add 'LoggerAdapter.traceback()' method (#8317) 
8c62be343e
 2025-11-28 14:15:20 +01:00
spicybiguy
11151033f6 [motherless] fix 'gallery_title' extraction (#8605) 
* Update motherless.py for title selector

Updated the selector for the title property for Motherless galleries to be an h2 instead of an h1 to reflect changes on the site

* fix 'gallery_title' extraction

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-11-28 10:53:16 +01:00
Mike Fährmann
acf281a46a [twitter] implement 'retries-api' option (#8317) 
retry API requests when encountering server-related errors
 2025-11-27 19:23:27 +01:00
Mike Fährmann
1e7f4ee178 [output] add 'defer' option for logging files (#8523) 
- defer file creation of error files by default
- implement custom FileHandler class
  to support deferred directory creation
 2025-11-27 19:23:04 +01:00
Mike Fährmann
0b05254055 [bunkr] detect when album is deleted mid-download (#8619) 2025-11-27 11:39:32 +01:00
Mike Fährmann
b3aefd4a99 [twitter] restore better user NotFoundError messages (#8621) 
fixes regression introduced in 5747dbf00c
 2025-11-27 11:39:32 +01:00
Mike Fährmann
36fa543715 [twitter] add 'search-results' option (#8613) 2025-11-27 11:31:07 +01:00
Mike Fährmann
1dc7955ba2 [simpcity] extract "click to load media" URLs (#8609) 2025-11-26 18:35:58 +01:00
Mike Fährmann
25ac5099cf [simpcity] extract attachment/inline files (#8560) 2025-11-26 18:18:41 +01:00
Mike Fährmann
aac1d8f36d [simpcity] fix 'content' for first post of a thread 2025-11-24 20:59:15 +01:00
Mike Fährmann
60b3f66950 [belazon] fix starting from a specific page 
with the default '"order-posts": "desc"'
 2025-11-23 18:12:10 +01:00
Mike Fährmann
8ae4c553d2 [simpcity] fix starting from a specific page (#8599) 
with the default '"order-posts": "desc"'
 2025-11-23 18:08:32 +01:00
Mike Fährmann
f06772e56e [tiktok] ignore empty 'music' entries (#8571) 2025-11-21 20:06:55 +01:00
Octavia Togami
685777e43e [patreon] include full metadata with each URL (#4286 #8498) 
* include full metadata object with each url
    Fixes #4286
* rename 'url_metadata' to 'file'
 2025-11-20 19:30:13 +01:00
MyFinalBellyache
d74809c538 [eporner] add support (#8581) 
* [eporner] Add support
* Line-length <80 chars
* Fix flake8 indentation
* update
    - generalize example URL
    - strip "Photo Gallery" from 'title'
    - extract 'id'
* update supportedsites
* update test results
 2025-11-20 18:03:54 +01:00
MyFinalBellyache
2bff6828e1 [scripts/init] Fix error running with default values (#8583) 
Fixes:
```sh
python scripts/init.py newsite https://newsite.com
# [INFO] gallery_dl/extractor/newsite.py
# [ERROR] TypeError: 'NoneType' object is not iterable
# Traceback (most recent call last):
#   File "/gallery-dl/scripts/init.py", line 58, in init_extractor
#     fp.write(func(args))
#              ^^^^^^^^^^
#   File "/gallery-dl/scripts/init.py", line 88, in generate_module
#     {generate_extractors(args)}\
#      ^^^^^^^^^^^^^^^^^^^^^^^^^
#   File "/gallery-dl/scripts/init.py", line 108, in generate_extractors_basic
#     for subcat in args.subcategories:
# TypeError: 'NoneType' object is not iterable
# [INFO] gallery_dl/extractor/__init__.py
# [INFO] test/results/newsite.py
```
 2025-11-20 11:00:35 +01:00
Mike Fährmann
7b059958c2 [fansly] handle posts without accountId/contentId/attachments (#8572) 2025-11-19 20:46:34 +01:00
Mike Fährmann
e91337d5c3 [Danbooru] add 'media-asset' extractor (#8580) 2025-11-19 20:46:22 +01:00
Mike Fährmann
89be2f45e4 [mangadex] add 'data-saver' option (#8573) 2025-11-19 19:54:53 +01:00
Mike Fährmann
aa39770783 [aryion:search] simplify further 
- skip 'build_query()' step
- add underscores to prefixes
 2025-11-19 19:54:53 +01:00
MyFinalBellyache
a9687d2928 [pornstarstube] add support (#8576) 
* Add support for pornstars.tube
* update
    - adjust pattern/example/page_url
    - extract '' & '' metadata
    - prevent unnecessary request
    - fix result URLs
    - return list comprehension result
* update supportedsites
* update test results
* fix extractor name

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
 2025-11-19 16:25:01 +01:00