Commit Graph

7159 Commits

Author SHA1 Message Date
Mike Fährmann
bfee2a37aa [fansly] improve file extraction code (#4401)
- add 'format' option
- handle exceptions
2025-09-04 22:58:37 +02:00
Mike Fährmann
b64eba1f56 [fansly] update (#4401)
- fix 'list' URLs
- allow 'id:…' as creator identifier
- simplify API code
2025-09-04 21:25:34 +02:00
Mike Fährmann
a09459525b [bunkr] fix 'JSONDecodeError: Invalid \escape' (#8150)
for filenames containing an apostrophe '

https://github.com/mikf/gallery-dl/issues/8150#issuecomment-3247750189
2025-09-04 10:10:53 +02:00
Mike Fährmann
d30d42b715 [scripts/supportedsites] convert subcategories with '-' 2025-09-03 22:11:34 +02:00
Mike Fährmann
8967a6e87e [shimmie2] support 'co.llection.pics' (#8166) 2025-09-03 21:59:05 +02:00
Mike Fährmann
0fcd34d15e [fansly] implement 'list' extractor (#4401)
and add 'lists' extractor to collect your account's lists
2025-09-03 21:14:22 +02:00
Mike Fährmann
1082d99aef [fansly] implement 'home' extractor (#4401) 2025-09-03 19:52:50 +02:00
Mike Fährmann
556af306f3 [hentaifoundry:stories] fix 'src' & 'description' extraction (#8163) 2025-09-02 22:58:49 +02:00
Mike Fährmann
e2ca64a636 [fansly] add initial support (#4401)
- only posts and creator posts work
- 'home' and 'list' extractors do nothing atm
- needs 'authorization' header as 'token' config value
  to access locked content
- needs yt-dlp to download 1080p videos
2025-09-02 22:12:51 +02:00
Mike Fährmann
1c9f4ff867 [dl:ytdl] support '_ytdl_manifest_cookies' 2025-09-02 22:12:51 +02:00
Mike Fährmann
951bf7c6b9 [tumblr] update
- provide 'search_tags' metadata for tag searches (#8160)
- support '/archive/tagged/' URLs (#8160)
- use self.groups
- remove __init__ constructors & _init functions
- remove "#category" test results
2025-09-02 10:26:53 +02:00
Mike Fährmann
ff147c2a32 [tumblr] fix pagination when using 'date-max' 2025-09-02 10:24:00 +02:00
Mike Fährmann
52c932add6 [twitter] prevent "KeyError: 'name'" in '_transform_user()' (#8154)
fixes regression introduced in 5747dbf00c
2025-09-01 20:52:05 +02:00
Mike Fährmann
12a6e0493e [bunkr] fix albums with more than 100 files (#8150) 2025-08-31 15:48:27 +02:00
Mike Fährmann
70524630e4 [jpgfish] update domain to 'jpg6.su' 2025-08-31 13:04:20 +02:00
Mike Fährmann
8047aaccd5 [chevereto] add 'video' extractor (#8149) 2025-08-31 12:47:19 +02:00
Mike Fährmann
75e7dc818d [comick] detect broken chapters (#8054) 2025-08-30 23:01:54 +02:00
Mike Fährmann
92f757e981 [comick] add 'covers' extractor 2025-08-30 23:01:54 +02:00
Mike Fährmann
f3596d0bde [tests/results] support 'iso:uuid' tests 2025-08-30 23:01:54 +02:00
Mike Fährmann
38ec62691f [chevereto] fix user URLs starting with 'a' (#8149) 2025-08-30 23:01:30 +02:00
Mike Fährmann
94c72a71fa [reddit] support video embeds (#8139) 2025-08-29 20:49:11 +02:00
Mike Fährmann
38542a8bba [reddit] fix 'TypeError' when processing comments (#8139) 2025-08-29 19:57:58 +02:00
Mike Fährmann
8650a6bf39 [twitter] fix "KeyError: 'core'" when processing communities (#8141)
fixes regression introduced in 8252980264
2025-08-29 19:42:37 +02:00
Mike Fährmann
afffdbde1d [khinsider] extract 'description' metadata 2025-08-29 19:42:37 +02:00
Mike Fährmann
4a5aee6e1f [instagram] relax video quality warning regex (#8078)
https://github.com/mikf/gallery-dl/issues/8078#issuecomment-3235445551
2025-08-29 19:42:13 +02:00
Mike Fährmann
de05453707 [reddit] add 'limit' option (#7997 #8012 #8092)
change default value from 100 to null,
i.e. don't send a 'limit' parameter
2025-08-29 10:02:37 +02:00
Mike Fährmann
2eca790c87 [reddit] add 'api' option (#7997 #8012 #8092) 2025-08-28 22:52:57 +02:00
Mike Fährmann
46cfe5b77d [tungsten] fix user UUID extraction when logged in (#8061) 2025-08-28 19:28:30 +02:00
Mike Fährmann
b4e94e6d75 [tungsten] add support (#8061) 2025-08-28 18:42:43 +02:00
Mike Fährmann
d251996d8e [twitter] prevent exceptions in '_transform_community()' (#8134)
fixes regression introduced in 8252980264
2025-08-28 11:24:45 +02:00
Mike Fährmann
188824c479 [instagram] add 'stories-tray' extractor (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3230919124
2025-08-28 11:17:27 +02:00
Mike Fährmann
df158995f7 [scripts/init] add '--no-test' option 2025-08-27 21:33:56 +02:00
Mike Fährmann
82318ffc6d [scripts/init] add '--subcategory' option 2025-08-27 21:31:31 +02:00
Mike Fährmann
53f252cfb1 merge #8123: [imagebam] update cookies to bypass guard page 2025-08-26 18:11:56 +02:00
Mike Fährmann
9309204d9b [formatter] add 'R' conversion - extract URLs (#8125) 2025-08-26 16:44:22 +02:00
Mike Fährmann
a953d3d316 [erome] handle reposts on user profiles (#6582)
https://github.com/mikf/gallery-dl/issues/6582#issuecomment-3221322147

- add 'reposts' option
- disable reposts by default
- process URL query parameters, e.g. 't=posts' or 'page=3'
2025-08-26 11:26:52 +02:00
Mike Fährmann
5a5857bafb [common] prevent exception when using empty 'user-agent' (#8116)
use '"headers": {"User-Agent": ""}' to send an empty User-Agent header
2025-08-26 09:08:49 +02:00
Mike Fährmann
dadf405803 [options] add '-a' as short option for '--user-agent' 2025-08-26 07:40:55 +02:00
Benjamin VERGNAUD
8d1c79c2b2 fix(imagebam): update cookies to bypass guard page
Signed-off-by: Benjamin VERGNAUD <ben@bvergnaud.fr>
2025-08-25 23:44:57 +02:00
Mike Fährmann
84dc8116a4 [deviantart:search] fix regex (#8083)
use custom regex for extracting search results from HTML
instead of the 'deviation' pattern
2025-08-25 20:59:09 +02:00
Mike Fährmann
2c035e184b [shimmie2] compute 'base' instead of using a pre-defined value 2025-08-24 20:59:49 +02:00
Mike Fährmann
3965f5d6a5 [zerochan] expect 500 status codes during login (#8097 #8114)
continuation of 4303b3ba9d
2025-08-24 18:16:51 +02:00
Mike Fährmann
ba5c080f0b release version 1.30.5 2025-08-24 16:12:30 +02:00
Mike Fährmann
ed3ac5a402 [sizebooru] add support (#7667) 2025-08-24 10:39:17 +02:00
Mike Fährmann
aafb53db9a [shimmie2] remove 'sizechangebooru.com' (#7667) 2025-08-24 10:39:17 +02:00
Mike Fährmann
bc376d8848 [zzup] remove module (#4604)
https://github.com/mikf/gallery-dl/issues/4604#issuecomment-3184960897

now redirects to aipornpix.com
2025-08-23 19:53:07 +02:00
Mike Fährmann
ab152c1122 [scripts] add rm.py
to simplify removing extractor modules
2025-08-23 19:53:07 +02:00
Mike Fährmann
57a4b5b5b1 [scripts/util] add 'lines()' helper 2025-08-23 19:53:07 +02:00
Mike Fährmann
1787478d6b [scripts/supportedsites] add 'main()' function 2025-08-23 19:52:55 +02:00
Mike Fährmann
5f9c8ee195 [dl:ytdl] pass 'ignoreerrors' as YoutubeDL param (#8085) 2025-08-22 23:12:26 +02:00