Commit Graph

7727 Commits

Author SHA1 Message Date
Duy Nguyen
befa9b8a3e [mangatown] fix base url and simplify image extraction 2026-01-25 11:40:15 +01:00
Duy Nguyen
9f2d5cbd5d docs: add mangatown to supported sites 2026-01-25 00:04:23 +01:00
Duy Nguyen
4d8f61ad76 [mangatown] add support 2026-01-25 00:02:36 +01:00
Mike Fährmann
3836c2a99f release version 1.31.4 2026-01-24 12:01:35 +01:00
Mike Fährmann
1530778bfb merge #8917: [kaliscan] add support 2026-01-23 21:04:48 +01:00
Mike Fährmann
180b29197b [kaliscan] update/simplify 2026-01-23 20:58:34 +01:00
Duy Nguyen
5c71993e0b docs: add kaliscan to supported sites 2026-01-23 20:29:24 +01:00
Duy Nguyen
15a93795fc refactor(kaliscan): simplify code style
Remove unused variable, use ternary expressions, deduplicate strip calls.
2026-01-23 20:22:51 +01:00
Duy Nguyen
0b0bcb1640 feat(kaliscan): add extractor for kaliscan.me
Support chapter and manga extractors with metadata extraction.
2026-01-23 20:22:50 +01:00
Mike Fährmann
e93cfa3348 [twitter] implement '"ratelimit": "abort:N"' (#5251 #8864) 2026-01-23 19:54:28 +01:00
CasualYouTuber31
be9b4cf24f [tiktok] prefer "legacy" endpoint over the "newer" endpoint for user extraction (#8812 #8847) 2026-01-23 19:23:22 +01:00
CasualYouTuber31
a3d7af66a1 [tiktok] fix following extractor (#8849) 2026-01-23 19:19:27 +01:00
CasualYouTuber31
88a3153df8 [tiktok] download best quality videos (#8846)
* [tiktok] download best quality videos
* [tiktok] code formatting fix
* simplify sorting in '_extract_video_urls'
2026-01-23 19:09:53 +01:00
Mike Fährmann
f869085476 [weebdex] add 'data-saver' option (#8914) 2026-01-23 09:22:41 +01:00
Mike Fährmann
72322deaee [mangafire] generate 'vrf' tokens (#8400 #8906)
26fc9e9649
2026-01-23 09:16:58 +01:00
Mike Fährmann
396334e66e [hentainexus] improve 'rc4' performance
- & 255
- "".join()
2026-01-22 17:36:44 +01:00
Mike Fährmann
16a59140c5 [xenforo:media-album] extract 'album' metadata (#8902)
- add 'callback' argument to _pagination()
- generalize 'author' metadata collection
2026-01-22 15:04:25 +01:00
Mike Fährmann
fb0d639f68 [xenforo] add 'media-album' extractor (#8902) 2026-01-22 09:10:31 +01:00
Mike Fährmann
18fabb9605 [batoto] remove module (#8908)
"Bato.to has shut down."

There are mirror sites, but they are unscrapeable
due to heavily obfuscated HTML and JS
2026-01-21 20:33:08 +01:00
Mike Fährmann
4798ac4836 [common] implement 'parent-session' 2026-01-21 20:33:08 +01:00
Mike Fährmann
9ca45aae73 [nitter] re-add instances 2026-01-21 20:32:58 +01:00
Mike Fährmann
63df6423bf [nitter] use 'gallery-dl/<version>' User-Agent (#7045 #8130 #8409) 2026-01-21 18:07:47 +01:00
Mike Fährmann
78da7edde8 [common] add 'googlebot' User-Agent preset 2026-01-21 17:57:26 +01:00
Mike Fährmann
e2a17a58f0 [docker] build from 'python:3.14-alpine' 2026-01-21 17:32:48 +01:00
Mike Fährmann
6765f4c77e [kemono:discord] improve 'filename' parsing 2026-01-21 17:01:18 +01:00
Mike Fährmann
774d885a86 [kemono:discord] extract 'archives' metadata (#8898)
4a74bc6e30
2026-01-20 17:58:36 +01:00
Mike Fährmann
efcbde7dcd [kemono:discord] support server URLs with trailing '/' 2026-01-20 17:29:00 +01:00
Mike Fährmann
2b42766956 [turbo] add '/v/' URL test 2026-01-20 17:16:46 +01:00
Mike Fährmann
14fb95747f [scripts/generate_result] use string names for native exceptions
make use of 8a481a5126
2026-01-20 12:07:38 +01:00
brerk
e00c717b15 [turbo] update 'saint' extractors (#8893 #8896)
* Implements turbo.py & remove from domain pattern from saints.py
* Remove leftover commented pattern from saints.py
* Make turbo.py comply with flake8
* Add album support
* Improved metadata extracion for albums and single files & created turbo.py tests using saints.py test
* Align turbo.py extractor with flake8 rules
* Fix #class name on turbo.py tests
* Fix #category test
* Fix #category test x2
* Fix #category tests
* Fix #category tests
* Fix TurboMediaExtractor self.groups unpacking

* update basic module formatting
* replace 'saint' with 'turbo' in modules list
* remove saint extractors and tests
* update & simplify 'media' extractor
* update & simplify 'album' extractor
* update tests
* update supportedsites
* update 'category-map' & 'config-map'

---------

Co-authored-by: Mike Fährmann <mike_faehrmann@web.de>
2026-01-19 22:20:13 +01:00
Mike Fährmann
cc5bfa6eb0 [xenforo] support 'celebforum.to' (#8902) 2026-01-19 16:04:33 +01:00
Mike Fährmann
2f84b05ccd [xenforo] ignore "external" links starting with '#' 2026-01-19 16:04:33 +01:00
Mike Fährmann
38160c9292 [xenforo] fix using cookies for custom instances (#8902) 2026-01-19 11:26:57 +01:00
Mike Fährmann
713d59df7d [newgrounds] remove '_path' attributes
They were used to work around 'categorytransfer' changing an extractor
instance's subcategory, but the class' subcategory is constant.
2026-01-19 11:19:35 +01:00
Mike Fährmann
366b0750a8 [common] use extractor subcategory for 'notfound=True' 2026-01-19 11:19:35 +01:00
Mike Fährmann
09635352d0 [imagebam] raise 'NotFoundError' for deleted galleries 2026-01-19 11:19:35 +01:00
Mike Fährmann
8a481a5126 [tests/results] allow using exception names for '#exception' 2026-01-19 11:19:12 +01:00
Mike Fährmann
8c9ca609ea [imagebam] raise 'NotFoundError' for deleted images (#8890) 2026-01-18 21:27:27 +01:00
Mike Fährmann
8a84714372 [util] use function for HTTPBasicAuth
more lightweight and faster than a class
2026-01-18 21:13:42 +01:00
Mike Fährmann
c23beee57c [util] use functions for predicates
more lightweight and faster than classes
2026-01-18 20:32:36 +01:00
Mike Fährmann
90cd23e279 [util] use function for custom Popen
instead of an entire class with inheritance
2026-01-17 20:44:07 +01:00
Mike Fährmann
235fb25f6b [scripts/release] add more checks before committing release
- check if CHANGELOG was updated
- sync with origin/master
2026-01-17 20:40:48 +01:00
Mike Fährmann
038efda445 release version 1.31.3 2026-01-16 16:58:13 +01:00
Mike Fährmann
bce802d6c3 [xenforo:media-user] fix 'author'/'author_slug' (#8785)
https://github.com/mikf/gallery-dl/issues/8785#issuecomment-3759495156
2026-01-16 16:58:13 +01:00
AngeredBacterium
d64ca94361 [saint] support alternate turbovid domain (#8888)
* Add alternate turbovid domain
* simplify regex pattern
* add tests
2026-01-16 09:37:52 +01:00
Mike Fährmann
ea2b4427e6 [xenforo:media] use 'author_slug' in default directories (#8785)
https://github.com/mikf/gallery-dl/issues/8785#issuecomment-3757492259
2026-01-16 09:34:33 +01:00
Mike Fährmann
254bb4505c [chevereto] implement password support 2026-01-16 09:33:55 +01:00
Mike Fährmann
cc86592a32 [chevereto] unescape continuation URLs
some instances respond with redirects when using these URLs as is
2026-01-16 09:33:54 +01:00
Mike Fährmann
589c90fc37 [chevereto:user] support 'album' results 2026-01-15 16:47:45 +01:00
Mike Fährmann
d3c77cca80 [sexcom] fix 'tags' when passing cookies (#8880) 2026-01-15 11:02:03 +01:00